thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-15 19:02:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
137,460 Commits 9,326 Branches 1,783 Tags 2.1 GiB
82da2d56e9
Commit Graph

4831 Commits

Author SHA1 Message Date
Alexey Milovidov
72e3a7e86e Implement FIXME 2023-12-17 22:00:39 +01:00
Azat Khuzhin
60bf2a45e2 Fix docker image for integration tests (fixes CI) 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-12-16 21:51:39 +01:00
Alexey Milovidov
4ff0eefe23
Merge pull request #57905 from ClickHouse/thiny-builder 
Remove heavy rust stable toolchain
 2023-12-15 21:47:48 +01:00
Mikhail f. Shiryaev
55467c5cfa
Remove heavy rust stable toolchain 2023-12-15 16:35:13 +01:00
Max K
8c7add0334 Revert "improve CI with digest for docker, build and test jobs (#56317)" 
This reverts commit 7844fcc196.
 2023-12-15 15:48:01 +01:00
Nikita Mikhaylov
1780671443
ClickHouse Cloud promotion (#57638) 
Co-authored-by: Alexander Sapin <alesapin@gmail.com>
 2023-12-15 15:23:23 +01:00
Max K
7844fcc196
improve CI with digest for docker, build and test jobs (#56317) 
* CI with digests to tag docker images, reuse builds, reuse tests and others
 2023-12-15 15:21:20 +01:00
Alexey Milovidov
781ba52376 ClickBench: slightly better 2023-12-13 22:12:53 +01:00
Alexey Milovidov
0bb267cf0b
Merge pull request #57824 from ClickHouse/auto/v23.11.2.11-stable 
Update version_date.tsv and changelogs after v23.11.2.11-stable
 2023-12-13 19:54:45 +01:00
Alexey Milovidov
bf4964b177
Merge pull request #57712 from ClickHouse/clickbench-ci 
Add ClickBench to CI
 2023-12-13 19:52:44 +01:00
robot-clickhouse
30e6797c7e Update version_date.tsv and changelogs after v23.11.2.11-stable 2023-12-13 17:19:14 +00:00
Alexey Milovidov
fa7190805a A timeout 2023-12-13 17:59:55 +01:00
Igor Nikonov
c165be76ab
Parallel replicas: friendly settings (#57542) 2023-12-13 14:42:06 +01:00
Alexey Milovidov
62b6d1ef5e iMerge branch 'master' of github.com:ClickHouse/ClickHouse into clickbench-ci 2023-12-13 01:41:27 +01:00
Alexey Milovidov
9f5299e118 Use a new bucket 2023-12-13 00:11:10 +01:00
Alexey Milovidov
2043791ed7 Fix typo 2023-12-12 23:37:55 +01:00
Alexey Milovidov
d51aaddf12 Use the local region 2023-12-12 22:15:19 +01:00
Alexey Milovidov
2099130bd2 Enable text_log 2023-12-12 21:28:28 +01:00
Alexey Milovidov
4c1860b9b4 Fix a mistake 2023-12-12 21:21:58 +01:00
Alexey Milovidov
49aad9c88e Maybe better 2023-12-12 19:33:08 +01:00
Alexey Milovidov
12561c0c9b Maybe better 2023-12-12 16:42:31 +01:00
Alexey Milovidov
af4f1abadd Fix error 2023-12-12 16:41:38 +01:00
Kseniia Sumarokova
91d36ad224
Merge pull request #57076 from ClickHouse/slru-for-filesystem-cache 
Implement SLRU cache policy for filesystem cache
 2023-12-12 10:20:58 +01:00
Alexey Milovidov
9789c2caa2 Review fixes 2023-12-12 05:48:09 +01:00
Alexey Milovidov
b40e04a8be Export the logs 2023-12-12 05:04:37 +01:00
Alexey Milovidov
4240e48a5e Sending the logs better 2023-12-12 04:55:16 +01:00
Alexey Milovidov
c76ceb29fd Minor changes 2023-12-11 17:21:02 +01:00
kssenii
fc4e6d70d8 Update run.sh 2023-12-11 14:24:05 +01:00
kssenii
3652419873 Update run.sh 2023-12-11 11:01:13 +01:00
Alexey Milovidov
740ceea108 Docker 2023-12-11 03:10:17 +01:00
Alexey Milovidov
7df7793724 Docker 2023-12-10 23:53:22 +01:00
Alexey Milovidov
bb501a0e13 Shellcheck 2023-12-10 19:06:38 +01:00
Alexey Milovidov
070934afad Merge branch 'master' of github.com:ClickHouse/ClickHouse into clickbench-ci 2023-12-10 17:43:50 +01:00
Alexey Milovidov
f2875068be Style 2023-12-10 00:19:30 +01:00
Alexey Milovidov
3ac3a06561 Add ClickBench to CI 2023-12-09 23:31:05 +01:00
Alexey Milovidov
f3def573c6 Switch Fast Test to Musl 2023-12-09 21:54:09 +01:00
Alexey Milovidov
0157066fc5 Merge branch 'master' into musl-7 2023-12-09 15:19:38 +01:00
Mikhail f. Shiryaev
8bcc4b879c
Pin alpine version of integration tests helper container 2023-12-08 14:15:28 +01:00
Alexey Milovidov
15a0e6ab05 Merge branch 'master' into musl-7 2023-12-08 03:19:55 +01:00
kssenii
725571461d Merge remote-tracking branch 'origin/master' into slru-for-filesystem-cache 2023-12-07 19:49:03 +01:00
robot-clickhouse
2bd0888966 Update version_date.tsv and changelogs after v23.11.1.2711-stable 2023-12-06 23:05:48 +00:00
Mikhail f. Shiryaev
7dbe435c36
Ignore rare removal race issue "No such file or directory" 2023-12-06 15:40:43 +01:00
Alexey Milovidov
c729d06e27
Merge pull request #56078 from hanfei1991/hanfei/sqllogic 
try to work sqllogic-test out
 2023-12-05 06:37:29 +01:00
Alexey Milovidov
02439eee58
Merge pull request #49351 from ClickHouse/async-loader-integration 
Asynchronous loading of tables
 2023-12-04 17:16:12 +01:00
kssenii
fd2c9dcc1a One more fix for bugfix check 2023-12-04 11:01:09 +01:00
alesapin
e8864a94cc
Update docker/test/stateless/run.sh 2023-12-03 22:33:35 +01:00
alesapin
a5782cb56b Revert "Revert bugfix check fix attempt" 
This reverts commit dcc5ae2928.
 2023-12-03 16:04:22 +01:00
kssenii
dcc5ae2928 Revert bugfix check fix attempt 2023-12-01 20:23:39 +01:00
Kseniia Sumarokova
98eb061812
Update run.sh 2023-12-01 13:49:31 +01:00
Kseniia Sumarokova
12368d56c1
Update run.sh 2023-12-01 13:44:35 +01:00
kssenii
bdf7d0907f Fix shellcheck 2023-11-30 21:30:39 +01:00
kssenii
0e9aa9b1cd Try fix bugfix check 2023-11-30 14:14:32 +01:00
kssenii
296afceed8 Merge remote-tracking branch 'origin/master' into fix-backup-restore-with-mv 2023-11-29 18:06:09 +01:00
kssenii
122146ca0f Update config (see https://github.com/ClickHouse/ClickHouse/pull/57257\#discussion_r1406629948) 2023-11-29 13:44:49 +01:00
Han Fei
824e9ef664 Merge branch 'master' into hanfei/sqllogic 2023-11-27 15:15:35 +01:00
Alexey Milovidov
49d4a90a0e Merge branch 'master' of github.com:ClickHouse/ClickHouse into musl-7 2023-11-26 17:55:17 +01:00
Alexey Milovidov
8ec4a90cb4 Fix error 2023-11-26 17:55:13 +01:00
Alexey Milovidov
f8ebe5134d
Merge pull request #55836 from azat/dist/limit-by-fix 
RFC: Fix "Cannot find column X in source stream" for Distributed queries with LIMIT BY
 2023-11-26 04:03:41 +01:00
Alexey Milovidov
b2d8103d19 Add special build with Musl 2023-11-26 02:27:54 +01:00
robot-clickhouse
2bb12386dd Update version_date.tsv and changelogs after v23.9.6.20-stable 2023-11-25 18:37:17 +00:00
Alexey Milovidov
91cc132feb
Merge pull request #56873 from ClickHouse/memory-for-client-in-stress-and-fuzzer 
Set limit for memory usage for client in Stress tests and ASTFuzzers
 2023-11-24 23:15:27 +01:00
Alexey Milovidov
bad410c6c4
Update run-fuzzer.sh 2023-11-24 23:10:48 +03:00
Alexey Milovidov
9e72cea249
Merge pull request #57128 from azat/tests/fix-logs-artifacts 
Fix system.*_log in artifacts on CI
 2023-11-24 21:05:46 +01:00
Alexey Milovidov
851e96cd80
Merge pull request #57130 from azat/ci/no-traces-symbolize-in-debug 
Do not symbolize traces for debug/sanitizer builds for sending to cloud
 2023-11-24 21:04:43 +01:00
Mikhail f. Shiryaev
dce47b4af4
Remove long-living remainings 2023-11-24 20:23:12 +01:00
kssenii
69260e322e Randomize cache policy in ci 2023-11-23 16:57:13 +01:00
Azat Khuzhin
9b258f4b09 Do not symbolize traces for debug/sanitizer builds for sending to cloud 
debug/sanitizer builds is very slow and symbolizing can take awhile, for
example this increases the time for `system flush logs`, and likely make
`02152_http_external_tables_memory_tracking` flaky again (#53215):

    azat@s1:~/ch/tmp$ zstd -cdq clickhouse-server.log.zst | grep -a -e 2dd61ba3-5a26-4b38-8979-af82cf3ff8bd -e 75b3cbcb-1d09-44ac-a82b-317b4fabfea9 -e 75ad1065-51cc-4c94-95a2-f9dd22981edd -e dc991967-4443-458b-84f0-2646a8d32a76 | grep trace_log -A1
    2023.11.22 05:46:32.872164 [ 59150 ] {2dd61ba3-5a26-4b38-8979-af82cf3ff8bd} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 308544
    2023.11.22 05:47:23.352098 [ 59150 ] {2dd61ba3-5a26-4b38-8979-af82cf3ff8bd} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0
    --
    2023.11.22 05:47:46.158400 [ 59158 ] {75b3cbcb-1d09-44ac-a82b-317b4fabfea9} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 328185
    2023.11.22 05:48:38.392275 [ 59158 ] {75b3cbcb-1d09-44ac-a82b-317b4fabfea9} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0
    --
    2023.11.22 05:49:07.348590 [ 59150 ] {75ad1065-51cc-4c94-95a2-f9dd22981edd} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 347744
    2023.11.22 05:50:00.265529 [ 59150 ] {75ad1065-51cc-4c94-95a2-f9dd22981edd} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0
    --
    2023.11.22 05:50:25.743286 [ 59158 ] {dc991967-4443-458b-84f0-2646a8d32a76} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 367101
    2023.11.22 05:51:15.567347 [ 59158 ] {dc991967-4443-458b-84f0-2646a8d32a76} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-11-23 14:49:28 +01:00
serxa
0fc25fbda8 Merge branch 'master' into async-loader-integration 2023-11-23 09:32:43 +00:00
Azat Khuzhin
3903b4bb39 Fix system.*_log in artifacts on CI 
For now it is broken due to #53086:

    Code: 701. DB::Exception: Requested cluster 'system_logs_export' not found: Cannot attach table `system`.`query_views_log_sender` from metadata file /var/lib/clickhouse/store/c05/c05d0eb0-ac48-4b02-aea4-f05cf4f875a5/query_views_log_sender.sql from query ATTACH TABLE system.query_views_log_sender UUID 'ffd9aed6-344c-4b1b-8444-287d82c5a712' (`pull_request_number` UInt32, `commit_sha` String, `check_start_time` DateTime('UTC'), `check_name` LowCardinality(String), `instance_type` LowCardinality(String), `instance_id` String, `event_date` Date, `event_time` DateTime, `event_time_microseconds` DateTime64(6), `view_duration_ms` UInt64, `initial_query_id` String, `view_name` String, `view_uuid` UUID, `view_type` Enum8('Default' = 1, 'Materialized' = 2, 'Live' = 3, 'Window' = 4), `view_query` String, `view_target` String, `read_rows` UInt64, `read_bytes` UInt64, `written_rows` UInt64, `written_bytes` UInt64, `peak_memory_usage` Int64, `ProfileEvents` Map(String, UInt64), `status` Enum8('QueryStart' = 1, 'QueryFinish' = 2, 'ExceptionBeforeStart' = 3, 'ExceptionWhileProcessing' = 4), `exception_code` Int32, `exception` String, `stack_trace` String) ENGINE = Distributed('system_logs_export', 'default', 'query_views_log_17512133378547479980') SETTINGS flush_on_detach = 0. (CLUSTER_DOESNT_EXIST)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-11-22 21:00:51 +01:00
Kseniia Sumarokova
d384762123
Merge branch 'master' into fs-cache-improvement 2023-11-21 11:24:52 +01:00
Alexey Milovidov
3c2cf5dc70 Enable Analyzer in Stress and Fuzz tests 2023-11-20 21:52:47 +01:00
Mikhail f. Shiryaev
c3a3cf8d24
Make check for the limited cmake dependencies the part of sparse checkout 2023-11-20 13:08:49 +01:00
Igor Nikonov
b9a28028e4
Merge branch 'master' into test-rabbitmq-with-secure-connection 2023-11-19 21:33:09 +01:00
serxa
9023f61349 Merge branch 'master' into async-loader-integration 2023-11-19 13:05:58 +00:00
Alexey Milovidov
8c6ed7f28c
Merge pull request #56898 from ClickHouse/simpler-cmake 
Simpler CMake
 2023-11-18 12:26:49 +01:00
Alexey Milovidov
32b4d6ccf8
Merge pull request #56619 from ClickHouse/access-control-and-named-collections-by-default 
Enable access and named collections control by default
 2023-11-18 09:22:16 +01:00
Alexey Milovidov
283af96670 Merge branch 'master' into simpler-cmake 2023-11-17 19:02:53 +01:00
Alexey Milovidov
30bd5642e9 Merge branch 'master' into remove-useless-part-from-build 2023-11-17 19:00:09 +01:00
Alexey Milovidov
20bdec61de
Merge pull request #56914 from ClickHouse/mac-no-supply-chain-attack 
Avoid dependencies with no fixed versions
 2023-11-17 18:58:52 +01:00
Alexander Tokmakov
dd626d51cb
Fix perf tests report when there are no tests (#56881) 
* fix perf tests report when there are no tests

* Automatic style fix

* Update docker/test/performance-comparison/compare.sh

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
 2023-11-17 16:36:19 +01:00
Alexey Milovidov
7b9b790667 Merge branch 'simpler-cmake' of github.com:ClickHouse/ClickHouse into simpler-cmake 2023-11-17 15:17:45 +01:00
Raúl Marín
7074bdb3bb Merge remote-tracking branch 'blessed/master' into access-control-and-named-collections-by-default 2023-11-17 14:53:02 +01:00
Alexey Milovidov
9b9b0a0b9a Merge branch 'master' into simpler-cmake 2023-11-17 14:44:55 +01:00
Alexey Milovidov
9eb0b74167
Update Dockerfile 2023-11-17 15:54:32 +03:00
Alexey Milovidov
b42db2ec29 Update fasttest 2023-11-17 13:50:13 +01:00
Alexey Milovidov
ea3cd71225
Update Dockerfile 2023-11-17 15:42:10 +03:00
Alexey Milovidov
19dd29e8af
Update Dockerfile 2023-11-17 15:19:00 +03:00
Alexey Milovidov
215cd7b9f2
Update build.sh 2023-11-17 15:13:16 +03:00
Alexey Milovidov
2a9d05e245 Remove more lines 2023-11-17 12:59:04 +01:00
Alexey Milovidov
1d5bc13e2a Check what will happen if I remove some lines 2023-11-17 12:50:51 +01:00
Alexey Milovidov
318c7a06f9 Avoid dependencies with no fixed versions 2023-11-17 12:39:00 +01:00
robot-clickhouse
af2f06db52 Update version_date.tsv and changelogs after v23.9.5.29-stable 2023-11-17 11:12:16 +00:00
Alexey Milovidov
0548eefbb7 Simpler CMake 2023-11-17 11:35:48 +01:00
Alexey Milovidov
4f441ec131 Own CMake for Abseil 2023-11-17 11:32:27 +01:00
Alexey Milovidov
c65607484e Remove garbage 2023-11-17 10:03:10 +01:00
Alexey Milovidov
c7d8465897 Ensure no new dependencies 2023-11-17 09:12:49 +01:00
Alexey Milovidov
f73b3e10ac Ensure no new dependencies 2023-11-17 08:46:45 +01:00
Nikita Mikhaylov
427d9fff70 Set limit for memory 2023-11-16 19:13:25 +01:00
Kseniia Sumarokova
a2ed756eec
Merge branch 'master' into fs-cache-improvement 2023-11-16 17:49:26 +01:00
Igor Nikonov
b9d083e68d Merge remote-tracking branch 'origin/master' into test-rabbitmq-with-secure-connection 2023-11-16 13:05:10 +00:00
Antonio Andelic
b05a3d02ed
Merge pull request #56788 from ClickHouse/fix-keeper-random-stress 
Fix randomization of Keeper configs in stress tests
 2023-11-16 11:32:05 +01:00
Vitaly Baranov
946e02ecbc
Merge pull request #56268 from vitlibar/add-script-backup-view 
Add an external utility to view backups and to extract information from them
 2023-11-16 11:17:16 +01:00
Antonio Andelic
052134b143 Better 2023-11-16 07:32:11 +00:00
Robert Schulze
44bd0598a3
Merge pull request #56799 from slvrtrn/fix-binary-mysql-nullable-columns 
Fix incorrect nullable columns reporting in MySQL binary protocol
 2023-11-16 01:12:46 +01:00
Vitaly Baranov
21a283049c Add the test for clickhouse_backupview to CI. 2023-11-15 17:40:53 +01:00
slvrtrn
9e3ba55070 Fix incorrect nullable columns reporting in MySQL binary protocol 2023-11-15 16:53:38 +01:00
Han Fei
d9a5e4fe40 Merge branch 'master' into hanfei/sqllogic 2023-11-15 14:53:14 +01:00
Antonio Andelic
a828410993 Fix randomization of Keeper configs in stress tests 2023-11-15 12:14:48 +00:00
Igor Nikonov
07452b613a Fix certificate's file names 2023-11-14 20:36:46 +00:00
Igor Nikonov
cd909ffc48 Test RabbitMQ with secure connection 2023-11-14 20:13:09 +00:00
Mikhail f. Shiryaev
6bd44ae595
Merge pull request #56689 from ClickHouse/performance-no-submodules 
Do not fetch submodules during preparation performance archive
 2023-11-14 10:57:55 +01:00
Mikhail f. Shiryaev
ed95698ff6
Decrease unnecessary verbosity 2023-11-13 19:38:11 +01:00
Mikhail f. Shiryaev
e437d3ae58
Merge pull request #56501 from ClickHouse/reusable-tests 
Continue rewriting workflows to reusable tests
 2023-11-13 18:15:51 +01:00
Mikhail f. Shiryaev
64d5f636a2
Do not fetch submodules during preparation performance archive 2023-11-13 18:07:25 +01:00
SmitaRKulkarni
951d9ac144
Disable randomization of allow_experimental_block_number_column flag (#56474) 
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
 2023-11-13 15:44:06 +01:00
Mikhail f. Shiryaev
025c3cf37b
Trigger docs check 2023-11-13 12:49:37 +01:00
Alexey Milovidov
0279345871
Merge pull request #56634 from ClickHouse/short-names 
Introduce short names for `clickhouse-client` and `clickhouse-local`
 2023-11-12 05:27:18 +01:00
Alexey Milovidov
67e4d22c56 Fix typo 2023-11-12 03:04:47 +01:00
Alexey Milovidov
ed0e3873a3 Add a test 2023-11-12 02:45:25 +01:00
Alexey Milovidov
e207b1b14a Merge branch 'master' into access-control-and-named-collections-by-default 2023-11-12 00:56:06 +01:00
Alexey Milovidov
9f46d45066 Merge branch 'master' into symbolize-trace-log 2023-11-12 00:53:16 +01:00
Alexey Milovidov
38ca18d8e7
Merge pull request #56617 from ClickHouse/publish-stripped-binary 
Publish stripped binary
 2023-11-11 22:18:26 +01:00
Alexey Milovidov
527ca9a1fc
Merge branch 'master' into symbolize-trace-log 2023-11-11 09:38:02 +01:00
Alexey Milovidov
f2a67ae811 Addition 2023-11-11 09:24:26 +01:00
Alexey Milovidov
356ae52e9b Enable access and named collections control by default 2023-11-11 08:46:10 +01:00
Alexey Milovidov
e073eaf5ce Try LowCardinality 2023-11-11 08:23:58 +01:00
Alexey Milovidov
0064872bc7 Apply LowCardinality in more places 2023-11-11 07:46:56 +01:00
Alexey Milovidov
9824631044 Apply LowCardinality in more places 2023-11-11 07:46:35 +01:00
Alexey Milovidov
4460abafbe No idea why it did not work 2023-11-11 07:37:39 +01:00
Alexey Milovidov
629c5c0e45 Change tables version 2023-11-11 06:21:31 +01:00
Alexey Milovidov
fb0335efb0 What if I add some indices 2023-11-11 06:20:57 +01:00
Alexey Milovidov
6078ff20bb Symbolize trace_log for exporting 2023-11-11 05:52:44 +01:00
robot-clickhouse
9ac7159a93 Update version_date.tsv and changelogs after v23.10.3.5-stable 2023-11-10 21:07:22 +00:00
Antonio Andelic
e9542e4153
Merge pull request #54957 from ClickHouse/49507_Support_compression_for_keeper_protocol 
Support compression for keeper protocol
 2023-11-09 10:00:19 +01:00
robot-clickhouse
bc4de36e51 Update version_date.tsv and changelogs after v23.9.4.11-stable 2023-11-08 15:36:31 +00:00
kssenii
dbea50738b Merge remote-tracking branch 'origin/master' into fs-cache-improvement 2023-11-08 11:53:54 +01:00
serxa
19aa1375fc Merge branch 'master' into async-loader-integration 2023-11-07 10:25:38 +00:00
tomtana
12a74986af
Update README.md 2023-11-04 16:53:22 +01:00
tomtana
841934ff49
Update README.md 
Add details for the supported arm devices
 2023-11-04 16:41:08 +01:00
serxa
77dc2e63b1 randomize async_load_databases in stress tests 2023-11-03 17:15:51 +00:00
robot-clickhouse
a8aa32fd3d Update version_date.tsv and changelogs after v23.10.1.1976-stable 2023-11-02 19:34:42 +00:00
Azat Khuzhin
c25d6cd624
Rename directory monitor concept into background INSERT (#55978) 
* Limit log frequence for "Skipping send data over distributed table" message

After SYSTEM STOP DISTRIBUTED SENDS it will constantly print this
message.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename directory monitor concept into async INSERT

Rename the following query settings (with preserving backward
compatiblity, by keeping old name as an alias):
- distributed_directory_monitor_sleep_time_ms -> distributed_async_insert_sleep_time_ms
- distributed_directory_monitor_max_sleep_time_ms -> distributed_async_insert_max_sleep_time_ms
- distributed_directory_monitor_batch -> distributed_async_insert_batch_inserts
- distributed_directory_monitor_split_batch_on_failure -> distributed_async_insert_split_batch_on_failure

Rename the following table settings (with preserving backward
compatiblity, by keeping old name as an alias):
- monitor_batch_inserts -> async_insert_batch
- monitor_split_batch_on_failure -> async_insert_split_batch_on_failure
- directory_monitor_sleep_time_ms -> async_insert_sleep_time_ms
- directory_monitor_max_sleep_time_ms -> async_insert_max_sleep_time_ms

And also update all the references:

    $ gg -e directory_monitor_ -e monitor_ tests docs | cut -d: -f1 | sort -u | xargs sed -e 's/distributed_directory_monitor_sleep_time_ms/distributed_async_insert_sleep_time_ms/g' -e 's/distributed_directory_monitor_max_sleep_time_ms/distributed_async_insert_max_sleep_time_ms/g' -e 's/distributed_directory_monitor_batch_inserts/distributed_async_insert_batch/g' -e 's/distributed_directory_monitor_split_batch_on_failure/distributed_async_insert_split_batch_on_failure/g' -e 's/monitor_batch_inserts/async_insert_batch/g' -e 's/monitor_split_batch_on_failure/async_insert_split_batch_on_failure/g' -e 's/monitor_sleep_time_ms/async_insert_sleep_time_ms/g' -e 's/monitor_max_sleep_time_ms/async_insert_max_sleep_time_ms/g' -i

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename async_insert for Distributed into background_insert

This will avoid amigibuity between general async INSERT's and INSERT
into Distributed, which are indeed background, so new term express it
even better.

Mostly done with:

    $ git di HEAD^ --name-only | xargs sed -i -e 's/distributed_async_insert/distributed_background_insert/g' -e 's/async_insert_batch/background_insert_batch/g' -e 's/async_insert_split_batch_on_failure/background_insert_split_batch_on_failure/g' -e 's/async_insert_sleep_time_ms/background_insert_sleep_time_ms/g' -e 's/async_insert_max_sleep_time_ms/background_insert_max_sleep_time_ms/g'

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Mark 02417_opentelemetry_insert_on_distributed_table as long

CI: https://s3.amazonaws.com/clickhouse-test-reports/55978/7a6abb03a0b507e29e999cb7e04f246a119c6f28/stateless_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-11-01 15:09:39 +01:00
Kseniia Sumarokova
e5efc42633
Merge branch 'master' into fs-cache-improvement 2023-11-01 10:47:36 +01:00
Smita Kulkarni
3fdf0daf1b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-31 10:43:28 +01:00
robot-clickhouse
3d2e295855 Update version_date.tsv and changelogs after v23.8.5.16-lts 2023-10-31 00:58:27 +00:00
Alexey Milovidov
0152908a10
Merge pull request #56113 from ClickHouse/unit-tests-remove-trash 
Remove old trash from unit tests
 2023-10-30 20:58:52 +01:00
Raúl Marín
39195d2715
Merge pull request #56074 from Algunenano/upgrade_test_force_shutdown 
Force shutdown in upgrade test
 2023-10-30 18:36:31 +01:00
Raúl Marín
b042e2d986
Merge pull request #55713 from ClickHouse/Randomize_block_number_column_in_ci 
Randomize block_number column setting in ci
 2023-10-30 12:30:51 +01:00
Raúl Marín
8e615e05f1 Merge remote-tracking branch 'blessed/master' into upgrade_test_force_shutdown 2023-10-30 10:29:42 +01:00
Alexey Milovidov
a1ef4e7d07 Remove old trash from unit tests 2023-10-30 03:26:18 +01:00
Han Fei
a19e5fe0db increase timeout for sqllogic-test 2023-10-28 16:55:25 +02:00
Alexey Milovidov
243499aad1
Merge pull request #55796 from ClickHouse/Fix_azurite_port 
Fix azurite port issue
 2023-10-28 00:40:24 +02:00
Han Fei
6a5b1a4830 try to work sqllogic-test out 2023-10-27 15:05:37 +02:00
Smita Kulkarni
13c90c0b86 Removed unwanted file and added chanegs to stress_test 2023-10-27 14:56:25 +02:00
Raúl Marín
e93f64670b Force shutdown in upgrade test 2023-10-27 11:16:00 +02:00
Nikita Mikhaylov
f5890a5b4c
Added healthcheck for LDAP (#55571) 2023-10-27 10:53:59 +02:00
Smita Kulkarni
d1d8f4b2e1 Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-26 16:56:03 +02:00
Raúl Marín
71dfdf5bfe
Merge pull request #56009 from Algunenano/stress_cont 
Stress tests: Try to wait until server is responsive after gdb detach
 2023-10-26 11:37:49 +02:00
Raúl Marín
62088772d2 Fuzzer: Use the known pid instead of reading the file 
The file might not exists yet
 2023-10-25 16:12:18 +02:00
Azat Khuzhin
ff7e9e16d5 Fix possible performance test error 
CI [1]:

    2023-10-24 12:18:27	 ++ rg -c array_fill.xml changed-test-definitions.txt
    2023-10-24 12:18:27	 + '[' '' -gt 0 ']'
    2023-10-24 12:18:27	 right/scripts/compare.sh: line 288: [: : integer expression expected

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/55944/da408df4a7296835897d7cef80d63f252df79b75/performance_comparison_[2_4]/compare.log

v1: use --include-zero
v2: revert to grep
v3: check exit code
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-24 13:51:57 +02:00
Smita Kulkarni
7b1c0c471c Merge branch 'master' into Fix_azurite_port 2023-10-23 22:13:56 +02:00
Smita Kulkarni
cd7c1d1f8c Updated to enable allow_experimental_block_numner_column for stress tests only 2023-10-23 16:59:12 +02:00
Smita Kulkarni
c98782bd2b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-20 14:47:17 +02:00
Azat Khuzhin
8609125f7a fuzzer/generate-test-j2: export missing product function 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-20 12:21:05 +02:00
robot-clickhouse
84f2d46642 Update version_date.tsv and changelogs after v23.3.14.78-lts 2023-10-19 18:18:34 +00:00
Smita Kulkarni
af5349f76b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-19 12:03:40 +02:00
Smita Kulkarni
c39ca0b549 Fixed clang-tidy and updated to randomize compression for stress test 2023-10-19 11:59:22 +02:00
kssenii
89272e0925 Fix upgrade check, randomize more settings 2023-10-19 11:23:56 +02:00
Alexey Milovidov
7cd10e1c4b
Merge pull request #55780 from ClickHouse/correct-grep-fuzzer 
Correctly grep fuzzer.log
 2023-10-19 05:50:38 +02:00
Smita Kulkarni
9d6cd0e9a2 Upadted to get free port for azurite 2023-10-18 22:20:39 +02:00
Mikhail f. Shiryaev
224edf26fe
Merge branch 'master' into speedup-images-enrich 2023-10-18 19:05:28 +02:00
Mikhail f. Shiryaev
8935c6ce5d
Merge pull request #55717 from ClickHouse/tune-dockerfiles 
Improve Dockerfiles for keeper and server images
 2023-10-18 19:04:27 +02:00
Mikhail f. Shiryaev
e4e1aac154
Move comment about created user to a proper place 2023-10-18 14:20:21 +02:00
Mikhail f. Shiryaev
8b49a94713
Check sha512 sums for alpine server and keeper images 2023-10-18 14:20:20 +02:00
Mikhail f. Shiryaev
726c370d08
Replace temporary REPORITORY url by a proper one 2023-10-18 14:20:11 +02:00
Antonio Andelic
2eabb260a7 Correctly grep fuzzer.log 2023-10-18 12:09:22 +00:00
Antonio Andelic
70d366a8eb Control feature flag randomization with env 2023-10-18 07:59:49 +00:00
Mikhail f. Shiryaev
4848baf302
Adjust performance artifacts prepare to the filtered checkout 2023-10-18 00:01:38 +02:00
Michael Kolupaev
ce7eca0615
DWARF input format (#55450) 
* Add ReadBufferFromFileBase::isRegularLocalFile()

* DWARF input format

* Review comments

* Changed things around ENABLE_EMBEDDED_COMPILER build setting

* Added 'ranges' column

* no-msan no-ubsan
 2023-10-16 17:00:07 -07:00
Mikhail f. Shiryaev
a4fb143413
Merge pull request #50724 from AlexNik/docker-initialization-once 
Initialization of the database only once in Docker.
 2023-10-16 13:12:17 +02:00
Han Fei
0167b76e98 fix structure does not match logs again 2023-10-14 16:01:32 +02:00
Han Fei
e3ceca06e0 cast extra column expression pull_request_number to Int32 2023-10-13 14:52:25 +02:00
Han Fei
54fb9a836e
Merge pull request #55503 from hanfei1991/hanfei/fix-export-logs-structure-mismatch 
fix lots of 'Structure does not match' warnings in ci
 2023-10-12 16:15:00 +02:00
Han Fei
9ab9075c2b update again 2023-10-12 13:59:33 +02:00
Han Fei
360ec55c7a update table ash 2023-10-11 23:30:38 +02:00
Han Fei
03d139764c fix lots of 'Structure does not match' warnings in ci 2023-10-11 15:54:42 +02:00
slvrtrn
76da9cf780 Remove old Java client tests 
Revert Java client docker image JDK bump (no AArch64 available)
 2023-10-10 20:35:51 +02:00
slvrtrn
e06d3ca1a5 Fix MySQL text protocol DateTime 
Introduce `removeLowCardinalityAndNullable` function
Fix incorrect removeLowCar/removeNullable usages
Add more MySQL text protocol tests
Deprecate old Java client tests
Use JDK 17 for test MySQL Java container
 2023-10-10 19:51:09 +02:00
Mikhail f. Shiryaev
3ed7cffbb4
Merge branch 'master' into docker-initialization-once 2023-10-10 13:40:05 +02:00
Yatsishin Ilya
686c3b458d Updated RabbitMQ image and fixed log retrieval in failed tests. 2023-10-09 18:39:39 +00:00
Azat Khuzhin
ce9cdc408c Upgrade MinIO to support accepting non signed requests 
During fixing one issue with multiple reads of input files while sending
them to S3 this had been pops up.

The problem is in this place [1].

  [1]: 200caab82b/cmd/object-handlers.go (L1573-L1591)

And this had been added only in [2].

  [2]: https://github.com/minio/minio/pull/16484

But even this implementation is not complete, since it does not
correctly support STREAMING-UNSIGNED-PAYLOAD-TRAILER, but this will be
the first step, to see if there are still problems with newer MinIO.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-08 07:30:13 +02:00
Alexey Milovidov
b38d4b5b0f
Merge pull request #55119 from jmaicher/fix/54318/deadlock-ldap-role-update 
Fix deadlock in LDAP assigned role update
 2023-10-08 00:38:10 +02:00
Ilya Yatsishin
262373c9ef
Merge pull request #51435 from qoega/sources-with-subs 
Build artifact with sources with submodules in Darwin special build
 2023-10-07 11:07:27 +02:00
Mikhail f. Shiryaev
f525f05598 Merge remote-tracking branch 'origin/master' into sources-with-subs 2023-10-03 14:42:24 +02:00
Alexey Milovidov
9200b121ac
Merge pull request #55189 from ClickHouse/remove-meilisearch 
Remove Meilisearch
 2023-10-01 01:57:04 +03:00
Alexey Milovidov
6c408c7867
Merge pull request #55071 from ClickHouse/nikitamikhaylov-patch-1 
Use `source` instead of `bash` for pre-build script
 2023-09-30 08:58:27 +03:00
Julian Maicher
19f8f365b2 test: Add IT that reproduces deadlock 2023-09-30 07:03:25 +02:00
Alexey Milovidov
5ebd8ef41d Remove Meilisearch 2023-09-30 06:02:38 +02:00
Kseniia Sumarokova
0b71fd0050
Merge pull request #55002 from kssenii/fix-broken-test 
Fix broken test
 2023-09-29 11:13:31 +02:00
robot-clickhouse
485422328d Update version_date.tsv and changelogs after v23.9.1.1854-stable 2023-09-29 07:04:45 +00:00
Yatsishin Ilya
a78311bd8c Fix typo in packager when ccache is used 2023-09-28 14:40:13 +00:00
Nikita Mikhaylov
1f78755da2
Update build.sh 2023-09-28 11:47:23 +02:00
Mikhail f. Shiryaev
f19c172c5e
Move to parsing json reports of google test 2023-09-28 09:39:56 +02:00
Kseniia Sumarokova
f5cc191cce
Update run.sh 2023-09-28 01:05:35 +02:00
Nikita Mikhaylov
5753c3e72f
bash -> source 2023-09-28 00:48:17 +02:00
Nikita Mikhaylov
8ac88645c8
Use different names for variables inside build.sh (#55067) 
* Better

* Even better
 2023-09-27 20:50:19 +02:00
Nikita Mikhaylov
02ac8d56ef
Fix prebuild scripts one more time (#55059) 
* Better

* Update build.sh

I made it a little bit shorter. 
The main value here that you changed negative condition with positive one. That excludes the cases when some error occur in condition. Since some error during calculation a predicate does not mean that predicate is false logically. It means predicate is just failed. Bash is hard in distinguishing such cases.

* Update build.sh

---------

Co-authored-by: Sema Checherinda <104093494+CheSema@users.noreply.github.com>
 2023-09-27 17:10:02 +02:00
kssenii
1f13e3ac92 Fix database replicated tests using the same paths for filesystem cache 2023-09-27 11:43:30 +02:00
Nikita Mikhaylov
f0b570d0c3
Fix pre-build scripts for old branches (#55032) 2023-09-26 21:59:51 +02:00
Antonio Andelic
e7c8363f6f
Merge pull request #48855 from ClickHouse/keeper-operation-create-if-not-exists 
Implement `createIfNotExists` in Keeper natively
 2023-09-26 16:04:51 +02:00
Nikita Mikhaylov
aff486dac1
Additional scripts for packager (#55000) 2023-09-26 15:59:57 +02:00
Antonio Andelic
ce583cb7fe Fix upgrade tests 2023-09-25 13:21:37 +00:00
Antonio Andelic
176baa6695 Merge branch 'master' into keeper-operation-create-if-not-exists 2023-09-22 13:47:30 +00:00
Antonio Andelic
3dbb6dcf4e Better 2023-09-22 13:47:28 +00:00
Robert Schulze
5209bd2d51
Merge remote-tracking branch 'rschu1ze/master' into clang-17 2023-09-21 14:45:55 +00:00
Mikhail f. Shiryaev
6acdd65c8e
Launch fast tests as the current user 2023-09-20 22:32:19 +02:00
Mikhail f. Shiryaev
16fc2739c6
Use xargs to parallel submodules 2023-09-20 19:09:06 +02:00
Mikhail f. Shiryaev
dd7096bc59
Speed up fast tests a little bit 2023-09-20 19:09:06 +02:00
Robert Schulze
cbcff6ef08
Merge remote-tracking branch 'rschu1ze/master' into clang-17 2023-09-20 09:15:58 +00:00
Mikhail f. Shiryaev
4882b99715
Merge pull request #54310 from ClickHouse/ci-libfuzzer-integration 
CI: libFuzzer integration
 2023-09-20 10:01:39 +02:00
Yakov Olkhovskiy
b1b49f430a review suggestions 2023-09-19 15:32:58 +00:00
Robert Schulze
d31a43a379
Remove Woboq 2023-09-18 17:44:04 +00:00
Robert Schulze
3a3a00f95e
Bump minimal required compiler to Clang 16 2023-09-18 17:44:04 +00:00
Yakov Olkhovskiy
dd6f12dd94 review suggestions 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
3a14bde95a cleanup, fix tee to escape non-decodable symbols 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
cd0c775355 review suggestions 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
d80ae88060 run docker 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
eb3a7caa74 add zip to build docker 2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
0847889db6 libFuzzer infrastructure 2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
b7a17bf8dd add libFuzzer tests, initial integration 2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
46fa7dbb80 add libFuzzer build on 'libFuzzer' label, build produces artifacts 2023-09-17 16:28:50 +00:00
Mikhail f. Shiryaev
850a6c99bf
Merge pull request #54675 from ClickHouse/disable-apk-packages 
Do not build and upload apk packages, nobody uses them
 2023-09-15 18:20:19 +02:00
Mikhail f. Shiryaev
c6e531ab27
Do not build and upload apk packages, nobody uses them 2023-09-15 16:48:45 +02:00
avogar
d5889c8cc8 Move all tests/ci/*.lib files to stateless-tests image 2023-09-15 11:27:09 +00:00
Kruglov Pavel
8d01137d73
Merge pull request #54498 from bakam412/bugfix/local_multiquery_parameter 
Bugfix/local multiquery parameter
 2023-09-15 11:46:08 +02:00
Robert Schulze
a9ae813db0
Merge pull request #54115 from slvrtrn/simplified-prepared-statements-for-mysql 
Implement the MySQL binary protocol implementation for initial support of Tableau Online
 2023-09-14 12:27:11 +02:00
bakam412
c5c3833a80 fix tests 2023-09-14 11:12:44 +08:00
slvrtrn
44e1f6b53d Fix LowCardinality/Nullable columns issues 2023-09-13 23:40:31 +02:00
slvrtrn
dddea9219a Address the review comments 2023-09-12 18:39:03 +02:00
slvrtrn
611a75a87f Merge remote-tracking branch 'origin' into simplified-prepared-statements-for-mysql 2023-09-12 10:38:44 +02:00
Antonio Andelic
479ae52f9c Merge branch 'master' into keeper-batch-flushes 2023-09-11 11:36:23 +00:00
robot-clickhouse-ci-2
47c0f8c99f
Merge pull request #54179 from joelynch/http-query-timing 
Add elapsed_ns to HTTP headers X-ClickHouse-Progress and X-ClickHouse-Summary
 2023-09-11 06:18:47 +02:00
Joe Lynch
eed11c36a4
Add jq to fasttest container 2023-09-10 23:11:24 +02:00
Alexey Milovidov
aac645efdc
Merge pull request #54469 from ClickHouse/ci-instance-type 
Add `instance_type` column to CI Logs and the `checks` table
 2023-09-09 19:21:57 +03:00
Alexey Milovidov
0728df37e6 Add instance_type column to CI Logs and the checks table 2023-09-09 01:44:14 +02:00
Joe Lynch
a5b508d6c5
Fix json in header 2023-09-07 14:59:33 +02:00
Antonio Andelic
824b90f754 Merge branch 'master' into keeper-batch-flushes 2023-09-06 13:29:35 +00:00
Mikhail Koviazin
f98007a4ed
Replace Turbo-Base64 with aklomp/base64 
Closes #31643
 2023-09-06 13:01:38 +00:00
Alexey Milovidov
12ff2d7cb1
Merge pull request #52721 from azat/musl-7 
Fix calculating stack size under musl for the main thread
 2023-09-05 18:37:40 +03:00
Alexander Tokmakov
735f543aeb
Follow-up to #54198 (#54246) 
* Update run.sh

* Update run.sh
 2023-09-05 14:55:41 +02:00