Commit Graph

4776 Commits

Author SHA1 Message Date
Alexey Milovidov
bf2e574857 Symbolization 2024-01-15 00:48:47 +01:00
Alexey Milovidov
97200e2c5d Symbolization 2024-01-15 00:46:01 +01:00
Alexey Milovidov
7662628393 Export coverage to the CI database 2024-01-15 00:41:14 +01:00
Alexey Milovidov
e43be2f3b0 Support stress test 2024-01-14 08:18:03 +01:00
Alexey Milovidov
6f6ec9705e Fix error 2024-01-14 05:18:12 +01:00
Alexey Milovidov
66d2353851 Revert "Fix Docker"
This reverts commit 6955574c4c.
2024-01-14 05:17:01 +01:00
Alexey Milovidov
cb73be8757 Merge branch 'enable-coverage-for-debug-build' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-01-14 05:15:08 +01:00
Alexey Milovidov
6405decbb0 Fix Python 2024-01-14 05:14:54 +01:00
Alexey Milovidov
564a9f0d6c Fix bash 2024-01-14 04:11:31 +01:00
robot-clickhouse
0219d58d92 Automatic style fix 2024-01-14 02:56:50 +00:00
Alexey Milovidov
1afc5e8c01 Enable coverage for debug build 2024-01-14 03:45:42 +01:00
Alexey Milovidov
dc76cb5beb Fix error 2024-01-14 03:25:42 +01:00
Alexey Milovidov
6955574c4c Fix Docker 2024-01-14 00:02:13 +01:00
Alexey Milovidov
7ca8ea9d23 Simplify stateful tests 2024-01-13 23:53:01 +01:00
Kruglov Pavel
8d7c24aa5a Install pyarrow in stateless tests 2024-01-12 13:06:51 +00:00
Kseniia Sumarokova
c211b3bb84
Update configs 2024-01-11 15:53:35 +01:00
Sema Checherinda
e7d33756fa fix a typo 2024-01-10 15:48:02 +01:00
Alexey Milovidov
47ada9440e
Merge pull request #58583 from Eyal-Shalev/patch-1
Support CLICKHOUSE_PASSWORD_FILE environment variable in Dockerfile
2024-01-10 00:43:29 +01:00
Sema Checherinda
6dbf7c967c
Merge pull request #57663 from ClickHouse/CheSema-remote-blobs-naming-2
generate object storage key by template
2024-01-09 13:26:56 +01:00
avogar
070a27fa44 better 2024-01-08 22:16:07 +00:00
Kruglov Pavel
66abfee982
Make better 2024-01-08 19:15:54 +01:00
avogar
76a512f210 Fix query 2024-01-08 14:07:55 +00:00
avogar
3165041f70 Fix 2024-01-08 14:07:07 +00:00
avogar
fe73431506 Move settings changes check to upgrade check 2024-01-08 14:06:38 +00:00
Eyal Halpern Shalev
14a869e518
Support CLICKHOUSE_PASSWORD_FILE environment variable in Dockerfile
Implement #58575
2024-01-07 21:10:57 +02:00
Kruglov Pavel
112a197593
Update images.json 2024-01-05 19:42:16 +01:00
avogar
7f8a8ce2d3 Fix typo 2024-01-05 16:46:19 +00:00
avogar
1d630e9a44 Set rebuild PR 2024-01-05 16:45:22 +00:00
avogar
778f2d0632 Add settings changes check to CI 2024-01-05 16:43:54 +00:00
robot-clickhouse
5b9cc914db Update version_date.tsv and changelogs after v23.8.9.54-lts 2024-01-05 14:11:11 +00:00
Sema Checherinda
c59a72b987 fix special build, add randomization to stateless tests 2024-01-05 13:42:30 +00:00
Sema Checherinda
8ab4aa3423 enable randomization setting 2024-01-05 13:42:30 +00:00
Max Kainov
82d3d57053 Sync content of the docker test images 2024-01-04 12:45:17 +00:00
Blargian
58cdda5265 updated docker/packager/README.md to use clang-17 and not clang-14 as required by packager python script 2023-12-30 22:04:45 +01:00
robot-clickhouse
27657a3eb6 Update version_date.tsv and changelogs after v23.12.1.1368-stable 2023-12-28 10:32:09 +00:00
Alexey Milovidov
dcc1f0c428
Merge pull request #58168 from ClickHouse/udpate-statefull-run-sh
Update docker/test/stateful/run.sh
2023-12-23 01:40:53 +01:00
Alexander Tokmakov
555128aed6
Merge pull request #58078 from ClickHouse/tavplubix-patch-9
Fix Tests Bugfix Validate Check
2023-12-22 20:01:50 +01:00
kssenii
1e19d84811 Update stateful/run.sh 2023-12-22 18:43:29 +01:00
Mikhail f. Shiryaev
4a04a1316f
Add a tag processing for python-bottle 2023-12-21 16:11:54 +01:00
robot-clickhouse
547050d41b Update version_date.tsv and changelogs after v23.11.3.23-stable 2023-12-21 08:44:28 +00:00
Alexander Tokmakov
961cb894b5
Update run.sh 2023-12-20 16:56:39 +01:00
Sema Checherinda
b4fec61814 fix style and black 2023-12-19 13:43:35 +01:00
Sema Checherinda
939d602c3c fix typo 2023-12-18 19:30:05 +01:00
Sema Checherinda
a12fe7473c add killed by timeout message 2023-12-18 18:08:57 +01:00
Max K
84e5870b71
Reapply "improve CI with digest for docker, build and test jobs" (#57904)
* Revert "Revert "improve CI with digest for docker, build and test jobs""

* fix: docker manifest merge for missing images only
2023-12-18 09:07:22 +01:00
Alexey Milovidov
72e3a7e86e Implement FIXME 2023-12-17 22:00:39 +01:00
Azat Khuzhin
60bf2a45e2 Fix docker image for integration tests (fixes CI)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-16 21:51:39 +01:00
Alexey Milovidov
4ff0eefe23
Merge pull request #57905 from ClickHouse/thiny-builder
Remove heavy rust stable toolchain
2023-12-15 21:47:48 +01:00
Mikhail f. Shiryaev
55467c5cfa
Remove heavy rust stable toolchain 2023-12-15 16:35:13 +01:00
Max K
8c7add0334 Revert "improve CI with digest for docker, build and test jobs (#56317)"
This reverts commit 7844fcc196.
2023-12-15 15:48:01 +01:00
Nikita Mikhaylov
1780671443
ClickHouse Cloud promotion (#57638)
Co-authored-by: Alexander Sapin <alesapin@gmail.com>
2023-12-15 15:23:23 +01:00
Max K
7844fcc196
improve CI with digest for docker, build and test jobs (#56317)
* CI with digests to tag docker images, reuse builds, reuse tests and others
2023-12-15 15:21:20 +01:00
Alexey Milovidov
781ba52376 ClickBench: slightly better 2023-12-13 22:12:53 +01:00
Alexey Milovidov
0bb267cf0b
Merge pull request #57824 from ClickHouse/auto/v23.11.2.11-stable
Update version_date.tsv and changelogs after v23.11.2.11-stable
2023-12-13 19:54:45 +01:00
Alexey Milovidov
bf4964b177
Merge pull request #57712 from ClickHouse/clickbench-ci
Add ClickBench to CI
2023-12-13 19:52:44 +01:00
robot-clickhouse
30e6797c7e Update version_date.tsv and changelogs after v23.11.2.11-stable 2023-12-13 17:19:14 +00:00
Alexey Milovidov
fa7190805a A timeout 2023-12-13 17:59:55 +01:00
Igor Nikonov
c165be76ab
Parallel replicas: friendly settings (#57542) 2023-12-13 14:42:06 +01:00
Alexey Milovidov
62b6d1ef5e iMerge branch 'master' of github.com:ClickHouse/ClickHouse into clickbench-ci 2023-12-13 01:41:27 +01:00
Alexey Milovidov
9f5299e118 Use a new bucket 2023-12-13 00:11:10 +01:00
Alexey Milovidov
2043791ed7 Fix typo 2023-12-12 23:37:55 +01:00
Alexey Milovidov
d51aaddf12 Use the local region 2023-12-12 22:15:19 +01:00
Alexey Milovidov
2099130bd2 Enable text_log 2023-12-12 21:28:28 +01:00
Alexey Milovidov
4c1860b9b4 Fix a mistake 2023-12-12 21:21:58 +01:00
Alexey Milovidov
49aad9c88e Maybe better 2023-12-12 19:33:08 +01:00
Alexey Milovidov
12561c0c9b Maybe better 2023-12-12 16:42:31 +01:00
Alexey Milovidov
af4f1abadd Fix error 2023-12-12 16:41:38 +01:00
Kseniia Sumarokova
91d36ad224
Merge pull request #57076 from ClickHouse/slru-for-filesystem-cache
Implement SLRU cache policy for filesystem cache
2023-12-12 10:20:58 +01:00
Alexey Milovidov
9789c2caa2 Review fixes 2023-12-12 05:48:09 +01:00
Alexey Milovidov
b40e04a8be Export the logs 2023-12-12 05:04:37 +01:00
Alexey Milovidov
4240e48a5e Sending the logs better 2023-12-12 04:55:16 +01:00
Alexey Milovidov
c76ceb29fd Minor changes 2023-12-11 17:21:02 +01:00
kssenii
fc4e6d70d8 Update run.sh 2023-12-11 14:24:05 +01:00
kssenii
3652419873 Update run.sh 2023-12-11 11:01:13 +01:00
Alexey Milovidov
740ceea108 Docker 2023-12-11 03:10:17 +01:00
Alexey Milovidov
7df7793724 Docker 2023-12-10 23:53:22 +01:00
Alexey Milovidov
bb501a0e13 Shellcheck 2023-12-10 19:06:38 +01:00
Alexey Milovidov
070934afad Merge branch 'master' of github.com:ClickHouse/ClickHouse into clickbench-ci 2023-12-10 17:43:50 +01:00
Alexey Milovidov
f2875068be Style 2023-12-10 00:19:30 +01:00
Alexey Milovidov
3ac3a06561 Add ClickBench to CI 2023-12-09 23:31:05 +01:00
Alexey Milovidov
f3def573c6 Switch Fast Test to Musl 2023-12-09 21:54:09 +01:00
Alexey Milovidov
0157066fc5 Merge branch 'master' into musl-7 2023-12-09 15:19:38 +01:00
Mikhail f. Shiryaev
8bcc4b879c
Pin alpine version of integration tests helper container 2023-12-08 14:15:28 +01:00
Alexey Milovidov
15a0e6ab05 Merge branch 'master' into musl-7 2023-12-08 03:19:55 +01:00
kssenii
725571461d Merge remote-tracking branch 'origin/master' into slru-for-filesystem-cache 2023-12-07 19:49:03 +01:00
robot-clickhouse
2bd0888966 Update version_date.tsv and changelogs after v23.11.1.2711-stable 2023-12-06 23:05:48 +00:00
Mikhail f. Shiryaev
7dbe435c36
Ignore rare removal race issue "No such file or directory" 2023-12-06 15:40:43 +01:00
Alexey Milovidov
c729d06e27
Merge pull request #56078 from hanfei1991/hanfei/sqllogic
try to work sqllogic-test out
2023-12-05 06:37:29 +01:00
Alexey Milovidov
02439eee58
Merge pull request #49351 from ClickHouse/async-loader-integration
Asynchronous loading of tables
2023-12-04 17:16:12 +01:00
kssenii
fd2c9dcc1a One more fix for bugfix check 2023-12-04 11:01:09 +01:00
alesapin
e8864a94cc
Update docker/test/stateless/run.sh 2023-12-03 22:33:35 +01:00
alesapin
a5782cb56b Revert "Revert bugfix check fix attempt"
This reverts commit dcc5ae2928.
2023-12-03 16:04:22 +01:00
kssenii
dcc5ae2928 Revert bugfix check fix attempt 2023-12-01 20:23:39 +01:00
Kseniia Sumarokova
98eb061812
Update run.sh 2023-12-01 13:49:31 +01:00
Kseniia Sumarokova
12368d56c1
Update run.sh 2023-12-01 13:44:35 +01:00
kssenii
bdf7d0907f Fix shellcheck 2023-11-30 21:30:39 +01:00
kssenii
0e9aa9b1cd Try fix bugfix check 2023-11-30 14:14:32 +01:00
kssenii
296afceed8 Merge remote-tracking branch 'origin/master' into fix-backup-restore-with-mv 2023-11-29 18:06:09 +01:00
kssenii
122146ca0f Update config (see https://github.com/ClickHouse/ClickHouse/pull/57257\#discussion_r1406629948) 2023-11-29 13:44:49 +01:00
Han Fei
824e9ef664 Merge branch 'master' into hanfei/sqllogic 2023-11-27 15:15:35 +01:00
Alexey Milovidov
49d4a90a0e Merge branch 'master' of github.com:ClickHouse/ClickHouse into musl-7 2023-11-26 17:55:17 +01:00
Alexey Milovidov
8ec4a90cb4 Fix error 2023-11-26 17:55:13 +01:00
Alexey Milovidov
f8ebe5134d
Merge pull request #55836 from azat/dist/limit-by-fix
RFC: Fix "Cannot find column X in source stream" for Distributed queries with LIMIT BY
2023-11-26 04:03:41 +01:00
Alexey Milovidov
b2d8103d19 Add special build with Musl 2023-11-26 02:27:54 +01:00
robot-clickhouse
2bb12386dd Update version_date.tsv and changelogs after v23.9.6.20-stable 2023-11-25 18:37:17 +00:00
Alexey Milovidov
91cc132feb
Merge pull request #56873 from ClickHouse/memory-for-client-in-stress-and-fuzzer
Set limit for memory usage for client in Stress tests and ASTFuzzers
2023-11-24 23:15:27 +01:00
Alexey Milovidov
bad410c6c4
Update run-fuzzer.sh 2023-11-24 23:10:48 +03:00
Alexey Milovidov
9e72cea249
Merge pull request #57128 from azat/tests/fix-logs-artifacts
Fix system.*_log in artifacts on CI
2023-11-24 21:05:46 +01:00
Alexey Milovidov
851e96cd80
Merge pull request #57130 from azat/ci/no-traces-symbolize-in-debug
Do not symbolize traces for debug/sanitizer builds for sending to cloud
2023-11-24 21:04:43 +01:00
Mikhail f. Shiryaev
dce47b4af4
Remove long-living remainings 2023-11-24 20:23:12 +01:00
kssenii
69260e322e Randomize cache policy in ci 2023-11-23 16:57:13 +01:00
Azat Khuzhin
9b258f4b09 Do not symbolize traces for debug/sanitizer builds for sending to cloud
debug/sanitizer builds is very slow and symbolizing can take awhile, for
example this increases the time for `system flush logs`, and likely make
`02152_http_external_tables_memory_tracking` flaky again (#53215):

    azat@s1:~/ch/tmp$ zstd -cdq clickhouse-server.log.zst | grep -a -e 2dd61ba3-5a26-4b38-8979-af82cf3ff8bd -e 75b3cbcb-1d09-44ac-a82b-317b4fabfea9 -e 75ad1065-51cc-4c94-95a2-f9dd22981edd -e dc991967-4443-458b-84f0-2646a8d32a76 | grep trace_log -A1
    2023.11.22 05:46:32.872164 [ 59150 ] {2dd61ba3-5a26-4b38-8979-af82cf3ff8bd} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 308544
    2023.11.22 05:47:23.352098 [ 59150 ] {2dd61ba3-5a26-4b38-8979-af82cf3ff8bd} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0
    --
    2023.11.22 05:47:46.158400 [ 59158 ] {75b3cbcb-1d09-44ac-a82b-317b4fabfea9} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 328185
    2023.11.22 05:48:38.392275 [ 59158 ] {75b3cbcb-1d09-44ac-a82b-317b4fabfea9} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0
    --
    2023.11.22 05:49:07.348590 [ 59150 ] {75ad1065-51cc-4c94-95a2-f9dd22981edd} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 347744
    2023.11.22 05:50:00.265529 [ 59150 ] {75ad1065-51cc-4c94-95a2-f9dd22981edd} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0
    --
    2023.11.22 05:50:25.743286 [ 59158 ] {dc991967-4443-458b-84f0-2646a8d32a76} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 367101
    2023.11.22 05:51:15.567347 [ 59158 ] {dc991967-4443-458b-84f0-2646a8d32a76} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-23 14:49:28 +01:00
serxa
0fc25fbda8 Merge branch 'master' into async-loader-integration 2023-11-23 09:32:43 +00:00
Azat Khuzhin
3903b4bb39 Fix system.*_log in artifacts on CI
For now it is broken due to #53086:

    Code: 701. DB::Exception: Requested cluster 'system_logs_export' not found: Cannot attach table `system`.`query_views_log_sender` from metadata file /var/lib/clickhouse/store/c05/c05d0eb0-ac48-4b02-aea4-f05cf4f875a5/query_views_log_sender.sql from query ATTACH TABLE system.query_views_log_sender UUID 'ffd9aed6-344c-4b1b-8444-287d82c5a712' (`pull_request_number` UInt32, `commit_sha` String, `check_start_time` DateTime('UTC'), `check_name` LowCardinality(String), `instance_type` LowCardinality(String), `instance_id` String, `event_date` Date, `event_time` DateTime, `event_time_microseconds` DateTime64(6), `view_duration_ms` UInt64, `initial_query_id` String, `view_name` String, `view_uuid` UUID, `view_type` Enum8('Default' = 1, 'Materialized' = 2, 'Live' = 3, 'Window' = 4), `view_query` String, `view_target` String, `read_rows` UInt64, `read_bytes` UInt64, `written_rows` UInt64, `written_bytes` UInt64, `peak_memory_usage` Int64, `ProfileEvents` Map(String, UInt64), `status` Enum8('QueryStart' = 1, 'QueryFinish' = 2, 'ExceptionBeforeStart' = 3, 'ExceptionWhileProcessing' = 4), `exception_code` Int32, `exception` String, `stack_trace` String) ENGINE = Distributed('system_logs_export', 'default', 'query_views_log_17512133378547479980') SETTINGS flush_on_detach = 0. (CLUSTER_DOESNT_EXIST)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-22 21:00:51 +01:00
Kseniia Sumarokova
d384762123
Merge branch 'master' into fs-cache-improvement 2023-11-21 11:24:52 +01:00
Alexey Milovidov
3c2cf5dc70 Enable Analyzer in Stress and Fuzz tests 2023-11-20 21:52:47 +01:00
Mikhail f. Shiryaev
c3a3cf8d24
Make check for the limited cmake dependencies the part of sparse checkout 2023-11-20 13:08:49 +01:00
Igor Nikonov
b9a28028e4
Merge branch 'master' into test-rabbitmq-with-secure-connection 2023-11-19 21:33:09 +01:00
serxa
9023f61349 Merge branch 'master' into async-loader-integration 2023-11-19 13:05:58 +00:00
Alexey Milovidov
8c6ed7f28c
Merge pull request #56898 from ClickHouse/simpler-cmake
Simpler CMake
2023-11-18 12:26:49 +01:00
Alexey Milovidov
32b4d6ccf8
Merge pull request #56619 from ClickHouse/access-control-and-named-collections-by-default
Enable access and named collections control by default
2023-11-18 09:22:16 +01:00
Alexey Milovidov
283af96670 Merge branch 'master' into simpler-cmake 2023-11-17 19:02:53 +01:00
Alexey Milovidov
30bd5642e9 Merge branch 'master' into remove-useless-part-from-build 2023-11-17 19:00:09 +01:00
Alexey Milovidov
20bdec61de
Merge pull request #56914 from ClickHouse/mac-no-supply-chain-attack
Avoid dependencies with no fixed versions
2023-11-17 18:58:52 +01:00
Alexander Tokmakov
dd626d51cb
Fix perf tests report when there are no tests (#56881)
* fix perf tests report when there are no tests

* Automatic style fix

* Update docker/test/performance-comparison/compare.sh

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2023-11-17 16:36:19 +01:00
Alexey Milovidov
7b9b790667 Merge branch 'simpler-cmake' of github.com:ClickHouse/ClickHouse into simpler-cmake 2023-11-17 15:17:45 +01:00
Raúl Marín
7074bdb3bb Merge remote-tracking branch 'blessed/master' into access-control-and-named-collections-by-default 2023-11-17 14:53:02 +01:00
Alexey Milovidov
9b9b0a0b9a Merge branch 'master' into simpler-cmake 2023-11-17 14:44:55 +01:00
Alexey Milovidov
9eb0b74167
Update Dockerfile 2023-11-17 15:54:32 +03:00
Alexey Milovidov
b42db2ec29 Update fasttest 2023-11-17 13:50:13 +01:00
Alexey Milovidov
ea3cd71225
Update Dockerfile 2023-11-17 15:42:10 +03:00
Alexey Milovidov
19dd29e8af
Update Dockerfile 2023-11-17 15:19:00 +03:00
Alexey Milovidov
215cd7b9f2
Update build.sh 2023-11-17 15:13:16 +03:00
Alexey Milovidov
2a9d05e245 Remove more lines 2023-11-17 12:59:04 +01:00
Alexey Milovidov
1d5bc13e2a Check what will happen if I remove some lines 2023-11-17 12:50:51 +01:00
Alexey Milovidov
318c7a06f9 Avoid dependencies with no fixed versions 2023-11-17 12:39:00 +01:00
robot-clickhouse
af2f06db52 Update version_date.tsv and changelogs after v23.9.5.29-stable 2023-11-17 11:12:16 +00:00
Alexey Milovidov
0548eefbb7 Simpler CMake 2023-11-17 11:35:48 +01:00
Alexey Milovidov
4f441ec131 Own CMake for Abseil 2023-11-17 11:32:27 +01:00
Alexey Milovidov
c65607484e Remove garbage 2023-11-17 10:03:10 +01:00
Alexey Milovidov
c7d8465897 Ensure no new dependencies 2023-11-17 09:12:49 +01:00
Alexey Milovidov
f73b3e10ac Ensure no new dependencies 2023-11-17 08:46:45 +01:00
Nikita Mikhaylov
427d9fff70 Set limit for memory 2023-11-16 19:13:25 +01:00
Kseniia Sumarokova
a2ed756eec
Merge branch 'master' into fs-cache-improvement 2023-11-16 17:49:26 +01:00
Igor Nikonov
b9d083e68d Merge remote-tracking branch 'origin/master' into test-rabbitmq-with-secure-connection 2023-11-16 13:05:10 +00:00
Antonio Andelic
b05a3d02ed
Merge pull request #56788 from ClickHouse/fix-keeper-random-stress
Fix randomization of Keeper configs in stress tests
2023-11-16 11:32:05 +01:00
Vitaly Baranov
946e02ecbc
Merge pull request #56268 from vitlibar/add-script-backup-view
Add an external utility to view backups and to extract information from them
2023-11-16 11:17:16 +01:00
Antonio Andelic
052134b143 Better 2023-11-16 07:32:11 +00:00
Robert Schulze
44bd0598a3
Merge pull request #56799 from slvrtrn/fix-binary-mysql-nullable-columns
Fix incorrect nullable columns reporting in MySQL binary protocol
2023-11-16 01:12:46 +01:00
Vitaly Baranov
21a283049c Add the test for clickhouse_backupview to CI. 2023-11-15 17:40:53 +01:00