Commit Graph

5309 Commits

Author SHA1 Message Date
Alexey Milovidov
ce4158f496
Merge pull request #64082 from ClickHouse/prevent-stack-overflow-ci
Prevent stack overflow in Fuzzer and Stress test
2024-05-20 05:14:59 +02:00
Azat Khuzhin
3743b4a2ed Fix sanitizers build by updating llvm/clang that includes fix for it
Rebuild for clang 18.1.3, that contains a workaround [1] for sanitizers
issue [2]:

    $ git tag --contains  c2a57034eff048cd36c563c8e0051db3a70991b3 | tail -1
    llvmorg-18.1.3

 [1]: c2a57034ef
 [2]: https://github.com/ClickHouse/ClickHouse/issues/64086

Since right now version is not enough:

    $ docker run --rm -it clickhouse/test-util llvm-nm-18 --version
    llvm-nm, compatible with GNU nm
    Ubuntu LLVM version 18.1.2
      Optimized build.

But I don't see any fix for TSan, only MSan, but let's try.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-05-18 16:43:19 +02:00
Alexey Milovidov
a2d9a32652
Merge pull request #63733 from qiangxuhui/qiangxuhui-loongarch64
Initial support for loongarch64
2024-05-18 05:26:26 +02:00
Alexey Milovidov
cafd074e0a Prevent stack overflow in Fuzzer and Stress test 2024-05-18 05:11:18 +02:00
Alexey Milovidov
26501178e6 Fix analyzer 2024-05-17 10:23:32 +02:00
Robert Schulze
5fb8ea4c62
Merge remote-tracking branch 'ClickHouse/master' into qiangxuhui-loongarch64 2024-05-17 07:56:01 +00:00
qiangxuhui
c30dea2d30 Fix loongarch64's CI code 2024-05-14 11:05:55 +00:00
qiangxuhui
13508de9a4 Fix code according to review suggestions 2024-05-14 10:49:09 +00:00
qiangxuhui
537b56b139 Add loongarch64 CI support 2024-05-14 08:15:28 +00:00
divanik
faef8807d2 Resolve conflicts 2024-05-13 12:04:06 +00:00
divanik
d468a0a577 Add archives reading support to s3 2024-05-13 12:00:15 +00:00
Alexey Milovidov
a1e6d1a6a9 Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-05-11 00:42:14 +02:00
Mikhail f. Shiryaev
544875fd2f
Apply markdownfmt.sh from https://github.com/docker-library/docs 2024-05-10 10:55:24 +02:00
Mikhail f. Shiryaev
291bb14696
The Dockerfile is reviewed by docker-official
`apt-get upgrade` shouldn't be executed during the build
`apt-get clean` is a noop
`gpg` should use batch and download key by full fingreprints
The CI specific steps shouln't be presented in docker library
Using `COPY --chmod` instead of two layers is not possible yet, but
  entrypoint.sh already contains +x bit in the git repo
2024-05-10 10:54:27 +02:00
Alexey Milovidov
dd58af7d4f Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-05-10 07:17:39 +02:00
Konstantin Bogdanov
27551ca3c7
Add jwcrypto to integration tests runner 2024-05-09 04:08:21 +03:00
Alexey Milovidov
773654c46e Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-05-08 21:24:04 +02:00
Raúl Marín
92bb69e062
Merge pull request #63470 from Algunenano/stress_constraints
Extra constraints for stress and fuzzer tests
2024-05-07 15:29:25 +00:00
Raúl Marín
463f95e956 Extra constraints for stress and fuzzer tests 2024-05-07 13:47:35 +02:00
Alexey Milovidov
fd430585e1 Merge remote-tracking branch 'origin/master' into fix-coverage 2024-05-07 09:34:00 +02:00
Alexey Milovidov
5f52cb43b4 Fix coverage. 2024-05-07 09:33:47 +02:00
Alexey Milovidov
98fb9f36a9 We are using Shared Catalog in the CI Logs cluster 2024-05-07 05:35:04 +02:00
alesapin
4eb5bea203
Merge pull request #63354 from ClickHouse/fix_azurite_version
Rollback azurite to working version
2024-05-06 09:25:23 +00:00
Alexey Milovidov
46bd25128c
Merge branch 'master' into clang-18-ci 2024-05-06 02:51:58 +02:00
alesapin
b8b4a3a6dd Fxi 2024-05-04 12:24:07 +02:00
Anton Popov
b991f77d04 randomize setting enable_block_offset_column in stress tests 2024-05-03 17:22:37 +00:00
Alexander Sapin
b1eb0a8e9c Try rollback azurite
(cherry picked from commit 967e51c1d6)
2024-05-03 18:42:59 +02:00
Robert Schulze
15e67fee78
Merge remote-tracking branch 'ClickHouse/master' into hlee-z-build-fix 2024-05-02 07:02:24 +00:00
robot-clickhouse
811ae63c0f Update version_date.tsv and changelogs after v24.4.1.2088-stable 2024-05-01 02:02:57 +00:00
Robert Schulze
6af89ecf12
Revert "Disable s390x build"
This reverts commit 116393c951.
2024-04-30 10:02:19 +00:00
alesapin
c7a6af3c4a Fix stateful 2024-04-27 21:47:48 +02:00
alesapin
78e6d62ed3
Merge branch 'master' into ci_add_azure_tests 2024-04-27 12:33:42 +02:00
alesapin
b4e3880c6b Test work without azurite 2024-04-27 12:30:28 +02:00
alesapin
8b050b2548 Merge branch 'ci_add_azure_tests' of github.com:ClickHouse/ClickHouse into ci_add_azure_tests 2024-04-26 19:18:18 +02:00
alesapin
349147b5b5 One more time 2024-04-26 19:16:27 +02:00
Nikita Mikhaylov
5c2fa14287
Merge branch 'master' into clang-18-ci 2024-04-25 13:19:17 +02:00
Alexander Sapin
adfe2f78a9 Try to make error more clear 2024-04-25 12:35:08 +02:00
alesapin
4d0ce04a91 Always start clickhouse with env forwarding 2024-04-24 20:03:23 +02:00
Ilya Golshtein
01de28b6c1 kerberized_hadoop_dockerfile: ADD instead of wget, no final OR 2024-04-24 20:36:35 +03:00
Ilya Golshtein
7d82260e3a kerberized_hadoop_dockerfile: get from https via wget 2024-04-24 20:36:35 +03:00
alesapin
68ff44259e Merge branch 'ci_add_azure_tests' of github.com:ClickHouse/ClickHouse into ci_add_azure_tests 2024-04-24 17:31:05 +02:00
Nikolay Degterinsky
26308744ac
Update run.sh 2024-04-24 02:50:04 +02:00
Mikhail f. Shiryaev
63d2f75f05
Fix accumulated shellcheck issues 2024-04-18 18:04:10 +02:00
Alexander Sapin
9896c50c3f azurite only in memory 2024-04-17 14:53:45 +02:00
Raúl Marín
5849aeb8c3
Merge pull request #62297 from Algunenano/rust_vendor
Vendor rust dependencies
2024-04-17 12:36:27 +00:00
Smita Kulkarni
d1a81e718c Merge branch 'master' into ci_add_azure_tests 2024-04-17 14:26:41 +02:00
Robert Schulze
4e881be128
Merge pull request #62634 from liuneng1994/std-except-parseDateTIme
Speed up `parseDateTime[InJodaSyntax]Or(Null|Zero)` on invalid inputs
2024-04-16 13:42:10 +00:00
Alexey Milovidov
e65dc63609
Merge branch 'master' into rust_vendor 2024-04-16 10:10:34 +02:00
Robert Schulze
01c55e69e6
Merge pull request #59870 from rschu1ze/be-less-boring-32
boringssl --> OpenSSL 3.2
2024-04-16 06:59:08 +00:00
Alexander Sapin
90ef5cc516 better 2024-04-15 18:52:17 +02:00
Robert Schulze
7dc05d092b
Merge remote-tracking branch 'rschu1ze/master' into be-less-boring-32 2024-04-15 16:35:10 +00:00
Alexander Sapin
c0c8c3be99 Fix 2024-04-15 17:28:22 +02:00
Robert Schulze
a86f769e25
Fix FastTest 2024-04-15 14:06:59 +00:00
Alexander Sapin
45d49ca53d I'll shut you down 2024-04-15 15:46:41 +02:00
Alexander Sapin
949ec8d44c Silence 2024-04-15 15:33:25 +02:00
Alexander Sapin
0f2cc6e00a Disable logs 2024-04-15 15:17:36 +02:00
Alexander Sapin
daea269a28 Try without debug logs 2024-04-15 14:42:20 +02:00
Robert Schulze
3c35f14804
Merge remote-tracking branch 'ClickHouse/master' into mkmkme/protobuf-25.1 2024-04-15 12:38:59 +00:00
Raúl Marín
69245545fa
Merge branch 'master' into rust_vendor 2024-04-15 10:57:01 +01:00
Alexander Tokmakov
d510c3ac55
Merge pull request #62266 from ClickHouse/cannot_allocate_thread
Add fault injection for "Cannot allocate thread"
2024-04-12 14:40:42 +00:00
Max Kainov
053c3cc0c1 redirect azure logs 2024-04-12 10:22:03 +00:00
Alexey Milovidov
164a8d6097
Merge branch 'master' into clang-18-ci 2024-04-12 03:49:10 +02:00
Alexey Milovidov
d903e189c4
Update docker/test/stateless/run.sh 2024-04-12 01:01:04 +02:00
Raúl Marín
361d73f7a4 Try to fix Bugfix validation job 2024-04-12 00:07:53 +02:00
Alexander Tokmakov
55c510563c Merge branch 'master' into cannot_allocate_thread 2024-04-11 23:06:17 +02:00
Raúl Marín
aa09876220 Merge remote-tracking branch 'blessed/master' into rust_vendor 2024-04-11 18:52:28 +02:00
Raúl Marín
0273b39804 Merge remote-tracking branch 'blessed/master' into rust_vendor 2024-04-10 22:05:20 +02:00
Alexander Tokmakov
d8e97b51bf Merge branch 'master' into cannot_allocate_thread 2024-04-10 21:21:42 +02:00
Raúl Marín
12569cc5fe Don't allow the fuzzer to change allow_experimental_analyzer 2024-04-10 18:18:47 +02:00
Raúl Marín
26469c9c10 Update rustc to nightly-2024-04-01 2024-04-09 19:16:46 +02:00
Nikolay Degterinsky
6f78e89044 Merge remote-tracking branch 'upstream/master' into docker-image 2024-04-09 13:13:58 +00:00
Nikolay Degterinsky
f45acef131 Support for a tiny feature in stateless tests image 2024-04-09 00:33:18 +00:00
Alexey Milovidov
8b856702f1
Merge pull request #62214 from ClickHouse/auto/v24.3.2.23-lts
Update version_date.tsv and changelogs after v24.3.2.23-lts
2024-04-08 15:11:52 +02:00
Robert Schulze
116393c951
Disable s390x build 2024-04-08 11:04:11 +00:00
Alexey Milovidov
0fccaafda4 Fix tests 2024-04-04 20:06:40 +02:00
Yakov Olkhovskiy
db3d923d4c return WITH_COVERAGE, fix build 2024-04-03 20:25:29 +00:00
Alexander Tokmakov
98ac8031e0 add fault injection 2024-04-03 19:49:23 +02:00
Mikhail Koviazin
e7a664e9df
Merge remote-tracking branch 'upstream/master' into mkmkme/protobuf-25.1 2024-04-03 13:51:37 +03:00
robot-clickhouse
c7a28b137a Update version_date.tsv and changelogs after v24.3.2.23-lts 2024-04-03 07:24:20 +00:00
Yakov Olkhovskiy
8d667ad5a3 fix build.sh 2024-04-01 22:55:51 +00:00
Yakov Olkhovskiy
99e25d762c remove WITH_COVERAGE for fuzzers build 2024-04-01 12:28:51 +00:00
Alexey Milovidov
5e7a90f85f
Merge pull request #62065 from azat/ci/fix-stress-tests-analyzer
Fix stress tests for analyzer due to experimental WINDOW VIEW (by disabling it)
2024-04-01 00:16:02 +03:00
Nikolay Degterinsky
85bba8c59d
Merge pull request #62019 from ClickHouse/evillique-patch-2
Fix logs saving in DatabaseReplicated tests
2024-03-29 01:00:19 +01:00
Azat Khuzhin
a94143ee19 Fix stress tests for analyzer due to experimental WINDOW VIEW (by disabling it)
CI found [1]:

    2024.03.28 13:16:00.797344 [ 99740 ] {} <Error> Application: Caught exception while loading metadata: Code: 695. DB::Exception: Load job 'load table 01069_window_view_proc_tumble_watch.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01069_window_view_proc_tumble_watch`.`wv` from metadata file /var/lib/clickhouse/store/dd8/dd82a4f5-5485-4747-9172-8976d1194c54/wv.sql from query ATTACH WINDOW VIEW `01069_window_view_proc_tumble_watch`.wv UUID '35cc7d27-df3b-4569-9cb9-2ccf6cb1ff4c' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01069_window_view_proc_tumble_watch`.mt GROUP BY tumble(timestamp, toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/61997/ced095394b6fb6d50ed8b6834bd5911ad4702c6e/stateless_tests__tsan__s3_storage__[5_5].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-28 18:27:43 +01:00
Mikhail Koviazin
a9a1bd1afe
docker/stateless-test: install protobuf-compiler v25.1 2024-03-28 16:08:24 +01:00
Kseniia Sumarokova
5ba2ad53b6
Merge pull request #61163 from ClickHouse/filecache-better-try-reserve
Less contention in cache, part 3
2024-03-28 13:24:22 +01:00
Nikolay Degterinsky
dae3a9e389
Fix 2024-03-28 06:31:46 +01:00
Nikolay Degterinsky
54348e5e8c
Fix logs saving in DatabaseReplicated tests 2024-03-28 06:27:48 +01:00
Mikhail f. Shiryaev
fc96a57422
Merge pull request #61683 from mangadex-pub/54767-remove-extraneous-keeper-docker-volumes
#54767 Remove extraneous volumes in Keeper image
2024-03-27 22:01:50 +01:00
robot-clickhouse
52417e3d42 Update version_date.tsv and changelogs after v24.3.1.2672-lts 2024-03-27 18:02:02 +00:00
Kseniia Sumarokova
db724b1293
Update create.sql 2024-03-25 19:36:48 +01:00
kssenii
ab17c4c987 Better randomization for stress test, restore trace log level back 2024-03-25 12:15:43 +01:00
Tristan
38fb8b3e9e
Explicitly add /var/lib/clickhouse as volume of keeper
Since it appears mandatory at the moment with default Keeper config
2024-03-24 11:19:36 +00:00
Tristan
352c368a54
Update server alpine image template to match improvements in keeper image 2024-03-24 11:19:35 +00:00
Tristan
7962a69770
Cleanup Keeper Dockerfile and Docker entrypoint 2024-03-24 11:19:35 +00:00
Tristan
dff916b64c
Remove extraneous volumes in Keeper image
Specifically the 2 non-data-related volumes

Fixes issue #54767
2024-03-24 11:19:34 +00:00
Raúl Marín
e562a7c117
Merge pull request #61706 from Algunenano/fuzzer_again
Fuzzer: Try a different way to wait for the server
2024-03-21 21:08:03 +01:00
Alexey Milovidov
9afe096ff5
Merge pull request #61681 from ClickHouse/remove-diagnostics
Remove clickhouse-diagnostics from the package
2024-03-21 19:50:47 +03:00
Raúl Marín
4700222a0d Fuzzer: Try a different way to wait for the server 2024-03-21 12:40:07 +01:00
Mikhail f. Shiryaev
ff9a6d0958
Merge pull request #61197 from ClickHouse/merge-commit-style-autofix
Merge commit style autofix
2024-03-21 09:59:53 +01:00
Alexey Milovidov
bfc7c3c89e Remove clickhouse-diagnostics 2024-03-21 02:52:51 +01:00
Max K
4f51d891a0
Merge pull request #61597 from ClickHouse/ci_remove_compose_files_from_docker
CI: remove compose files from integration test docker
2024-03-20 17:36:13 +01:00
Max Kainov
da28eaf454 CI: remove compose files from integration test docker
#ci_set_integration
2024-03-20 14:11:47 +00:00
Raúl Marín
007775c982 Better fuzzer logs 2024-03-20 13:09:26 +01:00
Mikhail f. Shiryaev
6550b6f227
Merge pull request #61607 from ClickHouse/fix-configs-bugfix
Fix configs for upgrade and bugfix
2024-03-20 10:44:43 +01:00
kssenii
fd7c732c12 Add one more comment, better cache policy randomizer 2024-03-19 23:09:17 +01:00
Mikhail f. Shiryaev
fce926446b
Fix sed to not produce local_blob_storage_blob_storage 2024-03-19 18:05:57 +01:00
Raúl Marín
b290fda45a
Merge pull request #61333 from Algunenano/fuzz_log
Minor changes in stress and fuzzer reports
2024-03-19 17:54:38 +01:00
Mikhail f. Shiryaev
301037ca6a
Replace cat | sed; mv by sed -i 2024-03-19 17:53:32 +01:00
kssenii
595165add0 Merge remote-tracking branch 'origin/master' into filecache-better-try-reserve 2024-03-19 15:12:55 +01:00
Alexey Milovidov
2a4116cfb3
Merge pull request #61410 from tomershafir/thread-fuzzer-sleep-rand
ThreadFuzzer: randomize sleep time
2024-03-19 15:56:14 +03:00
Raúl Marín
a6506e8e58 Missed sending the process to background 2024-03-19 12:05:13 +01:00
Raúl Marín
8f318bed0d
Merge pull request #61363 from azat/ci/fix-upgrade-bugfix
Fix bugfix check (due to "unknown object storage type: azure")
2024-03-19 11:58:00 +01:00
Raúl Marín
7dbd96cf4e Fix 2024-03-18 19:43:13 +01:00
Raúl Marín
10dd47cf5c Separate CH and sanitizer logs 2024-03-18 16:40:03 +01:00
Raúl Marín
83c660a545 Merge remote-tracking branch 'blessed/master' into fuzz_log 2024-03-18 16:12:50 +01:00
Mikhail f. Shiryaev
0e6b5705fb
Install python-magic in style-check, split pip and apt 2024-03-18 15:04:44 +01:00
kssenii
7931c44ff2 Check static storage policy 2024-03-17 17:40:43 +01:00
robot-clickhouse
e5a1c0e251 Update version_date.tsv and changelogs after v24.2.2.71-stable 2024-03-15 06:50:44 +00:00
Alexey Milovidov
05357bce5c Merge branch 'master' into clang-18-ci 2024-03-15 07:28:04 +01:00
tomershafir
23169117ae thread-fuzzer: randomize sleep time 2024-03-15 00:02:09 +02:00
Azat Khuzhin
02ae7e54a7 Fix bugfix check (due to "unknown object storage type: azure")
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-14 14:57:33 +01:00
Mikhail f. Shiryaev
277032e444
Move the least updating cctools into beginning, update it 2024-03-14 14:16:33 +01:00
Mikhail f. Shiryaev
c3aefb28e5
Remove unnecessary layers from clickhouse/cctools 2024-03-14 14:13:15 +01:00
Raúl Marín
f63368d83d Separate stdout and stderr in fuzzer report 2024-03-13 19:12:43 +01:00
Raúl Marín
2982f3b369 Fix stress test sanitizer report 2024-03-13 19:12:43 +01:00
Alexey Milovidov
d3872b155e Merge branch 'master' into clang-18-ci 2024-03-13 09:35:58 +01:00
Raúl Marín
a65ac96b04
Merge pull request #61147 from azat/ci/fix-symbolizer
Fix llvm symbolizer on CI
2024-03-12 12:01:43 +01:00
Alexey Milovidov
bdc884dfa5
Merge pull request #60255 from ClickHouse/dont-load-useless-index-parts-in-memory
Do not load useless columns from the index in memory
2024-03-12 08:30:53 +03:00
Azat Khuzhin
5a400c181b Fix llvm symbolizer on CI
In #61011 the whole toolchain installation had been removed from the
base image to reduce image sizes, and this is a good thing indeed.

However it also breaks the symbolizer for sanitizers, which makes
stacktraces unreadable, so let's fix this by getting back llvm package,
this should be OK, since it's size is not gigabytes, but only 48MiB (at
least for llvm-14):

    # dpkg -L llvm-14| xargs file | grep -v directory | cut -d: -f1 | xargs du -sch | grep total
    48M     total

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-11 20:36:15 +01:00
Nikita Mikhaylov
cfa042cb04 Merge branch 'master' of github.com:ClickHouse/ClickHouse into rip-copier 2024-03-11 15:45:20 +00:00
Alexey Milovidov
8a484a44e3 Merge branch 'master' into dont-load-useless-index-parts-in-memory 2024-03-11 02:10:20 +01:00
Alexey Milovidov
36e18d7500 Merge branch 'master' into clang-18-ci 2024-03-10 23:57:00 +01:00
Alexey Milovidov
2cc071e0e4 Fix error 2024-03-10 12:48:15 +01:00
Alexey Milovidov
3b8a8c9649 Better gitignore 2024-03-10 09:28:30 +01:00
Alexey Milovidov
9a880c3bb9 Merge branch 'master' into clang-18-ci 2024-03-10 06:59:27 +01:00
Max Kainov
681bd28c87 CI: make style check fast
#do_not_test
2024-03-09 20:57:23 +00:00
Nikita Mikhaylov
6b4867f746
Debug fuzzer failures (#61062) 2024-03-08 21:27:56 +01:00
Nikita Mikhaylov
2bc4d27ac6 Bye bye 2024-03-07 19:24:39 +00:00
Mikhail f. Shiryaev
922d4cee63
Set the static image tag for cctools sources 2024-03-07 11:58:42 +01:00
Mikhail f. Shiryaev
484453c703
Create a rare-changing clickhouse/cctools 2024-03-07 11:08:56 +01:00
Mikhail f. Shiryaev
e5a7ec7be6
Do not build odbc driver in sqllogic 2024-03-07 09:52:25 +01:00
Mikhail f. Shiryaev
0cbfe3421f
Reduce size of test images by removing clang from there 2024-03-07 09:52:25 +01:00
Mikhail f. Shiryaev
cf0780a777
Change the binary-builder directory 2024-03-07 09:52:24 +01:00
Mikhail f. Shiryaev
176ed5f96b
Use curl instead of wget 2024-03-07 09:52:24 +01:00
Mikhail f. Shiryaev
1d8fe381be
Update the odbc in stateless tests 2024-03-07 09:52:23 +01:00
Mikhail f. Shiryaev
0cedafef1e
Do not test odbc in fast tests 2024-03-07 09:52:21 +01:00
Mikhail f. Shiryaev
9967c60c53
Update sccache 2024-03-07 09:52:07 +01:00
Mikhail f. Shiryaev
5e597228d7
Merge pull request #60408 from ClickHouse/update-style-python
Update style python
2024-03-07 09:32:28 +01:00
Kseniia Sumarokova
0d67d9c79d
Merge pull request #60165 from ClickHouse/fix-for-local-object-storage
Allow local/azure as object storage type instead of local_blob_storage/azure_blob_storage
2024-03-07 14:42:44 +08:00
Nikita Mikhaylov
48bea29611
Merge pull request #60654 from ClickHouse/fuzzer-gdb
Try to run fuzzer under gdb
2024-03-05 18:52:13 +01:00
Mikhail f. Shiryaev
34bb40583c
Install stubs for python-requests 2024-03-05 16:02:43 +01:00
Mikhail f. Shiryaev
76cbd78331
Update pylint, mypy, and black in style check image 2024-03-05 15:59:07 +01:00
Raúl Marín
738c481cce Fix fuzzer report 2024-03-05 10:36:42 +00:00
Kseniia Sumarokova
6f5d79db24
Merge branch 'master' into fix-for-local-object-storage 2024-03-05 14:14:34 +08:00
Kseniia Sumarokova
9a3312f12d
Remove debug 2024-03-05 11:55:32 +08:00
Kseniia Sumarokova
b5fb12c6ec
Fix typo 2024-03-05 11:54:58 +08:00
Kseniia Sumarokova
c735caf44f
Fix typo 2024-03-05 11:54:13 +08:00
Nikita Mikhaylov
822ef975a5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fuzzer-gdb 2024-03-05 01:30:54 +01:00
Nikita Mikhaylov
e715ff622d Better 2024-03-05 00:52:13 +01:00
Raúl Marín
6e579e6bfa Use awk since it's much simpler 2024-03-04 18:15:53 +01:00
Raúl Marín
0149b8893a Include multiline logs in fuzzer fatal.log report 2024-03-04 17:42:06 +01:00
Mikhail f. Shiryaev
017a81692f
Merge pull request #60553 from ClickHouse/update-shellcheck
Update shellcheck
2024-03-04 11:21:34 +01:00
Alexey Milovidov
aeb5b9e921
Merge pull request #60607 from ClickHouse/auto/v24.2.1.2248-stable
Update version_date.tsv and changelogs after v24.2.1.2248-stable
2024-03-04 01:50:00 +03:00
Alexey Milovidov
6df3179341 Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-03-03 23:02:20 +01:00
Alexey Milovidov
c51b50aa1a
Merge pull request #60375 from azat/ci/bugfix-check-fix
Fix bugfix check (due to unknown commit_logs_cache_size_threshold)
2024-03-03 23:11:40 +03:00
Azat Khuzhin
c343ec4bcf Fix bugfix and upgrade checks (due to "Unknown handler type 'redirect'" error)
CI: https://s3.amazonaws.com/clickhouse-test-reports/60694/418a6258ac1b55d5e225107bd9ebfc711ca6511b/upgrade_check__msan_.html
CI: https://s3.amazonaws.com/clickhouse-test-reports/60689/707200d2a4ee765c5109dcca78aaaa7f2c63ab85/bugfix_validation.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-03 12:00:49 +01:00
Alexey Milovidov
3938d7156a Merge branch 'master' into fix-for-local-object-storage 2024-03-02 19:44:12 +01:00
Nikita Mikhaylov
361ec17c87 gdb... 2024-03-01 15:31:25 +00:00
Mikhail f. Shiryaev
17210bb494
Fix type, add _server suffix to start and stop functions 2024-03-01 00:21:31 +01:00
robot-clickhouse
c1d542d700 Update version_date.tsv and changelogs after v24.2.1.2248-stable 2024-02-29 21:19:40 +00:00
Mikhail f. Shiryaev
82a8308198
Update shellcheck to the latest release 2024-02-29 17:41:35 +01:00
Mikhail f. Shiryaev
f40e25f5c3
Check all shell scripts in docker directories 2024-02-29 17:41:33 +01:00
Alexey Milovidov
ee772aaf0f Use clang-18 in CI 2024-02-27 23:17:11 +01:00
Alexey Milovidov
12ecfbb0d0 Fix wrong log message in Fuzzer 2024-02-26 17:46:51 +01:00
Antonio Andelic
2b51497e55
Update docker/test/stateless/run.sh 2024-02-26 08:50:23 +01:00
Azat Khuzhin
83e7f3e1a1 Fix bugfix check (due to unknown commit_logs_cache_size_threshold)
Bugfix check is broken on CI [1], because of:

    2024.02.23 06:12:59.294500 [ 757 ] {} Application: Code: 115. DB::Exception: Unknown setting latest_logs_cache_size_threshold: in Coordination settings config. (UNKNOWN_SETTING), Stack trace (when copying this message, always include the lines below):

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/60031/89eb2a38c0a7c113b7b0a96c8069fea6eb48ae9d/bugfix_validation.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-24 21:17:03 +01:00
Azat Khuzhin
dd690dd05d Expose fatal.log separately for fuzzer
Otherwise you have to download the full server.log

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-24 19:23:28 +01:00
Alexander Tokmakov
ef3b19167f
Merge pull request #58036 from MikhailBurdukov/backoff_for_failed_mutations
Backoff policy for failed mutation.
2024-02-23 15:27:41 +01:00
Kseniia Sumarokova
d3c6761dcf
Update run.sh 2024-02-23 12:06:17 +01:00
Raúl Marín
c359f29842 Merge remote-tracking branch 'blessed/master' into stress_log 2024-02-23 10:50:46 +01:00
Raúl Marín
9c99a2dd2a Maybe better 2024-02-22 13:20:57 +01:00
Raúl Marín
b83b7a7ab7 Stress test: Include the first sanitizer block message in the report 2024-02-22 12:59:12 +01:00
Raúl Marín
5684a14160 Ignore valid 'No such key errors' in stress tests 2024-02-22 11:47:43 +01:00
Kseniia Sumarokova
84d6b4166a
Merge branch 'master' into fix-for-local-object-storage 2024-02-22 11:40:18 +01:00
Antonio Andelic
1b238d1180
Merge pull request #59460 from ClickHouse/keeper-logs-cache
Keeper log cache
2024-02-22 09:03:41 +01:00
Kseniia Sumarokova
2836d0bb55
Update run.sh 2024-02-21 18:46:42 +01:00
Max Kainov
9f51e840db CI: integration tests to mysql80
#ci_set_integration
 #no_merge_commit
2024-02-21 11:05:47 +00:00
Kseniia Sumarokova
462f597c6b
Update run.sh 2024-02-21 11:02:05 +01:00
MikhailBurdukov
fa5747ab7f Fix stress tests 2024-02-21 08:50:39 +00:00
Kseniia Sumarokova
2405115484
Fix upgrade check 2024-02-20 18:05:48 +01:00
MikhailBurdukov
7cdfedaedd Enable setting by default 2024-02-20 08:39:11 +00:00
Antonio Andelic
299a0bd996 Merge branch 'master' into keeper-logs-cache 2024-02-19 10:01:31 +01:00
Alexey Milovidov
c8415ddc29 Speed up the CI 2024-02-18 09:29:34 +01:00
Antonio Andelic
1ade535a83 Merge branch 'master' into keeper-logs-cache 2024-02-15 13:06:37 +01:00
Alexey Milovidov
91ef665ed3
Merge pull request #59993 from ClickHouse/auto/v24.1.5.6-stable
Update version_date.tsv and changelogs after v24.1.5.6-stable
2024-02-14 22:05:34 +01:00
robot-clickhouse
08df19157b Update version_date.tsv and changelogs after v24.1.5.6-stable 2024-02-14 17:22:21 +00:00
jktng
17c9e2df6b
Update entrypoint.sh 2024-02-14 11:39:22 -05:00
Raúl Marín
4fb76a6e25
Merge pull request #59969 from ClickHouse/no-aerospike
We don't have external dictionaries from Aerospike
2024-02-14 15:54:46 +01:00
robot-clickhouse
7514158353 Update version_date.tsv and changelogs after v24.1.4.20-stable 2024-02-14 10:30:32 +00:00
Mikhail f. Shiryaev
9e7ac6d0ee
Revert "Update version_date.tsv and changelogs after v24.1.4.19-stable" 2024-02-14 10:07:09 +01:00
Alexey Milovidov
1fbc52fa40 Remove Aerospike 2024-02-14 05:52:39 +01:00
Alexey Milovidov
2870c628c1
Merge pull request #58926 from MyroTk/master
Include `pytest-reportlog` in the integration tests' CI runner.
2024-02-14 05:05:51 +01:00
robot-clickhouse
3c0abe08cb Update version_date.tsv and changelogs after v24.1.4.19-stable 2024-02-14 00:29:24 +00:00
MyroTk
6a3c362443
Update Dockerfile 2024-02-12 10:39:26 -08:00
Mikhail f. Shiryaev
1285bdbef1
Merge pull request #59808 from AlexNik/always-initdb-option
Option to run init db scripts every time
2024-02-12 12:09:54 +01:00
Alexey Milovidov
a65b9cc1f8
Merge pull request #59800 from ClickHouse/auto/v23.12.4.15-stable
Update version_date.tsv and changelogs after v23.12.4.15-stable
2024-02-11 23:41:09 +01:00
Alexey Milovidov
ed02154a4a Fix "Too many parts" 2024-02-10 07:31:54 +01:00
Alexey Milovidov
99b66f75bd Sequential run 2024-02-10 02:27:55 +01:00
Alexander Nikolaev
68df201145 Add CLICKHOUSE_ALWAYS_RUN_INITDB_SCRIPTS envoronment variable. 2024-02-09 16:50:50 +03:00
robot-clickhouse
582abd40fd Update version_date.tsv and changelogs after v23.12.4.15-stable 2024-02-09 12:25:38 +00:00
Alexey Milovidov
d466e8d61e Run coverage collection sequentially 2024-02-09 03:55:39 +01:00
Alexey Milovidov
41ff8b3217 Reading Docker files 2024-02-09 00:15:52 +01:00
Alexey Milovidov
91c607f249 Fix a test 2024-02-08 22:11:37 +01:00
Alexey Milovidov
d38e6158b0 Merge branch 'enable-coverage-for-debug-build' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-02-07 22:46:10 +01:00
Alexey Milovidov
02c0b4c67f Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-02-07 22:45:50 +01:00
robot-clickhouse
64d9d2d467 Automatic style fix 2024-02-07 20:44:35 +00:00
Alexey Milovidov
4d25929d74 A few missing changes 2024-02-07 20:58:40 +01:00
Alexey Milovidov
33401643a4 Fix error 2024-02-07 20:28:37 +01:00
Alexey Milovidov
d65a56d967
Merge branch 'master' into enable-coverage-for-debug-build 2024-02-07 04:58:21 +01:00
Alexey Milovidov
aa91d52277
Merge branch 'master' into master 2024-02-06 23:58:53 +01:00
Raúl Marín
a64ce70671 Pin python dependencies in stateless tests 2024-02-06 20:11:04 +01:00
Antonio Andelic
41202cd7b2
fix upgrade 2024-02-06 09:39:22 +01:00
Antonio Andelic
dd3db5d092 Merge branch 'master' into keeper-logs-cache 2024-02-05 16:56:09 +01:00
Antonio Andelic
b0fde3828b Merge branch 'master' into keeper-logs-cache 2024-02-05 16:55:46 +01:00
Max K
411b76cc57
Merge pull request #59241 from ClickHouse/test_arm
CI: Add ARM integration tests
2024-02-05 14:52:46 +01:00
Raúl Marín
08c1799f9c
Merge pull request #59383 from Algunenano/fuzz_literal
Add some fuzzing to ASTLiterals
2024-02-05 12:27:43 +01:00
Mikhail f. Shiryaev
31f27ad398
Merge pull request #59337 from ClickHouse/fix-fasttests-gdb
Some small fixes for docker images
2024-02-05 11:42:18 +01:00
Max Kainov
6504dfe0b2 CI: Enable ARM integration test
#ci_set_integration #no_merge_commit
2024-02-02 17:37:05 +00:00
Raúl Marín
00096e5819 Merge remote-tracking branch 'blessed/master' into fuzz_literal 2024-02-02 17:28:47 +01:00
robot-clickhouse
e7f63abc2f Update version_date.tsv and changelogs after v24.1.2.5-stable 2024-02-02 11:41:46 +00:00
Antonio Andelic
a248491299
remove new settings from older versions 2024-02-02 11:14:03 +01:00
MyroTk
dffc539880
Merge branch 'ClickHouse:master' into master 2024-02-01 17:05:36 -08:00
Mikhail f. Shiryaev
6f1fbdb5ca
Fix the failed upgrade of kazoo to 2.10.0 2024-02-01 11:20:24 +01:00
Mikhail f. Shiryaev
2577f8031b
Add suid bit to gdb in fast tests image 2024-02-01 11:20:23 +01:00
Mikhail f. Shiryaev
76c6dc51bf
Unify the apt cleaning part in Dockerfile's 2024-02-01 11:20:23 +01:00
Azat Khuzhin
ea720e3171 Verify that stripped clickhouse shows symbol names
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-01 09:32:59 +01:00
Kseniia Sumarokova
60c37fb9bf
Update run.sh 2024-01-31 13:44:16 +01:00
Raúl Marín
4f0c78d665 Upload one file. Save the planet 2024-01-30 20:29:59 +01:00
robot-clickhouse
ef6c90c71b Update version_date.tsv and changelogs after v24.1.1.2048-stable 2024-01-30 18:01:46 +00:00
Alexey Milovidov
35ea956255
Merge pull request #59295 from ClickHouse/fix_block_number
Fix `_block_number` column with non-default serializations and mutation
2024-01-30 04:07:09 +01:00
Alexey Milovidov
cb69a1b25d Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-01-29 15:35:04 +01:00
alesapin
cef109a887 Fix backward compatibility check 2024-01-29 13:19:46 +01:00
Kseniia Sumarokova
f80b226035
Merge pull request #59280 from ClickHouse/kssenii-patch-8
Update run.sh
2024-01-29 10:27:33 +01:00
alesapin
b864b122fa Merge branch 'master' into fix_block_number 2024-01-29 10:19:43 +01:00
Alexey Milovidov
b32f9ae037
Merge pull request #59255 from azat/tests/pdb-v2
Improve pytest --pdb experience by preserving dockerd on SIGINT (v2)
2024-01-29 00:00:57 +01:00
Alexey Milovidov
4a94ae5a1b Merge branch 'master' into enable-coverage-for-debug-build 2024-01-28 22:24:26 +01:00
Kseniia Sumarokova
cc4d4647f5
Update run.sh 2024-01-28 22:24:03 +01:00
Kseniia Sumarokova
41883ddb34
Update run.sh 2024-01-28 18:15:11 +01:00
Kseniia Sumarokova
febd4ce8d7
Update run.sh 2024-01-28 13:41:33 +01:00
alesapin
d70fe79a1e Revert "Disable randomization of allow_experimental_block_number_column flag (#56474)"
This reverts commit 951d9ac144.
2024-01-28 12:28:08 +01:00
Kseniia Sumarokova
24ab61932e
Update run.sh 2024-01-27 22:42:43 +01:00
Kseniia Sumarokova
163a3e44d3
Update run.sh 2024-01-26 21:22:39 +01:00
Azat Khuzhin
94eb33ef27 Improve pytest --pdb experience by preserving dockerd on SIGINT (v2)
Previous fix (#43392) was not correct, since terminal sends SIGINT to
all processes in a group, so simply ignoring it in parent won't work. So
instead dockerd will be run in a new session.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-01-26 16:06:41 +01:00
Azat Khuzhin
92d96c4d02 Fix fasttest by pinning pip dependencies
After image update it prints the following warning:

    /ClickHouse/tests/queries/0_stateless/01558_ttest_scipy.python:5: DeprecationWarning:
    Pyarrow will become a required dependency of pandas in the next major release of pandas (pandas 3.0),
    (to allow more performant data types, such as the Arrow string type, and better interoperability with other libraries)
    but was not found to be installed on your system.
    If this would cause problems for you,
    please provide us feedback at https://github.com/pandas-dev/pandas/issues/54466

Pyarrow can be added as well, but according to the comment in the issue
it bloats the image size 170%, so let's simply downgrade it for now and
see how that issue will be resolved (or the warning could be suppressed
of course).

And pin other dependencies as well to avoid further failures.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-01-26 15:08:22 +01:00
Kseniia Sumarokova
291427d931
Update stateless/run.sh 2024-01-23 14:51:55 +01:00
MyroTk
e78eb41264
Update Dockerfile 2024-01-22 15:19:31 -08:00
Kseniia Sumarokova
bfb822b775
Try fix style check 2024-01-22 20:32:47 +01:00
Kseniia Sumarokova
a23d71b7bb
Update run.sh 2024-01-22 18:19:58 +01:00
Alexey Milovidov
09d7817940
Merge pull request #58975 from cangyin/cd-data-dir
Change working directory to data path
2024-01-21 15:49:03 +01:00
Alexey Milovidov
dc1dac3ba4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-01-20 21:41:07 +01:00
Alexey Milovidov
735708e9bb Merge branch 'master' into enable-coverage-for-debug-build 2024-01-20 21:40:53 +01:00
Kseniia Sumarokova
5d67e26fc4
Merge pull request #58869 from ClickHouse/force-check-for-cached-custom-disk
Fix for custom cached disk creation
2024-01-20 14:47:36 +01:00
cangyin
668d603344 Change working directory to data path
Take DATA_DIR out of loop
2024-01-20 10:46:55 +00:00
Alexey Milovidov
8c54a09e66 Fix error 2024-01-20 08:59:29 +01:00
Alexey Milovidov
639d7745d4 Fix error 2024-01-19 17:02:23 +01:00
Kruglov Pavel
55202db06b
Fix 2024-01-19 12:06:10 +01:00
avogar
8f2d78bbbf Merge branch 'master' of github.com:ClickHouse/ClickHouse into settings-changes-check 2024-01-19 11:04:50 +00:00
Kseniia Sumarokova
a661c6b2c0
Update run.sh 2024-01-19 10:37:21 +01:00
alesapin
3dc8b2dbf7
Merge pull request #58955 from ClickHouse/more_safe_way_to_dump_Logs
More safe way to dump system logs in tests
2024-01-19 10:20:55 +01:00
Alexander Sapin
ea6ca96c85 More safe way to dump system logs in tests 2024-01-18 17:51:48 +01:00
kssenii
255a52a8ff Fix tests with database replicated 2024-01-18 13:26:47 +01:00
Alexey Milovidov
cc5cc361ef Fix error 2024-01-18 12:35:49 +01:00
Alexey Milovidov
f9ca4e3b85 Slightly better 2024-01-18 00:52:05 +01:00
Alexey Milovidov
f89803ebf6 Slightly better 2024-01-17 23:17:53 +01:00
MyroTk
e3f5058f61
Update Dockerfile 2024-01-17 12:13:15 -08:00
Alexey Milovidov
779f738cb9 Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-01-16 05:07:17 +01:00
Alexey Milovidov
a9fe9cae60
Merge pull request #58821 from ClickHouse/do-not-trim-fuzzer-log
Fuzzer: do not trim fuzzer log
2024-01-16 00:01:55 +01:00
Alexey Milovidov
c5024a5f6d Fix typo 2024-01-15 23:36:48 +01:00
Kseniia Sumarokova
ae884760db
Merge pull request #58357 from ClickHouse/better-disks-configuration
Flexible configuration for disks
2024-01-15 21:34:36 +01:00
Dmitry Novik
a6a0122406 Fuzzer: do not trim fuzzer log 2024-01-15 13:06:43 +00:00
Alexey Milovidov
71bef27abf Follow-up 2024-01-15 06:26:54 +01:00
Alexey Milovidov
c5dfae1bca Fix error 2024-01-15 05:07:23 +01:00
Alexey Milovidov
bf2e574857 Symbolization 2024-01-15 00:48:47 +01:00
Alexey Milovidov
97200e2c5d Symbolization 2024-01-15 00:46:01 +01:00
Alexey Milovidov
7662628393 Export coverage to the CI database 2024-01-15 00:41:14 +01:00
Alexey Milovidov
e43be2f3b0 Support stress test 2024-01-14 08:18:03 +01:00
Alexey Milovidov
6f6ec9705e Fix error 2024-01-14 05:18:12 +01:00
Alexey Milovidov
66d2353851 Revert "Fix Docker"
This reverts commit 6955574c4c.
2024-01-14 05:17:01 +01:00
Alexey Milovidov
cb73be8757 Merge branch 'enable-coverage-for-debug-build' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-01-14 05:15:08 +01:00
Alexey Milovidov
6405decbb0 Fix Python 2024-01-14 05:14:54 +01:00
Alexey Milovidov
564a9f0d6c Fix bash 2024-01-14 04:11:31 +01:00
robot-clickhouse
0219d58d92 Automatic style fix 2024-01-14 02:56:50 +00:00
Alexey Milovidov
1afc5e8c01 Enable coverage for debug build 2024-01-14 03:45:42 +01:00
Alexey Milovidov
dc76cb5beb Fix error 2024-01-14 03:25:42 +01:00
Alexey Milovidov
6955574c4c Fix Docker 2024-01-14 00:02:13 +01:00
Alexey Milovidov
7ca8ea9d23 Simplify stateful tests 2024-01-13 23:53:01 +01:00
Kruglov Pavel
8d7c24aa5a Install pyarrow in stateless tests 2024-01-12 13:06:51 +00:00
Kseniia Sumarokova
c211b3bb84
Update configs 2024-01-11 15:53:35 +01:00
Sema Checherinda
e7d33756fa fix a typo 2024-01-10 15:48:02 +01:00
Alexey Milovidov
47ada9440e
Merge pull request #58583 from Eyal-Shalev/patch-1
Support CLICKHOUSE_PASSWORD_FILE environment variable in Dockerfile
2024-01-10 00:43:29 +01:00
Sema Checherinda
6dbf7c967c
Merge pull request #57663 from ClickHouse/CheSema-remote-blobs-naming-2
generate object storage key by template
2024-01-09 13:26:56 +01:00
avogar
070a27fa44 better 2024-01-08 22:16:07 +00:00
Kruglov Pavel
66abfee982
Make better 2024-01-08 19:15:54 +01:00
avogar
76a512f210 Fix query 2024-01-08 14:07:55 +00:00
avogar
3165041f70 Fix 2024-01-08 14:07:07 +00:00
avogar
fe73431506 Move settings changes check to upgrade check 2024-01-08 14:06:38 +00:00
Eyal Halpern Shalev
14a869e518
Support CLICKHOUSE_PASSWORD_FILE environment variable in Dockerfile
Implement #58575
2024-01-07 21:10:57 +02:00
Kruglov Pavel
112a197593
Update images.json 2024-01-05 19:42:16 +01:00
avogar
7f8a8ce2d3 Fix typo 2024-01-05 16:46:19 +00:00
avogar
1d630e9a44 Set rebuild PR 2024-01-05 16:45:22 +00:00
avogar
778f2d0632 Add settings changes check to CI 2024-01-05 16:43:54 +00:00
robot-clickhouse
5b9cc914db Update version_date.tsv and changelogs after v23.8.9.54-lts 2024-01-05 14:11:11 +00:00
Sema Checherinda
c59a72b987 fix special build, add randomization to stateless tests 2024-01-05 13:42:30 +00:00
Sema Checherinda
8ab4aa3423 enable randomization setting 2024-01-05 13:42:30 +00:00
Max Kainov
82d3d57053 Sync content of the docker test images 2024-01-04 12:45:17 +00:00
Blargian
58cdda5265 updated docker/packager/README.md to use clang-17 and not clang-14 as required by packager python script 2023-12-30 22:04:45 +01:00
robot-clickhouse
27657a3eb6 Update version_date.tsv and changelogs after v23.12.1.1368-stable 2023-12-28 10:32:09 +00:00
Alexey Milovidov
dcc1f0c428
Merge pull request #58168 from ClickHouse/udpate-statefull-run-sh
Update docker/test/stateful/run.sh
2023-12-23 01:40:53 +01:00
Alexander Tokmakov
555128aed6
Merge pull request #58078 from ClickHouse/tavplubix-patch-9
Fix Tests Bugfix Validate Check
2023-12-22 20:01:50 +01:00
kssenii
1e19d84811 Update stateful/run.sh 2023-12-22 18:43:29 +01:00
Mikhail f. Shiryaev
4a04a1316f
Add a tag processing for python-bottle 2023-12-21 16:11:54 +01:00
robot-clickhouse
547050d41b Update version_date.tsv and changelogs after v23.11.3.23-stable 2023-12-21 08:44:28 +00:00
Alexander Tokmakov
961cb894b5
Update run.sh 2023-12-20 16:56:39 +01:00
Sema Checherinda
b4fec61814 fix style and black 2023-12-19 13:43:35 +01:00
Sema Checherinda
939d602c3c fix typo 2023-12-18 19:30:05 +01:00
Sema Checherinda
a12fe7473c add killed by timeout message 2023-12-18 18:08:57 +01:00
Max K
84e5870b71
Reapply "improve CI with digest for docker, build and test jobs" (#57904)
* Revert "Revert "improve CI with digest for docker, build and test jobs""

* fix: docker manifest merge for missing images only
2023-12-18 09:07:22 +01:00
Alexey Milovidov
72e3a7e86e Implement FIXME 2023-12-17 22:00:39 +01:00
Azat Khuzhin
60bf2a45e2 Fix docker image for integration tests (fixes CI)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-16 21:51:39 +01:00
Alexey Milovidov
4ff0eefe23
Merge pull request #57905 from ClickHouse/thiny-builder
Remove heavy rust stable toolchain
2023-12-15 21:47:48 +01:00
Mikhail f. Shiryaev
55467c5cfa
Remove heavy rust stable toolchain 2023-12-15 16:35:13 +01:00
Max K
8c7add0334 Revert "improve CI with digest for docker, build and test jobs (#56317)"
This reverts commit 7844fcc196.
2023-12-15 15:48:01 +01:00
Nikita Mikhaylov
1780671443
ClickHouse Cloud promotion (#57638)
Co-authored-by: Alexander Sapin <alesapin@gmail.com>
2023-12-15 15:23:23 +01:00
Max K
7844fcc196
improve CI with digest for docker, build and test jobs (#56317)
* CI with digests to tag docker images, reuse builds, reuse tests and others
2023-12-15 15:21:20 +01:00
Alexey Milovidov
781ba52376 ClickBench: slightly better 2023-12-13 22:12:53 +01:00
Alexey Milovidov
0bb267cf0b
Merge pull request #57824 from ClickHouse/auto/v23.11.2.11-stable
Update version_date.tsv and changelogs after v23.11.2.11-stable
2023-12-13 19:54:45 +01:00
Alexey Milovidov
bf4964b177
Merge pull request #57712 from ClickHouse/clickbench-ci
Add ClickBench to CI
2023-12-13 19:52:44 +01:00
robot-clickhouse
30e6797c7e Update version_date.tsv and changelogs after v23.11.2.11-stable 2023-12-13 17:19:14 +00:00
Alexey Milovidov
fa7190805a A timeout 2023-12-13 17:59:55 +01:00
Igor Nikonov
c165be76ab
Parallel replicas: friendly settings (#57542) 2023-12-13 14:42:06 +01:00
Alexey Milovidov
62b6d1ef5e iMerge branch 'master' of github.com:ClickHouse/ClickHouse into clickbench-ci 2023-12-13 01:41:27 +01:00
Alexey Milovidov
9f5299e118 Use a new bucket 2023-12-13 00:11:10 +01:00
Alexey Milovidov
2043791ed7 Fix typo 2023-12-12 23:37:55 +01:00
Alexey Milovidov
d51aaddf12 Use the local region 2023-12-12 22:15:19 +01:00
Alexey Milovidov
2099130bd2 Enable text_log 2023-12-12 21:28:28 +01:00
Alexey Milovidov
4c1860b9b4 Fix a mistake 2023-12-12 21:21:58 +01:00
Alexey Milovidov
49aad9c88e Maybe better 2023-12-12 19:33:08 +01:00
Alexey Milovidov
12561c0c9b Maybe better 2023-12-12 16:42:31 +01:00
Alexey Milovidov
af4f1abadd Fix error 2023-12-12 16:41:38 +01:00
Kseniia Sumarokova
91d36ad224
Merge pull request #57076 from ClickHouse/slru-for-filesystem-cache
Implement SLRU cache policy for filesystem cache
2023-12-12 10:20:58 +01:00
Alexey Milovidov
9789c2caa2 Review fixes 2023-12-12 05:48:09 +01:00
Alexey Milovidov
b40e04a8be Export the logs 2023-12-12 05:04:37 +01:00
Alexey Milovidov
4240e48a5e Sending the logs better 2023-12-12 04:55:16 +01:00
Alexey Milovidov
c76ceb29fd Minor changes 2023-12-11 17:21:02 +01:00
kssenii
fc4e6d70d8 Update run.sh 2023-12-11 14:24:05 +01:00
kssenii
3652419873 Update run.sh 2023-12-11 11:01:13 +01:00
Alexey Milovidov
740ceea108 Docker 2023-12-11 03:10:17 +01:00
Alexey Milovidov
7df7793724 Docker 2023-12-10 23:53:22 +01:00
Alexey Milovidov
bb501a0e13 Shellcheck 2023-12-10 19:06:38 +01:00
Alexey Milovidov
070934afad Merge branch 'master' of github.com:ClickHouse/ClickHouse into clickbench-ci 2023-12-10 17:43:50 +01:00
Alexey Milovidov
f2875068be Style 2023-12-10 00:19:30 +01:00
Alexey Milovidov
3ac3a06561 Add ClickBench to CI 2023-12-09 23:31:05 +01:00
Alexey Milovidov
f3def573c6 Switch Fast Test to Musl 2023-12-09 21:54:09 +01:00
Alexey Milovidov
0157066fc5 Merge branch 'master' into musl-7 2023-12-09 15:19:38 +01:00
Mikhail f. Shiryaev
8bcc4b879c
Pin alpine version of integration tests helper container 2023-12-08 14:15:28 +01:00
Alexey Milovidov
15a0e6ab05 Merge branch 'master' into musl-7 2023-12-08 03:19:55 +01:00
kssenii
725571461d Merge remote-tracking branch 'origin/master' into slru-for-filesystem-cache 2023-12-07 19:49:03 +01:00
robot-clickhouse
2bd0888966 Update version_date.tsv and changelogs after v23.11.1.2711-stable 2023-12-06 23:05:48 +00:00
Mikhail f. Shiryaev
7dbe435c36
Ignore rare removal race issue "No such file or directory" 2023-12-06 15:40:43 +01:00
Alexey Milovidov
c729d06e27
Merge pull request #56078 from hanfei1991/hanfei/sqllogic
try to work sqllogic-test out
2023-12-05 06:37:29 +01:00
Alexey Milovidov
02439eee58
Merge pull request #49351 from ClickHouse/async-loader-integration
Asynchronous loading of tables
2023-12-04 17:16:12 +01:00
kssenii
fd2c9dcc1a One more fix for bugfix check 2023-12-04 11:01:09 +01:00
alesapin
e8864a94cc
Update docker/test/stateless/run.sh 2023-12-03 22:33:35 +01:00
alesapin
a5782cb56b Revert "Revert bugfix check fix attempt"
This reverts commit dcc5ae2928.
2023-12-03 16:04:22 +01:00
kssenii
dcc5ae2928 Revert bugfix check fix attempt 2023-12-01 20:23:39 +01:00
Kseniia Sumarokova
98eb061812
Update run.sh 2023-12-01 13:49:31 +01:00
Kseniia Sumarokova
12368d56c1
Update run.sh 2023-12-01 13:44:35 +01:00
kssenii
bdf7d0907f Fix shellcheck 2023-11-30 21:30:39 +01:00
kssenii
0e9aa9b1cd Try fix bugfix check 2023-11-30 14:14:32 +01:00
kssenii
296afceed8 Merge remote-tracking branch 'origin/master' into fix-backup-restore-with-mv 2023-11-29 18:06:09 +01:00
kssenii
122146ca0f Update config (see https://github.com/ClickHouse/ClickHouse/pull/57257\#discussion_r1406629948) 2023-11-29 13:44:49 +01:00
Han Fei
824e9ef664 Merge branch 'master' into hanfei/sqllogic 2023-11-27 15:15:35 +01:00
Alexey Milovidov
49d4a90a0e Merge branch 'master' of github.com:ClickHouse/ClickHouse into musl-7 2023-11-26 17:55:17 +01:00
Alexey Milovidov
8ec4a90cb4 Fix error 2023-11-26 17:55:13 +01:00
Alexey Milovidov
f8ebe5134d
Merge pull request #55836 from azat/dist/limit-by-fix
RFC: Fix "Cannot find column X in source stream" for Distributed queries with LIMIT BY
2023-11-26 04:03:41 +01:00
Alexey Milovidov
b2d8103d19 Add special build with Musl 2023-11-26 02:27:54 +01:00
robot-clickhouse
2bb12386dd Update version_date.tsv and changelogs after v23.9.6.20-stable 2023-11-25 18:37:17 +00:00
Alexey Milovidov
91cc132feb
Merge pull request #56873 from ClickHouse/memory-for-client-in-stress-and-fuzzer
Set limit for memory usage for client in Stress tests and ASTFuzzers
2023-11-24 23:15:27 +01:00
Alexey Milovidov
bad410c6c4
Update run-fuzzer.sh 2023-11-24 23:10:48 +03:00
Alexey Milovidov
9e72cea249
Merge pull request #57128 from azat/tests/fix-logs-artifacts
Fix system.*_log in artifacts on CI
2023-11-24 21:05:46 +01:00
Alexey Milovidov
851e96cd80
Merge pull request #57130 from azat/ci/no-traces-symbolize-in-debug
Do not symbolize traces for debug/sanitizer builds for sending to cloud
2023-11-24 21:04:43 +01:00
Mikhail f. Shiryaev
dce47b4af4
Remove long-living remainings 2023-11-24 20:23:12 +01:00
kssenii
69260e322e Randomize cache policy in ci 2023-11-23 16:57:13 +01:00
Azat Khuzhin
9b258f4b09 Do not symbolize traces for debug/sanitizer builds for sending to cloud
debug/sanitizer builds is very slow and symbolizing can take awhile, for
example this increases the time for `system flush logs`, and likely make
`02152_http_external_tables_memory_tracking` flaky again (#53215):

    azat@s1:~/ch/tmp$ zstd -cdq clickhouse-server.log.zst | grep -a -e 2dd61ba3-5a26-4b38-8979-af82cf3ff8bd -e 75b3cbcb-1d09-44ac-a82b-317b4fabfea9 -e 75ad1065-51cc-4c94-95a2-f9dd22981edd -e dc991967-4443-458b-84f0-2646a8d32a76 | grep trace_log -A1
    2023.11.22 05:46:32.872164 [ 59150 ] {2dd61ba3-5a26-4b38-8979-af82cf3ff8bd} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 308544
    2023.11.22 05:47:23.352098 [ 59150 ] {2dd61ba3-5a26-4b38-8979-af82cf3ff8bd} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0
    --
    2023.11.22 05:47:46.158400 [ 59158 ] {75b3cbcb-1d09-44ac-a82b-317b4fabfea9} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 328185
    2023.11.22 05:48:38.392275 [ 59158 ] {75b3cbcb-1d09-44ac-a82b-317b4fabfea9} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0
    --
    2023.11.22 05:49:07.348590 [ 59150 ] {75ad1065-51cc-4c94-95a2-f9dd22981edd} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 347744
    2023.11.22 05:50:00.265529 [ 59150 ] {75ad1065-51cc-4c94-95a2-f9dd22981edd} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0
    --
    2023.11.22 05:50:25.743286 [ 59158 ] {dc991967-4443-458b-84f0-2646a8d32a76} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 367101
    2023.11.22 05:51:15.567347 [ 59158 ] {dc991967-4443-458b-84f0-2646a8d32a76} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-23 14:49:28 +01:00
serxa
0fc25fbda8 Merge branch 'master' into async-loader-integration 2023-11-23 09:32:43 +00:00
Azat Khuzhin
3903b4bb39 Fix system.*_log in artifacts on CI
For now it is broken due to #53086:

    Code: 701. DB::Exception: Requested cluster 'system_logs_export' not found: Cannot attach table `system`.`query_views_log_sender` from metadata file /var/lib/clickhouse/store/c05/c05d0eb0-ac48-4b02-aea4-f05cf4f875a5/query_views_log_sender.sql from query ATTACH TABLE system.query_views_log_sender UUID 'ffd9aed6-344c-4b1b-8444-287d82c5a712' (`pull_request_number` UInt32, `commit_sha` String, `check_start_time` DateTime('UTC'), `check_name` LowCardinality(String), `instance_type` LowCardinality(String), `instance_id` String, `event_date` Date, `event_time` DateTime, `event_time_microseconds` DateTime64(6), `view_duration_ms` UInt64, `initial_query_id` String, `view_name` String, `view_uuid` UUID, `view_type` Enum8('Default' = 1, 'Materialized' = 2, 'Live' = 3, 'Window' = 4), `view_query` String, `view_target` String, `read_rows` UInt64, `read_bytes` UInt64, `written_rows` UInt64, `written_bytes` UInt64, `peak_memory_usage` Int64, `ProfileEvents` Map(String, UInt64), `status` Enum8('QueryStart' = 1, 'QueryFinish' = 2, 'ExceptionBeforeStart' = 3, 'ExceptionWhileProcessing' = 4), `exception_code` Int32, `exception` String, `stack_trace` String) ENGINE = Distributed('system_logs_export', 'default', 'query_views_log_17512133378547479980') SETTINGS flush_on_detach = 0. (CLUSTER_DOESNT_EXIST)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-22 21:00:51 +01:00
Kseniia Sumarokova
d384762123
Merge branch 'master' into fs-cache-improvement 2023-11-21 11:24:52 +01:00
Alexey Milovidov
3c2cf5dc70 Enable Analyzer in Stress and Fuzz tests 2023-11-20 21:52:47 +01:00
Mikhail f. Shiryaev
c3a3cf8d24
Make check for the limited cmake dependencies the part of sparse checkout 2023-11-20 13:08:49 +01:00