thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-11 00:42:29 +00:00
Code Issues Packages Projects Releases Wiki Activity
153,955 Commits 9,281 Branches 1,782 Tags 2 GiB
f3a6901585
Commit Graph

5234 Commits

Author SHA1 Message Date
Alexander Tokmakov
5798898314
Merge pull request #65309 from ClickHouse/save_server_data 
Save server data for failed stateless tests
 2024-06-18 18:46:24 +00:00
Pablo Marcos
216d26987a Add test and config changes for system.error_log 2024-06-18 08:37:40 +00:00
Alexander Tokmakov
fb110827f8 save server data for failed stateless tests 2024-06-17 23:29:03 +02:00
Alexey Milovidov
24dfc10755 Remove outdated override in stress tests 2024-06-16 12:57:05 +02:00
Alexey Milovidov
f27880eb81
Merge pull request #65240 from ClickHouse/auto/v24.5.3.5-stable 
Update version_date.tsv and changelogs after v24.5.3.5-stable
 2024-06-14 03:42:48 +00:00
Alexey Milovidov
e3f16ea491
Merge pull request #65247 from ClickHouse/fix-libunwind 
Fix libunwind in CI
 2024-06-14 00:22:15 +00:00
Alexey Milovidov
02677892e3 Fix libunwind in CI 2024-06-13 21:03:02 +02:00
robot-clickhouse
3bba8e80f1 Update version_date.tsv and changelogs after v24.5.3.5-stable 2024-06-13 17:51:46 +00:00
robot-clickhouse
833d138383 Update version_date.tsv and changelogs after v24.3.4.147-lts 2024-06-13 16:28:12 +00:00
Mikhail f. Shiryaev
f1707998d2
Fix search issues for progress_func, add zstd for GH cache 2024-06-13 15:40:38 +02:00
Mikhail f. Shiryaev
94c82787c5
Add a progress function for searching PRs in changelog.py 2024-06-12 14:43:26 +02:00
Mikhail f. Shiryaev
182f85b25c
Test if unit-tests can be decreased 2024-06-11 16:09:31 +02:00
Alexey Milovidov
821c7322bd
Merge pull request #58349 from azat/ci/flake8 
Check python code with flake8
 2024-06-06 19:03:58 +02:00
Mikhail f. Shiryaev
1156233ea8
Use a proper way to download packages from releases 2024-06-06 07:24:58 +02:00
alesapin
59784a4cf2 Upload blob_storage_log from stateless tests 2024-06-05 15:04:15 +02:00
Azat Khuzhin
11905682a9 Check python code with flake8 
Recently assert-on-tuple had been introduced in tests [1], let's prevent
this.

  [1]: https://github.com/ClickHouse/ClickHouse/pull/56367#discussion_r1437098533

v2: pin flake8 to 4.0.1 (instead of originally 6.1) due to other dependencies, hope that it will find such errors
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-06-05 14:46:38 +02:00
Mikhail f. Shiryaev
bad3f2d384
Migrate changelog from outdated fuzzywuzzy to a new thefuzz 2024-06-04 21:29:53 +02:00
Alexey Milovidov
955db75a0d
Merge pull request #64542 from Algunenano/upgrade_tests 
Upgrade tests: Update config and work with release candidates
 2024-06-02 20:12:32 +02:00
robot-clickhouse
eef5875506 Update version_date.tsv and changelogs after v24.5.1.1763-stable 2024-06-01 07:48:53 +00:00
Raúl Marín
b9af76538e Upgrade test: Detect setting changes across multiple releases (RC) 2024-05-28 19:49:54 +02:00
Raúl Marín
5b6c738532 Remove old config changes 2024-05-28 17:31:49 +02:00
Nikita Mikhaylov
7c9f36ad1e
Add gh to style-check dockerfile 2024-05-22 19:46:08 +02:00
Alexey Milovidov
d5c52e08df Merge branch 'master' into retries-in-submodules 2024-05-20 17:32:00 +02:00
Azat Khuzhin
434816820d Fix upgrade settings changes check 
settings changes check simply checks that the settings are either the
same, or there is a record in system.settings_changes, however, the
problem is that clickhouse-local now adjusts some settings for Pretty
format in case of stdout is not a tty, and this is the case for this
check.

So to avoid this, just run the clickhouse-local under script(1) to fool
it.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-05-20 10:19:11 +02:00
Alexey Milovidov
63f31d3c1e Add retries in git submodule update 2024-05-20 06:13:06 +02:00
Alexey Milovidov
ce4158f496
Merge pull request #64082 from ClickHouse/prevent-stack-overflow-ci 
Prevent stack overflow in Fuzzer and Stress test
 2024-05-20 05:14:59 +02:00
Azat Khuzhin
3743b4a2ed Fix sanitizers build by updating llvm/clang that includes fix for it 
Rebuild for clang 18.1.3, that contains a workaround [1] for sanitizers
issue [2]:

    $ git tag --contains  c2a57034eff048cd36c563c8e0051db3a70991b3 | tail -1
    llvmorg-18.1.3

 [1]: c2a57034ef
 [2]: https://github.com/ClickHouse/ClickHouse/issues/64086

Since right now version is not enough:

    $ docker run --rm -it clickhouse/test-util llvm-nm-18 --version
    llvm-nm, compatible with GNU nm
    Ubuntu LLVM version 18.1.2
      Optimized build.

But I don't see any fix for TSan, only MSan, but let's try.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-05-18 16:43:19 +02:00
Alexey Milovidov
a2d9a32652
Merge pull request #63733 from qiangxuhui/qiangxuhui-loongarch64 
Initial support for loongarch64
 2024-05-18 05:26:26 +02:00
Alexey Milovidov
cafd074e0a Prevent stack overflow in Fuzzer and Stress test 2024-05-18 05:11:18 +02:00
Alexey Milovidov
26501178e6 Fix analyzer 2024-05-17 10:23:32 +02:00
Robert Schulze
5fb8ea4c62
Merge remote-tracking branch 'ClickHouse/master' into qiangxuhui-loongarch64 2024-05-17 07:56:01 +00:00
qiangxuhui
c30dea2d30 Fix loongarch64's CI code 2024-05-14 11:05:55 +00:00
qiangxuhui
13508de9a4 Fix code according to review suggestions 2024-05-14 10:49:09 +00:00
qiangxuhui
537b56b139 Add loongarch64 CI support 2024-05-14 08:15:28 +00:00
divanik
faef8807d2 Resolve conflicts 2024-05-13 12:04:06 +00:00
divanik
d468a0a577 Add archives reading support to s3 2024-05-13 12:00:15 +00:00
Alexey Milovidov
a1e6d1a6a9 Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-05-11 00:42:14 +02:00
Mikhail f. Shiryaev
544875fd2f
Apply markdownfmt.sh from https://github.com/docker-library/docs 2024-05-10 10:55:24 +02:00
Mikhail f. Shiryaev
291bb14696
The Dockerfile is reviewed by docker-official 
`apt-get upgrade` shouldn't be executed during the build
`apt-get clean` is a noop
`gpg` should use batch and download key by full fingreprints
The CI specific steps shouln't be presented in docker library
Using `COPY --chmod` instead of two layers is not possible yet, but
  entrypoint.sh already contains +x bit in the git repo
 2024-05-10 10:54:27 +02:00
Alexey Milovidov
dd58af7d4f Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-05-10 07:17:39 +02:00
Konstantin Bogdanov
27551ca3c7
Add jwcrypto to integration tests runner 2024-05-09 04:08:21 +03:00
Alexey Milovidov
773654c46e Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-05-08 21:24:04 +02:00
Raúl Marín
92bb69e062
Merge pull request #63470 from Algunenano/stress_constraints 
Extra constraints for stress and fuzzer tests
 2024-05-07 15:29:25 +00:00
Raúl Marín
463f95e956 Extra constraints for stress and fuzzer tests 2024-05-07 13:47:35 +02:00
Alexey Milovidov
fd430585e1 Merge remote-tracking branch 'origin/master' into fix-coverage 2024-05-07 09:34:00 +02:00
Alexey Milovidov
5f52cb43b4 Fix coverage. 2024-05-07 09:33:47 +02:00
Alexey Milovidov
98fb9f36a9 We are using Shared Catalog in the CI Logs cluster 2024-05-07 05:35:04 +02:00
alesapin
4eb5bea203
Merge pull request #63354 from ClickHouse/fix_azurite_version 
Rollback azurite to working version
 2024-05-06 09:25:23 +00:00
Alexey Milovidov
46bd25128c
Merge branch 'master' into clang-18-ci 2024-05-06 02:51:58 +02:00
alesapin
b8b4a3a6dd Fxi 2024-05-04 12:24:07 +02:00
Anton Popov
b991f77d04 randomize setting enable_block_offset_column in stress tests 2024-05-03 17:22:37 +00:00
Alexander Sapin
b1eb0a8e9c Try rollback azurite 
(cherry picked from commit 967e51c1d6)
 2024-05-03 18:42:59 +02:00
Robert Schulze
15e67fee78
Merge remote-tracking branch 'ClickHouse/master' into hlee-z-build-fix 2024-05-02 07:02:24 +00:00
robot-clickhouse
811ae63c0f Update version_date.tsv and changelogs after v24.4.1.2088-stable 2024-05-01 02:02:57 +00:00
Robert Schulze
6af89ecf12
Revert "Disable s390x build" 
This reverts commit 116393c951.
 2024-04-30 10:02:19 +00:00
alesapin
c7a6af3c4a Fix stateful 2024-04-27 21:47:48 +02:00
alesapin
78e6d62ed3
Merge branch 'master' into ci_add_azure_tests 2024-04-27 12:33:42 +02:00
alesapin
b4e3880c6b Test work without azurite 2024-04-27 12:30:28 +02:00
alesapin
8b050b2548 Merge branch 'ci_add_azure_tests' of github.com:ClickHouse/ClickHouse into ci_add_azure_tests 2024-04-26 19:18:18 +02:00
alesapin
349147b5b5 One more time 2024-04-26 19:16:27 +02:00
Nikita Mikhaylov
5c2fa14287
Merge branch 'master' into clang-18-ci 2024-04-25 13:19:17 +02:00
Alexander Sapin
adfe2f78a9 Try to make error more clear 2024-04-25 12:35:08 +02:00
alesapin
4d0ce04a91 Always start clickhouse with env forwarding 2024-04-24 20:03:23 +02:00
Ilya Golshtein
01de28b6c1 kerberized_hadoop_dockerfile: ADD instead of wget, no final OR 2024-04-24 20:36:35 +03:00
Ilya Golshtein
7d82260e3a kerberized_hadoop_dockerfile: get from https via wget 2024-04-24 20:36:35 +03:00
alesapin
68ff44259e Merge branch 'ci_add_azure_tests' of github.com:ClickHouse/ClickHouse into ci_add_azure_tests 2024-04-24 17:31:05 +02:00
Nikolay Degterinsky
26308744ac
Update run.sh 2024-04-24 02:50:04 +02:00
Mikhail f. Shiryaev
63d2f75f05
Fix accumulated shellcheck issues 2024-04-18 18:04:10 +02:00
Alexander Sapin
9896c50c3f azurite only in memory 2024-04-17 14:53:45 +02:00
Raúl Marín
5849aeb8c3
Merge pull request #62297 from Algunenano/rust_vendor 
Vendor rust dependencies
 2024-04-17 12:36:27 +00:00
Smita Kulkarni
d1a81e718c Merge branch 'master' into ci_add_azure_tests 2024-04-17 14:26:41 +02:00
Robert Schulze
4e881be128
Merge pull request #62634 from liuneng1994/std-except-parseDateTIme 
Speed up `parseDateTime[InJodaSyntax]Or(Null|Zero)` on invalid inputs
 2024-04-16 13:42:10 +00:00
Alexey Milovidov
e65dc63609
Merge branch 'master' into rust_vendor 2024-04-16 10:10:34 +02:00
Robert Schulze
01c55e69e6
Merge pull request #59870 from rschu1ze/be-less-boring-32 
boringssl --> OpenSSL 3.2
 2024-04-16 06:59:08 +00:00
Alexander Sapin
90ef5cc516 better 2024-04-15 18:52:17 +02:00
Robert Schulze
7dc05d092b
Merge remote-tracking branch 'rschu1ze/master' into be-less-boring-32 2024-04-15 16:35:10 +00:00
Alexander Sapin
c0c8c3be99 Fix 2024-04-15 17:28:22 +02:00
Robert Schulze
a86f769e25
Fix FastTest 2024-04-15 14:06:59 +00:00
Alexander Sapin
45d49ca53d I'll shut you down 2024-04-15 15:46:41 +02:00
Alexander Sapin
949ec8d44c Silence 2024-04-15 15:33:25 +02:00
Alexander Sapin
0f2cc6e00a Disable logs 2024-04-15 15:17:36 +02:00
Alexander Sapin
daea269a28 Try without debug logs 2024-04-15 14:42:20 +02:00
Robert Schulze
3c35f14804
Merge remote-tracking branch 'ClickHouse/master' into mkmkme/protobuf-25.1 2024-04-15 12:38:59 +00:00
Raúl Marín
69245545fa
Merge branch 'master' into rust_vendor 2024-04-15 10:57:01 +01:00
Alexander Tokmakov
d510c3ac55
Merge pull request #62266 from ClickHouse/cannot_allocate_thread 
Add fault injection for "Cannot allocate thread"
 2024-04-12 14:40:42 +00:00
Max Kainov
053c3cc0c1 redirect azure logs 2024-04-12 10:22:03 +00:00
Alexey Milovidov
164a8d6097
Merge branch 'master' into clang-18-ci 2024-04-12 03:49:10 +02:00
Alexey Milovidov
d903e189c4
Update docker/test/stateless/run.sh 2024-04-12 01:01:04 +02:00
Raúl Marín
361d73f7a4 Try to fix Bugfix validation job 2024-04-12 00:07:53 +02:00
Alexander Tokmakov
55c510563c Merge branch 'master' into cannot_allocate_thread 2024-04-11 23:06:17 +02:00
Raúl Marín
aa09876220 Merge remote-tracking branch 'blessed/master' into rust_vendor 2024-04-11 18:52:28 +02:00
Raúl Marín
0273b39804 Merge remote-tracking branch 'blessed/master' into rust_vendor 2024-04-10 22:05:20 +02:00
Alexander Tokmakov
d8e97b51bf Merge branch 'master' into cannot_allocate_thread 2024-04-10 21:21:42 +02:00
Raúl Marín
12569cc5fe Don't allow the fuzzer to change allow_experimental_analyzer 2024-04-10 18:18:47 +02:00
Raúl Marín
26469c9c10 Update rustc to nightly-2024-04-01 2024-04-09 19:16:46 +02:00
Nikolay Degterinsky
6f78e89044 Merge remote-tracking branch 'upstream/master' into docker-image 2024-04-09 13:13:58 +00:00
Nikolay Degterinsky
f45acef131 Support for a tiny feature in stateless tests image 2024-04-09 00:33:18 +00:00
Alexey Milovidov
8b856702f1
Merge pull request #62214 from ClickHouse/auto/v24.3.2.23-lts 
Update version_date.tsv and changelogs after v24.3.2.23-lts
 2024-04-08 15:11:52 +02:00
Robert Schulze
116393c951
Disable s390x build 2024-04-08 11:04:11 +00:00
Alexey Milovidov
0fccaafda4 Fix tests 2024-04-04 20:06:40 +02:00
Yakov Olkhovskiy
db3d923d4c return WITH_COVERAGE, fix build 2024-04-03 20:25:29 +00:00
Alexander Tokmakov
98ac8031e0 add fault injection 2024-04-03 19:49:23 +02:00
Mikhail Koviazin
e7a664e9df
Merge remote-tracking branch 'upstream/master' into mkmkme/protobuf-25.1 2024-04-03 13:51:37 +03:00
robot-clickhouse
c7a28b137a Update version_date.tsv and changelogs after v24.3.2.23-lts 2024-04-03 07:24:20 +00:00
Yakov Olkhovskiy
8d667ad5a3 fix build.sh 2024-04-01 22:55:51 +00:00
Yakov Olkhovskiy
99e25d762c remove WITH_COVERAGE for fuzzers build 2024-04-01 12:28:51 +00:00
Alexey Milovidov
5e7a90f85f
Merge pull request #62065 from azat/ci/fix-stress-tests-analyzer 
Fix stress tests for analyzer due to experimental WINDOW VIEW (by disabling it)
 2024-04-01 00:16:02 +03:00
Nikolay Degterinsky
85bba8c59d
Merge pull request #62019 from ClickHouse/evillique-patch-2 
Fix logs saving in DatabaseReplicated tests
 2024-03-29 01:00:19 +01:00
Azat Khuzhin
a94143ee19 Fix stress tests for analyzer due to experimental WINDOW VIEW (by disabling it) 
CI found [1]:

    2024.03.28 13:16:00.797344 [ 99740 ] {} <Error> Application: Caught exception while loading metadata: Code: 695. DB::Exception: Load job 'load table 01069_window_view_proc_tumble_watch.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01069_window_view_proc_tumble_watch`.`wv` from metadata file /var/lib/clickhouse/store/dd8/dd82a4f5-5485-4747-9172-8976d1194c54/wv.sql from query ATTACH WINDOW VIEW `01069_window_view_proc_tumble_watch`.wv UUID '35cc7d27-df3b-4569-9cb9-2ccf6cb1ff4c' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01069_window_view_proc_tumble_watch`.mt GROUP BY tumble(timestamp, toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/61997/ced095394b6fb6d50ed8b6834bd5911ad4702c6e/stateless_tests__tsan__s3_storage__[5_5].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-03-28 18:27:43 +01:00
Mikhail Koviazin
a9a1bd1afe
docker/stateless-test: install protobuf-compiler v25.1 2024-03-28 16:08:24 +01:00
Kseniia Sumarokova
5ba2ad53b6
Merge pull request #61163 from ClickHouse/filecache-better-try-reserve 
Less contention in cache, part 3
 2024-03-28 13:24:22 +01:00
Nikolay Degterinsky
dae3a9e389
Fix 2024-03-28 06:31:46 +01:00
Nikolay Degterinsky
54348e5e8c
Fix logs saving in DatabaseReplicated tests 2024-03-28 06:27:48 +01:00
Mikhail f. Shiryaev
fc96a57422
Merge pull request #61683 from mangadex-pub/54767-remove-extraneous-keeper-docker-volumes 
#54767 Remove extraneous volumes in Keeper image
 2024-03-27 22:01:50 +01:00
robot-clickhouse
52417e3d42 Update version_date.tsv and changelogs after v24.3.1.2672-lts 2024-03-27 18:02:02 +00:00
Kseniia Sumarokova
db724b1293
Update create.sql 2024-03-25 19:36:48 +01:00
kssenii
ab17c4c987 Better randomization for stress test, restore trace log level back 2024-03-25 12:15:43 +01:00
Tristan
38fb8b3e9e
Explicitly add /var/lib/clickhouse as volume of keeper 
Since it appears mandatory at the moment with default Keeper config
 2024-03-24 11:19:36 +00:00
Tristan
352c368a54
Update server alpine image template to match improvements in keeper image 2024-03-24 11:19:35 +00:00
Tristan
7962a69770
Cleanup Keeper Dockerfile and Docker entrypoint 2024-03-24 11:19:35 +00:00
Tristan
dff916b64c
Remove extraneous volumes in Keeper image 
Specifically the 2 non-data-related volumes

Fixes issue #54767
 2024-03-24 11:19:34 +00:00
Raúl Marín
e562a7c117
Merge pull request #61706 from Algunenano/fuzzer_again 
Fuzzer: Try a different way to wait for the server
 2024-03-21 21:08:03 +01:00
Alexey Milovidov
9afe096ff5
Merge pull request #61681 from ClickHouse/remove-diagnostics 
Remove clickhouse-diagnostics from the package
 2024-03-21 19:50:47 +03:00
Raúl Marín
4700222a0d Fuzzer: Try a different way to wait for the server 2024-03-21 12:40:07 +01:00
Mikhail f. Shiryaev
ff9a6d0958
Merge pull request #61197 from ClickHouse/merge-commit-style-autofix 
Merge commit style autofix
 2024-03-21 09:59:53 +01:00
Alexey Milovidov
bfc7c3c89e Remove clickhouse-diagnostics 2024-03-21 02:52:51 +01:00
Max K
4f51d891a0
Merge pull request #61597 from ClickHouse/ci_remove_compose_files_from_docker 
CI: remove compose files from integration test docker
 2024-03-20 17:36:13 +01:00
Max Kainov
da28eaf454 CI: remove compose files from integration test docker 
#ci_set_integration
 2024-03-20 14:11:47 +00:00
Raúl Marín
007775c982 Better fuzzer logs 2024-03-20 13:09:26 +01:00
Mikhail f. Shiryaev
6550b6f227
Merge pull request #61607 from ClickHouse/fix-configs-bugfix 
Fix configs for upgrade and bugfix
 2024-03-20 10:44:43 +01:00
kssenii
fd7c732c12 Add one more comment, better cache policy randomizer 2024-03-19 23:09:17 +01:00
Mikhail f. Shiryaev
fce926446b
Fix sed to not produce local_blob_storage_blob_storage 2024-03-19 18:05:57 +01:00
Raúl Marín
b290fda45a
Merge pull request #61333 from Algunenano/fuzz_log 
Minor changes in stress and fuzzer reports
 2024-03-19 17:54:38 +01:00
Mikhail f. Shiryaev
301037ca6a
Replace cat | sed; mv by sed -i 2024-03-19 17:53:32 +01:00
kssenii
595165add0 Merge remote-tracking branch 'origin/master' into filecache-better-try-reserve 2024-03-19 15:12:55 +01:00
Alexey Milovidov
2a4116cfb3
Merge pull request #61410 from tomershafir/thread-fuzzer-sleep-rand 
ThreadFuzzer: randomize sleep time
 2024-03-19 15:56:14 +03:00
Raúl Marín
a6506e8e58 Missed sending the process to background 2024-03-19 12:05:13 +01:00
Raúl Marín
8f318bed0d
Merge pull request #61363 from azat/ci/fix-upgrade-bugfix 
Fix bugfix check (due to "unknown object storage type: azure")
 2024-03-19 11:58:00 +01:00
Raúl Marín
7dbd96cf4e Fix 2024-03-18 19:43:13 +01:00
Raúl Marín
10dd47cf5c Separate CH and sanitizer logs 2024-03-18 16:40:03 +01:00
Raúl Marín
83c660a545 Merge remote-tracking branch 'blessed/master' into fuzz_log 2024-03-18 16:12:50 +01:00
Mikhail f. Shiryaev
0e6b5705fb
Install python-magic in style-check, split pip and apt 2024-03-18 15:04:44 +01:00
kssenii
7931c44ff2 Check static storage policy 2024-03-17 17:40:43 +01:00
robot-clickhouse
e5a1c0e251 Update version_date.tsv and changelogs after v24.2.2.71-stable 2024-03-15 06:50:44 +00:00
Alexey Milovidov
05357bce5c Merge branch 'master' into clang-18-ci 2024-03-15 07:28:04 +01:00
tomershafir
23169117ae thread-fuzzer: randomize sleep time 2024-03-15 00:02:09 +02:00
Azat Khuzhin
02ae7e54a7 Fix bugfix check (due to "unknown object storage type: azure") 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-03-14 14:57:33 +01:00
Mikhail f. Shiryaev
277032e444
Move the least updating cctools into beginning, update it 2024-03-14 14:16:33 +01:00
Mikhail f. Shiryaev
c3aefb28e5
Remove unnecessary layers from clickhouse/cctools 2024-03-14 14:13:15 +01:00
Raúl Marín
f63368d83d Separate stdout and stderr in fuzzer report 2024-03-13 19:12:43 +01:00
Raúl Marín
2982f3b369 Fix stress test sanitizer report 2024-03-13 19:12:43 +01:00
Alexey Milovidov
d3872b155e Merge branch 'master' into clang-18-ci 2024-03-13 09:35:58 +01:00
Raúl Marín
a65ac96b04
Merge pull request #61147 from azat/ci/fix-symbolizer 
Fix llvm symbolizer on CI
 2024-03-12 12:01:43 +01:00
Alexey Milovidov
bdc884dfa5
Merge pull request #60255 from ClickHouse/dont-load-useless-index-parts-in-memory 
Do not load useless columns from the index in memory
 2024-03-12 08:30:53 +03:00
Azat Khuzhin
5a400c181b Fix llvm symbolizer on CI 
In #61011 the whole toolchain installation had been removed from the
base image to reduce image sizes, and this is a good thing indeed.

However it also breaks the symbolizer for sanitizers, which makes
stacktraces unreadable, so let's fix this by getting back llvm package,
this should be OK, since it's size is not gigabytes, but only 48MiB (at
least for llvm-14):

    # dpkg -L llvm-14| xargs file | grep -v directory | cut -d: -f1 | xargs du -sch | grep total
    48M     total

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-03-11 20:36:15 +01:00
Nikita Mikhaylov
cfa042cb04 Merge branch 'master' of github.com:ClickHouse/ClickHouse into rip-copier 2024-03-11 15:45:20 +00:00
Alexey Milovidov
8a484a44e3 Merge branch 'master' into dont-load-useless-index-parts-in-memory 2024-03-11 02:10:20 +01:00
Alexey Milovidov
36e18d7500 Merge branch 'master' into clang-18-ci 2024-03-10 23:57:00 +01:00
Alexey Milovidov
2cc071e0e4 Fix error 2024-03-10 12:48:15 +01:00
Alexey Milovidov
3b8a8c9649 Better gitignore 2024-03-10 09:28:30 +01:00
Alexey Milovidov
9a880c3bb9 Merge branch 'master' into clang-18-ci 2024-03-10 06:59:27 +01:00
Max Kainov
681bd28c87 CI: make style check fast 
#do_not_test
 2024-03-09 20:57:23 +00:00
Nikita Mikhaylov
6b4867f746
Debug fuzzer failures (#61062) 2024-03-08 21:27:56 +01:00
Nikita Mikhaylov
2bc4d27ac6 Bye bye 2024-03-07 19:24:39 +00:00
Mikhail f. Shiryaev
922d4cee63
Set the static image tag for cctools sources 2024-03-07 11:58:42 +01:00
Mikhail f. Shiryaev
484453c703
Create a rare-changing clickhouse/cctools 2024-03-07 11:08:56 +01:00
Mikhail f. Shiryaev
e5a7ec7be6
Do not build odbc driver in sqllogic 2024-03-07 09:52:25 +01:00
Mikhail f. Shiryaev
0cbfe3421f
Reduce size of test images by removing clang from there 2024-03-07 09:52:25 +01:00
Mikhail f. Shiryaev
cf0780a777
Change the binary-builder directory 2024-03-07 09:52:24 +01:00
Mikhail f. Shiryaev
176ed5f96b
Use curl instead of wget 2024-03-07 09:52:24 +01:00
Mikhail f. Shiryaev
1d8fe381be
Update the odbc in stateless tests 2024-03-07 09:52:23 +01:00
Mikhail f. Shiryaev
0cedafef1e
Do not test odbc in fast tests 2024-03-07 09:52:21 +01:00
Mikhail f. Shiryaev
9967c60c53
Update sccache 2024-03-07 09:52:07 +01:00
Mikhail f. Shiryaev
5e597228d7
Merge pull request #60408 from ClickHouse/update-style-python 
Update style python
 2024-03-07 09:32:28 +01:00
Kseniia Sumarokova
0d67d9c79d
Merge pull request #60165 from ClickHouse/fix-for-local-object-storage 
Allow local/azure as object storage type instead of local_blob_storage/azure_blob_storage
 2024-03-07 14:42:44 +08:00
Nikita Mikhaylov
48bea29611
Merge pull request #60654 from ClickHouse/fuzzer-gdb 
Try to run fuzzer under gdb
 2024-03-05 18:52:13 +01:00
Mikhail f. Shiryaev
34bb40583c
Install stubs for python-requests 2024-03-05 16:02:43 +01:00
Mikhail f. Shiryaev
76cbd78331
Update pylint, mypy, and black in style check image 2024-03-05 15:59:07 +01:00
Raúl Marín
738c481cce Fix fuzzer report 2024-03-05 10:36:42 +00:00
Kseniia Sumarokova
6f5d79db24
Merge branch 'master' into fix-for-local-object-storage 2024-03-05 14:14:34 +08:00
Kseniia Sumarokova
9a3312f12d
Remove debug 2024-03-05 11:55:32 +08:00
Kseniia Sumarokova
b5fb12c6ec
Fix typo 2024-03-05 11:54:58 +08:00
Kseniia Sumarokova
c735caf44f
Fix typo 2024-03-05 11:54:13 +08:00
Nikita Mikhaylov
822ef975a5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fuzzer-gdb 2024-03-05 01:30:54 +01:00
Nikita Mikhaylov
e715ff622d Better 2024-03-05 00:52:13 +01:00
Raúl Marín
6e579e6bfa Use awk since it's much simpler 2024-03-04 18:15:53 +01:00
Raúl Marín
0149b8893a Include multiline logs in fuzzer fatal.log report 2024-03-04 17:42:06 +01:00
Mikhail f. Shiryaev
017a81692f
Merge pull request #60553 from ClickHouse/update-shellcheck 
Update shellcheck
 2024-03-04 11:21:34 +01:00
Alexey Milovidov
aeb5b9e921
Merge pull request #60607 from ClickHouse/auto/v24.2.1.2248-stable 
Update version_date.tsv and changelogs after v24.2.1.2248-stable
 2024-03-04 01:50:00 +03:00
Alexey Milovidov
6df3179341 Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-03-03 23:02:20 +01:00
Alexey Milovidov
c51b50aa1a
Merge pull request #60375 from azat/ci/bugfix-check-fix 
Fix bugfix check (due to unknown commit_logs_cache_size_threshold)
 2024-03-03 23:11:40 +03:00
Azat Khuzhin
c343ec4bcf Fix bugfix and upgrade checks (due to "Unknown handler type 'redirect'" error) 
CI: https://s3.amazonaws.com/clickhouse-test-reports/60694/418a6258ac1b55d5e225107bd9ebfc711ca6511b/upgrade_check__msan_.html
CI: https://s3.amazonaws.com/clickhouse-test-reports/60689/707200d2a4ee765c5109dcca78aaaa7f2c63ab85/bugfix_validation.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-03-03 12:00:49 +01:00
Alexey Milovidov
3938d7156a Merge branch 'master' into fix-for-local-object-storage 2024-03-02 19:44:12 +01:00
Nikita Mikhaylov
361ec17c87 gdb... 2024-03-01 15:31:25 +00:00
Mikhail f. Shiryaev
17210bb494
Fix type, add _server suffix to start and stop functions 2024-03-01 00:21:31 +01:00
robot-clickhouse
c1d542d700 Update version_date.tsv and changelogs after v24.2.1.2248-stable 2024-02-29 21:19:40 +00:00
Mikhail f. Shiryaev
82a8308198
Update shellcheck to the latest release 2024-02-29 17:41:35 +01:00
Mikhail f. Shiryaev
f40e25f5c3
Check all shell scripts in docker directories 2024-02-29 17:41:33 +01:00
Alexey Milovidov
ee772aaf0f Use clang-18 in CI 2024-02-27 23:17:11 +01:00
Alexey Milovidov
12ecfbb0d0 Fix wrong log message in Fuzzer 2024-02-26 17:46:51 +01:00
Antonio Andelic
2b51497e55
Update docker/test/stateless/run.sh 2024-02-26 08:50:23 +01:00
Azat Khuzhin
83e7f3e1a1 Fix bugfix check (due to unknown commit_logs_cache_size_threshold) 
Bugfix check is broken on CI [1], because of:

    2024.02.23 06:12:59.294500 [ 757 ] {} Application: Code: 115. DB::Exception: Unknown setting latest_logs_cache_size_threshold: in Coordination settings config. (UNKNOWN_SETTING), Stack trace (when copying this message, always include the lines below):

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/60031/89eb2a38c0a7c113b7b0a96c8069fea6eb48ae9d/bugfix_validation.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-02-24 21:17:03 +01:00
Azat Khuzhin
dd690dd05d Expose fatal.log separately for fuzzer 
Otherwise you have to download the full server.log

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-02-24 19:23:28 +01:00
Alexander Tokmakov
ef3b19167f
Merge pull request #58036 from MikhailBurdukov/backoff_for_failed_mutations 
Backoff policy for failed mutation.
 2024-02-23 15:27:41 +01:00
Kseniia Sumarokova
d3c6761dcf
Update run.sh 2024-02-23 12:06:17 +01:00
Raúl Marín
c359f29842 Merge remote-tracking branch 'blessed/master' into stress_log 2024-02-23 10:50:46 +01:00
Raúl Marín
9c99a2dd2a Maybe better 2024-02-22 13:20:57 +01:00
Raúl Marín
b83b7a7ab7 Stress test: Include the first sanitizer block message in the report 2024-02-22 12:59:12 +01:00
Raúl Marín
5684a14160 Ignore valid 'No such key errors' in stress tests 2024-02-22 11:47:43 +01:00
Kseniia Sumarokova
84d6b4166a
Merge branch 'master' into fix-for-local-object-storage 2024-02-22 11:40:18 +01:00
Antonio Andelic
1b238d1180
Merge pull request #59460 from ClickHouse/keeper-logs-cache 
Keeper log cache
 2024-02-22 09:03:41 +01:00
Kseniia Sumarokova
2836d0bb55
Update run.sh 2024-02-21 18:46:42 +01:00
Max Kainov
9f51e840db CI: integration tests to mysql80 
#ci_set_integration
 #no_merge_commit
 2024-02-21 11:05:47 +00:00
Kseniia Sumarokova
462f597c6b
Update run.sh 2024-02-21 11:02:05 +01:00
MikhailBurdukov
fa5747ab7f Fix stress tests 2024-02-21 08:50:39 +00:00
Kseniia Sumarokova
2405115484
Fix upgrade check 2024-02-20 18:05:48 +01:00
MikhailBurdukov
7cdfedaedd Enable setting by default 2024-02-20 08:39:11 +00:00
Antonio Andelic
299a0bd996 Merge branch 'master' into keeper-logs-cache 2024-02-19 10:01:31 +01:00
Alexey Milovidov
c8415ddc29 Speed up the CI 2024-02-18 09:29:34 +01:00
Antonio Andelic
1ade535a83 Merge branch 'master' into keeper-logs-cache 2024-02-15 13:06:37 +01:00
Alexey Milovidov
91ef665ed3
Merge pull request #59993 from ClickHouse/auto/v24.1.5.6-stable 
Update version_date.tsv and changelogs after v24.1.5.6-stable
 2024-02-14 22:05:34 +01:00
robot-clickhouse
08df19157b Update version_date.tsv and changelogs after v24.1.5.6-stable 2024-02-14 17:22:21 +00:00
jktng
17c9e2df6b
Update entrypoint.sh 2024-02-14 11:39:22 -05:00
Raúl Marín
4fb76a6e25
Merge pull request #59969 from ClickHouse/no-aerospike 
We don't have external dictionaries from Aerospike
 2024-02-14 15:54:46 +01:00
robot-clickhouse
7514158353 Update version_date.tsv and changelogs after v24.1.4.20-stable 2024-02-14 10:30:32 +00:00
Mikhail f. Shiryaev
9e7ac6d0ee
Revert "Update version_date.tsv and changelogs after v24.1.4.19-stable" 2024-02-14 10:07:09 +01:00
Alexey Milovidov
1fbc52fa40 Remove Aerospike 2024-02-14 05:52:39 +01:00
Alexey Milovidov
2870c628c1
Merge pull request #58926 from MyroTk/master 
Include `pytest-reportlog` in the integration tests' CI runner.
 2024-02-14 05:05:51 +01:00
robot-clickhouse
3c0abe08cb Update version_date.tsv and changelogs after v24.1.4.19-stable 2024-02-14 00:29:24 +00:00
MyroTk
6a3c362443
Update Dockerfile 2024-02-12 10:39:26 -08:00
Mikhail f. Shiryaev
1285bdbef1
Merge pull request #59808 from AlexNik/always-initdb-option 
Option to run init db scripts every time
 2024-02-12 12:09:54 +01:00
Alexey Milovidov
a65b9cc1f8
Merge pull request #59800 from ClickHouse/auto/v23.12.4.15-stable 
Update version_date.tsv and changelogs after v23.12.4.15-stable
 2024-02-11 23:41:09 +01:00
Alexey Milovidov
ed02154a4a Fix "Too many parts" 2024-02-10 07:31:54 +01:00
Alexey Milovidov
99b66f75bd Sequential run 2024-02-10 02:27:55 +01:00
Alexander Nikolaev
68df201145 Add CLICKHOUSE_ALWAYS_RUN_INITDB_SCRIPTS envoronment variable. 2024-02-09 16:50:50 +03:00
robot-clickhouse
582abd40fd Update version_date.tsv and changelogs after v23.12.4.15-stable 2024-02-09 12:25:38 +00:00
Alexey Milovidov
d466e8d61e Run coverage collection sequentially 2024-02-09 03:55:39 +01:00
Alexey Milovidov
41ff8b3217 Reading Docker files 2024-02-09 00:15:52 +01:00
Alexey Milovidov
91c607f249 Fix a test 2024-02-08 22:11:37 +01:00
Alexey Milovidov
d38e6158b0 Merge branch 'enable-coverage-for-debug-build' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-02-07 22:46:10 +01:00
Alexey Milovidov
02c0b4c67f Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-02-07 22:45:50 +01:00
robot-clickhouse
64d9d2d467 Automatic style fix 2024-02-07 20:44:35 +00:00
Alexey Milovidov
4d25929d74 A few missing changes 2024-02-07 20:58:40 +01:00
Alexey Milovidov
33401643a4 Fix error 2024-02-07 20:28:37 +01:00
Alexey Milovidov
d65a56d967
Merge branch 'master' into enable-coverage-for-debug-build 2024-02-07 04:58:21 +01:00
Alexey Milovidov
aa91d52277
Merge branch 'master' into master 2024-02-06 23:58:53 +01:00
Raúl Marín
a64ce70671 Pin python dependencies in stateless tests 2024-02-06 20:11:04 +01:00
Antonio Andelic
41202cd7b2
fix upgrade 2024-02-06 09:39:22 +01:00
Antonio Andelic
dd3db5d092 Merge branch 'master' into keeper-logs-cache 2024-02-05 16:56:09 +01:00
Antonio Andelic
b0fde3828b Merge branch 'master' into keeper-logs-cache 2024-02-05 16:55:46 +01:00
Max K
411b76cc57
Merge pull request #59241 from ClickHouse/test_arm 
CI: Add ARM integration tests
 2024-02-05 14:52:46 +01:00
Raúl Marín
08c1799f9c
Merge pull request #59383 from Algunenano/fuzz_literal 
Add some fuzzing to ASTLiterals
 2024-02-05 12:27:43 +01:00
Mikhail f. Shiryaev
31f27ad398
Merge pull request #59337 from ClickHouse/fix-fasttests-gdb 
Some small fixes for docker images
 2024-02-05 11:42:18 +01:00
Max Kainov
6504dfe0b2 CI: Enable ARM integration test 
#ci_set_integration #no_merge_commit
 2024-02-02 17:37:05 +00:00
Raúl Marín
00096e5819 Merge remote-tracking branch 'blessed/master' into fuzz_literal 2024-02-02 17:28:47 +01:00
robot-clickhouse
e7f63abc2f Update version_date.tsv and changelogs after v24.1.2.5-stable 2024-02-02 11:41:46 +00:00
Antonio Andelic
a248491299
remove new settings from older versions 2024-02-02 11:14:03 +01:00
MyroTk
dffc539880
Merge branch 'ClickHouse:master' into master 2024-02-01 17:05:36 -08:00
Mikhail f. Shiryaev
6f1fbdb5ca
Fix the failed upgrade of kazoo to 2.10.0 2024-02-01 11:20:24 +01:00
Mikhail f. Shiryaev
2577f8031b
Add suid bit to gdb in fast tests image 2024-02-01 11:20:23 +01:00
Mikhail f. Shiryaev
76c6dc51bf
Unify the apt cleaning part in Dockerfile's 2024-02-01 11:20:23 +01:00
Azat Khuzhin
ea720e3171 Verify that stripped clickhouse shows symbol names 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-02-01 09:32:59 +01:00
Kseniia Sumarokova
60c37fb9bf
Update run.sh 2024-01-31 13:44:16 +01:00
Raúl Marín
4f0c78d665 Upload one file. Save the planet 2024-01-30 20:29:59 +01:00
robot-clickhouse
ef6c90c71b Update version_date.tsv and changelogs after v24.1.1.2048-stable 2024-01-30 18:01:46 +00:00
Alexey Milovidov
35ea956255
Merge pull request #59295 from ClickHouse/fix_block_number 
Fix `_block_number` column with non-default serializations and mutation
 2024-01-30 04:07:09 +01:00
Alexey Milovidov
cb69a1b25d Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-01-29 15:35:04 +01:00
alesapin
cef109a887 Fix backward compatibility check 2024-01-29 13:19:46 +01:00
Kseniia Sumarokova
f80b226035
Merge pull request #59280 from ClickHouse/kssenii-patch-8 
Update run.sh
 2024-01-29 10:27:33 +01:00
alesapin
b864b122fa Merge branch 'master' into fix_block_number 2024-01-29 10:19:43 +01:00
Alexey Milovidov
b32f9ae037
Merge pull request #59255 from azat/tests/pdb-v2 
Improve pytest --pdb experience by preserving dockerd on SIGINT (v2)
 2024-01-29 00:00:57 +01:00
Alexey Milovidov
4a94ae5a1b Merge branch 'master' into enable-coverage-for-debug-build 2024-01-28 22:24:26 +01:00
Kseniia Sumarokova
cc4d4647f5
Update run.sh 2024-01-28 22:24:03 +01:00
Kseniia Sumarokova
41883ddb34
Update run.sh 2024-01-28 18:15:11 +01:00
Kseniia Sumarokova
febd4ce8d7
Update run.sh 2024-01-28 13:41:33 +01:00
alesapin
d70fe79a1e Revert "Disable randomization of allow_experimental_block_number_column flag (#56474)" 
This reverts commit 951d9ac144.
 2024-01-28 12:28:08 +01:00
Kseniia Sumarokova
24ab61932e
Update run.sh 2024-01-27 22:42:43 +01:00
Kseniia Sumarokova
163a3e44d3
Update run.sh 2024-01-26 21:22:39 +01:00
Azat Khuzhin
94eb33ef27 Improve pytest --pdb experience by preserving dockerd on SIGINT (v2) 
Previous fix (#43392) was not correct, since terminal sends SIGINT to
all processes in a group, so simply ignoring it in parent won't work. So
instead dockerd will be run in a new session.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-01-26 16:06:41 +01:00
Azat Khuzhin
92d96c4d02 Fix fasttest by pinning pip dependencies 
After image update it prints the following warning:

    /ClickHouse/tests/queries/0_stateless/01558_ttest_scipy.python:5: DeprecationWarning:
    Pyarrow will become a required dependency of pandas in the next major release of pandas (pandas 3.0),
    (to allow more performant data types, such as the Arrow string type, and better interoperability with other libraries)
    but was not found to be installed on your system.
    If this would cause problems for you,
    please provide us feedback at https://github.com/pandas-dev/pandas/issues/54466

Pyarrow can be added as well, but according to the comment in the issue
it bloats the image size 170%, so let's simply downgrade it for now and
see how that issue will be resolved (or the warning could be suppressed
of course).

And pin other dependencies as well to avoid further failures.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-01-26 15:08:22 +01:00
Kseniia Sumarokova
291427d931
Update stateless/run.sh 2024-01-23 14:51:55 +01:00
MyroTk
e78eb41264
Update Dockerfile 2024-01-22 15:19:31 -08:00
Kseniia Sumarokova
bfb822b775
Try fix style check 2024-01-22 20:32:47 +01:00
Kseniia Sumarokova
a23d71b7bb
Update run.sh 2024-01-22 18:19:58 +01:00
Alexey Milovidov
09d7817940
Merge pull request #58975 from cangyin/cd-data-dir 
Change working directory to data path
 2024-01-21 15:49:03 +01:00
Alexey Milovidov
dc1dac3ba4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-01-20 21:41:07 +01:00
Alexey Milovidov
735708e9bb Merge branch 'master' into enable-coverage-for-debug-build 2024-01-20 21:40:53 +01:00
Kseniia Sumarokova
5d67e26fc4
Merge pull request #58869 from ClickHouse/force-check-for-cached-custom-disk 
Fix for custom cached disk creation
 2024-01-20 14:47:36 +01:00
cangyin
668d603344 Change working directory to data path 
Take DATA_DIR out of loop
 2024-01-20 10:46:55 +00:00
Alexey Milovidov
8c54a09e66 Fix error 2024-01-20 08:59:29 +01:00
Alexey Milovidov
639d7745d4 Fix error 2024-01-19 17:02:23 +01:00
Kruglov Pavel
55202db06b
Fix 2024-01-19 12:06:10 +01:00
avogar
8f2d78bbbf Merge branch 'master' of github.com:ClickHouse/ClickHouse into settings-changes-check 2024-01-19 11:04:50 +00:00
Kseniia Sumarokova
a661c6b2c0
Update run.sh 2024-01-19 10:37:21 +01:00
alesapin
3dc8b2dbf7
Merge pull request #58955 from ClickHouse/more_safe_way_to_dump_Logs 
More safe way to dump system logs in tests
 2024-01-19 10:20:55 +01:00
Alexander Sapin
ea6ca96c85 More safe way to dump system logs in tests 2024-01-18 17:51:48 +01:00
kssenii
255a52a8ff Fix tests with database replicated 2024-01-18 13:26:47 +01:00
Alexey Milovidov
cc5cc361ef Fix error 2024-01-18 12:35:49 +01:00
Alexey Milovidov
f9ca4e3b85 Slightly better 2024-01-18 00:52:05 +01:00
Alexey Milovidov
f89803ebf6 Slightly better 2024-01-17 23:17:53 +01:00