thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-27 01:51:59 +00:00
Code Issues Packages Projects Releases Wiki Activity
149,260 Commits 9,198 Branches 1,782 Tags 2.1 GiB
67fe443133
Commit Graph

5090 Commits

Author SHA1 Message Date
alesapin
59246cdf92 Merge remote-tracking branch 'origin/master' into unify_tests_with_object_storage 2024-07-03 14:25:59 +02:00
Nikita Fomichev
fe43ea27d2 Tests: fix timeouts handling in case of github timeout termination 2024-07-03 13:37:36 +02:00
alesapin
a2626037bc Improve object storage tags in tests 2024-07-02 14:15:59 +02:00
Kseniia Sumarokova
ee0c4093d4
Update run.sh 2024-07-02 12:03:27 +02:00
robot-clickhouse
46ed186250 Update version_date.tsv and changelogs after v24.5.4.49-stable 2024-07-01 15:05:48 +00:00
Antonio Andelic
4a9daa202d Remove Keeper standalone build 2024-07-01 11:24:45 +02:00
Antonio Andelic
6b47171f2c Keeper binary with different entrypoint 2024-07-01 10:52:08 +02:00
Max K
f66c065d11 CI: JWT python module in Style check image 2024-06-24 19:16:10 +02:00
Pablo Marcos
71f8937abd Merge branch 'master' into system-error-log 2024-06-20 16:33:44 +00:00
Alexander Tokmakov
5798898314
Merge pull request #65309 from ClickHouse/save_server_data 
Save server data for failed stateless tests
 2024-06-18 18:46:24 +00:00
Pablo Marcos
216d26987a Add test and config changes for system.error_log 2024-06-18 08:37:40 +00:00
Alexander Tokmakov
fb110827f8 save server data for failed stateless tests 2024-06-17 23:29:03 +02:00
Alexey Milovidov
24dfc10755 Remove outdated override in stress tests 2024-06-16 12:57:05 +02:00
Alexey Milovidov
f27880eb81
Merge pull request #65240 from ClickHouse/auto/v24.5.3.5-stable 
Update version_date.tsv and changelogs after v24.5.3.5-stable
 2024-06-14 03:42:48 +00:00
Alexey Milovidov
e3f16ea491
Merge pull request #65247 from ClickHouse/fix-libunwind 
Fix libunwind in CI
 2024-06-14 00:22:15 +00:00
Alexey Milovidov
02677892e3 Fix libunwind in CI 2024-06-13 21:03:02 +02:00
robot-clickhouse
3bba8e80f1 Update version_date.tsv and changelogs after v24.5.3.5-stable 2024-06-13 17:51:46 +00:00
robot-clickhouse
833d138383 Update version_date.tsv and changelogs after v24.3.4.147-lts 2024-06-13 16:28:12 +00:00
Mikhail f. Shiryaev
f1707998d2
Fix search issues for progress_func, add zstd for GH cache 2024-06-13 15:40:38 +02:00
Mikhail f. Shiryaev
94c82787c5
Add a progress function for searching PRs in changelog.py 2024-06-12 14:43:26 +02:00
Mikhail f. Shiryaev
182f85b25c
Test if unit-tests can be decreased 2024-06-11 16:09:31 +02:00
Alexey Milovidov
821c7322bd
Merge pull request #58349 from azat/ci/flake8 
Check python code with flake8
 2024-06-06 19:03:58 +02:00
Mikhail f. Shiryaev
1156233ea8
Use a proper way to download packages from releases 2024-06-06 07:24:58 +02:00
alesapin
59784a4cf2 Upload blob_storage_log from stateless tests 2024-06-05 15:04:15 +02:00
Azat Khuzhin
11905682a9 Check python code with flake8 
Recently assert-on-tuple had been introduced in tests [1], let's prevent
this.

  [1]: https://github.com/ClickHouse/ClickHouse/pull/56367#discussion_r1437098533

v2: pin flake8 to 4.0.1 (instead of originally 6.1) due to other dependencies, hope that it will find such errors
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-06-05 14:46:38 +02:00
Mikhail f. Shiryaev
bad3f2d384
Migrate changelog from outdated fuzzywuzzy to a new thefuzz 2024-06-04 21:29:53 +02:00
Alexey Milovidov
955db75a0d
Merge pull request #64542 from Algunenano/upgrade_tests 
Upgrade tests: Update config and work with release candidates
 2024-06-02 20:12:32 +02:00
robot-clickhouse
eef5875506 Update version_date.tsv and changelogs after v24.5.1.1763-stable 2024-06-01 07:48:53 +00:00
Raúl Marín
b9af76538e Upgrade test: Detect setting changes across multiple releases (RC) 2024-05-28 19:49:54 +02:00
Raúl Marín
5b6c738532 Remove old config changes 2024-05-28 17:31:49 +02:00
Nikita Mikhaylov
7c9f36ad1e
Add gh to style-check dockerfile 2024-05-22 19:46:08 +02:00
Alexey Milovidov
d5c52e08df Merge branch 'master' into retries-in-submodules 2024-05-20 17:32:00 +02:00
Azat Khuzhin
434816820d Fix upgrade settings changes check 
settings changes check simply checks that the settings are either the
same, or there is a record in system.settings_changes, however, the
problem is that clickhouse-local now adjusts some settings for Pretty
format in case of stdout is not a tty, and this is the case for this
check.

So to avoid this, just run the clickhouse-local under script(1) to fool
it.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-05-20 10:19:11 +02:00
Alexey Milovidov
63f31d3c1e Add retries in git submodule update 2024-05-20 06:13:06 +02:00
Alexey Milovidov
ce4158f496
Merge pull request #64082 from ClickHouse/prevent-stack-overflow-ci 
Prevent stack overflow in Fuzzer and Stress test
 2024-05-20 05:14:59 +02:00
Azat Khuzhin
3743b4a2ed Fix sanitizers build by updating llvm/clang that includes fix for it 
Rebuild for clang 18.1.3, that contains a workaround [1] for sanitizers
issue [2]:

    $ git tag --contains  c2a57034eff048cd36c563c8e0051db3a70991b3 | tail -1
    llvmorg-18.1.3

 [1]: c2a57034ef
 [2]: https://github.com/ClickHouse/ClickHouse/issues/64086

Since right now version is not enough:

    $ docker run --rm -it clickhouse/test-util llvm-nm-18 --version
    llvm-nm, compatible with GNU nm
    Ubuntu LLVM version 18.1.2
      Optimized build.

But I don't see any fix for TSan, only MSan, but let's try.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-05-18 16:43:19 +02:00
Alexey Milovidov
a2d9a32652
Merge pull request #63733 from qiangxuhui/qiangxuhui-loongarch64 
Initial support for loongarch64
 2024-05-18 05:26:26 +02:00
Alexey Milovidov
cafd074e0a Prevent stack overflow in Fuzzer and Stress test 2024-05-18 05:11:18 +02:00
Alexey Milovidov
26501178e6 Fix analyzer 2024-05-17 10:23:32 +02:00
Robert Schulze
5fb8ea4c62
Merge remote-tracking branch 'ClickHouse/master' into qiangxuhui-loongarch64 2024-05-17 07:56:01 +00:00
qiangxuhui
c30dea2d30 Fix loongarch64's CI code 2024-05-14 11:05:55 +00:00
qiangxuhui
13508de9a4 Fix code according to review suggestions 2024-05-14 10:49:09 +00:00
qiangxuhui
537b56b139 Add loongarch64 CI support 2024-05-14 08:15:28 +00:00
divanik
faef8807d2 Resolve conflicts 2024-05-13 12:04:06 +00:00
divanik
d468a0a577 Add archives reading support to s3 2024-05-13 12:00:15 +00:00
Alexey Milovidov
a1e6d1a6a9 Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-05-11 00:42:14 +02:00
Mikhail f. Shiryaev
544875fd2f
Apply markdownfmt.sh from https://github.com/docker-library/docs 2024-05-10 10:55:24 +02:00
Mikhail f. Shiryaev
291bb14696
The Dockerfile is reviewed by docker-official 
`apt-get upgrade` shouldn't be executed during the build
`apt-get clean` is a noop
`gpg` should use batch and download key by full fingreprints
The CI specific steps shouln't be presented in docker library
Using `COPY --chmod` instead of two layers is not possible yet, but
  entrypoint.sh already contains +x bit in the git repo
 2024-05-10 10:54:27 +02:00
Alexey Milovidov
dd58af7d4f Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-05-10 07:17:39 +02:00
Konstantin Bogdanov
27551ca3c7
Add jwcrypto to integration tests runner 2024-05-09 04:08:21 +03:00
Alexey Milovidov
773654c46e Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-05-08 21:24:04 +02:00
Raúl Marín
92bb69e062
Merge pull request #63470 from Algunenano/stress_constraints 
Extra constraints for stress and fuzzer tests
 2024-05-07 15:29:25 +00:00
Raúl Marín
463f95e956 Extra constraints for stress and fuzzer tests 2024-05-07 13:47:35 +02:00
Alexey Milovidov
fd430585e1 Merge remote-tracking branch 'origin/master' into fix-coverage 2024-05-07 09:34:00 +02:00
Alexey Milovidov
5f52cb43b4 Fix coverage. 2024-05-07 09:33:47 +02:00
Alexey Milovidov
98fb9f36a9 We are using Shared Catalog in the CI Logs cluster 2024-05-07 05:35:04 +02:00
alesapin
4eb5bea203
Merge pull request #63354 from ClickHouse/fix_azurite_version 
Rollback azurite to working version
 2024-05-06 09:25:23 +00:00
Alexey Milovidov
46bd25128c
Merge branch 'master' into clang-18-ci 2024-05-06 02:51:58 +02:00
alesapin
b8b4a3a6dd Fxi 2024-05-04 12:24:07 +02:00
Anton Popov
b991f77d04 randomize setting enable_block_offset_column in stress tests 2024-05-03 17:22:37 +00:00
Alexander Sapin
b1eb0a8e9c Try rollback azurite 
(cherry picked from commit 967e51c1d6)
 2024-05-03 18:42:59 +02:00
Robert Schulze
15e67fee78
Merge remote-tracking branch 'ClickHouse/master' into hlee-z-build-fix 2024-05-02 07:02:24 +00:00
robot-clickhouse
811ae63c0f Update version_date.tsv and changelogs after v24.4.1.2088-stable 2024-05-01 02:02:57 +00:00
Robert Schulze
6af89ecf12
Revert "Disable s390x build" 
This reverts commit 116393c951.
 2024-04-30 10:02:19 +00:00
alesapin
c7a6af3c4a Fix stateful 2024-04-27 21:47:48 +02:00
alesapin
78e6d62ed3
Merge branch 'master' into ci_add_azure_tests 2024-04-27 12:33:42 +02:00
alesapin
b4e3880c6b Test work without azurite 2024-04-27 12:30:28 +02:00
alesapin
8b050b2548 Merge branch 'ci_add_azure_tests' of github.com:ClickHouse/ClickHouse into ci_add_azure_tests 2024-04-26 19:18:18 +02:00
alesapin
349147b5b5 One more time 2024-04-26 19:16:27 +02:00
Nikita Mikhaylov
5c2fa14287
Merge branch 'master' into clang-18-ci 2024-04-25 13:19:17 +02:00
Alexander Sapin
adfe2f78a9 Try to make error more clear 2024-04-25 12:35:08 +02:00
alesapin
4d0ce04a91 Always start clickhouse with env forwarding 2024-04-24 20:03:23 +02:00
Ilya Golshtein
01de28b6c1 kerberized_hadoop_dockerfile: ADD instead of wget, no final OR 2024-04-24 20:36:35 +03:00
Ilya Golshtein
7d82260e3a kerberized_hadoop_dockerfile: get from https via wget 2024-04-24 20:36:35 +03:00
alesapin
68ff44259e Merge branch 'ci_add_azure_tests' of github.com:ClickHouse/ClickHouse into ci_add_azure_tests 2024-04-24 17:31:05 +02:00
Nikolay Degterinsky
26308744ac
Update run.sh 2024-04-24 02:50:04 +02:00
Mikhail f. Shiryaev
63d2f75f05
Fix accumulated shellcheck issues 2024-04-18 18:04:10 +02:00
Alexander Sapin
9896c50c3f azurite only in memory 2024-04-17 14:53:45 +02:00
Raúl Marín
5849aeb8c3
Merge pull request #62297 from Algunenano/rust_vendor 
Vendor rust dependencies
 2024-04-17 12:36:27 +00:00
Smita Kulkarni
d1a81e718c Merge branch 'master' into ci_add_azure_tests 2024-04-17 14:26:41 +02:00
Robert Schulze
4e881be128
Merge pull request #62634 from liuneng1994/std-except-parseDateTIme 
Speed up `parseDateTime[InJodaSyntax]Or(Null|Zero)` on invalid inputs
 2024-04-16 13:42:10 +00:00
Alexey Milovidov
e65dc63609
Merge branch 'master' into rust_vendor 2024-04-16 10:10:34 +02:00
Robert Schulze
01c55e69e6
Merge pull request #59870 from rschu1ze/be-less-boring-32 
boringssl --> OpenSSL 3.2
 2024-04-16 06:59:08 +00:00
Alexander Sapin
90ef5cc516 better 2024-04-15 18:52:17 +02:00
Robert Schulze
7dc05d092b
Merge remote-tracking branch 'rschu1ze/master' into be-less-boring-32 2024-04-15 16:35:10 +00:00
Alexander Sapin
c0c8c3be99 Fix 2024-04-15 17:28:22 +02:00
Robert Schulze
a86f769e25
Fix FastTest 2024-04-15 14:06:59 +00:00
Alexander Sapin
45d49ca53d I'll shut you down 2024-04-15 15:46:41 +02:00
Alexander Sapin
949ec8d44c Silence 2024-04-15 15:33:25 +02:00
Alexander Sapin
0f2cc6e00a Disable logs 2024-04-15 15:17:36 +02:00
Alexander Sapin
daea269a28 Try without debug logs 2024-04-15 14:42:20 +02:00
Robert Schulze
3c35f14804
Merge remote-tracking branch 'ClickHouse/master' into mkmkme/protobuf-25.1 2024-04-15 12:38:59 +00:00
Raúl Marín
69245545fa
Merge branch 'master' into rust_vendor 2024-04-15 10:57:01 +01:00
Alexander Tokmakov
d510c3ac55
Merge pull request #62266 from ClickHouse/cannot_allocate_thread 
Add fault injection for "Cannot allocate thread"
 2024-04-12 14:40:42 +00:00
Max Kainov
053c3cc0c1 redirect azure logs 2024-04-12 10:22:03 +00:00
Alexey Milovidov
164a8d6097
Merge branch 'master' into clang-18-ci 2024-04-12 03:49:10 +02:00
Alexey Milovidov
d903e189c4
Update docker/test/stateless/run.sh 2024-04-12 01:01:04 +02:00
Raúl Marín
361d73f7a4 Try to fix Bugfix validation job 2024-04-12 00:07:53 +02:00
Alexander Tokmakov
55c510563c Merge branch 'master' into cannot_allocate_thread 2024-04-11 23:06:17 +02:00
Raúl Marín
aa09876220 Merge remote-tracking branch 'blessed/master' into rust_vendor 2024-04-11 18:52:28 +02:00
Raúl Marín
0273b39804 Merge remote-tracking branch 'blessed/master' into rust_vendor 2024-04-10 22:05:20 +02:00
Alexander Tokmakov
d8e97b51bf Merge branch 'master' into cannot_allocate_thread 2024-04-10 21:21:42 +02:00
Raúl Marín
12569cc5fe Don't allow the fuzzer to change allow_experimental_analyzer 2024-04-10 18:18:47 +02:00
Raúl Marín
26469c9c10 Update rustc to nightly-2024-04-01 2024-04-09 19:16:46 +02:00
Nikolay Degterinsky
6f78e89044 Merge remote-tracking branch 'upstream/master' into docker-image 2024-04-09 13:13:58 +00:00
Nikolay Degterinsky
f45acef131 Support for a tiny feature in stateless tests image 2024-04-09 00:33:18 +00:00
Alexey Milovidov
8b856702f1
Merge pull request #62214 from ClickHouse/auto/v24.3.2.23-lts 
Update version_date.tsv and changelogs after v24.3.2.23-lts
 2024-04-08 15:11:52 +02:00
Robert Schulze
116393c951
Disable s390x build 2024-04-08 11:04:11 +00:00
Alexey Milovidov
0fccaafda4 Fix tests 2024-04-04 20:06:40 +02:00
Alexander Tokmakov
98ac8031e0 add fault injection 2024-04-03 19:49:23 +02:00
Mikhail Koviazin
e7a664e9df
Merge remote-tracking branch 'upstream/master' into mkmkme/protobuf-25.1 2024-04-03 13:51:37 +03:00
robot-clickhouse
c7a28b137a Update version_date.tsv and changelogs after v24.3.2.23-lts 2024-04-03 07:24:20 +00:00
Alexey Milovidov
5e7a90f85f
Merge pull request #62065 from azat/ci/fix-stress-tests-analyzer 
Fix stress tests for analyzer due to experimental WINDOW VIEW (by disabling it)
 2024-04-01 00:16:02 +03:00
Nikolay Degterinsky
85bba8c59d
Merge pull request #62019 from ClickHouse/evillique-patch-2 
Fix logs saving in DatabaseReplicated tests
 2024-03-29 01:00:19 +01:00
Azat Khuzhin
a94143ee19 Fix stress tests for analyzer due to experimental WINDOW VIEW (by disabling it) 
CI found [1]:

    2024.03.28 13:16:00.797344 [ 99740 ] {} <Error> Application: Caught exception while loading metadata: Code: 695. DB::Exception: Load job 'load table 01069_window_view_proc_tumble_watch.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01069_window_view_proc_tumble_watch`.`wv` from metadata file /var/lib/clickhouse/store/dd8/dd82a4f5-5485-4747-9172-8976d1194c54/wv.sql from query ATTACH WINDOW VIEW `01069_window_view_proc_tumble_watch`.wv UUID '35cc7d27-df3b-4569-9cb9-2ccf6cb1ff4c' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01069_window_view_proc_tumble_watch`.mt GROUP BY tumble(timestamp, toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/61997/ced095394b6fb6d50ed8b6834bd5911ad4702c6e/stateless_tests__tsan__s3_storage__[5_5].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-03-28 18:27:43 +01:00
Mikhail Koviazin
a9a1bd1afe
docker/stateless-test: install protobuf-compiler v25.1 2024-03-28 16:08:24 +01:00
Kseniia Sumarokova
5ba2ad53b6
Merge pull request #61163 from ClickHouse/filecache-better-try-reserve 
Less contention in cache, part 3
 2024-03-28 13:24:22 +01:00
Nikolay Degterinsky
dae3a9e389
Fix 2024-03-28 06:31:46 +01:00
Nikolay Degterinsky
54348e5e8c
Fix logs saving in DatabaseReplicated tests 2024-03-28 06:27:48 +01:00
Mikhail f. Shiryaev
fc96a57422
Merge pull request #61683 from mangadex-pub/54767-remove-extraneous-keeper-docker-volumes 
#54767 Remove extraneous volumes in Keeper image
 2024-03-27 22:01:50 +01:00
robot-clickhouse
52417e3d42 Update version_date.tsv and changelogs after v24.3.1.2672-lts 2024-03-27 18:02:02 +00:00
Kseniia Sumarokova
db724b1293
Update create.sql 2024-03-25 19:36:48 +01:00
kssenii
ab17c4c987 Better randomization for stress test, restore trace log level back 2024-03-25 12:15:43 +01:00
Tristan
38fb8b3e9e
Explicitly add /var/lib/clickhouse as volume of keeper 
Since it appears mandatory at the moment with default Keeper config
 2024-03-24 11:19:36 +00:00
Tristan
352c368a54
Update server alpine image template to match improvements in keeper image 2024-03-24 11:19:35 +00:00
Tristan
7962a69770
Cleanup Keeper Dockerfile and Docker entrypoint 2024-03-24 11:19:35 +00:00
Tristan
dff916b64c
Remove extraneous volumes in Keeper image 
Specifically the 2 non-data-related volumes

Fixes issue #54767
 2024-03-24 11:19:34 +00:00
Raúl Marín
e562a7c117
Merge pull request #61706 from Algunenano/fuzzer_again 
Fuzzer: Try a different way to wait for the server
 2024-03-21 21:08:03 +01:00
Alexey Milovidov
9afe096ff5
Merge pull request #61681 from ClickHouse/remove-diagnostics 
Remove clickhouse-diagnostics from the package
 2024-03-21 19:50:47 +03:00
Raúl Marín
4700222a0d Fuzzer: Try a different way to wait for the server 2024-03-21 12:40:07 +01:00
Mikhail f. Shiryaev
ff9a6d0958
Merge pull request #61197 from ClickHouse/merge-commit-style-autofix 
Merge commit style autofix
 2024-03-21 09:59:53 +01:00
Alexey Milovidov
bfc7c3c89e Remove clickhouse-diagnostics 2024-03-21 02:52:51 +01:00
Max K
4f51d891a0
Merge pull request #61597 from ClickHouse/ci_remove_compose_files_from_docker 
CI: remove compose files from integration test docker
 2024-03-20 17:36:13 +01:00
Max Kainov
da28eaf454 CI: remove compose files from integration test docker 
#ci_set_integration
 2024-03-20 14:11:47 +00:00
Raúl Marín
007775c982 Better fuzzer logs 2024-03-20 13:09:26 +01:00
Mikhail f. Shiryaev
6550b6f227
Merge pull request #61607 from ClickHouse/fix-configs-bugfix 
Fix configs for upgrade and bugfix
 2024-03-20 10:44:43 +01:00
kssenii
fd7c732c12 Add one more comment, better cache policy randomizer 2024-03-19 23:09:17 +01:00
Mikhail f. Shiryaev
fce926446b
Fix sed to not produce local_blob_storage_blob_storage 2024-03-19 18:05:57 +01:00
Raúl Marín
b290fda45a
Merge pull request #61333 from Algunenano/fuzz_log 
Minor changes in stress and fuzzer reports
 2024-03-19 17:54:38 +01:00
Mikhail f. Shiryaev
301037ca6a
Replace cat | sed; mv by sed -i 2024-03-19 17:53:32 +01:00
kssenii
595165add0 Merge remote-tracking branch 'origin/master' into filecache-better-try-reserve 2024-03-19 15:12:55 +01:00
Alexey Milovidov
2a4116cfb3
Merge pull request #61410 from tomershafir/thread-fuzzer-sleep-rand 
ThreadFuzzer: randomize sleep time
 2024-03-19 15:56:14 +03:00
Raúl Marín
a6506e8e58 Missed sending the process to background 2024-03-19 12:05:13 +01:00
Raúl Marín
8f318bed0d
Merge pull request #61363 from azat/ci/fix-upgrade-bugfix 
Fix bugfix check (due to "unknown object storage type: azure")
 2024-03-19 11:58:00 +01:00
Raúl Marín
7dbd96cf4e Fix 2024-03-18 19:43:13 +01:00
Raúl Marín
10dd47cf5c Separate CH and sanitizer logs 2024-03-18 16:40:03 +01:00
Raúl Marín
83c660a545 Merge remote-tracking branch 'blessed/master' into fuzz_log 2024-03-18 16:12:50 +01:00
Mikhail f. Shiryaev
0e6b5705fb
Install python-magic in style-check, split pip and apt 2024-03-18 15:04:44 +01:00
kssenii
7931c44ff2 Check static storage policy 2024-03-17 17:40:43 +01:00
robot-clickhouse
e5a1c0e251 Update version_date.tsv and changelogs after v24.2.2.71-stable 2024-03-15 06:50:44 +00:00