Commit Graph

3993 Commits

Author SHA1 Message Date
Kruglov Pavel
7b58722c07
Update setup_minio.sh 2024-07-10 13:15:44 +02:00
Antonio Andelic
1eec1fd77f Merge branch 'master' into collect-core-dumps-stateless 2024-07-10 13:01:41 +02:00
Kseniia Sumarokova
36b9a5641f
Update run.sh 2024-07-10 11:56:43 +02:00
Kseniia Sumarokova
ebc87d0c70
Update run.sh 2024-07-09 22:58:06 +02:00
Kruglov Pavel
d7f08ffdb7
Update setup_minio.sh 2024-07-09 21:01:37 +02:00
Kseniia Sumarokova
5a12659f43
Update run.sh 2024-07-09 20:18:03 +02:00
Nikita Fomichev
eeb3561c37 Stateless tests: run sequential tests in parallel to other tests 2024-07-09 19:41:06 +02:00
Yarik Briukhovetskyi
362bf4befc
Update setup_minio.sh 2024-07-09 17:30:08 +02:00
Antonio Andelic
0821d72f1c Collect core dumps in more tests 2024-07-09 17:06:37 +02:00
Yarik Briukhovetskyi
3cc6a133c6
Update setup_minio.sh 2024-07-09 12:38:16 +02:00
yariks5s
a3c4cbfce2 clang-tidy, fix cp with minio 2024-07-08 13:57:54 +00:00
Raúl Marín
18e2f0da9f Merge remote-tracking branch 'blessed/master' into fix_bugfix_checker 2024-07-08 11:23:47 +02:00
Nikita Fomichev
be8945f2a0 Merge remote-tracking branch 'origin/master' into fix-missing-tests-reports 2024-07-07 10:04:58 +02:00
alesapin
e2ff0c6809 Merge remote-tracking branch 'origin/master' into pin_python_packages 2024-07-05 22:16:08 +02:00
Raúl Marín
ad70710f4b stateless/run.sh cleanup 2024-07-05 16:45:32 +02:00
alesapin
964047bf8c Yarrrr 2024-07-05 16:31:00 +02:00
alesapin
1f07f33bd2 Less dirty still hack 2024-07-05 12:18:18 +02:00
Michael Kolupaev
90df83438f more shellcheck 2024-07-05 04:42:58 +00:00
Michael Kolupaev
158f59fd83 Merge remote-tracking branch 'origin/master' into reg 2024-07-04 19:10:07 +00:00
alesapin
e176587c59 Trying even worse fix 2024-07-04 17:16:25 +02:00
alesapin
963f39ede8 Revert "Update docker/test/fasttest/Dockerfile"
This reverts commit 1af3caf2b7.
2024-07-04 15:56:44 +02:00
alesapin
1af3caf2b7
Update docker/test/fasttest/Dockerfile
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2024-07-04 15:48:12 +02:00
alesapin
8d6c0147e2 Add comment 2024-07-04 15:30:27 +02:00
alesapin
2c77371b8b Better 2024-07-04 15:27:23 +02:00
alesapin
8040150de8 Very dirty hack 2024-07-04 14:22:30 +02:00
Nikita Fomichev
c4005d7e06 Fix fasttest 2024-07-03 23:13:50 +02:00
alesapin
31ca631ac5 Pin all python packages in CI images 2024-07-03 21:58:18 +02:00
Nikita Fomichev
a19eb86864 Review fixes 2 2024-07-03 19:39:00 +02:00
Nikita Fomichev
af845234a2 Review fixes 2024-07-03 17:53:05 +02:00
alesapin
4e6bdb15b0 Azure policy 2024-07-03 14:35:17 +02:00
alesapin
59246cdf92 Merge remote-tracking branch 'origin/master' into unify_tests_with_object_storage 2024-07-03 14:25:59 +02:00
Nikita Fomichev
fe43ea27d2 Tests: fix timeouts handling in case of github timeout termination 2024-07-03 13:37:36 +02:00
alesapin
a2626037bc Improve object storage tags in tests 2024-07-02 14:15:59 +02:00
Kseniia Sumarokova
ee0c4093d4
Update run.sh 2024-07-02 12:03:27 +02:00
Max K
f66c065d11 CI: JWT python module in Style check image 2024-06-24 19:16:10 +02:00
Michael Kolupaev
557cd2c08f Escape the $ 2024-06-20 18:56:06 +00:00
Michael Kolupaev
16baecf5a6 attach_gdb.lib: print registers before all stacks 2024-06-20 18:54:36 +00:00
Pablo Marcos
71f8937abd Merge branch 'master' into system-error-log 2024-06-20 16:33:44 +00:00
Alexander Tokmakov
5798898314
Merge pull request #65309 from ClickHouse/save_server_data
Save server data for failed stateless tests
2024-06-18 18:46:24 +00:00
Pablo Marcos
216d26987a Add test and config changes for system.error_log 2024-06-18 08:37:40 +00:00
Alexander Tokmakov
fb110827f8 save server data for failed stateless tests 2024-06-17 23:29:03 +02:00
Alexey Milovidov
24dfc10755 Remove outdated override in stress tests 2024-06-16 12:57:05 +02:00
Alexey Milovidov
02677892e3 Fix libunwind in CI 2024-06-13 21:03:02 +02:00
Mikhail f. Shiryaev
f1707998d2
Fix search issues for progress_func, add zstd for GH cache 2024-06-13 15:40:38 +02:00
Mikhail f. Shiryaev
94c82787c5
Add a progress function for searching PRs in changelog.py 2024-06-12 14:43:26 +02:00
Mikhail f. Shiryaev
182f85b25c
Test if unit-tests can be decreased 2024-06-11 16:09:31 +02:00
Alexey Milovidov
821c7322bd
Merge pull request #58349 from azat/ci/flake8
Check python code with flake8
2024-06-06 19:03:58 +02:00
Mikhail f. Shiryaev
1156233ea8
Use a proper way to download packages from releases 2024-06-06 07:24:58 +02:00
alesapin
59784a4cf2 Upload blob_storage_log from stateless tests 2024-06-05 15:04:15 +02:00
Azat Khuzhin
11905682a9 Check python code with flake8
Recently assert-on-tuple had been introduced in tests [1], let's prevent
this.

  [1]: https://github.com/ClickHouse/ClickHouse/pull/56367#discussion_r1437098533

v2: pin flake8 to 4.0.1 (instead of originally 6.1) due to other dependencies, hope that it will find such errors
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-06-05 14:46:38 +02:00
Mikhail f. Shiryaev
bad3f2d384
Migrate changelog from outdated fuzzywuzzy to a new thefuzz 2024-06-04 21:29:53 +02:00
Raúl Marín
b9af76538e Upgrade test: Detect setting changes across multiple releases (RC) 2024-05-28 19:49:54 +02:00
Raúl Marín
5b6c738532 Remove old config changes 2024-05-28 17:31:49 +02:00
Nikita Mikhaylov
7c9f36ad1e
Add gh to style-check dockerfile 2024-05-22 19:46:08 +02:00
Alexey Milovidov
d5c52e08df Merge branch 'master' into retries-in-submodules 2024-05-20 17:32:00 +02:00
Azat Khuzhin
434816820d Fix upgrade settings changes check
settings changes check simply checks that the settings are either the
same, or there is a record in system.settings_changes, however, the
problem is that clickhouse-local now adjusts some settings for Pretty
format in case of stdout is not a tty, and this is the case for this
check.

So to avoid this, just run the clickhouse-local under script(1) to fool
it.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-05-20 10:19:11 +02:00
Alexey Milovidov
63f31d3c1e Add retries in git submodule update 2024-05-20 06:13:06 +02:00
Alexey Milovidov
ce4158f496
Merge pull request #64082 from ClickHouse/prevent-stack-overflow-ci
Prevent stack overflow in Fuzzer and Stress test
2024-05-20 05:14:59 +02:00
Azat Khuzhin
3743b4a2ed Fix sanitizers build by updating llvm/clang that includes fix for it
Rebuild for clang 18.1.3, that contains a workaround [1] for sanitizers
issue [2]:

    $ git tag --contains  c2a57034eff048cd36c563c8e0051db3a70991b3 | tail -1
    llvmorg-18.1.3

 [1]: c2a57034ef
 [2]: https://github.com/ClickHouse/ClickHouse/issues/64086

Since right now version is not enough:

    $ docker run --rm -it clickhouse/test-util llvm-nm-18 --version
    llvm-nm, compatible with GNU nm
    Ubuntu LLVM version 18.1.2
      Optimized build.

But I don't see any fix for TSan, only MSan, but let's try.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-05-18 16:43:19 +02:00
Alexey Milovidov
cafd074e0a Prevent stack overflow in Fuzzer and Stress test 2024-05-18 05:11:18 +02:00
Alexey Milovidov
26501178e6 Fix analyzer 2024-05-17 10:23:32 +02:00
divanik
faef8807d2 Resolve conflicts 2024-05-13 12:04:06 +00:00
divanik
d468a0a577 Add archives reading support to s3 2024-05-13 12:00:15 +00:00
Alexey Milovidov
dd58af7d4f Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-05-10 07:17:39 +02:00
Konstantin Bogdanov
27551ca3c7
Add jwcrypto to integration tests runner 2024-05-09 04:08:21 +03:00
Alexey Milovidov
773654c46e Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-05-08 21:24:04 +02:00
Raúl Marín
92bb69e062
Merge pull request #63470 from Algunenano/stress_constraints
Extra constraints for stress and fuzzer tests
2024-05-07 15:29:25 +00:00
Raúl Marín
463f95e956 Extra constraints for stress and fuzzer tests 2024-05-07 13:47:35 +02:00
Alexey Milovidov
fd430585e1 Merge remote-tracking branch 'origin/master' into fix-coverage 2024-05-07 09:34:00 +02:00
Alexey Milovidov
5f52cb43b4 Fix coverage. 2024-05-07 09:33:47 +02:00
Alexey Milovidov
98fb9f36a9 We are using Shared Catalog in the CI Logs cluster 2024-05-07 05:35:04 +02:00
alesapin
4eb5bea203
Merge pull request #63354 from ClickHouse/fix_azurite_version
Rollback azurite to working version
2024-05-06 09:25:23 +00:00
Alexey Milovidov
46bd25128c
Merge branch 'master' into clang-18-ci 2024-05-06 02:51:58 +02:00
alesapin
b8b4a3a6dd Fxi 2024-05-04 12:24:07 +02:00
Anton Popov
b991f77d04 randomize setting enable_block_offset_column in stress tests 2024-05-03 17:22:37 +00:00
Alexander Sapin
b1eb0a8e9c Try rollback azurite
(cherry picked from commit 967e51c1d6)
2024-05-03 18:42:59 +02:00
alesapin
c7a6af3c4a Fix stateful 2024-04-27 21:47:48 +02:00
alesapin
78e6d62ed3
Merge branch 'master' into ci_add_azure_tests 2024-04-27 12:33:42 +02:00
alesapin
b4e3880c6b Test work without azurite 2024-04-27 12:30:28 +02:00
alesapin
8b050b2548 Merge branch 'ci_add_azure_tests' of github.com:ClickHouse/ClickHouse into ci_add_azure_tests 2024-04-26 19:18:18 +02:00
alesapin
349147b5b5 One more time 2024-04-26 19:16:27 +02:00
Nikita Mikhaylov
5c2fa14287
Merge branch 'master' into clang-18-ci 2024-04-25 13:19:17 +02:00
Alexander Sapin
adfe2f78a9 Try to make error more clear 2024-04-25 12:35:08 +02:00
alesapin
4d0ce04a91 Always start clickhouse with env forwarding 2024-04-24 20:03:23 +02:00
Ilya Golshtein
01de28b6c1 kerberized_hadoop_dockerfile: ADD instead of wget, no final OR 2024-04-24 20:36:35 +03:00
Ilya Golshtein
7d82260e3a kerberized_hadoop_dockerfile: get from https via wget 2024-04-24 20:36:35 +03:00
alesapin
68ff44259e Merge branch 'ci_add_azure_tests' of github.com:ClickHouse/ClickHouse into ci_add_azure_tests 2024-04-24 17:31:05 +02:00
Nikolay Degterinsky
26308744ac
Update run.sh 2024-04-24 02:50:04 +02:00
Mikhail f. Shiryaev
63d2f75f05
Fix accumulated shellcheck issues 2024-04-18 18:04:10 +02:00
Alexander Sapin
9896c50c3f azurite only in memory 2024-04-17 14:53:45 +02:00
Smita Kulkarni
d1a81e718c Merge branch 'master' into ci_add_azure_tests 2024-04-17 14:26:41 +02:00
Robert Schulze
4e881be128
Merge pull request #62634 from liuneng1994/std-except-parseDateTIme
Speed up `parseDateTime[InJodaSyntax]Or(Null|Zero)` on invalid inputs
2024-04-16 13:42:10 +00:00
Alexander Sapin
90ef5cc516 better 2024-04-15 18:52:17 +02:00
Alexander Sapin
c0c8c3be99 Fix 2024-04-15 17:28:22 +02:00
Robert Schulze
a86f769e25
Fix FastTest 2024-04-15 14:06:59 +00:00
Alexander Sapin
45d49ca53d I'll shut you down 2024-04-15 15:46:41 +02:00
Alexander Sapin
949ec8d44c Silence 2024-04-15 15:33:25 +02:00
Alexander Sapin
0f2cc6e00a Disable logs 2024-04-15 15:17:36 +02:00
Alexander Sapin
daea269a28 Try without debug logs 2024-04-15 14:42:20 +02:00
Robert Schulze
3c35f14804
Merge remote-tracking branch 'ClickHouse/master' into mkmkme/protobuf-25.1 2024-04-15 12:38:59 +00:00
Alexander Tokmakov
d510c3ac55
Merge pull request #62266 from ClickHouse/cannot_allocate_thread
Add fault injection for "Cannot allocate thread"
2024-04-12 14:40:42 +00:00
Max Kainov
053c3cc0c1 redirect azure logs 2024-04-12 10:22:03 +00:00
Alexey Milovidov
164a8d6097
Merge branch 'master' into clang-18-ci 2024-04-12 03:49:10 +02:00
Alexey Milovidov
d903e189c4
Update docker/test/stateless/run.sh 2024-04-12 01:01:04 +02:00
Raúl Marín
361d73f7a4 Try to fix Bugfix validation job 2024-04-12 00:07:53 +02:00
Alexander Tokmakov
55c510563c Merge branch 'master' into cannot_allocate_thread 2024-04-11 23:06:17 +02:00
Alexander Tokmakov
d8e97b51bf Merge branch 'master' into cannot_allocate_thread 2024-04-10 21:21:42 +02:00
Raúl Marín
12569cc5fe Don't allow the fuzzer to change allow_experimental_analyzer 2024-04-10 18:18:47 +02:00
Nikolay Degterinsky
6f78e89044 Merge remote-tracking branch 'upstream/master' into docker-image 2024-04-09 13:13:58 +00:00
Nikolay Degterinsky
f45acef131 Support for a tiny feature in stateless tests image 2024-04-09 00:33:18 +00:00
Alexey Milovidov
0fccaafda4 Fix tests 2024-04-04 20:06:40 +02:00
Alexander Tokmakov
98ac8031e0 add fault injection 2024-04-03 19:49:23 +02:00
Mikhail Koviazin
e7a664e9df
Merge remote-tracking branch 'upstream/master' into mkmkme/protobuf-25.1 2024-04-03 13:51:37 +03:00
Alexey Milovidov
5e7a90f85f
Merge pull request #62065 from azat/ci/fix-stress-tests-analyzer
Fix stress tests for analyzer due to experimental WINDOW VIEW (by disabling it)
2024-04-01 00:16:02 +03:00
Nikolay Degterinsky
85bba8c59d
Merge pull request #62019 from ClickHouse/evillique-patch-2
Fix logs saving in DatabaseReplicated tests
2024-03-29 01:00:19 +01:00
Azat Khuzhin
a94143ee19 Fix stress tests for analyzer due to experimental WINDOW VIEW (by disabling it)
CI found [1]:

    2024.03.28 13:16:00.797344 [ 99740 ] {} <Error> Application: Caught exception while loading metadata: Code: 695. DB::Exception: Load job 'load table 01069_window_view_proc_tumble_watch.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01069_window_view_proc_tumble_watch`.`wv` from metadata file /var/lib/clickhouse/store/dd8/dd82a4f5-5485-4747-9172-8976d1194c54/wv.sql from query ATTACH WINDOW VIEW `01069_window_view_proc_tumble_watch`.wv UUID '35cc7d27-df3b-4569-9cb9-2ccf6cb1ff4c' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01069_window_view_proc_tumble_watch`.mt GROUP BY tumble(timestamp, toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/61997/ced095394b6fb6d50ed8b6834bd5911ad4702c6e/stateless_tests__tsan__s3_storage__[5_5].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-28 18:27:43 +01:00
Mikhail Koviazin
a9a1bd1afe
docker/stateless-test: install protobuf-compiler v25.1 2024-03-28 16:08:24 +01:00
Kseniia Sumarokova
5ba2ad53b6
Merge pull request #61163 from ClickHouse/filecache-better-try-reserve
Less contention in cache, part 3
2024-03-28 13:24:22 +01:00
Nikolay Degterinsky
dae3a9e389
Fix 2024-03-28 06:31:46 +01:00
Nikolay Degterinsky
54348e5e8c
Fix logs saving in DatabaseReplicated tests 2024-03-28 06:27:48 +01:00
Kseniia Sumarokova
db724b1293
Update create.sql 2024-03-25 19:36:48 +01:00
kssenii
ab17c4c987 Better randomization for stress test, restore trace log level back 2024-03-25 12:15:43 +01:00
Raúl Marín
4700222a0d Fuzzer: Try a different way to wait for the server 2024-03-21 12:40:07 +01:00
Mikhail f. Shiryaev
ff9a6d0958
Merge pull request #61197 from ClickHouse/merge-commit-style-autofix
Merge commit style autofix
2024-03-21 09:59:53 +01:00
Max K
4f51d891a0
Merge pull request #61597 from ClickHouse/ci_remove_compose_files_from_docker
CI: remove compose files from integration test docker
2024-03-20 17:36:13 +01:00
Max Kainov
da28eaf454 CI: remove compose files from integration test docker
#ci_set_integration
2024-03-20 14:11:47 +00:00
Raúl Marín
007775c982 Better fuzzer logs 2024-03-20 13:09:26 +01:00
Mikhail f. Shiryaev
6550b6f227
Merge pull request #61607 from ClickHouse/fix-configs-bugfix
Fix configs for upgrade and bugfix
2024-03-20 10:44:43 +01:00
kssenii
fd7c732c12 Add one more comment, better cache policy randomizer 2024-03-19 23:09:17 +01:00
Mikhail f. Shiryaev
fce926446b
Fix sed to not produce local_blob_storage_blob_storage 2024-03-19 18:05:57 +01:00
Raúl Marín
b290fda45a
Merge pull request #61333 from Algunenano/fuzz_log
Minor changes in stress and fuzzer reports
2024-03-19 17:54:38 +01:00
Mikhail f. Shiryaev
301037ca6a
Replace cat | sed; mv by sed -i 2024-03-19 17:53:32 +01:00
kssenii
595165add0 Merge remote-tracking branch 'origin/master' into filecache-better-try-reserve 2024-03-19 15:12:55 +01:00
Alexey Milovidov
2a4116cfb3
Merge pull request #61410 from tomershafir/thread-fuzzer-sleep-rand
ThreadFuzzer: randomize sleep time
2024-03-19 15:56:14 +03:00
Raúl Marín
a6506e8e58 Missed sending the process to background 2024-03-19 12:05:13 +01:00
Raúl Marín
7dbd96cf4e Fix 2024-03-18 19:43:13 +01:00
Raúl Marín
10dd47cf5c Separate CH and sanitizer logs 2024-03-18 16:40:03 +01:00
Mikhail f. Shiryaev
0e6b5705fb
Install python-magic in style-check, split pip and apt 2024-03-18 15:04:44 +01:00
kssenii
7931c44ff2 Check static storage policy 2024-03-17 17:40:43 +01:00
tomershafir
23169117ae thread-fuzzer: randomize sleep time 2024-03-15 00:02:09 +02:00
Azat Khuzhin
02ae7e54a7 Fix bugfix check (due to "unknown object storage type: azure")
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-14 14:57:33 +01:00
Raúl Marín
f63368d83d Separate stdout and stderr in fuzzer report 2024-03-13 19:12:43 +01:00
Raúl Marín
2982f3b369 Fix stress test sanitizer report 2024-03-13 19:12:43 +01:00
Alexey Milovidov
d3872b155e Merge branch 'master' into clang-18-ci 2024-03-13 09:35:58 +01:00
Raúl Marín
a65ac96b04
Merge pull request #61147 from azat/ci/fix-symbolizer
Fix llvm symbolizer on CI
2024-03-12 12:01:43 +01:00
Azat Khuzhin
5a400c181b Fix llvm symbolizer on CI
In #61011 the whole toolchain installation had been removed from the
base image to reduce image sizes, and this is a good thing indeed.

However it also breaks the symbolizer for sanitizers, which makes
stacktraces unreadable, so let's fix this by getting back llvm package,
this should be OK, since it's size is not gigabytes, but only 48MiB (at
least for llvm-14):

    # dpkg -L llvm-14| xargs file | grep -v directory | cut -d: -f1 | xargs du -sch | grep total
    48M     total

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-11 20:36:15 +01:00
Alexey Milovidov
8a484a44e3 Merge branch 'master' into dont-load-useless-index-parts-in-memory 2024-03-11 02:10:20 +01:00
Alexey Milovidov
36e18d7500 Merge branch 'master' into clang-18-ci 2024-03-10 23:57:00 +01:00
Alexey Milovidov
2cc071e0e4 Fix error 2024-03-10 12:48:15 +01:00
Alexey Milovidov
3b8a8c9649 Better gitignore 2024-03-10 09:28:30 +01:00
Alexey Milovidov
9a880c3bb9 Merge branch 'master' into clang-18-ci 2024-03-10 06:59:27 +01:00
Max Kainov
681bd28c87 CI: make style check fast
#do_not_test
2024-03-09 20:57:23 +00:00
Nikita Mikhaylov
6b4867f746
Debug fuzzer failures (#61062) 2024-03-08 21:27:56 +01:00
Mikhail f. Shiryaev
e5a7ec7be6
Do not build odbc driver in sqllogic 2024-03-07 09:52:25 +01:00
Mikhail f. Shiryaev
0cbfe3421f
Reduce size of test images by removing clang from there 2024-03-07 09:52:25 +01:00
Mikhail f. Shiryaev
176ed5f96b
Use curl instead of wget 2024-03-07 09:52:24 +01:00
Mikhail f. Shiryaev
1d8fe381be
Update the odbc in stateless tests 2024-03-07 09:52:23 +01:00
Mikhail f. Shiryaev
0cedafef1e
Do not test odbc in fast tests 2024-03-07 09:52:21 +01:00
Mikhail f. Shiryaev
9967c60c53
Update sccache 2024-03-07 09:52:07 +01:00
Mikhail f. Shiryaev
5e597228d7
Merge pull request #60408 from ClickHouse/update-style-python
Update style python
2024-03-07 09:32:28 +01:00
Kseniia Sumarokova
0d67d9c79d
Merge pull request #60165 from ClickHouse/fix-for-local-object-storage
Allow local/azure as object storage type instead of local_blob_storage/azure_blob_storage
2024-03-07 14:42:44 +08:00
Nikita Mikhaylov
48bea29611
Merge pull request #60654 from ClickHouse/fuzzer-gdb
Try to run fuzzer under gdb
2024-03-05 18:52:13 +01:00
Mikhail f. Shiryaev
34bb40583c
Install stubs for python-requests 2024-03-05 16:02:43 +01:00
Mikhail f. Shiryaev
76cbd78331
Update pylint, mypy, and black in style check image 2024-03-05 15:59:07 +01:00
Raúl Marín
738c481cce Fix fuzzer report 2024-03-05 10:36:42 +00:00
Kseniia Sumarokova
6f5d79db24
Merge branch 'master' into fix-for-local-object-storage 2024-03-05 14:14:34 +08:00
Kseniia Sumarokova
9a3312f12d
Remove debug 2024-03-05 11:55:32 +08:00
Kseniia Sumarokova
b5fb12c6ec
Fix typo 2024-03-05 11:54:58 +08:00
Kseniia Sumarokova
c735caf44f
Fix typo 2024-03-05 11:54:13 +08:00
Nikita Mikhaylov
822ef975a5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fuzzer-gdb 2024-03-05 01:30:54 +01:00
Nikita Mikhaylov
e715ff622d Better 2024-03-05 00:52:13 +01:00
Raúl Marín
6e579e6bfa Use awk since it's much simpler 2024-03-04 18:15:53 +01:00
Raúl Marín
0149b8893a Include multiline logs in fuzzer fatal.log report 2024-03-04 17:42:06 +01:00
Mikhail f. Shiryaev
017a81692f
Merge pull request #60553 from ClickHouse/update-shellcheck
Update shellcheck
2024-03-04 11:21:34 +01:00
Alexey Milovidov
6df3179341 Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-03-03 23:02:20 +01:00
Alexey Milovidov
c51b50aa1a
Merge pull request #60375 from azat/ci/bugfix-check-fix
Fix bugfix check (due to unknown commit_logs_cache_size_threshold)
2024-03-03 23:11:40 +03:00
Azat Khuzhin
c343ec4bcf Fix bugfix and upgrade checks (due to "Unknown handler type 'redirect'" error)
CI: https://s3.amazonaws.com/clickhouse-test-reports/60694/418a6258ac1b55d5e225107bd9ebfc711ca6511b/upgrade_check__msan_.html
CI: https://s3.amazonaws.com/clickhouse-test-reports/60689/707200d2a4ee765c5109dcca78aaaa7f2c63ab85/bugfix_validation.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-03 12:00:49 +01:00
Alexey Milovidov
3938d7156a Merge branch 'master' into fix-for-local-object-storage 2024-03-02 19:44:12 +01:00
Nikita Mikhaylov
361ec17c87 gdb... 2024-03-01 15:31:25 +00:00
Mikhail f. Shiryaev
17210bb494
Fix type, add _server suffix to start and stop functions 2024-03-01 00:21:31 +01:00
Mikhail f. Shiryaev
82a8308198
Update shellcheck to the latest release 2024-02-29 17:41:35 +01:00
Mikhail f. Shiryaev
f40e25f5c3
Check all shell scripts in docker directories 2024-02-29 17:41:33 +01:00
Alexey Milovidov
ee772aaf0f Use clang-18 in CI 2024-02-27 23:17:11 +01:00
Alexey Milovidov
12ecfbb0d0 Fix wrong log message in Fuzzer 2024-02-26 17:46:51 +01:00
Antonio Andelic
2b51497e55
Update docker/test/stateless/run.sh 2024-02-26 08:50:23 +01:00
Azat Khuzhin
83e7f3e1a1 Fix bugfix check (due to unknown commit_logs_cache_size_threshold)
Bugfix check is broken on CI [1], because of:

    2024.02.23 06:12:59.294500 [ 757 ] {} Application: Code: 115. DB::Exception: Unknown setting latest_logs_cache_size_threshold: in Coordination settings config. (UNKNOWN_SETTING), Stack trace (when copying this message, always include the lines below):

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/60031/89eb2a38c0a7c113b7b0a96c8069fea6eb48ae9d/bugfix_validation.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-24 21:17:03 +01:00
Azat Khuzhin
dd690dd05d Expose fatal.log separately for fuzzer
Otherwise you have to download the full server.log

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-24 19:23:28 +01:00
Alexander Tokmakov
ef3b19167f
Merge pull request #58036 from MikhailBurdukov/backoff_for_failed_mutations
Backoff policy for failed mutation.
2024-02-23 15:27:41 +01:00
Kseniia Sumarokova
d3c6761dcf
Update run.sh 2024-02-23 12:06:17 +01:00
Raúl Marín
c359f29842 Merge remote-tracking branch 'blessed/master' into stress_log 2024-02-23 10:50:46 +01:00
Raúl Marín
9c99a2dd2a Maybe better 2024-02-22 13:20:57 +01:00
Raúl Marín
b83b7a7ab7 Stress test: Include the first sanitizer block message in the report 2024-02-22 12:59:12 +01:00
Raúl Marín
5684a14160 Ignore valid 'No such key errors' in stress tests 2024-02-22 11:47:43 +01:00
Kseniia Sumarokova
84d6b4166a
Merge branch 'master' into fix-for-local-object-storage 2024-02-22 11:40:18 +01:00
Antonio Andelic
1b238d1180
Merge pull request #59460 from ClickHouse/keeper-logs-cache
Keeper log cache
2024-02-22 09:03:41 +01:00
Kseniia Sumarokova
2836d0bb55
Update run.sh 2024-02-21 18:46:42 +01:00
Max Kainov
9f51e840db CI: integration tests to mysql80
#ci_set_integration
 #no_merge_commit
2024-02-21 11:05:47 +00:00
Kseniia Sumarokova
462f597c6b
Update run.sh 2024-02-21 11:02:05 +01:00
MikhailBurdukov
fa5747ab7f Fix stress tests 2024-02-21 08:50:39 +00:00
Kseniia Sumarokova
2405115484
Fix upgrade check 2024-02-20 18:05:48 +01:00
MikhailBurdukov
7cdfedaedd Enable setting by default 2024-02-20 08:39:11 +00:00
Antonio Andelic
299a0bd996 Merge branch 'master' into keeper-logs-cache 2024-02-19 10:01:31 +01:00
Alexey Milovidov
c8415ddc29 Speed up the CI 2024-02-18 09:29:34 +01:00
Antonio Andelic
1ade535a83 Merge branch 'master' into keeper-logs-cache 2024-02-15 13:06:37 +01:00
Alexey Milovidov
1fbc52fa40 Remove Aerospike 2024-02-14 05:52:39 +01:00
Alexey Milovidov
2870c628c1
Merge pull request #58926 from MyroTk/master
Include `pytest-reportlog` in the integration tests' CI runner.
2024-02-14 05:05:51 +01:00
MyroTk
6a3c362443
Update Dockerfile 2024-02-12 10:39:26 -08:00
Alexey Milovidov
ed02154a4a Fix "Too many parts" 2024-02-10 07:31:54 +01:00
Alexey Milovidov
99b66f75bd Sequential run 2024-02-10 02:27:55 +01:00
Alexey Milovidov
d466e8d61e Run coverage collection sequentially 2024-02-09 03:55:39 +01:00
Alexey Milovidov
41ff8b3217 Reading Docker files 2024-02-09 00:15:52 +01:00
Alexey Milovidov
91c607f249 Fix a test 2024-02-08 22:11:37 +01:00
Alexey Milovidov
02c0b4c67f Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-02-07 22:45:50 +01:00
Alexey Milovidov
33401643a4 Fix error 2024-02-07 20:28:37 +01:00
Alexey Milovidov
d65a56d967
Merge branch 'master' into enable-coverage-for-debug-build 2024-02-07 04:58:21 +01:00
Alexey Milovidov
aa91d52277
Merge branch 'master' into master 2024-02-06 23:58:53 +01:00
Raúl Marín
a64ce70671 Pin python dependencies in stateless tests 2024-02-06 20:11:04 +01:00
Antonio Andelic
41202cd7b2
fix upgrade 2024-02-06 09:39:22 +01:00
Antonio Andelic
dd3db5d092 Merge branch 'master' into keeper-logs-cache 2024-02-05 16:56:09 +01:00
Max K
411b76cc57
Merge pull request #59241 from ClickHouse/test_arm
CI: Add ARM integration tests
2024-02-05 14:52:46 +01:00
Raúl Marín
08c1799f9c
Merge pull request #59383 from Algunenano/fuzz_literal
Add some fuzzing to ASTLiterals
2024-02-05 12:27:43 +01:00
Mikhail f. Shiryaev
31f27ad398
Merge pull request #59337 from ClickHouse/fix-fasttests-gdb
Some small fixes for docker images
2024-02-05 11:42:18 +01:00
Max Kainov
6504dfe0b2 CI: Enable ARM integration test
#ci_set_integration #no_merge_commit
2024-02-02 17:37:05 +00:00
Raúl Marín
00096e5819 Merge remote-tracking branch 'blessed/master' into fuzz_literal 2024-02-02 17:28:47 +01:00
Antonio Andelic
a248491299
remove new settings from older versions 2024-02-02 11:14:03 +01:00
MyroTk
dffc539880
Merge branch 'ClickHouse:master' into master 2024-02-01 17:05:36 -08:00
Mikhail f. Shiryaev
6f1fbdb5ca
Fix the failed upgrade of kazoo to 2.10.0 2024-02-01 11:20:24 +01:00
Mikhail f. Shiryaev
2577f8031b
Add suid bit to gdb in fast tests image 2024-02-01 11:20:23 +01:00
Mikhail f. Shiryaev
76c6dc51bf
Unify the apt cleaning part in Dockerfile's 2024-02-01 11:20:23 +01:00
Azat Khuzhin
ea720e3171 Verify that stripped clickhouse shows symbol names
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-01 09:32:59 +01:00
Kseniia Sumarokova
60c37fb9bf
Update run.sh 2024-01-31 13:44:16 +01:00
Raúl Marín
4f0c78d665 Upload one file. Save the planet 2024-01-30 20:29:59 +01:00
Alexey Milovidov
35ea956255
Merge pull request #59295 from ClickHouse/fix_block_number
Fix `_block_number` column with non-default serializations and mutation
2024-01-30 04:07:09 +01:00
Alexey Milovidov
cb69a1b25d Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-01-29 15:35:04 +01:00
alesapin
cef109a887 Fix backward compatibility check 2024-01-29 13:19:46 +01:00
Kseniia Sumarokova
f80b226035
Merge pull request #59280 from ClickHouse/kssenii-patch-8
Update run.sh
2024-01-29 10:27:33 +01:00
alesapin
b864b122fa Merge branch 'master' into fix_block_number 2024-01-29 10:19:43 +01:00
Alexey Milovidov
b32f9ae037
Merge pull request #59255 from azat/tests/pdb-v2
Improve pytest --pdb experience by preserving dockerd on SIGINT (v2)
2024-01-29 00:00:57 +01:00
Alexey Milovidov
4a94ae5a1b Merge branch 'master' into enable-coverage-for-debug-build 2024-01-28 22:24:26 +01:00
Kseniia Sumarokova
cc4d4647f5
Update run.sh 2024-01-28 22:24:03 +01:00
Kseniia Sumarokova
41883ddb34
Update run.sh 2024-01-28 18:15:11 +01:00
Kseniia Sumarokova
febd4ce8d7
Update run.sh 2024-01-28 13:41:33 +01:00
alesapin
d70fe79a1e Revert "Disable randomization of allow_experimental_block_number_column flag (#56474)"
This reverts commit 951d9ac144.
2024-01-28 12:28:08 +01:00
Kseniia Sumarokova
24ab61932e
Update run.sh 2024-01-27 22:42:43 +01:00
Kseniia Sumarokova
163a3e44d3
Update run.sh 2024-01-26 21:22:39 +01:00
Azat Khuzhin
94eb33ef27 Improve pytest --pdb experience by preserving dockerd on SIGINT (v2)
Previous fix (#43392) was not correct, since terminal sends SIGINT to
all processes in a group, so simply ignoring it in parent won't work. So
instead dockerd will be run in a new session.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-01-26 16:06:41 +01:00
Azat Khuzhin
92d96c4d02 Fix fasttest by pinning pip dependencies
After image update it prints the following warning:

    /ClickHouse/tests/queries/0_stateless/01558_ttest_scipy.python:5: DeprecationWarning:
    Pyarrow will become a required dependency of pandas in the next major release of pandas (pandas 3.0),
    (to allow more performant data types, such as the Arrow string type, and better interoperability with other libraries)
    but was not found to be installed on your system.
    If this would cause problems for you,
    please provide us feedback at https://github.com/pandas-dev/pandas/issues/54466

Pyarrow can be added as well, but according to the comment in the issue
it bloats the image size 170%, so let's simply downgrade it for now and
see how that issue will be resolved (or the warning could be suppressed
of course).

And pin other dependencies as well to avoid further failures.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-01-26 15:08:22 +01:00
Kseniia Sumarokova
291427d931
Update stateless/run.sh 2024-01-23 14:51:55 +01:00
MyroTk
e78eb41264
Update Dockerfile 2024-01-22 15:19:31 -08:00
Kseniia Sumarokova
bfb822b775
Try fix style check 2024-01-22 20:32:47 +01:00