Commit Graph

3826 Commits

Author SHA1 Message Date
alesapin
e2ff0c6809 Merge remote-tracking branch 'origin/master' into pin_python_packages 2024-07-05 22:16:08 +02:00
Raúl Marín
ad70710f4b stateless/run.sh cleanup 2024-07-05 16:45:32 +02:00
alesapin
964047bf8c Yarrrr 2024-07-05 16:31:00 +02:00
alesapin
1f07f33bd2 Less dirty still hack 2024-07-05 12:18:18 +02:00
alesapin
e176587c59 Trying even worse fix 2024-07-04 17:16:25 +02:00
alesapin
963f39ede8 Revert "Update docker/test/fasttest/Dockerfile"
This reverts commit 1af3caf2b7.
2024-07-04 15:56:44 +02:00
alesapin
1af3caf2b7
Update docker/test/fasttest/Dockerfile
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2024-07-04 15:48:12 +02:00
alesapin
8d6c0147e2 Add comment 2024-07-04 15:30:27 +02:00
alesapin
2c77371b8b Better 2024-07-04 15:27:23 +02:00
alesapin
8040150de8 Very dirty hack 2024-07-04 14:22:30 +02:00
Nikita Fomichev
c4005d7e06 Fix fasttest 2024-07-03 23:13:50 +02:00
alesapin
31ca631ac5 Pin all python packages in CI images 2024-07-03 21:58:18 +02:00
Nikita Fomichev
a19eb86864 Review fixes 2 2024-07-03 19:39:00 +02:00
Nikita Fomichev
af845234a2 Review fixes 2024-07-03 17:53:05 +02:00
alesapin
4e6bdb15b0 Azure policy 2024-07-03 14:35:17 +02:00
alesapin
59246cdf92 Merge remote-tracking branch 'origin/master' into unify_tests_with_object_storage 2024-07-03 14:25:59 +02:00
Nikita Fomichev
fe43ea27d2 Tests: fix timeouts handling in case of github timeout termination 2024-07-03 13:37:36 +02:00
alesapin
a2626037bc Improve object storage tags in tests 2024-07-02 14:15:59 +02:00
Kseniia Sumarokova
ee0c4093d4
Update run.sh 2024-07-02 12:03:27 +02:00
Max K
f66c065d11 CI: JWT python module in Style check image 2024-06-24 19:16:10 +02:00
Pablo Marcos
71f8937abd Merge branch 'master' into system-error-log 2024-06-20 16:33:44 +00:00
Alexander Tokmakov
5798898314
Merge pull request #65309 from ClickHouse/save_server_data
Save server data for failed stateless tests
2024-06-18 18:46:24 +00:00
Pablo Marcos
216d26987a Add test and config changes for system.error_log 2024-06-18 08:37:40 +00:00
Alexander Tokmakov
fb110827f8 save server data for failed stateless tests 2024-06-17 23:29:03 +02:00
Alexey Milovidov
24dfc10755 Remove outdated override in stress tests 2024-06-16 12:57:05 +02:00
Alexey Milovidov
02677892e3 Fix libunwind in CI 2024-06-13 21:03:02 +02:00
Mikhail f. Shiryaev
f1707998d2
Fix search issues for progress_func, add zstd for GH cache 2024-06-13 15:40:38 +02:00
Mikhail f. Shiryaev
94c82787c5
Add a progress function for searching PRs in changelog.py 2024-06-12 14:43:26 +02:00
Mikhail f. Shiryaev
182f85b25c
Test if unit-tests can be decreased 2024-06-11 16:09:31 +02:00
Alexey Milovidov
821c7322bd
Merge pull request #58349 from azat/ci/flake8
Check python code with flake8
2024-06-06 19:03:58 +02:00
Mikhail f. Shiryaev
1156233ea8
Use a proper way to download packages from releases 2024-06-06 07:24:58 +02:00
alesapin
59784a4cf2 Upload blob_storage_log from stateless tests 2024-06-05 15:04:15 +02:00
Azat Khuzhin
11905682a9 Check python code with flake8
Recently assert-on-tuple had been introduced in tests [1], let's prevent
this.

  [1]: https://github.com/ClickHouse/ClickHouse/pull/56367#discussion_r1437098533

v2: pin flake8 to 4.0.1 (instead of originally 6.1) due to other dependencies, hope that it will find such errors
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-06-05 14:46:38 +02:00
Mikhail f. Shiryaev
bad3f2d384
Migrate changelog from outdated fuzzywuzzy to a new thefuzz 2024-06-04 21:29:53 +02:00
Raúl Marín
b9af76538e Upgrade test: Detect setting changes across multiple releases (RC) 2024-05-28 19:49:54 +02:00
Raúl Marín
5b6c738532 Remove old config changes 2024-05-28 17:31:49 +02:00
Nikita Mikhaylov
7c9f36ad1e
Add gh to style-check dockerfile 2024-05-22 19:46:08 +02:00
Alexey Milovidov
d5c52e08df Merge branch 'master' into retries-in-submodules 2024-05-20 17:32:00 +02:00
Azat Khuzhin
434816820d Fix upgrade settings changes check
settings changes check simply checks that the settings are either the
same, or there is a record in system.settings_changes, however, the
problem is that clickhouse-local now adjusts some settings for Pretty
format in case of stdout is not a tty, and this is the case for this
check.

So to avoid this, just run the clickhouse-local under script(1) to fool
it.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-05-20 10:19:11 +02:00
Alexey Milovidov
63f31d3c1e Add retries in git submodule update 2024-05-20 06:13:06 +02:00
Alexey Milovidov
ce4158f496
Merge pull request #64082 from ClickHouse/prevent-stack-overflow-ci
Prevent stack overflow in Fuzzer and Stress test
2024-05-20 05:14:59 +02:00
Azat Khuzhin
3743b4a2ed Fix sanitizers build by updating llvm/clang that includes fix for it
Rebuild for clang 18.1.3, that contains a workaround [1] for sanitizers
issue [2]:

    $ git tag --contains  c2a57034eff048cd36c563c8e0051db3a70991b3 | tail -1
    llvmorg-18.1.3

 [1]: c2a57034ef
 [2]: https://github.com/ClickHouse/ClickHouse/issues/64086

Since right now version is not enough:

    $ docker run --rm -it clickhouse/test-util llvm-nm-18 --version
    llvm-nm, compatible with GNU nm
    Ubuntu LLVM version 18.1.2
      Optimized build.

But I don't see any fix for TSan, only MSan, but let's try.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-05-18 16:43:19 +02:00
Alexey Milovidov
cafd074e0a Prevent stack overflow in Fuzzer and Stress test 2024-05-18 05:11:18 +02:00
Alexey Milovidov
26501178e6 Fix analyzer 2024-05-17 10:23:32 +02:00
divanik
faef8807d2 Resolve conflicts 2024-05-13 12:04:06 +00:00
divanik
d468a0a577 Add archives reading support to s3 2024-05-13 12:00:15 +00:00
Alexey Milovidov
dd58af7d4f Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-05-10 07:17:39 +02:00
Konstantin Bogdanov
27551ca3c7
Add jwcrypto to integration tests runner 2024-05-09 04:08:21 +03:00
Alexey Milovidov
773654c46e Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-05-08 21:24:04 +02:00
Raúl Marín
92bb69e062
Merge pull request #63470 from Algunenano/stress_constraints
Extra constraints for stress and fuzzer tests
2024-05-07 15:29:25 +00:00
Raúl Marín
463f95e956 Extra constraints for stress and fuzzer tests 2024-05-07 13:47:35 +02:00
Alexey Milovidov
fd430585e1 Merge remote-tracking branch 'origin/master' into fix-coverage 2024-05-07 09:34:00 +02:00
Alexey Milovidov
5f52cb43b4 Fix coverage. 2024-05-07 09:33:47 +02:00
Alexey Milovidov
98fb9f36a9 We are using Shared Catalog in the CI Logs cluster 2024-05-07 05:35:04 +02:00
alesapin
4eb5bea203
Merge pull request #63354 from ClickHouse/fix_azurite_version
Rollback azurite to working version
2024-05-06 09:25:23 +00:00
Alexey Milovidov
46bd25128c
Merge branch 'master' into clang-18-ci 2024-05-06 02:51:58 +02:00
alesapin
b8b4a3a6dd Fxi 2024-05-04 12:24:07 +02:00
Anton Popov
b991f77d04 randomize setting enable_block_offset_column in stress tests 2024-05-03 17:22:37 +00:00
Alexander Sapin
b1eb0a8e9c Try rollback azurite
(cherry picked from commit 967e51c1d6)
2024-05-03 18:42:59 +02:00
alesapin
c7a6af3c4a Fix stateful 2024-04-27 21:47:48 +02:00
alesapin
78e6d62ed3
Merge branch 'master' into ci_add_azure_tests 2024-04-27 12:33:42 +02:00
alesapin
b4e3880c6b Test work without azurite 2024-04-27 12:30:28 +02:00
alesapin
8b050b2548 Merge branch 'ci_add_azure_tests' of github.com:ClickHouse/ClickHouse into ci_add_azure_tests 2024-04-26 19:18:18 +02:00
alesapin
349147b5b5 One more time 2024-04-26 19:16:27 +02:00
Nikita Mikhaylov
5c2fa14287
Merge branch 'master' into clang-18-ci 2024-04-25 13:19:17 +02:00
Alexander Sapin
adfe2f78a9 Try to make error more clear 2024-04-25 12:35:08 +02:00
alesapin
4d0ce04a91 Always start clickhouse with env forwarding 2024-04-24 20:03:23 +02:00
Ilya Golshtein
01de28b6c1 kerberized_hadoop_dockerfile: ADD instead of wget, no final OR 2024-04-24 20:36:35 +03:00
Ilya Golshtein
7d82260e3a kerberized_hadoop_dockerfile: get from https via wget 2024-04-24 20:36:35 +03:00
alesapin
68ff44259e Merge branch 'ci_add_azure_tests' of github.com:ClickHouse/ClickHouse into ci_add_azure_tests 2024-04-24 17:31:05 +02:00
Nikolay Degterinsky
26308744ac
Update run.sh 2024-04-24 02:50:04 +02:00
Mikhail f. Shiryaev
63d2f75f05
Fix accumulated shellcheck issues 2024-04-18 18:04:10 +02:00
Alexander Sapin
9896c50c3f azurite only in memory 2024-04-17 14:53:45 +02:00
Smita Kulkarni
d1a81e718c Merge branch 'master' into ci_add_azure_tests 2024-04-17 14:26:41 +02:00
Robert Schulze
4e881be128
Merge pull request #62634 from liuneng1994/std-except-parseDateTIme
Speed up `parseDateTime[InJodaSyntax]Or(Null|Zero)` on invalid inputs
2024-04-16 13:42:10 +00:00
Alexander Sapin
90ef5cc516 better 2024-04-15 18:52:17 +02:00
Alexander Sapin
c0c8c3be99 Fix 2024-04-15 17:28:22 +02:00
Robert Schulze
a86f769e25
Fix FastTest 2024-04-15 14:06:59 +00:00
Alexander Sapin
45d49ca53d I'll shut you down 2024-04-15 15:46:41 +02:00
Alexander Sapin
949ec8d44c Silence 2024-04-15 15:33:25 +02:00
Alexander Sapin
0f2cc6e00a Disable logs 2024-04-15 15:17:36 +02:00
Alexander Sapin
daea269a28 Try without debug logs 2024-04-15 14:42:20 +02:00
Robert Schulze
3c35f14804
Merge remote-tracking branch 'ClickHouse/master' into mkmkme/protobuf-25.1 2024-04-15 12:38:59 +00:00
Alexander Tokmakov
d510c3ac55
Merge pull request #62266 from ClickHouse/cannot_allocate_thread
Add fault injection for "Cannot allocate thread"
2024-04-12 14:40:42 +00:00
Max Kainov
053c3cc0c1 redirect azure logs 2024-04-12 10:22:03 +00:00
Alexey Milovidov
164a8d6097
Merge branch 'master' into clang-18-ci 2024-04-12 03:49:10 +02:00
Alexey Milovidov
d903e189c4
Update docker/test/stateless/run.sh 2024-04-12 01:01:04 +02:00
Raúl Marín
361d73f7a4 Try to fix Bugfix validation job 2024-04-12 00:07:53 +02:00
Alexander Tokmakov
55c510563c Merge branch 'master' into cannot_allocate_thread 2024-04-11 23:06:17 +02:00
Alexander Tokmakov
d8e97b51bf Merge branch 'master' into cannot_allocate_thread 2024-04-10 21:21:42 +02:00
Raúl Marín
12569cc5fe Don't allow the fuzzer to change allow_experimental_analyzer 2024-04-10 18:18:47 +02:00
Nikolay Degterinsky
6f78e89044 Merge remote-tracking branch 'upstream/master' into docker-image 2024-04-09 13:13:58 +00:00
Nikolay Degterinsky
f45acef131 Support for a tiny feature in stateless tests image 2024-04-09 00:33:18 +00:00
Alexey Milovidov
0fccaafda4 Fix tests 2024-04-04 20:06:40 +02:00
Alexander Tokmakov
98ac8031e0 add fault injection 2024-04-03 19:49:23 +02:00
Mikhail Koviazin
e7a664e9df
Merge remote-tracking branch 'upstream/master' into mkmkme/protobuf-25.1 2024-04-03 13:51:37 +03:00
Alexey Milovidov
5e7a90f85f
Merge pull request #62065 from azat/ci/fix-stress-tests-analyzer
Fix stress tests for analyzer due to experimental WINDOW VIEW (by disabling it)
2024-04-01 00:16:02 +03:00
Nikolay Degterinsky
85bba8c59d
Merge pull request #62019 from ClickHouse/evillique-patch-2
Fix logs saving in DatabaseReplicated tests
2024-03-29 01:00:19 +01:00
Azat Khuzhin
a94143ee19 Fix stress tests for analyzer due to experimental WINDOW VIEW (by disabling it)
CI found [1]:

    2024.03.28 13:16:00.797344 [ 99740 ] {} <Error> Application: Caught exception while loading metadata: Code: 695. DB::Exception: Load job 'load table 01069_window_view_proc_tumble_watch.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01069_window_view_proc_tumble_watch`.`wv` from metadata file /var/lib/clickhouse/store/dd8/dd82a4f5-5485-4747-9172-8976d1194c54/wv.sql from query ATTACH WINDOW VIEW `01069_window_view_proc_tumble_watch`.wv UUID '35cc7d27-df3b-4569-9cb9-2ccf6cb1ff4c' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01069_window_view_proc_tumble_watch`.mt GROUP BY tumble(timestamp, toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/61997/ced095394b6fb6d50ed8b6834bd5911ad4702c6e/stateless_tests__tsan__s3_storage__[5_5].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-28 18:27:43 +01:00
Mikhail Koviazin
a9a1bd1afe
docker/stateless-test: install protobuf-compiler v25.1 2024-03-28 16:08:24 +01:00