Commit Graph

3766 Commits

Author SHA1 Message Date
Mikhail f. Shiryaev
6550b6f227
Merge pull request #61607 from ClickHouse/fix-configs-bugfix
Fix configs for upgrade and bugfix
2024-03-20 10:44:43 +01:00
kssenii
fd7c732c12 Add one more comment, better cache policy randomizer 2024-03-19 23:09:17 +01:00
Mikhail f. Shiryaev
fce926446b
Fix sed to not produce local_blob_storage_blob_storage 2024-03-19 18:05:57 +01:00
Raúl Marín
b290fda45a
Merge pull request #61333 from Algunenano/fuzz_log
Minor changes in stress and fuzzer reports
2024-03-19 17:54:38 +01:00
Mikhail f. Shiryaev
301037ca6a
Replace cat | sed; mv by sed -i 2024-03-19 17:53:32 +01:00
kssenii
595165add0 Merge remote-tracking branch 'origin/master' into filecache-better-try-reserve 2024-03-19 15:12:55 +01:00
Alexey Milovidov
2a4116cfb3
Merge pull request #61410 from tomershafir/thread-fuzzer-sleep-rand
ThreadFuzzer: randomize sleep time
2024-03-19 15:56:14 +03:00
Raúl Marín
a6506e8e58 Missed sending the process to background 2024-03-19 12:05:13 +01:00
Raúl Marín
7dbd96cf4e Fix 2024-03-18 19:43:13 +01:00
Raúl Marín
10dd47cf5c Separate CH and sanitizer logs 2024-03-18 16:40:03 +01:00
Mikhail f. Shiryaev
0e6b5705fb
Install python-magic in style-check, split pip and apt 2024-03-18 15:04:44 +01:00
kssenii
7931c44ff2 Check static storage policy 2024-03-17 17:40:43 +01:00
tomershafir
23169117ae thread-fuzzer: randomize sleep time 2024-03-15 00:02:09 +02:00
Azat Khuzhin
02ae7e54a7 Fix bugfix check (due to "unknown object storage type: azure")
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-14 14:57:33 +01:00
Raúl Marín
f63368d83d Separate stdout and stderr in fuzzer report 2024-03-13 19:12:43 +01:00
Raúl Marín
2982f3b369 Fix stress test sanitizer report 2024-03-13 19:12:43 +01:00
Alexey Milovidov
d3872b155e Merge branch 'master' into clang-18-ci 2024-03-13 09:35:58 +01:00
Raúl Marín
a65ac96b04
Merge pull request #61147 from azat/ci/fix-symbolizer
Fix llvm symbolizer on CI
2024-03-12 12:01:43 +01:00
Azat Khuzhin
5a400c181b Fix llvm symbolizer on CI
In #61011 the whole toolchain installation had been removed from the
base image to reduce image sizes, and this is a good thing indeed.

However it also breaks the symbolizer for sanitizers, which makes
stacktraces unreadable, so let's fix this by getting back llvm package,
this should be OK, since it's size is not gigabytes, but only 48MiB (at
least for llvm-14):

    # dpkg -L llvm-14| xargs file | grep -v directory | cut -d: -f1 | xargs du -sch | grep total
    48M     total

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-11 20:36:15 +01:00
Alexey Milovidov
8a484a44e3 Merge branch 'master' into dont-load-useless-index-parts-in-memory 2024-03-11 02:10:20 +01:00
Alexey Milovidov
36e18d7500 Merge branch 'master' into clang-18-ci 2024-03-10 23:57:00 +01:00
Alexey Milovidov
2cc071e0e4 Fix error 2024-03-10 12:48:15 +01:00
Alexey Milovidov
3b8a8c9649 Better gitignore 2024-03-10 09:28:30 +01:00
Alexey Milovidov
9a880c3bb9 Merge branch 'master' into clang-18-ci 2024-03-10 06:59:27 +01:00
Max Kainov
681bd28c87 CI: make style check fast
#do_not_test
2024-03-09 20:57:23 +00:00
Nikita Mikhaylov
6b4867f746
Debug fuzzer failures (#61062) 2024-03-08 21:27:56 +01:00
Mikhail f. Shiryaev
e5a7ec7be6
Do not build odbc driver in sqllogic 2024-03-07 09:52:25 +01:00
Mikhail f. Shiryaev
0cbfe3421f
Reduce size of test images by removing clang from there 2024-03-07 09:52:25 +01:00
Mikhail f. Shiryaev
176ed5f96b
Use curl instead of wget 2024-03-07 09:52:24 +01:00
Mikhail f. Shiryaev
1d8fe381be
Update the odbc in stateless tests 2024-03-07 09:52:23 +01:00
Mikhail f. Shiryaev
0cedafef1e
Do not test odbc in fast tests 2024-03-07 09:52:21 +01:00
Mikhail f. Shiryaev
9967c60c53
Update sccache 2024-03-07 09:52:07 +01:00
Mikhail f. Shiryaev
5e597228d7
Merge pull request #60408 from ClickHouse/update-style-python
Update style python
2024-03-07 09:32:28 +01:00
Kseniia Sumarokova
0d67d9c79d
Merge pull request #60165 from ClickHouse/fix-for-local-object-storage
Allow local/azure as object storage type instead of local_blob_storage/azure_blob_storage
2024-03-07 14:42:44 +08:00
Nikita Mikhaylov
48bea29611
Merge pull request #60654 from ClickHouse/fuzzer-gdb
Try to run fuzzer under gdb
2024-03-05 18:52:13 +01:00
Mikhail f. Shiryaev
34bb40583c
Install stubs for python-requests 2024-03-05 16:02:43 +01:00
Mikhail f. Shiryaev
76cbd78331
Update pylint, mypy, and black in style check image 2024-03-05 15:59:07 +01:00
Raúl Marín
738c481cce Fix fuzzer report 2024-03-05 10:36:42 +00:00
Kseniia Sumarokova
6f5d79db24
Merge branch 'master' into fix-for-local-object-storage 2024-03-05 14:14:34 +08:00
Kseniia Sumarokova
9a3312f12d
Remove debug 2024-03-05 11:55:32 +08:00
Kseniia Sumarokova
b5fb12c6ec
Fix typo 2024-03-05 11:54:58 +08:00
Kseniia Sumarokova
c735caf44f
Fix typo 2024-03-05 11:54:13 +08:00
Nikita Mikhaylov
822ef975a5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fuzzer-gdb 2024-03-05 01:30:54 +01:00
Nikita Mikhaylov
e715ff622d Better 2024-03-05 00:52:13 +01:00
Raúl Marín
6e579e6bfa Use awk since it's much simpler 2024-03-04 18:15:53 +01:00
Raúl Marín
0149b8893a Include multiline logs in fuzzer fatal.log report 2024-03-04 17:42:06 +01:00
Mikhail f. Shiryaev
017a81692f
Merge pull request #60553 from ClickHouse/update-shellcheck
Update shellcheck
2024-03-04 11:21:34 +01:00
Alexey Milovidov
6df3179341 Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-03-03 23:02:20 +01:00
Alexey Milovidov
c51b50aa1a
Merge pull request #60375 from azat/ci/bugfix-check-fix
Fix bugfix check (due to unknown commit_logs_cache_size_threshold)
2024-03-03 23:11:40 +03:00
Azat Khuzhin
c343ec4bcf Fix bugfix and upgrade checks (due to "Unknown handler type 'redirect'" error)
CI: https://s3.amazonaws.com/clickhouse-test-reports/60694/418a6258ac1b55d5e225107bd9ebfc711ca6511b/upgrade_check__msan_.html
CI: https://s3.amazonaws.com/clickhouse-test-reports/60689/707200d2a4ee765c5109dcca78aaaa7f2c63ab85/bugfix_validation.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-03 12:00:49 +01:00
Alexey Milovidov
3938d7156a Merge branch 'master' into fix-for-local-object-storage 2024-03-02 19:44:12 +01:00
Nikita Mikhaylov
361ec17c87 gdb... 2024-03-01 15:31:25 +00:00
Mikhail f. Shiryaev
17210bb494
Fix type, add _server suffix to start and stop functions 2024-03-01 00:21:31 +01:00
Mikhail f. Shiryaev
82a8308198
Update shellcheck to the latest release 2024-02-29 17:41:35 +01:00
Mikhail f. Shiryaev
f40e25f5c3
Check all shell scripts in docker directories 2024-02-29 17:41:33 +01:00
Alexey Milovidov
ee772aaf0f Use clang-18 in CI 2024-02-27 23:17:11 +01:00
Alexey Milovidov
12ecfbb0d0 Fix wrong log message in Fuzzer 2024-02-26 17:46:51 +01:00
Antonio Andelic
2b51497e55
Update docker/test/stateless/run.sh 2024-02-26 08:50:23 +01:00
Azat Khuzhin
83e7f3e1a1 Fix bugfix check (due to unknown commit_logs_cache_size_threshold)
Bugfix check is broken on CI [1], because of:

    2024.02.23 06:12:59.294500 [ 757 ] {} Application: Code: 115. DB::Exception: Unknown setting latest_logs_cache_size_threshold: in Coordination settings config. (UNKNOWN_SETTING), Stack trace (when copying this message, always include the lines below):

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/60031/89eb2a38c0a7c113b7b0a96c8069fea6eb48ae9d/bugfix_validation.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-24 21:17:03 +01:00
Azat Khuzhin
dd690dd05d Expose fatal.log separately for fuzzer
Otherwise you have to download the full server.log

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-24 19:23:28 +01:00
Alexander Tokmakov
ef3b19167f
Merge pull request #58036 from MikhailBurdukov/backoff_for_failed_mutations
Backoff policy for failed mutation.
2024-02-23 15:27:41 +01:00
Kseniia Sumarokova
d3c6761dcf
Update run.sh 2024-02-23 12:06:17 +01:00
Raúl Marín
c359f29842 Merge remote-tracking branch 'blessed/master' into stress_log 2024-02-23 10:50:46 +01:00
Raúl Marín
9c99a2dd2a Maybe better 2024-02-22 13:20:57 +01:00
Raúl Marín
b83b7a7ab7 Stress test: Include the first sanitizer block message in the report 2024-02-22 12:59:12 +01:00
Raúl Marín
5684a14160 Ignore valid 'No such key errors' in stress tests 2024-02-22 11:47:43 +01:00
Kseniia Sumarokova
84d6b4166a
Merge branch 'master' into fix-for-local-object-storage 2024-02-22 11:40:18 +01:00
Antonio Andelic
1b238d1180
Merge pull request #59460 from ClickHouse/keeper-logs-cache
Keeper log cache
2024-02-22 09:03:41 +01:00
Kseniia Sumarokova
2836d0bb55
Update run.sh 2024-02-21 18:46:42 +01:00
Max Kainov
9f51e840db CI: integration tests to mysql80
#ci_set_integration
 #no_merge_commit
2024-02-21 11:05:47 +00:00
Kseniia Sumarokova
462f597c6b
Update run.sh 2024-02-21 11:02:05 +01:00
MikhailBurdukov
fa5747ab7f Fix stress tests 2024-02-21 08:50:39 +00:00
Kseniia Sumarokova
2405115484
Fix upgrade check 2024-02-20 18:05:48 +01:00
MikhailBurdukov
7cdfedaedd Enable setting by default 2024-02-20 08:39:11 +00:00
Antonio Andelic
299a0bd996 Merge branch 'master' into keeper-logs-cache 2024-02-19 10:01:31 +01:00
Alexey Milovidov
c8415ddc29 Speed up the CI 2024-02-18 09:29:34 +01:00
Antonio Andelic
1ade535a83 Merge branch 'master' into keeper-logs-cache 2024-02-15 13:06:37 +01:00
Alexey Milovidov
1fbc52fa40 Remove Aerospike 2024-02-14 05:52:39 +01:00
Alexey Milovidov
2870c628c1
Merge pull request #58926 from MyroTk/master
Include `pytest-reportlog` in the integration tests' CI runner.
2024-02-14 05:05:51 +01:00
MyroTk
6a3c362443
Update Dockerfile 2024-02-12 10:39:26 -08:00
Alexey Milovidov
ed02154a4a Fix "Too many parts" 2024-02-10 07:31:54 +01:00
Alexey Milovidov
99b66f75bd Sequential run 2024-02-10 02:27:55 +01:00
Alexey Milovidov
d466e8d61e Run coverage collection sequentially 2024-02-09 03:55:39 +01:00
Alexey Milovidov
41ff8b3217 Reading Docker files 2024-02-09 00:15:52 +01:00
Alexey Milovidov
91c607f249 Fix a test 2024-02-08 22:11:37 +01:00
Alexey Milovidov
02c0b4c67f Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-02-07 22:45:50 +01:00
Alexey Milovidov
33401643a4 Fix error 2024-02-07 20:28:37 +01:00
Alexey Milovidov
d65a56d967
Merge branch 'master' into enable-coverage-for-debug-build 2024-02-07 04:58:21 +01:00
Alexey Milovidov
aa91d52277
Merge branch 'master' into master 2024-02-06 23:58:53 +01:00
Raúl Marín
a64ce70671 Pin python dependencies in stateless tests 2024-02-06 20:11:04 +01:00
Antonio Andelic
41202cd7b2
fix upgrade 2024-02-06 09:39:22 +01:00
Antonio Andelic
dd3db5d092 Merge branch 'master' into keeper-logs-cache 2024-02-05 16:56:09 +01:00
Max K
411b76cc57
Merge pull request #59241 from ClickHouse/test_arm
CI: Add ARM integration tests
2024-02-05 14:52:46 +01:00
Raúl Marín
08c1799f9c
Merge pull request #59383 from Algunenano/fuzz_literal
Add some fuzzing to ASTLiterals
2024-02-05 12:27:43 +01:00
Mikhail f. Shiryaev
31f27ad398
Merge pull request #59337 from ClickHouse/fix-fasttests-gdb
Some small fixes for docker images
2024-02-05 11:42:18 +01:00
Max Kainov
6504dfe0b2 CI: Enable ARM integration test
#ci_set_integration #no_merge_commit
2024-02-02 17:37:05 +00:00
Raúl Marín
00096e5819 Merge remote-tracking branch 'blessed/master' into fuzz_literal 2024-02-02 17:28:47 +01:00
Antonio Andelic
a248491299
remove new settings from older versions 2024-02-02 11:14:03 +01:00
MyroTk
dffc539880
Merge branch 'ClickHouse:master' into master 2024-02-01 17:05:36 -08:00
Mikhail f. Shiryaev
6f1fbdb5ca
Fix the failed upgrade of kazoo to 2.10.0 2024-02-01 11:20:24 +01:00
Mikhail f. Shiryaev
2577f8031b
Add suid bit to gdb in fast tests image 2024-02-01 11:20:23 +01:00
Mikhail f. Shiryaev
76c6dc51bf
Unify the apt cleaning part in Dockerfile's 2024-02-01 11:20:23 +01:00
Azat Khuzhin
ea720e3171 Verify that stripped clickhouse shows symbol names
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-01 09:32:59 +01:00
Kseniia Sumarokova
60c37fb9bf
Update run.sh 2024-01-31 13:44:16 +01:00
Raúl Marín
4f0c78d665 Upload one file. Save the planet 2024-01-30 20:29:59 +01:00
Alexey Milovidov
35ea956255
Merge pull request #59295 from ClickHouse/fix_block_number
Fix `_block_number` column with non-default serializations and mutation
2024-01-30 04:07:09 +01:00
Alexey Milovidov
cb69a1b25d Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-01-29 15:35:04 +01:00
alesapin
cef109a887 Fix backward compatibility check 2024-01-29 13:19:46 +01:00
Kseniia Sumarokova
f80b226035
Merge pull request #59280 from ClickHouse/kssenii-patch-8
Update run.sh
2024-01-29 10:27:33 +01:00
alesapin
b864b122fa Merge branch 'master' into fix_block_number 2024-01-29 10:19:43 +01:00
Alexey Milovidov
b32f9ae037
Merge pull request #59255 from azat/tests/pdb-v2
Improve pytest --pdb experience by preserving dockerd on SIGINT (v2)
2024-01-29 00:00:57 +01:00
Alexey Milovidov
4a94ae5a1b Merge branch 'master' into enable-coverage-for-debug-build 2024-01-28 22:24:26 +01:00
Kseniia Sumarokova
cc4d4647f5
Update run.sh 2024-01-28 22:24:03 +01:00
Kseniia Sumarokova
41883ddb34
Update run.sh 2024-01-28 18:15:11 +01:00
Kseniia Sumarokova
febd4ce8d7
Update run.sh 2024-01-28 13:41:33 +01:00
alesapin
d70fe79a1e Revert "Disable randomization of allow_experimental_block_number_column flag (#56474)"
This reverts commit 951d9ac144.
2024-01-28 12:28:08 +01:00
Kseniia Sumarokova
24ab61932e
Update run.sh 2024-01-27 22:42:43 +01:00
Kseniia Sumarokova
163a3e44d3
Update run.sh 2024-01-26 21:22:39 +01:00
Azat Khuzhin
94eb33ef27 Improve pytest --pdb experience by preserving dockerd on SIGINT (v2)
Previous fix (#43392) was not correct, since terminal sends SIGINT to
all processes in a group, so simply ignoring it in parent won't work. So
instead dockerd will be run in a new session.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-01-26 16:06:41 +01:00
Azat Khuzhin
92d96c4d02 Fix fasttest by pinning pip dependencies
After image update it prints the following warning:

    /ClickHouse/tests/queries/0_stateless/01558_ttest_scipy.python:5: DeprecationWarning:
    Pyarrow will become a required dependency of pandas in the next major release of pandas (pandas 3.0),
    (to allow more performant data types, such as the Arrow string type, and better interoperability with other libraries)
    but was not found to be installed on your system.
    If this would cause problems for you,
    please provide us feedback at https://github.com/pandas-dev/pandas/issues/54466

Pyarrow can be added as well, but according to the comment in the issue
it bloats the image size 170%, so let's simply downgrade it for now and
see how that issue will be resolved (or the warning could be suppressed
of course).

And pin other dependencies as well to avoid further failures.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-01-26 15:08:22 +01:00
Kseniia Sumarokova
291427d931
Update stateless/run.sh 2024-01-23 14:51:55 +01:00
MyroTk
e78eb41264
Update Dockerfile 2024-01-22 15:19:31 -08:00
Kseniia Sumarokova
bfb822b775
Try fix style check 2024-01-22 20:32:47 +01:00
Kseniia Sumarokova
a23d71b7bb
Update run.sh 2024-01-22 18:19:58 +01:00
Alexey Milovidov
dc1dac3ba4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-01-20 21:41:07 +01:00
Alexey Milovidov
735708e9bb Merge branch 'master' into enable-coverage-for-debug-build 2024-01-20 21:40:53 +01:00
Kseniia Sumarokova
5d67e26fc4
Merge pull request #58869 from ClickHouse/force-check-for-cached-custom-disk
Fix for custom cached disk creation
2024-01-20 14:47:36 +01:00
Alexey Milovidov
8c54a09e66 Fix error 2024-01-20 08:59:29 +01:00
Alexey Milovidov
639d7745d4 Fix error 2024-01-19 17:02:23 +01:00
Kruglov Pavel
55202db06b
Fix 2024-01-19 12:06:10 +01:00
avogar
8f2d78bbbf Merge branch 'master' of github.com:ClickHouse/ClickHouse into settings-changes-check 2024-01-19 11:04:50 +00:00
Kseniia Sumarokova
a661c6b2c0
Update run.sh 2024-01-19 10:37:21 +01:00
alesapin
3dc8b2dbf7
Merge pull request #58955 from ClickHouse/more_safe_way_to_dump_Logs
More safe way to dump system logs in tests
2024-01-19 10:20:55 +01:00
Alexander Sapin
ea6ca96c85 More safe way to dump system logs in tests 2024-01-18 17:51:48 +01:00
kssenii
255a52a8ff Fix tests with database replicated 2024-01-18 13:26:47 +01:00
Alexey Milovidov
f9ca4e3b85 Slightly better 2024-01-18 00:52:05 +01:00
Alexey Milovidov
f89803ebf6 Slightly better 2024-01-17 23:17:53 +01:00
MyroTk
e3f5058f61
Update Dockerfile 2024-01-17 12:13:15 -08:00
Alexey Milovidov
779f738cb9 Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-01-16 05:07:17 +01:00
Alexey Milovidov
a9fe9cae60
Merge pull request #58821 from ClickHouse/do-not-trim-fuzzer-log
Fuzzer: do not trim fuzzer log
2024-01-16 00:01:55 +01:00
Alexey Milovidov
c5024a5f6d Fix typo 2024-01-15 23:36:48 +01:00
Kseniia Sumarokova
ae884760db
Merge pull request #58357 from ClickHouse/better-disks-configuration
Flexible configuration for disks
2024-01-15 21:34:36 +01:00
Dmitry Novik
a6a0122406 Fuzzer: do not trim fuzzer log 2024-01-15 13:06:43 +00:00
Alexey Milovidov
71bef27abf Follow-up 2024-01-15 06:26:54 +01:00
Alexey Milovidov
c5dfae1bca Fix error 2024-01-15 05:07:23 +01:00
Alexey Milovidov
bf2e574857 Symbolization 2024-01-15 00:48:47 +01:00
Alexey Milovidov
97200e2c5d Symbolization 2024-01-15 00:46:01 +01:00
Alexey Milovidov
7662628393 Export coverage to the CI database 2024-01-15 00:41:14 +01:00
Alexey Milovidov
e43be2f3b0 Support stress test 2024-01-14 08:18:03 +01:00
Alexey Milovidov
6f6ec9705e Fix error 2024-01-14 05:18:12 +01:00