Commit Graph

4977 Commits

Author SHA1 Message Date
Nikolay Degterinsky
85bba8c59d
Merge pull request #62019 from ClickHouse/evillique-patch-2
Fix logs saving in DatabaseReplicated tests
2024-03-29 01:00:19 +01:00
Azat Khuzhin
a94143ee19 Fix stress tests for analyzer due to experimental WINDOW VIEW (by disabling it)
CI found [1]:

    2024.03.28 13:16:00.797344 [ 99740 ] {} <Error> Application: Caught exception while loading metadata: Code: 695. DB::Exception: Load job 'load table 01069_window_view_proc_tumble_watch.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01069_window_view_proc_tumble_watch`.`wv` from metadata file /var/lib/clickhouse/store/dd8/dd82a4f5-5485-4747-9172-8976d1194c54/wv.sql from query ATTACH WINDOW VIEW `01069_window_view_proc_tumble_watch`.wv UUID '35cc7d27-df3b-4569-9cb9-2ccf6cb1ff4c' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01069_window_view_proc_tumble_watch`.mt GROUP BY tumble(timestamp, toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/61997/ced095394b6fb6d50ed8b6834bd5911ad4702c6e/stateless_tests__tsan__s3_storage__[5_5].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-28 18:27:43 +01:00
Mikhail Koviazin
a9a1bd1afe
docker/stateless-test: install protobuf-compiler v25.1 2024-03-28 16:08:24 +01:00
Kseniia Sumarokova
5ba2ad53b6
Merge pull request #61163 from ClickHouse/filecache-better-try-reserve
Less contention in cache, part 3
2024-03-28 13:24:22 +01:00
Nikolay Degterinsky
dae3a9e389
Fix 2024-03-28 06:31:46 +01:00
Nikolay Degterinsky
54348e5e8c
Fix logs saving in DatabaseReplicated tests 2024-03-28 06:27:48 +01:00
Mikhail f. Shiryaev
fc96a57422
Merge pull request #61683 from mangadex-pub/54767-remove-extraneous-keeper-docker-volumes
#54767 Remove extraneous volumes in Keeper image
2024-03-27 22:01:50 +01:00
robot-clickhouse
52417e3d42 Update version_date.tsv and changelogs after v24.3.1.2672-lts 2024-03-27 18:02:02 +00:00
Kseniia Sumarokova
db724b1293
Update create.sql 2024-03-25 19:36:48 +01:00
kssenii
ab17c4c987 Better randomization for stress test, restore trace log level back 2024-03-25 12:15:43 +01:00
Tristan
38fb8b3e9e
Explicitly add /var/lib/clickhouse as volume of keeper
Since it appears mandatory at the moment with default Keeper config
2024-03-24 11:19:36 +00:00
Tristan
352c368a54
Update server alpine image template to match improvements in keeper image 2024-03-24 11:19:35 +00:00
Tristan
7962a69770
Cleanup Keeper Dockerfile and Docker entrypoint 2024-03-24 11:19:35 +00:00
Tristan
dff916b64c
Remove extraneous volumes in Keeper image
Specifically the 2 non-data-related volumes

Fixes issue #54767
2024-03-24 11:19:34 +00:00
Raúl Marín
e562a7c117
Merge pull request #61706 from Algunenano/fuzzer_again
Fuzzer: Try a different way to wait for the server
2024-03-21 21:08:03 +01:00
Alexey Milovidov
9afe096ff5
Merge pull request #61681 from ClickHouse/remove-diagnostics
Remove clickhouse-diagnostics from the package
2024-03-21 19:50:47 +03:00
Raúl Marín
4700222a0d Fuzzer: Try a different way to wait for the server 2024-03-21 12:40:07 +01:00
Mikhail f. Shiryaev
ff9a6d0958
Merge pull request #61197 from ClickHouse/merge-commit-style-autofix
Merge commit style autofix
2024-03-21 09:59:53 +01:00
Alexey Milovidov
bfc7c3c89e Remove clickhouse-diagnostics 2024-03-21 02:52:51 +01:00
Max K
4f51d891a0
Merge pull request #61597 from ClickHouse/ci_remove_compose_files_from_docker
CI: remove compose files from integration test docker
2024-03-20 17:36:13 +01:00
Max Kainov
da28eaf454 CI: remove compose files from integration test docker
#ci_set_integration
2024-03-20 14:11:47 +00:00
Raúl Marín
007775c982 Better fuzzer logs 2024-03-20 13:09:26 +01:00
Mikhail f. Shiryaev
6550b6f227
Merge pull request #61607 from ClickHouse/fix-configs-bugfix
Fix configs for upgrade and bugfix
2024-03-20 10:44:43 +01:00
kssenii
fd7c732c12 Add one more comment, better cache policy randomizer 2024-03-19 23:09:17 +01:00
Mikhail f. Shiryaev
fce926446b
Fix sed to not produce local_blob_storage_blob_storage 2024-03-19 18:05:57 +01:00
Raúl Marín
b290fda45a
Merge pull request #61333 from Algunenano/fuzz_log
Minor changes in stress and fuzzer reports
2024-03-19 17:54:38 +01:00
Mikhail f. Shiryaev
301037ca6a
Replace cat | sed; mv by sed -i 2024-03-19 17:53:32 +01:00
kssenii
595165add0 Merge remote-tracking branch 'origin/master' into filecache-better-try-reserve 2024-03-19 15:12:55 +01:00
Alexey Milovidov
2a4116cfb3
Merge pull request #61410 from tomershafir/thread-fuzzer-sleep-rand
ThreadFuzzer: randomize sleep time
2024-03-19 15:56:14 +03:00
Raúl Marín
a6506e8e58 Missed sending the process to background 2024-03-19 12:05:13 +01:00
Raúl Marín
8f318bed0d
Merge pull request #61363 from azat/ci/fix-upgrade-bugfix
Fix bugfix check (due to "unknown object storage type: azure")
2024-03-19 11:58:00 +01:00
Raúl Marín
7dbd96cf4e Fix 2024-03-18 19:43:13 +01:00
Raúl Marín
10dd47cf5c Separate CH and sanitizer logs 2024-03-18 16:40:03 +01:00
Raúl Marín
83c660a545 Merge remote-tracking branch 'blessed/master' into fuzz_log 2024-03-18 16:12:50 +01:00
Mikhail f. Shiryaev
0e6b5705fb
Install python-magic in style-check, split pip and apt 2024-03-18 15:04:44 +01:00
kssenii
7931c44ff2 Check static storage policy 2024-03-17 17:40:43 +01:00
robot-clickhouse
e5a1c0e251 Update version_date.tsv and changelogs after v24.2.2.71-stable 2024-03-15 06:50:44 +00:00
Alexey Milovidov
05357bce5c Merge branch 'master' into clang-18-ci 2024-03-15 07:28:04 +01:00
tomershafir
23169117ae thread-fuzzer: randomize sleep time 2024-03-15 00:02:09 +02:00
Azat Khuzhin
02ae7e54a7 Fix bugfix check (due to "unknown object storage type: azure")
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-14 14:57:33 +01:00
Mikhail f. Shiryaev
277032e444
Move the least updating cctools into beginning, update it 2024-03-14 14:16:33 +01:00
Mikhail f. Shiryaev
c3aefb28e5
Remove unnecessary layers from clickhouse/cctools 2024-03-14 14:13:15 +01:00
Raúl Marín
f63368d83d Separate stdout and stderr in fuzzer report 2024-03-13 19:12:43 +01:00
Raúl Marín
2982f3b369 Fix stress test sanitizer report 2024-03-13 19:12:43 +01:00
Alexey Milovidov
d3872b155e Merge branch 'master' into clang-18-ci 2024-03-13 09:35:58 +01:00
Raúl Marín
a65ac96b04
Merge pull request #61147 from azat/ci/fix-symbolizer
Fix llvm symbolizer on CI
2024-03-12 12:01:43 +01:00
Alexey Milovidov
bdc884dfa5
Merge pull request #60255 from ClickHouse/dont-load-useless-index-parts-in-memory
Do not load useless columns from the index in memory
2024-03-12 08:30:53 +03:00
Azat Khuzhin
5a400c181b Fix llvm symbolizer on CI
In #61011 the whole toolchain installation had been removed from the
base image to reduce image sizes, and this is a good thing indeed.

However it also breaks the symbolizer for sanitizers, which makes
stacktraces unreadable, so let's fix this by getting back llvm package,
this should be OK, since it's size is not gigabytes, but only 48MiB (at
least for llvm-14):

    # dpkg -L llvm-14| xargs file | grep -v directory | cut -d: -f1 | xargs du -sch | grep total
    48M     total

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-11 20:36:15 +01:00
Nikita Mikhaylov
cfa042cb04 Merge branch 'master' of github.com:ClickHouse/ClickHouse into rip-copier 2024-03-11 15:45:20 +00:00
Alexey Milovidov
8a484a44e3 Merge branch 'master' into dont-load-useless-index-parts-in-memory 2024-03-11 02:10:20 +01:00
Alexey Milovidov
36e18d7500 Merge branch 'master' into clang-18-ci 2024-03-10 23:57:00 +01:00
Alexey Milovidov
2cc071e0e4 Fix error 2024-03-10 12:48:15 +01:00
Alexey Milovidov
3b8a8c9649 Better gitignore 2024-03-10 09:28:30 +01:00
Alexey Milovidov
9a880c3bb9 Merge branch 'master' into clang-18-ci 2024-03-10 06:59:27 +01:00
Max Kainov
681bd28c87 CI: make style check fast
#do_not_test
2024-03-09 20:57:23 +00:00
Nikita Mikhaylov
6b4867f746
Debug fuzzer failures (#61062) 2024-03-08 21:27:56 +01:00
Nikita Mikhaylov
2bc4d27ac6 Bye bye 2024-03-07 19:24:39 +00:00
Mikhail f. Shiryaev
922d4cee63
Set the static image tag for cctools sources 2024-03-07 11:58:42 +01:00
Mikhail f. Shiryaev
484453c703
Create a rare-changing clickhouse/cctools 2024-03-07 11:08:56 +01:00
Mikhail f. Shiryaev
e5a7ec7be6
Do not build odbc driver in sqllogic 2024-03-07 09:52:25 +01:00
Mikhail f. Shiryaev
0cbfe3421f
Reduce size of test images by removing clang from there 2024-03-07 09:52:25 +01:00
Mikhail f. Shiryaev
cf0780a777
Change the binary-builder directory 2024-03-07 09:52:24 +01:00
Mikhail f. Shiryaev
176ed5f96b
Use curl instead of wget 2024-03-07 09:52:24 +01:00
Mikhail f. Shiryaev
1d8fe381be
Update the odbc in stateless tests 2024-03-07 09:52:23 +01:00
Mikhail f. Shiryaev
0cedafef1e
Do not test odbc in fast tests 2024-03-07 09:52:21 +01:00
Mikhail f. Shiryaev
9967c60c53
Update sccache 2024-03-07 09:52:07 +01:00
Mikhail f. Shiryaev
5e597228d7
Merge pull request #60408 from ClickHouse/update-style-python
Update style python
2024-03-07 09:32:28 +01:00
Kseniia Sumarokova
0d67d9c79d
Merge pull request #60165 from ClickHouse/fix-for-local-object-storage
Allow local/azure as object storage type instead of local_blob_storage/azure_blob_storage
2024-03-07 14:42:44 +08:00
Nikita Mikhaylov
48bea29611
Merge pull request #60654 from ClickHouse/fuzzer-gdb
Try to run fuzzer under gdb
2024-03-05 18:52:13 +01:00
Mikhail f. Shiryaev
34bb40583c
Install stubs for python-requests 2024-03-05 16:02:43 +01:00
Mikhail f. Shiryaev
76cbd78331
Update pylint, mypy, and black in style check image 2024-03-05 15:59:07 +01:00
Raúl Marín
738c481cce Fix fuzzer report 2024-03-05 10:36:42 +00:00
Kseniia Sumarokova
6f5d79db24
Merge branch 'master' into fix-for-local-object-storage 2024-03-05 14:14:34 +08:00
Kseniia Sumarokova
9a3312f12d
Remove debug 2024-03-05 11:55:32 +08:00
Kseniia Sumarokova
b5fb12c6ec
Fix typo 2024-03-05 11:54:58 +08:00
Kseniia Sumarokova
c735caf44f
Fix typo 2024-03-05 11:54:13 +08:00
Nikita Mikhaylov
822ef975a5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fuzzer-gdb 2024-03-05 01:30:54 +01:00
Nikita Mikhaylov
e715ff622d Better 2024-03-05 00:52:13 +01:00
Raúl Marín
6e579e6bfa Use awk since it's much simpler 2024-03-04 18:15:53 +01:00
Raúl Marín
0149b8893a Include multiline logs in fuzzer fatal.log report 2024-03-04 17:42:06 +01:00
Mikhail f. Shiryaev
017a81692f
Merge pull request #60553 from ClickHouse/update-shellcheck
Update shellcheck
2024-03-04 11:21:34 +01:00
Alexey Milovidov
aeb5b9e921
Merge pull request #60607 from ClickHouse/auto/v24.2.1.2248-stable
Update version_date.tsv and changelogs after v24.2.1.2248-stable
2024-03-04 01:50:00 +03:00
Alexey Milovidov
6df3179341 Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-03-03 23:02:20 +01:00
Alexey Milovidov
c51b50aa1a
Merge pull request #60375 from azat/ci/bugfix-check-fix
Fix bugfix check (due to unknown commit_logs_cache_size_threshold)
2024-03-03 23:11:40 +03:00
Azat Khuzhin
c343ec4bcf Fix bugfix and upgrade checks (due to "Unknown handler type 'redirect'" error)
CI: https://s3.amazonaws.com/clickhouse-test-reports/60694/418a6258ac1b55d5e225107bd9ebfc711ca6511b/upgrade_check__msan_.html
CI: https://s3.amazonaws.com/clickhouse-test-reports/60689/707200d2a4ee765c5109dcca78aaaa7f2c63ab85/bugfix_validation.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-03 12:00:49 +01:00
Alexey Milovidov
3938d7156a Merge branch 'master' into fix-for-local-object-storage 2024-03-02 19:44:12 +01:00
Nikita Mikhaylov
361ec17c87 gdb... 2024-03-01 15:31:25 +00:00
Mikhail f. Shiryaev
17210bb494
Fix type, add _server suffix to start and stop functions 2024-03-01 00:21:31 +01:00
robot-clickhouse
c1d542d700 Update version_date.tsv and changelogs after v24.2.1.2248-stable 2024-02-29 21:19:40 +00:00
Mikhail f. Shiryaev
82a8308198
Update shellcheck to the latest release 2024-02-29 17:41:35 +01:00
Mikhail f. Shiryaev
f40e25f5c3
Check all shell scripts in docker directories 2024-02-29 17:41:33 +01:00
Alexey Milovidov
ee772aaf0f Use clang-18 in CI 2024-02-27 23:17:11 +01:00
Alexey Milovidov
12ecfbb0d0 Fix wrong log message in Fuzzer 2024-02-26 17:46:51 +01:00
Antonio Andelic
2b51497e55
Update docker/test/stateless/run.sh 2024-02-26 08:50:23 +01:00
Azat Khuzhin
83e7f3e1a1 Fix bugfix check (due to unknown commit_logs_cache_size_threshold)
Bugfix check is broken on CI [1], because of:

    2024.02.23 06:12:59.294500 [ 757 ] {} Application: Code: 115. DB::Exception: Unknown setting latest_logs_cache_size_threshold: in Coordination settings config. (UNKNOWN_SETTING), Stack trace (when copying this message, always include the lines below):

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/60031/89eb2a38c0a7c113b7b0a96c8069fea6eb48ae9d/bugfix_validation.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-24 21:17:03 +01:00
Azat Khuzhin
dd690dd05d Expose fatal.log separately for fuzzer
Otherwise you have to download the full server.log

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-24 19:23:28 +01:00
Alexander Tokmakov
ef3b19167f
Merge pull request #58036 from MikhailBurdukov/backoff_for_failed_mutations
Backoff policy for failed mutation.
2024-02-23 15:27:41 +01:00
Kseniia Sumarokova
d3c6761dcf
Update run.sh 2024-02-23 12:06:17 +01:00
Raúl Marín
c359f29842 Merge remote-tracking branch 'blessed/master' into stress_log 2024-02-23 10:50:46 +01:00
Raúl Marín
9c99a2dd2a Maybe better 2024-02-22 13:20:57 +01:00
Raúl Marín
b83b7a7ab7 Stress test: Include the first sanitizer block message in the report 2024-02-22 12:59:12 +01:00
Raúl Marín
5684a14160 Ignore valid 'No such key errors' in stress tests 2024-02-22 11:47:43 +01:00
Kseniia Sumarokova
84d6b4166a
Merge branch 'master' into fix-for-local-object-storage 2024-02-22 11:40:18 +01:00
Antonio Andelic
1b238d1180
Merge pull request #59460 from ClickHouse/keeper-logs-cache
Keeper log cache
2024-02-22 09:03:41 +01:00
Kseniia Sumarokova
2836d0bb55
Update run.sh 2024-02-21 18:46:42 +01:00
Max Kainov
9f51e840db CI: integration tests to mysql80
#ci_set_integration
 #no_merge_commit
2024-02-21 11:05:47 +00:00
Kseniia Sumarokova
462f597c6b
Update run.sh 2024-02-21 11:02:05 +01:00
MikhailBurdukov
fa5747ab7f Fix stress tests 2024-02-21 08:50:39 +00:00
Kseniia Sumarokova
2405115484
Fix upgrade check 2024-02-20 18:05:48 +01:00
MikhailBurdukov
7cdfedaedd Enable setting by default 2024-02-20 08:39:11 +00:00
Antonio Andelic
299a0bd996 Merge branch 'master' into keeper-logs-cache 2024-02-19 10:01:31 +01:00
Alexey Milovidov
c8415ddc29 Speed up the CI 2024-02-18 09:29:34 +01:00
Antonio Andelic
1ade535a83 Merge branch 'master' into keeper-logs-cache 2024-02-15 13:06:37 +01:00
Alexey Milovidov
91ef665ed3
Merge pull request #59993 from ClickHouse/auto/v24.1.5.6-stable
Update version_date.tsv and changelogs after v24.1.5.6-stable
2024-02-14 22:05:34 +01:00
robot-clickhouse
08df19157b Update version_date.tsv and changelogs after v24.1.5.6-stable 2024-02-14 17:22:21 +00:00
jktng
17c9e2df6b
Update entrypoint.sh 2024-02-14 11:39:22 -05:00
Raúl Marín
4fb76a6e25
Merge pull request #59969 from ClickHouse/no-aerospike
We don't have external dictionaries from Aerospike
2024-02-14 15:54:46 +01:00
robot-clickhouse
7514158353 Update version_date.tsv and changelogs after v24.1.4.20-stable 2024-02-14 10:30:32 +00:00
Mikhail f. Shiryaev
9e7ac6d0ee
Revert "Update version_date.tsv and changelogs after v24.1.4.19-stable" 2024-02-14 10:07:09 +01:00
Alexey Milovidov
1fbc52fa40 Remove Aerospike 2024-02-14 05:52:39 +01:00
Alexey Milovidov
2870c628c1
Merge pull request #58926 from MyroTk/master
Include `pytest-reportlog` in the integration tests' CI runner.
2024-02-14 05:05:51 +01:00
robot-clickhouse
3c0abe08cb Update version_date.tsv and changelogs after v24.1.4.19-stable 2024-02-14 00:29:24 +00:00
MyroTk
6a3c362443
Update Dockerfile 2024-02-12 10:39:26 -08:00
Mikhail f. Shiryaev
1285bdbef1
Merge pull request #59808 from AlexNik/always-initdb-option
Option to run init db scripts every time
2024-02-12 12:09:54 +01:00
Alexey Milovidov
a65b9cc1f8
Merge pull request #59800 from ClickHouse/auto/v23.12.4.15-stable
Update version_date.tsv and changelogs after v23.12.4.15-stable
2024-02-11 23:41:09 +01:00
Alexey Milovidov
ed02154a4a Fix "Too many parts" 2024-02-10 07:31:54 +01:00
Alexey Milovidov
99b66f75bd Sequential run 2024-02-10 02:27:55 +01:00
Alexander Nikolaev
68df201145 Add CLICKHOUSE_ALWAYS_RUN_INITDB_SCRIPTS envoronment variable. 2024-02-09 16:50:50 +03:00
robot-clickhouse
582abd40fd Update version_date.tsv and changelogs after v23.12.4.15-stable 2024-02-09 12:25:38 +00:00
Alexey Milovidov
d466e8d61e Run coverage collection sequentially 2024-02-09 03:55:39 +01:00
Alexey Milovidov
41ff8b3217 Reading Docker files 2024-02-09 00:15:52 +01:00
Alexey Milovidov
91c607f249 Fix a test 2024-02-08 22:11:37 +01:00
Alexey Milovidov
d38e6158b0 Merge branch 'enable-coverage-for-debug-build' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-02-07 22:46:10 +01:00
Alexey Milovidov
02c0b4c67f Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-02-07 22:45:50 +01:00
robot-clickhouse
64d9d2d467 Automatic style fix 2024-02-07 20:44:35 +00:00
Alexey Milovidov
4d25929d74 A few missing changes 2024-02-07 20:58:40 +01:00
Alexey Milovidov
33401643a4 Fix error 2024-02-07 20:28:37 +01:00
Alexey Milovidov
d65a56d967
Merge branch 'master' into enable-coverage-for-debug-build 2024-02-07 04:58:21 +01:00
Alexey Milovidov
aa91d52277
Merge branch 'master' into master 2024-02-06 23:58:53 +01:00
Raúl Marín
a64ce70671 Pin python dependencies in stateless tests 2024-02-06 20:11:04 +01:00
Antonio Andelic
41202cd7b2
fix upgrade 2024-02-06 09:39:22 +01:00
Antonio Andelic
dd3db5d092 Merge branch 'master' into keeper-logs-cache 2024-02-05 16:56:09 +01:00
Antonio Andelic
b0fde3828b Merge branch 'master' into keeper-logs-cache 2024-02-05 16:55:46 +01:00
Max K
411b76cc57
Merge pull request #59241 from ClickHouse/test_arm
CI: Add ARM integration tests
2024-02-05 14:52:46 +01:00
Raúl Marín
08c1799f9c
Merge pull request #59383 from Algunenano/fuzz_literal
Add some fuzzing to ASTLiterals
2024-02-05 12:27:43 +01:00
Mikhail f. Shiryaev
31f27ad398
Merge pull request #59337 from ClickHouse/fix-fasttests-gdb
Some small fixes for docker images
2024-02-05 11:42:18 +01:00
Max Kainov
6504dfe0b2 CI: Enable ARM integration test
#ci_set_integration #no_merge_commit
2024-02-02 17:37:05 +00:00
Raúl Marín
00096e5819 Merge remote-tracking branch 'blessed/master' into fuzz_literal 2024-02-02 17:28:47 +01:00
robot-clickhouse
e7f63abc2f Update version_date.tsv and changelogs after v24.1.2.5-stable 2024-02-02 11:41:46 +00:00
Antonio Andelic
a248491299
remove new settings from older versions 2024-02-02 11:14:03 +01:00