thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-09-20 08:40:50 +00:00
Code Issues Packages Projects Releases Wiki Activity
105,019 Commits 8,927 Branches 1,765 Tags 2 GiB
69cdb838c5
Commit Graph

2920 Commits

Author SHA1 Message Date
Alexey Milovidov
31bd775073
Update run-fuzzer.sh 2022-12-25 19:53:26 +03:00
Alexey Milovidov
51503fc9e4 Fuzzer HTML: fix trash 2022-12-25 16:19:42 +01:00
Alexey Milovidov
f22fc35900 Minimal changes 2022-12-25 14:18:05 +01:00
alesapin
bd19c6b699 Make BC check optional (if env var set) 2022-12-24 17:46:22 +01:00
Nikita Taranov
c79c80f841 better 2022-12-20 19:56:29 +01:00
kssenii
7509bb2d3f Fix 2022-12-19 21:29:35 +01:00
Mikhail f. Shiryaev
815ba5b48f
Add check for submodules sanity 2022-12-19 17:36:03 +01:00
Alexey Milovidov
87b4a32d59
Merge pull request #43392 from azat/tests/pdb 
Improve pytest --pdb experience by preserving dockerd on SIGINT
 2022-12-17 04:24:10 +03:00
Alexey Milovidov
a3dc5e8b0a
Merge pull request #44132 from azat/bump-libdivide 
Bump libdivide (to gain some new optimizations)
 2022-12-17 04:07:08 +03:00
Nikita Taranov
7058a5e7ed impl 2022-12-15 18:37:04 +01:00
Alexander Tokmakov
3f336190a7
Update run.sh 2022-12-14 14:21:21 +03:00
Alexander Tokmakov
f68a407636
Update docker/test/stress/run.sh 
Co-authored-by: Alexander Gololobov <440544+davenger@users.noreply.github.com>
 2022-12-13 18:58:02 +03:00
Alexander Tokmakov
49f3e8e19b
Update run.sh 2022-12-13 18:47:13 +03:00
Alexander Tokmakov
371e85d854
Merge pull request #44157 from ClickHouse/fix_session_expired_on_startup 
Ignore "session expired" errors after BC check
 2022-12-13 15:10:36 +03:00
Azat Khuzhin
cdfe62f303 Update libdivide 
This will includes at least [1].

  [1]: https://github.com/ridiculousfish/libdivide/pull/94

v2: Define LIBDIVIDE_* macros mutually exclusive
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-12-13 10:45:01 +01:00
Alexander Tokmakov
469406c494 ignore session expired errors after BC check 2022-12-12 14:02:14 +01:00
Sema Checherinda
9a3aecd4c1 set max-tries bigger when backward compatibility check runs, old version still drop parts at shutdown 2022-12-05 16:05:14 +01:00
Sema Checherinda
dc52a40c04 decrease stop max-tries back to default, do not clear old parts at shutdown 2022-12-05 16:05:14 +01:00
Mikhail f. Shiryaev
8897aa7fe8
Merge pull request #43132 from ClickHouse/strict-typing-ci 
Enable strict typing check in tests/ci
 2022-12-01 14:37:25 +01:00
Mikhail f. Shiryaev
1c5610bf65
Changes during the review 2022-12-01 14:06:17 +01:00
Azat Khuzhin
4c1fb543e1
Sync everything to persistent storage to avoid writeback affects perf tests (#43530) 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-12-01 13:42:59 +01:00
Alexey Milovidov
54e27d4230
Merge branch 'master' into build-libcxx-and-libcxxabi-from-llvm-project 2022-11-30 00:25:25 +01:00
Alexander Tokmakov
ac578efc05
Update run.sh 2022-11-29 20:16:59 +03:00
Mikhail f. Shiryaev
9cb2aa1c46
Add python mypy check to CI 2022-11-29 16:50:22 +01:00
Mikhail f. Shiryaev
e46f615176
Simplify checks list in style-check image 2022-11-29 16:50:22 +01:00
Robert Schulze
829958e13a
Merge branch 'master' into build-libcxx-and-libcxxabi-from-llvm-project 2022-11-28 16:09:14 +01:00
Alexander Tokmakov
9a948dc05a
Merge pull request #43593 from ClickHouse/fix_fuzzer_run 
Remove code that I do not understand
 2022-11-28 18:01:11 +03:00
Azat Khuzhin
ca16f5136f stress: use --max-tries only since 22.12 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-11-27 09:40:39 +01:00
Azat Khuzhin
2c36b52050 stress: increase timeout for server waiting after TERM 
Greater timeout after TERM may reduce about of KILL, let's try.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-11-27 09:40:39 +01:00
Alexander Tokmakov
cdbd1cb158 fix 2022-11-26 18:45:50 +01:00
Nikita Taranov
d1c258cf20
Add xxh3 hash function (#43411) 
* impl

* try fix

* add docs

* add test

* rm unused file

* excellent
 2022-11-26 00:14:08 +01:00
Alexander Tokmakov
a982e62f65 fix 2022-11-25 19:01:24 +01:00
Alexander Tokmakov
98e6c76a60 fix 2022-11-25 16:58:18 +01:00
Alexander Tokmakov
91b4b8e1d5 Merge branch 'master' into fix_fuzzer_run 2022-11-25 16:57:47 +01:00
Mikhail f. Shiryaev
58557c87c2
Merge pull request #43654 from ClickHouse/optimize-builder-image 
Optimize binary-builder size
 2022-11-25 15:24:57 +01:00
Alexey Milovidov
69d1be50bc
Merge pull request #43446 from ClickHouse/fix-typo-3 
Fix typo
 2022-11-25 15:22:28 +01:00
Alexander Tokmakov
1e1caf1440
Update run-fuzzer.sh 2022-11-25 15:06:52 +03:00
Mikhail f. Shiryaev
a68dc6280d
Optimize binary-builder size 2022-11-25 12:17:51 +01:00
Alexander Tokmakov
e125f4016b fix 2022-11-24 21:37:08 +01:00
Alexander Tokmakov
162c7db972
Update run-fuzzer.sh 2022-11-24 14:29:48 +03:00
alesapin
f64f0461fe
Merge pull request #43288 from ClickHouse/Enable_compress_marks_and_primary_key 
Enable compress marks and primary key for CI
 2022-11-24 12:24:04 +01:00
Alexander Tokmakov
f3b7193635 remove code that I do not understand 2022-11-23 21:49:44 +01:00
alesapin
41d3825770 Merge branch 'Enable_compress_marks_and_primary_key' of https://github.com/ClickHouse/ClickHouse into Enable_compress_marks_and_primary_key 2022-11-22 19:12:00 +01:00
alesapin
31142808de Disable compressed marks and index in stress tests 2022-11-22 19:10:51 +01:00
Alexey Milovidov
b7e4547f53
Merge branch 'master' into fix-typo-3 2022-11-22 18:30:06 +01:00
Alexey Milovidov
56f8c0b84b Fix typo 2022-11-21 15:10:15 +01:00
Alexey Milovidov
17e2189199 Fix backward compatibility check 2022-11-21 12:51:51 +01:00
Azat Khuzhin
6e52748af6 Improve pytest --pdb experience by preserving dockerd on SIGINT 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-11-19 10:47:44 +01:00
alesapin
2dbf07f58a Splitting checks 2022-11-18 17:38:17 +01:00
Igor Nikonov
b12ebab65c Enable keeper fault injection and retries for insert queries in 
funcntional tests
 2022-11-11 18:07:15 +00:00
Antonio Andelic
e512d7f036
Merge pull request #42619 from ClickHouse/jepen-multiple-tests 
Extend Jepsen tests with support for server
 2022-11-10 09:01:40 +01:00
Alexander Tokmakov
af78f4b66a
Merge branch 'master' into tavplubix-patch-5 2022-11-09 16:20:24 +03:00
Alexander Tokmakov
9edb4d779b fix 2022-11-09 12:18:29 +01:00
Alexander Tokmakov
d9af3d61b6 Merge branch 'master' into tavplubix-patch-5 2022-11-09 12:17:54 +01:00
Alexander Tokmakov
236f3329bc
Update run-fuzzer.sh 2022-11-08 22:54:58 +03:00
Dmitry Novik
a3c1049f9d
Update run-fuzzer.sh 2022-11-08 19:42:13 +01:00
Alexander Tokmakov
e659fb5d85
Update run-fuzzer.sh 2022-11-08 19:11:44 +03:00
alesapin
de6014e4a5
Update run-fuzzer.sh 2022-11-07 22:54:08 +01:00
Alexander Tokmakov
b8174a63a8 Merge branch 'master' into fix_intersecting_parts2 2022-11-07 20:26:36 +01:00
Mikhail f. Shiryaev
105c6a70f0
Update GH actions checkers 2022-11-07 13:19:40 +01:00
Antonio Andelic
7467490861 Increase test count 2022-11-07 10:39:16 +00:00
Antonio Andelic
8e1a4bcf9a Update CI config 2022-11-07 09:42:00 +00:00
Antonio Andelic
e751557599 Merge branch 'master' into jepen-multiple-tests 2022-11-07 08:13:49 +00:00
Antonio Andelic
98d3b4a835 Support Jepsen for server in CI 2022-11-04 13:40:13 +00:00
Alexander Tokmakov
acbad99b24 remove abandonable_lock part 2 2022-11-02 14:28:49 +01:00
Robert Schulze
ba4fa7e391
Replace libcxx(abi) by llvm-project as fasttest dependency 2022-10-30 13:04:22 +00:00
Antonio Andelic
c5fe2c9be7 Merge branch 'master' into jepen-multiple-tests 2022-10-28 11:34:15 +00:00
Yatsishin Ilya
3ab23ef3f2 Merge remote-tracking branch 'origin/master' into revive-sqlancer 2022-10-28 07:21:39 +00:00
Alexander Tokmakov
86b81a2b6f
Merge pull request #42234 from arthurpassos/fix_ares_fd_process_race_condition 
Fix c-ares crash
 2022-10-27 17:17:22 +03:00
Yatsishin Ilya
3a19752d54 style 2022-10-27 14:08:23 +00:00
Yatsishin Ilya
8a5ef517e3 style 2022-10-27 13:30:35 +00:00
Antonio Andelic
1db9888508 Merge branch 'master' into jepen-multiple-tests 2022-10-27 09:06:51 +00:00
Yatsishin Ilya
d8e8dd006f support server fail 2022-10-27 09:06:11 +00:00
Yatsishin Ilya
8e77180968 Merge remote-tracking branch 'origin/master' into revive-sqlancer 2022-10-26 08:31:00 +00:00
Yatsishin Ilya
c89c14a05d add NoREC 2022-10-25 10:34:55 +00:00
Alexey Milovidov
c48127534b
Merge pull request #41753 from pkit/morton_coding 
add Morton Coding (ZCurve)
 2022-10-25 06:10:37 +02:00
Alexey Milovidov
4f582e19a8
Merge pull request #42479 from ClickHouse/Avogar-patch-1 
Add error "Destination table is myself" to exception list in BC check
 2022-10-25 04:55:12 +02:00
Alexey Milovidov
c4fd827442
Merge pull request #42483 from ClickHouse/Avogar-patch-2 
Get current clickhouse version without sending query in BC check
 2022-10-25 04:54:24 +02:00
Antonio Andelic
5bc9be8a5f Start defining tests for server 2022-10-24 15:04:57 +00:00
Yatsishin Ilya
15b6de2aae Merge remote-tracking branch 'origin/master' into revive-sqlancer 2022-10-24 08:26:01 +00:00
Azat Khuzhin
f0aed68893 ci/stress: fix memory limits overrides for hung check 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-10-22 20:53:18 +02:00
Alexey Milovidov
5fd7409ce1
Merge branch 'master' into morton_coding 2022-10-22 04:39:13 +02:00
Alexander Tokmakov
77ea58d539
Update run-fuzzer.sh 2022-10-21 17:58:20 +03:00
Arthur Passos
50f9acb221
Merge branch 'master' into fix_ares_fd_process_race_condition 2022-10-20 13:35:58 -03:00
Yatsishin Ilya
ab41c8e8ce black 2022-10-19 17:16:41 +00:00
Yatsishin Ilya
7d90d54af8 better reporting 2022-10-19 17:02:49 +00:00
Yatsishin Ilya
5121e9b096 update docker scripts 2022-10-19 16:30:01 +00:00
Alexander Tokmakov
f958c155f3
Merge branch 'master' into fixes_for_replicated_merge_tree2 2022-10-19 17:25:24 +03:00
Antonio Andelic
10b176fe19
Merge pull request #41854 from azat/tests/stress/fix-dbg-sym-bc 
tests: fix debug symbols (and possible crashes) for backward compatiblity check
 2022-10-19 16:18:41 +02:00
Constantine Peresypkin
5b3b11b517 add Morton Coding (ZCurve) 2022-10-19 15:59:25 +02:00
Kruglov Pavel
2ca0d37e83
Get current clickhouse version without sending query in BC check 2022-10-19 13:25:03 +02:00
Kruglov Pavel
632965212f
Add error "Destination table is myself" to exception list in BC check 2022-10-19 12:52:32 +02:00
Azat Khuzhin
7893ff0785 Update woboq_codebrowser location 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-10-18 17:31:15 +02:00
Alexander Tokmakov
ea77ff9022 Merge branch 'master' into fixes_for_replicated_merge_tree2 2022-10-18 17:25:25 +02:00
Yatsishin Ilya
b8193a0eb3 one more time 2022-10-17 17:42:18 +00:00
Yatsishin Ilya
6f26816d4f fix 2022-10-17 16:31:19 +00:00
Yatsishin Ilya
7a74792c1b shellcheck 2022-10-17 16:30:36 +00:00
Yatsishin Ilya
aa432fe95a staging 2022-10-17 15:20:20 +00:00
Yatsishin Ilya
6a82d54314 add CI files 2022-10-17 14:46:50 +00:00
Yatsishin Ilya
9320ae1abf update sqlancer docker files 2022-10-17 13:10:31 +00:00
Azat Khuzhin
a0ceef48da Add a workaround for "The imported target "merge-fdata" references the file" error 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-10-17 12:29:59 +02:00
Azat Khuzhin
f7b2addae9 Bump llvm/clang to 15.0.2 
Otherwise right now codebrowser image is broken [1], due to changes in
cmake:

    #10 1.607 CMake Error at /usr/lib/llvm-15/lib/cmake/llvm/LLVMExports.cmake:1693 (message):
    #10 1.607   The imported target "merge-fdata" references the file
    #10 1.607
    #10 1.607      "/usr/lib/llvm-15/bin/merge-fdata"

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/42349/36502270eb9f195dcd2dc8b350db9367c619f0f8/push_to_dockerhub_amd64.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-10-17 12:29:59 +02:00
Arthur Passos
6d22bb78e0 custom py script in integ tests 2022-10-14 12:39:08 -03:00
Alexander Tokmakov
dc99e67d3f
Update run-fuzzer.sh 2022-10-14 17:45:17 +03:00
Alexey Milovidov
aa9e8f1cde
Merge branch 'master' into new-http-compression-methods 2022-10-05 23:07:01 +03:00
Nikolay Degterinsky
c0497ddf36 Add lz4 to the stateless tests image 2022-10-05 06:45:21 +00:00
Anton Popov
8ca73eab03
Merge branch 'master' into fuzz-table-definitions 2022-10-04 15:10:31 +02:00
Vitaly Baranov
65c61877c7
Merge pull request #33435 from BoloniniD/BLAKE3 
Integrating Rust code into ClickHouse
 2022-10-03 15:25:06 +02:00
Alexander Tokmakov
4211605093 disable zk fault injections in bc check 2022-10-03 13:13:29 +02:00
Robert Schulze
5d15d28843
Fix warning that ENABLE_REPLXX is unused 
- 3rd party lib replxx is mandatory since #37719
- remove the corresponding CMake switch from the fasttest build
 2022-10-03 08:36:23 +00:00
BoloniniD
3a3ca51980 Fixes after review 2022-10-02 20:52:05 +03:00
BoloniniD
fe7b2fdf6e
Merge branch 'master' into BLAKE3 2022-09-30 18:51:31 +03:00
BoloniniD
55c79230b3 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-09-29 23:53:25 +03:00
Alexander Tokmakov
8741785a72 temporarily disable ThreadFuzzer with tsan 2022-09-29 18:08:35 +02:00
Anton Popov
4ac5df2540 drop all fuzzed tables 2022-09-28 14:52:10 +00:00
Anton Popov
c8beae8237 Merge remote-tracking branch 'upstream/master' into HEAD 2022-09-28 12:47:02 +00:00
Azat Khuzhin
9b20468198 tests: fix debug symbols (and possible crashes) for backward compatiblity check 
stress running previous version of the server w/o correct debug symbols
right now, since nobody restore clickhouse.debug file, and this can lead
to the following issues, like in [1]:
- incorrect stack traces
- gdb crashes
- clickhouse crashes, due to non-robust internal DWARF parser (probably)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/41730/8cc53a48ae99a765085f44a75fa49314d1f1cc7d/stress_test__ubsan_.html

Right now I decided not to rework the script to make it less error
prone, but simply fix the problem.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-09-27 22:50:28 +02:00
alesapin
69f3a66538 Keep the most important log in stress tests 2022-09-27 11:16:10 +02:00
Antonio Andelic
97cf045203
Merge pull request #41721 from ClickHouse/collect-correctly-logs-in-stress-test 
Collect logs in Stress test using clickhouse-local
 2022-09-27 08:43:44 +02:00
Antonio Andelic
eb78761a7e Collect necessary 2022-09-26 16:30:01 +00:00
Antonio Andelic
6f4a636e8f Remove wildcard 2022-09-26 11:21:53 +00:00
Antonio Andelic
8fde8b2c56 Try with multiple calls 2022-09-26 11:03:24 +00:00
Antonio Andelic
c60d9db687
Merge branch 'master' into ignore-attach-thread-keeper-errors 2022-09-26 08:38:48 +02:00
Antonio Andelic
5ff1bcd553
Merge branch 'master' into collect-correctly-logs-in-stress-test 2022-09-26 08:38:38 +02:00
alesapin
06e0f554d8 Fix fetch to local disk 2022-09-23 16:46:53 +02:00
Antonio Andelic
1d93c56d1a Collect logs using clickhouse-local 2022-09-23 10:54:16 +00:00
Antonio Andelic
a17a3e1de1 Ignore Keeper hardware errors 2022-09-23 08:23:57 +00:00
Antonio Andelic
0f92e5e576 Add option for loading only system tables from path using clickhouse-local 2022-09-19 14:18:42 +00:00
BoloniniD
5b4fb4bf66
Merge branch 'master' into BLAKE3 2022-09-18 23:14:37 +03:00
Alexey Milovidov
ecfd8cb5a6 Remove trash error message from integration tests 2022-09-17 20:24:56 +02:00
BoloniniD
452ef4435b Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-09-16 20:05:56 +03:00
Alexey Milovidov
da01982652
Merge pull request #41046 from azat/build/llvm-15 
Switch to llvm/clang 15
 2022-09-16 07:31:06 +03:00
BoloniniD
0df426d329 Corrosion fixes + review fixes 2022-09-16 00:05:21 +03:00
Nikita Taranov
def4eeac70
Fix perf tests (#41332) 
We run left server two times. If after the first run server will not be properly stopped, we will get `Address already in use: [::]:9001` exception on the second run.
 2022-09-15 12:27:08 +02:00
Kseniia Sumarokova
b2c9c04c7b
Merge pull request #40821 from kssenii/improve-marks-cache-loading 
Allow to load marks in threadpool in advance
 2022-09-13 12:31:58 +02:00
kssenii
46f74aaba9 Update stress/run.sh 2022-09-12 20:10:35 +02:00
BoloniniD
fe239e7ee9 Fix style + free err_msg before throwing exception 2022-09-12 18:46:54 +03:00
Kseniia Sumarokova
49e0b1316d
Merge pull request #41144 from ClickHouse/bump_minio_version 
Bump minio version in tests
 2022-09-12 13:55:14 +02:00
Azat Khuzhin
ced30a2072 Switch to llvm/clang 15 
It had been released few hours ago, and I want to check how clang-15
generates DWARF-5

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-09-10 21:38:34 +02:00
Igor Nikonov
06070fe0ae
Merge branch 'master' into fix_int8_test_standalone_keeper_mode 2022-09-09 22:03:02 +02:00
Alexander Tokmakov
e77b9e4d0c
Merge pull request #40775 from azat/ci/core-dumps-rework 
Rework core collecting on CI (eliminate gcore usage)
 2022-09-09 20:20:10 +03:00
alesapin
e904822051 Bump minio version in tests 2022-09-09 16:54:03 +02:00
Igor Nikonov
dbfb448290 Fix: integration test, standalone keeper mode 
There is logic regarding which keeper binary use to start keeper cluster in an integration test
There 2 options:
(1) standalone keeper binary (expected binary name clickhouse-keeper)
(2) clickhouse binary with keeper inside

Fixed:
- option (1) didn't work since docker_compose_keeper.yaml didn't create
target clickhouse-keeper at all
- if clickhouse-keeper existed, option (1) was taken but
  clickhouse-keeper could be just a link to clickhouse binary (the link
  is created always during build if cmake option BUILD_STANDALONE_KEEPER is OFF)
 2022-09-09 14:51:34 +00:00
BoloniniD
e8bcbcd016
Merge branch 'master' into BLAKE3 2022-09-09 11:48:31 +03:00
Alexey Milovidov
7776512b04
Merge pull request #41002 from azat/ci/fix-oom-check 
ci/stress: clear dmesg before run to fix "OOM in dmesg" check
 2022-09-06 06:41:36 +03:00
Alexander Tokmakov
b264be3c63
Merge branch 'master' into zookeeper_client_fault_injection 2022-09-05 22:13:09 +03:00
Azat Khuzhin
2724b67537 ci/stress: clear dmesg before run to fix "OOM in dmesg" check 
CI: https://s3.amazonaws.com/clickhouse-test-reports/40772/afa137ae2b6108e72c2d6e43556a04548afa2ea9/stress_test__ubsan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-09-05 15:51:36 +02:00
Kseniia Sumarokova
e12858dca5
Merge pull request #36837 from ClickHouse/stress_s3 
Trying stress on top of S3
 2022-09-05 15:12:55 +02:00
Alexander Tokmakov
abffd4595e
Merge branch 'master' into zookeeper_client_fault_injection 2022-09-05 15:03:26 +03:00
Azat Khuzhin
25e3bebd9d Rework core collecting on CI (eliminate gcore usage) 
gcore is a gdb command, that internally uses gdb to dump the core.

However with proper configuration of limits (core_dump.size_limit) it
should not be required, althought some issues is possible:
- non standard kernel.core_pattern
- sanitizers

So yes, gcore is more "universal" (you don't need to configure any
`kernel_pattern`), but it is ad-hoc, and it has drawbacks -
**it does not work when gdb fails**. For example gdb may fail with
`Dwarf Error: DW_FORM_strx1 found in non-DWO CU` in case of DWARF-5 [1].

  [1]: https://github.com/ClickHouse/ClickHouse/pull/40772#issuecomment-1236331323.

Let's try to switch to more native way.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-09-04 22:07:16 +02:00