Azat Khuzhin
6e52748af6
Improve pytest --pdb experience by preserving dockerd on SIGINT
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-19 10:47:44 +01:00
alesapin
2dbf07f58a
Splitting checks
2022-11-18 17:38:17 +01:00
Igor Nikonov
b12ebab65c
Enable keeper fault injection and retries for insert queries in
...
funcntional tests
2022-11-11 18:07:15 +00:00
Antonio Andelic
e512d7f036
Merge pull request #42619 from ClickHouse/jepen-multiple-tests
...
Extend Jepsen tests with support for server
2022-11-10 09:01:40 +01:00
Alexander Tokmakov
af78f4b66a
Merge branch 'master' into tavplubix-patch-5
2022-11-09 16:20:24 +03:00
Alexander Tokmakov
9edb4d779b
fix
2022-11-09 12:18:29 +01:00
Alexander Tokmakov
d9af3d61b6
Merge branch 'master' into tavplubix-patch-5
2022-11-09 12:17:54 +01:00
Alexander Tokmakov
236f3329bc
Update run-fuzzer.sh
2022-11-08 22:54:58 +03:00
Dmitry Novik
a3c1049f9d
Update run-fuzzer.sh
2022-11-08 19:42:13 +01:00
Alexander Tokmakov
e659fb5d85
Update run-fuzzer.sh
2022-11-08 19:11:44 +03:00
alesapin
de6014e4a5
Update run-fuzzer.sh
2022-11-07 22:54:08 +01:00
Alexander Tokmakov
b8174a63a8
Merge branch 'master' into fix_intersecting_parts2
2022-11-07 20:26:36 +01:00
Mikhail f. Shiryaev
105c6a70f0
Update GH actions checkers
2022-11-07 13:19:40 +01:00
Antonio Andelic
7467490861
Increase test count
2022-11-07 10:39:16 +00:00
Antonio Andelic
8e1a4bcf9a
Update CI config
2022-11-07 09:42:00 +00:00
Antonio Andelic
e751557599
Merge branch 'master' into jepen-multiple-tests
2022-11-07 08:13:49 +00:00
Antonio Andelic
98d3b4a835
Support Jepsen for server in CI
2022-11-04 13:40:13 +00:00
Alexander Tokmakov
acbad99b24
remove abandonable_lock part 2
2022-11-02 14:28:49 +01:00
Robert Schulze
ba4fa7e391
Replace libcxx(abi) by llvm-project as fasttest dependency
2022-10-30 13:04:22 +00:00
Anton Popov
c7f6a410ac
fix some tests
2022-10-28 23:26:06 +00:00
Anton Popov
6a9f195390
do not randomize mt settings with 'show create table'
2022-10-28 15:54:16 +00:00
Anton Popov
d09039418f
Merge remote-tracking branch 'upstream/master' into HEAD
2022-10-28 14:35:45 +00:00
Antonio Andelic
c5fe2c9be7
Merge branch 'master' into jepen-multiple-tests
2022-10-28 11:34:15 +00:00
Yatsishin Ilya
3ab23ef3f2
Merge remote-tracking branch 'origin/master' into revive-sqlancer
2022-10-28 07:21:39 +00:00
Alexander Tokmakov
86b81a2b6f
Merge pull request #42234 from arthurpassos/fix_ares_fd_process_race_condition
...
Fix c-ares crash
2022-10-27 17:17:22 +03:00
Yatsishin Ilya
3a19752d54
style
2022-10-27 14:08:23 +00:00
Yatsishin Ilya
8a5ef517e3
style
2022-10-27 13:30:35 +00:00
Antonio Andelic
1db9888508
Merge branch 'master' into jepen-multiple-tests
2022-10-27 09:06:51 +00:00
Yatsishin Ilya
d8e8dd006f
support server fail
2022-10-27 09:06:11 +00:00
Yatsishin Ilya
8e77180968
Merge remote-tracking branch 'origin/master' into revive-sqlancer
2022-10-26 08:31:00 +00:00
Yatsishin Ilya
c89c14a05d
add NoREC
2022-10-25 10:34:55 +00:00
Alexey Milovidov
c48127534b
Merge pull request #41753 from pkit/morton_coding
...
add Morton Coding (ZCurve)
2022-10-25 06:10:37 +02:00
Alexey Milovidov
4f582e19a8
Merge pull request #42479 from ClickHouse/Avogar-patch-1
...
Add error "Destination table is myself" to exception list in BC check
2022-10-25 04:55:12 +02:00
Alexey Milovidov
c4fd827442
Merge pull request #42483 from ClickHouse/Avogar-patch-2
...
Get current clickhouse version without sending query in BC check
2022-10-25 04:54:24 +02:00
Antonio Andelic
5bc9be8a5f
Start defining tests for server
2022-10-24 15:04:57 +00:00
Yatsishin Ilya
15b6de2aae
Merge remote-tracking branch 'origin/master' into revive-sqlancer
2022-10-24 08:26:01 +00:00
Azat Khuzhin
f0aed68893
ci/stress: fix memory limits overrides for hung check
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-22 20:53:18 +02:00
Alexey Milovidov
5fd7409ce1
Merge branch 'master' into morton_coding
2022-10-22 04:39:13 +02:00
Alexander Tokmakov
77ea58d539
Update run-fuzzer.sh
2022-10-21 17:58:20 +03:00
Arthur Passos
50f9acb221
Merge branch 'master' into fix_ares_fd_process_race_condition
2022-10-20 13:35:58 -03:00
Yatsishin Ilya
ab41c8e8ce
black
2022-10-19 17:16:41 +00:00
Yatsishin Ilya
7d90d54af8
better reporting
2022-10-19 17:02:49 +00:00
Yatsishin Ilya
5121e9b096
update docker scripts
2022-10-19 16:30:01 +00:00
Alexander Tokmakov
f958c155f3
Merge branch 'master' into fixes_for_replicated_merge_tree2
2022-10-19 17:25:24 +03:00
Antonio Andelic
10b176fe19
Merge pull request #41854 from azat/tests/stress/fix-dbg-sym-bc
...
tests: fix debug symbols (and possible crashes) for backward compatiblity check
2022-10-19 16:18:41 +02:00
Constantine Peresypkin
5b3b11b517
add Morton Coding (ZCurve)
2022-10-19 15:59:25 +02:00
Kruglov Pavel
2ca0d37e83
Get current clickhouse version without sending query in BC check
2022-10-19 13:25:03 +02:00
Kruglov Pavel
632965212f
Add error "Destination table is myself" to exception list in BC check
2022-10-19 12:52:32 +02:00
Azat Khuzhin
7893ff0785
Update woboq_codebrowser location
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-18 17:31:15 +02:00
Alexander Tokmakov
ea77ff9022
Merge branch 'master' into fixes_for_replicated_merge_tree2
2022-10-18 17:25:25 +02:00
Yatsishin Ilya
b8193a0eb3
one more time
2022-10-17 17:42:18 +00:00
Yatsishin Ilya
6f26816d4f
fix
2022-10-17 16:31:19 +00:00
Yatsishin Ilya
7a74792c1b
shellcheck
2022-10-17 16:30:36 +00:00
Yatsishin Ilya
aa432fe95a
staging
2022-10-17 15:20:20 +00:00
Yatsishin Ilya
6a82d54314
add CI files
2022-10-17 14:46:50 +00:00
Yatsishin Ilya
9320ae1abf
update sqlancer docker files
2022-10-17 13:10:31 +00:00
Azat Khuzhin
a0ceef48da
Add a workaround for "The imported target "merge-fdata" references the file" error
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-17 12:29:59 +02:00
Azat Khuzhin
f7b2addae9
Bump llvm/clang to 15.0.2
...
Otherwise right now codebrowser image is broken [1], due to changes in
cmake:
#10 1.607 CMake Error at /usr/lib/llvm-15/lib/cmake/llvm/LLVMExports.cmake:1693 (message):
#10 1.607 The imported target "merge-fdata" references the file
#10 1.607
#10 1.607 "/usr/lib/llvm-15/bin/merge-fdata"
[1]: https://s3.amazonaws.com/clickhouse-test-reports/42349/36502270eb9f195dcd2dc8b350db9367c619f0f8/push_to_dockerhub_amd64.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-17 12:29:59 +02:00
Arthur Passos
6d22bb78e0
custom py script in integ tests
2022-10-14 12:39:08 -03:00
Alexander Tokmakov
dc99e67d3f
Update run-fuzzer.sh
2022-10-14 17:45:17 +03:00
Alexey Milovidov
aa9e8f1cde
Merge branch 'master' into new-http-compression-methods
2022-10-05 23:07:01 +03:00
Nikolay Degterinsky
c0497ddf36
Add lz4 to the stateless tests image
2022-10-05 06:45:21 +00:00
Anton Popov
8ca73eab03
Merge branch 'master' into fuzz-table-definitions
2022-10-04 15:10:31 +02:00
Vitaly Baranov
65c61877c7
Merge pull request #33435 from BoloniniD/BLAKE3
...
Integrating Rust code into ClickHouse
2022-10-03 15:25:06 +02:00
Alexander Tokmakov
4211605093
disable zk fault injections in bc check
2022-10-03 13:13:29 +02:00
Robert Schulze
5d15d28843
Fix warning that ENABLE_REPLXX is unused
...
- 3rd party lib replxx is mandatory since #37719
- remove the corresponding CMake switch from the fasttest build
2022-10-03 08:36:23 +00:00
BoloniniD
3a3ca51980
Fixes after review
2022-10-02 20:52:05 +03:00
BoloniniD
fe7b2fdf6e
Merge branch 'master' into BLAKE3
2022-09-30 18:51:31 +03:00
BoloniniD
55c79230b3
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-09-29 23:53:25 +03:00
Alexander Tokmakov
8741785a72
temporarily disable ThreadFuzzer with tsan
2022-09-29 18:08:35 +02:00
Anton Popov
4ac5df2540
drop all fuzzed tables
2022-09-28 14:52:10 +00:00
Anton Popov
c8beae8237
Merge remote-tracking branch 'upstream/master' into HEAD
2022-09-28 12:47:02 +00:00
Azat Khuzhin
9b20468198
tests: fix debug symbols (and possible crashes) for backward compatiblity check
...
stress running previous version of the server w/o correct debug symbols
right now, since nobody restore clickhouse.debug file, and this can lead
to the following issues, like in [1]:
- incorrect stack traces
- gdb crashes
- clickhouse crashes, due to non-robust internal DWARF parser (probably)
[1]: https://s3.amazonaws.com/clickhouse-test-reports/41730/8cc53a48ae99a765085f44a75fa49314d1f1cc7d/stress_test__ubsan_.html
Right now I decided not to rework the script to make it less error
prone, but simply fix the problem.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-27 22:50:28 +02:00
alesapin
69f3a66538
Keep the most important log in stress tests
2022-09-27 11:16:10 +02:00
Antonio Andelic
97cf045203
Merge pull request #41721 from ClickHouse/collect-correctly-logs-in-stress-test
...
Collect logs in Stress test using clickhouse-local
2022-09-27 08:43:44 +02:00
Antonio Andelic
eb78761a7e
Collect necessary
2022-09-26 16:30:01 +00:00
Antonio Andelic
6f4a636e8f
Remove wildcard
2022-09-26 11:21:53 +00:00
Antonio Andelic
8fde8b2c56
Try with multiple calls
2022-09-26 11:03:24 +00:00
Antonio Andelic
c60d9db687
Merge branch 'master' into ignore-attach-thread-keeper-errors
2022-09-26 08:38:48 +02:00
Antonio Andelic
5ff1bcd553
Merge branch 'master' into collect-correctly-logs-in-stress-test
2022-09-26 08:38:38 +02:00
alesapin
06e0f554d8
Fix fetch to local disk
2022-09-23 16:46:53 +02:00
Antonio Andelic
1d93c56d1a
Collect logs using clickhouse-local
2022-09-23 10:54:16 +00:00
Antonio Andelic
a17a3e1de1
Ignore Keeper hardware errors
2022-09-23 08:23:57 +00:00
Antonio Andelic
0f92e5e576
Add option for loading only system tables from path using clickhouse-local
2022-09-19 14:18:42 +00:00
BoloniniD
5b4fb4bf66
Merge branch 'master' into BLAKE3
2022-09-18 23:14:37 +03:00
Alexey Milovidov
ecfd8cb5a6
Remove trash error message from integration tests
2022-09-17 20:24:56 +02:00
BoloniniD
452ef4435b
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-09-16 20:05:56 +03:00
Alexey Milovidov
da01982652
Merge pull request #41046 from azat/build/llvm-15
...
Switch to llvm/clang 15
2022-09-16 07:31:06 +03:00
BoloniniD
0df426d329
Corrosion fixes + review fixes
2022-09-16 00:05:21 +03:00
Nikita Taranov
def4eeac70
Fix perf tests ( #41332 )
...
We run left server two times. If after the first run server will not be properly stopped, we will get `Address already in use: [::]:9001` exception on the second run.
2022-09-15 12:27:08 +02:00
Kseniia Sumarokova
b2c9c04c7b
Merge pull request #40821 from kssenii/improve-marks-cache-loading
...
Allow to load marks in threadpool in advance
2022-09-13 12:31:58 +02:00
kssenii
46f74aaba9
Update stress/run.sh
2022-09-12 20:10:35 +02:00
BoloniniD
fe239e7ee9
Fix style + free err_msg before throwing exception
2022-09-12 18:46:54 +03:00
Kseniia Sumarokova
49e0b1316d
Merge pull request #41144 from ClickHouse/bump_minio_version
...
Bump minio version in tests
2022-09-12 13:55:14 +02:00
Azat Khuzhin
ced30a2072
Switch to llvm/clang 15
...
It had been released few hours ago, and I want to check how clang-15
generates DWARF-5
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Igor Nikonov
06070fe0ae
Merge branch 'master' into fix_int8_test_standalone_keeper_mode
2022-09-09 22:03:02 +02:00
Alexander Tokmakov
e77b9e4d0c
Merge pull request #40775 from azat/ci/core-dumps-rework
...
Rework core collecting on CI (eliminate gcore usage)
2022-09-09 20:20:10 +03:00
alesapin
e904822051
Bump minio version in tests
2022-09-09 16:54:03 +02:00
Igor Nikonov
dbfb448290
Fix: integration test, standalone keeper mode
...
There is logic regarding which keeper binary use to start keeper cluster in an integration test
There 2 options:
(1) standalone keeper binary (expected binary name clickhouse-keeper)
(2) clickhouse binary with keeper inside
Fixed:
- option (1) didn't work since docker_compose_keeper.yaml didn't create
target clickhouse-keeper at all
- if clickhouse-keeper existed, option (1) was taken but
clickhouse-keeper could be just a link to clickhouse binary (the link
is created always during build if cmake option BUILD_STANDALONE_KEEPER is OFF)
2022-09-09 14:51:34 +00:00
BoloniniD
e8bcbcd016
Merge branch 'master' into BLAKE3
2022-09-09 11:48:31 +03:00
Alexey Milovidov
7776512b04
Merge pull request #41002 from azat/ci/fix-oom-check
...
ci/stress: clear dmesg before run to fix "OOM in dmesg" check
2022-09-06 06:41:36 +03:00
Alexander Tokmakov
b264be3c63
Merge branch 'master' into zookeeper_client_fault_injection
2022-09-05 22:13:09 +03:00
Azat Khuzhin
2724b67537
ci/stress: clear dmesg before run to fix "OOM in dmesg" check
...
CI: https://s3.amazonaws.com/clickhouse-test-reports/40772/afa137ae2b6108e72c2d6e43556a04548afa2ea9/stress_test__ubsan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-05 15:51:36 +02:00
Kseniia Sumarokova
e12858dca5
Merge pull request #36837 from ClickHouse/stress_s3
...
Trying stress on top of S3
2022-09-05 15:12:55 +02:00
Alexander Tokmakov
abffd4595e
Merge branch 'master' into zookeeper_client_fault_injection
2022-09-05 15:03:26 +03:00
Azat Khuzhin
25e3bebd9d
Rework core collecting on CI (eliminate gcore usage)
...
gcore is a gdb command, that internally uses gdb to dump the core.
However with proper configuration of limits (core_dump.size_limit) it
should not be required, althought some issues is possible:
- non standard kernel.core_pattern
- sanitizers
So yes, gcore is more "universal" (you don't need to configure any
`kernel_pattern`), but it is ad-hoc, and it has drawbacks -
**it does not work when gdb fails**. For example gdb may fail with
`Dwarf Error: DW_FORM_strx1 found in non-DWO CU` in case of DWARF-5 [1].
[1]: https://github.com/ClickHouse/ClickHouse/pull/40772#issuecomment-1236331323 .
Let's try to switch to more native way.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-04 22:07:16 +02:00
Ilya Golshtein
74561b40ae
stylecheck renewed
2022-09-02 17:42:18 +03:00
Alexander Tokmakov
8bdb589c2b
Merge branch 'master' into zookeeper_client_fault_injection
2022-08-29 13:34:57 +02:00
alesapin
133ca01447
Merge branch 'master' into stress_s3
2022-08-29 11:25:28 +02:00
Alexey Milovidov
7bd1142f63
Merge pull request #40647 from ClickHouse/high-level-coverage
...
Report high-level function and data types test coverage
2022-08-27 23:13:10 +03:00
Alexey Milovidov
f86242c17e
Merge pull request #40699 from ClickHouse/remove-unbundled
...
Remove the remaining parts of "unbundled" build
2022-08-27 21:54:42 +03:00
Alexey Milovidov
00afbadb53
Merge branch 'master' into high-level-coverage
2022-08-27 19:34:26 +03:00
Azat Khuzhin
ebc61a36e0
tests/stress: improve OOM detection (add separate check by dmesg)
...
Right now if you will look at the OOM errors:
- OOM killer (or signal 9) in clickhouse-server.log
- Backward compatibility check: OOM messages in clickhouse-server.log
Most of them are not real, but just clickhouse server got KILLed by
clickhouse stop, #40678 may imporove the situation, but to definitely
sure that there was OOM let's look at dmesg.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-27 12:46:58 +02:00
Alexey Milovidov
91ed3ebe9a
Remove the remaining parts of "unbundled" build
2022-08-27 02:18:47 +02:00
Alexey Milovidov
2a7d9f0778
Merge branch 'master' into high-level-coverage
2022-08-26 23:44:52 +02:00
Azat Khuzhin
3b519c5d44
tests/stress: capture stacktrace of server hungs if pid was removed already
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-26 22:06:32 +03:00
Alexander Tokmakov
263c467d90
Update setup_hdfs_minicluster.sh
2022-08-26 14:09:42 +03:00
Alexander Tokmakov
76e3ab8c59
Update setup_hdfs_minicluster.sh
2022-08-26 13:33:12 +03:00
alesapin
704c4b2c5b
Stop thread fuzzer on shutdown
2022-08-26 11:54:54 +02:00
Alexey Milovidov
440d10370a
Report high-level function test coverage
2022-08-26 01:59:14 +02:00
alesapin
3ff6489fae
Merge branch 'master' into stress_s3
2022-08-25 13:14:58 +02:00
alesapin
ad692f732a
Merge branch 'master' into stress_s3
2022-08-25 13:13:30 +02:00
alesapin
35f9815b8e
Fix backward comp check
2022-08-24 14:43:02 +02:00
Alexey Milovidov
35ce19ab63
Merge pull request #40354 from azat/tests/stress-dmesg-v3
...
tests/stress: use --privileged over --cap-add syslog to obtain dmesg
2022-08-20 14:13:55 +03:00
Nikita Taranov
9f1ee52b00
Run all queries from changed perf tests ( #40322 )
...
* impl
* fix
2022-08-19 19:46:07 +02:00
Azat Khuzhin
50bddc43dc
tests/stress: ignore NETLINK_ERROR from checkPermissionsImpl
...
Since now with --privileged it has CAP_SYS_ADMIN and tries to
communicate via netlink.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-19 14:07:06 +02:00
Alexander Tokmakov
3d253ec51b
Merge branch 'master' into zookeeper_client_fault_injection
2022-08-18 21:23:50 +03:00
alesapin
922818bbd9
Merge branch 'stress_s3' of github.com:ClickHouse/ClickHouse into stress_s3
2022-08-18 14:46:50 +02:00
alesapin
932ea146f5
Merge branch 'master' into stress_s3
2022-08-18 13:14:47 +02:00
alesapin
86b1e33eed
Disable cache on writes
2022-08-17 19:00:53 +02:00
alesapin
600d22851f
Grep dangerous S3 errors
2022-08-17 12:43:11 +02:00
alesapin
0433b801d2
Configure properly
2022-08-17 12:27:15 +02:00
Alexander Tokmakov
ae000e9125
Merge branch 'master' into zookeeper_client_fault_injection
2022-08-17 12:48:54 +03:00
alesapin
1ec6627a70
Fix tables creation
2022-08-16 18:28:17 +02:00
kssenii
52832ea788
May be fix database replicated check
2022-08-16 11:51:57 +02:00
kssenii
eb26b219b9
Merge master
2022-08-16 00:56:27 +02:00
Alexander Tokmakov
589c3408d2
Merge pull request #40234 from ClickHouse/better_message_on_restore_covered
...
Better error message when restoring covered parts
2022-08-15 22:01:48 +03:00
alesapin
243bd492fa
Trying to fix it
2022-08-15 20:55:11 +02:00
alesapin
96722a13bb
Merge branch 'master' into stress_s3
2022-08-15 20:20:31 +02:00
Alexander Tokmakov
edaff70010
better error message when restoring covered parts
2022-08-15 13:53:14 +02:00
Alexey Milovidov
6b8f4f1d59
Merge branch 'master' into server-side-time
2022-08-12 21:36:40 +02:00
Alexander Tokmakov
46aaf842f8
Merge pull request #40031 from ClickHouse/fix_old_tmp_dirs_cleanup
...
Fix old temporary directories cleanup
2022-08-12 20:31:20 +03:00
Alexander Tokmakov
b3deae3593
Merge branch 'master' into flaky_check_ordinary
2022-08-12 18:11:39 +03:00
Alexey Milovidov
8c3d1f2b5b
Merge branch 'master' into server-side-time
2022-08-12 17:40:02 +03:00
Alexander Tokmakov
467ef7bbc2
Update run.sh
2022-08-12 14:30:18 +03:00
kssenii
768a207176
Merge master
2022-08-11 22:25:53 +02:00
Alexander Tokmakov
06e42a1b23
run tests with Ordinary database in flaky check
2022-08-11 21:32:03 +02:00
Alexander Tokmakov
b9d18182f2
fix
2022-08-11 15:27:26 +02:00
Anton Popov
0ba886f763
enable fuzzing of table definitions
2022-08-11 12:24:15 +00:00
Maksim Kita
627424889d
Merge pull request #39926 from azat/dict-prom-fix
...
Remove dictionaries from prometheus metrics on DETACH/DROP
2022-08-11 13:10:47 +02:00
Anton Popov
e347fa2f45
add fuzzer for table definition
2022-08-11 02:34:10 +00:00
Alexey Milovidov
c323f64804
Fix Fasttest
2022-08-11 03:29:46 +02:00
Alexander Tokmakov
bb46bfa6d9
Update process_functional_tests_result.py
2022-08-10 21:20:52 +03:00
Alexey Milovidov
cbeba683d8
Merge pull request #40017 from ClickHouse/ci-self-extracting-s3-deployment-2
...
copy self-extracting to output
2022-08-10 21:10:23 +03:00
Alexey Milovidov
774ba4db23
Remove old code
2022-08-10 19:44:13 +02:00
Alexey Milovidov
7aff85fc79
Fix test Dockerfile
2022-08-10 19:41:29 +02:00
kssenii
5c3227ba56
Merge master
2022-08-10 12:00:34 +02:00
kssenii
0dda03c94b
Fix checks
2022-08-10 00:06:58 +02:00
Alexey Milovidov
f7d995681b
Merge branch 'master' into replace-yandex-to-noto
2022-08-09 22:43:52 +03:00
Yakov Olkhovskiy
09e6b1a497
run clickhouse to decompress
2022-08-09 09:16:03 -04:00
Alexander Tokmakov
3bc583c22b
Revert "copy self-extracting to output"
2022-08-08 20:13:40 +03:00
Alexey Milovidov
0921548a37
Merge pull request #39527 from pkit/pkit/fix_nats_tls
...
fix nats-io TLS support
2022-08-08 08:28:14 +03:00
Alexey Milovidov
0349d9da96
Change font in CI reports just in case (might be worse)
2022-08-08 07:25:29 +02:00
Alexey Milovidov
cb7f072fe8
Merge pull request #39617 from ClickHouse/ci-self-extracting-s3-deployment
...
copy self-extracting to output
2022-08-08 08:19:15 +03:00
kssenii
e81f85a79e
Fix checks
2022-08-07 16:44:02 +02:00
Azat Khuzhin
791377e4dc
tests: avoid prometheus.port overlap for replicated database
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-06 13:00:53 +03:00
Azat Khuzhin
3772415588
tests/stress: add dmesg output (to see OOM details)
...
max_server_memory_usage already set to 75%, so OOM should not happens,
the reason is that because RSS does not match with memory tracker
statistics:
2022.08.05 12:36:57.869896 [ 82524 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 64.69 GiB, peak 65.26 GiB, will set to 62.80 GiB (RSS), difference: -1.89 GiB
...
2022.08.05 12:37:00.213440 [ 82334 ] {} <Error> void DB::MergeTreeBackgroundExecutor<DB::MergeMutateRuntimeQueue>::routine(DB::TaskRuntimeDataPtr) [Queue = DB::MergeMutateRuntimeQueue]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 64.68 GiB (attempt to allocate chunk of 1298794 bytes), maximum: 51.44 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or orvercommit denominator are set to zero.. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-06 12:34:38 +03:00
kssenii
9685f9a8b7
Fix checks
2022-08-05 22:16:33 +02:00
Yakov Olkhovskiy
4c78f0fc7d
Merge branch 'master' into ci-self-extracting-s3-deployment
2022-08-05 08:14:48 -04:00
Constantine Peresypkin
10c76917ea
fix nats-io TLS support
...
nats-io library needs `NATS_HAS_TLS` define to correctly compile-in TLS
support
fixes #39525
2022-08-05 11:20:05 +02:00
kssenii
7a9b0bc47f
Merge master
2022-08-05 01:48:52 +02:00
Anton Popov
4f2c73f9f6
Merge remote-tracking branch 'upstream/master' into HEAD
2022-08-04 23:08:15 +00:00
BoloniniD
48c91619b0
Merge branch 'master' into BLAKE3
2022-08-04 20:30:47 +03:00
Kruglov Pavel
235649cb98
Merge pull request #39458 from Avogar/fix-cancel-insert-into-function
...
Fix WriteBuffer finalize when cancel insert into function
2022-08-04 13:02:08 +02:00
Mikhail f. Shiryaev
8533769132
Use compression and cleanup with the recent version ccache
2022-08-03 14:49:07 +02:00
Mikhail f. Shiryaev
eeaf08525f
Use test-util as source for base-test, fasttest and package builder
2022-08-03 14:49:06 +02:00
BoloniniD
b745842c36
Fix Rust build in fasttest
2022-08-03 10:20:57 +03:00
BoloniniD
b161773f71
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-08-02 20:25:25 +03:00
kssenii
d462782d1a
Fix checks
2022-08-02 14:27:45 +02:00
Alexander Tokmakov
e5c47cb26f
Update run.sh
2022-08-02 12:10:53 +03:00
Alexander Tokmakov
ecf7ce1f74
Merge branch 'master' into zookeeper_client_fault_injection
2022-08-01 20:49:01 +02:00
kssenii
2850f68ac9
Fix checks
2022-08-01 20:48:05 +02:00
Alexander Tokmakov
3cc20f05ba
Update run.sh
2022-08-01 20:47:14 +03:00
kssenii
e5f4a619ed
Merge master
2022-07-31 20:24:40 +03:00
Alexey Milovidov
36e6500e54
Merge branch 'master' into BLAKE3
2022-07-30 23:14:05 +03:00
Yakov Olkhovskiy
f5442cba86
clickhouse may be compressed - run once to decompress
2022-07-29 15:06:15 -04:00
Yakov Olkhovskiy
72be640cfb
clickhouse may be compressed - run once to decompress
2022-07-29 15:04:50 -04:00
avogar
573d9c1b57
Fix stress test
2022-07-29 18:30:40 +00:00
Mikhail f. Shiryaev
672e67aa8e
Change mysql-odbc url
2022-07-29 11:52:20 +02:00
Mikhail f. Shiryaev
061e61919a
Merge pull request #39450 from ClickHouse/tsal-clang-13
...
Build thread sanitizer binaries with clang-13
2022-07-26 15:13:17 +02:00
Mikhail f. Shiryaev
3e0db34ed9
Merge pull request #39390 from ClickHouse/paint-it-black
...
Automatic fixes for black formatting for domestic repo PRs
2022-07-22 17:19:00 +02:00
Mikhail f. Shiryaev
c6b251d0cb
Revert "Merge pull request #38106 from ClickHouse/tsan_less_flaky_tests"
...
This reverts commit 0ae0cc54aa1d7cf28cab
2022-07-22 12:14:23 +02:00
jasperzhu
614f3b14a2
Merge branch 'master' into dev_intel_iaa_deflate
2022-07-22 11:05:44 +08:00
Mikhail f. Shiryaev
7d2cf648df
Make a docker image for style check lighter
2022-07-21 16:59:49 +02:00
Mikhail f. Shiryaev
dacfc7886c
Improve style_check scripts style a little bit
2022-07-21 16:59:44 +02:00
Alexander Tokmakov
9e9969cea7
Merge pull request #37827 from arthurpassos/host_regexp_multiple_domains
...
Test host_regexp against all PTR records instead of only one
2022-07-21 16:43:05 +03:00
Arthur Passos
828de2a674
Add host regexp multiple PTR records integration tests
2022-07-20 14:09:38 -03:00
Dmitry Novik
a09422de7b
Merge pull request #38642 from ClickHouse/group-by-use-nulls
...
Add group_by_use_nulls setting
2022-07-20 14:42:42 +02:00
Alexander Tokmakov
840ace663b
Update run.sh
2022-07-20 13:19:53 +03:00
Dmitry Novik
50989bdb68
Merge branch 'master' into group-by-use-nulls
2022-07-19 14:58:01 +02:00
kssenii
df17df67c2
Fix checks
2022-07-19 10:45:54 +02:00
jasperzhu
c044c67745
Merge branch 'master' into dev_intel_iaa_deflate
2022-07-19 15:32:57 +08:00
kssenii
274457e5cf
Allow cache over azure blob storage, add tests
2022-07-18 16:15:04 +02:00
kssenii
8ad26b3111
Merge master
2022-07-16 22:50:03 +02:00
Alexander Tokmakov
b770f9903d
Update run.sh
2022-07-15 20:03:00 +03:00
Alexander Tokmakov
5c24cd979b
Merge pull request #39256 from ClickHouse/bc_check_fix_stacks_in_gdb
...
Fix stacktraces in gdb in BC check
2022-07-15 17:54:18 +03:00
Anton Popov
da97a22465
Merge pull request #39243 from CurtizJ/send-logs-level-colors
...
Do not color logs on client if they are redirected to file
2022-07-15 13:33:13 +02:00
Alexander Tokmakov
77487e996c
fix stacktraces in gdb in bc check
2022-07-15 12:23:28 +02:00
Anton Popov
efed134758
fix test
2022-07-14 21:48:34 +00:00
kssenii
15a2d60f23
Fix checks
2022-07-14 22:04:39 +02:00
Alexander Tokmakov
f8e23c1deb
Update run.sh
2022-07-14 17:29:08 +03:00
Anton Popov
97425bb167
turn on merge tree settings randomization
2022-07-13 21:07:12 +00:00
Alexander Tokmakov
991493e6fc
Update run.sh
2022-07-13 15:22:36 +03:00
Dmitry Novik
5f65b45269
Merge branch 'master' into group-by-use-nulls
2022-07-12 22:36:04 +02:00
Kseniia Sumarokova
f69ec635d0
Merge pull request #39110 from ClickHouse/kssenii-patch-4
...
Fix meilisearch tests
2022-07-12 18:32:49 +02:00
Kseniia Sumarokova
f629fd7e57
Update docker_compose_meili.yml
2022-07-12 15:50:35 +02:00
Alexander Tokmakov
948f15eff3
Update run.sh
2022-07-12 14:01:53 +03:00
Kseniia Sumarokova
bcd9453f33
Set meilieserach client version too
2022-07-12 12:15:20 +02:00
Kseniia Sumarokova
aebb73a24d
Update docker_compose_meili.yml
2022-07-11 21:41:15 +02:00
Arthur Passos
7b626da080
remove cpp-dns and udns from fasttest
2022-07-11 12:43:56 -03:00
Vladimir C
ca2e27aaa2
Merge pull request #37841 from vdimir/perf-save-to-stat
...
Send perf tests results to ci database
2022-07-11 13:07:40 +02:00
jinjunzh
7cb5b35bef
remove qpl from fasttest
2022-07-09 13:54:23 -04:00
Vladimir C
bfba67cf88
Update docker/test/performance-comparison/compare.sh
2022-07-08 17:13:20 +02:00
Alexander Tokmakov
2b886ddc2e
Update run.sh
2022-07-08 16:47:54 +03:00
Vladimir C
9555d72dfc
Remove head ci-checks.tsv
2022-07-08 15:26:07 +02:00
Alexander Tokmakov
57b8a6a542
Update run.sh
2022-07-08 13:53:35 +03:00
Dmitry Novik
0b18b4ed43
Use group_by_use_nulls in tests more often
2022-07-07 18:58:46 +00:00
Dmitry Novik
d1df66687b
Merge branch 'master' into group-by-use-nulls
2022-07-07 20:54:38 +02:00
Vladimir C
db838f1343
Merge pull request #35796 from vdimir/full-sorting-merge-join
2022-07-07 19:16:49 +02:00
Kruglov Pavel
8ffd6cd22c
Merge pull request #38717 from Avogar/improve-bc-check
...
Try to improve backward compatibility check
2022-07-07 18:52:34 +02:00
vdimir
b0c0ec370d
Add join_algorithm='full_sorting_merge' to stress tests
2022-07-06 14:27:34 +00:00
Kruglov Pavel
a3a94a1c09
Avoid false positive red sanitizer asserts check in stress test
2022-07-06 14:32:17 +02:00
mergify[bot]
e746760e41
Merge branch 'master' into improve-bc-check
2022-07-06 11:53:43 +00:00
jinjunzh
ba38969e9c
enable qpl for clickhouse-keeper build
2022-07-05 15:28:41 -04:00
vdimir
f701b58dd0
Update check_name in performance comparsion upload
2022-07-05 14:24:58 +02:00
vdimir
e4917914ae
Revert "show grants in compare.sh"
...
This reverts commit 4d3a64b318aa665bf1494cca6ae94e58dc8d361e.
2022-07-05 14:00:27 +02:00
vdimir
3731bd44c1
Revert "[testing] run only one perftest"
...
This reverts commit 3b079827b78e04ac20043346998ce9d546969746.
2022-07-05 14:00:26 +02:00
vdimir
051dd63a62
Fix types in ci-checks.tsv in compare.sh
2022-07-05 14:00:26 +02:00
vdimir
c1d44fee9f
upd compare.sh
2022-07-05 14:00:26 +02:00
vdimir
b1ee16ef77
show grants in compare.sh
2022-07-05 14:00:26 +02:00
vdimir
18dc718e4e
do not create tables for perf tests
2022-07-05 14:00:25 +02:00
vdimir
f8fa10578c
Use default database for perf tests
2022-07-05 14:00:25 +02:00
vdimir
7352c26e89
create tables for perf tests
2022-07-05 14:00:25 +02:00
vdimir
45b2b1ca8a
[wip] persist pertest results
2022-07-05 14:00:24 +02:00
vdimir
c2d774d598
[testing] run only one perftest
2022-07-05 14:00:24 +02:00
vdimir
aac2f8aefc
Rename envs for performance comparsion
2022-07-05 14:00:24 +02:00
Kseniia Sumarokova
6c3d648f49
Merge branch 'master' into nats-integration
2022-07-04 21:06:07 +02:00
Kruglov Pavel
45ac74617b
Fix
2022-07-04 20:38:21 +02:00
Dmitry Novik
614ce26ee7
Add group_be_use_nulls setting to stress tests
2022-07-04 18:09:48 +00:00
Kruglov Pavel
65dd81586b
Update run.sh
2022-07-04 17:30:22 +02:00
Arthur Passos
6c987fb28e
Minor adjustments
2022-07-04 10:13:50 -03:00
Arthur Passos
52c5d7e0f9
Add cpp-dns and udns to docker/test/fasttest
2022-07-04 10:06:26 -03:00
avogar
17da24b584
Try to improve backward compatibility check
2022-07-04 13:02:22 +00:00
Azat Khuzhin
8e9c1eaa73
tests/stress: redirect gdb output on stop hang to gdb.log
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-03 14:46:17 +03:00
Alexander Tokmakov
b238ed4093
fix stress tests
2022-07-01 17:19:00 +02:00
Alexander Tokmakov
4dde5a6165
Merge pull request #38568 from ClickHouse/tavplubix-patch-1
...
Allow Ordinary database in Stress Tests
2022-06-30 16:23:08 +03:00
Alexander Tokmakov
4bf1443dae
Update download.sh
2022-06-30 01:00:08 +03:00
Alexander Tokmakov
cd2cb10f60
another try to fix performance tests
2022-06-29 20:55:46 +03:00
Alexander Tokmakov
baeb1811e1
try to fix performance tests
2022-06-29 16:59:16 +03:00
Alexander Tokmakov
3ff26939fc
Update run.sh
2022-06-29 15:46:40 +03:00
mergify[bot]
3f266954f0
Merge branch 'master' into deprecate_ordinary_database
2022-06-28 18:13:36 +00:00
Alexander Tokmakov
0bb036dd21
Update Dockerfile
2022-06-28 20:35:20 +03:00
mergify[bot]
4a1fefb42d
Merge branch 'master' into deprecate_ordinary_database
2022-06-28 15:49:52 +00:00
Alexander Tokmakov
66cf6da35c
Merge pull request #38518 from ClickHouse/tavplubix-patch-1
...
Fix `_csv.Error: field larger than field limit`
2022-06-28 18:46:43 +03:00
Alexander Tokmakov
e23f1fa774
Merge pull request #38269 from excitoon-favorites/integrationtestsfixes
...
Don't try to kill empty list of containers in `integration/runner` II
2022-06-28 17:35:48 +03:00
BoloniniD
6ddcec0906
Merge branch 'master' into BLAKE3
2022-06-28 16:53:06 +03:00
Alexander Tokmakov
428628238f
Merge branch 'master' into deprecate_ordinary_database
2022-06-28 15:40:33 +02:00
Kruglov Pavel
25100ad5e5
Merge pull request #38520 from ClickHouse/Avogar-patch-1
...
Fix application errors grep in stress test
2022-06-28 14:26:22 +02:00
Alexander Tokmakov
411512ed6f
Update run.sh
2022-06-28 14:28:06 +03:00
Kruglov Pavel
f7419e0703
Fix application errors grep in stress test
2022-06-28 13:12:21 +02:00
Alexander Tokmakov
456e03758b
Update process_functional_tests_result.py
2022-06-28 13:52:39 +03:00
Vladimir Chebotarev
89dc2844db
Fix for integration tests fix.
2022-06-27 23:13:40 +03:00
Alexander Tokmakov
7c37079a96
Merge branch 'master' into deprecate_ordinary_database
2022-06-27 14:46:59 +02:00
Vladimir Chebotarev
2b19e69930
Don't try to kill empty list of containers in integration/runner.
2022-06-27 06:12:10 +03:00
jasperzhu
b2f98fa73b
Merge branch 'master' into dev_intel_iaa_deflate
2022-06-27 10:21:21 +08:00
Mikhail f. Shiryaev
848ae7b130
Update docker-compose to try get rid of v1 errors
2022-06-24 16:49:48 +02:00
Alexander Tokmakov
cfe0e434e5
Revert "Add support for io_uring read method"
2022-06-24 12:19:41 +03:00
Alexey Milovidov
812ab9bd6b
Merge pull request #36103 from sauliusvl/uring
...
Add support for io_uring read method
2022-06-24 00:34:29 +03:00
Alexander Tokmakov
dbf2763788
automatically convert system database to Atomic
2022-06-23 21:38:43 +02:00
Alexander Tokmakov
2c5a88faba
deprecate Ordinary database
2022-06-23 10:20:14 +02:00
Alexander Tokmakov
1595ff5620
Merge pull request #38260 from bigo-sg/hive_test
...
Improve the stability for hive storage integration test
2022-06-22 21:08:23 +03:00
lgbo-ustc
eddb6443f2
rollback dockerd-entrypoint.sh
2022-06-21 16:25:24 +08:00
lgbo-ustc
cdd7a54995
improve stability for hive intergration test
2022-06-21 15:59:54 +08:00
lgbo-ustc
633c3c8287
update hive test
2022-06-21 15:10:48 +08:00
Saulius Valatka
6bbabf59d9
simplify build, add read method randomized tests, fix typos
2022-06-21 09:59:46 +03:00
Alexander Tokmakov
b5a977ad54
Merge pull request #38213 from azat/stress-thread-fuzzer-v2
...
tests/stress: fix TSan detection
2022-06-20 16:46:31 +03:00
Azat Khuzhin
dce71bbe06
tests/stress: fix TSan detection
...
+ test -f package_folder/clickhouse-client_22.7.1.1+tsan_all.deb package_folder/clickhouse-common-static-dbg_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-common-static_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-keeper_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-server_22.7.1.1+tsan_all.deb
/run.sh: line 13: test: too many arguments
Follow-up for: #38207 (cc @tavplubix)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 08:10:03 +03:00
Azat Khuzhin
e307a728ca
tests: add no-stress tag
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 07:48:10 +03:00
Azat Khuzhin
e79c24deda
docker/test/stress/stress: apply black
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 07:48:10 +03:00
Azat Khuzhin
d154288fc6
tests/stress: fix TSan detection (enables thread fuzzer for non-TSan builds)
...
Follow-up for: #38106 (cc @tavplubix @alesapin)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-19 19:27:25 +03:00
alesapin
0ae0cc54aa
Merge pull request #38106 from ClickHouse/tsan_less_flaky_tests
...
Some fixes for tests with tsan
2022-06-18 14:22:43 +02:00
Alexander Tokmakov
5ba304476d
Merge pull request #37560 from azat/tests-scripts-proper-wait
...
Proper wait of the clickhouse-server in tests
2022-06-17 18:23:30 +03:00
Alexander Tokmakov
3e8aa2dc47
Update run.sh
2022-06-16 13:24:21 +03:00
jasperzhu
bca18b2caf
Merge branch 'master' into dev_intel_iaa_deflate
2022-06-16 08:56:27 +08:00
Alexander Tokmakov
9cac78b498
make tests with tsan less flaky
2022-06-15 19:54:46 +02:00
Azat Khuzhin
23494e9957
tests: avoid "_csv.Error: field larger than field limit (131072)" error
...
v2: apply black
v3: ignore only hung check report
v4: ignore everything after "Database: "
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-14 18:16:59 +03:00
Azat Khuzhin
4ae0dccf00
docker/test/util/process_functional_tests_result.py: fix typo
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-14 18:16:31 +03:00
Mikhail f. Shiryaev
3ba7d1b2e2
Trying get rid of llvm in stateful tests image
2022-06-10 18:12:24 +02:00
Mikhail f. Shiryaev
92fb62aed5
Pin minio client version too
2022-06-10 18:11:45 +02:00
Mikhail f. Shiryaev
4d45839f17
Generalize setup_minio.sh
...
- Cleanup apt garbage in the container
- Download the same binary in docker and setup_minio.sh
- Use binary and not rpm for minio
- Sort packages in Dockerfile's
2022-06-10 15:04:45 +02:00
