thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-15 02:41:59 +00:00
Code Issues Packages Projects Releases Wiki Activity
128,558 Commits 9,328 Branches 1,783 Tags 2.1 GiB
89b93adf82
Commit Graph

3403 Commits

Author SHA1 Message Date
Alexander Tokmakov
ac578efc05
Update run.sh 2022-11-29 20:16:59 +03:00
Mikhail f. Shiryaev
9cb2aa1c46
Add python mypy check to CI 2022-11-29 16:50:22 +01:00
Mikhail f. Shiryaev
e46f615176
Simplify checks list in style-check image 2022-11-29 16:50:22 +01:00
Robert Schulze
829958e13a
Merge branch 'master' into build-libcxx-and-libcxxabi-from-llvm-project 2022-11-28 16:09:14 +01:00
Alexander Tokmakov
9a948dc05a
Merge pull request #43593 from ClickHouse/fix_fuzzer_run 
Remove code that I do not understand
 2022-11-28 18:01:11 +03:00
Azat Khuzhin
ca16f5136f stress: use --max-tries only since 22.12 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-11-27 09:40:39 +01:00
Azat Khuzhin
2c36b52050 stress: increase timeout for server waiting after TERM 
Greater timeout after TERM may reduce about of KILL, let's try.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-11-27 09:40:39 +01:00
Alexander Tokmakov
cdbd1cb158 fix 2022-11-26 18:45:50 +01:00
Nikita Taranov
d1c258cf20
Add xxh3 hash function (#43411) 
* impl

* try fix

* add docs

* add test

* rm unused file

* excellent
 2022-11-26 00:14:08 +01:00
Alexander Tokmakov
a982e62f65 fix 2022-11-25 19:01:24 +01:00
Alexander Tokmakov
98e6c76a60 fix 2022-11-25 16:58:18 +01:00
Alexander Tokmakov
91b4b8e1d5 Merge branch 'master' into fix_fuzzer_run 2022-11-25 16:57:47 +01:00
Mikhail f. Shiryaev
58557c87c2
Merge pull request #43654 from ClickHouse/optimize-builder-image 
Optimize binary-builder size
 2022-11-25 15:24:57 +01:00
Alexey Milovidov
69d1be50bc
Merge pull request #43446 from ClickHouse/fix-typo-3 
Fix typo
 2022-11-25 15:22:28 +01:00
Alexander Tokmakov
1e1caf1440
Update run-fuzzer.sh 2022-11-25 15:06:52 +03:00
Mikhail f. Shiryaev
a68dc6280d
Optimize binary-builder size 2022-11-25 12:17:51 +01:00
Alexander Tokmakov
e125f4016b fix 2022-11-24 21:37:08 +01:00
Alexander Tokmakov
162c7db972
Update run-fuzzer.sh 2022-11-24 14:29:48 +03:00
alesapin
f64f0461fe
Merge pull request #43288 from ClickHouse/Enable_compress_marks_and_primary_key 
Enable compress marks and primary key for CI
 2022-11-24 12:24:04 +01:00
Alexander Tokmakov
f3b7193635 remove code that I do not understand 2022-11-23 21:49:44 +01:00
alesapin
41d3825770 Merge branch 'Enable_compress_marks_and_primary_key' of https://github.com/ClickHouse/ClickHouse into Enable_compress_marks_and_primary_key 2022-11-22 19:12:00 +01:00
alesapin
31142808de Disable compressed marks and index in stress tests 2022-11-22 19:10:51 +01:00
Alexey Milovidov
b7e4547f53
Merge branch 'master' into fix-typo-3 2022-11-22 18:30:06 +01:00
Alexey Milovidov
56f8c0b84b Fix typo 2022-11-21 15:10:15 +01:00
Alexey Milovidov
17e2189199 Fix backward compatibility check 2022-11-21 12:51:51 +01:00
Azat Khuzhin
6e52748af6 Improve pytest --pdb experience by preserving dockerd on SIGINT 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-11-19 10:47:44 +01:00
alesapin
2dbf07f58a Splitting checks 2022-11-18 17:38:17 +01:00
Igor Nikonov
b12ebab65c Enable keeper fault injection and retries for insert queries in 
funcntional tests
 2022-11-11 18:07:15 +00:00
Antonio Andelic
e512d7f036
Merge pull request #42619 from ClickHouse/jepen-multiple-tests 
Extend Jepsen tests with support for server
 2022-11-10 09:01:40 +01:00
Alexander Tokmakov
af78f4b66a
Merge branch 'master' into tavplubix-patch-5 2022-11-09 16:20:24 +03:00
Alexander Tokmakov
9edb4d779b fix 2022-11-09 12:18:29 +01:00
Alexander Tokmakov
d9af3d61b6 Merge branch 'master' into tavplubix-patch-5 2022-11-09 12:17:54 +01:00
Alexander Tokmakov
236f3329bc
Update run-fuzzer.sh 2022-11-08 22:54:58 +03:00
Dmitry Novik
a3c1049f9d
Update run-fuzzer.sh 2022-11-08 19:42:13 +01:00
Alexander Tokmakov
e659fb5d85
Update run-fuzzer.sh 2022-11-08 19:11:44 +03:00
alesapin
de6014e4a5
Update run-fuzzer.sh 2022-11-07 22:54:08 +01:00
Alexander Tokmakov
b8174a63a8 Merge branch 'master' into fix_intersecting_parts2 2022-11-07 20:26:36 +01:00
Mikhail f. Shiryaev
105c6a70f0
Update GH actions checkers 2022-11-07 13:19:40 +01:00
Antonio Andelic
7467490861 Increase test count 2022-11-07 10:39:16 +00:00
Antonio Andelic
8e1a4bcf9a Update CI config 2022-11-07 09:42:00 +00:00
Antonio Andelic
e751557599 Merge branch 'master' into jepen-multiple-tests 2022-11-07 08:13:49 +00:00
Antonio Andelic
98d3b4a835 Support Jepsen for server in CI 2022-11-04 13:40:13 +00:00
Alexander Tokmakov
acbad99b24 remove abandonable_lock part 2 2022-11-02 14:28:49 +01:00
Robert Schulze
ba4fa7e391
Replace libcxx(abi) by llvm-project as fasttest dependency 2022-10-30 13:04:22 +00:00
Anton Popov
c7f6a410ac fix some tests 2022-10-28 23:26:06 +00:00
Anton Popov
6a9f195390 do not randomize mt settings with 'show create table' 2022-10-28 15:54:16 +00:00
Anton Popov
d09039418f Merge remote-tracking branch 'upstream/master' into HEAD 2022-10-28 14:35:45 +00:00
Antonio Andelic
c5fe2c9be7 Merge branch 'master' into jepen-multiple-tests 2022-10-28 11:34:15 +00:00
Yatsishin Ilya
3ab23ef3f2 Merge remote-tracking branch 'origin/master' into revive-sqlancer 2022-10-28 07:21:39 +00:00
Alexander Tokmakov
86b81a2b6f
Merge pull request #42234 from arthurpassos/fix_ares_fd_process_race_condition 
Fix c-ares crash
 2022-10-27 17:17:22 +03:00
Yatsishin Ilya
3a19752d54 style 2022-10-27 14:08:23 +00:00
Yatsishin Ilya
8a5ef517e3 style 2022-10-27 13:30:35 +00:00
Antonio Andelic
1db9888508 Merge branch 'master' into jepen-multiple-tests 2022-10-27 09:06:51 +00:00
Yatsishin Ilya
d8e8dd006f support server fail 2022-10-27 09:06:11 +00:00
Yatsishin Ilya
8e77180968 Merge remote-tracking branch 'origin/master' into revive-sqlancer 2022-10-26 08:31:00 +00:00
Yatsishin Ilya
c89c14a05d add NoREC 2022-10-25 10:34:55 +00:00
Alexey Milovidov
c48127534b
Merge pull request #41753 from pkit/morton_coding 
add Morton Coding (ZCurve)
 2022-10-25 06:10:37 +02:00
Alexey Milovidov
4f582e19a8
Merge pull request #42479 from ClickHouse/Avogar-patch-1 
Add error "Destination table is myself" to exception list in BC check
 2022-10-25 04:55:12 +02:00
Alexey Milovidov
c4fd827442
Merge pull request #42483 from ClickHouse/Avogar-patch-2 
Get current clickhouse version without sending query in BC check
 2022-10-25 04:54:24 +02:00
Antonio Andelic
5bc9be8a5f Start defining tests for server 2022-10-24 15:04:57 +00:00
Yatsishin Ilya
15b6de2aae Merge remote-tracking branch 'origin/master' into revive-sqlancer 2022-10-24 08:26:01 +00:00
Azat Khuzhin
f0aed68893 ci/stress: fix memory limits overrides for hung check 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-10-22 20:53:18 +02:00
Alexey Milovidov
5fd7409ce1
Merge branch 'master' into morton_coding 2022-10-22 04:39:13 +02:00
Alexander Tokmakov
77ea58d539
Update run-fuzzer.sh 2022-10-21 17:58:20 +03:00
Arthur Passos
50f9acb221
Merge branch 'master' into fix_ares_fd_process_race_condition 2022-10-20 13:35:58 -03:00
Yatsishin Ilya
ab41c8e8ce black 2022-10-19 17:16:41 +00:00
Yatsishin Ilya
7d90d54af8 better reporting 2022-10-19 17:02:49 +00:00
Yatsishin Ilya
5121e9b096 update docker scripts 2022-10-19 16:30:01 +00:00
Alexander Tokmakov
f958c155f3
Merge branch 'master' into fixes_for_replicated_merge_tree2 2022-10-19 17:25:24 +03:00
Antonio Andelic
10b176fe19
Merge pull request #41854 from azat/tests/stress/fix-dbg-sym-bc 
tests: fix debug symbols (and possible crashes) for backward compatiblity check
 2022-10-19 16:18:41 +02:00
Constantine Peresypkin
5b3b11b517 add Morton Coding (ZCurve) 2022-10-19 15:59:25 +02:00
Kruglov Pavel
2ca0d37e83
Get current clickhouse version without sending query in BC check 2022-10-19 13:25:03 +02:00
Kruglov Pavel
632965212f
Add error "Destination table is myself" to exception list in BC check 2022-10-19 12:52:32 +02:00
Azat Khuzhin
7893ff0785 Update woboq_codebrowser location 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-10-18 17:31:15 +02:00
Alexander Tokmakov
ea77ff9022 Merge branch 'master' into fixes_for_replicated_merge_tree2 2022-10-18 17:25:25 +02:00
Yatsishin Ilya
b8193a0eb3 one more time 2022-10-17 17:42:18 +00:00
Yatsishin Ilya
6f26816d4f fix 2022-10-17 16:31:19 +00:00
Yatsishin Ilya
7a74792c1b shellcheck 2022-10-17 16:30:36 +00:00
Yatsishin Ilya
aa432fe95a staging 2022-10-17 15:20:20 +00:00
Yatsishin Ilya
6a82d54314 add CI files 2022-10-17 14:46:50 +00:00
Yatsishin Ilya
9320ae1abf update sqlancer docker files 2022-10-17 13:10:31 +00:00
Azat Khuzhin
a0ceef48da Add a workaround for "The imported target "merge-fdata" references the file" error 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-10-17 12:29:59 +02:00
Azat Khuzhin
f7b2addae9 Bump llvm/clang to 15.0.2 
Otherwise right now codebrowser image is broken [1], due to changes in
cmake:

    #10 1.607 CMake Error at /usr/lib/llvm-15/lib/cmake/llvm/LLVMExports.cmake:1693 (message):
    #10 1.607   The imported target "merge-fdata" references the file
    #10 1.607
    #10 1.607      "/usr/lib/llvm-15/bin/merge-fdata"

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/42349/36502270eb9f195dcd2dc8b350db9367c619f0f8/push_to_dockerhub_amd64.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-10-17 12:29:59 +02:00
Arthur Passos
6d22bb78e0 custom py script in integ tests 2022-10-14 12:39:08 -03:00
Alexander Tokmakov
dc99e67d3f
Update run-fuzzer.sh 2022-10-14 17:45:17 +03:00
Alexey Milovidov
aa9e8f1cde
Merge branch 'master' into new-http-compression-methods 2022-10-05 23:07:01 +03:00
Nikolay Degterinsky
c0497ddf36 Add lz4 to the stateless tests image 2022-10-05 06:45:21 +00:00
Anton Popov
8ca73eab03
Merge branch 'master' into fuzz-table-definitions 2022-10-04 15:10:31 +02:00
Vitaly Baranov
65c61877c7
Merge pull request #33435 from BoloniniD/BLAKE3 
Integrating Rust code into ClickHouse
 2022-10-03 15:25:06 +02:00
Alexander Tokmakov
4211605093 disable zk fault injections in bc check 2022-10-03 13:13:29 +02:00
Robert Schulze
5d15d28843
Fix warning that ENABLE_REPLXX is unused 
- 3rd party lib replxx is mandatory since #37719
- remove the corresponding CMake switch from the fasttest build
 2022-10-03 08:36:23 +00:00
BoloniniD
3a3ca51980 Fixes after review 2022-10-02 20:52:05 +03:00
BoloniniD
fe7b2fdf6e
Merge branch 'master' into BLAKE3 2022-09-30 18:51:31 +03:00
BoloniniD
55c79230b3 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-09-29 23:53:25 +03:00
Alexander Tokmakov
8741785a72 temporarily disable ThreadFuzzer with tsan 2022-09-29 18:08:35 +02:00
Anton Popov
4ac5df2540 drop all fuzzed tables 2022-09-28 14:52:10 +00:00
Anton Popov
c8beae8237 Merge remote-tracking branch 'upstream/master' into HEAD 2022-09-28 12:47:02 +00:00
Azat Khuzhin
9b20468198 tests: fix debug symbols (and possible crashes) for backward compatiblity check 
stress running previous version of the server w/o correct debug symbols
right now, since nobody restore clickhouse.debug file, and this can lead
to the following issues, like in [1]:
- incorrect stack traces
- gdb crashes
- clickhouse crashes, due to non-robust internal DWARF parser (probably)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/41730/8cc53a48ae99a765085f44a75fa49314d1f1cc7d/stress_test__ubsan_.html

Right now I decided not to rework the script to make it less error
prone, but simply fix the problem.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-09-27 22:50:28 +02:00
alesapin
69f3a66538 Keep the most important log in stress tests 2022-09-27 11:16:10 +02:00
Antonio Andelic
97cf045203
Merge pull request #41721 from ClickHouse/collect-correctly-logs-in-stress-test 
Collect logs in Stress test using clickhouse-local
 2022-09-27 08:43:44 +02:00
Antonio Andelic
eb78761a7e Collect necessary 2022-09-26 16:30:01 +00:00
Antonio Andelic
6f4a636e8f Remove wildcard 2022-09-26 11:21:53 +00:00
Antonio Andelic
8fde8b2c56 Try with multiple calls 2022-09-26 11:03:24 +00:00
Antonio Andelic
c60d9db687
Merge branch 'master' into ignore-attach-thread-keeper-errors 2022-09-26 08:38:48 +02:00
Antonio Andelic
5ff1bcd553
Merge branch 'master' into collect-correctly-logs-in-stress-test 2022-09-26 08:38:38 +02:00
alesapin
06e0f554d8 Fix fetch to local disk 2022-09-23 16:46:53 +02:00
Antonio Andelic
1d93c56d1a Collect logs using clickhouse-local 2022-09-23 10:54:16 +00:00
Antonio Andelic
a17a3e1de1 Ignore Keeper hardware errors 2022-09-23 08:23:57 +00:00
Antonio Andelic
0f92e5e576 Add option for loading only system tables from path using clickhouse-local 2022-09-19 14:18:42 +00:00
BoloniniD
5b4fb4bf66
Merge branch 'master' into BLAKE3 2022-09-18 23:14:37 +03:00
Alexey Milovidov
ecfd8cb5a6 Remove trash error message from integration tests 2022-09-17 20:24:56 +02:00
BoloniniD
452ef4435b Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-09-16 20:05:56 +03:00
Alexey Milovidov
da01982652
Merge pull request #41046 from azat/build/llvm-15 
Switch to llvm/clang 15
 2022-09-16 07:31:06 +03:00
BoloniniD
0df426d329 Corrosion fixes + review fixes 2022-09-16 00:05:21 +03:00
Nikita Taranov
def4eeac70
Fix perf tests (#41332) 
We run left server two times. If after the first run server will not be properly stopped, we will get `Address already in use: [::]:9001` exception on the second run.
 2022-09-15 12:27:08 +02:00
Kseniia Sumarokova
b2c9c04c7b
Merge pull request #40821 from kssenii/improve-marks-cache-loading 
Allow to load marks in threadpool in advance
 2022-09-13 12:31:58 +02:00
kssenii
46f74aaba9 Update stress/run.sh 2022-09-12 20:10:35 +02:00
BoloniniD
fe239e7ee9 Fix style + free err_msg before throwing exception 2022-09-12 18:46:54 +03:00
Kseniia Sumarokova
49e0b1316d
Merge pull request #41144 from ClickHouse/bump_minio_version 
Bump minio version in tests
 2022-09-12 13:55:14 +02:00
Azat Khuzhin
ced30a2072 Switch to llvm/clang 15 
It had been released few hours ago, and I want to check how clang-15
generates DWARF-5

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-09-10 21:38:34 +02:00
Igor Nikonov
06070fe0ae
Merge branch 'master' into fix_int8_test_standalone_keeper_mode 2022-09-09 22:03:02 +02:00
Alexander Tokmakov
e77b9e4d0c
Merge pull request #40775 from azat/ci/core-dumps-rework 
Rework core collecting on CI (eliminate gcore usage)
 2022-09-09 20:20:10 +03:00
alesapin
e904822051 Bump minio version in tests 2022-09-09 16:54:03 +02:00
Igor Nikonov
dbfb448290 Fix: integration test, standalone keeper mode 
There is logic regarding which keeper binary use to start keeper cluster in an integration test
There 2 options:
(1) standalone keeper binary (expected binary name clickhouse-keeper)
(2) clickhouse binary with keeper inside

Fixed:
- option (1) didn't work since docker_compose_keeper.yaml didn't create
target clickhouse-keeper at all
- if clickhouse-keeper existed, option (1) was taken but
  clickhouse-keeper could be just a link to clickhouse binary (the link
  is created always during build if cmake option BUILD_STANDALONE_KEEPER is OFF)
 2022-09-09 14:51:34 +00:00
BoloniniD
e8bcbcd016
Merge branch 'master' into BLAKE3 2022-09-09 11:48:31 +03:00
Alexey Milovidov
7776512b04
Merge pull request #41002 from azat/ci/fix-oom-check 
ci/stress: clear dmesg before run to fix "OOM in dmesg" check
 2022-09-06 06:41:36 +03:00
Alexander Tokmakov
b264be3c63
Merge branch 'master' into zookeeper_client_fault_injection 2022-09-05 22:13:09 +03:00
Azat Khuzhin
2724b67537 ci/stress: clear dmesg before run to fix "OOM in dmesg" check 
CI: https://s3.amazonaws.com/clickhouse-test-reports/40772/afa137ae2b6108e72c2d6e43556a04548afa2ea9/stress_test__ubsan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-09-05 15:51:36 +02:00
Kseniia Sumarokova
e12858dca5
Merge pull request #36837 from ClickHouse/stress_s3 
Trying stress on top of S3
 2022-09-05 15:12:55 +02:00
Alexander Tokmakov
abffd4595e
Merge branch 'master' into zookeeper_client_fault_injection 2022-09-05 15:03:26 +03:00
Azat Khuzhin
25e3bebd9d Rework core collecting on CI (eliminate gcore usage) 
gcore is a gdb command, that internally uses gdb to dump the core.

However with proper configuration of limits (core_dump.size_limit) it
should not be required, althought some issues is possible:
- non standard kernel.core_pattern
- sanitizers

So yes, gcore is more "universal" (you don't need to configure any
`kernel_pattern`), but it is ad-hoc, and it has drawbacks -
**it does not work when gdb fails**. For example gdb may fail with
`Dwarf Error: DW_FORM_strx1 found in non-DWO CU` in case of DWARF-5 [1].

  [1]: https://github.com/ClickHouse/ClickHouse/pull/40772#issuecomment-1236331323.

Let's try to switch to more native way.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-09-04 22:07:16 +02:00
Ilya Golshtein
74561b40ae stylecheck renewed 2022-09-02 17:42:18 +03:00
Alexander Tokmakov
8bdb589c2b Merge branch 'master' into zookeeper_client_fault_injection 2022-08-29 13:34:57 +02:00
alesapin
133ca01447 Merge branch 'master' into stress_s3 2022-08-29 11:25:28 +02:00
Alexey Milovidov
7bd1142f63
Merge pull request #40647 from ClickHouse/high-level-coverage 
Report high-level function and data types test coverage
 2022-08-27 23:13:10 +03:00
Alexey Milovidov
f86242c17e
Merge pull request #40699 from ClickHouse/remove-unbundled 
Remove the remaining parts of "unbundled" build
 2022-08-27 21:54:42 +03:00
Alexey Milovidov
00afbadb53
Merge branch 'master' into high-level-coverage 2022-08-27 19:34:26 +03:00
Azat Khuzhin
ebc61a36e0 tests/stress: improve OOM detection (add separate check by dmesg) 
Right now if you will look at the OOM errors:
- OOM killer (or signal 9) in clickhouse-server.log
- Backward compatibility check: OOM messages in clickhouse-server.log

Most of them are not real, but just clickhouse server got KILLed by
clickhouse stop, #40678 may imporove the situation, but to definitely
sure that there was OOM let's look at dmesg.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-08-27 12:46:58 +02:00
Alexey Milovidov
91ed3ebe9a Remove the remaining parts of "unbundled" build 2022-08-27 02:18:47 +02:00
Alexey Milovidov
2a7d9f0778 Merge branch 'master' into high-level-coverage 2022-08-26 23:44:52 +02:00
Azat Khuzhin
3b519c5d44 tests/stress: capture stacktrace of server hungs if pid was removed already 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-08-26 22:06:32 +03:00
Alexander Tokmakov
263c467d90
Update setup_hdfs_minicluster.sh 2022-08-26 14:09:42 +03:00
Alexander Tokmakov
76e3ab8c59
Update setup_hdfs_minicluster.sh 2022-08-26 13:33:12 +03:00
alesapin
704c4b2c5b Stop thread fuzzer on shutdown 2022-08-26 11:54:54 +02:00
Alexey Milovidov
440d10370a Report high-level function test coverage 2022-08-26 01:59:14 +02:00
alesapin
3ff6489fae Merge branch 'master' into stress_s3 2022-08-25 13:14:58 +02:00
alesapin
ad692f732a Merge branch 'master' into stress_s3 2022-08-25 13:13:30 +02:00
alesapin
35f9815b8e Fix backward comp check 2022-08-24 14:43:02 +02:00
Alexey Milovidov
35ce19ab63
Merge pull request #40354 from azat/tests/stress-dmesg-v3 
tests/stress: use --privileged over --cap-add syslog to obtain dmesg
 2022-08-20 14:13:55 +03:00
Nikita Taranov
9f1ee52b00
Run all queries from changed perf tests (#40322) 
* impl

* fix
 2022-08-19 19:46:07 +02:00
Azat Khuzhin
50bddc43dc tests/stress: ignore NETLINK_ERROR from checkPermissionsImpl 
Since now with --privileged it has CAP_SYS_ADMIN and tries to
communicate via netlink.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-08-19 14:07:06 +02:00
Alexander Tokmakov
3d253ec51b
Merge branch 'master' into zookeeper_client_fault_injection 2022-08-18 21:23:50 +03:00
alesapin
922818bbd9 Merge branch 'stress_s3' of github.com:ClickHouse/ClickHouse into stress_s3 2022-08-18 14:46:50 +02:00
alesapin
932ea146f5 Merge branch 'master' into stress_s3 2022-08-18 13:14:47 +02:00
alesapin
86b1e33eed Disable cache on writes 2022-08-17 19:00:53 +02:00
alesapin
600d22851f Grep dangerous S3 errors 2022-08-17 12:43:11 +02:00
alesapin
0433b801d2 Configure properly 2022-08-17 12:27:15 +02:00
Alexander Tokmakov
ae000e9125
Merge branch 'master' into zookeeper_client_fault_injection 2022-08-17 12:48:54 +03:00
alesapin
1ec6627a70 Fix tables creation 2022-08-16 18:28:17 +02:00
kssenii
52832ea788 May be fix database replicated check 2022-08-16 11:51:57 +02:00
kssenii
eb26b219b9 Merge master 2022-08-16 00:56:27 +02:00
Alexander Tokmakov
589c3408d2
Merge pull request #40234 from ClickHouse/better_message_on_restore_covered 
Better error message when restoring covered parts
 2022-08-15 22:01:48 +03:00
alesapin
243bd492fa Trying to fix it 2022-08-15 20:55:11 +02:00
alesapin
96722a13bb Merge branch 'master' into stress_s3 2022-08-15 20:20:31 +02:00
Alexander Tokmakov
edaff70010 better error message when restoring covered parts 2022-08-15 13:53:14 +02:00
Alexey Milovidov
6b8f4f1d59 Merge branch 'master' into server-side-time 2022-08-12 21:36:40 +02:00
Alexander Tokmakov
46aaf842f8
Merge pull request #40031 from ClickHouse/fix_old_tmp_dirs_cleanup 
Fix old temporary directories cleanup
 2022-08-12 20:31:20 +03:00
Alexander Tokmakov
b3deae3593
Merge branch 'master' into flaky_check_ordinary 2022-08-12 18:11:39 +03:00
Alexey Milovidov
8c3d1f2b5b
Merge branch 'master' into server-side-time 2022-08-12 17:40:02 +03:00
Alexander Tokmakov
467ef7bbc2
Update run.sh 2022-08-12 14:30:18 +03:00
kssenii
768a207176 Merge master 2022-08-11 22:25:53 +02:00
Alexander Tokmakov
06e42a1b23 run tests with Ordinary database in flaky check 2022-08-11 21:32:03 +02:00
Alexander Tokmakov
b9d18182f2 fix 2022-08-11 15:27:26 +02:00
Anton Popov
0ba886f763 enable fuzzing of table definitions 2022-08-11 12:24:15 +00:00
Maksim Kita
627424889d
Merge pull request #39926 from azat/dict-prom-fix 
Remove dictionaries from prometheus metrics on DETACH/DROP
 2022-08-11 13:10:47 +02:00
Anton Popov
e347fa2f45 add fuzzer for table definition 2022-08-11 02:34:10 +00:00
Alexey Milovidov
c323f64804 Fix Fasttest 2022-08-11 03:29:46 +02:00
Alexander Tokmakov
bb46bfa6d9
Update process_functional_tests_result.py 2022-08-10 21:20:52 +03:00
Alexey Milovidov
cbeba683d8
Merge pull request #40017 from ClickHouse/ci-self-extracting-s3-deployment-2 
copy self-extracting to output
 2022-08-10 21:10:23 +03:00
Alexey Milovidov
774ba4db23 Remove old code 2022-08-10 19:44:13 +02:00
Alexey Milovidov
7aff85fc79 Fix test Dockerfile 2022-08-10 19:41:29 +02:00
kssenii
5c3227ba56 Merge master 2022-08-10 12:00:34 +02:00
kssenii
0dda03c94b Fix checks 2022-08-10 00:06:58 +02:00
Alexey Milovidov
f7d995681b
Merge branch 'master' into replace-yandex-to-noto 2022-08-09 22:43:52 +03:00
Yakov Olkhovskiy
09e6b1a497
run clickhouse to decompress 2022-08-09 09:16:03 -04:00
Alexander Tokmakov
3bc583c22b
Revert "copy self-extracting to output" 2022-08-08 20:13:40 +03:00
Alexey Milovidov
0921548a37
Merge pull request #39527 from pkit/pkit/fix_nats_tls 
fix nats-io TLS support
 2022-08-08 08:28:14 +03:00
Alexey Milovidov
0349d9da96 Change font in CI reports just in case (might be worse) 2022-08-08 07:25:29 +02:00
Alexey Milovidov
cb7f072fe8
Merge pull request #39617 from ClickHouse/ci-self-extracting-s3-deployment 
copy self-extracting to output
 2022-08-08 08:19:15 +03:00
kssenii
e81f85a79e Fix checks 2022-08-07 16:44:02 +02:00
Azat Khuzhin
791377e4dc tests: avoid prometheus.port overlap for replicated database 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-08-06 13:00:53 +03:00
Azat Khuzhin
3772415588 tests/stress: add dmesg output (to see OOM details) 
max_server_memory_usage already set to 75%, so OOM should not happens,
the reason is that because RSS does not match with memory tracker
statistics:

    2022.08.05 12:36:57.869896 [ 82524 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 64.69 GiB, peak 65.26 GiB, will set to 62.80 GiB (RSS), difference: -1.89 GiB
    ...
    2022.08.05 12:37:00.213440 [ 82334 ] {} <Error> void DB::MergeTreeBackgroundExecutor<DB::MergeMutateRuntimeQueue>::routine(DB::TaskRuntimeDataPtr) [Queue = DB::MergeMutateRuntimeQueue]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 64.68 GiB (attempt to allocate chunk of 1298794 bytes), maximum: 51.44 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or orvercommit denominator are set to zero.. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-08-06 12:34:38 +03:00
kssenii
9685f9a8b7 Fix checks 2022-08-05 22:16:33 +02:00
Yakov Olkhovskiy
4c78f0fc7d
Merge branch 'master' into ci-self-extracting-s3-deployment 2022-08-05 08:14:48 -04:00
Constantine Peresypkin
10c76917ea fix nats-io TLS support 
nats-io library needs `NATS_HAS_TLS` define to correctly compile-in TLS
support

fixes #39525
 2022-08-05 11:20:05 +02:00
kssenii
7a9b0bc47f Merge master 2022-08-05 01:48:52 +02:00
Anton Popov
4f2c73f9f6 Merge remote-tracking branch 'upstream/master' into HEAD 2022-08-04 23:08:15 +00:00
BoloniniD
48c91619b0
Merge branch 'master' into BLAKE3 2022-08-04 20:30:47 +03:00
Kruglov Pavel
235649cb98
Merge pull request #39458 from Avogar/fix-cancel-insert-into-function 
Fix WriteBuffer finalize when cancel insert into function
 2022-08-04 13:02:08 +02:00
Mikhail f. Shiryaev
8533769132
Use compression and cleanup with the recent version ccache 2022-08-03 14:49:07 +02:00
Mikhail f. Shiryaev
eeaf08525f
Use test-util as source for base-test, fasttest and package builder 2022-08-03 14:49:06 +02:00
BoloniniD
b745842c36
Fix Rust build in fasttest 2022-08-03 10:20:57 +03:00
BoloniniD
b161773f71 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-08-02 20:25:25 +03:00
kssenii
d462782d1a Fix checks 2022-08-02 14:27:45 +02:00
Alexander Tokmakov
e5c47cb26f
Update run.sh 2022-08-02 12:10:53 +03:00
Alexander Tokmakov
ecf7ce1f74 Merge branch 'master' into zookeeper_client_fault_injection 2022-08-01 20:49:01 +02:00
kssenii
2850f68ac9 Fix checks 2022-08-01 20:48:05 +02:00
Alexander Tokmakov
3cc20f05ba
Update run.sh 2022-08-01 20:47:14 +03:00
kssenii
e5f4a619ed Merge master 2022-07-31 20:24:40 +03:00
Alexey Milovidov
36e6500e54
Merge branch 'master' into BLAKE3 2022-07-30 23:14:05 +03:00
Yakov Olkhovskiy
f5442cba86 clickhouse may be compressed - run once to decompress 2022-07-29 15:06:15 -04:00
Yakov Olkhovskiy
72be640cfb clickhouse may be compressed - run once to decompress 2022-07-29 15:04:50 -04:00
avogar
573d9c1b57 Fix stress test 2022-07-29 18:30:40 +00:00
Mikhail f. Shiryaev
672e67aa8e
Change mysql-odbc url 2022-07-29 11:52:20 +02:00
Mikhail f. Shiryaev
061e61919a
Merge pull request #39450 from ClickHouse/tsal-clang-13 
Build thread sanitizer binaries with clang-13
 2022-07-26 15:13:17 +02:00
Mikhail f. Shiryaev
3e0db34ed9
Merge pull request #39390 from ClickHouse/paint-it-black 
Automatic fixes for black formatting for domestic repo PRs
 2022-07-22 17:19:00 +02:00
Mikhail f. Shiryaev
c6b251d0cb
Revert "Merge pull request #38106 from ClickHouse/tsan_less_flaky_tests" 
This reverts commit 0ae0cc54aa, reversing
changes made to 1d7cf28cab.
 2022-07-22 12:14:23 +02:00
jasperzhu
614f3b14a2
Merge branch 'master' into dev_intel_iaa_deflate 2022-07-22 11:05:44 +08:00
Mikhail f. Shiryaev
7d2cf648df
Make a docker image for style check lighter 2022-07-21 16:59:49 +02:00
Mikhail f. Shiryaev
dacfc7886c
Improve style_check scripts style a little bit 2022-07-21 16:59:44 +02:00
Alexander Tokmakov
9e9969cea7
Merge pull request #37827 from arthurpassos/host_regexp_multiple_domains 
Test host_regexp against all PTR records instead of only one
 2022-07-21 16:43:05 +03:00
Arthur Passos
828de2a674 Add host regexp multiple PTR records integration tests 2022-07-20 14:09:38 -03:00
Dmitry Novik
a09422de7b
Merge pull request #38642 from ClickHouse/group-by-use-nulls 
Add group_by_use_nulls setting
 2022-07-20 14:42:42 +02:00
Alexander Tokmakov
840ace663b
Update run.sh 2022-07-20 13:19:53 +03:00
Dmitry Novik
50989bdb68
Merge branch 'master' into group-by-use-nulls 2022-07-19 14:58:01 +02:00
kssenii
df17df67c2 Fix checks 2022-07-19 10:45:54 +02:00
jasperzhu
c044c67745
Merge branch 'master' into dev_intel_iaa_deflate 2022-07-19 15:32:57 +08:00
kssenii
274457e5cf Allow cache over azure blob storage, add tests 2022-07-18 16:15:04 +02:00
kssenii
8ad26b3111 Merge master 2022-07-16 22:50:03 +02:00
Alexander Tokmakov
b770f9903d
Update run.sh 2022-07-15 20:03:00 +03:00
Alexander Tokmakov
5c24cd979b
Merge pull request #39256 from ClickHouse/bc_check_fix_stacks_in_gdb 
Fix stacktraces in gdb in BC check
 2022-07-15 17:54:18 +03:00
Anton Popov
da97a22465
Merge pull request #39243 from CurtizJ/send-logs-level-colors 
Do not color logs on client if they are redirected to file
 2022-07-15 13:33:13 +02:00
Alexander Tokmakov
77487e996c fix stacktraces in gdb in bc check 2022-07-15 12:23:28 +02:00
Anton Popov
efed134758 fix test 2022-07-14 21:48:34 +00:00
kssenii
15a2d60f23 Fix checks 2022-07-14 22:04:39 +02:00
Alexander Tokmakov
f8e23c1deb
Update run.sh 2022-07-14 17:29:08 +03:00
Anton Popov
97425bb167 turn on merge tree settings randomization 2022-07-13 21:07:12 +00:00
Alexander Tokmakov
991493e6fc
Update run.sh 2022-07-13 15:22:36 +03:00
Dmitry Novik
5f65b45269
Merge branch 'master' into group-by-use-nulls 2022-07-12 22:36:04 +02:00
Kseniia Sumarokova
f69ec635d0
Merge pull request #39110 from ClickHouse/kssenii-patch-4 
Fix meilisearch tests
 2022-07-12 18:32:49 +02:00
Kseniia Sumarokova
f629fd7e57
Update docker_compose_meili.yml 2022-07-12 15:50:35 +02:00
Alexander Tokmakov
948f15eff3
Update run.sh 2022-07-12 14:01:53 +03:00
Kseniia Sumarokova
bcd9453f33
Set meilieserach client version too 2022-07-12 12:15:20 +02:00
Kseniia Sumarokova
aebb73a24d
Update docker_compose_meili.yml 2022-07-11 21:41:15 +02:00
Arthur Passos
7b626da080 remove cpp-dns and udns from fasttest 2022-07-11 12:43:56 -03:00
Vladimir C
ca2e27aaa2
Merge pull request #37841 from vdimir/perf-save-to-stat 
Send perf tests results to ci database
 2022-07-11 13:07:40 +02:00
jinjunzh
7cb5b35bef remove qpl from fasttest 2022-07-09 13:54:23 -04:00
Vladimir C
bfba67cf88
Update docker/test/performance-comparison/compare.sh 2022-07-08 17:13:20 +02:00
Alexander Tokmakov
2b886ddc2e
Update run.sh 2022-07-08 16:47:54 +03:00
Vladimir C
9555d72dfc
Remove head ci-checks.tsv 2022-07-08 15:26:07 +02:00
Alexander Tokmakov
57b8a6a542
Update run.sh 2022-07-08 13:53:35 +03:00
Dmitry Novik
0b18b4ed43 Use group_by_use_nulls in tests more often 2022-07-07 18:58:46 +00:00
Dmitry Novik
d1df66687b
Merge branch 'master' into group-by-use-nulls 2022-07-07 20:54:38 +02:00
Vladimir C
db838f1343
Merge pull request #35796 from vdimir/full-sorting-merge-join 2022-07-07 19:16:49 +02:00
Kruglov Pavel
8ffd6cd22c
Merge pull request #38717 from Avogar/improve-bc-check 
Try to improve backward compatibility check
 2022-07-07 18:52:34 +02:00
vdimir
b0c0ec370d
Add join_algorithm='full_sorting_merge' to stress tests 2022-07-06 14:27:34 +00:00
Kruglov Pavel
a3a94a1c09
Avoid false positive red sanitizer asserts check in stress test 2022-07-06 14:32:17 +02:00
mergify[bot]
e746760e41
Merge branch 'master' into improve-bc-check 2022-07-06 11:53:43 +00:00
jinjunzh
ba38969e9c enable qpl for clickhouse-keeper build 2022-07-05 15:28:41 -04:00
vdimir
f701b58dd0
Update check_name in performance comparsion upload 2022-07-05 14:24:58 +02:00
vdimir
e4917914ae
Revert "show grants in compare.sh" 
This reverts commit 4d3a64b318aa665bf1494cca6ae94e58dc8d361e.
 2022-07-05 14:00:27 +02:00
vdimir
3731bd44c1
Revert "[testing] run only one perftest" 
This reverts commit 3b079827b78e04ac20043346998ce9d546969746.
 2022-07-05 14:00:26 +02:00
vdimir
051dd63a62
Fix types in ci-checks.tsv in compare.sh 2022-07-05 14:00:26 +02:00
vdimir
c1d44fee9f
upd compare.sh 2022-07-05 14:00:26 +02:00
vdimir
b1ee16ef77
show grants in compare.sh 2022-07-05 14:00:26 +02:00
vdimir
18dc718e4e
do not create tables for perf tests 2022-07-05 14:00:25 +02:00
vdimir
f8fa10578c
Use default database for perf tests 2022-07-05 14:00:25 +02:00
vdimir
7352c26e89
create tables for perf tests 2022-07-05 14:00:25 +02:00
vdimir
45b2b1ca8a
[wip] persist pertest results 2022-07-05 14:00:24 +02:00
vdimir
c2d774d598
[testing] run only one perftest 2022-07-05 14:00:24 +02:00
vdimir
aac2f8aefc
Rename envs for performance comparsion 2022-07-05 14:00:24 +02:00
Kseniia Sumarokova
6c3d648f49
Merge branch 'master' into nats-integration 2022-07-04 21:06:07 +02:00
Kruglov Pavel
45ac74617b
Fix 2022-07-04 20:38:21 +02:00
Dmitry Novik
614ce26ee7 Add group_be_use_nulls setting to stress tests 2022-07-04 18:09:48 +00:00
Kruglov Pavel
65dd81586b
Update run.sh 2022-07-04 17:30:22 +02:00
Arthur Passos
6c987fb28e Minor adjustments 2022-07-04 10:13:50 -03:00
Arthur Passos
52c5d7e0f9 Add cpp-dns and udns to docker/test/fasttest 2022-07-04 10:06:26 -03:00
avogar
17da24b584 Try to improve backward compatibility check 2022-07-04 13:02:22 +00:00
Azat Khuzhin
8e9c1eaa73 tests/stress: redirect gdb output on stop hang to gdb.log 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-07-03 14:46:17 +03:00
Alexander Tokmakov
b238ed4093 fix stress tests 2022-07-01 17:19:00 +02:00
Alexander Tokmakov
4dde5a6165
Merge pull request #38568 from ClickHouse/tavplubix-patch-1 
Allow Ordinary database in Stress Tests
 2022-06-30 16:23:08 +03:00
Alexander Tokmakov
4bf1443dae
Update download.sh 2022-06-30 01:00:08 +03:00
Alexander Tokmakov
cd2cb10f60
another try to fix performance tests 2022-06-29 20:55:46 +03:00
Alexander Tokmakov
baeb1811e1
try to fix performance tests 2022-06-29 16:59:16 +03:00
Alexander Tokmakov
3ff26939fc
Update run.sh 2022-06-29 15:46:40 +03:00
mergify[bot]
3f266954f0
Merge branch 'master' into deprecate_ordinary_database 2022-06-28 18:13:36 +00:00
Alexander Tokmakov
0bb036dd21
Update Dockerfile 2022-06-28 20:35:20 +03:00
mergify[bot]
4a1fefb42d
Merge branch 'master' into deprecate_ordinary_database 2022-06-28 15:49:52 +00:00
Alexander Tokmakov
66cf6da35c
Merge pull request #38518 from ClickHouse/tavplubix-patch-1 
Fix `_csv.Error: field larger than field limit`
 2022-06-28 18:46:43 +03:00
Alexander Tokmakov
e23f1fa774
Merge pull request #38269 from excitoon-favorites/integrationtestsfixes 
Don't try to kill empty list of containers in `integration/runner` II
 2022-06-28 17:35:48 +03:00
BoloniniD
6ddcec0906
Merge branch 'master' into BLAKE3 2022-06-28 16:53:06 +03:00
Alexander Tokmakov
428628238f Merge branch 'master' into deprecate_ordinary_database 2022-06-28 15:40:33 +02:00
Kruglov Pavel
25100ad5e5
Merge pull request #38520 from ClickHouse/Avogar-patch-1 
Fix application errors grep in stress test
 2022-06-28 14:26:22 +02:00
Alexander Tokmakov
411512ed6f
Update run.sh 2022-06-28 14:28:06 +03:00
Kruglov Pavel
f7419e0703
Fix application errors grep in stress test 2022-06-28 13:12:21 +02:00
Alexander Tokmakov
456e03758b
Update process_functional_tests_result.py 2022-06-28 13:52:39 +03:00
Vladimir Chebotarev
89dc2844db Fix for integration tests fix. 2022-06-27 23:13:40 +03:00
Alexander Tokmakov
7c37079a96 Merge branch 'master' into deprecate_ordinary_database 2022-06-27 14:46:59 +02:00
Vladimir Chebotarev
2b19e69930 Don't try to kill empty list of containers in integration/runner. 2022-06-27 06:12:10 +03:00
jasperzhu
b2f98fa73b
Merge branch 'master' into dev_intel_iaa_deflate 2022-06-27 10:21:21 +08:00
Mikhail f. Shiryaev
848ae7b130
Update docker-compose to try get rid of v1 errors 2022-06-24 16:49:48 +02:00
Alexander Tokmakov
cfe0e434e5
Revert "Add support for io_uring read method" 2022-06-24 12:19:41 +03:00
Alexey Milovidov
812ab9bd6b
Merge pull request #36103 from sauliusvl/uring 
Add support for io_uring read method
 2022-06-24 00:34:29 +03:00
Alexander Tokmakov
dbf2763788 automatically convert system database to Atomic 2022-06-23 21:38:43 +02:00
Alexander Tokmakov
2c5a88faba deprecate Ordinary database 2022-06-23 10:20:14 +02:00
Alexander Tokmakov
1595ff5620
Merge pull request #38260 from bigo-sg/hive_test 
Improve the stability for hive storage integration test
 2022-06-22 21:08:23 +03:00
lgbo-ustc
eddb6443f2 rollback dockerd-entrypoint.sh 2022-06-21 16:25:24 +08:00
lgbo-ustc
cdd7a54995 improve stability for hive intergration test 2022-06-21 15:59:54 +08:00
lgbo-ustc
633c3c8287 update hive test 2022-06-21 15:10:48 +08:00
Saulius Valatka
6bbabf59d9 simplify build, add read method randomized tests, fix typos 2022-06-21 09:59:46 +03:00
Alexander Tokmakov
b5a977ad54
Merge pull request #38213 from azat/stress-thread-fuzzer-v2 
tests/stress: fix TSan detection
 2022-06-20 16:46:31 +03:00
Azat Khuzhin
dce71bbe06 tests/stress: fix TSan detection 
+ test -f package_folder/clickhouse-client_22.7.1.1+tsan_all.deb package_folder/clickhouse-common-static-dbg_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-common-static_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-keeper_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-server_22.7.1.1+tsan_all.deb
    /run.sh: line 13: test: too many arguments

Follow-up for: #38207 (cc @tavplubix)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-06-20 08:10:03 +03:00
Azat Khuzhin
e307a728ca tests: add no-stress tag 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-06-20 07:48:10 +03:00
Azat Khuzhin
e79c24deda docker/test/stress/stress: apply black 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-06-20 07:48:10 +03:00
Azat Khuzhin
d154288fc6 tests/stress: fix TSan detection (enables thread fuzzer for non-TSan builds) 
Follow-up for: #38106 (cc @tavplubix @alesapin)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-06-19 19:27:25 +03:00
alesapin
0ae0cc54aa
Merge pull request #38106 from ClickHouse/tsan_less_flaky_tests 
Some fixes for tests with tsan
 2022-06-18 14:22:43 +02:00
Alexander Tokmakov
5ba304476d
Merge pull request #37560 from azat/tests-scripts-proper-wait 
Proper wait of the clickhouse-server in tests
 2022-06-17 18:23:30 +03:00
Alexander Tokmakov
3e8aa2dc47
Update run.sh 2022-06-16 13:24:21 +03:00
jasperzhu
bca18b2caf
Merge branch 'master' into dev_intel_iaa_deflate 2022-06-16 08:56:27 +08:00
Alexander Tokmakov
9cac78b498 make tests with tsan less flaky 2022-06-15 19:54:46 +02:00
Azat Khuzhin
23494e9957 tests: avoid "_csv.Error: field larger than field limit (131072)" error 
v2: apply black
v3: ignore only hung check report
v4: ignore everything after "Database: "
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-06-14 18:16:59 +03:00
Azat Khuzhin
4ae0dccf00 docker/test/util/process_functional_tests_result.py: fix typo 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-06-14 18:16:31 +03:00
Mikhail f. Shiryaev
3ba7d1b2e2
Trying get rid of llvm in stateful tests image 2022-06-10 18:12:24 +02:00
Mikhail f. Shiryaev
92fb62aed5
Pin minio client version too 2022-06-10 18:11:45 +02:00
Mikhail f. Shiryaev
4d45839f17
Generalize setup_minio.sh 
- Cleanup apt garbage in the container
- Download the same binary in docker and setup_minio.sh
- Use binary and not rpm for minio
- Sort packages in Dockerfile's
 2022-06-10 15:04:45 +02:00
Mikhail f. Shiryaev
62f60c1462
Merge branch 'master' into doc-aspell 2022-06-09 11:01:25 +02:00
Mikhail f. Shiryaev
145c916e65
Update pylint 2022-06-08 15:15:13 +02:00
vdimir
27ebad89c5
Add doc_spell_output.txt to process_style_check_result.py 2022-06-08 14:28:44 +02:00
vdimir
abce81058e
Add doc aspell 2022-06-08 14:25:56 +02:00
Kruglov Pavel
83418ebba2
Merge pull request #37712 from vdimir/duplicate_download_previous_release 
Get rid of duplicate download_previous_release
 2022-06-07 12:51:34 +02:00
BoloniniD
b05ee41d25 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-06-06 16:03:10 +03:00
jinjunzh
c7ca746994 fixed build issues in clickhouse-keeper 2022-06-05 14:46:28 -04:00
Alexander Tokmakov
1ab5dcae38 fix for aarch64 2022-06-03 23:49:06 +02:00
Alexander Tokmakov
c21783273f fix 2022-06-03 21:58:58 +02:00
Alexander Tokmakov
66f8c69c15 fix 2022-06-03 21:53:44 +02:00
Alexander Tokmakov
5916633344 hotfix for minio in functional tests 2022-06-03 20:47:26 +02:00
Nikita Mikhaylov
fe477355df
Added support for schema inference for hdfsCluster [2] (#35812) 2022-06-03 15:54:29 +02:00
Kruglov Pavel
ed3bc4328e
Merge pull request #37788 from ClickHouse/Avogar-patch-5 
Ignore PART_IS_TEMPORARILY_LOCKED error in BC check
 2022-06-03 13:09:04 +02:00
Alexey Milovidov
1529d47207
Merge pull request #34754 from ClickHouse/llvm-14 
Switch to clang/llvm 14
 2022-06-03 14:07:34 +03:00
Ilya Yatsishin
a57432659a Merge remote-tracking branch 'origin/master' into aarch64-perf 2022-06-02 14:31:55 +02:00
Ilya Yatsishin
64befe9753 Filter out incompatible performance test 2022-06-02 14:29:24 +02:00
Kruglov Pavel
196863ade5
Ignore PART_IS_TEMPORARILY_LOCKED error in BC check 2022-06-02 13:33:27 +02:00
Alexey Milovidov
b5f48a7d3f Merge branch 'master' of github.com:ClickHouse/ClickHouse into llvm-14 2022-06-01 22:09:58 +02:00
Vladimir C
2622791b9e
upd 2022-06-01 16:17:17 +02:00
mergify[bot]
3866c27850
Merge branch 'master' into stress_s3 2022-06-01 12:02:33 +00:00
BoloniniD
dd8aefdf1e Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-06-01 11:46:55 +03:00
jinjunzh
1d3ae2d88c fixed unable to find library -ldl in docker build 2022-05-31 17:14:08 -04:00
vdimir
4d336d0228
Get rid of duplicate download_previous_release 2022-05-31 17:50:29 +00:00
jinjunzh
822cef10b3 add nasm into more docker configuration 2022-05-30 21:16:06 -04:00
jasperzhu
fc03af2259
Merge branch 'master' into dev_intel_iaa_deflate 2022-05-30 17:49:04 +08:00
jinjunzh
4857d6e2c3 add nasm into docker configuration 2022-05-30 17:45:26 -04:00
mergify[bot]
df9f7c59a2
Merge branch 'master' into try_fix_tests 2022-05-29 15:04:48 +00:00
Alexey Milovidov
c1169019d2 Merge branch 'master' into llvm-14 2022-05-29 02:29:02 +02:00
Alexey Milovidov
e500ec5fd8
Update run-fuzzer.sh 2022-05-28 21:25:20 +03:00
Alexander Tokmakov
1ae919a18a Revert "Merge pull request #35865 from azat/clickhouse-test-left-queries" 
This reverts commit 18d094d79d, reversing
changes made to 224f4dc620.
 2022-05-28 19:23:58 +02:00
Alexey Milovidov
f7a5b1fdaf Remove margin in test reports and change the font 2022-05-28 03:24:56 +02:00
Azat Khuzhin
827e73a2f4 tests/fasttest: simplify waiting of the server 
Note, thiat removes "ability to run fasttest locally", but other jobs
cannot do this.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-05-27 07:19:15 +03:00
Azat Khuzhin
2570136e5e tests/sqlancer: remove superior wait of the server stop 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-05-27 07:19:15 +03:00
Azat Khuzhin
d90f21a569 tests/stateful: properly wait the server 
v2: fix permissions for /var/run/clickhouse-server?
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-05-27 07:18:51 +03:00
Azat Khuzhin
478b03c5cb tests/fuzzer: use "clickhouse stop" to stop the server 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-05-27 07:18:51 +03:00
Azat Khuzhin
28e0bb78db tests/stateless: properly wait for server 
If 10 seconds will not be enough to finish the server, then
clickhouse-local (that goes after) cannot obtain the logs due to status
file will be locked, like in [1]:

    Code: 76. DB::Exception: Cannot lock file /var/lib/clickhouse/status. Another server instance in same directory is already running. (CANNOT_OPEN_FILE)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/35075/4a064e5b6f81136f2bf923d85001f25fa05d39ce/stateless_tests_flaky_check__address__actions_.html

So use proper wait via "clickhouse stop"

v2: Fix permissions pid file for replicated database servers
    They do not use default, /var/run/clickhouse-server, that do not have
    proper permissions.

Fixes: #36885
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-05-27 07:18:51 +03:00
Kseniia Sumarokova
02d162c25d
Merge branch 'master' into nats-integration 2022-05-25 10:04:39 +02:00
Alexey Milovidov
a5541dc2d5 Merge branch 'master' into llvm-14 2022-05-25 01:56:24 +02:00
Alexander Gololobov
2ff747785e
Merge pull request #37394 from ClickHouse/array_norm_dist_fixes 
Do computations on the raw input data without copying to Eigen::Matrix
 2022-05-24 20:59:04 +02:00
tchepavel
43226a57fc
Merge branch 'master' into nats-integration 2022-05-24 18:15:11 +03:00
Alexander Gololobov
7d0ed7e51a Remove eigen library 2022-05-24 10:24:50 +02:00
tchepavel
d9436ec7dd
Merge branch 'master' into nats-integration 2022-05-23 14:30:09 +03:00
vdimir
6d2fab49f4
Add join_algorithm='parallel_hash' to stress test 2022-05-23 10:18:22 +02:00
Alexey Milovidov
dce7a86ca9 Merge branch 'master' into llvm-14 2022-05-22 22:38:07 +02:00
Michael Nutt
23dbf1b257 Merge branch 'master' into hashid 2022-05-20 08:42:01 -04:00
Michael Nutt
e0c14dfc01 fix includes 2022-05-18 20:16:43 -04:00
Mikhail f. Shiryaev
79c30f5e58
Do not fail if output and workspace are the same 2022-05-18 01:38:46 +02:00
Mikhail f. Shiryaev
1f67665c95
Build performance output in release builds 2022-05-18 01:38:44 +02:00
tchepavel
2692d88a42
Merge branch 'master' into nats-integration 2022-05-17 16:59:57 +03:00
tchepavel
a3af94d49e Documentation; integration tests; subscribe on startup 2022-05-17 16:58:09 +03:00
Kseniia Sumarokova
94683786dc
Merge branch 'master' into MeiliSearch 2022-05-16 22:42:09 +02:00
tchepavel
35cbe48ca3 Fixing; preparing test 2022-05-16 13:03:28 +03:00
Nikolai Kochetov
f1bc2bc615 Merge branch 'master' into llvm-14 2022-05-16 12:03:26 +02:00
tchepavel
7317c76d3c
Merge branch 'master' into nats-integration 2022-05-15 14:41:22 +03:00
jasperzhu
5e607e6cf5
Merge branch 'master' into dev_intel_iaa_deflate 2022-05-15 10:59:07 +08:00
tchepavel
cc94378698 Add nats-io cmake; finally fix publishing 2022-05-12 19:11:32 +03:00
Mikhail Artemenko
12717f2417 fix <Breaking changes> in Meilisearch v0.27.0 2022-05-12 16:51:00 +03:00
jasperzhu
c74732ae79
Merge branch 'master' into dev_intel_iaa_deflate 2022-05-12 21:28:13 +08:00
Alexander Tokmakov
425b31ba1b
Update stress 2022-05-12 15:04:12 +03:00
Alexander Tokmakov
c23bc01196 Merge branch 'master' into zookeeper_client_fault_injection 2022-05-11 17:20:42 +02:00
Alexander Gololobov
b34a55c9e9
Merge branch 'master' into array-distance-functions 2022-05-11 16:55:02 +02:00
Yakov Olkhovskiy
6d3a54a044
Merge pull request #36467 from olevino/wyhash 
Wyhash
 2022-05-11 09:57:09 -04:00
qieqieplus
6903b3d33c fix ci fast test 2022-05-11 17:16:23 +08:00
Mikhail f. Shiryaev
3fa955aec1
Merge pull request #37057 from ClickHouse/changelog 
Changelog script
 2022-05-11 10:54:29 +02:00
mergify[bot]
0e2a86dcee
Merge branch 'master' into MeiliSearch 2022-05-11 08:49:19 +00:00
Mikhail f. Shiryaev
d5b1e39bb9
Merge pull request #36866 from ClickHouse/integration-tests 
Fix using proper image for integration tests; improve logging; fix docker volume cleaning in integration-tests-runner.
 2022-05-11 10:46:51 +02:00
alesapin
3cc8e2af51
Merge pull request #37079 from ClickHouse/disable_thread_fuzzer 
Disable thread fuzzer after server restart
 2022-05-10 23:24:34 +02:00
Mikhail f. Shiryaev
3802944cc0
Merge pull request #36863 from ClickHouse/tests-result-for-not-finished 
Replace `Timeout` with `Tests not finished`
 2022-05-10 19:23:34 +02:00
Mikhail f. Shiryaev
e31ac2e717
Fix cleaning up integration-runner docker volume 2022-05-10 17:41:49 +02:00
alesapin
af99183950 Disable thread fuzzer after server restart 2022-05-10 15:16:21 +02:00
mergify[bot]
5c742cf2d5
Merge branch 'master' into stress_s3 2022-05-10 12:26:26 +00:00
Alexander Tokmakov
9346c9363a
Merge pull request #37052 from ClickHouse/fix_server_termination_stress_tests 
Print stacks if we cannot terminate server in stress tests
 2022-05-10 13:12:44 +03:00
Alexander Tokmakov
17c954bea7 fix shellcheck 2022-05-10 11:48:55 +02:00
Mikhail f. Shiryaev
d78709c656
Add dependencies and CI for changelogs generator 2022-05-10 11:25:38 +02:00
Alexander Tokmakov
92d423c478 print stacks if wa cannot terminate server in stress tests 2022-05-09 19:43:51 +02:00
Alexander Tokmakov
b647f8f9bf
Update run.sh 2022-05-09 17:48:10 +03:00
Alexey Milovidov
419687ac50
Update run.sh 2022-05-09 10:17:49 +02:00
Mikhail f. Shiryaev
b14dca2fac
Improve stress tests report a little bit 2022-05-09 10:17:40 +02:00
jinjunzh
fd5085c290 Merge branch 'dev_intel_iaa_deflate' of https://github.com/jinjunzh/ClickHouse into dev_intel_iaa_deflate 2022-05-05 12:00:30 -04:00
jinjunzh
c4bce5234e add nasm source into contrib for nasm compiler 2022-05-05 11:56:11 -04:00
Mikhail f. Shiryaev
37533eb14b
Improve comment FIXME for errors report 2022-05-04 16:56:43 +02:00
Mikhail f. Shiryaev
2b67208dea
Ignore slow query as errors in performance tests report 2022-05-04 13:02:48 +02:00
Alexander Tokmakov
c3f177f0ac
Merge pull request #36885 from ClickHouse/fix_system_logs_saving 
Save system logs in functionsl tests if server crashed
 2022-05-04 01:12:41 +03:00
Alexander Tokmakov
7a9c9da0bd
Update run.sh 2022-05-04 01:10:40 +03:00
Alexander Tokmakov
193a50a688
Update run.sh 2022-05-03 23:17:03 +03:00
Alexander Tokmakov
3baf72f1d4 save system logs in func tests if server crashed 2022-05-03 20:10:07 +02:00
Mikhail f. Shiryaev
6197934e14
Replace Timeout with Tests not finished 2022-05-03 10:45:29 +02:00
jasperzhu
7f47e9b934
Merge branch 'master' into dev_intel_iaa_deflate 2022-05-03 15:47:57 +08:00
Alexey Milovidov
88826e2da5 Remove "preconditions" from performance tests (overengineering, unneeded feature) 2022-05-02 02:33:22 +02:00
alesapin
85dda249b8 Don't download stateful table 2022-05-02 00:11:05 +02:00
Mikhail Artemenko
6830b74925 fix ref after merge & change runner dockerfile 2022-05-01 23:57:44 +03:00
alesapin
51345fa25b Trying stress on top of S3 2022-05-01 19:07:02 +02:00
Mikhail Artemenko
41f657d8ed
Merge branch 'master' into MeiliSearch 2022-05-01 10:01:56 +03:00
jinjunzh
34934b80a9 update qpl deflate supporting test script and docs 2022-04-29 11:40:08 -04:00
Alexey Milovidov
1dc56e39fc black . 2022-04-29 04:39:21 +02:00
Alexey Milovidov
2a3a2184ec Refinement 2022-04-29 04:37:57 +02:00
Alexey Milovidov
2d7d67e7bc Remove special handling of "short" queries - the logic is too ad-hoc, it pollutes the code and is difficult to handle 2022-04-29 04:27:57 +02:00
Mikhail f. Shiryaev
a2dc780174
Make backward compatible integration tests runner 2022-04-25 21:16:02 +02:00
Mikhail f. Shiryaev
f53040b95e
Merge pull request #36559 from ClickHouse/performance-rebalance 
Use just index to split performance tests by group
 2022-04-25 14:15:23 +02:00
Alexey Milovidov
bdf86f3b7a
Merge pull request #36554 from ClickHouse/snyk-fixes 
Snyk fixes
 2022-04-23 22:51:56 +03:00
Mikhail f. Shiryaev
04a8955427
fixup! Update golang-mysql integration image 2022-04-23 15:24:42 +02:00
Mikhail f. Shiryaev
e434d78e68
fixup! Update golang-mysql integration image 2022-04-22 23:02:22 +02:00
alesapin
7380a71333
Merge pull request #31833 from ClickHouse/musl-check 
Build clickhouse-keeper with Musl
 2022-04-22 22:41:16 +02:00
Mikhail f. Shiryaev
74a755d170
Use just index to split tests by group 2022-04-22 20:34:34 +02:00
Mikhail f. Shiryaev
11694459f3
Update mysql_php_client php version 2022-04-22 18:22:14 +02:00
Mikhail f. Shiryaev
d4e8c6fb44
Update golang-mysql integration image 2022-04-22 18:22:12 +02:00
BoloniniD
a26acd3660 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-04-22 18:12:54 +03:00
alesapin
18d094d79d
Merge pull request #35865 from azat/clickhouse-test-left-queries 
clickhouse-test: fix left-queries-check, to fix test log parser
 2022-04-22 15:59:38 +02:00
Mikhail f. Shiryaev
382c717d09
Speed-up fetching submodules 2022-04-21 20:08:55 +02:00
olevino999
a32aa93b50 wyhash 2022-04-21 19:36:47 +03:00
BoloniniD
a353210e94 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-04-21 18:44:42 +03:00
tavplubix
06de1adebc
Merge pull request #36450 from ClickHouse/Avogar-patch-4 
Fix stress test
 2022-04-20 21:42:24 +03:00
tavplubix
2d34d46b28
Update entrypoint.sh 2022-04-20 21:38:49 +03:00
Azat Khuzhin
08e74b98f5 tests: do not check queries after tests for replicated database 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-20 21:34:31 +03:00
Kruglov Pavel
4e2b1cd981
Update run.sh 2022-04-20 16:48:54 +02:00
Kruglov Pavel
cd77f927b6
Fix putting logs into test_output 2022-04-20 15:06:09 +02:00
Kruglov Pavel
6bcdf21801
Fix stress test 2022-04-20 13:53:16 +02:00
alesapin
ba81816dc1 Better cmake 2022-04-20 12:11:55 +02:00
Azat Khuzhin
8d87e48cb4 Simplify perf scripts by using schema inference 2022-04-17 09:01:15 +03:00
Alexey Milovidov
b5c64244c9 Merge branch 'llvm-14' of github.com:ClickHouse/ClickHouse into llvm-14 2022-04-16 01:15:27 +02:00
Alexey Milovidov
73b52859df Merge branch 'master' into llvm-14 2022-04-16 00:46:58 +02:00
tavplubix
5f31185125
Update stress 2022-04-14 14:35:46 +03:00
Mikhail f. Shiryaev
51685e0956
Dirty fix fasttest after addressing CVE-2022-24765 2022-04-13 13:36:28 +02:00
Mikhail Artemenko
2fd86cc564
Merge branch 'master' into MeiliSearch 2022-04-13 12:05:46 +03:00
BoloniniD
30712ead45
Merge branch 'master' into BLAKE3 2022-04-13 00:45:44 +03:00
Kruglov Pavel
5b46e9655a
Merge pull request #36067 from ClickHouse/Avogar-patch-4 
Try to turn off always green backward compatibility checks
 2022-04-12 16:20:07 +02:00
tavplubix
ccb45ae943
Update stress 2022-04-12 12:42:45 +03:00
tavplubix
48f9b61bdb
Update stress 2022-04-12 12:22:03 +03:00
tavplubix
f7c17a8e86
Update stress 2022-04-11 18:03:19 +03:00
mergify[bot]
df81e8d60c
Merge branch 'master' into Avogar-patch-4 2022-04-11 14:37:28 +00:00
Mikhail f. Shiryaev
08e518a821
Merge branch 'master' into llvm-14 2022-04-08 13:57:44 +02:00
Kruglov Pavel
eaad99bd48
Try to turn off always green backward compatibility checks 2022-04-08 13:55:10 +02:00
Mikhail f. Shiryaev
20aee231bd
Improve codebrowser image, use a temporary branch as source 2022-04-08 13:44:25 +02:00
Alexander Tokmakov
49c35f3261 Merge branch 'master' into mvcc_prototype 2022-04-08 13:34:40 +02:00
tavplubix
6868223af0
Merge pull request #36026 from ClickHouse/tavplubix-patch-2 
Fix Backward comapatibility check
 2022-04-08 13:10:59 +03:00
alesapin
8ec802bc62
Merge pull request #35475 from kssenii/remote-fs-cache-improvements 
Allow to write remote fs cache on all write operations. Add `system.remote_filesystem_cache` table. Add `drop remote filesystem cache (<path>)` query. Add `system.remote_data_paths` table.
 2022-04-08 12:06:26 +02:00
Alexander Tokmakov
6a46da93ae Merge branch 'master' into mvcc_prototype 2022-04-07 23:22:19 +02:00
Kruglov Pavel
9fa6e6e7df
Make backward compatibility check always green 2022-04-07 17:42:33 +02:00
Mikhail f. Shiryaev
5b69caf383
Update codebrowser clang to 14 2022-04-07 15:18:26 +02:00
Alexander Tokmakov
7f54e7b422 Merge branch 'master' into mvcc_prototype 2022-04-07 15:14:06 +02:00
Alexander Tokmakov
8290ffa88d Merge branch 'master' into mvcc_prototype 2022-04-07 13:50:42 +02:00
tavplubix
b32800420c
Update stress 2022-04-07 13:30:11 +03:00
Mikhail Artemenko
151eeb1a27
Merge branch 'master' into MeiliSearch 2022-04-06 17:07:55 +03:00
Azat Khuzhin
2fb6d6acb4 stress: use more meaningful names for clickhouse-server.log 
But note, that stderr.log/stdout.log/clickhouse-server.err.log still not separated.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-06 14:09:53 +03:00
Azat Khuzhin
058cde820f test/stress: improve error checks for backward compatiblity check 
Before the log was analyzed only after the server had been restarted
after stressing, and hence it cannot find anything in case of error,
like here [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/34355/acd48ebe2d51d20d0c2a5bc545d46d27f9bf7904/stress_test__thread__actions_.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-06 14:09:52 +03:00
Kruglov Pavel
ab5c912ad4
Merge pull request #35613 from ClickHouse/Avogar-patch-3 
Check all logs for crashes, logical errors, etc in backward compatibility check
 2022-04-06 12:58:37 +02:00
Kseniia Sumarokova
0e1637dfaf
Merge pull request #35354 from kssenii/enable-testmode-by-default 
Remove testmode option, enable it unconditionally
 2022-04-06 10:06:08 +02:00
kssenii
d59d4eda4f Fix tests 2022-04-06 01:58:16 +02:00
Mikhail f. Shiryaev
4d7618585b
Fix WORKDIR issue after upgrading npm 2022-04-05 00:10:33 +02:00
snyk-bot
e78ff3ea7b
fix: docker/test/integration/mysql_js_client/Dockerfile to reduce vulnerabilities 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-DEBIAN9-PYTHON27-341379
- https://snyk.io/vuln/SNYK-DEBIAN9-PYTHON35-1063181
- https://snyk.io/vuln/SNYK-DEBIAN9-PYTHON35-340072
- https://snyk.io/vuln/SNYK-DEBIAN9-PYTHON35-453739
- https://snyk.io/vuln/SNYK-DEBIAN9-PYTHON35-584435
 2022-04-04 21:20:18 +00:00
Alexander Tokmakov
a2167f12b8 Merge branch 'master' into mvcc_prototype 2022-04-04 14:24:23 +02:00
kssenii
6c8e073a61 Merge master 2022-04-01 16:48:29 +02:00
Mikhail f. Shiryaev
4cc37ae9f3
Clean stale code 2022-04-01 11:59:44 +02:00
Alexey Milovidov
93edf05259
Merge branch 'master' into llvm-14 2022-04-01 04:49:03 +03:00
Alexander Tokmakov
307a2ca579 Merge branch 'master' into zookeeper_client_fault_injection 2022-03-31 15:32:41 +02:00
Nikita Mikhaylov
5f27f690f4 Revert "Added support for schema inference for hdfsCluster (#35602)" 
This reverts commit f6bfdcc0c9.
 2022-03-31 14:19:56 +02:00
mergify[bot]
f9a0692e2c
Merge branch 'master' into Avogar-patch-3 2022-03-31 11:45:31 +00:00
Nikita Mikhaylov
f6bfdcc0c9
Added support for schema inference for hdfsCluster (#35602) 2022-03-31 12:47:36 +02:00
Alexander Tokmakov
5a50ad9de3 Merge branch 'master' into mvcc_prototype 2022-03-31 11:35:04 +02:00
tavplubix
5680f53ed4
Merge pull request #35773 from azat/stateless-tests-artifacts 
ci: replace directory system log tables artifacts with tsv
 2022-03-31 12:16:48 +03:00
Azat Khuzhin
8b84829e93 ci: replace directory system log tables artifacts with tsv 
Changelog:
- remove query_thread_log (query_log should be enough)
- for s3 storage there /var/lib/clickhouse/data/system/*_log cannot be
  used, replace them with plain TSVWithNamesAndTypes, also note, that
  after schema inference it is even pretty easy to use
- support replicated database env correctly

Co-authored-by: tavplubix <tavplubix@clickhouse.com>
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-03-30 21:50:55 +03:00
kssenii
0fc92fe2aa Get rid of all "remote" mentions 2022-03-30 17:15:29 +02:00
mergify[bot]
9a391f2fed
Merge branch 'master' into parallel_stateful 2022-03-30 09:40:12 +00:00
Nikolai Kochetov
3849e63ab1 Change database 2022-03-29 19:06:50 +00:00
Alexander Tokmakov
287d858fda Merge branch 'master' into mvcc_prototype 2022-03-29 16:24:12 +02:00
Alexander Tokmakov
c37945b2c8 run stateful tests in parallel 2022-03-29 15:24:29 +02:00
BoloniniD
2d2420c8a9 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-03-29 11:00:50 +03:00
Nikita Mikhaylov
85282f1b4d
Made schema inference work with s3Cluster table function (#35544) 2022-03-29 00:46:35 +02:00
alesapin
a38f63af2d
Merge pull request #35676 from ClickHouse/remove_outdated_links 
Remove outdated links from CI
 2022-03-28 21:24:45 +02:00
Alexander Tokmakov
208b242188 Merge branch 'master' into mvcc_prototype 2022-03-28 19:58:06 +02:00
alesapin
b838a7dcb0 Remove outdated links from CI 2022-03-28 15:53:22 +02:00
Alexander Tokmakov
e795b83148 disable random settings in fast test 2022-03-28 14:56:23 +02:00
Mikhail Artemenko
1886d9c2ea refactor parseTypeOfField & fix tests 2022-03-27 23:00:28 +03:00
Kruglov Pavel
18ab49e788
Check all logs for crashes, logical errors, etc in backward compatibility check 2022-03-25 11:59:50 +01:00
mergify[bot]
03c8a59a57
Merge branch 'master' into stress-test 2022-03-23 17:37:05 +00:00
Alexander Tokmakov
bcec53aadc Merge branch 'master' into mvcc_prototype 2022-03-23 11:28:43 +01:00
Kruglov Pavel
5efad9699c
Update run.sh 2022-03-23 11:28:40 +01:00
Kruglov Pavel
8ef2f13524
Update run.sh 2022-03-23 11:26:31 +01:00
Kruglov Pavel
034d92d817
Fix removing empty files 2022-03-22 18:06:35 +01:00
Mikhail f. Shiryaev
e6f5a3f98b
Apply black formatter to all *.py files in the repo 2022-03-22 17:39:58 +01:00
Mikhail f. Shiryaev
5fea6d24fa
Add black formatting check 2022-03-22 17:38:48 +01:00
alesapin
0ab9a9c0f6
Merge pull request #33664 from ClickHouse/release-steps 
Refactor releasing process
 2022-03-22 14:43:18 +01:00
avogar
c5245c1ad1 Improve backward compatibility check and stress test 2022-03-22 12:00:20 +00:00
Mikhail f. Shiryaev
70945764e5
Fix a tiny typo 2022-03-22 11:10:00 +01:00
Alexander Tokmakov
3c762f566d Merge branch 'master' into mvcc_prototype 2022-03-21 20:16:29 +01:00
avogar
288d08f3f2 Add retries in backward compatibility check 2022-03-21 17:26:24 +00:00
Alexander Tokmakov
5c760fd7ce Merge branch 'master' into zookeeper_client_fault_injection 2022-03-21 11:57:40 +01:00
Alexey Milovidov
159a73b6d5 Merge branch 'master' into llvm-14 2022-03-20 22:50:20 +01:00
mergify[bot]
5295dd0ef2
Merge branch 'master' into stress-test 2022-03-17 11:10:37 +00:00
Alexander Tokmakov
4b3e13a4fe Merge branch 'master' into mvcc_prototype 2022-03-16 21:06:19 +01:00
Kruglov Pavel
fa6d963f83
Update run.sh 2022-03-16 12:30:45 +01:00
Kruglov Pavel
6b3a25e20d
Update run.sh 2022-03-15 17:15:17 +01:00
Alexander Tokmakov
9702b5177d Merge branch 'master' into mvcc_prototype 2022-03-14 21:45:38 +01:00
alesapin
1edd4347fc Hope I'll fix it 2022-03-14 21:43:51 +01:00
avogar
b9496af3b3 Fix tests 2022-03-14 16:40:17 +00:00
alesapin
2f8da04891 Fix timezones 2022-03-14 13:46:45 +01:00
BoloniniD
253afd032f Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-03-13 21:18:46 +03:00
Alexey Milovidov
d0716b035f
Revert "Change timezone in Docker" 2022-03-13 04:03:06 +03:00
Alexey Milovidov
6b9129c494 Change timezone in Docker 2022-03-11 23:21:45 +01:00
Kruglov Pavel
3d36eced2d
Update run.sh 2022-03-10 17:55:45 +03:00
Kruglov Pavel
91b9c11939
Increase the number of attempts to start server 2022-03-10 14:38:39 +03:00
mergify[bot]
78c8029aeb
Merge branch 'master' into stress-test 2022-03-09 16:22:45 +00:00
kssenii
5260822964 Merge master 2022-03-08 18:21:28 +01:00
Alexander Tokmakov
8acfb8d27f Merge branch 'master' into mvcc_prototype 2022-03-07 17:40:15 +01:00
Kseniia Sumarokova
28b9ec01c0
Merge pull request #34945 from bigo-sg/hive_bug_fixed 
unexpected result when use `in` in hive query
 2022-03-07 17:13:11 +01:00
lgbo-ustc
68fb92edf2 update hive server image 2022-03-07 10:36:12 +08:00
Kruglov Pavel
dbba752398
Merge branch 'master' into stress-test 2022-03-04 18:33:37 +03:00
Kruglov Pavel
0f90996bb8
Update run.sh 2022-03-04 14:24:24 +03:00
Azat Khuzhin
15bbc5537b fasttest: add --print-time for "Test time" column in the results table 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-03-03 15:44:41 +03:00
Azat Khuzhin
b2ed5552cc fasttest: use bash arrays over wrap lines with backslash 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-03-03 15:44:41 +03:00
lgbo-ustc
21c164ad2c update tests 2022-03-02 14:20:59 +08:00
lgbo-ustc
2ff7ff90fa update tests 2022-03-02 14:17:04 +08:00
Kruglov Pavel
8f6ba99fec
Update run.sh 2022-03-01 15:20:02 +03:00
kssenii
9983a5d802 Add test for profile events 2022-02-28 15:47:12 +01:00
lgbo-ustc
24caa70243 remove meaningless codes 2022-02-28 20:23:00 +08:00
lgbo-ustc
b8a2deba0f update tests 2022-02-28 20:11:59 +08:00
Kruglov Pavel
6252588922
Update run.sh 2022-02-28 13:33:10 +03:00
lgbo-ustc
aa8db563d6 update test 2022-02-28 18:02:37 +08:00
lgbo-ustc
5885cfd869 fixed bug : unexpected result when using in clause for filtering partitions 2022-02-28 16:47:50 +08:00
kssenii
725f967ac6 Add stress test 2022-02-24 07:54:58 +01:00
Alexander Tokmakov
aa6b9a2abc Merge branch 'master' into mvcc_prototype 2022-02-23 23:22:03 +03:00
kssenii
36a76d6a75 Fix test 2022-02-22 15:18:28 +01:00
kssenii
c637385dd0 Merge master 2022-02-22 13:17:51 +01:00
kssenii
26f58274b6 Fix stateful test 2022-02-22 12:05:43 +01:00
kssenii
4543513a5d Add comments 2022-02-21 13:54:03 +01:00
kssenii
009e71e273 Fix tests 2022-02-21 11:43:03 +01:00
Alexey Milovidov
aa8f282ad9 Switch to clang/llvm 14 2022-02-19 18:43:02 +01:00
BoloniniD
3f149e88be Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-02-19 20:23:19 +03:00
Kruglov Pavel
500ed56061
Update docker/test/stress/run.sh 
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
 2022-02-18 16:36:48 +03:00
Kruglov Pavel
de888db506
Update docker/test/stress/stress 
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
 2022-02-18 16:36:38 +03:00
Kruglov Pavel
10c45bef67
Remove clickhouse-test package 2022-02-18 13:03:23 +03:00
Kruglov Pavel
71e7668fa6
Remove downloading clickhouse-test 2022-02-18 13:02:49 +03:00
Kruglov Pavel
74087470c2
Update run.sh 2022-02-18 12:52:56 +03:00
kssenii
353ffacca3 Add test 2022-02-17 19:57:04 +01:00
Kruglov Pavel
e77319bf01
Merge branch 'master' into stress-test 2022-02-17 20:28:46 +03:00
alesapin
8a0153b6d3
Merge pull request #34606 from qoega/no-clickhouse-test-deb 
Remove clickhouse-test deb completely
 2022-02-17 18:13:44 +03:00
Mikhail f. Shiryaev
c3bf9eb2f9
Remove PVS test 2022-02-17 12:59:47 +01:00
Alexander Tokmakov
dae044f86b Merge branch 'master' into mvcc_prototype 2022-02-17 13:49:37 +03:00
alesapin
6df2c9c2d8
Merge pull request #34433 from ClickHouse/s3-fix-content-type 
Workaround for bug when AWS mistakenly set Content-Type to XML
 2022-02-17 13:11:14 +03:00
alesapin
0b099b140f Fix 2022-02-17 10:39:33 +03:00
kssenii
47f94120da Merge master 2022-02-16 14:43:28 +01:00
kssenii
f9622d44f0 Try add stateful tests 2022-02-16 14:18:55 +01:00
alesapin
bc2d0ee7c7
Merge pull request #34215 from ClickHouse/revert-34211-revert-34153-add_func_tests_over_s3 
Add func tests run with s3 and fix several bugs
 2022-02-15 19:07:11 +03:00
alesapin
3b531e43b7 Setup credentials 2022-02-15 16:12:08 +03:00
Yatsishin Ilya
bbe2c07a7b remove clickhouse-test deb completely 2022-02-15 12:03:51 +00:00
alesapin
e1fb220bb7 Fix test 2022-02-15 13:31:41 +03:00
Alexander Tokmakov
1e4e569151 Merge branch 'master' into mvcc_prototype 2022-02-15 02:26:47 +03:00
Mikhail f. Shiryaev
23546ab825
Use the current kerberized-haddop image 2022-02-13 22:01:45 +01:00
Mikhail f. Shiryaev
0ae948866a
Create symlink hadoop -> ./hadoop-2.7.0 2022-02-13 19:10:11 +01:00
alesapin
89373155fc Merge branch 'master' into revert-34211-revert-34153-add_func_tests_over_s3 2022-02-13 21:07:54 +03:00
Azat Khuzhin
4965586e7e
More gdb introspection on CI (#34517) 
* test/fuzzer: preserve core

This may help to capture things like in [1]:

    Failed assertion: "bin->low_bits_full > bin->low_bits_empty" Received signal 6 Received signal Aborted (6)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33057/19216f4c0ae0f72108c147f958a708b521ad27dc/fuzzer_astfuzzerdebug,actions//report.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test: do not run 'info locals' since 'backtrace full' includes it

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test: try capture backtrace from all threads

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test/stress: fix path for core artifacts

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
Fixes: #33389

* test/fuzzer: store core file in artifacts

v2: fix report, because of undefined variable CORE_LINK
v3: fix case when there is no core file

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-13 15:02:15 +03:00
BoloniniD
c8bb6fb38a Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-02-13 12:47:18 +03:00
BoloniniD
677b5ea6aa Add MSan support for BLAKE3 lib 2022-02-13 12:46:20 +03:00
Mikhail f. Shiryaev
ac459dccd8
Force update kerberized hadoop 2022-02-11 18:26:49 +01:00
Mikhail f. Shiryaev
65e8605af1
Make testflows aarch64 compatible 2022-02-11 18:26:48 +01:00
Mikhail f. Shiryaev
7ca684aa9c
Revert checks for architectures in Dockerfiles 2022-02-11 18:26:44 +01:00
Mikhail f. Shiryaev
bd3812a462
Add a comment 2022-02-11 18:26:44 +01:00
Mikhail f. Shiryaev
c19d0a3494
Update performance-comparison, fix x86 hard-code 2022-02-11 18:26:41 +01:00
Mikhail f. Shiryaev
2d02eab750
Revert "Merge pull request #34373 from ClickHouse/docker-tz" 
This reverts commit efd8044ab7, reversing
changes made to 4bb69bcb15.
 2022-02-08 15:34:01 +01:00
Mikhail f. Shiryaev
c7ba5204b3
Make testflows a multiarch image 2022-02-07 13:21:51 +01:00
Mikhail f. Shiryaev
4a1e84306a
Update performance comparison OS version 2022-02-07 12:57:58 +01:00
Mikhail f. Shiryaev
4a857d7d18
Use UTC in docker images 2022-02-07 12:35:32 +01:00
Alexander Tokmakov
45be75b4db Merge branch 'master' into mvcc_prototype 2022-02-06 23:36:08 +03:00
alesapin
06499ce847 Revert "Remove docker change" 
This reverts commit 3c80e0bff8.
 2022-02-04 14:32:11 +03:00
Alexander Tokmakov
fe30e0f162 fixes 2022-02-03 21:57:09 +03:00
Mikhail f. Shiryaev
a7325bbe32
Fix check-workflows in style check, iterate over checks 2022-02-03 18:36:01 +01:00
Mikhail f. Shiryaev
37179bbc9c
Add verbosity to stylecheck 2022-02-03 17:50:35 +01:00
BoloniniD
23e29e22a0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-02-03 19:32:14 +03:00
Alexander Tokmakov
ca5f951558 Merge branch 'master' into mvcc_prototype 2022-02-03 18:56:44 +03:00
BoloniniD
a744378cc7 Fix performance test 2022-01-27 20:14:50 +03:00
Kruglov Pavel
e004dae25b
Update run.sh 2022-01-27 18:15:03 +03:00
BoloniniD
6f078c164d Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-01-26 20:11:27 +03:00
Kruglov Pavel
b54bf18b27
Merge branch 'master' into stress-test 2022-01-25 14:35:42 +03:00
Yatsishin Ilya
3a55f7a7d6 Do not use clickhouse-test.deb in stateless 2022-01-24 11:53:42 +00:00
Kruglov Pavel
d5bde26bc1
Update run.sh 2022-01-20 15:22:00 +03:00
Alexander Tokmakov
e9a5a64a71 Merge branch 'master' into mvcc_prototype 2022-01-19 21:41:23 +03:00
mergify[bot]
e492fe0a0f
Merge branch 'master' into zookeeper_client_fault_injection 2022-01-17 15:26:16 +00:00
Alexander Tokmakov
d237099729 rebuild docker image 2022-01-15 22:38:25 +03:00
Alexander Tokmakov
9a518d789f rebuild docker image 2022-01-15 16:21:43 +03:00
Alexander Tokmakov
5132411e00 rebuild docker image 2022-01-15 14:07:40 +03:00
Alexander Tokmakov
7feb014804 rebuild docker image 2022-01-14 23:26:18 +03:00
mergify[bot]
4ffc3bb589
Merge branch 'master' into fix-mongo2-compose 2022-01-14 18:36:37 +00:00
Alexander Tokmakov
c1c3f25c10 Merge branch 'master' into mvcc_prototype 2022-01-14 21:03:58 +03:00
Mikhail Artemenko
698364f7b0 add tests 2022-01-14 20:58:56 +03:00
Mikhail f. Shiryaev
fdb88b75ec
Don't build integration tests on arm64 yet 2022-01-14 15:48:43 +01:00
Alexander Tokmakov
4dd216ce8f Merge branch 'master' into mvcc_prototype 2022-01-14 17:11:32 +03:00
Mikhail f. Shiryaev
73f06421b1
Use automatic architecture for docker repo 2022-01-14 15:03:43 +01:00
Alexander Tokmakov
e1a41fc694 add system log for introspection 2022-01-14 17:03:00 +03:00
Mikhail f. Shiryaev
97e4151aff
Remove broken editing of /etc/hosts 2022-01-14 14:46:14 +01:00
Yatsishin Ilya
2fe8f6c60b Fix ports allocated for mongo2 that is w/o creds 2022-01-14 13:00:38 +00:00
alesapin
d7a7926610 Update version to 22.1 not 21.13 2022-01-14 15:10:45 +03:00
alesapin
5257b413d4
Merge pull request #33612 from ClickHouse/workflow-linting 
Add actionlint configuration and fix all issues
 2022-01-14 11:41:48 +03:00
Kseniia Sumarokova
5da673c3a5
Merge pull request #31104 from bigo-sg/hive_table 
Implement hive table engine
 2022-01-14 09:39:17 +03:00
alexey-milovidov
438519aeec
Merge pull request #33389 from azat/stress-core-dumps 
tests/stress: add core dumps into artifacts
 2022-01-14 01:26:35 +03:00
Mikhail f. Shiryaev
49fa1a1cd3
Add linter and checker for workflow files 2022-01-13 21:40:21 +01:00
Mikhail f. Shiryaev
55032a0286
Fix wrong variables in processing results 2022-01-13 21:36:34 +01:00
Mikhail f. Shiryaev
0edb80939f
Apply black to process_style_check_result.py 2022-01-13 20:59:36 +01:00
Mikhail f. Shiryaev
c465593706
Force rebuild images once again in master 2022-01-13 19:03:34 +01:00
Mikhail f. Shiryaev
e314eed992
Force rebuild images in CI 2022-01-13 17:49:23 +01:00
Mikhail f. Shiryaev
651b22f611
Add necessary MLIR dependency for codebrowser 2022-01-12 17:07:58 +01:00
Mikhail f. Shiryaev
8779b6763d
Use architecture specific version of minio 2022-01-12 17:07:56 +01:00
Mikhail f. Shiryaev
d1b14d5ee0
Use a library with proper architecture for mysql odbc 2022-01-12 17:07:54 +01:00
Mikhail f. Shiryaev
7a369837c3
Improve integration tests image 
- Order packages
- Add rpm2cpio package
- Clean cache
- Use apache CDN for zookeeper
 2022-01-12 17:07:54 +01:00
Mikhail f. Shiryaev
18a9aac61e
Use mysql-client-8.0 from ubuntu original repo 2022-01-12 17:07:53 +01:00
Mikhail f. Shiryaev
565e469b19
Don't build image for arm64 pvs-sturio 2022-01-12 17:07:53 +01:00
Mikhail f. Shiryaev
2a83a1c05d
Build dependent images from the current version 2022-01-12 17:07:52 +01:00
Mikhail f. Shiryaev
624dfda931
Fix dpkg-deb architecture-dependent artifact 2022-01-12 17:07:51 +01:00
taiyang-li
66813a3aa9 merge master 2022-01-12 16:56:29 +08:00
BoloniniD
620f6ca8c1 Fix performance tests Dockerfile 2022-01-11 22:14:18 +03:00
BoloniniD
82027176f1 Move BLAKE3 tests away from fasttest + add USE_BLAKE3 key to CMakeLists 2022-01-10 23:12:33 +03:00
BoloniniD
a50530f061 Add cargo to fasttest + fixes 2022-01-10 23:12:32 +03:00
BoloniniD
fc5cd6dd83 Start BLAKE3 integration 2022-01-10 23:12:32 +03:00
Azat Khuzhin
ebed6193b4 tests/stress: add core dumps into artifacts 
gcore is used here because:

- default kernel.core_pattern is "|/usr/share/apport/apport %p %s %c %d %P %E" [1]
  and so to make it work you need to install apport into container and
  configure it propertly -- to complex

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33389/204e459d259570e6bc7fe2903f7e516094a916ca/stress_test__address__actions_/runlog.log

- kernel.core_pattern cannot be changed, since proc is mounted in
  read-only mode in non --privileged containers [2]

  [2]: https://s3.amazonaws.com/clickhouse-test-reports/33389/dab3afbd94558f9654bf0aa1e06e06e2962f3bb0/stress_test__address__actions_/runlog.log

v2: change kernel.core_pattern
v3: use gcore, since you are not allowed to change kernel.core_pattern
    in container (only under --privileged)
 2022-01-04 14:03:40 +03:00
Alexey Milovidov
2c7a8db58c Add test output and compare to reference 2022-01-03 03:36:23 +03:00
Alexey Milovidov
268842afa8 Add a comment 2022-01-03 03:07:25 +03:00
Alexey Milovidov
c3ab18d1b0 Merge branch 'feature/dotnet-integration-test' of github.com:DarkWanderer/ClickHouse into dotnet-integration-test 2022-01-03 03:00:01 +03:00
alexey-milovidov
f1b6bc1074
Update docker_compose_dotnet_client.yml 2022-01-03 02:55:49 +03:00
alexey-milovidov
7d52ba4576
Update Dockerfile 2022-01-03 02:54:43 +03:00
alexey-milovidov
817bb0ee6d
Update docker_compose_dotnet_client.yml 2022-01-03 02:46:08 +03:00
alexey-milovidov
57926cf366
Update Dockerfile 2022-01-03 02:45:46 +03:00
taiyang-li
1e102bc1b2 merge master 2022-01-01 09:01:06 +08:00
alesapin
333dfab6a6 Add retries to AST fuzzer 2021-12-28 16:12:51 +03:00
taiyang-li
9036b18c2f merge master 2021-12-27 15:12:48 +08:00
alesapin
118004015a Longer timeout for server start in fuzzer 2021-12-24 14:56:51 +03:00
Kruglov Pavel
ffb6c5b37b
Merge branch 'master' into stress-test 2021-12-23 20:14:15 +03:00