Commit Graph

3735 Commits

Author SHA1 Message Date
Mikhail f. Shiryaev
1c5610bf65
Changes during the review 2022-12-01 14:06:17 +01:00
Azat Khuzhin
4c1fb543e1
Sync everything to persistent storage to avoid writeback affects perf tests (#43530)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-12-01 13:42:59 +01:00
Alexey Milovidov
54e27d4230
Merge branch 'master' into build-libcxx-and-libcxxabi-from-llvm-project 2022-11-30 00:25:25 +01:00
Alexander Tokmakov
ac578efc05
Update run.sh 2022-11-29 20:16:59 +03:00
Mikhail f. Shiryaev
9cb2aa1c46
Add python mypy check to CI 2022-11-29 16:50:22 +01:00
Mikhail f. Shiryaev
e46f615176
Simplify checks list in style-check image 2022-11-29 16:50:22 +01:00
Robert Schulze
829958e13a
Merge branch 'master' into build-libcxx-and-libcxxabi-from-llvm-project 2022-11-28 16:09:14 +01:00
Alexander Tokmakov
9a948dc05a
Merge pull request #43593 from ClickHouse/fix_fuzzer_run
Remove code that I do not understand
2022-11-28 18:01:11 +03:00
Azat Khuzhin
ca16f5136f stress: use --max-tries only since 22.12
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-27 09:40:39 +01:00
Azat Khuzhin
2c36b52050 stress: increase timeout for server waiting after TERM
Greater timeout after TERM may reduce about of KILL, let's try.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-27 09:40:39 +01:00
Alexander Tokmakov
cdbd1cb158 fix 2022-11-26 18:45:50 +01:00
Nikita Taranov
d1c258cf20
Add xxh3 hash function (#43411)
* impl

* try fix

* add docs

* add test

* rm unused file

* excellent
2022-11-26 00:14:08 +01:00
Alexander Tokmakov
a982e62f65 fix 2022-11-25 19:01:24 +01:00
Alexander Tokmakov
98e6c76a60 fix 2022-11-25 16:58:18 +01:00
Alexander Tokmakov
91b4b8e1d5 Merge branch 'master' into fix_fuzzer_run 2022-11-25 16:57:47 +01:00
Mikhail f. Shiryaev
58557c87c2
Merge pull request #43654 from ClickHouse/optimize-builder-image
Optimize binary-builder size
2022-11-25 15:24:57 +01:00
Alexey Milovidov
69d1be50bc
Merge pull request #43446 from ClickHouse/fix-typo-3
Fix typo
2022-11-25 15:22:28 +01:00
Alexander Tokmakov
1e1caf1440
Update run-fuzzer.sh 2022-11-25 15:06:52 +03:00
Mikhail f. Shiryaev
a68dc6280d
Optimize binary-builder size 2022-11-25 12:17:51 +01:00
Alexander Tokmakov
e125f4016b fix 2022-11-24 21:37:08 +01:00
Alexander Tokmakov
162c7db972
Update run-fuzzer.sh 2022-11-24 14:29:48 +03:00
alesapin
f64f0461fe
Merge pull request #43288 from ClickHouse/Enable_compress_marks_and_primary_key
Enable compress marks and primary key for CI
2022-11-24 12:24:04 +01:00
Alexander Tokmakov
f3b7193635 remove code that I do not understand 2022-11-23 21:49:44 +01:00
alesapin
41d3825770 Merge branch 'Enable_compress_marks_and_primary_key' of https://github.com/ClickHouse/ClickHouse into Enable_compress_marks_and_primary_key 2022-11-22 19:12:00 +01:00
alesapin
31142808de Disable compressed marks and index in stress tests 2022-11-22 19:10:51 +01:00
Alexey Milovidov
b7e4547f53
Merge branch 'master' into fix-typo-3 2022-11-22 18:30:06 +01:00
Alexey Milovidov
56f8c0b84b Fix typo 2022-11-21 15:10:15 +01:00
Alexey Milovidov
17e2189199 Fix backward compatibility check 2022-11-21 12:51:51 +01:00
Azat Khuzhin
6e52748af6 Improve pytest --pdb experience by preserving dockerd on SIGINT
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-19 10:47:44 +01:00
alesapin
2dbf07f58a Splitting checks 2022-11-18 17:38:17 +01:00
robot-clickhouse
77500b7065 Update version_date.tsv and changelogs after v22.11.1.1360-stable 2022-11-17 21:20:45 +00:00
Igor Nikonov
00920b1aa9
Merge pull request #43117 from ClickHouse/igor/keeper_retries_enable_fault_injection_in_tests
Enable keeper fault injection for inserts in functional tests
2022-11-17 14:36:09 +01:00
Mikhail f. Shiryaev
2a1268a9cf
Merge pull request #41903 from ClickHouse/filimonov-docs-builder-better-logging
Better logging for docs builder
2022-11-15 18:42:48 +01:00
Igor Nikonov
c57188f2f9
Merge branch 'master' into igor/keeper_retries_enable_fault_injection_in_tests 2022-11-14 10:26:42 +01:00
Alexey Milovidov
a4797d372f
Merge branch 'master' into ubuntu-cruft 2022-11-13 05:12:32 +01:00
Alexey Milovidov
c2ddef897f
Update Dockerfile.ubuntu 2022-11-13 07:12:25 +03:00
Igor Nikonov
b12ebab65c Enable keeper fault injection and retries for insert queries in
funcntional tests
2022-11-11 18:07:15 +00:00
Antonio Andelic
e512d7f036
Merge pull request #42619 from ClickHouse/jepen-multiple-tests
Extend Jepsen tests with support for server
2022-11-10 09:01:40 +01:00
Alexander Tokmakov
af78f4b66a
Merge branch 'master' into tavplubix-patch-5 2022-11-09 16:20:24 +03:00
Alexander Tokmakov
9edb4d779b fix 2022-11-09 12:18:29 +01:00
Alexander Tokmakov
d9af3d61b6 Merge branch 'master' into tavplubix-patch-5 2022-11-09 12:17:54 +01:00
Alexander Tokmakov
236f3329bc
Update run-fuzzer.sh 2022-11-08 22:54:58 +03:00
Dmitry Novik
a3c1049f9d
Update run-fuzzer.sh 2022-11-08 19:42:13 +01:00
Alexander Tokmakov
e659fb5d85
Update run-fuzzer.sh 2022-11-08 19:11:44 +03:00
alesapin
de6014e4a5
Update run-fuzzer.sh 2022-11-07 22:54:08 +01:00
Alexander Tokmakov
b8174a63a8 Merge branch 'master' into fix_intersecting_parts2 2022-11-07 20:26:36 +01:00
Mikhail f. Shiryaev
105c6a70f0
Update GH actions checkers 2022-11-07 13:19:40 +01:00
Antonio Andelic
7467490861 Increase test count 2022-11-07 10:39:16 +00:00
Antonio Andelic
8e1a4bcf9a Update CI config 2022-11-07 09:42:00 +00:00
Antonio Andelic
e751557599 Merge branch 'master' into jepen-multiple-tests 2022-11-07 08:13:49 +00:00
Antonio Andelic
98d3b4a835 Support Jepsen for server in CI 2022-11-04 13:40:13 +00:00
Ilya Yatsishin
2e7013f439
Merge pull request #42397 from qoega/revive-sqlancer
Revive SQLancer
2022-11-04 14:28:21 +01:00
Antonio Andelic
2744cea382 Merge branch 'master' into jepen-multiple-tests 2022-11-04 13:05:03 +00:00
Alexander Tokmakov
b3ae38f98c
Merge branch 'master' into fix_intersecting_parts2 2022-11-03 14:25:13 +03:00
Mikhail f. Shiryaev
150ceb7d37
Use matus-chochlik/ctcache for clang-tidy 2022-11-03 11:53:11 +01:00
Antonio Andelic
8a3c56f09f Merge branch 'master' into jepen-multiple-tests 2022-11-03 09:04:49 +00:00
Alexander Tokmakov
e67d05604c Merge branch 'master' into fix_intersecting_parts2 2022-11-02 19:30:27 +01:00
Alexander Tokmakov
acbad99b24 remove abandonable_lock part 2 2022-11-02 14:28:49 +01:00
alesapin
cf68d02ea0
Merge branch 'master' into ubuntu-cruft 2022-11-02 12:24:33 +01:00
robot-clickhouse
fc1ae1d99d Update version_date.tsv and changelogs after v22.10.2.11-stable 2022-11-01 15:50:38 +00:00
Robert Schulze
ba4fa7e391
Replace libcxx(abi) by llvm-project as fasttest dependency 2022-10-30 13:04:22 +00:00
Antonio Andelic
c5fe2c9be7 Merge branch 'master' into jepen-multiple-tests 2022-10-28 11:34:15 +00:00
Yatsishin Ilya
3ab23ef3f2 Merge remote-tracking branch 'origin/master' into revive-sqlancer 2022-10-28 07:21:39 +00:00
Alexander Tokmakov
86b81a2b6f
Merge pull request #42234 from arthurpassos/fix_ares_fd_process_race_condition
Fix c-ares crash
2022-10-27 17:17:22 +03:00
Yatsishin Ilya
3a19752d54 style 2022-10-27 14:08:23 +00:00
Yatsishin Ilya
8a5ef517e3 style 2022-10-27 13:30:35 +00:00
Antonio Andelic
1db9888508 Merge branch 'master' into jepen-multiple-tests 2022-10-27 09:06:51 +00:00
Yatsishin Ilya
d8e8dd006f support server fail 2022-10-27 09:06:11 +00:00
Yatsishin Ilya
ccc515bebd Merge remote-tracking branch 'origin/master' into revive-sqlancer 2022-10-27 07:13:28 +00:00
robot-clickhouse
42f5a3b2f8
Update version_date.tsv and changelogs after v22.10.1.1877-stable 2022-10-26 15:39:34 +02:00
robot-clickhouse
117674c0ce Update version_date.tsv and changelogs after v22.10.1.1875-stable 2022-10-26 08:48:12 +00:00
Yatsishin Ilya
8e77180968 Merge remote-tracking branch 'origin/master' into revive-sqlancer 2022-10-26 08:31:00 +00:00
Yatsishin Ilya
c89c14a05d add NoREC 2022-10-25 10:34:55 +00:00
Alexey Milovidov
c48127534b
Merge pull request #41753 from pkit/morton_coding
add Morton Coding (ZCurve)
2022-10-25 06:10:37 +02:00
Alexey Milovidov
4f582e19a8
Merge pull request #42479 from ClickHouse/Avogar-patch-1
Add error "Destination table is myself" to exception list in BC check
2022-10-25 04:55:12 +02:00
Alexey Milovidov
c4fd827442
Merge pull request #42483 from ClickHouse/Avogar-patch-2
Get current clickhouse version without sending query in BC check
2022-10-25 04:54:24 +02:00
Alexey Milovidov
d0a7f855ef
Update docker/server/Dockerfile.ubuntu
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2022-10-25 05:32:11 +03:00
Alexey Milovidov
1d40578809 Remove cruft from Docker 2022-10-24 18:35:56 +02:00
Antonio Andelic
5bc9be8a5f Start defining tests for server 2022-10-24 15:04:57 +00:00
Alexander Gololobov
5ec9b35bbb
Merge pull request #42585 from azat/ci/stress/hung-check-fix
ci/stress: fix memory limits overrides for hung check
2022-10-24 13:45:56 +02:00
Mikhail f. Shiryaev
a29ece3bb8
Merge pull request #42349 from azat/packages/archlinux
Use nfpm packager for archlinux packages
2022-10-24 10:26:24 +02:00
Yatsishin Ilya
15b6de2aae Merge remote-tracking branch 'origin/master' into revive-sqlancer 2022-10-24 08:26:01 +00:00
Azat Khuzhin
f0aed68893 ci/stress: fix memory limits overrides for hung check
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-22 20:53:18 +02:00
Alexey Milovidov
5fd7409ce1
Merge branch 'master' into morton_coding 2022-10-22 04:39:13 +02:00
Alexander Tokmakov
77ea58d539
Update run-fuzzer.sh 2022-10-21 17:58:20 +03:00
Arthur Passos
50f9acb221
Merge branch 'master' into fix_ares_fd_process_race_condition 2022-10-20 13:35:58 -03:00
Yatsishin Ilya
ab41c8e8ce black 2022-10-19 17:16:41 +00:00
Yatsishin Ilya
7d90d54af8 better reporting 2022-10-19 17:02:49 +00:00
Yatsishin Ilya
5121e9b096 update docker scripts 2022-10-19 16:30:01 +00:00
Alexander Tokmakov
f958c155f3
Merge branch 'master' into fixes_for_replicated_merge_tree2 2022-10-19 17:25:24 +03:00
Antonio Andelic
10b176fe19
Merge pull request #41854 from azat/tests/stress/fix-dbg-sym-bc
tests: fix debug symbols (and possible crashes) for backward compatiblity check
2022-10-19 16:18:41 +02:00
Constantine Peresypkin
5b3b11b517 add Morton Coding (ZCurve) 2022-10-19 15:59:25 +02:00
Kruglov Pavel
2ca0d37e83
Get current clickhouse version without sending query in BC check 2022-10-19 13:25:03 +02:00
Kruglov Pavel
632965212f
Add error "Destination table is myself" to exception list in BC check 2022-10-19 12:52:32 +02:00
Azat Khuzhin
043c4163f4 Use nfpm packager for archlinux packages
Since nfpm v2.20.0 it can build packages for archlinux [1].

  [1]: https://github.com/goreleaser/nfpm/pull/543

Something like this:

    $ mkdir -p /src/packages/root
    $ cmake -DCMAKE_INSTALL_PREFIX=/usr /src
    $ DESTDIR=/src/packages/root ninja install
    $ cd /src/packages
    $ ./build --archlinux

    $ root@s3:/src/packages# ./build --archlinux
    Current version is 22.10.1.1
    Building archlinux package for clickhouse-client.yaml
    using archlinux packager...
    created package: /src/clickhouse-client-22.10.1.1-1-x86_64.pkg.tar.zst
    ...

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-18 18:33:48 +03:00
Azat Khuzhin
fb6474c35b Add a comment about MAKE_* env vars
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-18 18:33:48 +03:00
Azat Khuzhin
7893ff0785 Update woboq_codebrowser location
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-18 17:31:15 +02:00
Alexander Tokmakov
ea77ff9022 Merge branch 'master' into fixes_for_replicated_merge_tree2 2022-10-18 17:25:25 +02:00
Yatsishin Ilya
b8193a0eb3 one more time 2022-10-17 17:42:18 +00:00
Yatsishin Ilya
6f26816d4f fix 2022-10-17 16:31:19 +00:00
Yatsishin Ilya
7a74792c1b shellcheck 2022-10-17 16:30:36 +00:00
Yatsishin Ilya
aa432fe95a staging 2022-10-17 15:20:20 +00:00
Yatsishin Ilya
6a82d54314 add CI files 2022-10-17 14:46:50 +00:00
Yatsishin Ilya
9320ae1abf update sqlancer docker files 2022-10-17 13:10:31 +00:00
Azat Khuzhin
a0ceef48da Add a workaround for "The imported target "merge-fdata" references the file" error
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-17 12:29:59 +02:00
Azat Khuzhin
f7b2addae9 Bump llvm/clang to 15.0.2
Otherwise right now codebrowser image is broken [1], due to changes in
cmake:

    #10 1.607 CMake Error at /usr/lib/llvm-15/lib/cmake/llvm/LLVMExports.cmake:1693 (message):
    #10 1.607   The imported target "merge-fdata" references the file
    #10 1.607
    #10 1.607      "/usr/lib/llvm-15/bin/merge-fdata"

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/42349/36502270eb9f195dcd2dc8b350db9367c619f0f8/push_to_dockerhub_amd64.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-17 12:29:59 +02:00
Arthur Passos
6d22bb78e0 custom py script in integ tests 2022-10-14 12:39:08 -03:00
Alexander Tokmakov
dc99e67d3f
Update run-fuzzer.sh 2022-10-14 17:45:17 +03:00
Alexey Milovidov
aa9e8f1cde
Merge branch 'master' into new-http-compression-methods 2022-10-05 23:07:01 +03:00
Nikolay Degterinsky
c0497ddf36 Add lz4 to the stateless tests image 2022-10-05 06:45:21 +00:00
Anton Popov
8ca73eab03
Merge branch 'master' into fuzz-table-definitions 2022-10-04 15:10:31 +02:00
Vitaly Baranov
65c61877c7
Merge pull request #33435 from BoloniniD/BLAKE3
Integrating Rust code into ClickHouse
2022-10-03 15:25:06 +02:00
Alexander Tokmakov
4211605093 disable zk fault injections in bc check 2022-10-03 13:13:29 +02:00
Robert Schulze
5d15d28843
Fix warning that ENABLE_REPLXX is unused
- 3rd party lib replxx is mandatory since #37719
- remove the corresponding CMake switch from the fasttest build
2022-10-03 08:36:23 +00:00
BoloniniD
3a3ca51980 Fixes after review 2022-10-02 20:52:05 +03:00
Mikhail f. Shiryaev
26eee5c113
Merge pull request #41956 from ClickHouse/auto/v22.9.3.18-stable
Update version_date.tsv and changelogs after v22.9.3.18-stable
2022-09-30 19:23:47 +02:00
BoloniniD
fe7b2fdf6e
Merge branch 'master' into BLAKE3 2022-09-30 18:51:31 +03:00
robot-clickhouse
42760b577a Update version_date.tsv and changelogs after v22.9.3.18-stable 2022-09-29 23:35:12 +00:00
BoloniniD
55c79230b3 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-09-29 23:53:25 +03:00
Alexander Tokmakov
8741785a72 temporarily disable ThreadFuzzer with tsan 2022-09-29 18:08:35 +02:00
Anton Popov
4ac5df2540 drop all fuzzed tables 2022-09-28 14:52:10 +00:00
filimonov
952d546a7c
Better logging for docs builder
CI=true is not pushed from github actions inside container, so it can use some fancy console output formats which may accidentally suppress the docusaurus output, makind the real error not visible in CI report (see https://github.com/ClickHouse/ClickHouse/pull/41254#issuecomment-1259275622 )
2022-09-28 16:19:06 +02:00
Anton Popov
c8beae8237 Merge remote-tracking branch 'upstream/master' into HEAD 2022-09-28 12:47:02 +00:00
Azat Khuzhin
9b20468198 tests: fix debug symbols (and possible crashes) for backward compatiblity check
stress running previous version of the server w/o correct debug symbols
right now, since nobody restore clickhouse.debug file, and this can lead
to the following issues, like in [1]:
- incorrect stack traces
- gdb crashes
- clickhouse crashes, due to non-robust internal DWARF parser (probably)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/41730/8cc53a48ae99a765085f44a75fa49314d1f1cc7d/stress_test__ubsan_.html

Right now I decided not to rework the script to make it less error
prone, but simply fix the problem.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-27 22:50:28 +02:00
alesapin
69f3a66538 Keep the most important log in stress tests 2022-09-27 11:16:10 +02:00
Antonio Andelic
97cf045203
Merge pull request #41721 from ClickHouse/collect-correctly-logs-in-stress-test
Collect logs in Stress test using clickhouse-local
2022-09-27 08:43:44 +02:00
Antonio Andelic
eb78761a7e Collect necessary 2022-09-26 16:30:01 +00:00
Antonio Andelic
9c24929c06
Merge branch 'master' into ignore-attach-thread-keeper-errors 2022-09-26 14:12:54 +02:00
Antonio Andelic
562b214799
Merge branch 'master' into collect-correctly-logs-in-stress-test 2022-09-26 13:23:00 +02:00
Antonio Andelic
6f4a636e8f Remove wildcard 2022-09-26 11:21:53 +00:00
Alexey Milovidov
62ebf397d2
Merge pull request #41610 from ClickHouse/upgrade-arm-requirement
Bump minimum required ARM ISA to v8.2 and add v8.0 compat build
2022-09-26 14:08:48 +03:00
Antonio Andelic
8fde8b2c56 Try with multiple calls 2022-09-26 11:03:24 +00:00
Antonio Andelic
c60d9db687
Merge branch 'master' into ignore-attach-thread-keeper-errors 2022-09-26 08:38:48 +02:00
Antonio Andelic
5ff1bcd553
Merge branch 'master' into collect-correctly-logs-in-stress-test 2022-09-26 08:38:38 +02:00
alesapin
34d9794ab7
Merge pull request #41653 from ClickHouse/investigating_more_bugs
Add very explicit logging on disk choice for fetch
2022-09-24 16:15:02 +02:00
alesapin
06e0f554d8 Fix fetch to local disk 2022-09-23 16:46:53 +02:00
robot-clickhouse
8d2052307e Update version_date.tsv and changelogs after v22.9.2.7-stable 2022-09-23 11:53:04 +00:00
Antonio Andelic
1d93c56d1a Collect logs using clickhouse-local 2022-09-23 10:54:16 +00:00
Antonio Andelic
a17a3e1de1 Ignore Keeper hardware errors 2022-09-23 08:23:57 +00:00
Yakov Olkhovskiy
339aee2c89
do not fail if keys not present 2022-09-22 09:44:44 -04:00
Robert Schulze
bcaa66c804
Add arm-v80compat builds 2022-09-21 13:09:24 +00:00
Mikhail f. Shiryaev
34b9861991
Merge pull request #41531 from ClickHouse/deb-source
Add deb Source for packages
2022-09-20 10:19:50 +02:00
BoloniniD
4f2915c8f7 Fix aarch64-darwin build 2022-09-19 21:52:57 +03:00
Mikhail f. Shiryaev
5d8b8a7db6
Add deb Source for packages 2022-09-19 20:42:02 +02:00
Antonio Andelic
0f92e5e576 Add option for loading only system tables from path using clickhouse-local 2022-09-19 14:18:42 +00:00
BoloniniD
5b4fb4bf66
Merge branch 'master' into BLAKE3 2022-09-18 23:14:37 +03:00
BoloniniD
7b5d3e3d82 Fix Rust installation for Corrosion 2022-09-18 23:14:16 +03:00
BoloniniD
627dea333e Merge branch 'master' into BLAKE3 2022-09-17 22:14:30 +03:00
Alexey Milovidov
ecfd8cb5a6 Remove trash error message from integration tests 2022-09-17 20:24:56 +02:00
BoloniniD
452ef4435b Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-09-16 20:05:56 +03:00