thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-18 05:32:52 +00:00
Code Issues Packages Projects Releases Wiki Activity
106,485 Commits 9,136 Branches 1,774 Tags 2 GiB
e3a5318739
Commit Graph

3819 Commits

Author SHA1 Message Date
Alexey Milovidov
69d1be50bc
Merge pull request #43446 from ClickHouse/fix-typo-3 
Fix typo
 2022-11-25 15:22:28 +01:00
Alexander Tokmakov
1e1caf1440
Update run-fuzzer.sh 2022-11-25 15:06:52 +03:00
Mikhail f. Shiryaev
a68dc6280d
Optimize binary-builder size 2022-11-25 12:17:51 +01:00
Alexander Tokmakov
e125f4016b fix 2022-11-24 21:37:08 +01:00
Alexander Tokmakov
162c7db972
Update run-fuzzer.sh 2022-11-24 14:29:48 +03:00
alesapin
f64f0461fe
Merge pull request #43288 from ClickHouse/Enable_compress_marks_and_primary_key 
Enable compress marks and primary key for CI
 2022-11-24 12:24:04 +01:00
Alexander Tokmakov
f3b7193635 remove code that I do not understand 2022-11-23 21:49:44 +01:00
alesapin
41d3825770 Merge branch 'Enable_compress_marks_and_primary_key' of https://github.com/ClickHouse/ClickHouse into Enable_compress_marks_and_primary_key 2022-11-22 19:12:00 +01:00
alesapin
31142808de Disable compressed marks and index in stress tests 2022-11-22 19:10:51 +01:00
Alexey Milovidov
b7e4547f53
Merge branch 'master' into fix-typo-3 2022-11-22 18:30:06 +01:00
Alexey Milovidov
56f8c0b84b Fix typo 2022-11-21 15:10:15 +01:00
Alexey Milovidov
17e2189199 Fix backward compatibility check 2022-11-21 12:51:51 +01:00
Azat Khuzhin
6e52748af6 Improve pytest --pdb experience by preserving dockerd on SIGINT 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-11-19 10:47:44 +01:00
alesapin
2dbf07f58a Splitting checks 2022-11-18 17:38:17 +01:00
robot-clickhouse
77500b7065 Update version_date.tsv and changelogs after v22.11.1.1360-stable 2022-11-17 21:20:45 +00:00
Igor Nikonov
00920b1aa9
Merge pull request #43117 from ClickHouse/igor/keeper_retries_enable_fault_injection_in_tests 
Enable keeper fault injection for inserts in functional tests
 2022-11-17 14:36:09 +01:00
Mikhail f. Shiryaev
2a1268a9cf
Merge pull request #41903 from ClickHouse/filimonov-docs-builder-better-logging 
Better logging for docs builder
 2022-11-15 18:42:48 +01:00
Igor Nikonov
c57188f2f9
Merge branch 'master' into igor/keeper_retries_enable_fault_injection_in_tests 2022-11-14 10:26:42 +01:00
Alexey Milovidov
a4797d372f
Merge branch 'master' into ubuntu-cruft 2022-11-13 05:12:32 +01:00
Alexey Milovidov
c2ddef897f
Update Dockerfile.ubuntu 2022-11-13 07:12:25 +03:00
Igor Nikonov
b12ebab65c Enable keeper fault injection and retries for insert queries in 
funcntional tests
 2022-11-11 18:07:15 +00:00
Antonio Andelic
e512d7f036
Merge pull request #42619 from ClickHouse/jepen-multiple-tests 
Extend Jepsen tests with support for server
 2022-11-10 09:01:40 +01:00
Alexander Tokmakov
af78f4b66a
Merge branch 'master' into tavplubix-patch-5 2022-11-09 16:20:24 +03:00
Alexander Tokmakov
9edb4d779b fix 2022-11-09 12:18:29 +01:00
Alexander Tokmakov
d9af3d61b6 Merge branch 'master' into tavplubix-patch-5 2022-11-09 12:17:54 +01:00
Alexander Tokmakov
236f3329bc
Update run-fuzzer.sh 2022-11-08 22:54:58 +03:00
Dmitry Novik
a3c1049f9d
Update run-fuzzer.sh 2022-11-08 19:42:13 +01:00
Alexander Tokmakov
e659fb5d85
Update run-fuzzer.sh 2022-11-08 19:11:44 +03:00
alesapin
de6014e4a5
Update run-fuzzer.sh 2022-11-07 22:54:08 +01:00
Alexander Tokmakov
b8174a63a8 Merge branch 'master' into fix_intersecting_parts2 2022-11-07 20:26:36 +01:00
Mikhail f. Shiryaev
105c6a70f0
Update GH actions checkers 2022-11-07 13:19:40 +01:00
Antonio Andelic
7467490861 Increase test count 2022-11-07 10:39:16 +00:00
Antonio Andelic
8e1a4bcf9a Update CI config 2022-11-07 09:42:00 +00:00
Antonio Andelic
e751557599 Merge branch 'master' into jepen-multiple-tests 2022-11-07 08:13:49 +00:00
Antonio Andelic
98d3b4a835 Support Jepsen for server in CI 2022-11-04 13:40:13 +00:00
Ilya Yatsishin
2e7013f439
Merge pull request #42397 from qoega/revive-sqlancer 
Revive SQLancer
 2022-11-04 14:28:21 +01:00
Antonio Andelic
2744cea382 Merge branch 'master' into jepen-multiple-tests 2022-11-04 13:05:03 +00:00
Alexander Tokmakov
b3ae38f98c
Merge branch 'master' into fix_intersecting_parts2 2022-11-03 14:25:13 +03:00
Mikhail f. Shiryaev
150ceb7d37
Use matus-chochlik/ctcache for clang-tidy 2022-11-03 11:53:11 +01:00
Antonio Andelic
8a3c56f09f Merge branch 'master' into jepen-multiple-tests 2022-11-03 09:04:49 +00:00
Alexander Tokmakov
e67d05604c Merge branch 'master' into fix_intersecting_parts2 2022-11-02 19:30:27 +01:00
Alexander Tokmakov
acbad99b24 remove abandonable_lock part 2 2022-11-02 14:28:49 +01:00
alesapin
cf68d02ea0
Merge branch 'master' into ubuntu-cruft 2022-11-02 12:24:33 +01:00
robot-clickhouse
fc1ae1d99d Update version_date.tsv and changelogs after v22.10.2.11-stable 2022-11-01 15:50:38 +00:00
Robert Schulze
ba4fa7e391
Replace libcxx(abi) by llvm-project as fasttest dependency 2022-10-30 13:04:22 +00:00
Antonio Andelic
c5fe2c9be7 Merge branch 'master' into jepen-multiple-tests 2022-10-28 11:34:15 +00:00
Yatsishin Ilya
3ab23ef3f2 Merge remote-tracking branch 'origin/master' into revive-sqlancer 2022-10-28 07:21:39 +00:00
Alexander Tokmakov
86b81a2b6f
Merge pull request #42234 from arthurpassos/fix_ares_fd_process_race_condition 
Fix c-ares crash
 2022-10-27 17:17:22 +03:00
Yatsishin Ilya
3a19752d54 style 2022-10-27 14:08:23 +00:00
Yatsishin Ilya
8a5ef517e3 style 2022-10-27 13:30:35 +00:00
Antonio Andelic
1db9888508 Merge branch 'master' into jepen-multiple-tests 2022-10-27 09:06:51 +00:00
Yatsishin Ilya
d8e8dd006f support server fail 2022-10-27 09:06:11 +00:00
Yatsishin Ilya
ccc515bebd Merge remote-tracking branch 'origin/master' into revive-sqlancer 2022-10-27 07:13:28 +00:00
robot-clickhouse
42f5a3b2f8
Update version_date.tsv and changelogs after v22.10.1.1877-stable 2022-10-26 15:39:34 +02:00
robot-clickhouse
117674c0ce Update version_date.tsv and changelogs after v22.10.1.1875-stable 2022-10-26 08:48:12 +00:00
Yatsishin Ilya
8e77180968 Merge remote-tracking branch 'origin/master' into revive-sqlancer 2022-10-26 08:31:00 +00:00
Yatsishin Ilya
c89c14a05d add NoREC 2022-10-25 10:34:55 +00:00
Alexey Milovidov
c48127534b
Merge pull request #41753 from pkit/morton_coding 
add Morton Coding (ZCurve)
 2022-10-25 06:10:37 +02:00
Alexey Milovidov
4f582e19a8
Merge pull request #42479 from ClickHouse/Avogar-patch-1 
Add error "Destination table is myself" to exception list in BC check
 2022-10-25 04:55:12 +02:00
Alexey Milovidov
c4fd827442
Merge pull request #42483 from ClickHouse/Avogar-patch-2 
Get current clickhouse version without sending query in BC check
 2022-10-25 04:54:24 +02:00
Alexey Milovidov
d0a7f855ef
Update docker/server/Dockerfile.ubuntu 
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2022-10-25 05:32:11 +03:00
Alexey Milovidov
1d40578809 Remove cruft from Docker 2022-10-24 18:35:56 +02:00
Antonio Andelic
5bc9be8a5f Start defining tests for server 2022-10-24 15:04:57 +00:00
Alexander Gololobov
5ec9b35bbb
Merge pull request #42585 from azat/ci/stress/hung-check-fix 
ci/stress: fix memory limits overrides for hung check
 2022-10-24 13:45:56 +02:00
Mikhail f. Shiryaev
a29ece3bb8
Merge pull request #42349 from azat/packages/archlinux 
Use nfpm packager for archlinux packages
 2022-10-24 10:26:24 +02:00
Yatsishin Ilya
15b6de2aae Merge remote-tracking branch 'origin/master' into revive-sqlancer 2022-10-24 08:26:01 +00:00
Azat Khuzhin
f0aed68893 ci/stress: fix memory limits overrides for hung check 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-10-22 20:53:18 +02:00
Alexey Milovidov
5fd7409ce1
Merge branch 'master' into morton_coding 2022-10-22 04:39:13 +02:00
Alexander Tokmakov
77ea58d539
Update run-fuzzer.sh 2022-10-21 17:58:20 +03:00
Arthur Passos
50f9acb221
Merge branch 'master' into fix_ares_fd_process_race_condition 2022-10-20 13:35:58 -03:00
Yatsishin Ilya
ab41c8e8ce black 2022-10-19 17:16:41 +00:00
Yatsishin Ilya
7d90d54af8 better reporting 2022-10-19 17:02:49 +00:00
Yatsishin Ilya
5121e9b096 update docker scripts 2022-10-19 16:30:01 +00:00
Alexander Tokmakov
f958c155f3
Merge branch 'master' into fixes_for_replicated_merge_tree2 2022-10-19 17:25:24 +03:00
Antonio Andelic
10b176fe19
Merge pull request #41854 from azat/tests/stress/fix-dbg-sym-bc 
tests: fix debug symbols (and possible crashes) for backward compatiblity check
 2022-10-19 16:18:41 +02:00
Constantine Peresypkin
5b3b11b517 add Morton Coding (ZCurve) 2022-10-19 15:59:25 +02:00
Kruglov Pavel
2ca0d37e83
Get current clickhouse version without sending query in BC check 2022-10-19 13:25:03 +02:00
Kruglov Pavel
632965212f
Add error "Destination table is myself" to exception list in BC check 2022-10-19 12:52:32 +02:00
Azat Khuzhin
043c4163f4 Use nfpm packager for archlinux packages 
Since nfpm v2.20.0 it can build packages for archlinux [1].

  [1]: https://github.com/goreleaser/nfpm/pull/543

Something like this:

    $ mkdir -p /src/packages/root
    $ cmake -DCMAKE_INSTALL_PREFIX=/usr /src
    $ DESTDIR=/src/packages/root ninja install
    $ cd /src/packages
    $ ./build --archlinux

    $ root@s3:/src/packages# ./build --archlinux
    Current version is 22.10.1.1
    Building archlinux package for clickhouse-client.yaml
    using archlinux packager...
    created package: /src/clickhouse-client-22.10.1.1-1-x86_64.pkg.tar.zst
    ...

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-10-18 18:33:48 +03:00
Azat Khuzhin
fb6474c35b Add a comment about MAKE_* env vars 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-10-18 18:33:48 +03:00
Azat Khuzhin
7893ff0785 Update woboq_codebrowser location 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-10-18 17:31:15 +02:00
Alexander Tokmakov
ea77ff9022 Merge branch 'master' into fixes_for_replicated_merge_tree2 2022-10-18 17:25:25 +02:00
Yatsishin Ilya
b8193a0eb3 one more time 2022-10-17 17:42:18 +00:00
Yatsishin Ilya
6f26816d4f fix 2022-10-17 16:31:19 +00:00
Yatsishin Ilya
7a74792c1b shellcheck 2022-10-17 16:30:36 +00:00
Yatsishin Ilya
aa432fe95a staging 2022-10-17 15:20:20 +00:00
Yatsishin Ilya
6a82d54314 add CI files 2022-10-17 14:46:50 +00:00
Yatsishin Ilya
9320ae1abf update sqlancer docker files 2022-10-17 13:10:31 +00:00
Azat Khuzhin
a0ceef48da Add a workaround for "The imported target "merge-fdata" references the file" error 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-10-17 12:29:59 +02:00
Azat Khuzhin
f7b2addae9 Bump llvm/clang to 15.0.2 
Otherwise right now codebrowser image is broken [1], due to changes in
cmake:

    #10 1.607 CMake Error at /usr/lib/llvm-15/lib/cmake/llvm/LLVMExports.cmake:1693 (message):
    #10 1.607   The imported target "merge-fdata" references the file
    #10 1.607
    #10 1.607      "/usr/lib/llvm-15/bin/merge-fdata"

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/42349/36502270eb9f195dcd2dc8b350db9367c619f0f8/push_to_dockerhub_amd64.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-10-17 12:29:59 +02:00
Arthur Passos
6d22bb78e0 custom py script in integ tests 2022-10-14 12:39:08 -03:00
Alexander Tokmakov
dc99e67d3f
Update run-fuzzer.sh 2022-10-14 17:45:17 +03:00
Alexey Milovidov
aa9e8f1cde
Merge branch 'master' into new-http-compression-methods 2022-10-05 23:07:01 +03:00
Nikolay Degterinsky
c0497ddf36 Add lz4 to the stateless tests image 2022-10-05 06:45:21 +00:00
Anton Popov
8ca73eab03
Merge branch 'master' into fuzz-table-definitions 2022-10-04 15:10:31 +02:00
Vitaly Baranov
65c61877c7
Merge pull request #33435 from BoloniniD/BLAKE3 
Integrating Rust code into ClickHouse
 2022-10-03 15:25:06 +02:00
Alexander Tokmakov
4211605093 disable zk fault injections in bc check 2022-10-03 13:13:29 +02:00
Robert Schulze
5d15d28843
Fix warning that ENABLE_REPLXX is unused 
- 3rd party lib replxx is mandatory since #37719
- remove the corresponding CMake switch from the fasttest build
 2022-10-03 08:36:23 +00:00
BoloniniD
3a3ca51980 Fixes after review 2022-10-02 20:52:05 +03:00
Mikhail f. Shiryaev
26eee5c113
Merge pull request #41956 from ClickHouse/auto/v22.9.3.18-stable 
Update version_date.tsv and changelogs after v22.9.3.18-stable
 2022-09-30 19:23:47 +02:00
BoloniniD
fe7b2fdf6e
Merge branch 'master' into BLAKE3 2022-09-30 18:51:31 +03:00
robot-clickhouse
42760b577a Update version_date.tsv and changelogs after v22.9.3.18-stable 2022-09-29 23:35:12 +00:00
BoloniniD
55c79230b3 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-09-29 23:53:25 +03:00
Alexander Tokmakov
8741785a72 temporarily disable ThreadFuzzer with tsan 2022-09-29 18:08:35 +02:00
Anton Popov
4ac5df2540 drop all fuzzed tables 2022-09-28 14:52:10 +00:00
filimonov
952d546a7c
Better logging for docs builder 
CI=true is not pushed from github actions inside container, so it can use some fancy console output formats which may accidentally suppress the docusaurus output, makind the real error not visible in CI report (see https://github.com/ClickHouse/ClickHouse/pull/41254#issuecomment-1259275622 )
 2022-09-28 16:19:06 +02:00
Anton Popov
c8beae8237 Merge remote-tracking branch 'upstream/master' into HEAD 2022-09-28 12:47:02 +00:00
Azat Khuzhin
9b20468198 tests: fix debug symbols (and possible crashes) for backward compatiblity check 
stress running previous version of the server w/o correct debug symbols
right now, since nobody restore clickhouse.debug file, and this can lead
to the following issues, like in [1]:
- incorrect stack traces
- gdb crashes
- clickhouse crashes, due to non-robust internal DWARF parser (probably)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/41730/8cc53a48ae99a765085f44a75fa49314d1f1cc7d/stress_test__ubsan_.html

Right now I decided not to rework the script to make it less error
prone, but simply fix the problem.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-09-27 22:50:28 +02:00
alesapin
69f3a66538 Keep the most important log in stress tests 2022-09-27 11:16:10 +02:00
Antonio Andelic
97cf045203
Merge pull request #41721 from ClickHouse/collect-correctly-logs-in-stress-test 
Collect logs in Stress test using clickhouse-local
 2022-09-27 08:43:44 +02:00
Antonio Andelic
eb78761a7e Collect necessary 2022-09-26 16:30:01 +00:00
Antonio Andelic
9c24929c06
Merge branch 'master' into ignore-attach-thread-keeper-errors 2022-09-26 14:12:54 +02:00
Antonio Andelic
562b214799
Merge branch 'master' into collect-correctly-logs-in-stress-test 2022-09-26 13:23:00 +02:00
Antonio Andelic
6f4a636e8f Remove wildcard 2022-09-26 11:21:53 +00:00
Alexey Milovidov
62ebf397d2
Merge pull request #41610 from ClickHouse/upgrade-arm-requirement 
Bump minimum required ARM ISA to v8.2 and add v8.0 compat build
 2022-09-26 14:08:48 +03:00
Antonio Andelic
8fde8b2c56 Try with multiple calls 2022-09-26 11:03:24 +00:00
Antonio Andelic
c60d9db687
Merge branch 'master' into ignore-attach-thread-keeper-errors 2022-09-26 08:38:48 +02:00
Antonio Andelic
5ff1bcd553
Merge branch 'master' into collect-correctly-logs-in-stress-test 2022-09-26 08:38:38 +02:00
alesapin
34d9794ab7
Merge pull request #41653 from ClickHouse/investigating_more_bugs 
Add very explicit logging on disk choice for fetch
 2022-09-24 16:15:02 +02:00
alesapin
06e0f554d8 Fix fetch to local disk 2022-09-23 16:46:53 +02:00
robot-clickhouse
8d2052307e Update version_date.tsv and changelogs after v22.9.2.7-stable 2022-09-23 11:53:04 +00:00
Antonio Andelic
1d93c56d1a Collect logs using clickhouse-local 2022-09-23 10:54:16 +00:00
Antonio Andelic
a17a3e1de1 Ignore Keeper hardware errors 2022-09-23 08:23:57 +00:00
Yakov Olkhovskiy
339aee2c89
do not fail if keys not present 2022-09-22 09:44:44 -04:00
Robert Schulze
bcaa66c804
Add arm-v80compat builds 2022-09-21 13:09:24 +00:00
Mikhail f. Shiryaev
34b9861991
Merge pull request #41531 from ClickHouse/deb-source 
Add deb Source for packages
 2022-09-20 10:19:50 +02:00
BoloniniD
4f2915c8f7 Fix aarch64-darwin build 2022-09-19 21:52:57 +03:00
Mikhail f. Shiryaev
5d8b8a7db6
Add deb Source for packages 2022-09-19 20:42:02 +02:00
Antonio Andelic
0f92e5e576 Add option for loading only system tables from path using clickhouse-local 2022-09-19 14:18:42 +00:00
BoloniniD
5b4fb4bf66
Merge branch 'master' into BLAKE3 2022-09-18 23:14:37 +03:00
BoloniniD
7b5d3e3d82 Fix Rust installation for Corrosion 2022-09-18 23:14:16 +03:00
BoloniniD
627dea333e Merge branch 'master' into BLAKE3 2022-09-17 22:14:30 +03:00
Alexey Milovidov
ecfd8cb5a6 Remove trash error message from integration tests 2022-09-17 20:24:56 +02:00
BoloniniD
452ef4435b Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-09-16 20:05:56 +03:00
Alexey Milovidov
da01982652
Merge pull request #41046 from azat/build/llvm-15 
Switch to llvm/clang 15
 2022-09-16 07:31:06 +03:00
BoloniniD
0df426d329 Corrosion fixes + review fixes 2022-09-16 00:05:21 +03:00
Nikita Taranov
def4eeac70
Fix perf tests (#41332) 
We run left server two times. If after the first run server will not be properly stopped, we will get `Address already in use: [::]:9001` exception on the second run.
 2022-09-15 12:27:08 +02:00
Mikhail f. Shiryaev
dbe919e992
Update server Dockerfiles to the latest version 2022-09-13 15:55:23 +02:00
Kseniia Sumarokova
b2c9c04c7b
Merge pull request #40821 from kssenii/improve-marks-cache-loading 
Allow to load marks in threadpool in advance
 2022-09-13 12:31:58 +02:00
Kseniia Sumarokova
6ebd68e600
Merge pull request #41244 from ClickHouse/create-directories-metadata-path 
Create directories for `metadata_path`s in container
 2022-09-13 12:06:22 +02:00
Nikita Mikhaylov
51c29ae772 Done 2022-09-12 21:39:16 +00:00
kssenii
46f74aaba9 Update stress/run.sh 2022-09-12 20:10:35 +02:00
BoloniniD
fe239e7ee9 Fix style + free err_msg before throwing exception 2022-09-12 18:46:54 +03:00
Kseniia Sumarokova
49e0b1316d
Merge pull request #41144 from ClickHouse/bump_minio_version 
Bump minio version in tests
 2022-09-12 13:55:14 +02:00
Azat Khuzhin
ced30a2072 Switch to llvm/clang 15 
It had been released few hours ago, and I want to check how clang-15
generates DWARF-5

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-09-10 21:38:34 +02:00
Igor Nikonov
06070fe0ae
Merge branch 'master' into fix_int8_test_standalone_keeper_mode 2022-09-09 22:03:02 +02:00
Alexander Tokmakov
e77b9e4d0c
Merge pull request #40775 from azat/ci/core-dumps-rework 
Rework core collecting on CI (eliminate gcore usage)
 2022-09-09 20:20:10 +03:00
alesapin
e904822051 Bump minio version in tests 2022-09-09 16:54:03 +02:00
Igor Nikonov
dbfb448290 Fix: integration test, standalone keeper mode 
There is logic regarding which keeper binary use to start keeper cluster in an integration test
There 2 options:
(1) standalone keeper binary (expected binary name clickhouse-keeper)
(2) clickhouse binary with keeper inside

Fixed:
- option (1) didn't work since docker_compose_keeper.yaml didn't create
target clickhouse-keeper at all
- if clickhouse-keeper existed, option (1) was taken but
  clickhouse-keeper could be just a link to clickhouse binary (the link
  is created always during build if cmake option BUILD_STANDALONE_KEEPER is OFF)
 2022-09-09 14:51:34 +00:00
BoloniniD
e8bcbcd016
Merge branch 'master' into BLAKE3 2022-09-09 11:48:31 +03:00
Robert Schulze
9d4de0cbaa
Merge pull request #40999 from ClickHouse/sse2-special-build 
Add special x86-SSE2-only build
 2022-09-08 09:06:29 +02:00
Robert Schulze
652f1bfd19
fix: pass -DNO_SSE3_OR_HIGHER=1 from packager 2022-09-06 12:18:11 +00:00
Robert Schulze
1ebcc3a14e
fix: endswidth --> endswith 2022-09-06 07:41:37 +00:00
Alexey Milovidov
7776512b04
Merge pull request #41002 from azat/ci/fix-oom-check 
ci/stress: clear dmesg before run to fix "OOM in dmesg" check
 2022-09-06 06:41:36 +03:00
Alexander Tokmakov
b264be3c63
Merge branch 'master' into zookeeper_client_fault_injection 2022-09-05 22:13:09 +03:00
Robert Schulze
438ed368a1
fix: correct compiler parsing 2022-09-05 17:49:40 +00:00
Robert Schulze
401747eaa7
Merge branch 'master' into sse2-special-build 2022-09-05 16:17:20 +02:00
Azat Khuzhin
2724b67537 ci/stress: clear dmesg before run to fix "OOM in dmesg" check 
CI: https://s3.amazonaws.com/clickhouse-test-reports/40772/afa137ae2b6108e72c2d6e43556a04548afa2ea9/stress_test__ubsan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-09-05 15:51:36 +02:00
Kseniia Sumarokova
e12858dca5
Merge pull request #36837 from ClickHouse/stress_s3 
Trying stress on top of S3
 2022-09-05 15:12:55 +02:00
Robert Schulze
e1def723f8
Add special x86-SSE2-only build 2022-09-05 12:51:44 +00:00
Alexander Tokmakov
abffd4595e
Merge branch 'master' into zookeeper_client_fault_injection 2022-09-05 15:03:26 +03:00
Alexey Milovidov
d20d49f39f
Merge pull request #40958 from arenadata/ADQM-566 
stylecheck renewed and version in docker set explicitely
 2022-09-05 03:23:38 +03:00
Nikita Mikhaylov
f621bd0055
Delete old cache directories creation from entrypoint (#40946) 2022-09-04 23:54:05 +02:00
Alexey Milovidov
b2a2217e57
Merge pull request #40969 from ClickHouse/remove-trash-2 
Remove trash
 2022-09-05 00:35:32 +03:00
alesapin
45b1f9dc41
Merge branch 'master' into stress_s3 2022-09-04 23:17:10 +02:00
Azat Khuzhin
25e3bebd9d Rework core collecting on CI (eliminate gcore usage) 
gcore is a gdb command, that internally uses gdb to dump the core.

However with proper configuration of limits (core_dump.size_limit) it
should not be required, althought some issues is possible:
- non standard kernel.core_pattern
- sanitizers

So yes, gcore is more "universal" (you don't need to configure any
`kernel_pattern`), but it is ad-hoc, and it has drawbacks -
**it does not work when gdb fails**. For example gdb may fail with
`Dwarf Error: DW_FORM_strx1 found in non-DWO CU` in case of DWARF-5 [1].

  [1]: https://github.com/ClickHouse/ClickHouse/pull/40772#issuecomment-1236331323.

Let's try to switch to more native way.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-09-04 22:07:16 +02:00
Azat Khuzhin
64f95710cd ci: add symlink for llvm-symbolizer (to make symbolizer work) 
Simply installing llvm-symbolizer-$VER is not enough, since it does not
contain proper symblink, while LLVM is looking only for
"llvm-symbolizer" (without version) - [1]:

  [1]:
c444af1c20/compiler-rt/lib/sanitizer_common/sanitizer_symbolizer_posix_libcdep.cpp (L454)

Follow-up for: #40655
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-09-04 14:03:34 +02:00
Alexey Milovidov
c4adc9ed8f Remove trash 2022-09-04 04:28:08 +02:00
Ilya Golshtein
74561b40ae stylecheck renewed 2022-09-02 17:42:18 +03:00
Alexander Tokmakov
8bdb589c2b Merge branch 'master' into zookeeper_client_fault_injection 2022-08-29 13:34:57 +02:00
alesapin
133ca01447 Merge branch 'master' into stress_s3 2022-08-29 11:25:28 +02:00
Alexey Milovidov
7bd1142f63
Merge pull request #40647 from ClickHouse/high-level-coverage 
Report high-level function and data types test coverage
 2022-08-27 23:13:10 +03:00
Alexey Milovidov
f86242c17e
Merge pull request #40699 from ClickHouse/remove-unbundled 
Remove the remaining parts of "unbundled" build
 2022-08-27 21:54:42 +03:00
Alexey Milovidov
00afbadb53
Merge branch 'master' into high-level-coverage 2022-08-27 19:34:26 +03:00
Azat Khuzhin
ebc61a36e0 tests/stress: improve OOM detection (add separate check by dmesg) 
Right now if you will look at the OOM errors:
- OOM killer (or signal 9) in clickhouse-server.log
- Backward compatibility check: OOM messages in clickhouse-server.log

Most of them are not real, but just clickhouse server got KILLed by
clickhouse stop, #40678 may imporove the situation, but to definitely
sure that there was OOM let's look at dmesg.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-08-27 12:46:58 +02:00
Alexey Milovidov
91ed3ebe9a Remove the remaining parts of "unbundled" build 2022-08-27 02:18:47 +02:00
Alexey Milovidov
2a7d9f0778 Merge branch 'master' into high-level-coverage 2022-08-26 23:44:52 +02:00
Azat Khuzhin
3b519c5d44 tests/stress: capture stacktrace of server hungs if pid was removed already 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-08-26 22:06:32 +03:00
Alexander Tokmakov
a3f7d1a5cc
Merge pull request #40662 from ClickHouse/tavplubix-patch-3 
Remove garbage from runlog.log in functional tests
 2022-08-26 17:01:31 +03:00
Alexander Tokmakov
263c467d90
Update setup_hdfs_minicluster.sh 2022-08-26 14:09:42 +03:00
Alexander Tokmakov
76e3ab8c59
Update setup_hdfs_minicluster.sh 2022-08-26 13:33:12 +03:00
alesapin
704c4b2c5b Stop thread fuzzer on shutdown 2022-08-26 11:54:54 +02:00
Azat Khuzhin
ce88c7cb60 Add llvm-15 for llvm-symbolizer-15 for clang-15 (used for TSan) 
Simply installing llvm-15 over TSAN_SYMBOLIZER_PATH had been prefered
(to keep everything in one place and as simple as possible), though
TSAN_SYMBOLIZER_PATH should also work.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-08-26 09:28:42 +02:00
Alexey Milovidov
440d10370a Report high-level function test coverage 2022-08-26 01:59:14 +02:00
alesapin
3ff6489fae Merge branch 'master' into stress_s3 2022-08-25 13:14:58 +02:00
alesapin
ad692f732a Merge branch 'master' into stress_s3 2022-08-25 13:13:30 +02:00
alesapin
35f9815b8e Fix backward comp check 2022-08-24 14:43:02 +02:00
Alexey Milovidov
35ce19ab63
Merge pull request #40354 from azat/tests/stress-dmesg-v3 
tests/stress: use --privileged over --cap-add syslog to obtain dmesg
 2022-08-20 14:13:55 +03:00
Alexey Milovidov
40ed829a29
Merge pull request #40074 from HeenaBansal2009/Entrypoint_Issue 
Entrypoint to check for HTTPS_PORT if http_port is disabled.
 2022-08-20 02:40:20 +03:00
Nikita Taranov
9f1ee52b00
Run all queries from changed perf tests (#40322) 
* impl

* fix
 2022-08-19 19:46:07 +02:00
Azat Khuzhin
50bddc43dc tests/stress: ignore NETLINK_ERROR from checkPermissionsImpl 
Since now with --privileged it has CAP_SYS_ADMIN and tries to
communicate via netlink.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-08-19 14:07:06 +02:00
Alexander Tokmakov
3d253ec51b
Merge branch 'master' into zookeeper_client_fault_injection 2022-08-18 21:23:50 +03:00
alesapin
922818bbd9 Merge branch 'stress_s3' of github.com:ClickHouse/ClickHouse into stress_s3 2022-08-18 14:46:50 +02:00
alesapin
932ea146f5 Merge branch 'master' into stress_s3 2022-08-18 13:14:47 +02:00
alesapin
86b1e33eed Disable cache on writes 2022-08-17 19:00:53 +02:00
alesapin
600d22851f Grep dangerous S3 errors 2022-08-17 12:43:11 +02:00
alesapin
0433b801d2 Configure properly 2022-08-17 12:27:15 +02:00
Alexander Tokmakov
ae000e9125
Merge branch 'master' into zookeeper_client_fault_injection 2022-08-17 12:48:54 +03:00
alesapin
1ec6627a70 Fix tables creation 2022-08-16 18:28:17 +02:00
kssenii
52832ea788 May be fix database replicated check 2022-08-16 11:51:57 +02:00
kssenii
eb26b219b9 Merge master 2022-08-16 00:56:27 +02:00
Alexander Tokmakov
589c3408d2
Merge pull request #40234 from ClickHouse/better_message_on_restore_covered 
Better error message when restoring covered parts
 2022-08-15 22:01:48 +03:00
alesapin
243bd492fa Trying to fix it 2022-08-15 20:55:11 +02:00
alesapin
96722a13bb Merge branch 'master' into stress_s3 2022-08-15 20:20:31 +02:00
Alexander Tokmakov
edaff70010 better error message when restoring covered parts 2022-08-15 13:53:14 +02:00
Alexey Milovidov
5ce6c07005 Set linker for RISC-V 64 2022-08-14 05:57:55 +02:00
Alexey Milovidov
6b8f4f1d59 Merge branch 'master' into server-side-time 2022-08-12 21:36:40 +02:00
Alexander Tokmakov
46aaf842f8
Merge pull request #40031 from ClickHouse/fix_old_tmp_dirs_cleanup 
Fix old temporary directories cleanup
 2022-08-12 20:31:20 +03:00
Alexander Tokmakov
b3deae3593
Merge branch 'master' into flaky_check_ordinary 2022-08-12 18:11:39 +03:00
Alexey Milovidov
8c3d1f2b5b
Merge branch 'master' into server-side-time 2022-08-12 17:40:02 +03:00
Alexander Tokmakov
467ef7bbc2
Update run.sh 2022-08-12 14:30:18 +03:00
kssenii
768a207176 Merge master 2022-08-11 22:25:53 +02:00
Alexander Tokmakov
06e42a1b23 run tests with Ordinary database in flaky check 2022-08-11 21:32:03 +02:00
Heena Bansal
7779ac4707
Update entrypoint.sh 
Typo error.
 2022-08-11 12:01:05 -04:00
HeenaBansal2009
f9347aa9ec Merge branch 'Entrypoint_Issue' of github.com:HeenaBansal2009/ClickHouse into Entrypoint_Issue 2022-08-11 06:51:16 -07:00
HeenaBansal2009
8880171899 Add --no-check-certificate in wget 2022-08-11 06:49:45 -07:00
Alexander Tokmakov
b9d18182f2 fix 2022-08-11 15:27:26 +02:00
Anton Popov
0ba886f763 enable fuzzing of table definitions 2022-08-11 12:24:15 +00:00
Maksim Kita
627424889d
Merge pull request #39926 from azat/dict-prom-fix 
Remove dictionaries from prometheus metrics on DETACH/DROP
 2022-08-11 13:10:47 +02:00
Alexey Milovidov
c54985ff71
Update entrypoint.sh 2022-08-11 09:46:24 +03:00
Heena Bansal
fd03038722
Merge branch 'master' into Entrypoint_Issue 2022-08-11 00:10:45 -04:00
HeenaBansal2009
653ad05ce9 Addresed review comments 2022-08-10 21:10:01 -07:00
Anton Popov
e347fa2f45 add fuzzer for table definition 2022-08-11 02:34:10 +00:00
Alexey Milovidov
c323f64804 Fix Fasttest 2022-08-11 03:29:46 +02:00
HeenaBansal2009
0d2aa07b4d Updated entrypoint.sh to listen on https_port if defined 2022-08-10 11:30:06 -07:00
HeenaBansal2009
3658530088 Updated entrypoint.sh to listen on https_port if defined 2022-08-10 11:23:15 -07:00
Alexander Tokmakov
bb46bfa6d9
Update process_functional_tests_result.py 2022-08-10 21:20:52 +03:00
Alexey Milovidov
cbeba683d8
Merge pull request #40017 from ClickHouse/ci-self-extracting-s3-deployment-2 
copy self-extracting to output
 2022-08-10 21:10:23 +03:00
Alexey Milovidov
774ba4db23 Remove old code 2022-08-10 19:44:13 +02:00
Alexey Milovidov
7aff85fc79 Fix test Dockerfile 2022-08-10 19:41:29 +02:00
kssenii
5c3227ba56 Merge master 2022-08-10 12:00:34 +02:00
kssenii
0dda03c94b Fix checks 2022-08-10 00:06:58 +02:00
Alexey Milovidov
f7d995681b
Merge branch 'master' into replace-yandex-to-noto 2022-08-09 22:43:52 +03:00
Yakov Olkhovskiy
09e6b1a497
run clickhouse to decompress 2022-08-09 09:16:03 -04:00
Yakov Olkhovskiy
78cc2a970d
copy self-extracting to output 2022-08-09 02:40:17 -04:00
Alexander Tokmakov
3bc583c22b
Revert "copy self-extracting to output" 2022-08-08 20:13:40 +03:00
Alexey Milovidov
0921548a37
Merge pull request #39527 from pkit/pkit/fix_nats_tls 
fix nats-io TLS support
 2022-08-08 08:28:14 +03:00
Alexey Milovidov
0349d9da96 Change font in CI reports just in case (might be worse) 2022-08-08 07:25:29 +02:00
Alexey Milovidov
cb7f072fe8
Merge pull request #39617 from ClickHouse/ci-self-extracting-s3-deployment 
copy self-extracting to output
 2022-08-08 08:19:15 +03:00
kssenii
e81f85a79e Fix checks 2022-08-07 16:44:02 +02:00
Yakov Olkhovskiy
19d74d7871
Merge branch 'master' into ci-self-extracting-s3-deployment 2022-08-07 07:24:22 -04:00
BoloniniD
24f3b00193
Merge branch 'master' into BLAKE3 2022-08-06 19:48:10 +03:00
Azat Khuzhin
791377e4dc tests: avoid prometheus.port overlap for replicated database 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-08-06 13:00:53 +03:00
Azat Khuzhin
3772415588 tests/stress: add dmesg output (to see OOM details) 
max_server_memory_usage already set to 75%, so OOM should not happens,
the reason is that because RSS does not match with memory tracker
statistics:

    2022.08.05 12:36:57.869896 [ 82524 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 64.69 GiB, peak 65.26 GiB, will set to 62.80 GiB (RSS), difference: -1.89 GiB
    ...
    2022.08.05 12:37:00.213440 [ 82334 ] {} <Error> void DB::MergeTreeBackgroundExecutor<DB::MergeMutateRuntimeQueue>::routine(DB::TaskRuntimeDataPtr) [Queue = DB::MergeMutateRuntimeQueue]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 64.68 GiB (attempt to allocate chunk of 1298794 bytes), maximum: 51.44 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or orvercommit denominator are set to zero.. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-08-06 12:34:38 +03:00
Alexey Milovidov
20fdc5b77b
Merge pull request #39898 from pkit/pkit/fix_mkdir_nfs 
fix broken NFS mkdir introduced in #36341
 2022-08-06 01:54:57 +03:00
kssenii
9685f9a8b7 Fix checks 2022-08-05 22:16:33 +02:00
Yakov Olkhovskiy
4c78f0fc7d
Merge branch 'master' into ci-self-extracting-s3-deployment 2022-08-05 08:14:48 -04:00
kssenii
91f4143b6e Merge master 2022-08-05 12:14:08 +02:00
Constantine Peresypkin
10c76917ea fix nats-io TLS support 
nats-io library needs `NATS_HAS_TLS` define to correctly compile-in TLS
support

fixes #39525
 2022-08-05 11:20:05 +02:00
Ilya Yatsishin
e583345987
Merge pull request #38978 from qoega/integration-tests-7 2022-08-05 07:21:18 +02:00