Commit Graph

3823 Commits

Author SHA1 Message Date
Yatsishin Ilya
3ab23ef3f2 Merge remote-tracking branch 'origin/master' into revive-sqlancer 2022-10-28 07:21:39 +00:00
Alexander Tokmakov
86b81a2b6f
Merge pull request #42234 from arthurpassos/fix_ares_fd_process_race_condition
Fix c-ares crash
2022-10-27 17:17:22 +03:00
Yatsishin Ilya
3a19752d54 style 2022-10-27 14:08:23 +00:00
Yatsishin Ilya
8a5ef517e3 style 2022-10-27 13:30:35 +00:00
Antonio Andelic
1db9888508 Merge branch 'master' into jepen-multiple-tests 2022-10-27 09:06:51 +00:00
Yatsishin Ilya
d8e8dd006f support server fail 2022-10-27 09:06:11 +00:00
Yatsishin Ilya
ccc515bebd Merge remote-tracking branch 'origin/master' into revive-sqlancer 2022-10-27 07:13:28 +00:00
robot-clickhouse
42f5a3b2f8
Update version_date.tsv and changelogs after v22.10.1.1877-stable 2022-10-26 15:39:34 +02:00
robot-clickhouse
117674c0ce Update version_date.tsv and changelogs after v22.10.1.1875-stable 2022-10-26 08:48:12 +00:00
Yatsishin Ilya
8e77180968 Merge remote-tracking branch 'origin/master' into revive-sqlancer 2022-10-26 08:31:00 +00:00
Yatsishin Ilya
c89c14a05d add NoREC 2022-10-25 10:34:55 +00:00
Alexey Milovidov
c48127534b
Merge pull request #41753 from pkit/morton_coding
add Morton Coding (ZCurve)
2022-10-25 06:10:37 +02:00
Alexey Milovidov
4f582e19a8
Merge pull request #42479 from ClickHouse/Avogar-patch-1
Add error "Destination table is myself" to exception list in BC check
2022-10-25 04:55:12 +02:00
Alexey Milovidov
c4fd827442
Merge pull request #42483 from ClickHouse/Avogar-patch-2
Get current clickhouse version without sending query in BC check
2022-10-25 04:54:24 +02:00
Alexey Milovidov
d0a7f855ef
Update docker/server/Dockerfile.ubuntu
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2022-10-25 05:32:11 +03:00
Alexey Milovidov
1d40578809 Remove cruft from Docker 2022-10-24 18:35:56 +02:00
Antonio Andelic
5bc9be8a5f Start defining tests for server 2022-10-24 15:04:57 +00:00
Alexander Gololobov
5ec9b35bbb
Merge pull request #42585 from azat/ci/stress/hung-check-fix
ci/stress: fix memory limits overrides for hung check
2022-10-24 13:45:56 +02:00
Mikhail f. Shiryaev
a29ece3bb8
Merge pull request #42349 from azat/packages/archlinux
Use nfpm packager for archlinux packages
2022-10-24 10:26:24 +02:00
Yatsishin Ilya
15b6de2aae Merge remote-tracking branch 'origin/master' into revive-sqlancer 2022-10-24 08:26:01 +00:00
Azat Khuzhin
f0aed68893 ci/stress: fix memory limits overrides for hung check
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-22 20:53:18 +02:00
Alexey Milovidov
5fd7409ce1
Merge branch 'master' into morton_coding 2022-10-22 04:39:13 +02:00
Alexander Tokmakov
77ea58d539
Update run-fuzzer.sh 2022-10-21 17:58:20 +03:00
Arthur Passos
50f9acb221
Merge branch 'master' into fix_ares_fd_process_race_condition 2022-10-20 13:35:58 -03:00
Yatsishin Ilya
ab41c8e8ce black 2022-10-19 17:16:41 +00:00
Yatsishin Ilya
7d90d54af8 better reporting 2022-10-19 17:02:49 +00:00
Yatsishin Ilya
5121e9b096 update docker scripts 2022-10-19 16:30:01 +00:00
Alexander Tokmakov
f958c155f3
Merge branch 'master' into fixes_for_replicated_merge_tree2 2022-10-19 17:25:24 +03:00
Antonio Andelic
10b176fe19
Merge pull request #41854 from azat/tests/stress/fix-dbg-sym-bc
tests: fix debug symbols (and possible crashes) for backward compatiblity check
2022-10-19 16:18:41 +02:00
Constantine Peresypkin
5b3b11b517 add Morton Coding (ZCurve) 2022-10-19 15:59:25 +02:00
Kruglov Pavel
2ca0d37e83
Get current clickhouse version without sending query in BC check 2022-10-19 13:25:03 +02:00
Kruglov Pavel
632965212f
Add error "Destination table is myself" to exception list in BC check 2022-10-19 12:52:32 +02:00
Azat Khuzhin
043c4163f4 Use nfpm packager for archlinux packages
Since nfpm v2.20.0 it can build packages for archlinux [1].

  [1]: https://github.com/goreleaser/nfpm/pull/543

Something like this:

    $ mkdir -p /src/packages/root
    $ cmake -DCMAKE_INSTALL_PREFIX=/usr /src
    $ DESTDIR=/src/packages/root ninja install
    $ cd /src/packages
    $ ./build --archlinux

    $ root@s3:/src/packages# ./build --archlinux
    Current version is 22.10.1.1
    Building archlinux package for clickhouse-client.yaml
    using archlinux packager...
    created package: /src/clickhouse-client-22.10.1.1-1-x86_64.pkg.tar.zst
    ...

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-18 18:33:48 +03:00
Azat Khuzhin
fb6474c35b Add a comment about MAKE_* env vars
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-18 18:33:48 +03:00
Azat Khuzhin
7893ff0785 Update woboq_codebrowser location
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-18 17:31:15 +02:00
Alexander Tokmakov
ea77ff9022 Merge branch 'master' into fixes_for_replicated_merge_tree2 2022-10-18 17:25:25 +02:00
Yatsishin Ilya
b8193a0eb3 one more time 2022-10-17 17:42:18 +00:00
Yatsishin Ilya
6f26816d4f fix 2022-10-17 16:31:19 +00:00
Yatsishin Ilya
7a74792c1b shellcheck 2022-10-17 16:30:36 +00:00
Yatsishin Ilya
aa432fe95a staging 2022-10-17 15:20:20 +00:00
Yatsishin Ilya
6a82d54314 add CI files 2022-10-17 14:46:50 +00:00
Yatsishin Ilya
9320ae1abf update sqlancer docker files 2022-10-17 13:10:31 +00:00
Azat Khuzhin
a0ceef48da Add a workaround for "The imported target "merge-fdata" references the file" error
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-17 12:29:59 +02:00
Azat Khuzhin
f7b2addae9 Bump llvm/clang to 15.0.2
Otherwise right now codebrowser image is broken [1], due to changes in
cmake:

    #10 1.607 CMake Error at /usr/lib/llvm-15/lib/cmake/llvm/LLVMExports.cmake:1693 (message):
    #10 1.607   The imported target "merge-fdata" references the file
    #10 1.607
    #10 1.607      "/usr/lib/llvm-15/bin/merge-fdata"

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/42349/36502270eb9f195dcd2dc8b350db9367c619f0f8/push_to_dockerhub_amd64.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-17 12:29:59 +02:00
Arthur Passos
6d22bb78e0 custom py script in integ tests 2022-10-14 12:39:08 -03:00
Alexander Tokmakov
dc99e67d3f
Update run-fuzzer.sh 2022-10-14 17:45:17 +03:00
Alexey Milovidov
aa9e8f1cde
Merge branch 'master' into new-http-compression-methods 2022-10-05 23:07:01 +03:00
Nikolay Degterinsky
c0497ddf36 Add lz4 to the stateless tests image 2022-10-05 06:45:21 +00:00
Anton Popov
8ca73eab03
Merge branch 'master' into fuzz-table-definitions 2022-10-04 15:10:31 +02:00
Vitaly Baranov
65c61877c7
Merge pull request #33435 from BoloniniD/BLAKE3
Integrating Rust code into ClickHouse
2022-10-03 15:25:06 +02:00
Alexander Tokmakov
4211605093 disable zk fault injections in bc check 2022-10-03 13:13:29 +02:00
Robert Schulze
5d15d28843
Fix warning that ENABLE_REPLXX is unused
- 3rd party lib replxx is mandatory since #37719
- remove the corresponding CMake switch from the fasttest build
2022-10-03 08:36:23 +00:00
BoloniniD
3a3ca51980 Fixes after review 2022-10-02 20:52:05 +03:00
Mikhail f. Shiryaev
26eee5c113
Merge pull request #41956 from ClickHouse/auto/v22.9.3.18-stable
Update version_date.tsv and changelogs after v22.9.3.18-stable
2022-09-30 19:23:47 +02:00
BoloniniD
fe7b2fdf6e
Merge branch 'master' into BLAKE3 2022-09-30 18:51:31 +03:00
robot-clickhouse
42760b577a Update version_date.tsv and changelogs after v22.9.3.18-stable 2022-09-29 23:35:12 +00:00
BoloniniD
55c79230b3 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-09-29 23:53:25 +03:00
Alexander Tokmakov
8741785a72 temporarily disable ThreadFuzzer with tsan 2022-09-29 18:08:35 +02:00
Anton Popov
4ac5df2540 drop all fuzzed tables 2022-09-28 14:52:10 +00:00
filimonov
952d546a7c
Better logging for docs builder
CI=true is not pushed from github actions inside container, so it can use some fancy console output formats which may accidentally suppress the docusaurus output, makind the real error not visible in CI report (see https://github.com/ClickHouse/ClickHouse/pull/41254#issuecomment-1259275622 )
2022-09-28 16:19:06 +02:00
Anton Popov
c8beae8237 Merge remote-tracking branch 'upstream/master' into HEAD 2022-09-28 12:47:02 +00:00
Azat Khuzhin
9b20468198 tests: fix debug symbols (and possible crashes) for backward compatiblity check
stress running previous version of the server w/o correct debug symbols
right now, since nobody restore clickhouse.debug file, and this can lead
to the following issues, like in [1]:
- incorrect stack traces
- gdb crashes
- clickhouse crashes, due to non-robust internal DWARF parser (probably)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/41730/8cc53a48ae99a765085f44a75fa49314d1f1cc7d/stress_test__ubsan_.html

Right now I decided not to rework the script to make it less error
prone, but simply fix the problem.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-27 22:50:28 +02:00
alesapin
69f3a66538 Keep the most important log in stress tests 2022-09-27 11:16:10 +02:00
Antonio Andelic
97cf045203
Merge pull request #41721 from ClickHouse/collect-correctly-logs-in-stress-test
Collect logs in Stress test using clickhouse-local
2022-09-27 08:43:44 +02:00
Antonio Andelic
eb78761a7e Collect necessary 2022-09-26 16:30:01 +00:00
Antonio Andelic
9c24929c06
Merge branch 'master' into ignore-attach-thread-keeper-errors 2022-09-26 14:12:54 +02:00
Antonio Andelic
562b214799
Merge branch 'master' into collect-correctly-logs-in-stress-test 2022-09-26 13:23:00 +02:00
Antonio Andelic
6f4a636e8f Remove wildcard 2022-09-26 11:21:53 +00:00
Alexey Milovidov
62ebf397d2
Merge pull request #41610 from ClickHouse/upgrade-arm-requirement
Bump minimum required ARM ISA to v8.2 and add v8.0 compat build
2022-09-26 14:08:48 +03:00
Antonio Andelic
8fde8b2c56 Try with multiple calls 2022-09-26 11:03:24 +00:00
Antonio Andelic
c60d9db687
Merge branch 'master' into ignore-attach-thread-keeper-errors 2022-09-26 08:38:48 +02:00
Antonio Andelic
5ff1bcd553
Merge branch 'master' into collect-correctly-logs-in-stress-test 2022-09-26 08:38:38 +02:00
alesapin
34d9794ab7
Merge pull request #41653 from ClickHouse/investigating_more_bugs
Add very explicit logging on disk choice for fetch
2022-09-24 16:15:02 +02:00
alesapin
06e0f554d8 Fix fetch to local disk 2022-09-23 16:46:53 +02:00
robot-clickhouse
8d2052307e Update version_date.tsv and changelogs after v22.9.2.7-stable 2022-09-23 11:53:04 +00:00
Antonio Andelic
1d93c56d1a Collect logs using clickhouse-local 2022-09-23 10:54:16 +00:00
Antonio Andelic
a17a3e1de1 Ignore Keeper hardware errors 2022-09-23 08:23:57 +00:00
Yakov Olkhovskiy
339aee2c89
do not fail if keys not present 2022-09-22 09:44:44 -04:00
Robert Schulze
bcaa66c804
Add arm-v80compat builds 2022-09-21 13:09:24 +00:00
Mikhail f. Shiryaev
34b9861991
Merge pull request #41531 from ClickHouse/deb-source
Add deb Source for packages
2022-09-20 10:19:50 +02:00
BoloniniD
4f2915c8f7 Fix aarch64-darwin build 2022-09-19 21:52:57 +03:00
Mikhail f. Shiryaev
5d8b8a7db6
Add deb Source for packages 2022-09-19 20:42:02 +02:00
Antonio Andelic
0f92e5e576 Add option for loading only system tables from path using clickhouse-local 2022-09-19 14:18:42 +00:00
BoloniniD
5b4fb4bf66
Merge branch 'master' into BLAKE3 2022-09-18 23:14:37 +03:00
BoloniniD
7b5d3e3d82 Fix Rust installation for Corrosion 2022-09-18 23:14:16 +03:00
BoloniniD
627dea333e Merge branch 'master' into BLAKE3 2022-09-17 22:14:30 +03:00
Alexey Milovidov
ecfd8cb5a6 Remove trash error message from integration tests 2022-09-17 20:24:56 +02:00
BoloniniD
452ef4435b Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-09-16 20:05:56 +03:00
Alexey Milovidov
da01982652
Merge pull request #41046 from azat/build/llvm-15
Switch to llvm/clang 15
2022-09-16 07:31:06 +03:00
BoloniniD
0df426d329 Corrosion fixes + review fixes 2022-09-16 00:05:21 +03:00
Nikita Taranov
def4eeac70
Fix perf tests (#41332)
We run left server two times. If after the first run server will not be properly stopped, we will get `Address already in use: [::]:9001` exception on the second run.
2022-09-15 12:27:08 +02:00
Mikhail f. Shiryaev
dbe919e992
Update server Dockerfiles to the latest version 2022-09-13 15:55:23 +02:00
Kseniia Sumarokova
b2c9c04c7b
Merge pull request #40821 from kssenii/improve-marks-cache-loading
Allow to load marks in threadpool in advance
2022-09-13 12:31:58 +02:00
Kseniia Sumarokova
6ebd68e600
Merge pull request #41244 from ClickHouse/create-directories-metadata-path
Create directories for `metadata_path`s in container
2022-09-13 12:06:22 +02:00
Nikita Mikhaylov
51c29ae772 Done 2022-09-12 21:39:16 +00:00
kssenii
46f74aaba9 Update stress/run.sh 2022-09-12 20:10:35 +02:00
BoloniniD
fe239e7ee9 Fix style + free err_msg before throwing exception 2022-09-12 18:46:54 +03:00
Kseniia Sumarokova
49e0b1316d
Merge pull request #41144 from ClickHouse/bump_minio_version
Bump minio version in tests
2022-09-12 13:55:14 +02:00
Azat Khuzhin
ced30a2072 Switch to llvm/clang 15
It had been released few hours ago, and I want to check how clang-15
generates DWARF-5

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Igor Nikonov
06070fe0ae
Merge branch 'master' into fix_int8_test_standalone_keeper_mode 2022-09-09 22:03:02 +02:00
Alexander Tokmakov
e77b9e4d0c
Merge pull request #40775 from azat/ci/core-dumps-rework
Rework core collecting on CI (eliminate gcore usage)
2022-09-09 20:20:10 +03:00
alesapin
e904822051 Bump minio version in tests 2022-09-09 16:54:03 +02:00
Igor Nikonov
dbfb448290 Fix: integration test, standalone keeper mode
There is logic regarding which keeper binary use to start keeper cluster in an integration test
There 2 options:
(1) standalone keeper binary (expected binary name clickhouse-keeper)
(2) clickhouse binary with keeper inside

Fixed:
- option (1) didn't work since docker_compose_keeper.yaml didn't create
target clickhouse-keeper at all
- if clickhouse-keeper existed, option (1) was taken but
  clickhouse-keeper could be just a link to clickhouse binary (the link
  is created always during build if cmake option BUILD_STANDALONE_KEEPER is OFF)
2022-09-09 14:51:34 +00:00
BoloniniD
e8bcbcd016
Merge branch 'master' into BLAKE3 2022-09-09 11:48:31 +03:00
Robert Schulze
9d4de0cbaa
Merge pull request #40999 from ClickHouse/sse2-special-build
Add special x86-SSE2-only build
2022-09-08 09:06:29 +02:00
Robert Schulze
652f1bfd19
fix: pass -DNO_SSE3_OR_HIGHER=1 from packager 2022-09-06 12:18:11 +00:00
Robert Schulze
1ebcc3a14e
fix: endswidth --> endswith 2022-09-06 07:41:37 +00:00
Alexey Milovidov
7776512b04
Merge pull request #41002 from azat/ci/fix-oom-check
ci/stress: clear dmesg before run to fix "OOM in dmesg" check
2022-09-06 06:41:36 +03:00
Alexander Tokmakov
b264be3c63
Merge branch 'master' into zookeeper_client_fault_injection 2022-09-05 22:13:09 +03:00
Robert Schulze
438ed368a1
fix: correct compiler parsing 2022-09-05 17:49:40 +00:00
Robert Schulze
401747eaa7
Merge branch 'master' into sse2-special-build 2022-09-05 16:17:20 +02:00
Azat Khuzhin
2724b67537 ci/stress: clear dmesg before run to fix "OOM in dmesg" check
CI: https://s3.amazonaws.com/clickhouse-test-reports/40772/afa137ae2b6108e72c2d6e43556a04548afa2ea9/stress_test__ubsan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-05 15:51:36 +02:00
Kseniia Sumarokova
e12858dca5
Merge pull request #36837 from ClickHouse/stress_s3
Trying stress on top of S3
2022-09-05 15:12:55 +02:00
Robert Schulze
e1def723f8
Add special x86-SSE2-only build 2022-09-05 12:51:44 +00:00
Alexander Tokmakov
abffd4595e
Merge branch 'master' into zookeeper_client_fault_injection 2022-09-05 15:03:26 +03:00
Alexey Milovidov
d20d49f39f
Merge pull request #40958 from arenadata/ADQM-566
stylecheck renewed and version in docker set explicitely
2022-09-05 03:23:38 +03:00
Nikita Mikhaylov
f621bd0055
Delete old cache directories creation from entrypoint (#40946) 2022-09-04 23:54:05 +02:00
Alexey Milovidov
b2a2217e57
Merge pull request #40969 from ClickHouse/remove-trash-2
Remove trash
2022-09-05 00:35:32 +03:00
alesapin
45b1f9dc41
Merge branch 'master' into stress_s3 2022-09-04 23:17:10 +02:00
Azat Khuzhin
25e3bebd9d Rework core collecting on CI (eliminate gcore usage)
gcore is a gdb command, that internally uses gdb to dump the core.

However with proper configuration of limits (core_dump.size_limit) it
should not be required, althought some issues is possible:
- non standard kernel.core_pattern
- sanitizers

So yes, gcore is more "universal" (you don't need to configure any
`kernel_pattern`), but it is ad-hoc, and it has drawbacks -
**it does not work when gdb fails**. For example gdb may fail with
`Dwarf Error: DW_FORM_strx1 found in non-DWO CU` in case of DWARF-5 [1].

  [1]: https://github.com/ClickHouse/ClickHouse/pull/40772#issuecomment-1236331323.

Let's try to switch to more native way.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-04 22:07:16 +02:00
Azat Khuzhin
64f95710cd ci: add symlink for llvm-symbolizer (to make symbolizer work)
Simply installing llvm-symbolizer-$VER is not enough, since it does not
contain proper symblink, while LLVM is looking only for
"llvm-symbolizer" (without version) - [1]:

  [1]:
c444af1c20/compiler-rt/lib/sanitizer_common/sanitizer_symbolizer_posix_libcdep.cpp (L454)

Follow-up for: #40655
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-04 14:03:34 +02:00
Alexey Milovidov
c4adc9ed8f Remove trash 2022-09-04 04:28:08 +02:00
Ilya Golshtein
74561b40ae stylecheck renewed 2022-09-02 17:42:18 +03:00
Alexander Tokmakov
8bdb589c2b Merge branch 'master' into zookeeper_client_fault_injection 2022-08-29 13:34:57 +02:00
alesapin
133ca01447 Merge branch 'master' into stress_s3 2022-08-29 11:25:28 +02:00
Alexey Milovidov
7bd1142f63
Merge pull request #40647 from ClickHouse/high-level-coverage
Report high-level function and data types test coverage
2022-08-27 23:13:10 +03:00
Alexey Milovidov
f86242c17e
Merge pull request #40699 from ClickHouse/remove-unbundled
Remove the remaining parts of "unbundled" build
2022-08-27 21:54:42 +03:00
Alexey Milovidov
00afbadb53
Merge branch 'master' into high-level-coverage 2022-08-27 19:34:26 +03:00
Azat Khuzhin
ebc61a36e0 tests/stress: improve OOM detection (add separate check by dmesg)
Right now if you will look at the OOM errors:
- OOM killer (or signal 9) in clickhouse-server.log
- Backward compatibility check: OOM messages in clickhouse-server.log

Most of them are not real, but just clickhouse server got KILLed by
clickhouse stop, #40678 may imporove the situation, but to definitely
sure that there was OOM let's look at dmesg.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-27 12:46:58 +02:00
Alexey Milovidov
91ed3ebe9a Remove the remaining parts of "unbundled" build 2022-08-27 02:18:47 +02:00
Alexey Milovidov
2a7d9f0778 Merge branch 'master' into high-level-coverage 2022-08-26 23:44:52 +02:00
Azat Khuzhin
3b519c5d44 tests/stress: capture stacktrace of server hungs if pid was removed already
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-26 22:06:32 +03:00
Alexander Tokmakov
a3f7d1a5cc
Merge pull request #40662 from ClickHouse/tavplubix-patch-3
Remove garbage from runlog.log in functional tests
2022-08-26 17:01:31 +03:00
Alexander Tokmakov
263c467d90
Update setup_hdfs_minicluster.sh 2022-08-26 14:09:42 +03:00
Alexander Tokmakov
76e3ab8c59
Update setup_hdfs_minicluster.sh 2022-08-26 13:33:12 +03:00
alesapin
704c4b2c5b Stop thread fuzzer on shutdown 2022-08-26 11:54:54 +02:00
Azat Khuzhin
ce88c7cb60 Add llvm-15 for llvm-symbolizer-15 for clang-15 (used for TSan)
Simply installing llvm-15 over TSAN_SYMBOLIZER_PATH had been prefered
(to keep everything in one place and as simple as possible), though
TSAN_SYMBOLIZER_PATH should also work.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-26 09:28:42 +02:00
Alexey Milovidov
440d10370a Report high-level function test coverage 2022-08-26 01:59:14 +02:00
alesapin
3ff6489fae Merge branch 'master' into stress_s3 2022-08-25 13:14:58 +02:00
alesapin
ad692f732a Merge branch 'master' into stress_s3 2022-08-25 13:13:30 +02:00
alesapin
35f9815b8e Fix backward comp check 2022-08-24 14:43:02 +02:00
Alexey Milovidov
35ce19ab63
Merge pull request #40354 from azat/tests/stress-dmesg-v3
tests/stress: use --privileged over --cap-add syslog to obtain dmesg
2022-08-20 14:13:55 +03:00
Alexey Milovidov
40ed829a29
Merge pull request #40074 from HeenaBansal2009/Entrypoint_Issue
Entrypoint to check for HTTPS_PORT if http_port is disabled.
2022-08-20 02:40:20 +03:00
Nikita Taranov
9f1ee52b00
Run all queries from changed perf tests (#40322)
* impl

* fix
2022-08-19 19:46:07 +02:00
Azat Khuzhin
50bddc43dc tests/stress: ignore NETLINK_ERROR from checkPermissionsImpl
Since now with --privileged it has CAP_SYS_ADMIN and tries to
communicate via netlink.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-19 14:07:06 +02:00
Alexander Tokmakov
3d253ec51b
Merge branch 'master' into zookeeper_client_fault_injection 2022-08-18 21:23:50 +03:00
alesapin
922818bbd9 Merge branch 'stress_s3' of github.com:ClickHouse/ClickHouse into stress_s3 2022-08-18 14:46:50 +02:00
alesapin
932ea146f5 Merge branch 'master' into stress_s3 2022-08-18 13:14:47 +02:00
alesapin
86b1e33eed Disable cache on writes 2022-08-17 19:00:53 +02:00
alesapin
600d22851f Grep dangerous S3 errors 2022-08-17 12:43:11 +02:00
alesapin
0433b801d2 Configure properly 2022-08-17 12:27:15 +02:00
Alexander Tokmakov
ae000e9125
Merge branch 'master' into zookeeper_client_fault_injection 2022-08-17 12:48:54 +03:00
alesapin
1ec6627a70 Fix tables creation 2022-08-16 18:28:17 +02:00
kssenii
52832ea788 May be fix database replicated check 2022-08-16 11:51:57 +02:00
kssenii
eb26b219b9 Merge master 2022-08-16 00:56:27 +02:00
Alexander Tokmakov
589c3408d2
Merge pull request #40234 from ClickHouse/better_message_on_restore_covered
Better error message when restoring covered parts
2022-08-15 22:01:48 +03:00
alesapin
243bd492fa Trying to fix it 2022-08-15 20:55:11 +02:00
alesapin
96722a13bb Merge branch 'master' into stress_s3 2022-08-15 20:20:31 +02:00
Alexander Tokmakov
edaff70010 better error message when restoring covered parts 2022-08-15 13:53:14 +02:00
Alexey Milovidov
5ce6c07005 Set linker for RISC-V 64 2022-08-14 05:57:55 +02:00
Alexey Milovidov
6b8f4f1d59 Merge branch 'master' into server-side-time 2022-08-12 21:36:40 +02:00
Alexander Tokmakov
46aaf842f8
Merge pull request #40031 from ClickHouse/fix_old_tmp_dirs_cleanup
Fix old temporary directories cleanup
2022-08-12 20:31:20 +03:00
Alexander Tokmakov
b3deae3593
Merge branch 'master' into flaky_check_ordinary 2022-08-12 18:11:39 +03:00
Alexey Milovidov
8c3d1f2b5b
Merge branch 'master' into server-side-time 2022-08-12 17:40:02 +03:00
Alexander Tokmakov
467ef7bbc2
Update run.sh 2022-08-12 14:30:18 +03:00
kssenii
768a207176 Merge master 2022-08-11 22:25:53 +02:00
Alexander Tokmakov
06e42a1b23 run tests with Ordinary database in flaky check 2022-08-11 21:32:03 +02:00
Heena Bansal
7779ac4707
Update entrypoint.sh
Typo error.
2022-08-11 12:01:05 -04:00
HeenaBansal2009
f9347aa9ec Merge branch 'Entrypoint_Issue' of github.com:HeenaBansal2009/ClickHouse into Entrypoint_Issue 2022-08-11 06:51:16 -07:00
HeenaBansal2009
8880171899 Add --no-check-certificate in wget 2022-08-11 06:49:45 -07:00
Alexander Tokmakov
b9d18182f2 fix 2022-08-11 15:27:26 +02:00
Anton Popov
0ba886f763 enable fuzzing of table definitions 2022-08-11 12:24:15 +00:00
Maksim Kita
627424889d
Merge pull request #39926 from azat/dict-prom-fix
Remove dictionaries from prometheus metrics on DETACH/DROP
2022-08-11 13:10:47 +02:00
Alexey Milovidov
c54985ff71
Update entrypoint.sh 2022-08-11 09:46:24 +03:00
Heena Bansal
fd03038722
Merge branch 'master' into Entrypoint_Issue 2022-08-11 00:10:45 -04:00
HeenaBansal2009
653ad05ce9 Addresed review comments 2022-08-10 21:10:01 -07:00
Anton Popov
e347fa2f45 add fuzzer for table definition 2022-08-11 02:34:10 +00:00
Alexey Milovidov
c323f64804 Fix Fasttest 2022-08-11 03:29:46 +02:00
HeenaBansal2009
0d2aa07b4d Updated entrypoint.sh to listen on https_port if defined 2022-08-10 11:30:06 -07:00
HeenaBansal2009
3658530088 Updated entrypoint.sh to listen on https_port if defined 2022-08-10 11:23:15 -07:00
Alexander Tokmakov
bb46bfa6d9
Update process_functional_tests_result.py 2022-08-10 21:20:52 +03:00
Alexey Milovidov
cbeba683d8
Merge pull request #40017 from ClickHouse/ci-self-extracting-s3-deployment-2
copy self-extracting to output
2022-08-10 21:10:23 +03:00
Alexey Milovidov
774ba4db23 Remove old code 2022-08-10 19:44:13 +02:00
Alexey Milovidov
7aff85fc79 Fix test Dockerfile 2022-08-10 19:41:29 +02:00
kssenii
5c3227ba56 Merge master 2022-08-10 12:00:34 +02:00
kssenii
0dda03c94b Fix checks 2022-08-10 00:06:58 +02:00
Alexey Milovidov
f7d995681b
Merge branch 'master' into replace-yandex-to-noto 2022-08-09 22:43:52 +03:00
Yakov Olkhovskiy
09e6b1a497
run clickhouse to decompress 2022-08-09 09:16:03 -04:00
Yakov Olkhovskiy
78cc2a970d
copy self-extracting to output 2022-08-09 02:40:17 -04:00
Alexander Tokmakov
3bc583c22b
Revert "copy self-extracting to output" 2022-08-08 20:13:40 +03:00
Alexey Milovidov
0921548a37
Merge pull request #39527 from pkit/pkit/fix_nats_tls
fix nats-io TLS support
2022-08-08 08:28:14 +03:00
Alexey Milovidov
0349d9da96 Change font in CI reports just in case (might be worse) 2022-08-08 07:25:29 +02:00
Alexey Milovidov
cb7f072fe8
Merge pull request #39617 from ClickHouse/ci-self-extracting-s3-deployment
copy self-extracting to output
2022-08-08 08:19:15 +03:00
kssenii
e81f85a79e Fix checks 2022-08-07 16:44:02 +02:00
Yakov Olkhovskiy
19d74d7871
Merge branch 'master' into ci-self-extracting-s3-deployment 2022-08-07 07:24:22 -04:00
BoloniniD
24f3b00193
Merge branch 'master' into BLAKE3 2022-08-06 19:48:10 +03:00
Azat Khuzhin
791377e4dc tests: avoid prometheus.port overlap for replicated database
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-06 13:00:53 +03:00
Azat Khuzhin
3772415588 tests/stress: add dmesg output (to see OOM details)
max_server_memory_usage already set to 75%, so OOM should not happens,
the reason is that because RSS does not match with memory tracker
statistics:

    2022.08.05 12:36:57.869896 [ 82524 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 64.69 GiB, peak 65.26 GiB, will set to 62.80 GiB (RSS), difference: -1.89 GiB
    ...
    2022.08.05 12:37:00.213440 [ 82334 ] {} <Error> void DB::MergeTreeBackgroundExecutor<DB::MergeMutateRuntimeQueue>::routine(DB::TaskRuntimeDataPtr) [Queue = DB::MergeMutateRuntimeQueue]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 64.68 GiB (attempt to allocate chunk of 1298794 bytes), maximum: 51.44 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or orvercommit denominator are set to zero.. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-06 12:34:38 +03:00
Alexey Milovidov
20fdc5b77b
Merge pull request #39898 from pkit/pkit/fix_mkdir_nfs
fix broken NFS mkdir introduced in #36341
2022-08-06 01:54:57 +03:00
kssenii
9685f9a8b7 Fix checks 2022-08-05 22:16:33 +02:00
Yakov Olkhovskiy
4c78f0fc7d
Merge branch 'master' into ci-self-extracting-s3-deployment 2022-08-05 08:14:48 -04:00
kssenii
91f4143b6e Merge master 2022-08-05 12:14:08 +02:00
Constantine Peresypkin
10c76917ea fix nats-io TLS support
nats-io library needs `NATS_HAS_TLS` define to correctly compile-in TLS
support

fixes #39525
2022-08-05 11:20:05 +02:00
Ilya Yatsishin
e583345987
Merge pull request #38978 from qoega/integration-tests-7 2022-08-05 07:21:18 +02:00
Alexey Milovidov
67a6b32a89
Update entrypoint.sh 2022-08-05 07:12:50 +03:00
kssenii
7a9b0bc47f Merge master 2022-08-05 01:48:52 +02:00
BoloniniD
48c91619b0
Merge branch 'master' into BLAKE3 2022-08-04 20:30:47 +03:00
Constantine Peresypkin
0d892b1cac fix broken NFS mkdir introduced in #36341 2022-08-04 13:23:45 +02:00
Kruglov Pavel
235649cb98
Merge pull request #39458 from Avogar/fix-cancel-insert-into-function
Fix WriteBuffer finalize when cancel insert into function
2022-08-04 13:02:08 +02:00
Ilya Yatsishin
cecdc313d8
Merge branch 'master' into integration-tests-7 2022-08-04 11:37:16 +02:00
Alexey Milovidov
f474eb957d
Merge pull request #39758 from ClickHouse/tsan_clang_15
Try clang-15 for build with tsan
2022-08-04 01:56:52 +03:00
Mikhail f. Shiryaev
8533769132
Use compression and cleanup with the recent version ccache 2022-08-03 14:49:07 +02:00
Mikhail f. Shiryaev
eeaf08525f
Use test-util as source for base-test, fasttest and package builder 2022-08-03 14:49:06 +02:00
BoloniniD
b745842c36
Fix Rust build in fasttest 2022-08-03 10:20:57 +03:00
BoloniniD
b161773f71 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-08-02 20:25:25 +03:00
Alexander Tokmakov
914bd3654f
Merge pull request #39798 from ClickHouse/tavplubix-patch-2
Minor fix for Stress Tests
2022-08-02 16:40:55 +03:00
Alexander Tokmakov
e292d830f5
Update Dockerfile 2022-08-02 15:37:02 +03:00
kssenii
d462782d1a Fix checks 2022-08-02 14:27:45 +02:00
Alexander Tokmakov
82b50e79cf
Merge branch 'master' into tsan_clang_15 2022-08-02 13:00:55 +03:00
Alexander Tokmakov
e5c47cb26f
Update run.sh 2022-08-02 12:10:53 +03:00
Robert Schulze
e832153e93
Typos 2022-08-02 08:37:58 +00:00
Alexey Milovidov
81a15304ca
Merge branch 'master' into tavplubix-patch-2 2022-08-02 05:45:04 +03:00
Robert Schulze
b33fe26d8c
Merge pull request #39759 from ClickHouse/splitted-to-shared-renaming
Rename "splitted build" to "shared libraries build" in CI tools
2022-08-01 22:39:57 +02:00
Alexander Tokmakov
ecf7ce1f74 Merge branch 'master' into zookeeper_client_fault_injection 2022-08-01 20:49:01 +02:00
kssenii
2850f68ac9 Fix checks 2022-08-01 20:48:05 +02:00
Alexander Tokmakov
3cc20f05ba
Update run.sh 2022-08-01 20:47:14 +03:00
Nikita Mikhaylov
379d8c5c6a
Chown all directories for multidisk setup (#39121) 2022-08-01 12:08:32 +02:00
kssenii
e5f4a619ed Merge master 2022-07-31 20:24:40 +03:00
Alexander Tokmakov
31550436e4 try clang-15 for build with tsan 2022-07-31 14:38:13 +02:00
Robert Schulze
729d19fa4f
Rename "splitted build" to "shared libraries build" in CI tools
- The old name made sense for (dev option) "-DUSE_STATIC_LIBRARIES=0
  -DSPLIT_SHARED_LIBRARIES=1 -DSPLIT_BINARY=1" but that was removed with
  #39520.

- What still exists is "-DUSE_STATIC_LIBRARIES=0
  -DSPLIT_SHARED_LIBRARIES=1" which does a shared library build
2022-07-31 12:26:51 +00:00
Robert Schulze
52d08d9db4
Merge pull request #39520 from ClickHouse/no-split-binary
Remove SPLIT_BINARY
2022-07-31 14:23:31 +02:00
Alexey Milovidov
36e6500e54
Merge branch 'master' into BLAKE3 2022-07-30 23:14:05 +03:00
Yakov Olkhovskiy
f5442cba86 clickhouse may be compressed - run once to decompress 2022-07-29 15:06:15 -04:00
Yakov Olkhovskiy
72be640cfb clickhouse may be compressed - run once to decompress 2022-07-29 15:04:50 -04:00
avogar
573d9c1b57 Fix stress test 2022-07-29 18:30:40 +00:00
Mikhail f. Shiryaev
e91fb2ee5c
Merge pull request #39652 from ClickHouse/clang-tidy-ccache
Increase ccache max size for clang tidy builds
2022-07-29 20:09:52 +02:00
Mikhail f. Shiryaev
24aaac59ca
Merge pull request #39702 from ClickHouse/mysql-odbc-integration-tests
Change mysql-odbc url
2022-07-29 17:11:47 +02:00
Robert Schulze
3d1797f75f
Merge remote-tracking branch 'origin/master' into no-split-binary 2022-07-29 12:17:43 +00:00
Mikhail f. Shiryaev
672e67aa8e
Change mysql-odbc url 2022-07-29 11:52:20 +02:00
Azat Khuzhin
4b0594633b Build utils on CI when they was requested
clickhouse-bundle does not includes utils, and to avoid modifying each
utility it is better to build all, anyway this is not a common build.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-29 11:36:51 +03:00
Azat Khuzhin
2901ddc217 Remove --verbose=1 for cmake on configuration stage
--verbose is supported only for make/install, while 3.16 is OK (ubuntu
20.04), newer cmake (3.23) does not, and simply fails:

    # cmake --debug-trycompile --verbose=1 /foo
    debug trycompile on
    CMake Error: Unknown argument --verbose=1
    CMake Error: Run 'cmake --help' for all supported options.

And this is how it works with 3.16:

    # cmake --debug-trycompile --verbose=1 /foo
    debug trycompile on
    CMake Error: The source directory "/foo" does not exist.
    Specify --help for usage, or press the help button on the CMake GUI.

Anyway this script sets CMAKE_VERBOSE_MAKEFILE, and this is what
--verbose does.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-29 11:36:51 +03:00
Robert Schulze
199e254777
Merge remote-tracking branch 'origin/master' into no-split-binary 2022-07-28 15:54:22 +00:00
Mikhail f. Shiryaev
c6fd8364a4
Increase ccache max size for clang tidy builds 2022-07-28 15:11:45 +02:00
Yakov Olkhovskiy
ea17492f5f
Merge branch 'master' into ci-self-extracting-s3-deployment 2022-07-27 21:15:36 -04:00
Yakov Olkhovskiy
f91a0935cd
check existence of compressed clickhouse 2022-07-27 09:00:05 -04:00
Yakov Olkhovskiy
0720936c2d
rewrite original clickhouse with compressed one 2022-07-26 09:16:31 -04:00
Mikhail f. Shiryaev
061e61919a
Merge pull request #39450 from ClickHouse/tsal-clang-13
Build thread sanitizer binaries with clang-13
2022-07-26 15:13:17 +02:00
Yakov Olkhovskiy
c05c32e823
copy self-extracting to output 2022-07-26 08:41:36 -04:00
Yatsishin Ilya
25db71a8a3 Merge remote-tracking branch 'origin/master' into integration-tests-7 2022-07-25 09:17:55 +00:00
Alexey Milovidov
071374b152 Remove SPLIT_BINARY 2022-07-24 01:15:54 +02:00
Mikhail f. Shiryaev
3e0db34ed9
Merge pull request #39390 from ClickHouse/paint-it-black
Automatic fixes for black formatting for domestic repo PRs
2022-07-22 17:19:00 +02:00
Mikhail f. Shiryaev
c6b251d0cb
Revert "Merge pull request #38106 from ClickHouse/tsan_less_flaky_tests"
This reverts commit 0ae0cc54aa, reversing
changes made to 1d7cf28cab.
2022-07-22 12:14:23 +02:00
Mikhail f. Shiryaev
17b504b0d4
Build thread sanitizer binaries with clang-13 2022-07-22 12:14:22 +02:00
jasperzhu
614f3b14a2
Merge branch 'master' into dev_intel_iaa_deflate 2022-07-22 11:05:44 +08:00
Mikhail f. Shiryaev
7d2cf648df
Make a docker image for style check lighter 2022-07-21 16:59:49 +02:00
Mikhail f. Shiryaev
dacfc7886c
Improve style_check scripts style a little bit 2022-07-21 16:59:44 +02:00
Alexander Tokmakov
9e9969cea7
Merge pull request #37827 from arthurpassos/host_regexp_multiple_domains
Test host_regexp against all PTR records instead of only one
2022-07-21 16:43:05 +03:00
Arthur Passos
828de2a674 Add host regexp multiple PTR records integration tests 2022-07-20 14:09:38 -03:00
Dmitry Novik
a09422de7b
Merge pull request #38642 from ClickHouse/group-by-use-nulls
Add group_by_use_nulls setting
2022-07-20 14:42:42 +02:00
Alexander Tokmakov
840ace663b
Update run.sh 2022-07-20 13:19:53 +03:00
Dmitry Novik
50989bdb68
Merge branch 'master' into group-by-use-nulls 2022-07-19 14:58:01 +02:00
kssenii
df17df67c2 Fix checks 2022-07-19 10:45:54 +02:00
jasperzhu
c044c67745
Merge branch 'master' into dev_intel_iaa_deflate 2022-07-19 15:32:57 +08:00
kssenii
274457e5cf Allow cache over azure blob storage, add tests 2022-07-18 16:15:04 +02:00
Yatsishin Ilya
eb2da901c7 Merge remote-tracking branch 'origin/master' into integration-tests-7 2022-07-18 09:29:35 +00:00
kssenii
8ad26b3111 Merge master 2022-07-16 22:50:03 +02:00
Azat Khuzhin
1ef9910453 Fix builder image for releases w/o diagnostics tool
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-16 12:07:58 +03:00
Alexander Tokmakov
b770f9903d
Update run.sh 2022-07-15 20:03:00 +03:00
Alexander Tokmakov
5c24cd979b
Merge pull request #39256 from ClickHouse/bc_check_fix_stacks_in_gdb
Fix stacktraces in gdb in BC check
2022-07-15 17:54:18 +03:00
Anton Popov
da97a22465
Merge pull request #39243 from CurtizJ/send-logs-level-colors
Do not color logs on client if they are redirected to file
2022-07-15 13:33:13 +02:00
Alexander Tokmakov
77487e996c fix stacktraces in gdb in bc check 2022-07-15 12:23:28 +02:00
Anton Popov
efed134758 fix test 2022-07-14 21:48:34 +00:00
kssenii
15a2d60f23 Fix checks 2022-07-14 22:04:39 +02:00
Alexander Tokmakov
f8e23c1deb
Update run.sh 2022-07-14 17:29:08 +03:00
Alexander Tokmakov
991493e6fc
Update run.sh 2022-07-13 15:22:36 +03:00
Dmitry Novik
5f65b45269
Merge branch 'master' into group-by-use-nulls 2022-07-12 22:36:04 +02:00
Kseniia Sumarokova
f69ec635d0
Merge pull request #39110 from ClickHouse/kssenii-patch-4
Fix meilisearch tests
2022-07-12 18:32:49 +02:00
Timur Solodovnikov
0c7388aea8
Handling SIGTERM signals from k8s (#39130) 2022-07-12 18:14:05 +02:00
Kseniia Sumarokova
f629fd7e57
Update docker_compose_meili.yml 2022-07-12 15:50:35 +02:00
Alexander Tokmakov
948f15eff3
Update run.sh 2022-07-12 14:01:53 +03:00
Kseniia Sumarokova
bcd9453f33
Set meilieserach client version too 2022-07-12 12:15:20 +02:00
Kseniia Sumarokova
aebb73a24d
Update docker_compose_meili.yml 2022-07-11 21:41:15 +02:00
Arthur Passos
7b626da080 remove cpp-dns and udns from fasttest 2022-07-11 12:43:56 -03:00
Vladimir C
ca2e27aaa2
Merge pull request #37841 from vdimir/perf-save-to-stat
Send perf tests results to ci database
2022-07-11 13:07:40 +02:00
jinjunzh
7cb5b35bef remove qpl from fasttest 2022-07-09 13:54:23 -04:00
Vladimir C
bfba67cf88
Update docker/test/performance-comparison/compare.sh 2022-07-08 17:13:20 +02:00
Nikita Mikhaylov
a44157d81d
Allow globs in keys for clickhouse-extract-from-config tool (#38966) 2022-07-08 16:13:32 +02:00
Alexander Tokmakov
2b886ddc2e
Update run.sh 2022-07-08 16:47:54 +03:00
Vladimir C
9555d72dfc
Remove head ci-checks.tsv 2022-07-08 15:26:07 +02:00
Alexander Tokmakov
57b8a6a542
Update run.sh 2022-07-08 13:53:35 +03:00
Yatsishin Ilya
d274b05fac improvements 2022-07-07 20:21:10 +00:00
Dmitry Novik
0b18b4ed43 Use group_by_use_nulls in tests more often 2022-07-07 18:58:46 +00:00
Dmitry Novik
d1df66687b
Merge branch 'master' into group-by-use-nulls 2022-07-07 20:54:38 +02:00
Vladimir C
db838f1343
Merge pull request #35796 from vdimir/full-sorting-merge-join 2022-07-07 19:16:49 +02:00
Kruglov Pavel
8ffd6cd22c
Merge pull request #38717 from Avogar/improve-bc-check
Try to improve backward compatibility check
2022-07-07 18:52:34 +02:00
Kruglov Pavel
fa1d5b8bdb
Merge pull request #38901 from ClickHouse/Avogar-patch-1
Avoid false positive red sanitizer asserts check in stress test
2022-07-07 11:42:47 +02:00
mergify[bot]
7ba147bc7d
Merge branch 'master' into improve-bc-check 2022-07-07 09:38:17 +00:00
DanRoscigno
88bc5a84e5 update README 2022-07-06 14:06:53 -04:00
vdimir
b0c0ec370d
Add join_algorithm='full_sorting_merge' to stress tests 2022-07-06 14:27:34 +00:00
Kruglov Pavel
a3a94a1c09
Avoid false positive red sanitizer asserts check in stress test 2022-07-06 14:32:17 +02:00