Commit Graph

3549 Commits

Author SHA1 Message Date
alesapin
133ca01447 Merge branch 'master' into stress_s3 2022-08-29 11:25:28 +02:00
Alexey Milovidov
7bd1142f63
Merge pull request #40647 from ClickHouse/high-level-coverage
Report high-level function and data types test coverage
2022-08-27 23:13:10 +03:00
Alexey Milovidov
f86242c17e
Merge pull request #40699 from ClickHouse/remove-unbundled
Remove the remaining parts of "unbundled" build
2022-08-27 21:54:42 +03:00
Alexey Milovidov
00afbadb53
Merge branch 'master' into high-level-coverage 2022-08-27 19:34:26 +03:00
Azat Khuzhin
ebc61a36e0 tests/stress: improve OOM detection (add separate check by dmesg)
Right now if you will look at the OOM errors:
- OOM killer (or signal 9) in clickhouse-server.log
- Backward compatibility check: OOM messages in clickhouse-server.log

Most of them are not real, but just clickhouse server got KILLed by
clickhouse stop, #40678 may imporove the situation, but to definitely
sure that there was OOM let's look at dmesg.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-27 12:46:58 +02:00
Alexey Milovidov
91ed3ebe9a Remove the remaining parts of "unbundled" build 2022-08-27 02:18:47 +02:00
Alexey Milovidov
2a7d9f0778 Merge branch 'master' into high-level-coverage 2022-08-26 23:44:52 +02:00
Azat Khuzhin
3b519c5d44 tests/stress: capture stacktrace of server hungs if pid was removed already
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-26 22:06:32 +03:00
Alexander Tokmakov
a3f7d1a5cc
Merge pull request #40662 from ClickHouse/tavplubix-patch-3
Remove garbage from runlog.log in functional tests
2022-08-26 17:01:31 +03:00
Alexander Tokmakov
263c467d90
Update setup_hdfs_minicluster.sh 2022-08-26 14:09:42 +03:00
Alexander Tokmakov
76e3ab8c59
Update setup_hdfs_minicluster.sh 2022-08-26 13:33:12 +03:00
alesapin
704c4b2c5b Stop thread fuzzer on shutdown 2022-08-26 11:54:54 +02:00
Azat Khuzhin
ce88c7cb60 Add llvm-15 for llvm-symbolizer-15 for clang-15 (used for TSan)
Simply installing llvm-15 over TSAN_SYMBOLIZER_PATH had been prefered
(to keep everything in one place and as simple as possible), though
TSAN_SYMBOLIZER_PATH should also work.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-26 09:28:42 +02:00
Alexey Milovidov
440d10370a Report high-level function test coverage 2022-08-26 01:59:14 +02:00
alesapin
3ff6489fae Merge branch 'master' into stress_s3 2022-08-25 13:14:58 +02:00
alesapin
ad692f732a Merge branch 'master' into stress_s3 2022-08-25 13:13:30 +02:00
alesapin
35f9815b8e Fix backward comp check 2022-08-24 14:43:02 +02:00
Alexey Milovidov
35ce19ab63
Merge pull request #40354 from azat/tests/stress-dmesg-v3
tests/stress: use --privileged over --cap-add syslog to obtain dmesg
2022-08-20 14:13:55 +03:00
Alexey Milovidov
40ed829a29
Merge pull request #40074 from HeenaBansal2009/Entrypoint_Issue
Entrypoint to check for HTTPS_PORT if http_port is disabled.
2022-08-20 02:40:20 +03:00
Nikita Taranov
9f1ee52b00
Run all queries from changed perf tests (#40322)
* impl

* fix
2022-08-19 19:46:07 +02:00
Azat Khuzhin
50bddc43dc tests/stress: ignore NETLINK_ERROR from checkPermissionsImpl
Since now with --privileged it has CAP_SYS_ADMIN and tries to
communicate via netlink.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-19 14:07:06 +02:00
Alexander Tokmakov
3d253ec51b
Merge branch 'master' into zookeeper_client_fault_injection 2022-08-18 21:23:50 +03:00
alesapin
922818bbd9 Merge branch 'stress_s3' of github.com:ClickHouse/ClickHouse into stress_s3 2022-08-18 14:46:50 +02:00
alesapin
932ea146f5 Merge branch 'master' into stress_s3 2022-08-18 13:14:47 +02:00
alesapin
86b1e33eed Disable cache on writes 2022-08-17 19:00:53 +02:00
alesapin
600d22851f Grep dangerous S3 errors 2022-08-17 12:43:11 +02:00
alesapin
0433b801d2 Configure properly 2022-08-17 12:27:15 +02:00
Alexander Tokmakov
ae000e9125
Merge branch 'master' into zookeeper_client_fault_injection 2022-08-17 12:48:54 +03:00
alesapin
1ec6627a70 Fix tables creation 2022-08-16 18:28:17 +02:00
kssenii
52832ea788 May be fix database replicated check 2022-08-16 11:51:57 +02:00
kssenii
eb26b219b9 Merge master 2022-08-16 00:56:27 +02:00
Alexander Tokmakov
589c3408d2
Merge pull request #40234 from ClickHouse/better_message_on_restore_covered
Better error message when restoring covered parts
2022-08-15 22:01:48 +03:00
alesapin
243bd492fa Trying to fix it 2022-08-15 20:55:11 +02:00
alesapin
96722a13bb Merge branch 'master' into stress_s3 2022-08-15 20:20:31 +02:00
Alexander Tokmakov
edaff70010 better error message when restoring covered parts 2022-08-15 13:53:14 +02:00
Alexey Milovidov
5ce6c07005 Set linker for RISC-V 64 2022-08-14 05:57:55 +02:00
Alexey Milovidov
6b8f4f1d59 Merge branch 'master' into server-side-time 2022-08-12 21:36:40 +02:00
Alexander Tokmakov
46aaf842f8
Merge pull request #40031 from ClickHouse/fix_old_tmp_dirs_cleanup
Fix old temporary directories cleanup
2022-08-12 20:31:20 +03:00
Alexander Tokmakov
b3deae3593
Merge branch 'master' into flaky_check_ordinary 2022-08-12 18:11:39 +03:00
Alexey Milovidov
8c3d1f2b5b
Merge branch 'master' into server-side-time 2022-08-12 17:40:02 +03:00
Alexander Tokmakov
467ef7bbc2
Update run.sh 2022-08-12 14:30:18 +03:00
kssenii
768a207176 Merge master 2022-08-11 22:25:53 +02:00
Alexander Tokmakov
06e42a1b23 run tests with Ordinary database in flaky check 2022-08-11 21:32:03 +02:00
Heena Bansal
7779ac4707
Update entrypoint.sh
Typo error.
2022-08-11 12:01:05 -04:00
HeenaBansal2009
f9347aa9ec Merge branch 'Entrypoint_Issue' of github.com:HeenaBansal2009/ClickHouse into Entrypoint_Issue 2022-08-11 06:51:16 -07:00
HeenaBansal2009
8880171899 Add --no-check-certificate in wget 2022-08-11 06:49:45 -07:00
Alexander Tokmakov
b9d18182f2 fix 2022-08-11 15:27:26 +02:00
Anton Popov
0ba886f763 enable fuzzing of table definitions 2022-08-11 12:24:15 +00:00
Maksim Kita
627424889d
Merge pull request #39926 from azat/dict-prom-fix
Remove dictionaries from prometheus metrics on DETACH/DROP
2022-08-11 13:10:47 +02:00
Alexey Milovidov
c54985ff71
Update entrypoint.sh 2022-08-11 09:46:24 +03:00
Heena Bansal
fd03038722
Merge branch 'master' into Entrypoint_Issue 2022-08-11 00:10:45 -04:00
HeenaBansal2009
653ad05ce9 Addresed review comments 2022-08-10 21:10:01 -07:00
Anton Popov
e347fa2f45 add fuzzer for table definition 2022-08-11 02:34:10 +00:00
Alexey Milovidov
c323f64804 Fix Fasttest 2022-08-11 03:29:46 +02:00
HeenaBansal2009
0d2aa07b4d Updated entrypoint.sh to listen on https_port if defined 2022-08-10 11:30:06 -07:00
HeenaBansal2009
3658530088 Updated entrypoint.sh to listen on https_port if defined 2022-08-10 11:23:15 -07:00
Alexander Tokmakov
bb46bfa6d9
Update process_functional_tests_result.py 2022-08-10 21:20:52 +03:00
Alexey Milovidov
cbeba683d8
Merge pull request #40017 from ClickHouse/ci-self-extracting-s3-deployment-2
copy self-extracting to output
2022-08-10 21:10:23 +03:00
Alexey Milovidov
774ba4db23 Remove old code 2022-08-10 19:44:13 +02:00
Alexey Milovidov
7aff85fc79 Fix test Dockerfile 2022-08-10 19:41:29 +02:00
kssenii
5c3227ba56 Merge master 2022-08-10 12:00:34 +02:00
kssenii
0dda03c94b Fix checks 2022-08-10 00:06:58 +02:00
Alexey Milovidov
f7d995681b
Merge branch 'master' into replace-yandex-to-noto 2022-08-09 22:43:52 +03:00
Yakov Olkhovskiy
09e6b1a497
run clickhouse to decompress 2022-08-09 09:16:03 -04:00
Yakov Olkhovskiy
78cc2a970d
copy self-extracting to output 2022-08-09 02:40:17 -04:00
Alexander Tokmakov
3bc583c22b
Revert "copy self-extracting to output" 2022-08-08 20:13:40 +03:00
Alexey Milovidov
0921548a37
Merge pull request #39527 from pkit/pkit/fix_nats_tls
fix nats-io TLS support
2022-08-08 08:28:14 +03:00
Alexey Milovidov
0349d9da96 Change font in CI reports just in case (might be worse) 2022-08-08 07:25:29 +02:00
Alexey Milovidov
cb7f072fe8
Merge pull request #39617 from ClickHouse/ci-self-extracting-s3-deployment
copy self-extracting to output
2022-08-08 08:19:15 +03:00
kssenii
e81f85a79e Fix checks 2022-08-07 16:44:02 +02:00
Yakov Olkhovskiy
19d74d7871
Merge branch 'master' into ci-self-extracting-s3-deployment 2022-08-07 07:24:22 -04:00
BoloniniD
24f3b00193
Merge branch 'master' into BLAKE3 2022-08-06 19:48:10 +03:00
Azat Khuzhin
791377e4dc tests: avoid prometheus.port overlap for replicated database
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-06 13:00:53 +03:00
Azat Khuzhin
3772415588 tests/stress: add dmesg output (to see OOM details)
max_server_memory_usage already set to 75%, so OOM should not happens,
the reason is that because RSS does not match with memory tracker
statistics:

    2022.08.05 12:36:57.869896 [ 82524 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 64.69 GiB, peak 65.26 GiB, will set to 62.80 GiB (RSS), difference: -1.89 GiB
    ...
    2022.08.05 12:37:00.213440 [ 82334 ] {} <Error> void DB::MergeTreeBackgroundExecutor<DB::MergeMutateRuntimeQueue>::routine(DB::TaskRuntimeDataPtr) [Queue = DB::MergeMutateRuntimeQueue]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 64.68 GiB (attempt to allocate chunk of 1298794 bytes), maximum: 51.44 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or orvercommit denominator are set to zero.. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-06 12:34:38 +03:00
Alexey Milovidov
20fdc5b77b
Merge pull request #39898 from pkit/pkit/fix_mkdir_nfs
fix broken NFS mkdir introduced in #36341
2022-08-06 01:54:57 +03:00
kssenii
9685f9a8b7 Fix checks 2022-08-05 22:16:33 +02:00
Yakov Olkhovskiy
4c78f0fc7d
Merge branch 'master' into ci-self-extracting-s3-deployment 2022-08-05 08:14:48 -04:00
kssenii
91f4143b6e Merge master 2022-08-05 12:14:08 +02:00
Constantine Peresypkin
10c76917ea fix nats-io TLS support
nats-io library needs `NATS_HAS_TLS` define to correctly compile-in TLS
support

fixes #39525
2022-08-05 11:20:05 +02:00
Ilya Yatsishin
e583345987
Merge pull request #38978 from qoega/integration-tests-7 2022-08-05 07:21:18 +02:00
Alexey Milovidov
67a6b32a89
Update entrypoint.sh 2022-08-05 07:12:50 +03:00
kssenii
7a9b0bc47f Merge master 2022-08-05 01:48:52 +02:00
BoloniniD
48c91619b0
Merge branch 'master' into BLAKE3 2022-08-04 20:30:47 +03:00
Constantine Peresypkin
0d892b1cac fix broken NFS mkdir introduced in #36341 2022-08-04 13:23:45 +02:00
Kruglov Pavel
235649cb98
Merge pull request #39458 from Avogar/fix-cancel-insert-into-function
Fix WriteBuffer finalize when cancel insert into function
2022-08-04 13:02:08 +02:00
Ilya Yatsishin
cecdc313d8
Merge branch 'master' into integration-tests-7 2022-08-04 11:37:16 +02:00
Alexey Milovidov
f474eb957d
Merge pull request #39758 from ClickHouse/tsan_clang_15
Try clang-15 for build with tsan
2022-08-04 01:56:52 +03:00
Mikhail f. Shiryaev
8533769132
Use compression and cleanup with the recent version ccache 2022-08-03 14:49:07 +02:00
Mikhail f. Shiryaev
eeaf08525f
Use test-util as source for base-test, fasttest and package builder 2022-08-03 14:49:06 +02:00
BoloniniD
b745842c36
Fix Rust build in fasttest 2022-08-03 10:20:57 +03:00
BoloniniD
b161773f71 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-08-02 20:25:25 +03:00
Alexander Tokmakov
914bd3654f
Merge pull request #39798 from ClickHouse/tavplubix-patch-2
Minor fix for Stress Tests
2022-08-02 16:40:55 +03:00
Alexander Tokmakov
e292d830f5
Update Dockerfile 2022-08-02 15:37:02 +03:00
kssenii
d462782d1a Fix checks 2022-08-02 14:27:45 +02:00
Alexander Tokmakov
82b50e79cf
Merge branch 'master' into tsan_clang_15 2022-08-02 13:00:55 +03:00
Alexander Tokmakov
e5c47cb26f
Update run.sh 2022-08-02 12:10:53 +03:00
Robert Schulze
e832153e93
Typos 2022-08-02 08:37:58 +00:00
Alexey Milovidov
81a15304ca
Merge branch 'master' into tavplubix-patch-2 2022-08-02 05:45:04 +03:00
Robert Schulze
b33fe26d8c
Merge pull request #39759 from ClickHouse/splitted-to-shared-renaming
Rename "splitted build" to "shared libraries build" in CI tools
2022-08-01 22:39:57 +02:00
Alexander Tokmakov
ecf7ce1f74 Merge branch 'master' into zookeeper_client_fault_injection 2022-08-01 20:49:01 +02:00
kssenii
2850f68ac9 Fix checks 2022-08-01 20:48:05 +02:00
Alexander Tokmakov
3cc20f05ba
Update run.sh 2022-08-01 20:47:14 +03:00
Nikita Mikhaylov
379d8c5c6a
Chown all directories for multidisk setup (#39121) 2022-08-01 12:08:32 +02:00
kssenii
e5f4a619ed Merge master 2022-07-31 20:24:40 +03:00
Alexander Tokmakov
31550436e4 try clang-15 for build with tsan 2022-07-31 14:38:13 +02:00
Robert Schulze
729d19fa4f
Rename "splitted build" to "shared libraries build" in CI tools
- The old name made sense for (dev option) "-DUSE_STATIC_LIBRARIES=0
  -DSPLIT_SHARED_LIBRARIES=1 -DSPLIT_BINARY=1" but that was removed with
  #39520.

- What still exists is "-DUSE_STATIC_LIBRARIES=0
  -DSPLIT_SHARED_LIBRARIES=1" which does a shared library build
2022-07-31 12:26:51 +00:00
Robert Schulze
52d08d9db4
Merge pull request #39520 from ClickHouse/no-split-binary
Remove SPLIT_BINARY
2022-07-31 14:23:31 +02:00
Alexey Milovidov
36e6500e54
Merge branch 'master' into BLAKE3 2022-07-30 23:14:05 +03:00
Yakov Olkhovskiy
f5442cba86 clickhouse may be compressed - run once to decompress 2022-07-29 15:06:15 -04:00
Yakov Olkhovskiy
72be640cfb clickhouse may be compressed - run once to decompress 2022-07-29 15:04:50 -04:00
avogar
573d9c1b57 Fix stress test 2022-07-29 18:30:40 +00:00
Mikhail f. Shiryaev
e91fb2ee5c
Merge pull request #39652 from ClickHouse/clang-tidy-ccache
Increase ccache max size for clang tidy builds
2022-07-29 20:09:52 +02:00
Mikhail f. Shiryaev
24aaac59ca
Merge pull request #39702 from ClickHouse/mysql-odbc-integration-tests
Change mysql-odbc url
2022-07-29 17:11:47 +02:00
Robert Schulze
3d1797f75f
Merge remote-tracking branch 'origin/master' into no-split-binary 2022-07-29 12:17:43 +00:00
Mikhail f. Shiryaev
672e67aa8e
Change mysql-odbc url 2022-07-29 11:52:20 +02:00
Azat Khuzhin
4b0594633b Build utils on CI when they was requested
clickhouse-bundle does not includes utils, and to avoid modifying each
utility it is better to build all, anyway this is not a common build.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-29 11:36:51 +03:00
Azat Khuzhin
2901ddc217 Remove --verbose=1 for cmake on configuration stage
--verbose is supported only for make/install, while 3.16 is OK (ubuntu
20.04), newer cmake (3.23) does not, and simply fails:

    # cmake --debug-trycompile --verbose=1 /foo
    debug trycompile on
    CMake Error: Unknown argument --verbose=1
    CMake Error: Run 'cmake --help' for all supported options.

And this is how it works with 3.16:

    # cmake --debug-trycompile --verbose=1 /foo
    debug trycompile on
    CMake Error: The source directory "/foo" does not exist.
    Specify --help for usage, or press the help button on the CMake GUI.

Anyway this script sets CMAKE_VERBOSE_MAKEFILE, and this is what
--verbose does.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-29 11:36:51 +03:00
Robert Schulze
199e254777
Merge remote-tracking branch 'origin/master' into no-split-binary 2022-07-28 15:54:22 +00:00
Mikhail f. Shiryaev
c6fd8364a4
Increase ccache max size for clang tidy builds 2022-07-28 15:11:45 +02:00
Yakov Olkhovskiy
ea17492f5f
Merge branch 'master' into ci-self-extracting-s3-deployment 2022-07-27 21:15:36 -04:00
Yakov Olkhovskiy
f91a0935cd
check existence of compressed clickhouse 2022-07-27 09:00:05 -04:00
Yakov Olkhovskiy
0720936c2d
rewrite original clickhouse with compressed one 2022-07-26 09:16:31 -04:00
Mikhail f. Shiryaev
061e61919a
Merge pull request #39450 from ClickHouse/tsal-clang-13
Build thread sanitizer binaries with clang-13
2022-07-26 15:13:17 +02:00
Yakov Olkhovskiy
c05c32e823
copy self-extracting to output 2022-07-26 08:41:36 -04:00
Yatsishin Ilya
25db71a8a3 Merge remote-tracking branch 'origin/master' into integration-tests-7 2022-07-25 09:17:55 +00:00
Alexey Milovidov
071374b152 Remove SPLIT_BINARY 2022-07-24 01:15:54 +02:00
Mikhail f. Shiryaev
3e0db34ed9
Merge pull request #39390 from ClickHouse/paint-it-black
Automatic fixes for black formatting for domestic repo PRs
2022-07-22 17:19:00 +02:00
Mikhail f. Shiryaev
c6b251d0cb
Revert "Merge pull request #38106 from ClickHouse/tsan_less_flaky_tests"
This reverts commit 0ae0cc54aa, reversing
changes made to 1d7cf28cab.
2022-07-22 12:14:23 +02:00
Mikhail f. Shiryaev
17b504b0d4
Build thread sanitizer binaries with clang-13 2022-07-22 12:14:22 +02:00
jasperzhu
614f3b14a2
Merge branch 'master' into dev_intel_iaa_deflate 2022-07-22 11:05:44 +08:00
Mikhail f. Shiryaev
7d2cf648df
Make a docker image for style check lighter 2022-07-21 16:59:49 +02:00
Mikhail f. Shiryaev
dacfc7886c
Improve style_check scripts style a little bit 2022-07-21 16:59:44 +02:00
Alexander Tokmakov
9e9969cea7
Merge pull request #37827 from arthurpassos/host_regexp_multiple_domains
Test host_regexp against all PTR records instead of only one
2022-07-21 16:43:05 +03:00
Arthur Passos
828de2a674 Add host regexp multiple PTR records integration tests 2022-07-20 14:09:38 -03:00
Dmitry Novik
a09422de7b
Merge pull request #38642 from ClickHouse/group-by-use-nulls
Add group_by_use_nulls setting
2022-07-20 14:42:42 +02:00
Alexander Tokmakov
840ace663b
Update run.sh 2022-07-20 13:19:53 +03:00
Dmitry Novik
50989bdb68
Merge branch 'master' into group-by-use-nulls 2022-07-19 14:58:01 +02:00
kssenii
df17df67c2 Fix checks 2022-07-19 10:45:54 +02:00
jasperzhu
c044c67745
Merge branch 'master' into dev_intel_iaa_deflate 2022-07-19 15:32:57 +08:00
kssenii
274457e5cf Allow cache over azure blob storage, add tests 2022-07-18 16:15:04 +02:00
Yatsishin Ilya
eb2da901c7 Merge remote-tracking branch 'origin/master' into integration-tests-7 2022-07-18 09:29:35 +00:00
kssenii
8ad26b3111 Merge master 2022-07-16 22:50:03 +02:00
Azat Khuzhin
1ef9910453 Fix builder image for releases w/o diagnostics tool
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-16 12:07:58 +03:00
Alexander Tokmakov
b770f9903d
Update run.sh 2022-07-15 20:03:00 +03:00
Alexander Tokmakov
5c24cd979b
Merge pull request #39256 from ClickHouse/bc_check_fix_stacks_in_gdb
Fix stacktraces in gdb in BC check
2022-07-15 17:54:18 +03:00
Anton Popov
da97a22465
Merge pull request #39243 from CurtizJ/send-logs-level-colors
Do not color logs on client if they are redirected to file
2022-07-15 13:33:13 +02:00
Alexander Tokmakov
77487e996c fix stacktraces in gdb in bc check 2022-07-15 12:23:28 +02:00
Anton Popov
efed134758 fix test 2022-07-14 21:48:34 +00:00
kssenii
15a2d60f23 Fix checks 2022-07-14 22:04:39 +02:00
Alexander Tokmakov
f8e23c1deb
Update run.sh 2022-07-14 17:29:08 +03:00