thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-01 03:52:15 +00:00
Code Issues Packages Projects Releases Wiki Activity
99,391 Commits 9,191 Branches 1,782 Tags 2.2 GiB
89390ebc01
Commit Graph

3524 Commits

Author SHA1 Message Date
Igor Nikonov
06070fe0ae
Merge branch 'master' into fix_int8_test_standalone_keeper_mode 2022-09-09 22:03:02 +02:00
Alexander Tokmakov
e77b9e4d0c
Merge pull request #40775 from azat/ci/core-dumps-rework 
Rework core collecting on CI (eliminate gcore usage)
 2022-09-09 20:20:10 +03:00
alesapin
e904822051 Bump minio version in tests 2022-09-09 16:54:03 +02:00
Igor Nikonov
dbfb448290 Fix: integration test, standalone keeper mode 
There is logic regarding which keeper binary use to start keeper cluster in an integration test
There 2 options:
(1) standalone keeper binary (expected binary name clickhouse-keeper)
(2) clickhouse binary with keeper inside

Fixed:
- option (1) didn't work since docker_compose_keeper.yaml didn't create
target clickhouse-keeper at all
- if clickhouse-keeper existed, option (1) was taken but
  clickhouse-keeper could be just a link to clickhouse binary (the link
  is created always during build if cmake option BUILD_STANDALONE_KEEPER is OFF)
 2022-09-09 14:51:34 +00:00
BoloniniD
e8bcbcd016
Merge branch 'master' into BLAKE3 2022-09-09 11:48:31 +03:00
Robert Schulze
9d4de0cbaa
Merge pull request #40999 from ClickHouse/sse2-special-build 
Add special x86-SSE2-only build
 2022-09-08 09:06:29 +02:00
Robert Schulze
652f1bfd19
fix: pass -DNO_SSE3_OR_HIGHER=1 from packager 2022-09-06 12:18:11 +00:00
Robert Schulze
1ebcc3a14e
fix: endswidth --> endswith 2022-09-06 07:41:37 +00:00
Alexey Milovidov
7776512b04
Merge pull request #41002 from azat/ci/fix-oom-check 
ci/stress: clear dmesg before run to fix "OOM in dmesg" check
 2022-09-06 06:41:36 +03:00
Alexander Tokmakov
b264be3c63
Merge branch 'master' into zookeeper_client_fault_injection 2022-09-05 22:13:09 +03:00
Robert Schulze
438ed368a1
fix: correct compiler parsing 2022-09-05 17:49:40 +00:00
Robert Schulze
401747eaa7
Merge branch 'master' into sse2-special-build 2022-09-05 16:17:20 +02:00
Azat Khuzhin
2724b67537 ci/stress: clear dmesg before run to fix "OOM in dmesg" check 
CI: https://s3.amazonaws.com/clickhouse-test-reports/40772/afa137ae2b6108e72c2d6e43556a04548afa2ea9/stress_test__ubsan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-09-05 15:51:36 +02:00
Kseniia Sumarokova
e12858dca5
Merge pull request #36837 from ClickHouse/stress_s3 
Trying stress on top of S3
 2022-09-05 15:12:55 +02:00
Robert Schulze
e1def723f8
Add special x86-SSE2-only build 2022-09-05 12:51:44 +00:00
Alexander Tokmakov
abffd4595e
Merge branch 'master' into zookeeper_client_fault_injection 2022-09-05 15:03:26 +03:00
Alexey Milovidov
d20d49f39f
Merge pull request #40958 from arenadata/ADQM-566 
stylecheck renewed and version in docker set explicitely
 2022-09-05 03:23:38 +03:00
Nikita Mikhaylov
f621bd0055
Delete old cache directories creation from entrypoint (#40946) 2022-09-04 23:54:05 +02:00
Alexey Milovidov
b2a2217e57
Merge pull request #40969 from ClickHouse/remove-trash-2 
Remove trash
 2022-09-05 00:35:32 +03:00
alesapin
45b1f9dc41
Merge branch 'master' into stress_s3 2022-09-04 23:17:10 +02:00
Azat Khuzhin
25e3bebd9d Rework core collecting on CI (eliminate gcore usage) 
gcore is a gdb command, that internally uses gdb to dump the core.

However with proper configuration of limits (core_dump.size_limit) it
should not be required, althought some issues is possible:
- non standard kernel.core_pattern
- sanitizers

So yes, gcore is more "universal" (you don't need to configure any
`kernel_pattern`), but it is ad-hoc, and it has drawbacks -
**it does not work when gdb fails**. For example gdb may fail with
`Dwarf Error: DW_FORM_strx1 found in non-DWO CU` in case of DWARF-5 [1].

  [1]: https://github.com/ClickHouse/ClickHouse/pull/40772#issuecomment-1236331323.

Let's try to switch to more native way.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-09-04 22:07:16 +02:00
Azat Khuzhin
64f95710cd ci: add symlink for llvm-symbolizer (to make symbolizer work) 
Simply installing llvm-symbolizer-$VER is not enough, since it does not
contain proper symblink, while LLVM is looking only for
"llvm-symbolizer" (without version) - [1]:

  [1]:
c444af1c20/compiler-rt/lib/sanitizer_common/sanitizer_symbolizer_posix_libcdep.cpp (L454)

Follow-up for: #40655
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-09-04 14:03:34 +02:00
Alexey Milovidov
c4adc9ed8f Remove trash 2022-09-04 04:28:08 +02:00
Ilya Golshtein
74561b40ae stylecheck renewed 2022-09-02 17:42:18 +03:00
Alexander Tokmakov
8bdb589c2b Merge branch 'master' into zookeeper_client_fault_injection 2022-08-29 13:34:57 +02:00
alesapin
133ca01447 Merge branch 'master' into stress_s3 2022-08-29 11:25:28 +02:00
Alexey Milovidov
7bd1142f63
Merge pull request #40647 from ClickHouse/high-level-coverage 
Report high-level function and data types test coverage
 2022-08-27 23:13:10 +03:00
Alexey Milovidov
f86242c17e
Merge pull request #40699 from ClickHouse/remove-unbundled 
Remove the remaining parts of "unbundled" build
 2022-08-27 21:54:42 +03:00
Alexey Milovidov
00afbadb53
Merge branch 'master' into high-level-coverage 2022-08-27 19:34:26 +03:00
Azat Khuzhin
ebc61a36e0 tests/stress: improve OOM detection (add separate check by dmesg) 
Right now if you will look at the OOM errors:
- OOM killer (or signal 9) in clickhouse-server.log
- Backward compatibility check: OOM messages in clickhouse-server.log

Most of them are not real, but just clickhouse server got KILLed by
clickhouse stop, #40678 may imporove the situation, but to definitely
sure that there was OOM let's look at dmesg.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-08-27 12:46:58 +02:00
Alexey Milovidov
91ed3ebe9a Remove the remaining parts of "unbundled" build 2022-08-27 02:18:47 +02:00
Alexey Milovidov
2a7d9f0778 Merge branch 'master' into high-level-coverage 2022-08-26 23:44:52 +02:00
Azat Khuzhin
3b519c5d44 tests/stress: capture stacktrace of server hungs if pid was removed already 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-08-26 22:06:32 +03:00
Alexander Tokmakov
a3f7d1a5cc
Merge pull request #40662 from ClickHouse/tavplubix-patch-3 
Remove garbage from runlog.log in functional tests
 2022-08-26 17:01:31 +03:00
Alexander Tokmakov
263c467d90
Update setup_hdfs_minicluster.sh 2022-08-26 14:09:42 +03:00
Alexander Tokmakov
76e3ab8c59
Update setup_hdfs_minicluster.sh 2022-08-26 13:33:12 +03:00
alesapin
704c4b2c5b Stop thread fuzzer on shutdown 2022-08-26 11:54:54 +02:00
Azat Khuzhin
ce88c7cb60 Add llvm-15 for llvm-symbolizer-15 for clang-15 (used for TSan) 
Simply installing llvm-15 over TSAN_SYMBOLIZER_PATH had been prefered
(to keep everything in one place and as simple as possible), though
TSAN_SYMBOLIZER_PATH should also work.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-08-26 09:28:42 +02:00
Alexey Milovidov
440d10370a Report high-level function test coverage 2022-08-26 01:59:14 +02:00
alesapin
3ff6489fae Merge branch 'master' into stress_s3 2022-08-25 13:14:58 +02:00
alesapin
ad692f732a Merge branch 'master' into stress_s3 2022-08-25 13:13:30 +02:00
alesapin
35f9815b8e Fix backward comp check 2022-08-24 14:43:02 +02:00
Alexey Milovidov
35ce19ab63
Merge pull request #40354 from azat/tests/stress-dmesg-v3 
tests/stress: use --privileged over --cap-add syslog to obtain dmesg
 2022-08-20 14:13:55 +03:00
Alexey Milovidov
40ed829a29
Merge pull request #40074 from HeenaBansal2009/Entrypoint_Issue 
Entrypoint to check for HTTPS_PORT if http_port is disabled.
 2022-08-20 02:40:20 +03:00
Nikita Taranov
9f1ee52b00
Run all queries from changed perf tests (#40322) 
* impl

* fix
 2022-08-19 19:46:07 +02:00
Azat Khuzhin
50bddc43dc tests/stress: ignore NETLINK_ERROR from checkPermissionsImpl 
Since now with --privileged it has CAP_SYS_ADMIN and tries to
communicate via netlink.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-08-19 14:07:06 +02:00
Alexander Tokmakov
3d253ec51b
Merge branch 'master' into zookeeper_client_fault_injection 2022-08-18 21:23:50 +03:00
alesapin
922818bbd9 Merge branch 'stress_s3' of github.com:ClickHouse/ClickHouse into stress_s3 2022-08-18 14:46:50 +02:00
alesapin
932ea146f5 Merge branch 'master' into stress_s3 2022-08-18 13:14:47 +02:00
alesapin
86b1e33eed Disable cache on writes 2022-08-17 19:00:53 +02:00
alesapin
600d22851f Grep dangerous S3 errors 2022-08-17 12:43:11 +02:00
alesapin
0433b801d2 Configure properly 2022-08-17 12:27:15 +02:00
Alexander Tokmakov
ae000e9125
Merge branch 'master' into zookeeper_client_fault_injection 2022-08-17 12:48:54 +03:00
alesapin
1ec6627a70 Fix tables creation 2022-08-16 18:28:17 +02:00
kssenii
52832ea788 May be fix database replicated check 2022-08-16 11:51:57 +02:00
kssenii
eb26b219b9 Merge master 2022-08-16 00:56:27 +02:00
Alexander Tokmakov
589c3408d2
Merge pull request #40234 from ClickHouse/better_message_on_restore_covered 
Better error message when restoring covered parts
 2022-08-15 22:01:48 +03:00
alesapin
243bd492fa Trying to fix it 2022-08-15 20:55:11 +02:00
alesapin
96722a13bb Merge branch 'master' into stress_s3 2022-08-15 20:20:31 +02:00
Alexander Tokmakov
edaff70010 better error message when restoring covered parts 2022-08-15 13:53:14 +02:00
Alexey Milovidov
5ce6c07005 Set linker for RISC-V 64 2022-08-14 05:57:55 +02:00
Alexey Milovidov
6b8f4f1d59 Merge branch 'master' into server-side-time 2022-08-12 21:36:40 +02:00
Alexander Tokmakov
46aaf842f8
Merge pull request #40031 from ClickHouse/fix_old_tmp_dirs_cleanup 
Fix old temporary directories cleanup
 2022-08-12 20:31:20 +03:00
Alexander Tokmakov
b3deae3593
Merge branch 'master' into flaky_check_ordinary 2022-08-12 18:11:39 +03:00
Alexey Milovidov
8c3d1f2b5b
Merge branch 'master' into server-side-time 2022-08-12 17:40:02 +03:00
Alexander Tokmakov
467ef7bbc2
Update run.sh 2022-08-12 14:30:18 +03:00
kssenii
768a207176 Merge master 2022-08-11 22:25:53 +02:00
Alexander Tokmakov
06e42a1b23 run tests with Ordinary database in flaky check 2022-08-11 21:32:03 +02:00
Heena Bansal
7779ac4707
Update entrypoint.sh 
Typo error.
 2022-08-11 12:01:05 -04:00
HeenaBansal2009
f9347aa9ec Merge branch 'Entrypoint_Issue' of github.com:HeenaBansal2009/ClickHouse into Entrypoint_Issue 2022-08-11 06:51:16 -07:00
HeenaBansal2009
8880171899 Add --no-check-certificate in wget 2022-08-11 06:49:45 -07:00
Alexander Tokmakov
b9d18182f2 fix 2022-08-11 15:27:26 +02:00
Anton Popov
0ba886f763 enable fuzzing of table definitions 2022-08-11 12:24:15 +00:00
Maksim Kita
627424889d
Merge pull request #39926 from azat/dict-prom-fix 
Remove dictionaries from prometheus metrics on DETACH/DROP
 2022-08-11 13:10:47 +02:00
Alexey Milovidov
c54985ff71
Update entrypoint.sh 2022-08-11 09:46:24 +03:00
Heena Bansal
fd03038722
Merge branch 'master' into Entrypoint_Issue 2022-08-11 00:10:45 -04:00
HeenaBansal2009
653ad05ce9 Addresed review comments 2022-08-10 21:10:01 -07:00
Anton Popov
e347fa2f45 add fuzzer for table definition 2022-08-11 02:34:10 +00:00
Alexey Milovidov
c323f64804 Fix Fasttest 2022-08-11 03:29:46 +02:00
HeenaBansal2009
0d2aa07b4d Updated entrypoint.sh to listen on https_port if defined 2022-08-10 11:30:06 -07:00
HeenaBansal2009
3658530088 Updated entrypoint.sh to listen on https_port if defined 2022-08-10 11:23:15 -07:00
Alexander Tokmakov
bb46bfa6d9
Update process_functional_tests_result.py 2022-08-10 21:20:52 +03:00
Alexey Milovidov
cbeba683d8
Merge pull request #40017 from ClickHouse/ci-self-extracting-s3-deployment-2 
copy self-extracting to output
 2022-08-10 21:10:23 +03:00
Alexey Milovidov
774ba4db23 Remove old code 2022-08-10 19:44:13 +02:00
Alexey Milovidov
7aff85fc79 Fix test Dockerfile 2022-08-10 19:41:29 +02:00
kssenii
5c3227ba56 Merge master 2022-08-10 12:00:34 +02:00
kssenii
0dda03c94b Fix checks 2022-08-10 00:06:58 +02:00
Alexey Milovidov
f7d995681b
Merge branch 'master' into replace-yandex-to-noto 2022-08-09 22:43:52 +03:00
Yakov Olkhovskiy
09e6b1a497
run clickhouse to decompress 2022-08-09 09:16:03 -04:00
Yakov Olkhovskiy
78cc2a970d
copy self-extracting to output 2022-08-09 02:40:17 -04:00
Alexander Tokmakov
3bc583c22b
Revert "copy self-extracting to output" 2022-08-08 20:13:40 +03:00
Alexey Milovidov
0921548a37
Merge pull request #39527 from pkit/pkit/fix_nats_tls 
fix nats-io TLS support
 2022-08-08 08:28:14 +03:00
Alexey Milovidov
0349d9da96 Change font in CI reports just in case (might be worse) 2022-08-08 07:25:29 +02:00
Alexey Milovidov
cb7f072fe8
Merge pull request #39617 from ClickHouse/ci-self-extracting-s3-deployment 
copy self-extracting to output
 2022-08-08 08:19:15 +03:00
kssenii
e81f85a79e Fix checks 2022-08-07 16:44:02 +02:00
Yakov Olkhovskiy
19d74d7871
Merge branch 'master' into ci-self-extracting-s3-deployment 2022-08-07 07:24:22 -04:00
BoloniniD
24f3b00193
Merge branch 'master' into BLAKE3 2022-08-06 19:48:10 +03:00
Azat Khuzhin
791377e4dc tests: avoid prometheus.port overlap for replicated database 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-08-06 13:00:53 +03:00
Azat Khuzhin
3772415588 tests/stress: add dmesg output (to see OOM details) 
max_server_memory_usage already set to 75%, so OOM should not happens,
the reason is that because RSS does not match with memory tracker
statistics:

    2022.08.05 12:36:57.869896 [ 82524 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 64.69 GiB, peak 65.26 GiB, will set to 62.80 GiB (RSS), difference: -1.89 GiB
    ...
    2022.08.05 12:37:00.213440 [ 82334 ] {} <Error> void DB::MergeTreeBackgroundExecutor<DB::MergeMutateRuntimeQueue>::routine(DB::TaskRuntimeDataPtr) [Queue = DB::MergeMutateRuntimeQueue]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 64.68 GiB (attempt to allocate chunk of 1298794 bytes), maximum: 51.44 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or orvercommit denominator are set to zero.. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-08-06 12:34:38 +03:00
Alexey Milovidov
20fdc5b77b
Merge pull request #39898 from pkit/pkit/fix_mkdir_nfs 
fix broken NFS mkdir introduced in #36341
 2022-08-06 01:54:57 +03:00