thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-25 09:02:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
81,375 Commits 9,170 Branches 1,781 Tags 2.1 GiB
eaa0e4e542
Commit Graph

2747 Commits

Author SHA1 Message Date
taiyang-li
9036b18c2f merge master 2021-12-27 15:12:48 +08:00
alesapin
118004015a Longer timeout for server start in fuzzer 2021-12-24 14:56:51 +03:00
alexey-milovidov
b248b69c3b
Merge pull request #32854 from ClickHouse/pvs-nproc 
Use all available processors for checks
 2021-12-23 08:00:12 +03:00
alesapin
bc03e5e10f
Merge pull request #32983 from ClickHouse/add_woboq_build 
Trying to add woboq to new CI
 2021-12-21 23:05:38 +03:00
Mikhail f. Shiryaev
1b623f6b71
Autodetect threads count for fast tests as half of CPUs 2021-12-21 15:43:09 +01:00
Mikhail f. Shiryaev
eefdeabff2
Delete code coverage image 2021-12-21 15:43:08 +01:00
Mikhail f. Shiryaev
b0e37b808e
Use all available processors for PVS sturio check 2021-12-21 15:43:04 +01:00
alesapin
a89a05c0da Finally woboq is ready 2021-12-21 14:16:21 +03:00
taiyang-li
2597925724 merge master 2021-12-21 15:55:39 +08:00
alesapin
532b01c371 Followup 2021-12-21 10:49:22 +03:00
alesapin
62eb504029 Trying to add woboq 2021-12-20 22:43:37 +03:00
Vitaly Baranov
e61d3eef0c
Merge pull request #32747 from vitlibar/improve-grpc-compression 
Improve gRPC compression support
 2021-12-20 19:44:58 +03:00
Vitaly Baranov
708439b036 Support customized compression for input/output data in gRPC protocol. 2021-12-19 16:29:44 +03:00
alexey-milovidov
9c04901117
Merge pull request #32801 from ClickHouse/better_gdb_script 
More diagnostics in gdb script
 2021-12-19 08:00:12 +03:00
Azat Khuzhin
492fa98276 Add replxx/jemalloc into fasttest build of clickhouse 
Both of the are pretty small, and so should not affect build time, but
will have additional bonus, since jemalloc is the production allocator
and replxx is just useful to use binary with completion (and later some
test can be enabled for fasttest with completion)
 2021-12-17 22:09:05 +03:00
alesapin
d36f828b9c
Merge pull request #32910 from ClickHouse/performance_retry 
More retries in perf tests.
 2021-12-17 19:20:50 +03:00
alesapin
c2e8a73f14 Fix style 2021-12-17 16:43:58 +03:00
Mikhail f. Shiryaev
6f6b7c7bac
Merge pull request #32905 from ClickHouse/add_dockerhub_proxy 
Add dockerhub proxy to CI
 2021-12-17 14:31:50 +01:00
alesapin
1931726e15 Followup 2021-12-17 16:19:44 +03:00
alesapin
24480ac4de More agressive retries in perf tests 2021-12-17 16:16:35 +03:00
alesapin
47c907d41a Add dockerhub proxy 2021-12-17 13:20:48 +03:00
Vladimir C
fa011c66b7
Merge pull request #32846 from vdimir/flaky_test_s3_zero_copy_replication 2021-12-17 12:09:21 +03:00
vdimir
3f118f6734
Try fix flaky test: order for test_s3_zero_copy_replication 2021-12-17 12:08:39 +03:00
taiyang-li
d033fc4c24 merge master and fix conflict 2021-12-17 15:11:21 +08:00
alexey-milovidov
e834d655a5
Merge pull request #32415 from ClickHouse/arm64_workers 
Add arm64/aarch64 tests
 2021-12-17 08:46:52 +03:00
Mikhail f. Shiryaev
d2d1f5aba7
Optimize binary packager container 2021-12-16 13:00:31 +01:00
Mikhail f. Shiryaev
91083bea21
Fix building of packager containers 2021-12-16 12:42:49 +01:00
Mikhail f. Shiryaev
eb5a26891f
Add aarch64 deb package 2021-12-16 12:42:49 +01:00
alesapin
c9b03eaf64
Update entrypoint.sh 2021-12-15 22:28:21 +03:00
alesapin
6f2543b943 Better fix 2021-12-15 18:50:11 +03:00
alesapin
6799ce2162 Add retries to curl 2021-12-15 18:46:40 +03:00
Alexander Tokmakov
bd5931e5af improve gdb script 2021-12-15 13:21:21 +03:00
tavplubix
2cf5456423
Merge pull request #32511 from ClickHouse/fix_attaching_gdb2 
Try to fix attaching gdb 2
 2021-12-14 21:10:00 +03:00
mergify[bot]
68c96f4dd4
Merge branch 'master' into add_performance_tests 2021-12-14 11:04:41 +00:00
taiyang-li
8234d1176f merge master 2021-12-14 10:39:21 +08:00
Kseniia Sumarokova
78ed383f15
Merge pull request #31505 from ContentSquare/azure_blob_storage_dependency 
Azure Blob Storage Disks
 2021-12-13 18:28:48 +03:00
alesapin
3eb5e42972 Trying to allow bigger timeout for prewarm 2021-12-13 18:09:29 +03:00
alesapin
8e1fec39cd Fix bash 2021-12-13 12:58:34 +03:00
alesapin
e2a2d1cdc3 Merge branch 'master' into add_performance_tests 2021-12-13 12:01:31 +03:00
alesapin
cf281b10dc Split perf test into multiple checks 2021-12-13 11:59:58 +03:00
李扬
8675086104
Merge branch 'master' into hive_table 2021-12-12 09:01:46 -06:00
Azat Khuzhin
44f366fd12 Cleanup perf test runner 
Use subshell to:
- avoid change/restore of TIMEFORMAT
- grepping out trace output, by using set +x in a subshell
- use array for options to avoid extra backslashes
 2021-12-12 13:58:00 +03:00
alesapin
eb51d9550d
Merge branch 'master' into add_performance_tests 2021-12-12 01:01:13 +03:00
Azat Khuzhin
8a89b8e395 perf: do not fail in case of slow queries (to avoid hiding possible issues) 
Do not stop processing pathologically slow queries,
since this may hide errors in other queries,
i.e. when the test failed on one of servers (upstream or from PR)
and someone interpret this is as OK with the following comment:

  "the failure was on the upstream server it is OK, PR should fix it"

Anyway there is almost zero such queries right now, and before merging
something this should be reviewed.
 2021-12-12 00:15:25 +03:00
Azat Khuzhin
4e4837758a Remove readline support 
- it was not nested for a long time
- replxx is an upstream way for completion
 2021-12-11 11:29:59 +03:00
Kseniia Sumarokova
7e0bc290da
Merge pull request #32460 from kssenii/mongo-extend-auth 
Allow empty credentials for mongo engine
 2021-12-11 10:42:15 +03:00
Jakub Kuklis
e58f74d8dc Connecting to Azurite and invoking simple INSERTs works in the integration test 2021-12-10 22:04:38 +01:00
Jakub Kuklis
abd685e14c Installing azure-storage-blob in the integration tests docker, raising exception when not connected to Azurite, changing ports in the Azurite docker 2021-12-10 22:04:38 +01:00
Jakub Kuklis
910db6ca57 Code cleanup addressing PR remarks 2021-12-10 22:04:38 +01:00
Jakub Kuklis
850c9a7e7a Reverting submodule changes to fast test docker and disabling Blob Storage support when files missing 2021-12-10 22:04:38 +01:00
Jakub Kuklis
37a23b402b Add missing dependencies for azure for fast test 2021-12-10 22:04:38 +01:00
Jakub Kuklis
024a3b4626 Fixing submodule update for clickhouse compilation in the fast test 2021-12-10 22:04:38 +01:00
Jakub Kuklis
639d8a2b38 Running Azurite docker in the integration test for Blob Storage support 2021-12-10 22:04:37 +01:00
Alexander Tokmakov
dfa31a6577 fix 2021-12-10 22:38:34 +03:00
alesapin
5a542516e6
Merge pull request #32515 from ClickHouse/revert-32514-revert-32496-smaller_checks 
Revert "Revert "Split long tests into multiple checks""
 2021-12-10 22:30:04 +03:00
Kseniia Sumarokova
2cd5a15193
Update docker_compose_mongo.yml 2021-12-10 22:02:28 +03:00
tavplubix
5079134ffd
Update run.sh 2021-12-10 20:10:49 +03:00
Alexander Tokmakov
254d6c5d59 fix 2021-12-10 20:07:28 +03:00
alesapin
84bccb83bd Trying to add debug info 2021-12-10 19:38:20 +03:00
alesapin
a6e55b00e3
Revert "Revert "Split long tests into multiple checks"" 2021-12-10 18:39:02 +03:00
alesapin
dcbba460c1
Revert "Split long tests into multiple checks" 2021-12-10 18:38:42 +03:00
Alexander Tokmakov
3ff8aff1b5 try to fix attaching gdb 2021-12-10 18:03:57 +03:00
kssenii
46356a34a3 Update pymongo 2021-12-10 14:58:17 +00:00
kssenii
b6b73ba5b2 pymongo 2021-12-10 14:54:55 +00:00
alesapin
a2aa0bc6cc
Merge pull request #32496 from ClickHouse/smaller_checks 
Split long tests into multiple checks
 2021-12-10 17:42:14 +03:00
alesapin
f655b43f5a Merge branch 'master' into add_performance_tests 2021-12-10 12:32:43 +03:00
alesapin
4c1babee05 Split long functional tests to multiple checks 2021-12-10 12:07:24 +03:00
mergify[bot]
a07061ac84
Merge branch 'master' into update-mongo-contrb 2021-12-10 08:57:16 +00:00
alexey-milovidov
6ce2559078
Merge branch 'master' into feature/dotnet-integration-test 2021-12-10 01:25:47 +03:00
tavplubix
85e53b1b1f
Try fix attaching gdb in tests (#32448) 
* attach gdb with sudo

* fix

* Update run.sh
 2021-12-10 00:12:45 +03:00
Kseniia Sumarokova
f2dfa89bc9
Update docker_compose_mongo.yml 2021-12-09 23:58:46 +03:00
kssenii
f5a77fca39 Done 2021-12-09 14:44:25 +00:00
Kruglov Pavel
ef42cd6821
Merge pull request #32138 from Avogar/fix-apply-lambda 
Fix 'APPLY lambda' parsing
 2021-12-09 17:09:11 +03:00
alesapin
89ac8da76e Fix build path 2021-12-09 16:02:29 +03:00
tavplubix
f4cbbfd8c0
Update run-fuzzer.sh 2021-12-09 14:17:55 +03:00
tavplubix
de0a9a84a9
Update run-fuzzer.sh 2021-12-09 13:51:39 +03:00
Nikita Mikhaylov
dbf5091016
Parallel reading from replicas (#29279) 2021-12-09 13:39:28 +03:00
Kruglov Pavel
1df2383d00
Update run-fuzzer.sh 2021-12-09 12:17:31 +03:00
alesapin
b62de9b2f4 Merge branch 'master' into add_performance_tests 2021-12-09 11:40:32 +03:00
robot-clickhouse
f2ccddb7be Auto version update to [21.13.1.1] [54458] 2021-12-09 00:33:01 +03:00
kssenii
b6c1d1e72e Use latest version for tests 2021-12-08 21:09:11 +00:00
avogar
51bb37715f Fix fuzzer 2021-12-08 21:29:50 +03:00
Nikita Mikhaylov
d3d4524390 Merge branch 'master' of github.com:ClickHouse/ClickHouse into get_fuzz_data 2021-12-07 10:32:03 +00:00
tavplubix
523e23cfcd
Merge pull request #32164 from azat/stress-ignore-mem-limit 
Fix stress tests
 2021-12-07 13:10:17 +03:00
Nikita Mikhaylov
80a146816c More comments and style 2021-12-06 21:34:52 +00:00
Nikita Mikhaylov
fa22fdc097 Merge branch 'master' of github.com:ClickHouse/ClickHouse into get_fuzz_data 2021-12-06 14:30:49 +00:00
Azat Khuzhin
f8bf3b1993 stress: use max_memory_usage_for_user as a soft limit to avoid memory limit exceeded 
By using max_memory_usage_for_user as a soft limit, and after
max_server_memory_usage as a hard, we can allow normal overcommit, using
max_memory_usage_for_user=0 instead of relying on max_untracked_memory.
 2021-12-06 09:05:34 +03:00
Azat Khuzhin
f9a95fce13 stress: allow memory overcommit for SELECT 1 query 2021-12-06 09:02:56 +03:00
Azat Khuzhin
1167313961 stress: allow memory overcommit for one more query 2021-12-06 09:02:56 +03:00
Azat Khuzhin
7063ea3ee2 stress: add make_query_command() helper 2021-12-06 09:02:56 +03:00
Azat Khuzhin
adec690166 stress: SYSTEM DROP MARK CACHE 2021-12-06 09:02:56 +03:00
Azat Khuzhin
d3a7aed005 stress: tune memory_profiler_step too 2021-12-06 09:02:56 +03:00
Azat Khuzhin
169941c5d0 stress: allow 100MiB of memory to overcommit for SHOW/DROP DATABASE 
CI: https://s3.amazonaws.com/clickhouse-test-reports/32019/b6290ae00223fc91d514b82de25e195ab34f8bca/stress_test__thread__actions_.html
 2021-12-06 09:02:56 +03:00
Azat Khuzhin
445b0983ea stress: ignore server memory limits for hung check 
In [1] hung check failed because the server was under memory pressure.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/32019/b6290ae00223fc91d514b82de25e195ab34f8bca/stress_test__undefined__actions_.html
 2021-12-06 09:02:56 +03:00
Azat Khuzhin
3e96b28843 perf: convert killall to pkill (since killall has some magic, see -e option) 2021-12-03 10:56:42 +03:00
Azat Khuzhin
fb0cc62509 perf: fix waiting of the server after running tests 
killall requires strict match, i.e. "clickhouse-server" not
"clickhouse":

    2021-12-03 05:24:56      + env kill -- -21700
    2021-12-03 05:24:56      kill: (-21700): No such process
    2021-12-03 05:24:56      + killall clickhouse
    2021-12-03 05:24:56      clickhouse: no process found
    2021-12-03 05:24:56      + echo Servers stopped.
    2021-12-03 05:24:56      Servers stopped.
    2021-12-03 05:24:56      + analyze_queries

    $ tail -n1 *-server-log.log
    ==> left-server-log.log <==
    2021.12.03 05:26:59.530647 [ 450 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 1668052

    ==> right-server-log.log <==
    2021.12.03 05:27:20.873136 [ 466 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 9605

    ==> setup-server-log.log <==
    2021.12.03 02:47:14.844395 [ 96 ] {} <Information> Application: Child process exited normally with code 0.

As you can see killall instantly fails with no such process, while this
cannot be true since it was there, and also according to logs there were
messages after running analyze_queries() from compare.sh

This should fix problems like in [1].

  [1]: https://clickhouse-test-reports.s3.yandex.net/32080/344298f4037f88b114b8e798bb30036b24be8f16/performance_comparison/report.html#fail1
 2021-12-03 10:55:35 +03:00
taiyang-li
2f4e7e1d4e merge master 2021-12-02 19:48:21 +08:00
Azat Khuzhin
e976cd8691 Provide clickhouse binary w/o debug symbols (stripped) in fasttest 
- regular binary: 1.8G
- stripped: 343M (5x less)
- gzipped stripped: 92M (20x less)

This can be useful to check something fast.
 2021-12-01 21:50:03 +03:00
alesapin
b4d4295c16 Followup 2021-11-30 13:24:04 +03:00
alesapin
085a30b98e Fixup 2021-11-30 13:22:50 +03:00