Commit Graph

1018 Commits

Author SHA1 Message Date
alesapin
c40ba48822 Raise on error 2020-09-08 11:49:24 +03:00
alesapin
1a1bccf416 Add sleeps 2020-09-08 11:45:22 +03:00
alesapin
73253f058d Add sleep 2020-09-08 11:45:01 +03:00
alesapin
0193a132d4 Add retries to s3 downloader 2020-09-08 11:43:02 +03:00
Anton Popov
9493532fdb rework test for redis dictionary 2020-09-07 14:16:47 +03:00
Alexander Kuzmenkov
f7d631bf82 use fasttest script from sources 2020-09-07 13:19:01 +03:00
Alexey Milovidov
04a6965006 Fix error with executable dictionary source 2020-09-07 09:40:01 +03:00
Alexander Kuzmenkov
0904433c87 Temporarily remove UInt256 perf test broken in https://github.com/ClickHouse/ClickHouse/pull/14229
Also add one more timeout to perf test runner.
2020-09-07 09:33:57 +03:00
Alexander Kuzmenkov
1978968067 performance comparison 2020-09-07 02:49:34 +03:00
Vitaly Baranov
81db73f066
Merge pull request #13647 from qoega/integration-explicit-configs
Add explicit main_configs, user_configs and dictionaries in integration tests
2020-09-04 20:16:00 +03:00
Alexander Tokmakov
ed5f827708 Merge branch 'master' into write_structure_of_table_functions 2020-09-04 16:38:57 +03:00
alesapin
5d897231e1
Merge pull request #14432 from ClickHouse/minor-changes-in-stateful-tests
Wait for clickhouse-server to start in stateful tests
2020-09-04 13:12:32 +03:00
Alexander Tokmakov
b840d741d0 Merge branch 'master' into write_structure_of_table_functions 2020-09-04 13:00:07 +03:00
Alexander Tokmakov
df09bf3cb6 add suppressions for leak sanitizer 2020-09-03 22:50:26 +03:00
alexey-milovidov
fb56d0b9a3
Update run.sh 2020-09-03 21:21:27 +03:00
Alexander Kuzmenkov
29b97ff259
Merge pull request #14430 from ClickHouse/aku/perf4
[wip] perf experiment no.4 -- geomean
2020-09-03 21:13:07 +03:00
Vasily Nemkov
9ba4613381 Excluding tests from fasttest runs since they depend on external libraries: OpenSSL 2020-09-03 16:12:32 +03:00
Yatsishin Ilya
14b61e87d9 mysql bin log 2020-09-03 13:27:17 +03:00
Yatsishin Ilya
fc075e65da Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-09-03 11:49:48 +03:00
Alexey Milovidov
cd812d94de Wait for clickhouse-server to start in stateful tests 2020-09-03 04:54:50 +03:00
Alexander Kuzmenkov
a321d6970c adjust report and increase time 2020-09-03 04:42:25 +03:00
Alexander Kuzmenkov
8e8e195e45 geomean 2020-09-03 03:58:40 +03:00
alesapin
12f76d9448
Merge pull request #14325 from azat/suppress-wget-output
Suppress superfluous wget (-nv) output
2020-09-02 14:59:28 +03:00
Yatsishin Ilya
5ab9f249e5 Merge branch 'try-dns-fix' into integration-explicit-configs 2020-09-02 12:53:10 +03:00
Yatsishin Ilya
6902bbce50 Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-09-02 12:48:07 +03:00
Yatsishin Ilya
5d39b8ce04 unnecessary change 2020-09-02 11:39:16 +03:00
Alexander Kuzmenkov
00c924b0dd whitespace 2020-09-02 06:31:53 +03:00
Alexander Kuzmenkov
5fcb9bd163 short queries 2020-09-02 06:29:36 +03:00
Alexander Kuzmenkov
e622e108f7 readme 2020-09-02 06:29:16 +03:00
Alexander Kuzmenkov
0db5b4a72c Remove concurrent benchmark from the perf test
It's not stable enough and has only secondary utility.
2020-09-02 02:43:23 +03:00
Alexander Kuzmenkov
f6cfb96748
Merge pull request #14346 from ClickHouse/aku/fuzzer
Don't let the fuzzer change max_execution_time
2020-09-02 01:59:50 +03:00
Anton Popov
7c3712c121
Merge pull request #13688 from it1804/master
Redis dictionary support for simple Redis requirepass authorization
2020-09-02 01:43:02 +03:00
Alexander Kuzmenkov
a6486490a2 performance comparison 2020-09-01 22:05:57 +03:00
Alexander Kuzmenkov
0b70abe542 Don't let the fuzzer change max_execution_time 2020-09-01 18:51:46 +03:00
Alexander Kuzmenkov
2f3bb5844a
Merge branch 'master' into suppress-wget-output 2020-09-01 16:59:04 +03:00
Alexander Kuzmenkov
4620ac4c0d
Update docker/test/fuzzer/run-fuzzer.sh 2020-09-01 16:57:20 +03:00
Alexander Kuzmenkov
4e58f00305
Update docker/test/fuzzer/run-fuzzer.sh 2020-09-01 16:57:13 +03:00
Alexander Kuzmenkov
73d433a7dd
Merge pull request #14316 from ClickHouse/aku/html-fuzzer
Add a HTML report for AST Fuzzer
2020-09-01 16:46:30 +03:00
Azat Khuzhin
2d7cb03120 Suppress superfluous wget (-nv) output
Since for dowloading some of files wget logging may take 50% of overall
log [1].

  [1]: https://clickhouse-builds.s3.yandex.net/14315/c32ff4c98cb3b83a12f945eadd180415b7a3b269/clickhouse_build_check/build_log_761119955_1598923036.txt
2020-09-01 10:25:13 +03:00
Yatsishin Ilya
6cb893f073 Draft. 2020-09-01 09:38:23 +03:00
Alexander Kuzmenkov
33c5815eb3 Add a HTML report for AST Fuzzer 2020-09-01 02:33:42 +03:00
robot-clickhouse
e2fa0eae2f Auto version update to [20.9.1.1] [54439] 2020-08-31 23:07:41 +03:00
Alexander Kuzmenkov
bc8765d5ad
Merge pull request #14095 from azat/DistributedFilesToInsert-fix
Fix DistributedFilesToInsert metric (zeroed when it should not)
2020-08-31 18:58:30 +03:00
Alexander Kuzmenkov
b601dd4596 cosmetic fixes for performance report 2020-08-29 01:46:04 +03:00
Alexander Kuzmenkov
bb28320107 cosmetic fixes in performance report 2020-08-29 01:14:48 +03:00
Azat Khuzhin
a384194216 Add a test for DistributedFilesToInsert 2020-08-27 22:00:35 +03:00
Ilya Yatsishin
7509991d82
Merge pull request #14167 from qoega/docker-test-base
Switch docker tests to use test-base
2020-08-27 16:45:55 +03:00
alexey-milovidov
e1cf919c93
Merge pull request #14112 from vzakaznikov/testflows_increase_compose_http_timeout_and_retry_docker_compose_up
testflows: adding retry logic when bringing up docker-compose cluster
2020-08-27 15:51:16 +03:00
Alexander Tokmakov
65a69ff6ad move docker-compose files 2020-08-27 14:46:19 +03:00
Yatsishin Ilya
bfe4e94806 Switch docker tests to use test-base 2020-08-27 13:17:17 +03:00
Alexey Milovidov
fe5cfe3151 Increase number of threads in stress test 2020-08-26 23:39:02 +03:00
Alexey Milovidov
0bfe78636c Increase number of threads in stress test 2020-08-26 23:38:20 +03:00
alexey-milovidov
f62037e9dc
Update stress 2020-08-26 20:45:36 +03:00
Alexey Milovidov
07596b5323 Limit stress test to one hour 2020-08-26 20:44:03 +03:00
Vitaliy Zakaznikov
eb01601944 Adding retry login when bringing docker-compose cluster
Moving to using testflows version 1.6.42
2020-08-26 10:00:12 -04:00
alexey-milovidov
5d31442fa8
Delete perf.py.orig 2020-08-26 03:26:54 +03:00
Konstantin Podshumok
cda4472ebc
dockerfiles: verify 3rd party apt repos, disable LLVM in PVS check
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:44 +03:00
alexey-milovidov
ad64cea4aa
Merge pull request #13980 from ClickHouse/fix-stress-test-2
Attempt to fix stress test
2020-08-24 22:03:32 +03:00
Ilya Yatsishin
20bff27eef
Merge pull request #13995 from qoega/stateless-unbundled
Separate stateless unbundled image
2020-08-24 19:49:27 +03:00
Alexander Kuzmenkov
a348bc4641 performance comparison 2020-08-24 17:15:11 +03:00
Yatsishin Ilya
f2182db765 Separate stateless unbundled image 2020-08-24 13:05:56 +03:00
Alexey Milovidov
d44982072c More robust 2020-08-24 03:14:24 +03:00
Alexey Milovidov
1fb4294cdf Attempt to fix stress test 2020-08-24 00:13:21 +03:00
Alexey Milovidov
f4bf99fadc Better output of stress test 2020-08-23 23:48:27 +03:00
Yatsishin Ilya
7dcdde0775 Add docker test base separately to have :latest build available 2020-08-20 20:54:51 +03:00
Alexander Kuzmenkov
5c8013b083
Merge pull request #13892 from ClickHouse/aku/timeout-perf
Avoid timeouts in perf test
2020-08-20 18:14:26 +03:00
Alexander Kuzmenkov
3a0bdfa5f3 Publish list of tests that failed the concurrent fast test 2020-08-20 03:13:44 +03:00
Alexander Kuzmenkov
f43457454e warn on undefined shell variables 2020-08-19 18:34:23 +03:00
Alexander Kuzmenkov
e9ad81b362 shellcheck 2020-08-19 18:31:13 +03:00
Alexander Kuzmenkov
000326b627 Avoid timeouts in perf test 2020-08-19 18:08:23 +03:00
tavplubix
d95470f7c3
Update docker/test/stress/run.sh 2020-08-18 20:52:54 +03:00
Yatsishin Ilya
8fd70835d5 Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-08-18 17:31:41 +03:00
Nikita Mikhaylov
e7f8c0af52 done 2020-08-18 15:28:38 +03:00
Alexander Kuzmenkov
ce0dfe3fea Fix server restart in fasttest
Remove the server data before sequential test run, so that there is no
interference from the failed parallel run.

Also fix some shellcheck warning.
2020-08-18 13:24:37 +03:00
alexey-milovidov
3e6acf1329
Experiment with start/stop in stress test (#13779)
* Experiment with start/stop in stress test

* Support other installation options in "clickhouse start"

* Better diagnostics in install script

* Fixup

* Fixup

* Better diagnostics in stress test

* Update run.sh
2020-08-18 12:43:02 +03:00
Alexey Milovidov
47889b0f2b Install codespell 2020-08-16 14:59:16 +03:00
Ivan A. Torgashov
1006c4f11b Update tests for Redis dictionary requirepass authorization support 2020-08-15 14:18:17 +05:00
Alexey Milovidov
0140093b17 Fix fast test 2020-08-15 10:11:19 +03:00
Alexander Kuzmenkov
ecc40b7c75
Merge pull request #13724 from qoega/docker-style
Add docker image for style check, add check for docker files placement
2020-08-15 03:01:39 +03:00
Alexander Kuzmenkov
1cbfd1327a
trigger the CI 2020-08-15 01:40:40 +03:00
Yatsishin Ilya
ab337b243a Add docker for style check 2020-08-14 16:09:23 +03:00
Alexander Tokmakov
128b19fdba Merge branch 'master' into use_atomic_engine_for_system_db 2020-08-14 13:47:44 +03:00
Yatsishin Ilya
73e9f4d421 update test_materialize_mysql_database test 2020-08-13 21:20:47 +03:00
Alexander Tokmakov
a5d74c44f1 run stress tests with Atomic database 2020-08-13 20:55:12 +03:00
Ilya Yatsishin
e6420c82ca
mysql/postgresql: move Dockerfiles and docker_compose to docker/test (#13448)
* mysql/postgresql: move Dockerfiles and docker_compose to docker/test
* Build client containers in CI
* pass tag to docker_compose
2020-08-12 18:04:36 +03:00
Yatsishin Ilya
730056a9f0 fix 2020-08-12 15:22:31 +03:00
Yatsishin Ilya
f663f794b0 Merge remote-tracking branch 'qoega/integration-explicit-configs' into integration-explicit-configs 2020-08-12 14:58:41 +03:00
Alexander Kuzmenkov
6fdfe65694 performance comparison 2020-08-12 11:55:51 +03:00
Yatsishin Ilya
160776f183 Add explicit main_configs, user_configs and dictionaries in integration tests. 2020-08-12 11:55:04 +03:00
Alexander Kuzmenkov
89b712a180 performance comparison 2020-08-12 08:40:03 +03:00
Yatsishin Ilya
fdd18e540d move reference files 2020-08-12 07:06:23 +03:00
Alexander Kuzmenkov
7547b850d6 performance comparison 2020-08-11 17:14:24 +03:00
Alexander Kuzmenkov
5a97f0c19e performance comparison 2020-08-11 14:53:25 +03:00
Yatsishin Ilya
e3f7fea33a fix 2020-08-11 11:31:26 +03:00
Yatsishin Ilya
1d0e4ca670 pass tag to docker_compose 2020-08-10 16:35:08 +03:00
Yatsishin Ilya
1884cfe110 Merge remote-tracking branch 'origin/master' into docker-mysql-postgres 2020-08-10 11:12:22 +03:00
robot-clickhouse
a82c0f5371 Auto version update to [20.8.1.1] [54438] 2020-08-07 21:45:49 +03:00
Yatsishin Ilya
70fca95a5a mysql/postgresql: move Dockerfiles and docker_compose to docker/test 2020-08-07 11:42:04 +03:00
Alexander Kuzmenkov
11727864dd performance comparison 2020-08-07 04:25:45 +03:00
Alexander Kuzmenkov
dbb65a8bd7 performance comparison 2020-08-06 16:28:51 +03:00
Alexander Kuzmenkov
a92438eff2 performance comparison 2020-08-06 02:33:32 +03:00
Alexander Kuzmenkov
88aa371e0c performance comparison 2020-08-06 02:02:52 +03:00
Alexander Kuzmenkov
d1554e76ec Merge remote-tracking branch 'origin/master' into HEAD 2020-08-06 00:59:25 +03:00
Alexander Kuzmenkov
ff3f378e8a try to rebuild package for 2b7c0167cb 2020-08-06 00:58:56 +03:00
Alexander Kuzmenkov
9cac8a7244 performance comparison 2020-08-05 19:07:37 +03:00
Alexander Kuzmenkov
7945041a9a perf test error summary 2020-08-05 18:56:51 +03:00
alesapin
63391bbb66
Merge pull request #13382 from Enmk/fasttest-fix-query_masking_rules.xml
Keep original query_masking_rules.xml when performing fasttests
2020-08-05 17:47:33 +03:00
alesapin
a18461091f
Merge pull request #13384 from ClickHouse/fix_fast_test_server_kill
Better kill in fast test
2020-08-05 17:42:52 +03:00
alesapin
87c56f9556 Symlink for server logs 2020-08-05 16:15:06 +03:00
alesapin
c862ae93d1 Replace backticks with modern alternative 2020-08-05 16:10:47 +03:00
alesapin
68a9499e92 Simplier kill clickhouse server 2020-08-05 15:59:52 +03:00
alesapin
cdad1e718f Better kill in fast test 2020-08-05 15:37:54 +03:00
Vasily Nemkov
baed365c19 Keep original query_masking_rules.xml when performing fasttests 2020-08-05 15:14:20 +03:00
alexey-milovidov
d94e556455
Merge pull request #13321 from ClickHouse/restart_server_with_timeout
Restart server in stress test with timeout
2020-08-05 00:43:45 +03:00
alexey-milovidov
18ef0c0c96
Update run.sh, thanks @azat 2020-08-04 20:54:09 +03:00
alesapin
bd0322421b Better timeout 2020-08-04 17:28:35 +03:00
alesapin
caf0bcdc86 More timeouts 2020-08-04 11:48:47 +03:00
alesapin
ee5153bbc4 Restart server in stress test with timeout 2020-08-04 11:47:20 +03:00
alesapin
b69e6b935b
Wait with retries in fast test (#13284) 2020-08-03 21:05:35 +03:00
alexey-milovidov
935533e841
Merge pull request #13193 from ClickHouse/aku/spurious-perf
Fix some spurious perf test failures
2020-08-03 01:02:53 +03:00
Azat Khuzhin
8cbcd4027a Exclude 01413_rows_events from the fasttest (TRUNCATE query_log) 2020-08-02 13:30:00 +03:00
Azat Khuzhin
37c3f44dbe fasttest: use arrays for skip list (to make it more patch friendly)
Plus it looks better.
2020-08-02 13:29:31 +03:00
Vitaly Baranov
18b21511a9
Merge pull request #13013 from vitlibar/implement-custom-settings
Implement custom settings
2020-08-02 05:01:14 +03:00
Alexander Kuzmenkov
dd475fe82c
Update report.py 2020-08-01 13:10:36 +03:00
Alexander Kuzmenkov
a317f995be performance comparison 2020-07-31 22:58:38 +03:00
Vitaly Baranov
0fcee34322 Add test. 2020-07-31 20:57:49 +03:00
Alexander Kuzmenkov
1d954581eb Fix some spurious perf test failures 2020-07-31 19:28:04 +03:00
Alexander Kuzmenkov
6f861294f4 query fuzzer 2020-07-31 18:57:01 +03:00
Ilya Yatsishin
1566c8a92b
Merge pull request #12285 from qoega/rework-integrational
Rework integrational configuration paths
2020-07-31 15:34:21 +03:00
Alexander Kuzmenkov
e2e4fc9848 align numbers to the right in perf report 2020-07-31 13:59:15 +03:00
Alexander Kuzmenkov
42e5f8ec44
Update compare.sh 2020-07-31 03:49:36 +03:00
Alexander Kuzmenkov
db15108005 add times speedup/slowdown to changed tests table 2020-07-31 01:14:20 +03:00
Alexander Kuzmenkov
0e70e21b58
Update run-fuzzer.sh 2020-07-30 22:04:15 +03:00
Alexander Kuzmenkov
3d13da1c24 query fuzzer 2020-07-30 20:07:10 +03:00
Alexander Kuzmenkov
96125111fe
Merge pull request #13085 from ClickHouse/aku/fuzzer-error-code
Fix the AST fuzzer error message
2020-07-30 19:53:21 +03:00
Alexander Kuzmenkov
0e20507539
Update compare.sh 2020-07-30 17:26:47 +03:00
Alexander Kuzmenkov
f0fda359de pipefail 2020-07-30 16:43:22 +03:00
Alexander Kuzmenkov
b2b94ba13d
Update run-fuzzer.sh 2020-07-30 16:35:24 +03:00
Alexander Kuzmenkov
65771ad516 Fix the AST fuzzer error message 2020-07-29 20:05:38 +03:00
alesapin
5c1aa52f40 Better check for failed tests 2020-07-29 14:39:08 +03:00
alesapin
26ff008898 Remove test 2020-07-29 14:34:42 +03:00
alesapin
3a0d44b5b9 Merge branch 'master' into rerun_failed_in_fast_test 2020-07-29 12:54:18 +03:00
Yatsishin Ilya
58b6621dd3 Merge remote-tracking branch 'origin' into rework-integrational 2020-07-29 10:24:26 +03:00
Alexander Kuzmenkov
e0c207d6b4
Update entrypoint.sh 2020-07-28 16:15:41 +03:00
Yatsishin Ilya
b5722493f5 less changes 2020-07-28 16:11:29 +03:00
Yatsishin Ilya
7ca2a54e74 fix 2020-07-28 16:08:08 +03:00
Yatsishin Ilya
99ff6cae27 Merge remote-tracking branch 'origin/master' into rework-integrational 2020-07-28 14:35:51 +03:00
alesapin
d39318c8fe Grep in correct file 2020-07-28 14:23:49 +03:00
alesapin
3eb77ab076 Better kill 2020-07-28 14:22:25 +03:00
alesapin
a75657d88e Better 2020-07-28 14:18:08 +03:00
alesapin
8ff9e6c9de Rerun tests in fast test 2020-07-28 14:16:06 +03:00
alesapin
ff358be3d6
Merge pull request #12739 from ClickHouse/qoega-patch-1
Fix MySQL broken link
2020-07-27 19:51:01 +03:00
Alexander Kuzmenkov
b6f2fde37e performance comparison 2020-07-27 14:20:45 +03:00
Ilya Yatsishin
0517449e28
Update docker/test/integration/base/Dockerfile 2020-07-27 13:01:26 +03:00
alexey-milovidov
49beef860d
Merge pull request #12733 from ClickHouse/aku/perf-version
Choose proper old version for perf comparison
2020-07-24 15:24:00 +03:00
Alexander Kuzmenkov
9475b27936
Update run-fuzzer.sh 2020-07-24 00:07:23 +03:00
Ilya Yatsishin
c2e0954f26
Fix MySQL broken link 2020-07-23 22:33:55 +03:00
Alexander Kuzmenkov
acf1e5fe7e Choose proper old version for perf comparison 2020-07-23 18:17:11 +03:00
Alexander Kuzmenkov
15cd448afa
Update compare.sh 2020-07-23 17:59:32 +03:00
Alexander Kuzmenkov
186b2c3b1b Support different query log format in perf test 2020-07-23 16:32:03 +03:00
Alexander Kuzmenkov
2b7c0167cb
Update compare.sh 2020-07-22 21:02:56 +03:00
Alexander Kuzmenkov
c25348ded9 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-22 16:19:20 +03:00
Alexander Kuzmenkov
72167aa746
Update Dockerfile 2020-07-22 16:18:57 +03:00
alesapin
26a6f7993d
Merge pull request #12637 from qoega/helper_container
Do not build helper_container image inside integrational tests. Part 1: build helper_container in CI
2020-07-22 11:50:51 +03:00
Alexander Kuzmenkov
9f49bf2d82 fixup 2020-07-22 01:09:54 +03:00
Alexander Kuzmenkov
9956285091
Update run-fuzzer.sh 2020-07-22 01:02:05 +03:00
Yatsishin Ilya
9633215684 Do not build helper_container image inside integrational tests. Part 1: build helper_container in CI 2020-07-21 17:40:48 +03:00
Alexander Kuzmenkov
b26de8d2d1 Query fuzzer 2020-07-21 16:53:50 +03:00
Alexander Kuzmenkov
3d89f0e9df Perf test: bind server to one NUMA node 2020-07-21 15:41:14 +03:00
alesapin
e7a4bc8dae Even less tests in fasttest 2020-07-20 19:55:36 +03:00
alesapin
619f5f6180 Less tests in fast test 2020-07-20 19:44:48 +03:00
Alexander Kuzmenkov
abec684daf query fuzzer 2020-07-20 14:57:16 +03:00
Alexander Kuzmenkov
37b3cef4cb
Update run-fuzzer.sh 2020-07-17 21:41:33 +03:00
Alexander Kuzmenkov
039cf36acb Minor fixes for query fuzzer 2020-07-16 21:05:34 +03:00
alesapin
a4666df090 Even less tests in fasttest 2020-07-16 14:16:08 +03:00
alesapin
f7ffd2da36 Remove memory limiting tests 2020-07-16 14:12:47 +03:00
Vitaly Baranov
000b197ad1
Merge pull request #11234 from traceon/ldap-per-user-authentication
Add LDAP authentication support
2020-07-16 13:17:21 +03:00
alesapin
f7792d0145
Merge pull request #12294 from ClickHouse/fasttest
Add image for fast tests run (with clone, build, etc.)
2020-07-16 11:21:53 +03:00
alesapin
c86b2a407f
Merge pull request #12526 from Enmk/test_config_fix
Retain existing config.d/query_masking_rules.xml from server package
2020-07-16 11:16:56 +03:00
Denis Glazachev
59cb758cf7 Merge branch 'master' into ldap-per-user-authentication 2020-07-16 02:29:24 +04:00
Vitaliy Zakaznikov
0ef9fc9022 Moving to TestFlows version 1.6.39 2020-07-15 22:13:43 +02:00
alesapin
e35c49faa2 Merge branch 'master' into fasttest 2020-07-15 22:35:46 +03:00
alesapin
d6da417e71 Disable live view tests 2020-07-15 22:34:44 +03:00
alexey-milovidov
e7cf3f4e70
Merge pull request #12464 from ianton-ru/s3_profile_events
add profiling events from S3 request to system.events and system.quer…
2020-07-15 19:33:15 +03:00
alesapin
74181a30ae One more test to skip 2020-07-15 17:56:21 +03:00
alesapin
4892706d95 Simplify build configuration 2020-07-15 17:40:51 +03:00
alesapin
54255c10e1
Merge pull request #12496 from ClickHouse/restart_server_after_stress
Check server able to restart after stress
2020-07-15 17:23:27 +03:00
Alexander Kuzmenkov
00acf4173c Fixes for perf test after #12469 2020-07-15 16:38:02 +03:00
Vasily Nemkov
78f69bbfc4 Retain existing config.d/query_masking_rules.xml that come from server package 2020-07-15 16:11:43 +03:00
alesapin
3ab7bdbbbb One more test to skip 2020-07-15 15:16:59 +03:00
alesapin
ba05bb1b39 Better tests for parallel run 2020-07-15 14:47:51 +03:00
Anton Ivashkin
4c8498c115 Merge master 2020-07-15 14:16:10 +03:00
alesapin
530ad951bc Less tests 2020-07-15 12:29:31 +03:00
alesapin
a061418dab Remove redundant cmd 2020-07-15 12:23:50 +03:00
alesapin
ecea1e0292 Run tests in parallel 2020-07-15 11:49:50 +03:00
alesapin
00d2219808 Merge branch 'master' into fasttest 2020-07-15 11:35:15 +03:00
alesapin
43ba417132 Better submodules update 2020-07-15 11:34:38 +03:00
alesapin
a31109f023 Better submdoules 2020-07-14 21:44:57 +03:00
alesapin
c483de8a35 Check result in separate file 2020-07-14 18:00:24 +03:00
alesapin
c400048a48 Check server able to restart in stateless tests 2020-07-14 17:47:23 +03:00
Alexander Kuzmenkov
57ad000c62
Update README.md 2020-07-14 16:46:19 +03:00
Anton Ivashkin
52fea6a5a3 Merge master 2020-07-14 15:56:38 +03:00
alesapin
0740b88d6b Merge branch 'master' into fasttest 2020-07-14 15:19:05 +03:00
alesapin
86a6a5e2c6 Less tests to run 2020-07-14 15:17:35 +03:00
robot-clickhouse
0f23642a3d Auto version update to [20.7.1.1] [54437] 2020-07-13 18:26:03 +03:00
Alexander Kuzmenkov
d9ac91b34d query fuzzer 2020-07-13 18:16:54 +03:00
Alexander Kuzmenkov
028abb9dc4 query fuzzer 2020-07-13 16:58:48 +03:00
Alexander Kuzmenkov
5a15e03400 Improve data layout in perf test
Also fix a bad test query found with new data.
2020-07-13 14:31:15 +03:00
Alexander Kuzmenkov
c13425f0e9 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-13 14:29:10 +03:00
Anton Ivashkin
26fca949bd add profiling events from S3 request to system.events and system.query_log 2020-07-13 11:27:11 +03:00
alexey-milovidov
26d32f2ce5
Merge pull request #12412 from Jokser/s3-https
S3 HTTPS integration tests
2020-07-12 03:36:37 +03:00
Pavel Kovalenko
5a42dca252 Trigger integration-test-runner image rebuild. 2020-07-11 12:16:10 +03:00
Pavel Kovalenko
d4826a3df7 Replace build with proper images in docker_compose_minio.yml 2020-07-10 23:38:48 +03:00
Pavel Kovalenko
f43428a4d5 S3 HTTPS integration test. 2020-07-10 22:42:18 +03:00
alesapin
d69f925c30 Fix build 2020-07-10 22:28:21 +03:00
alesapin
d2fcbe1f4e Fix build 2020-07-10 22:27:12 +03:00
alesapin
69d6ad0a62 Disable bunch of tests 2020-07-10 22:12:25 +03:00
alesapin
a9824fd650 Better cmake and less libraries 2020-07-10 22:08:18 +03:00
alesapin
df176c633e Disable msgpack 2020-07-10 21:27:10 +03:00
alesapin
b70c3b607f No long tests 2020-07-10 20:44:29 +03:00
alesapin
0b1a1867a6 Less dependencies 2020-07-10 20:21:24 +03:00
alesapin
57d03bfbc0 Disable secure ports 2020-07-10 18:47:20 +03:00
Alexander Kuzmenkov
cd09cf8c0b Merge remote-tracking branch 'origin/master' into HEAD 2020-07-10 17:18:24 +03:00
Alexander Kuzmenkov
eb6fbdfd4b query fuzzer 2020-07-10 17:16:16 +03:00
alesapin
ce96262a2c
Update run.sh 2020-07-10 16:21:58 +03:00
Alexander Kuzmenkov
0fe4c37033 query fuzzer 2020-07-10 14:11:49 +03:00
alesapin
4ab5edadb7 Less libraries 2020-07-10 12:47:50 +03:00
Alexander Kuzmenkov
7af916e44a fuzzer docker image 2020-07-09 21:30:22 +03:00
Alexander Kuzmenkov
bbcdf12e4f fuzzer container fix 2020-07-09 20:19:36 +03:00
alesapin
51aaa8800d Don't skip libs 2020-07-09 18:34:19 +03:00
Alexander Kuzmenkov
e06b675801 fixes in fuzzer docker image 2020-07-09 14:55:54 +03:00
Alexander Kuzmenkov
761b03f17d add docker image for fuzzer 2020-07-09 14:21:55 +03:00
Alexander Kuzmenkov
394cf20673 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-09 13:46:54 +03:00
alesapin
960a730c7a Merge branch 'master' into fasttest 2020-07-09 13:14:09 +03:00
alexey-milovidov
1536e89abe
Merge pull request #12287 from ClickHouse/fix_skip_list_option_old_branches
Fix skip lists for old branches
2020-07-09 04:25:35 +03:00
alesapin
e0ff6bd6d7 Less libraries to build 2020-07-08 19:59:47 +03:00
alesapin
6378c79539 Fix script 2020-07-08 19:02:19 +03:00
alesapin
f30e2ea464 Tmp version 2020-07-08 18:25:02 +03:00
alesapin
80d9816e00 Add brotli 2020-07-08 17:22:17 +03:00
alesapin
6e79e88149 Add curl 2020-07-08 16:49:09 +03:00
alesapin
069880a003 Prototype 2020-07-08 16:06:35 +03:00
alesapin
c0dea3ab1c Ignore testflows exit code 2020-07-08 15:52:54 +03:00
Alexander Kuzmenkov
cec35a0e1d
Update README.md 2020-07-08 15:07:01 +03:00
Alexander Kuzmenkov
c9162f6e77
Update README.md 2020-07-08 15:05:49 +03:00
Alexander Kuzmenkov
344e2713fa
Update README.md 2020-07-08 14:52:06 +03:00
Alexander Kuzmenkov
bd14d06476
Update README.md 2020-07-08 14:25:43 +03:00
Alexander Kuzmenkov
41addf9173 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-08 13:22:06 +03:00
alesapin
dc8051f737 Fixes 2020-07-08 12:47:14 +03:00
alesapin
9ea3bdd054 Fix skip lists for old branches 2020-07-08 11:41:39 +03:00
Yatsishin Ilya
79e4c6ff83 Merge remote-tracking branch 'origin' into rework-integrational 2020-07-08 10:36:38 +03:00
alesapin
f54351635a
Merge pull request #12090 from vzakaznikov/adding-tests-in-testflows
Adding a simple example of using TestFlows.
2020-07-07 22:58:11 +03:00
Alexander Kuzmenkov
f514d0da77
Revert "Run perf tests with memory sampling (for allocations >1M)" 2020-07-07 19:59:42 +03:00
alesapin
042a3aa8d1
Merge pull request #12168 from qoega/compose-inside-docker
Place common docker compose files to integration docker container
2020-07-07 18:43:27 +03:00
alesapin
e89ccfd5bf No color 2020-07-07 16:11:19 +03:00
alesapin
f5a7d8a5c7 Add runner for testflows 2020-07-07 15:35:06 +03:00
Alexander Kuzmenkov
a3826e5443
Merge pull request #12142 from azat/perf-memory-sampling
Run perf tests with memory sampling (for allocations >1M)
2020-07-07 01:35:33 +03:00
Yatsishin Ilya
0c7a261bc6 Place common docker compose files to integration docker container 2020-07-06 16:45:54 +03:00
Yatsishin Ilya
d23f0008ee Merge branch 'master', remote-tracking branch 'origin' into rework-integrational 2020-07-06 14:51:15 +03:00
Alexander Kuzmenkov
432cadae15 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-06 11:44:09 +03:00
alexey-milovidov
1719ab1ec5
Merge pull request #12041 from azat/curl-proper-cmake
Rewrite curl dependency in a more ch compatible way
2020-07-06 06:31:51 +03:00
Azat Khuzhin
307c3c92a5 Run perf tests with memory sampling (for allocations >1M)
This is to know the memory allocation size distribution, that can be
obtained later from left-metric-log.tsv.

This is an attempt to tune tcmalloc (new CPP version by google) to use
lock-free part of the allocator for typical allocations (and it is a bad
idea just to increase kMaxSize there, since number of allocation for
each size class is also important).

P.S. hope that this file will be applied, if no, then the same effect
can be reached by tunning defaults in Settings.h

Refs: #11590
Cc: @akuzm
2020-07-05 12:43:12 +03:00
alesapin
a2b6d58053
Merge pull request #11069 from kssenii/add-storage-rabbitmq-read-only
Add storage RabbitMQ
2020-07-04 10:38:50 +03:00
Yatsishin Ilya
3790c8ccd9 wip 2020-07-03 18:43:48 +03:00
alesapin
5098df8d0b Make skip-list optional 2020-07-03 14:15:30 +03:00
Alexander Kuzmenkov
10b6f98ca6 fixup 2020-07-03 11:39:43 +03:00
Alexander Kuzmenkov
7d8a31aff3 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-03 10:09:20 +03:00
Azat Khuzhin
0700a705bc Rewrite curl dependency in a more ch compatible way
- add support of unbundled curl
- add CURL::libcurl libraries
- avoid explicit linkage of daemon with curl (added with sentry)
- set CACHE variables for non-direct users:
  - mariadb-connector-c
  - aws-s3-cmake
  - sentry-native

Cc: @alexey-milovidov
Cc: @alesapin (requires docker image update)
Cc: @abyss7

Refs: #11300
Refs: #8011
Refs: #8905

v2: replace cmake/find/curl.cmake with proper contrib/curl-cmake (as
pointed by @abyss7, cmake/find/*.cmake is deprecated)
2020-07-03 00:57:08 +03:00
Alexander Kuzmenkov
9e02a0d879
Merge pull request #11991 from ClickHouse/aku/perf-partial
perf test: report queries with new functions separately
2020-07-02 17:12:46 +03:00
alesapin
64583ceb22 Merge branch 'master' into add-storage-rabbitmq-read-only 2020-07-02 16:08:29 +03:00
alesapin
1fb90f3811
Merge pull request #12052 from ClickHouse/test_image_changes
Test image changes
2020-07-02 15:01:06 +03:00
alesapin
4c3ae82273 Better PVS image 2020-07-02 12:02:15 +03:00
Alexander Kuzmenkov
f50f8d936e Merge remote-tracking branch 'origin/master' into HEAD 2020-07-02 10:19:26 +03:00
Alexander Kuzmenkov
41088c3416 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-02 10:13:11 +03:00
Alexander Kuzmenkov
99514a7e24 fixup 2020-07-02 10:13:02 +03:00
alesapin
f0b012c94b Remove garbage from images 2020-07-01 23:07:11 +03:00
Alexander Kuzmenkov
baec4093dd
Merge pull request #11993 from ClickHouse/aku/more-jemalloc-tweaks
jemalloc: set muzzy_decay_ms = 10s
2020-06-30 22:51:21 +03:00
alesapin
41142c5e95 Test image changes 2020-06-30 13:34:20 +03:00
Alexander Kuzmenkov
7e2f6937e0 fixup 2020-06-30 12:45:19 +03:00
Alexander Kuzmenkov
b5f9e9de78 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-30 12:28:14 +03:00
Alexander Kuzmenkov
a4152cfb00 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-30 08:55:56 +03:00
Alexander Kuzmenkov
588ff8fcc1
Merge pull request #11989 from ClickHouse/aku/long-perf
Try to enable long perf tests
2020-06-30 08:52:29 +03:00
Alexander Kuzmenkov
6d67c77e68 fixup 2020-06-29 17:09:51 +03:00
Alexander Kuzmenkov
1b49feae6b Fixup 2020-06-29 11:29:40 +03:00
alesapin
fb891ee4eb
Revert "[experiment] maybe fix warnings in integration tests" 2020-06-28 16:20:57 +03:00
Alexander Kuzmenkov
960c455e0e performance comparison 2020-06-27 04:15:58 +03:00
Alexander Kuzmenkov
8b82ff215f muzzy decay 10 ms 2020-06-27 04:08:21 +03:00
Alexander Kuzmenkov
7e88cc15f1 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-27 04:00:26 +03:00
Alexander Kuzmenkov
459ebf1ea0 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-27 03:59:36 +03:00
Alexander Kuzmenkov
e0c4cc9135 performance comparison 2020-06-27 03:53:54 +03:00
Alexander Kuzmenkov
be57bc56d7 perf test: report queries with new functions separately 2020-06-27 03:45:00 +03:00
Alexander Kuzmenkov
c8b633fe47 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-26 21:01:40 +03:00
alesapin
ca5278b40f
Merge pull request #11903 from ClickHouse/blinkov-patch-20
[experiment] maybe fix warnings in integration tests
2020-06-26 15:43:54 +03:00
Alexander Kuzmenkov
41659e38ce Update path to perf test package 2020-06-26 03:46:44 +03:00
Alexander Kuzmenkov
beb386674d Update path to performance tests build 2020-06-26 00:58:38 +03:00
Alexander Kuzmenkov
e521d616fe performance comparison 2020-06-25 23:42:29 +03:00
Alexander Kuzmenkov
593a0181bd
Merge pull request #11616 from ClickHouse/aku/perf-benchmark
Add concurrent benchmark to performance test
2020-06-25 09:36:52 +03:00
Alexander Kuzmenkov
58747df00c
Update docker/test/performance-comparison/perf.py 2020-06-25 09:35:21 +03:00
Alexander Kuzmenkov
865ebcda16 variadic return value was too new python 2020-06-25 01:21:02 +03:00
alesapin
3fc65b3269 Merge branch 'master' into kssenii-rabbit-mq 2020-06-24 20:14:28 +03:00
alesapin
e7ff0cb8e4 Update pvs-studio version 2020-06-24 20:02:25 +03:00