Alexander Kuzmenkov
679c5278e4
reword the diagnostic about short queries in perf test
2020-09-21 15:14:47 +03:00
Alexander Kuzmenkov
2f8d7ae208
fix the conditions
2020-09-21 15:01:27 +03:00
Alexander Kuzmenkov
85be1f1685
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-21 14:57:25 +03:00
Alexander Tokmakov
13e41cdd20
try enable atomic database by default
2020-09-21 13:55:34 +03:00
alesapin
1bd76c820c
Back to 19.10
2020-09-21 12:05:10 +03:00
alesapin
fd469f1266
Remove redundant file
2020-09-21 10:41:23 +03:00
alesapin
27613f8346
Fix symbolizers path in test images
2020-09-21 10:38:11 +03:00
Vitaly Baranov
a288674867
Fix testflows tests.
2020-09-20 18:49:56 +03:00
Alexey Milovidov
ef800b5083
Perf test: development
2020-09-19 21:21:29 +03:00
Alexey Milovidov
35e8a895b6
Calculate profiler data in separate query runs
2020-09-19 20:38:21 +03:00
Alexey Milovidov
03aec83aec
Remove obsolete code from performance test
2020-09-19 19:27:37 +03:00
Alexander Tokmakov
1ca9a92b21
Merge branch 'master' into write_structure_of_table_functions
2020-09-18 21:09:23 +03:00
Alexander Kuzmenkov
8995140ffb
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-18 18:06:41 +03:00
Alexander Kuzmenkov
840586bd98
Merge pull request #14386 from ClickHouse/aku/perf-short
...
[wip] an experiment with short queries in perf test
2020-09-18 17:54:50 +03:00
Alexander Kuzmenkov
e7b9319e12
If perf test definition changed, run everything + longer (as in master)
...
Also some other perf test fixes
2020-09-18 16:28:46 +03:00
Alexander Kuzmenkov
cfc975d759
Merge pull request #14724 from ClickHouse/aku/perf-some
...
Run only some queries in perf tests, not all combos
2020-09-18 13:13:28 +03:00
Alexander Kuzmenkov
7f029ee03c
Update perf.py
2020-09-18 11:27:27 +03:00
Alexey Milovidov
799a675b5d
Merge branch 'master' into AES_encrypt_decrypt
2020-09-17 21:42:51 +03:00
Alexander Kuzmenkov
4fc86f05da
some fixes + docs + report queries that are not short
2020-09-17 19:21:59 +03:00
Alexander Kuzmenkov
b1d7df80cd
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-17 18:20:14 +03:00
Ilya Golshtein
624a4c4d55
kdc Dockerfile integrated
2020-09-17 16:51:34 +03:00
Ilya Golshtein
c227f91636
remove_files improved, proper docker images, tiny cleanup
2020-09-17 16:51:34 +03:00
Ilya Golshtein
a2e72ec37a
test via runner is Ok, switched to custom images
2020-09-17 16:51:34 +03:00
Ilya Golshtein
7a6f7a872a
forgotten docker changes
2020-09-17 16:51:34 +03:00
Ilya Golshtein
c12fa26fe3
kerberized kafka test works
2020-09-17 16:51:34 +03:00
Alexander Kuzmenkov
ada1c7c4a0
fixup
2020-09-17 13:15:46 +03:00
alesapin
50c55eb2d2
Merge pull request #14846 from ClickHouse/add_clang_11
...
Move to clang-11 in CI builds
2020-09-17 13:14:00 +03:00
Alexander Kuzmenkov
dda88eebd1
test again
2020-09-16 18:35:27 +03:00
Alexander Kuzmenkov
d55e3cd214
Update perf.py
2020-09-16 14:39:44 +03:00
Alexander Kuzmenkov
3b8ca1f262
Update compare.sh
2020-09-16 12:16:07 +03:00
Alexander Kuzmenkov
c5c5faf8ee
fixup
2020-09-16 12:06:42 +03:00
Alexander Kuzmenkov
e333a7bad4
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-16 12:05:22 +03:00
alesapin
d144421214
Disable lto for glibc-compatibility
2020-09-16 10:46:38 +03:00
alexey-milovidov
018f596d21
Merge pull request #14685 from ClickHouse/remap-executable
...
Attempt to make performance test more reliable
2020-09-15 15:09:47 +03:00
Alexander Kuzmenkov
df95f91d7c
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-15 13:53:50 +03:00
Alexander Kuzmenkov
24dd33d5cb
Update compare.sh
2020-09-15 13:44:21 +03:00
Alexander Tokmakov
da6beb1a91
Merge branch 'master' into enable_some_tests_with_database_atomic
2020-09-14 23:00:14 +03:00
Alexey Milovidov
b87c108246
Enable remap in performance tests
2020-09-14 21:14:28 +03:00
Alexander Kuzmenkov
ab6bc1ed59
Update compare.sh
2020-09-14 20:25:17 +03:00
Alexander Kuzmenkov
9e3797b252
Merge pull request #14710 from ClickHouse/aku/faster-perf
...
Do less runs in perf test
2020-09-14 19:17:34 +03:00
Alexander Kuzmenkov
b3138605c7
performance comparison
2020-09-14 19:16:59 +03:00
Vasily Nemkov
b980cf354a
Moving to TestFlows version 1.6.46
2020-09-14 18:24:57 +03:00
Alexander Kuzmenkov
3113aa6cfe
Avoid extra error in perf report on broken queries
2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov
c701a15271
fixup
2020-09-14 10:27:46 +03:00
Vitaliy Zakaznikov
bb1d126ce5
Updating TestFlows to 1.6.45 to fix stability issues with multi line commands.
2020-09-10 22:54:40 +03:00
Alexander Kuzmenkov
8689797efc
Run only some queries in perf tests, not all combos
2020-09-10 19:57:26 +03:00
Alexander Kuzmenkov
26348ad014
fixup
2020-09-10 18:48:39 +03:00
Alexander Kuzmenkov
ca2a33008b
faster
2020-09-10 17:55:54 +03:00
Nikita Mikhaylov
44726c37c3
Merge branch 'master' into fix-executable-dictionary-source-hangup
2020-09-09 23:01:41 +04:00
Alexander Tokmakov
d278d849e4
Merge branch 'master' into write_structure_of_table_functions
2020-09-09 17:12:35 +03:00
Alexander Tokmakov
b68782d285
enable more tests with Atomic database
2020-09-09 16:32:50 +03:00
Anton Popov
032f4ba6f3
Merge pull request #14532 from CurtizJ/fix-redis-test
...
Rework test for redis dictionary
2020-09-09 02:38:09 +03:00
robot-clickhouse
8def718661
Auto version update to [20.10.1.1] [54440]
2020-09-08 17:04:41 +03:00
alesapin
c40ba48822
Raise on error
2020-09-08 11:49:24 +03:00
alesapin
1a1bccf416
Add sleeps
2020-09-08 11:45:22 +03:00
alesapin
73253f058d
Add sleep
2020-09-08 11:45:01 +03:00
alesapin
0193a132d4
Add retries to s3 downloader
2020-09-08 11:43:02 +03:00
Anton Popov
9493532fdb
rework test for redis dictionary
2020-09-07 14:16:47 +03:00
Alexander Kuzmenkov
f7d631bf82
use fasttest script from sources
2020-09-07 13:19:01 +03:00
Alexey Milovidov
04a6965006
Fix error with executable dictionary source
2020-09-07 09:40:01 +03:00
Alexander Kuzmenkov
0904433c87
Temporarily remove UInt256 perf test broken in https://github.com/ClickHouse/ClickHouse/pull/14229
...
Also add one more timeout to perf test runner.
2020-09-07 09:33:57 +03:00
Alexander Kuzmenkov
1978968067
performance comparison
2020-09-07 02:49:34 +03:00
Vitaly Baranov
81db73f066
Merge pull request #13647 from qoega/integration-explicit-configs
...
Add explicit main_configs, user_configs and dictionaries in integration tests
2020-09-04 20:16:00 +03:00
Alexander Tokmakov
ed5f827708
Merge branch 'master' into write_structure_of_table_functions
2020-09-04 16:38:57 +03:00
alesapin
5d897231e1
Merge pull request #14432 from ClickHouse/minor-changes-in-stateful-tests
...
Wait for clickhouse-server to start in stateful tests
2020-09-04 13:12:32 +03:00
Alexander Tokmakov
b840d741d0
Merge branch 'master' into write_structure_of_table_functions
2020-09-04 13:00:07 +03:00
Alexander Tokmakov
df09bf3cb6
add suppressions for leak sanitizer
2020-09-03 22:50:26 +03:00
alexey-milovidov
fb56d0b9a3
Update run.sh
2020-09-03 21:21:27 +03:00
Alexander Kuzmenkov
29b97ff259
Merge pull request #14430 from ClickHouse/aku/perf4
...
[wip] perf experiment no.4 -- geomean
2020-09-03 21:13:07 +03:00
Vasily Nemkov
9ba4613381
Excluding tests from fasttest runs since they depend on external libraries: OpenSSL
2020-09-03 16:12:32 +03:00
Yatsishin Ilya
14b61e87d9
mysql bin log
2020-09-03 13:27:17 +03:00
Yatsishin Ilya
fc075e65da
Merge remote-tracking branch 'origin' into integration-explicit-configs
2020-09-03 11:49:48 +03:00
Alexey Milovidov
cd812d94de
Wait for clickhouse-server to start in stateful tests
2020-09-03 04:54:50 +03:00
Alexander Kuzmenkov
a321d6970c
adjust report and increase time
2020-09-03 04:42:25 +03:00
Alexander Kuzmenkov
8e8e195e45
geomean
2020-09-03 03:58:40 +03:00
alesapin
12f76d9448
Merge pull request #14325 from azat/suppress-wget-output
...
Suppress superfluous wget (-nv) output
2020-09-02 14:59:28 +03:00
Yatsishin Ilya
5ab9f249e5
Merge branch 'try-dns-fix' into integration-explicit-configs
2020-09-02 12:53:10 +03:00
Yatsishin Ilya
6902bbce50
Merge remote-tracking branch 'origin' into integration-explicit-configs
2020-09-02 12:48:07 +03:00
Yatsishin Ilya
5d39b8ce04
unnecessary change
2020-09-02 11:39:16 +03:00
Alexander Kuzmenkov
00c924b0dd
whitespace
2020-09-02 06:31:53 +03:00
Alexander Kuzmenkov
5fcb9bd163
short queries
2020-09-02 06:29:36 +03:00
Alexander Kuzmenkov
e622e108f7
readme
2020-09-02 06:29:16 +03:00
Alexander Kuzmenkov
0db5b4a72c
Remove concurrent benchmark from the perf test
...
It's not stable enough and has only secondary utility.
2020-09-02 02:43:23 +03:00
Alexander Kuzmenkov
f6cfb96748
Merge pull request #14346 from ClickHouse/aku/fuzzer
...
Don't let the fuzzer change max_execution_time
2020-09-02 01:59:50 +03:00
Anton Popov
7c3712c121
Merge pull request #13688 from it1804/master
...
Redis dictionary support for simple Redis requirepass authorization
2020-09-02 01:43:02 +03:00
Alexander Kuzmenkov
a6486490a2
performance comparison
2020-09-01 22:05:57 +03:00
Alexander Kuzmenkov
0b70abe542
Don't let the fuzzer change max_execution_time
2020-09-01 18:51:46 +03:00
Alexander Kuzmenkov
2f3bb5844a
Merge branch 'master' into suppress-wget-output
2020-09-01 16:59:04 +03:00
Alexander Kuzmenkov
4620ac4c0d
Update docker/test/fuzzer/run-fuzzer.sh
2020-09-01 16:57:20 +03:00
Alexander Kuzmenkov
4e58f00305
Update docker/test/fuzzer/run-fuzzer.sh
2020-09-01 16:57:13 +03:00
Alexander Kuzmenkov
73d433a7dd
Merge pull request #14316 from ClickHouse/aku/html-fuzzer
...
Add a HTML report for AST Fuzzer
2020-09-01 16:46:30 +03:00
Azat Khuzhin
2d7cb03120
Suppress superfluous wget (-nv) output
...
Since for dowloading some of files wget logging may take 50% of overall
log [1].
[1]: https://clickhouse-builds.s3.yandex.net/14315/c32ff4c98cb3b83a12f945eadd180415b7a3b269/clickhouse_build_check/build_log_761119955_1598923036.txt
2020-09-01 10:25:13 +03:00
Yatsishin Ilya
6cb893f073
Draft.
2020-09-01 09:38:23 +03:00
Alexander Kuzmenkov
33c5815eb3
Add a HTML report for AST Fuzzer
2020-09-01 02:33:42 +03:00
robot-clickhouse
e2fa0eae2f
Auto version update to [20.9.1.1] [54439]
2020-08-31 23:07:41 +03:00
Alexander Kuzmenkov
bc8765d5ad
Merge pull request #14095 from azat/DistributedFilesToInsert-fix
...
Fix DistributedFilesToInsert metric (zeroed when it should not)
2020-08-31 18:58:30 +03:00
Alexander Kuzmenkov
b601dd4596
cosmetic fixes for performance report
2020-08-29 01:46:04 +03:00
Alexander Kuzmenkov
bb28320107
cosmetic fixes in performance report
2020-08-29 01:14:48 +03:00
Azat Khuzhin
a384194216
Add a test for DistributedFilesToInsert
2020-08-27 22:00:35 +03:00
Ilya Yatsishin
7509991d82
Merge pull request #14167 from qoega/docker-test-base
...
Switch docker tests to use test-base
2020-08-27 16:45:55 +03:00
alexey-milovidov
e1cf919c93
Merge pull request #14112 from vzakaznikov/testflows_increase_compose_http_timeout_and_retry_docker_compose_up
...
testflows: adding retry logic when bringing up docker-compose cluster
2020-08-27 15:51:16 +03:00
Alexander Tokmakov
65a69ff6ad
move docker-compose files
2020-08-27 14:46:19 +03:00
Yatsishin Ilya
bfe4e94806
Switch docker tests to use test-base
2020-08-27 13:17:17 +03:00
Alexey Milovidov
fe5cfe3151
Increase number of threads in stress test
2020-08-26 23:39:02 +03:00
Alexey Milovidov
0bfe78636c
Increase number of threads in stress test
2020-08-26 23:38:20 +03:00
alexey-milovidov
f62037e9dc
Update stress
2020-08-26 20:45:36 +03:00
Alexey Milovidov
07596b5323
Limit stress test to one hour
2020-08-26 20:44:03 +03:00
Vitaliy Zakaznikov
eb01601944
Adding retry login when bringing docker-compose cluster
...
Moving to using testflows version 1.6.42
2020-08-26 10:00:12 -04:00
Konstantin Podshumok
cda4472ebc
dockerfiles: verify 3rd party apt repos, disable LLVM in PVS check
...
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:44 +03:00
alexey-milovidov
ad64cea4aa
Merge pull request #13980 from ClickHouse/fix-stress-test-2
...
Attempt to fix stress test
2020-08-24 22:03:32 +03:00
Ilya Yatsishin
20bff27eef
Merge pull request #13995 from qoega/stateless-unbundled
...
Separate stateless unbundled image
2020-08-24 19:49:27 +03:00
Alexander Kuzmenkov
a348bc4641
performance comparison
2020-08-24 17:15:11 +03:00
Yatsishin Ilya
f2182db765
Separate stateless unbundled image
2020-08-24 13:05:56 +03:00
Alexey Milovidov
d44982072c
More robust
2020-08-24 03:14:24 +03:00
Alexey Milovidov
1fb4294cdf
Attempt to fix stress test
2020-08-24 00:13:21 +03:00
Alexey Milovidov
f4bf99fadc
Better output of stress test
2020-08-23 23:48:27 +03:00
Yatsishin Ilya
7dcdde0775
Add docker test base separately to have :latest build available
2020-08-20 20:54:51 +03:00
Alexander Kuzmenkov
5c8013b083
Merge pull request #13892 from ClickHouse/aku/timeout-perf
...
Avoid timeouts in perf test
2020-08-20 18:14:26 +03:00
Alexander Kuzmenkov
3a0bdfa5f3
Publish list of tests that failed the concurrent fast test
2020-08-20 03:13:44 +03:00
Alexander Kuzmenkov
f43457454e
warn on undefined shell variables
2020-08-19 18:34:23 +03:00
Alexander Kuzmenkov
e9ad81b362
shellcheck
2020-08-19 18:31:13 +03:00
Alexander Kuzmenkov
000326b627
Avoid timeouts in perf test
2020-08-19 18:08:23 +03:00
tavplubix
d95470f7c3
Update docker/test/stress/run.sh
2020-08-18 20:52:54 +03:00
Yatsishin Ilya
8fd70835d5
Merge remote-tracking branch 'origin' into integration-explicit-configs
2020-08-18 17:31:41 +03:00
Nikita Mikhaylov
e7f8c0af52
done
2020-08-18 15:28:38 +03:00
Alexander Kuzmenkov
ce0dfe3fea
Fix server restart in fasttest
...
Remove the server data before sequential test run, so that there is no
interference from the failed parallel run.
Also fix some shellcheck warning.
2020-08-18 13:24:37 +03:00
alexey-milovidov
3e6acf1329
Experiment with start/stop in stress test ( #13779 )
...
* Experiment with start/stop in stress test
* Support other installation options in "clickhouse start"
* Better diagnostics in install script
* Fixup
* Fixup
* Better diagnostics in stress test
* Update run.sh
2020-08-18 12:43:02 +03:00
Alexey Milovidov
47889b0f2b
Install codespell
2020-08-16 14:59:16 +03:00
Ivan A. Torgashov
1006c4f11b
Update tests for Redis dictionary requirepass authorization support
2020-08-15 14:18:17 +05:00
Alexey Milovidov
0140093b17
Fix fast test
2020-08-15 10:11:19 +03:00
Alexander Kuzmenkov
ecc40b7c75
Merge pull request #13724 from qoega/docker-style
...
Add docker image for style check, add check for docker files placement
2020-08-15 03:01:39 +03:00
Alexander Kuzmenkov
1cbfd1327a
trigger the CI
2020-08-15 01:40:40 +03:00
Yatsishin Ilya
ab337b243a
Add docker for style check
2020-08-14 16:09:23 +03:00
Alexander Tokmakov
128b19fdba
Merge branch 'master' into use_atomic_engine_for_system_db
2020-08-14 13:47:44 +03:00
Yatsishin Ilya
73e9f4d421
update test_materialize_mysql_database test
2020-08-13 21:20:47 +03:00
Alexander Tokmakov
a5d74c44f1
run stress tests with Atomic database
2020-08-13 20:55:12 +03:00
Ilya Yatsishin
e6420c82ca
mysql/postgresql: move Dockerfiles and docker_compose to docker/test ( #13448 )
...
* mysql/postgresql: move Dockerfiles and docker_compose to docker/test
* Build client containers in CI
* pass tag to docker_compose
2020-08-12 18:04:36 +03:00
Yatsishin Ilya
730056a9f0
fix
2020-08-12 15:22:31 +03:00
Yatsishin Ilya
f663f794b0
Merge remote-tracking branch 'qoega/integration-explicit-configs' into integration-explicit-configs
2020-08-12 14:58:41 +03:00
Alexander Kuzmenkov
6fdfe65694
performance comparison
2020-08-12 11:55:51 +03:00
Yatsishin Ilya
160776f183
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 11:55:04 +03:00
Alexander Kuzmenkov
89b712a180
performance comparison
2020-08-12 08:40:03 +03:00
Yatsishin Ilya
fdd18e540d
move reference files
2020-08-12 07:06:23 +03:00
Alexander Kuzmenkov
7547b850d6
performance comparison
2020-08-11 17:14:24 +03:00
Alexander Kuzmenkov
5a97f0c19e
performance comparison
2020-08-11 14:53:25 +03:00
Yatsishin Ilya
e3f7fea33a
fix
2020-08-11 11:31:26 +03:00
Yatsishin Ilya
1d0e4ca670
pass tag to docker_compose
2020-08-10 16:35:08 +03:00
Yatsishin Ilya
1884cfe110
Merge remote-tracking branch 'origin/master' into docker-mysql-postgres
2020-08-10 11:12:22 +03:00
robot-clickhouse
a82c0f5371
Auto version update to [20.8.1.1] [54438]
2020-08-07 21:45:49 +03:00
Yatsishin Ilya
70fca95a5a
mysql/postgresql: move Dockerfiles and docker_compose to docker/test
2020-08-07 11:42:04 +03:00