Alexander Kuzmenkov
3b8ca1f262
Update compare.sh
2020-09-16 12:16:07 +03:00
Alexander Kuzmenkov
c5c5faf8ee
fixup
2020-09-16 12:06:42 +03:00
Alexander Kuzmenkov
e333a7bad4
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-16 12:05:22 +03:00
alesapin
d144421214
Disable lto for glibc-compatibility
2020-09-16 10:46:38 +03:00
alexey-milovidov
018f596d21
Merge pull request #14685 from ClickHouse/remap-executable
...
Attempt to make performance test more reliable
2020-09-15 15:09:47 +03:00
Alexander Kuzmenkov
df95f91d7c
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-15 13:53:50 +03:00
Alexander Kuzmenkov
24dd33d5cb
Update compare.sh
2020-09-15 13:44:21 +03:00
Alexander Tokmakov
da6beb1a91
Merge branch 'master' into enable_some_tests_with_database_atomic
2020-09-14 23:00:14 +03:00
Alexey Milovidov
b87c108246
Enable remap in performance tests
2020-09-14 21:14:28 +03:00
Alexander Kuzmenkov
ab6bc1ed59
Update compare.sh
2020-09-14 20:25:17 +03:00
Alexander Kuzmenkov
9e3797b252
Merge pull request #14710 from ClickHouse/aku/faster-perf
...
Do less runs in perf test
2020-09-14 19:17:34 +03:00
Alexander Kuzmenkov
b3138605c7
performance comparison
2020-09-14 19:16:59 +03:00
Alexander Kuzmenkov
3113aa6cfe
Avoid extra error in perf report on broken queries
2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov
c701a15271
fixup
2020-09-14 10:27:46 +03:00
Alexander Kuzmenkov
8689797efc
Run only some queries in perf tests, not all combos
2020-09-10 19:57:26 +03:00
Alexander Kuzmenkov
26348ad014
fixup
2020-09-10 18:48:39 +03:00
Alexander Kuzmenkov
ca2a33008b
faster
2020-09-10 17:55:54 +03:00
Nikita Mikhaylov
44726c37c3
Merge branch 'master' into fix-executable-dictionary-source-hangup
2020-09-09 23:01:41 +04:00
Alexander Tokmakov
d278d849e4
Merge branch 'master' into write_structure_of_table_functions
2020-09-09 17:12:35 +03:00
Alexander Tokmakov
b68782d285
enable more tests with Atomic database
2020-09-09 16:32:50 +03:00
Anton Popov
032f4ba6f3
Merge pull request #14532 from CurtizJ/fix-redis-test
...
Rework test for redis dictionary
2020-09-09 02:38:09 +03:00
robot-clickhouse
8def718661
Auto version update to [20.10.1.1] [54440]
2020-09-08 17:04:41 +03:00
alesapin
c40ba48822
Raise on error
2020-09-08 11:49:24 +03:00
alesapin
1a1bccf416
Add sleeps
2020-09-08 11:45:22 +03:00
alesapin
73253f058d
Add sleep
2020-09-08 11:45:01 +03:00
alesapin
0193a132d4
Add retries to s3 downloader
2020-09-08 11:43:02 +03:00
Anton Popov
9493532fdb
rework test for redis dictionary
2020-09-07 14:16:47 +03:00
Alexander Kuzmenkov
f7d631bf82
use fasttest script from sources
2020-09-07 13:19:01 +03:00
Alexey Milovidov
04a6965006
Fix error with executable dictionary source
2020-09-07 09:40:01 +03:00
Alexander Kuzmenkov
0904433c87
Temporarily remove UInt256 perf test broken in https://github.com/ClickHouse/ClickHouse/pull/14229
...
Also add one more timeout to perf test runner.
2020-09-07 09:33:57 +03:00
Alexander Kuzmenkov
1978968067
performance comparison
2020-09-07 02:49:34 +03:00
Vitaly Baranov
81db73f066
Merge pull request #13647 from qoega/integration-explicit-configs
...
Add explicit main_configs, user_configs and dictionaries in integration tests
2020-09-04 20:16:00 +03:00
Alexander Tokmakov
ed5f827708
Merge branch 'master' into write_structure_of_table_functions
2020-09-04 16:38:57 +03:00
alesapin
5d897231e1
Merge pull request #14432 from ClickHouse/minor-changes-in-stateful-tests
...
Wait for clickhouse-server to start in stateful tests
2020-09-04 13:12:32 +03:00
Alexander Tokmakov
b840d741d0
Merge branch 'master' into write_structure_of_table_functions
2020-09-04 13:00:07 +03:00
Alexander Tokmakov
df09bf3cb6
add suppressions for leak sanitizer
2020-09-03 22:50:26 +03:00
alexey-milovidov
fb56d0b9a3
Update run.sh
2020-09-03 21:21:27 +03:00
Alexander Kuzmenkov
29b97ff259
Merge pull request #14430 from ClickHouse/aku/perf4
...
[wip] perf experiment no.4 -- geomean
2020-09-03 21:13:07 +03:00
Yatsishin Ilya
14b61e87d9
mysql bin log
2020-09-03 13:27:17 +03:00
Yatsishin Ilya
fc075e65da
Merge remote-tracking branch 'origin' into integration-explicit-configs
2020-09-03 11:49:48 +03:00
Alexey Milovidov
cd812d94de
Wait for clickhouse-server to start in stateful tests
2020-09-03 04:54:50 +03:00
Alexander Kuzmenkov
a321d6970c
adjust report and increase time
2020-09-03 04:42:25 +03:00
Alexander Kuzmenkov
8e8e195e45
geomean
2020-09-03 03:58:40 +03:00
alesapin
12f76d9448
Merge pull request #14325 from azat/suppress-wget-output
...
Suppress superfluous wget (-nv) output
2020-09-02 14:59:28 +03:00
Yatsishin Ilya
5ab9f249e5
Merge branch 'try-dns-fix' into integration-explicit-configs
2020-09-02 12:53:10 +03:00
Yatsishin Ilya
6902bbce50
Merge remote-tracking branch 'origin' into integration-explicit-configs
2020-09-02 12:48:07 +03:00
Yatsishin Ilya
5d39b8ce04
unnecessary change
2020-09-02 11:39:16 +03:00
Alexander Kuzmenkov
00c924b0dd
whitespace
2020-09-02 06:31:53 +03:00
Alexander Kuzmenkov
5fcb9bd163
short queries
2020-09-02 06:29:36 +03:00
Alexander Kuzmenkov
e622e108f7
readme
2020-09-02 06:29:16 +03:00
Alexander Kuzmenkov
0db5b4a72c
Remove concurrent benchmark from the perf test
...
It's not stable enough and has only secondary utility.
2020-09-02 02:43:23 +03:00
Alexander Kuzmenkov
f6cfb96748
Merge pull request #14346 from ClickHouse/aku/fuzzer
...
Don't let the fuzzer change max_execution_time
2020-09-02 01:59:50 +03:00
Anton Popov
7c3712c121
Merge pull request #13688 from it1804/master
...
Redis dictionary support for simple Redis requirepass authorization
2020-09-02 01:43:02 +03:00
Alexander Kuzmenkov
a6486490a2
performance comparison
2020-09-01 22:05:57 +03:00
Alexander Kuzmenkov
0b70abe542
Don't let the fuzzer change max_execution_time
2020-09-01 18:51:46 +03:00
Alexander Kuzmenkov
2f3bb5844a
Merge branch 'master' into suppress-wget-output
2020-09-01 16:59:04 +03:00
Alexander Kuzmenkov
4620ac4c0d
Update docker/test/fuzzer/run-fuzzer.sh
2020-09-01 16:57:20 +03:00
Alexander Kuzmenkov
4e58f00305
Update docker/test/fuzzer/run-fuzzer.sh
2020-09-01 16:57:13 +03:00
Alexander Kuzmenkov
73d433a7dd
Merge pull request #14316 from ClickHouse/aku/html-fuzzer
...
Add a HTML report for AST Fuzzer
2020-09-01 16:46:30 +03:00
Azat Khuzhin
2d7cb03120
Suppress superfluous wget (-nv) output
...
Since for dowloading some of files wget logging may take 50% of overall
log [1].
[1]: https://clickhouse-builds.s3.yandex.net/14315/c32ff4c98cb3b83a12f945eadd180415b7a3b269/clickhouse_build_check/build_log_761119955_1598923036.txt
2020-09-01 10:25:13 +03:00
Yatsishin Ilya
6cb893f073
Draft.
2020-09-01 09:38:23 +03:00
Alexander Kuzmenkov
33c5815eb3
Add a HTML report for AST Fuzzer
2020-09-01 02:33:42 +03:00
robot-clickhouse
e2fa0eae2f
Auto version update to [20.9.1.1] [54439]
2020-08-31 23:07:41 +03:00
Alexander Kuzmenkov
bc8765d5ad
Merge pull request #14095 from azat/DistributedFilesToInsert-fix
...
Fix DistributedFilesToInsert metric (zeroed when it should not)
2020-08-31 18:58:30 +03:00
Alexander Kuzmenkov
b601dd4596
cosmetic fixes for performance report
2020-08-29 01:46:04 +03:00
Alexander Kuzmenkov
bb28320107
cosmetic fixes in performance report
2020-08-29 01:14:48 +03:00
Azat Khuzhin
a384194216
Add a test for DistributedFilesToInsert
2020-08-27 22:00:35 +03:00
Ilya Yatsishin
7509991d82
Merge pull request #14167 from qoega/docker-test-base
...
Switch docker tests to use test-base
2020-08-27 16:45:55 +03:00
alexey-milovidov
e1cf919c93
Merge pull request #14112 from vzakaznikov/testflows_increase_compose_http_timeout_and_retry_docker_compose_up
...
testflows: adding retry logic when bringing up docker-compose cluster
2020-08-27 15:51:16 +03:00
Alexander Tokmakov
65a69ff6ad
move docker-compose files
2020-08-27 14:46:19 +03:00
Yatsishin Ilya
bfe4e94806
Switch docker tests to use test-base
2020-08-27 13:17:17 +03:00
Alexey Milovidov
fe5cfe3151
Increase number of threads in stress test
2020-08-26 23:39:02 +03:00
Alexey Milovidov
0bfe78636c
Increase number of threads in stress test
2020-08-26 23:38:20 +03:00
alexey-milovidov
f62037e9dc
Update stress
2020-08-26 20:45:36 +03:00
Alexey Milovidov
07596b5323
Limit stress test to one hour
2020-08-26 20:44:03 +03:00
Vitaliy Zakaznikov
eb01601944
Adding retry login when bringing docker-compose cluster
...
Moving to using testflows version 1.6.42
2020-08-26 10:00:12 -04:00
Konstantin Podshumok
cda4472ebc
dockerfiles: verify 3rd party apt repos, disable LLVM in PVS check
...
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:44 +03:00
alexey-milovidov
ad64cea4aa
Merge pull request #13980 from ClickHouse/fix-stress-test-2
...
Attempt to fix stress test
2020-08-24 22:03:32 +03:00
Ilya Yatsishin
20bff27eef
Merge pull request #13995 from qoega/stateless-unbundled
...
Separate stateless unbundled image
2020-08-24 19:49:27 +03:00
Alexander Kuzmenkov
a348bc4641
performance comparison
2020-08-24 17:15:11 +03:00
Yatsishin Ilya
f2182db765
Separate stateless unbundled image
2020-08-24 13:05:56 +03:00
Alexey Milovidov
d44982072c
More robust
2020-08-24 03:14:24 +03:00
Alexey Milovidov
1fb4294cdf
Attempt to fix stress test
2020-08-24 00:13:21 +03:00
Alexey Milovidov
f4bf99fadc
Better output of stress test
2020-08-23 23:48:27 +03:00
Yatsishin Ilya
7dcdde0775
Add docker test base separately to have :latest build available
2020-08-20 20:54:51 +03:00
Alexander Kuzmenkov
5c8013b083
Merge pull request #13892 from ClickHouse/aku/timeout-perf
...
Avoid timeouts in perf test
2020-08-20 18:14:26 +03:00
Alexander Kuzmenkov
3a0bdfa5f3
Publish list of tests that failed the concurrent fast test
2020-08-20 03:13:44 +03:00
Alexander Kuzmenkov
f43457454e
warn on undefined shell variables
2020-08-19 18:34:23 +03:00
Alexander Kuzmenkov
e9ad81b362
shellcheck
2020-08-19 18:31:13 +03:00
Alexander Kuzmenkov
000326b627
Avoid timeouts in perf test
2020-08-19 18:08:23 +03:00
tavplubix
d95470f7c3
Update docker/test/stress/run.sh
2020-08-18 20:52:54 +03:00
Yatsishin Ilya
8fd70835d5
Merge remote-tracking branch 'origin' into integration-explicit-configs
2020-08-18 17:31:41 +03:00
Nikita Mikhaylov
e7f8c0af52
done
2020-08-18 15:28:38 +03:00
Alexander Kuzmenkov
ce0dfe3fea
Fix server restart in fasttest
...
Remove the server data before sequential test run, so that there is no
interference from the failed parallel run.
Also fix some shellcheck warning.
2020-08-18 13:24:37 +03:00
alexey-milovidov
3e6acf1329
Experiment with start/stop in stress test ( #13779 )
...
* Experiment with start/stop in stress test
* Support other installation options in "clickhouse start"
* Better diagnostics in install script
* Fixup
* Fixup
* Better diagnostics in stress test
* Update run.sh
2020-08-18 12:43:02 +03:00
Alexey Milovidov
47889b0f2b
Install codespell
2020-08-16 14:59:16 +03:00
Ivan A. Torgashov
1006c4f11b
Update tests for Redis dictionary requirepass authorization support
2020-08-15 14:18:17 +05:00
Alexey Milovidov
0140093b17
Fix fast test
2020-08-15 10:11:19 +03:00
Alexander Kuzmenkov
ecc40b7c75
Merge pull request #13724 from qoega/docker-style
...
Add docker image for style check, add check for docker files placement
2020-08-15 03:01:39 +03:00
Alexander Kuzmenkov
1cbfd1327a
trigger the CI
2020-08-15 01:40:40 +03:00
Yatsishin Ilya
ab337b243a
Add docker for style check
2020-08-14 16:09:23 +03:00
Alexander Tokmakov
128b19fdba
Merge branch 'master' into use_atomic_engine_for_system_db
2020-08-14 13:47:44 +03:00
Yatsishin Ilya
73e9f4d421
update test_materialize_mysql_database test
2020-08-13 21:20:47 +03:00
Alexander Tokmakov
a5d74c44f1
run stress tests with Atomic database
2020-08-13 20:55:12 +03:00
Ilya Yatsishin
e6420c82ca
mysql/postgresql: move Dockerfiles and docker_compose to docker/test ( #13448 )
...
* mysql/postgresql: move Dockerfiles and docker_compose to docker/test
* Build client containers in CI
* pass tag to docker_compose
2020-08-12 18:04:36 +03:00
Yatsishin Ilya
730056a9f0
fix
2020-08-12 15:22:31 +03:00
Yatsishin Ilya
f663f794b0
Merge remote-tracking branch 'qoega/integration-explicit-configs' into integration-explicit-configs
2020-08-12 14:58:41 +03:00
Alexander Kuzmenkov
6fdfe65694
performance comparison
2020-08-12 11:55:51 +03:00
Yatsishin Ilya
160776f183
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 11:55:04 +03:00
Alexander Kuzmenkov
89b712a180
performance comparison
2020-08-12 08:40:03 +03:00
Yatsishin Ilya
fdd18e540d
move reference files
2020-08-12 07:06:23 +03:00
Alexander Kuzmenkov
7547b850d6
performance comparison
2020-08-11 17:14:24 +03:00
Alexander Kuzmenkov
5a97f0c19e
performance comparison
2020-08-11 14:53:25 +03:00
Yatsishin Ilya
e3f7fea33a
fix
2020-08-11 11:31:26 +03:00
Yatsishin Ilya
1d0e4ca670
pass tag to docker_compose
2020-08-10 16:35:08 +03:00
Yatsishin Ilya
1884cfe110
Merge remote-tracking branch 'origin/master' into docker-mysql-postgres
2020-08-10 11:12:22 +03:00
robot-clickhouse
a82c0f5371
Auto version update to [20.8.1.1] [54438]
2020-08-07 21:45:49 +03:00
Yatsishin Ilya
70fca95a5a
mysql/postgresql: move Dockerfiles and docker_compose to docker/test
2020-08-07 11:42:04 +03:00
Alexander Kuzmenkov
11727864dd
performance comparison
2020-08-07 04:25:45 +03:00
Alexander Kuzmenkov
dbb65a8bd7
performance comparison
2020-08-06 16:28:51 +03:00
Alexander Kuzmenkov
a92438eff2
performance comparison
2020-08-06 02:33:32 +03:00
Alexander Kuzmenkov
88aa371e0c
performance comparison
2020-08-06 02:02:52 +03:00
Alexander Kuzmenkov
9cac8a7244
performance comparison
2020-08-05 19:07:37 +03:00
Alexander Kuzmenkov
7945041a9a
perf test error summary
2020-08-05 18:56:51 +03:00
alesapin
63391bbb66
Merge pull request #13382 from Enmk/fasttest-fix-query_masking_rules.xml
...
Keep original query_masking_rules.xml when performing fasttests
2020-08-05 17:47:33 +03:00
alesapin
a18461091f
Merge pull request #13384 from ClickHouse/fix_fast_test_server_kill
...
Better kill in fast test
2020-08-05 17:42:52 +03:00
alesapin
87c56f9556
Symlink for server logs
2020-08-05 16:15:06 +03:00
alesapin
c862ae93d1
Replace backticks with modern alternative
2020-08-05 16:10:47 +03:00
alesapin
68a9499e92
Simplier kill clickhouse server
2020-08-05 15:59:52 +03:00
alesapin
cdad1e718f
Better kill in fast test
2020-08-05 15:37:54 +03:00
Vasily Nemkov
baed365c19
Keep original query_masking_rules.xml when performing fasttests
2020-08-05 15:14:20 +03:00
alexey-milovidov
d94e556455
Merge pull request #13321 from ClickHouse/restart_server_with_timeout
...
Restart server in stress test with timeout
2020-08-05 00:43:45 +03:00
alexey-milovidov
18ef0c0c96
Update run.sh, thanks @azat
2020-08-04 20:54:09 +03:00
alesapin
bd0322421b
Better timeout
2020-08-04 17:28:35 +03:00
alesapin
caf0bcdc86
More timeouts
2020-08-04 11:48:47 +03:00
alesapin
ee5153bbc4
Restart server in stress test with timeout
2020-08-04 11:47:20 +03:00
alesapin
b69e6b935b
Wait with retries in fast test ( #13284 )
2020-08-03 21:05:35 +03:00
alexey-milovidov
935533e841
Merge pull request #13193 from ClickHouse/aku/spurious-perf
...
Fix some spurious perf test failures
2020-08-03 01:02:53 +03:00
Azat Khuzhin
8cbcd4027a
Exclude 01413_rows_events from the fasttest (TRUNCATE query_log)
2020-08-02 13:30:00 +03:00
Azat Khuzhin
37c3f44dbe
fasttest: use arrays for skip list (to make it more patch friendly)
...
Plus it looks better.
2020-08-02 13:29:31 +03:00
Vitaly Baranov
18b21511a9
Merge pull request #13013 from vitlibar/implement-custom-settings
...
Implement custom settings
2020-08-02 05:01:14 +03:00
Alexander Kuzmenkov
dd475fe82c
Update report.py
2020-08-01 13:10:36 +03:00
Alexander Kuzmenkov
a317f995be
performance comparison
2020-07-31 22:58:38 +03:00
Vitaly Baranov
0fcee34322
Add test.
2020-07-31 20:57:49 +03:00
Alexander Kuzmenkov
1d954581eb
Fix some spurious perf test failures
2020-07-31 19:28:04 +03:00
Alexander Kuzmenkov
6f861294f4
query fuzzer
2020-07-31 18:57:01 +03:00
Ilya Yatsishin
1566c8a92b
Merge pull request #12285 from qoega/rework-integrational
...
Rework integrational configuration paths
2020-07-31 15:34:21 +03:00
Alexander Kuzmenkov
e2e4fc9848
align numbers to the right in perf report
2020-07-31 13:59:15 +03:00
Alexander Kuzmenkov
db15108005
add times speedup/slowdown to changed tests table
2020-07-31 01:14:20 +03:00
Alexander Kuzmenkov
0e70e21b58
Update run-fuzzer.sh
2020-07-30 22:04:15 +03:00