Alexander Kuzmenkov
f8047102fe
fixup
2020-09-29 22:06:45 +03:00
Alexander Kuzmenkov
6062c55569
fasttest fixup
2020-09-29 21:59:45 +03:00
Alexander Kuzmenkov
e943a22d28
allow fast test to run locally
2020-09-29 21:02:44 +03:00
Alexander Kuzmenkov
dc15bceadc
Merge remote-tracking branch 'origin/aku/debug-perf' into HEAD
2020-09-29 16:41:38 +03:00
Alexander Kuzmenkov
ac4f0cdf22
fix
2020-09-29 14:07:31 +03:00
alesapin
a1f4d38019
Add ability to run tests multiple time in stateless image
2020-09-29 12:44:28 +03:00
Alexander Tokmakov
a7d3a024c7
Revert "Revert "Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka""
...
This reverts commit c298c633a7
2020-09-29 11:56:37 +03:00
Alexander Kuzmenkov
6671b26f20
fixes
2020-09-28 21:43:47 +03:00
Alexander Kuzmenkov
3d1456a55d
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-28 21:19:53 +03:00
alesapin
071ff6c9af
Merge pull request #15063 from azat/symbolizers-settings-for-non-server
...
Set sanitizers options in the current shell too
2020-09-28 17:44:39 +03:00
Alexander Kuzmenkov
c48d212320
performance comparison
2020-09-28 15:09:08 +03:00
Alexander Kuzmenkov
1e7a0f0e5f
typo
2020-09-28 14:44:49 +03:00
alesapin
fff9e5d592
Merge branch 'master' into azat-symbolizers-settings-for-non-server
2020-09-28 12:31:05 +03:00
Alexander Tokmakov
b0d99217fb
Merge branch 'master' into write_structure_of_table_functions
2020-09-27 14:26:47 +03:00
Alexander Kuzmenkov
425150e783
bind to different nodes
2020-09-25 13:19:37 +03:00
Alexander Kuzmenkov
3ff16325d8
fix the profiler
2020-09-25 12:52:09 +03:00
Alexander Kuzmenkov
40209f9ed2
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-25 11:28:47 +03:00
Alexander Tokmakov
fb826557b7
Merge branch 'master' into enable_atomic_database_by_default
2020-09-25 02:04:01 +03:00
Alexander Kuzmenkov
4ed4205647
Update run.sh
2020-09-24 19:54:09 +03:00
tavplubix
1c9398c5ee
Merge pull request #15215 from ClickHouse/better_image_for_stateless
...
Better images for CI tests
2020-09-24 18:54:34 +03:00
Vitaly Baranov
0605808ed1
Merge pull request #14492 from vitlibar/use-previous-users-xml-if-failed-to-reload
...
Use previous users.xml if failed to reload
2020-09-24 16:25:19 +03:00
Alexander Kuzmenkov
651518566a
performance comparison
2020-09-24 16:24:44 +03:00
tavplubix
c298c633a7
Revert "Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka"
2020-09-24 16:10:24 +03:00
alesapin
cc305cf886
Fix fuzzer image
2020-09-24 15:34:03 +03:00
Alexander Kuzmenkov
dee34a834f
debug perf test run time
2020-09-24 14:46:03 +03:00
Alexander Kuzmenkov
41ad365eaf
Increase fast test threads to 8
...
Tests don't often fail in parallel (1/10 runs), so we can make them faster.
2020-09-24 14:11:59 +03:00
Alexander Kuzmenkov
26abe8cb30
Update compare.sh
2020-09-24 12:24:30 +03:00
alesapin
4f3eb4532a
Add missed changes
2020-09-24 11:37:20 +03:00
alesapin
bb8a2e1617
Better clickhouse-configs
2020-09-24 11:18:36 +03:00
alesapin
a85bb16c66
Remove zookeeper from CI images
2020-09-24 10:33:22 +03:00
Alexander Kuzmenkov
c2b11221a3
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-23 23:56:15 +03:00
Alexander Kuzmenkov
21f9cc65c9
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-23 23:54:55 +03:00
Alexander Kuzmenkov
179807b0b4
performance comparison
2020-09-23 23:45:39 +03:00
Alexander Tokmakov
f0f91f84af
Merge branch 'master' into enable_atomic_database_by_default
2020-09-23 21:50:15 +03:00
Ilya Yatsishin
7dad84ea6b
Merge pull request #14265 from arenadata/ADQM-160
...
Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka
2020-09-23 19:02:58 +03:00
Alexander Kuzmenkov
d96c89972c
Update compare.sh
2020-09-23 12:04:13 +03:00
Alexander Kuzmenkov
bb51aade56
Update docker/test/performance-comparison/compare.sh
...
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2020-09-23 12:02:22 +03:00
Alexander Kuzmenkov
833c07f1f7
Update compare.sh
2020-09-23 11:31:18 +03:00
Alexander Kuzmenkov
2b6f4134eb
Parallel create/fill in perf test
2020-09-23 11:22:54 +03:00
Alexander Kuzmenkov
5eaa2a08d4
Update report.py
2020-09-23 10:28:28 +03:00
alesapin
01237170af
Fix fast test CMakeOptions
2020-09-22 17:25:48 +03:00
Alexander Kuzmenkov
0b01e62050
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-22 14:29:54 +03:00
Alexander Kuzmenkov
4937159f85
Merge pull request #14990 from ClickHouse/aku/longer-perf
...
If perf test definition changed, run everything + longer (as in master)
2020-09-22 13:25:49 +03:00
Alexander Tokmakov
dc1cc11764
Merge branch 'master' into enable_atomic_database_by_default
2020-09-22 12:40:32 +03:00
Alexander Tokmakov
639466afdb
fix docker images
2020-09-22 10:45:08 +03:00
Azat Khuzhin
3fd85430f2
Set sanitizers options in the current shell too
...
/etc/environment will not be read in current shell, so export variables
from that file manually, to make clickhouse-local/clickhouse-client use
them too.
2020-09-21 23:57:45 +03:00
Alexander Kuzmenkov
4696e22799
Update perf.py
2020-09-21 22:08:41 +03:00
alexey-milovidov
5e56f14d5f
Merge pull request #15027 from ClickHouse/perf-test-separate-profiler
...
Separate profile runs in performance test
2020-09-21 21:07:14 +03:00
Ilya Golshtein
494e59e7c1
DOCKER_KERBEROS_KDC_TAG
2020-09-21 19:12:31 +03:00
alesapin
084b40affe
Merge pull request #15069 from ClickHouse/fix_test_images
...
Use llvm-symbolizer-11 in all test images.
2020-09-21 17:02:27 +03:00
Alexander Kuzmenkov
679c5278e4
reword the diagnostic about short queries in perf test
2020-09-21 15:14:47 +03:00
Alexander Kuzmenkov
2f8d7ae208
fix the conditions
2020-09-21 15:01:27 +03:00
Alexander Kuzmenkov
85be1f1685
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-21 14:57:25 +03:00
Alexander Tokmakov
13e41cdd20
try enable atomic database by default
2020-09-21 13:55:34 +03:00
alesapin
1bd76c820c
Back to 19.10
2020-09-21 12:05:10 +03:00
alesapin
fd469f1266
Remove redundant file
2020-09-21 10:41:23 +03:00
alesapin
27613f8346
Fix symbolizers path in test images
2020-09-21 10:38:11 +03:00
Vitaly Baranov
a288674867
Fix testflows tests.
2020-09-20 18:49:56 +03:00
Alexey Milovidov
ef800b5083
Perf test: development
2020-09-19 21:21:29 +03:00
Alexey Milovidov
35e8a895b6
Calculate profiler data in separate query runs
2020-09-19 20:38:21 +03:00
Alexey Milovidov
03aec83aec
Remove obsolete code from performance test
2020-09-19 19:27:37 +03:00
Alexander Tokmakov
1ca9a92b21
Merge branch 'master' into write_structure_of_table_functions
2020-09-18 21:09:23 +03:00
Alexander Kuzmenkov
8995140ffb
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-18 18:06:41 +03:00
Alexander Kuzmenkov
840586bd98
Merge pull request #14386 from ClickHouse/aku/perf-short
...
[wip] an experiment with short queries in perf test
2020-09-18 17:54:50 +03:00
Alexander Kuzmenkov
e7b9319e12
If perf test definition changed, run everything + longer (as in master)
...
Also some other perf test fixes
2020-09-18 16:28:46 +03:00
Alexander Kuzmenkov
cfc975d759
Merge pull request #14724 from ClickHouse/aku/perf-some
...
Run only some queries in perf tests, not all combos
2020-09-18 13:13:28 +03:00
Alexander Kuzmenkov
7f029ee03c
Update perf.py
2020-09-18 11:27:27 +03:00
Alexey Milovidov
799a675b5d
Merge branch 'master' into AES_encrypt_decrypt
2020-09-17 21:42:51 +03:00
Alexander Kuzmenkov
4fc86f05da
some fixes + docs + report queries that are not short
2020-09-17 19:21:59 +03:00
Alexander Kuzmenkov
b1d7df80cd
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-17 18:20:14 +03:00
Ilya Golshtein
624a4c4d55
kdc Dockerfile integrated
2020-09-17 16:51:34 +03:00
Ilya Golshtein
c227f91636
remove_files improved, proper docker images, tiny cleanup
2020-09-17 16:51:34 +03:00
Ilya Golshtein
a2e72ec37a
test via runner is Ok, switched to custom images
2020-09-17 16:51:34 +03:00
Ilya Golshtein
7a6f7a872a
forgotten docker changes
2020-09-17 16:51:34 +03:00
Ilya Golshtein
c12fa26fe3
kerberized kafka test works
2020-09-17 16:51:34 +03:00
Alexander Kuzmenkov
ada1c7c4a0
fixup
2020-09-17 13:15:46 +03:00
alesapin
50c55eb2d2
Merge pull request #14846 from ClickHouse/add_clang_11
...
Move to clang-11 in CI builds
2020-09-17 13:14:00 +03:00
Alexander Kuzmenkov
dda88eebd1
test again
2020-09-16 18:35:27 +03:00
Alexander Kuzmenkov
d55e3cd214
Update perf.py
2020-09-16 14:39:44 +03:00
Alexander Kuzmenkov
3b8ca1f262
Update compare.sh
2020-09-16 12:16:07 +03:00
Alexander Kuzmenkov
c5c5faf8ee
fixup
2020-09-16 12:06:42 +03:00
Alexander Kuzmenkov
e333a7bad4
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-16 12:05:22 +03:00
alesapin
d144421214
Disable lto for glibc-compatibility
2020-09-16 10:46:38 +03:00
alexey-milovidov
018f596d21
Merge pull request #14685 from ClickHouse/remap-executable
...
Attempt to make performance test more reliable
2020-09-15 15:09:47 +03:00
Alexander Kuzmenkov
df95f91d7c
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-15 13:53:50 +03:00
Alexander Kuzmenkov
24dd33d5cb
Update compare.sh
2020-09-15 13:44:21 +03:00
Alexander Tokmakov
da6beb1a91
Merge branch 'master' into enable_some_tests_with_database_atomic
2020-09-14 23:00:14 +03:00
Alexey Milovidov
b87c108246
Enable remap in performance tests
2020-09-14 21:14:28 +03:00
Alexander Kuzmenkov
ab6bc1ed59
Update compare.sh
2020-09-14 20:25:17 +03:00
Alexander Kuzmenkov
9e3797b252
Merge pull request #14710 from ClickHouse/aku/faster-perf
...
Do less runs in perf test
2020-09-14 19:17:34 +03:00
Alexander Kuzmenkov
b3138605c7
performance comparison
2020-09-14 19:16:59 +03:00
Vasily Nemkov
b980cf354a
Moving to TestFlows version 1.6.46
2020-09-14 18:24:57 +03:00
Alexander Kuzmenkov
3113aa6cfe
Avoid extra error in perf report on broken queries
2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov
c701a15271
fixup
2020-09-14 10:27:46 +03:00
Vitaliy Zakaznikov
bb1d126ce5
Updating TestFlows to 1.6.45 to fix stability issues with multi line commands.
2020-09-10 22:54:40 +03:00
Alexander Kuzmenkov
8689797efc
Run only some queries in perf tests, not all combos
2020-09-10 19:57:26 +03:00
Alexander Kuzmenkov
26348ad014
fixup
2020-09-10 18:48:39 +03:00
Alexander Kuzmenkov
ca2a33008b
faster
2020-09-10 17:55:54 +03:00
Nikita Mikhaylov
44726c37c3
Merge branch 'master' into fix-executable-dictionary-source-hangup
2020-09-09 23:01:41 +04:00
Alexander Tokmakov
d278d849e4
Merge branch 'master' into write_structure_of_table_functions
2020-09-09 17:12:35 +03:00
Alexander Tokmakov
b68782d285
enable more tests with Atomic database
2020-09-09 16:32:50 +03:00
Anton Popov
032f4ba6f3
Merge pull request #14532 from CurtizJ/fix-redis-test
...
Rework test for redis dictionary
2020-09-09 02:38:09 +03:00
robot-clickhouse
8def718661
Auto version update to [20.10.1.1] [54440]
2020-09-08 17:04:41 +03:00
alesapin
c40ba48822
Raise on error
2020-09-08 11:49:24 +03:00
alesapin
1a1bccf416
Add sleeps
2020-09-08 11:45:22 +03:00
alesapin
73253f058d
Add sleep
2020-09-08 11:45:01 +03:00
alesapin
0193a132d4
Add retries to s3 downloader
2020-09-08 11:43:02 +03:00
Anton Popov
9493532fdb
rework test for redis dictionary
2020-09-07 14:16:47 +03:00
Alexander Kuzmenkov
f7d631bf82
use fasttest script from sources
2020-09-07 13:19:01 +03:00
Alexey Milovidov
04a6965006
Fix error with executable dictionary source
2020-09-07 09:40:01 +03:00
Alexander Kuzmenkov
0904433c87
Temporarily remove UInt256 perf test broken in https://github.com/ClickHouse/ClickHouse/pull/14229
...
Also add one more timeout to perf test runner.
2020-09-07 09:33:57 +03:00
Alexander Kuzmenkov
1978968067
performance comparison
2020-09-07 02:49:34 +03:00
Vitaly Baranov
81db73f066
Merge pull request #13647 from qoega/integration-explicit-configs
...
Add explicit main_configs, user_configs and dictionaries in integration tests
2020-09-04 20:16:00 +03:00
Alexander Tokmakov
ed5f827708
Merge branch 'master' into write_structure_of_table_functions
2020-09-04 16:38:57 +03:00
alesapin
5d897231e1
Merge pull request #14432 from ClickHouse/minor-changes-in-stateful-tests
...
Wait for clickhouse-server to start in stateful tests
2020-09-04 13:12:32 +03:00
Alexander Tokmakov
b840d741d0
Merge branch 'master' into write_structure_of_table_functions
2020-09-04 13:00:07 +03:00
Alexander Tokmakov
df09bf3cb6
add suppressions for leak sanitizer
2020-09-03 22:50:26 +03:00
alexey-milovidov
fb56d0b9a3
Update run.sh
2020-09-03 21:21:27 +03:00
Alexander Kuzmenkov
29b97ff259
Merge pull request #14430 from ClickHouse/aku/perf4
...
[wip] perf experiment no.4 -- geomean
2020-09-03 21:13:07 +03:00
Vasily Nemkov
9ba4613381
Excluding tests from fasttest runs since they depend on external libraries: OpenSSL
2020-09-03 16:12:32 +03:00
Yatsishin Ilya
14b61e87d9
mysql bin log
2020-09-03 13:27:17 +03:00
Yatsishin Ilya
fc075e65da
Merge remote-tracking branch 'origin' into integration-explicit-configs
2020-09-03 11:49:48 +03:00
Alexey Milovidov
cd812d94de
Wait for clickhouse-server to start in stateful tests
2020-09-03 04:54:50 +03:00
Alexander Kuzmenkov
a321d6970c
adjust report and increase time
2020-09-03 04:42:25 +03:00
Alexander Kuzmenkov
8e8e195e45
geomean
2020-09-03 03:58:40 +03:00
alesapin
12f76d9448
Merge pull request #14325 from azat/suppress-wget-output
...
Suppress superfluous wget (-nv) output
2020-09-02 14:59:28 +03:00
Yatsishin Ilya
5ab9f249e5
Merge branch 'try-dns-fix' into integration-explicit-configs
2020-09-02 12:53:10 +03:00
Yatsishin Ilya
6902bbce50
Merge remote-tracking branch 'origin' into integration-explicit-configs
2020-09-02 12:48:07 +03:00
Yatsishin Ilya
5d39b8ce04
unnecessary change
2020-09-02 11:39:16 +03:00
Alexander Kuzmenkov
00c924b0dd
whitespace
2020-09-02 06:31:53 +03:00
Alexander Kuzmenkov
5fcb9bd163
short queries
2020-09-02 06:29:36 +03:00
Alexander Kuzmenkov
e622e108f7
readme
2020-09-02 06:29:16 +03:00
Alexander Kuzmenkov
0db5b4a72c
Remove concurrent benchmark from the perf test
...
It's not stable enough and has only secondary utility.
2020-09-02 02:43:23 +03:00
Alexander Kuzmenkov
f6cfb96748
Merge pull request #14346 from ClickHouse/aku/fuzzer
...
Don't let the fuzzer change max_execution_time
2020-09-02 01:59:50 +03:00
Anton Popov
7c3712c121
Merge pull request #13688 from it1804/master
...
Redis dictionary support for simple Redis requirepass authorization
2020-09-02 01:43:02 +03:00
Alexander Kuzmenkov
a6486490a2
performance comparison
2020-09-01 22:05:57 +03:00
Alexander Kuzmenkov
0b70abe542
Don't let the fuzzer change max_execution_time
2020-09-01 18:51:46 +03:00
Alexander Kuzmenkov
2f3bb5844a
Merge branch 'master' into suppress-wget-output
2020-09-01 16:59:04 +03:00
Alexander Kuzmenkov
4620ac4c0d
Update docker/test/fuzzer/run-fuzzer.sh
2020-09-01 16:57:20 +03:00
Alexander Kuzmenkov
4e58f00305
Update docker/test/fuzzer/run-fuzzer.sh
2020-09-01 16:57:13 +03:00
Alexander Kuzmenkov
73d433a7dd
Merge pull request #14316 from ClickHouse/aku/html-fuzzer
...
Add a HTML report for AST Fuzzer
2020-09-01 16:46:30 +03:00
Azat Khuzhin
2d7cb03120
Suppress superfluous wget (-nv) output
...
Since for dowloading some of files wget logging may take 50% of overall
log [1].
[1]: https://clickhouse-builds.s3.yandex.net/14315/c32ff4c98cb3b83a12f945eadd180415b7a3b269/clickhouse_build_check/build_log_761119955_1598923036.txt
2020-09-01 10:25:13 +03:00
Yatsishin Ilya
6cb893f073
Draft.
2020-09-01 09:38:23 +03:00
Alexander Kuzmenkov
33c5815eb3
Add a HTML report for AST Fuzzer
2020-09-01 02:33:42 +03:00
robot-clickhouse
e2fa0eae2f
Auto version update to [20.9.1.1] [54439]
2020-08-31 23:07:41 +03:00
Alexander Kuzmenkov
bc8765d5ad
Merge pull request #14095 from azat/DistributedFilesToInsert-fix
...
Fix DistributedFilesToInsert metric (zeroed when it should not)
2020-08-31 18:58:30 +03:00
Alexander Kuzmenkov
b601dd4596
cosmetic fixes for performance report
2020-08-29 01:46:04 +03:00
Alexander Kuzmenkov
bb28320107
cosmetic fixes in performance report
2020-08-29 01:14:48 +03:00
Azat Khuzhin
a384194216
Add a test for DistributedFilesToInsert
2020-08-27 22:00:35 +03:00
Ilya Yatsishin
7509991d82
Merge pull request #14167 from qoega/docker-test-base
...
Switch docker tests to use test-base
2020-08-27 16:45:55 +03:00
