Commit Graph

1253 Commits

Author SHA1 Message Date
alexey-milovidov
5e56f14d5f
Merge pull request #15027 from ClickHouse/perf-test-separate-profiler
Separate profile runs in performance test
2020-09-21 21:07:14 +03:00
Ilya Golshtein
494e59e7c1 DOCKER_KERBEROS_KDC_TAG 2020-09-21 19:12:31 +03:00
Nikolai Kochetov
8a3549ebd3 Merge branch 'master' into control-heavy-builds 2020-09-21 17:09:33 +03:00
alesapin
084b40affe
Merge pull request #15069 from ClickHouse/fix_test_images
Use llvm-symbolizer-11 in all test images.
2020-09-21 17:02:27 +03:00
Alexander Kuzmenkov
679c5278e4 reword the diagnostic about short queries in perf test 2020-09-21 15:14:47 +03:00
Alexander Kuzmenkov
2f8d7ae208 fix the conditions 2020-09-21 15:01:27 +03:00
Alexander Kuzmenkov
85be1f1685 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-21 14:57:25 +03:00
Alexander Tokmakov
13e41cdd20 try enable atomic database by default 2020-09-21 13:55:34 +03:00
alesapin
1bd76c820c Back to 19.10 2020-09-21 12:05:10 +03:00
alesapin
fd469f1266 Remove redundant file 2020-09-21 10:41:23 +03:00
alesapin
27613f8346 Fix symbolizers path in test images 2020-09-21 10:38:11 +03:00
Alexey Milovidov
035d7cb47f Enable control for heavy translation units 2020-09-20 23:46:32 +03:00
Vitaly Baranov
a288674867 Fix testflows tests. 2020-09-20 18:49:56 +03:00
Alexey Milovidov
ef800b5083 Perf test: development 2020-09-19 21:21:29 +03:00
Alexey Milovidov
35e8a895b6 Calculate profiler data in separate query runs 2020-09-19 20:38:21 +03:00
Alexey Milovidov
03aec83aec Remove obsolete code from performance test 2020-09-19 19:27:37 +03:00
alesapin
368ddada33 Fix binary build 2020-09-18 22:01:59 +03:00
alesapin
1f429b3d52 Set enable tests to zero for performance build 2020-09-18 22:01:59 +03:00
Alexander Tokmakov
1ca9a92b21 Merge branch 'master' into write_structure_of_table_functions 2020-09-18 21:09:23 +03:00
Alexander Kuzmenkov
8995140ffb Merge remote-tracking branch 'origin/master' into HEAD 2020-09-18 18:06:41 +03:00
Alexander Kuzmenkov
840586bd98
Merge pull request #14386 from ClickHouse/aku/perf-short
[wip] an experiment with short queries in perf test
2020-09-18 17:54:50 +03:00
Alexander Kuzmenkov
e7b9319e12 If perf test definition changed, run everything + longer (as in master)
Also some other perf test fixes
2020-09-18 16:28:46 +03:00
Alexander Kuzmenkov
cfc975d759
Merge pull request #14724 from ClickHouse/aku/perf-some
Run only some queries in perf tests, not all combos
2020-09-18 13:13:28 +03:00
Alexander Kuzmenkov
7f029ee03c
Update perf.py 2020-09-18 11:27:27 +03:00
Alexey Milovidov
799a675b5d Merge branch 'master' into AES_encrypt_decrypt 2020-09-17 21:42:51 +03:00
Alexander Kuzmenkov
4fc86f05da some fixes + docs + report queries that are not short 2020-09-17 19:21:59 +03:00
Alexander Kuzmenkov
b1d7df80cd Merge remote-tracking branch 'origin/master' into HEAD 2020-09-17 18:20:14 +03:00
Ilya Golshtein
624a4c4d55 kdc Dockerfile integrated 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c227f91636 remove_files improved, proper docker images, tiny cleanup 2020-09-17 16:51:34 +03:00
Ilya Golshtein
a2e72ec37a test via runner is Ok, switched to custom images 2020-09-17 16:51:34 +03:00
Ilya Golshtein
7a6f7a872a forgotten docker changes 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c12fa26fe3 kerberized kafka test works 2020-09-17 16:51:34 +03:00
Nikolai Kochetov
000cd42d5e
Merge pull request #14917 from ClickHouse/revert-14607-lower-number-of-threads-in-binary-build
Revert "Lower number of threads in binary build"
2020-09-17 15:45:02 +03:00
Alexander Kuzmenkov
ada1c7c4a0 fixup 2020-09-17 13:15:46 +03:00
alesapin
50c55eb2d2
Merge pull request #14846 from ClickHouse/add_clang_11
Move to clang-11 in CI builds
2020-09-17 13:14:00 +03:00
Nikolai Kochetov
d23244b3a5
Revert "Lower number of threads in binary build" 2020-09-17 12:45:06 +03:00
Alexander Kuzmenkov
dda88eebd1
test again 2020-09-16 18:35:27 +03:00
Alexander Kuzmenkov
d55e3cd214
Update perf.py 2020-09-16 14:39:44 +03:00
Alexander Kuzmenkov
3b8ca1f262
Update compare.sh 2020-09-16 12:16:07 +03:00
Alexander Kuzmenkov
c5c5faf8ee fixup 2020-09-16 12:06:42 +03:00
Alexander Kuzmenkov
e333a7bad4 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-16 12:05:22 +03:00
alesapin
d144421214 Disable lto for glibc-compatibility 2020-09-16 10:46:38 +03:00
alesapin
7fc09b930e Clang 11 in binary build 2020-09-15 15:16:23 +03:00
alexey-milovidov
018f596d21
Merge pull request #14685 from ClickHouse/remap-executable
Attempt to make performance test more reliable
2020-09-15 15:09:47 +03:00
Alexander Kuzmenkov
df95f91d7c Merge remote-tracking branch 'origin/master' into HEAD 2020-09-15 13:53:50 +03:00
Alexander Kuzmenkov
24dd33d5cb
Update compare.sh 2020-09-15 13:44:21 +03:00
tavplubix
1d8ee50769
Merge pull request #14628 from ClickHouse/enable_some_tests_with_database_atomic
Enable more tests with Atomic database
2020-09-15 12:13:40 +03:00
alesapin
a75254766e
Merge pull request #14609 from ClickHouse/update_to_gcc_10
Update default build to gcc-10
2020-09-15 09:49:43 +03:00
Alexander Tokmakov
da6beb1a91 Merge branch 'master' into enable_some_tests_with_database_atomic 2020-09-14 23:00:14 +03:00
Alexey Milovidov
b87c108246 Enable remap in performance tests 2020-09-14 21:14:28 +03:00
Alexander Kuzmenkov
ab6bc1ed59
Update compare.sh 2020-09-14 20:25:17 +03:00
Alexander Kuzmenkov
9e3797b252
Merge pull request #14710 from ClickHouse/aku/faster-perf
Do less runs in perf test
2020-09-14 19:17:34 +03:00
Alexander Kuzmenkov
b3138605c7 performance comparison 2020-09-14 19:16:59 +03:00
Vasily Nemkov
b980cf354a Moving to TestFlows version 1.6.46 2020-09-14 18:24:57 +03:00
alesapin
393c213866 Revert changes 2020-09-14 15:25:00 +03:00
alesapin
558164bf24 Add retries 2020-09-14 11:17:59 +03:00
alesapin
e519e2b87a Use patched dpkg on build stage 2020-09-14 11:16:00 +03:00
Alexander Kuzmenkov
3113aa6cfe Avoid extra error in perf report on broken queries 2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov
c701a15271 fixup 2020-09-14 10:27:46 +03:00
alesapin
b0e6df1532 Trying to fix build 2020-09-14 10:21:03 +03:00
alesapin
c202ce8e63 Merge branch 'master' into update_to_gcc_10 2020-09-11 12:50:10 +03:00
Vitaliy Zakaznikov
bb1d126ce5 Updating TestFlows to 1.6.45 to fix stability issues with multi line commands. 2020-09-10 22:54:40 +03:00
Alexander Kuzmenkov
8689797efc Run only some queries in perf tests, not all combos 2020-09-10 19:57:26 +03:00
Alexander Kuzmenkov
26348ad014 fixup 2020-09-10 18:48:39 +03:00
Alexander Kuzmenkov
ca2a33008b faster 2020-09-10 17:55:54 +03:00
Nikita Mikhaylov
44726c37c3
Merge branch 'master' into fix-executable-dictionary-source-hangup 2020-09-09 23:01:41 +04:00
Alexander Tokmakov
d278d849e4 Merge branch 'master' into write_structure_of_table_functions 2020-09-09 17:12:35 +03:00
Alexander Tokmakov
b68782d285 enable more tests with Atomic database 2020-09-09 16:32:50 +03:00
alesapin
956138635d Fix compiler name 2020-09-09 15:59:26 +03:00
alesapin
c535d75243 Add update 2020-09-09 14:47:34 +03:00
alesapin
ca6b634eb0 Install gcc-10 from proposed repo 2020-09-09 13:51:01 +03:00
alesapin
f528cd9f97 Forward compiler version to unbundled build 2020-09-09 13:01:12 +03:00
Alexey Milovidov
cc2b4014ff Lower number of threads in binary build 2020-09-09 09:32:09 +03:00
Anton Popov
032f4ba6f3
Merge pull request #14532 from CurtizJ/fix-redis-test
Rework test for redis dictionary
2020-09-09 02:38:09 +03:00
robot-clickhouse
8def718661 Auto version update to [20.10.1.1] [54440] 2020-09-08 17:04:41 +03:00
alesapin
c40ba48822 Raise on error 2020-09-08 11:49:24 +03:00
alesapin
1a1bccf416 Add sleeps 2020-09-08 11:45:22 +03:00
alesapin
73253f058d Add sleep 2020-09-08 11:45:01 +03:00
alesapin
0193a132d4 Add retries to s3 downloader 2020-09-08 11:43:02 +03:00
alesapin
54cdb2472c Bump binary image version 2020-09-07 18:40:21 +03:00
Anton Popov
9493532fdb rework test for redis dictionary 2020-09-07 14:16:47 +03:00
Alexander Kuzmenkov
f7d631bf82 use fasttest script from sources 2020-09-07 13:19:01 +03:00
Alexey Milovidov
04a6965006 Fix error with executable dictionary source 2020-09-07 09:40:01 +03:00
Alexander Kuzmenkov
0904433c87 Temporarily remove UInt256 perf test broken in https://github.com/ClickHouse/ClickHouse/pull/14229
Also add one more timeout to perf test runner.
2020-09-07 09:33:57 +03:00
Alexander Kuzmenkov
1978968067 performance comparison 2020-09-07 02:49:34 +03:00
Vitaly Baranov
81db73f066
Merge pull request #13647 from qoega/integration-explicit-configs
Add explicit main_configs, user_configs and dictionaries in integration tests
2020-09-04 20:16:00 +03:00
Alexander Tokmakov
ed5f827708 Merge branch 'master' into write_structure_of_table_functions 2020-09-04 16:38:57 +03:00
alesapin
5d897231e1
Merge pull request #14432 from ClickHouse/minor-changes-in-stateful-tests
Wait for clickhouse-server to start in stateful tests
2020-09-04 13:12:32 +03:00
Alexander Tokmakov
b840d741d0 Merge branch 'master' into write_structure_of_table_functions 2020-09-04 13:00:07 +03:00
Alexander Tokmakov
df09bf3cb6 add suppressions for leak sanitizer 2020-09-03 22:50:26 +03:00
alexey-milovidov
fb56d0b9a3
Update run.sh 2020-09-03 21:21:27 +03:00
Alexander Kuzmenkov
29b97ff259
Merge pull request #14430 from ClickHouse/aku/perf4
[wip] perf experiment no.4 -- geomean
2020-09-03 21:13:07 +03:00
Vasily Nemkov
9ba4613381 Excluding tests from fasttest runs since they depend on external libraries: OpenSSL 2020-09-03 16:12:32 +03:00
Yatsishin Ilya
14b61e87d9 mysql bin log 2020-09-03 13:27:17 +03:00
Yatsishin Ilya
fc075e65da Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-09-03 11:49:48 +03:00
Alexey Milovidov
cd812d94de Wait for clickhouse-server to start in stateful tests 2020-09-03 04:54:50 +03:00
Alexander Kuzmenkov
a321d6970c adjust report and increase time 2020-09-03 04:42:25 +03:00
Alexander Kuzmenkov
8e8e195e45 geomean 2020-09-03 03:58:40 +03:00
alesapin
12f76d9448
Merge pull request #14325 from azat/suppress-wget-output
Suppress superfluous wget (-nv) output
2020-09-02 14:59:28 +03:00
Yatsishin Ilya
5ab9f249e5 Merge branch 'try-dns-fix' into integration-explicit-configs 2020-09-02 12:53:10 +03:00
Yatsishin Ilya
6902bbce50 Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-09-02 12:48:07 +03:00
Yatsishin Ilya
5d39b8ce04 unnecessary change 2020-09-02 11:39:16 +03:00
Alexander Kuzmenkov
00c924b0dd whitespace 2020-09-02 06:31:53 +03:00
Alexander Kuzmenkov
5fcb9bd163 short queries 2020-09-02 06:29:36 +03:00
Alexander Kuzmenkov
e622e108f7 readme 2020-09-02 06:29:16 +03:00
Alexander Kuzmenkov
0db5b4a72c Remove concurrent benchmark from the perf test
It's not stable enough and has only secondary utility.
2020-09-02 02:43:23 +03:00
Alexander Kuzmenkov
f6cfb96748
Merge pull request #14346 from ClickHouse/aku/fuzzer
Don't let the fuzzer change max_execution_time
2020-09-02 01:59:50 +03:00
Anton Popov
7c3712c121
Merge pull request #13688 from it1804/master
Redis dictionary support for simple Redis requirepass authorization
2020-09-02 01:43:02 +03:00
Alexander Kuzmenkov
a6486490a2 performance comparison 2020-09-01 22:05:57 +03:00
Alexander Kuzmenkov
0b70abe542 Don't let the fuzzer change max_execution_time 2020-09-01 18:51:46 +03:00
Alexander Kuzmenkov
2f3bb5844a
Merge branch 'master' into suppress-wget-output 2020-09-01 16:59:04 +03:00
Alexander Kuzmenkov
4620ac4c0d
Update docker/test/fuzzer/run-fuzzer.sh 2020-09-01 16:57:20 +03:00
Alexander Kuzmenkov
4e58f00305
Update docker/test/fuzzer/run-fuzzer.sh 2020-09-01 16:57:13 +03:00
Alexander Kuzmenkov
73d433a7dd
Merge pull request #14316 from ClickHouse/aku/html-fuzzer
Add a HTML report for AST Fuzzer
2020-09-01 16:46:30 +03:00
Azat Khuzhin
2d7cb03120 Suppress superfluous wget (-nv) output
Since for dowloading some of files wget logging may take 50% of overall
log [1].

  [1]: https://clickhouse-builds.s3.yandex.net/14315/c32ff4c98cb3b83a12f945eadd180415b7a3b269/clickhouse_build_check/build_log_761119955_1598923036.txt
2020-09-01 10:25:13 +03:00
Yatsishin Ilya
6cb893f073 Draft. 2020-09-01 09:38:23 +03:00
Alexander Kuzmenkov
33c5815eb3 Add a HTML report for AST Fuzzer 2020-09-01 02:33:42 +03:00
robot-clickhouse
e2fa0eae2f Auto version update to [20.9.1.1] [54439] 2020-08-31 23:07:41 +03:00
Alexander Kuzmenkov
bc8765d5ad
Merge pull request #14095 from azat/DistributedFilesToInsert-fix
Fix DistributedFilesToInsert metric (zeroed when it should not)
2020-08-31 18:58:30 +03:00
Alexey Milovidov
0aec4c99d0 Cut off broken parts of "unbundled" build 2020-08-29 18:42:04 +03:00
Alexander Kuzmenkov
b601dd4596 cosmetic fixes for performance report 2020-08-29 01:46:04 +03:00
Alexander Kuzmenkov
bb28320107 cosmetic fixes in performance report 2020-08-29 01:14:48 +03:00
Azat Khuzhin
a384194216 Add a test for DistributedFilesToInsert 2020-08-27 22:00:35 +03:00
Yatsishin Ilya
2e7a4483f6 fixes after #13687 2020-08-27 20:35:51 +03:00
Yatsishin Ilya
74d52e69d3 fix 2020-08-27 19:13:32 +03:00
Yatsishin Ilya
3bf5dc578d fixes 2020-08-27 19:06:40 +03:00
Yatsishin Ilya
9e9e723061 Merge remote-tracking branch 'origin' into unbundled-packager 2020-08-27 18:54:43 +03:00
Ilya Yatsishin
7509991d82
Merge pull request #14167 from qoega/docker-test-base
Switch docker tests to use test-base
2020-08-27 16:45:55 +03:00
Yatsishin Ilya
bf6de9c28a Merge remote-tracking branch 'origin' into unbundled-packager 2020-08-27 16:00:36 +03:00
alexey-milovidov
e1cf919c93
Merge pull request #14112 from vzakaznikov/testflows_increase_compose_http_timeout_and_retry_docker_compose_up
testflows: adding retry logic when bringing up docker-compose cluster
2020-08-27 15:51:16 +03:00
Alexander Tokmakov
65a69ff6ad move docker-compose files 2020-08-27 14:46:19 +03:00
Yatsishin Ilya
bfe4e94806 Switch docker tests to use test-base 2020-08-27 13:17:17 +03:00
Yatsishin Ilya
345fd77695 Merge remote-tracking branch 'origin' into unbundled-packager 2020-08-27 13:01:14 +03:00
Yatsishin Ilya
fa1875a313 Merge remote-tracking branch 'origin' into unbundled-packager 2020-08-27 13:00:56 +03:00
Alexey Milovidov
fe5cfe3151 Increase number of threads in stress test 2020-08-26 23:39:02 +03:00
Alexey Milovidov
0bfe78636c Increase number of threads in stress test 2020-08-26 23:38:20 +03:00
alexey-milovidov
f62037e9dc
Update stress 2020-08-26 20:45:36 +03:00
Alexey Milovidov
07596b5323 Limit stress test to one hour 2020-08-26 20:44:03 +03:00
Vitaliy Zakaznikov
eb01601944 Adding retry login when bringing docker-compose cluster
Moving to using testflows version 1.6.42
2020-08-26 10:00:12 -04:00
Konstantin Podshumok
cbdedc39f2
REVERSE ME: workaround for docker/packager/unbundled
Please, reverse this commit after docker/packager/deb image update

Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:34:36 +03:00
Konstantin Podshumok
f4383389d5
sync unbundled/build.sh with a0ae1b2b42
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:44 +03:00
Konstantin Podshumok
cda4472ebc
dockerfiles: verify 3rd party apt repos, disable LLVM in PVS check
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:44 +03:00
Konstantin Podshumok
68a921cdea
cmake: use bundled rdkafaka for in unbundled tests for now
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:43 +03:00
Konstantin Podshumok
45e089e0c3
re-enable replxx in packager for unbundled
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:42 +03:00
Konstantin Podshumok
b3180437da
test builds: docker/packager/packager: re-enable mysql
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:42 +03:00
Konstantin Podshumok
17c46faaa7
cmake: fix parquet/arrow variables
squashed:

- sync FindArrow.cmake and FindParquet.cmake with arrow repo
- unbundled: add arrow to dbms link libraries
- cmake: fix-up unbundled Arrow support

Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:41 +03:00
Konstantin Podshumok
4e9b5bd31b
docker/packager/deb: new dependencies for unbundled
Squashed:
- docker/packager/deb: add arrow repo
- docker/packager/deb: cleanup
- docker/packager/deb: Add thrift
- docker/packager/deb: add myariadbclient
- docker/packager/deb: remove poco-dev as we always use contrib/ version now
- docker/packager/deb: add libssl-dev (unbundled) and restructure
- docker/packager/deb: fix repo url
- docker/packager/deb: fix tzdata not updated in build.sh
- docker/packager/deb: add mysqlclient-dev

Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:40 +03:00
Yatsishin Ilya
b8002dc812 mErge remote-tracking branch 'origin' into unbundled-packager 2020-08-25 14:12:01 +03:00
alexey-milovidov
7ea5364299
Merge pull request #13648 from filimonov/tzdata_version2
tzdata improvements
2020-08-24 23:07:37 +03:00
alexey-milovidov
ad64cea4aa
Merge pull request #13980 from ClickHouse/fix-stress-test-2
Attempt to fix stress test
2020-08-24 22:03:32 +03:00