Commit Graph

1597 Commits

Author SHA1 Message Date
alesapin
368ddada33 Fix binary build 2020-09-18 22:01:59 +03:00
alesapin
1f429b3d52 Set enable tests to zero for performance build 2020-09-18 22:01:59 +03:00
Alexander Tokmakov
1ca9a92b21 Merge branch 'master' into write_structure_of_table_functions 2020-09-18 21:09:23 +03:00
Alexander Kuzmenkov
8995140ffb Merge remote-tracking branch 'origin/master' into HEAD 2020-09-18 18:06:41 +03:00
Alexander Kuzmenkov
840586bd98
Merge pull request #14386 from ClickHouse/aku/perf-short
[wip] an experiment with short queries in perf test
2020-09-18 17:54:50 +03:00
Alexander Kuzmenkov
e7b9319e12 If perf test definition changed, run everything + longer (as in master)
Also some other perf test fixes
2020-09-18 16:28:46 +03:00
Alexander Kuzmenkov
cfc975d759
Merge pull request #14724 from ClickHouse/aku/perf-some
Run only some queries in perf tests, not all combos
2020-09-18 13:13:28 +03:00
Alexander Kuzmenkov
7f029ee03c
Update perf.py 2020-09-18 11:27:27 +03:00
Alexey Milovidov
799a675b5d Merge branch 'master' into AES_encrypt_decrypt 2020-09-17 21:42:51 +03:00
Alexander Kuzmenkov
4fc86f05da some fixes + docs + report queries that are not short 2020-09-17 19:21:59 +03:00
Alexander Kuzmenkov
b1d7df80cd Merge remote-tracking branch 'origin/master' into HEAD 2020-09-17 18:20:14 +03:00
Ilya Golshtein
624a4c4d55 kdc Dockerfile integrated 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c227f91636 remove_files improved, proper docker images, tiny cleanup 2020-09-17 16:51:34 +03:00
Ilya Golshtein
a2e72ec37a test via runner is Ok, switched to custom images 2020-09-17 16:51:34 +03:00
Ilya Golshtein
7a6f7a872a forgotten docker changes 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c12fa26fe3 kerberized kafka test works 2020-09-17 16:51:34 +03:00
Nikolai Kochetov
000cd42d5e
Merge pull request #14917 from ClickHouse/revert-14607-lower-number-of-threads-in-binary-build
Revert "Lower number of threads in binary build"
2020-09-17 15:45:02 +03:00
Alexander Kuzmenkov
ada1c7c4a0 fixup 2020-09-17 13:15:46 +03:00
alesapin
50c55eb2d2
Merge pull request #14846 from ClickHouse/add_clang_11
Move to clang-11 in CI builds
2020-09-17 13:14:00 +03:00
Nikolai Kochetov
d23244b3a5
Revert "Lower number of threads in binary build" 2020-09-17 12:45:06 +03:00
Alexander Kuzmenkov
dda88eebd1
test again 2020-09-16 18:35:27 +03:00
Alexander Kuzmenkov
d55e3cd214
Update perf.py 2020-09-16 14:39:44 +03:00
Alexander Kuzmenkov
3b8ca1f262
Update compare.sh 2020-09-16 12:16:07 +03:00
Alexander Kuzmenkov
c5c5faf8ee fixup 2020-09-16 12:06:42 +03:00
Alexander Kuzmenkov
e333a7bad4 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-16 12:05:22 +03:00
alesapin
d144421214 Disable lto for glibc-compatibility 2020-09-16 10:46:38 +03:00
alesapin
7fc09b930e Clang 11 in binary build 2020-09-15 15:16:23 +03:00
alexey-milovidov
018f596d21
Merge pull request #14685 from ClickHouse/remap-executable
Attempt to make performance test more reliable
2020-09-15 15:09:47 +03:00
Alexander Kuzmenkov
df95f91d7c Merge remote-tracking branch 'origin/master' into HEAD 2020-09-15 13:53:50 +03:00
Alexander Kuzmenkov
24dd33d5cb
Update compare.sh 2020-09-15 13:44:21 +03:00
tavplubix
1d8ee50769
Merge pull request #14628 from ClickHouse/enable_some_tests_with_database_atomic
Enable more tests with Atomic database
2020-09-15 12:13:40 +03:00
alesapin
a75254766e
Merge pull request #14609 from ClickHouse/update_to_gcc_10
Update default build to gcc-10
2020-09-15 09:49:43 +03:00
Alexander Tokmakov
da6beb1a91 Merge branch 'master' into enable_some_tests_with_database_atomic 2020-09-14 23:00:14 +03:00
Alexey Milovidov
b87c108246 Enable remap in performance tests 2020-09-14 21:14:28 +03:00
Alexander Kuzmenkov
ab6bc1ed59
Update compare.sh 2020-09-14 20:25:17 +03:00
Alexander Kuzmenkov
9e3797b252
Merge pull request #14710 from ClickHouse/aku/faster-perf
Do less runs in perf test
2020-09-14 19:17:34 +03:00
Alexander Kuzmenkov
b3138605c7 performance comparison 2020-09-14 19:16:59 +03:00
Vasily Nemkov
b980cf354a Moving to TestFlows version 1.6.46 2020-09-14 18:24:57 +03:00
alesapin
393c213866 Revert changes 2020-09-14 15:25:00 +03:00
alesapin
558164bf24 Add retries 2020-09-14 11:17:59 +03:00
alesapin
e519e2b87a Use patched dpkg on build stage 2020-09-14 11:16:00 +03:00
Alexander Kuzmenkov
3113aa6cfe Avoid extra error in perf report on broken queries 2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov
c701a15271 fixup 2020-09-14 10:27:46 +03:00
alesapin
b0e6df1532 Trying to fix build 2020-09-14 10:21:03 +03:00
alesapin
c202ce8e63 Merge branch 'master' into update_to_gcc_10 2020-09-11 12:50:10 +03:00
Vitaliy Zakaznikov
bb1d126ce5 Updating TestFlows to 1.6.45 to fix stability issues with multi line commands. 2020-09-10 22:54:40 +03:00
Alexander Kuzmenkov
8689797efc Run only some queries in perf tests, not all combos 2020-09-10 19:57:26 +03:00
Alexander Kuzmenkov
26348ad014 fixup 2020-09-10 18:48:39 +03:00
Alexander Kuzmenkov
ca2a33008b faster 2020-09-10 17:55:54 +03:00
Nikita Mikhaylov
44726c37c3
Merge branch 'master' into fix-executable-dictionary-source-hangup 2020-09-09 23:01:41 +04:00
Alexander Tokmakov
d278d849e4 Merge branch 'master' into write_structure_of_table_functions 2020-09-09 17:12:35 +03:00
Alexander Tokmakov
b68782d285 enable more tests with Atomic database 2020-09-09 16:32:50 +03:00
alesapin
956138635d Fix compiler name 2020-09-09 15:59:26 +03:00
alesapin
c535d75243 Add update 2020-09-09 14:47:34 +03:00
alesapin
ca6b634eb0 Install gcc-10 from proposed repo 2020-09-09 13:51:01 +03:00
alesapin
f528cd9f97 Forward compiler version to unbundled build 2020-09-09 13:01:12 +03:00
Alexey Milovidov
cc2b4014ff Lower number of threads in binary build 2020-09-09 09:32:09 +03:00
Anton Popov
032f4ba6f3
Merge pull request #14532 from CurtizJ/fix-redis-test
Rework test for redis dictionary
2020-09-09 02:38:09 +03:00
robot-clickhouse
8def718661 Auto version update to [20.10.1.1] [54440] 2020-09-08 17:04:41 +03:00
alesapin
c40ba48822 Raise on error 2020-09-08 11:49:24 +03:00
alesapin
1a1bccf416 Add sleeps 2020-09-08 11:45:22 +03:00
alesapin
73253f058d Add sleep 2020-09-08 11:45:01 +03:00
alesapin
0193a132d4 Add retries to s3 downloader 2020-09-08 11:43:02 +03:00
alesapin
54cdb2472c Bump binary image version 2020-09-07 18:40:21 +03:00
Anton Popov
9493532fdb rework test for redis dictionary 2020-09-07 14:16:47 +03:00
Alexander Kuzmenkov
f7d631bf82 use fasttest script from sources 2020-09-07 13:19:01 +03:00
Alexey Milovidov
04a6965006 Fix error with executable dictionary source 2020-09-07 09:40:01 +03:00
Alexander Kuzmenkov
0904433c87 Temporarily remove UInt256 perf test broken in https://github.com/ClickHouse/ClickHouse/pull/14229
Also add one more timeout to perf test runner.
2020-09-07 09:33:57 +03:00
Alexander Kuzmenkov
1978968067 performance comparison 2020-09-07 02:49:34 +03:00
Vitaly Baranov
81db73f066
Merge pull request #13647 from qoega/integration-explicit-configs
Add explicit main_configs, user_configs and dictionaries in integration tests
2020-09-04 20:16:00 +03:00
Alexander Tokmakov
ed5f827708 Merge branch 'master' into write_structure_of_table_functions 2020-09-04 16:38:57 +03:00
alesapin
5d897231e1
Merge pull request #14432 from ClickHouse/minor-changes-in-stateful-tests
Wait for clickhouse-server to start in stateful tests
2020-09-04 13:12:32 +03:00
Alexander Tokmakov
b840d741d0 Merge branch 'master' into write_structure_of_table_functions 2020-09-04 13:00:07 +03:00
Alexander Tokmakov
df09bf3cb6 add suppressions for leak sanitizer 2020-09-03 22:50:26 +03:00
alexey-milovidov
fb56d0b9a3
Update run.sh 2020-09-03 21:21:27 +03:00
Alexander Kuzmenkov
29b97ff259
Merge pull request #14430 from ClickHouse/aku/perf4
[wip] perf experiment no.4 -- geomean
2020-09-03 21:13:07 +03:00
Vasily Nemkov
9ba4613381 Excluding tests from fasttest runs since they depend on external libraries: OpenSSL 2020-09-03 16:12:32 +03:00
Yatsishin Ilya
14b61e87d9 mysql bin log 2020-09-03 13:27:17 +03:00
Yatsishin Ilya
fc075e65da Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-09-03 11:49:48 +03:00
Alexey Milovidov
cd812d94de Wait for clickhouse-server to start in stateful tests 2020-09-03 04:54:50 +03:00
Alexander Kuzmenkov
a321d6970c adjust report and increase time 2020-09-03 04:42:25 +03:00
Alexander Kuzmenkov
8e8e195e45 geomean 2020-09-03 03:58:40 +03:00
alesapin
12f76d9448
Merge pull request #14325 from azat/suppress-wget-output
Suppress superfluous wget (-nv) output
2020-09-02 14:59:28 +03:00
Yatsishin Ilya
5ab9f249e5 Merge branch 'try-dns-fix' into integration-explicit-configs 2020-09-02 12:53:10 +03:00
Yatsishin Ilya
6902bbce50 Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-09-02 12:48:07 +03:00
Yatsishin Ilya
5d39b8ce04 unnecessary change 2020-09-02 11:39:16 +03:00
Alexander Kuzmenkov
00c924b0dd whitespace 2020-09-02 06:31:53 +03:00
Alexander Kuzmenkov
5fcb9bd163 short queries 2020-09-02 06:29:36 +03:00
Alexander Kuzmenkov
e622e108f7 readme 2020-09-02 06:29:16 +03:00
Alexander Kuzmenkov
0db5b4a72c Remove concurrent benchmark from the perf test
It's not stable enough and has only secondary utility.
2020-09-02 02:43:23 +03:00
Alexander Kuzmenkov
f6cfb96748
Merge pull request #14346 from ClickHouse/aku/fuzzer
Don't let the fuzzer change max_execution_time
2020-09-02 01:59:50 +03:00
Anton Popov
7c3712c121
Merge pull request #13688 from it1804/master
Redis dictionary support for simple Redis requirepass authorization
2020-09-02 01:43:02 +03:00
Alexander Kuzmenkov
a6486490a2 performance comparison 2020-09-01 22:05:57 +03:00
Alexander Kuzmenkov
0b70abe542 Don't let the fuzzer change max_execution_time 2020-09-01 18:51:46 +03:00
Alexander Kuzmenkov
2f3bb5844a
Merge branch 'master' into suppress-wget-output 2020-09-01 16:59:04 +03:00
Alexander Kuzmenkov
4620ac4c0d
Update docker/test/fuzzer/run-fuzzer.sh 2020-09-01 16:57:20 +03:00
Alexander Kuzmenkov
4e58f00305
Update docker/test/fuzzer/run-fuzzer.sh 2020-09-01 16:57:13 +03:00
Alexander Kuzmenkov
73d433a7dd
Merge pull request #14316 from ClickHouse/aku/html-fuzzer
Add a HTML report for AST Fuzzer
2020-09-01 16:46:30 +03:00
Azat Khuzhin
2d7cb03120 Suppress superfluous wget (-nv) output
Since for dowloading some of files wget logging may take 50% of overall
log [1].

  [1]: https://clickhouse-builds.s3.yandex.net/14315/c32ff4c98cb3b83a12f945eadd180415b7a3b269/clickhouse_build_check/build_log_761119955_1598923036.txt
2020-09-01 10:25:13 +03:00
Yatsishin Ilya
6cb893f073 Draft. 2020-09-01 09:38:23 +03:00
Alexander Kuzmenkov
33c5815eb3 Add a HTML report for AST Fuzzer 2020-09-01 02:33:42 +03:00
robot-clickhouse
e2fa0eae2f Auto version update to [20.9.1.1] [54439] 2020-08-31 23:07:41 +03:00
Alexander Kuzmenkov
bc8765d5ad
Merge pull request #14095 from azat/DistributedFilesToInsert-fix
Fix DistributedFilesToInsert metric (zeroed when it should not)
2020-08-31 18:58:30 +03:00
Alexey Milovidov
0aec4c99d0 Cut off broken parts of "unbundled" build 2020-08-29 18:42:04 +03:00
Alexander Kuzmenkov
b601dd4596 cosmetic fixes for performance report 2020-08-29 01:46:04 +03:00
Alexander Kuzmenkov
bb28320107 cosmetic fixes in performance report 2020-08-29 01:14:48 +03:00
Azat Khuzhin
a384194216 Add a test for DistributedFilesToInsert 2020-08-27 22:00:35 +03:00
Yatsishin Ilya
2e7a4483f6 fixes after #13687 2020-08-27 20:35:51 +03:00
Yatsishin Ilya
74d52e69d3 fix 2020-08-27 19:13:32 +03:00
Yatsishin Ilya
3bf5dc578d fixes 2020-08-27 19:06:40 +03:00
Yatsishin Ilya
9e9e723061 Merge remote-tracking branch 'origin' into unbundled-packager 2020-08-27 18:54:43 +03:00
Ilya Yatsishin
7509991d82
Merge pull request #14167 from qoega/docker-test-base
Switch docker tests to use test-base
2020-08-27 16:45:55 +03:00
Yatsishin Ilya
bf6de9c28a Merge remote-tracking branch 'origin' into unbundled-packager 2020-08-27 16:00:36 +03:00
alexey-milovidov
e1cf919c93
Merge pull request #14112 from vzakaznikov/testflows_increase_compose_http_timeout_and_retry_docker_compose_up
testflows: adding retry logic when bringing up docker-compose cluster
2020-08-27 15:51:16 +03:00
Alexander Tokmakov
65a69ff6ad move docker-compose files 2020-08-27 14:46:19 +03:00
Yatsishin Ilya
bfe4e94806 Switch docker tests to use test-base 2020-08-27 13:17:17 +03:00
Yatsishin Ilya
345fd77695 Merge remote-tracking branch 'origin' into unbundled-packager 2020-08-27 13:01:14 +03:00
Yatsishin Ilya
fa1875a313 Merge remote-tracking branch 'origin' into unbundled-packager 2020-08-27 13:00:56 +03:00
Alexey Milovidov
fe5cfe3151 Increase number of threads in stress test 2020-08-26 23:39:02 +03:00
Alexey Milovidov
0bfe78636c Increase number of threads in stress test 2020-08-26 23:38:20 +03:00
alexey-milovidov
f62037e9dc
Update stress 2020-08-26 20:45:36 +03:00
Alexey Milovidov
07596b5323 Limit stress test to one hour 2020-08-26 20:44:03 +03:00
Vitaliy Zakaznikov
eb01601944 Adding retry login when bringing docker-compose cluster
Moving to using testflows version 1.6.42
2020-08-26 10:00:12 -04:00
alexey-milovidov
5d31442fa8
Delete perf.py.orig 2020-08-26 03:26:54 +03:00
Konstantin Podshumok
cbdedc39f2
REVERSE ME: workaround for docker/packager/unbundled
Please, reverse this commit after docker/packager/deb image update

Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:34:36 +03:00
Konstantin Podshumok
f4383389d5
sync unbundled/build.sh with a0ae1b2b42
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:44 +03:00
Konstantin Podshumok
cda4472ebc
dockerfiles: verify 3rd party apt repos, disable LLVM in PVS check
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:44 +03:00
Konstantin Podshumok
68a921cdea
cmake: use bundled rdkafaka for in unbundled tests for now
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:43 +03:00
Konstantin Podshumok
45e089e0c3
re-enable replxx in packager for unbundled
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:42 +03:00
Konstantin Podshumok
b3180437da
test builds: docker/packager/packager: re-enable mysql
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:42 +03:00
Konstantin Podshumok
17c46faaa7
cmake: fix parquet/arrow variables
squashed:

- sync FindArrow.cmake and FindParquet.cmake with arrow repo
- unbundled: add arrow to dbms link libraries
- cmake: fix-up unbundled Arrow support

Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:41 +03:00
Konstantin Podshumok
4e9b5bd31b
docker/packager/deb: new dependencies for unbundled
Squashed:
- docker/packager/deb: add arrow repo
- docker/packager/deb: cleanup
- docker/packager/deb: Add thrift
- docker/packager/deb: add myariadbclient
- docker/packager/deb: remove poco-dev as we always use contrib/ version now
- docker/packager/deb: add libssl-dev (unbundled) and restructure
- docker/packager/deb: fix repo url
- docker/packager/deb: fix tzdata not updated in build.sh
- docker/packager/deb: add mysqlclient-dev

Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:40 +03:00
Yatsishin Ilya
b8002dc812 mErge remote-tracking branch 'origin' into unbundled-packager 2020-08-25 14:12:01 +03:00
alexey-milovidov
7ea5364299
Merge pull request #13648 from filimonov/tzdata_version2
tzdata improvements
2020-08-24 23:07:37 +03:00
alexey-milovidov
ad64cea4aa
Merge pull request #13980 from ClickHouse/fix-stress-test-2
Attempt to fix stress test
2020-08-24 22:03:32 +03:00
Ilya Yatsishin
20bff27eef
Merge pull request #13995 from qoega/stateless-unbundled
Separate stateless unbundled image
2020-08-24 19:49:27 +03:00
Alexander Kuzmenkov
a348bc4641 performance comparison 2020-08-24 17:15:11 +03:00
Ilya Yatsishin
7a98a0fdb0
Update images.json 2020-08-24 13:27:09 +03:00
Yatsishin Ilya
f2182db765 Separate stateless unbundled image 2020-08-24 13:05:56 +03:00
Yatsishin Ilya
99b2e69c68 Merge remote-tracking branch 'origin' into unbundled-packager 2020-08-24 10:44:53 +03:00
Alexey Milovidov
d44982072c More robust 2020-08-24 03:14:24 +03:00
Alexey Milovidov
1fb4294cdf Attempt to fix stress test 2020-08-24 00:13:21 +03:00
Alexey Milovidov
f4bf99fadc Better output of stress test 2020-08-23 23:48:27 +03:00
Yatsishin Ilya
7dcdde0775 Add docker test base separately to have :latest build available 2020-08-20 20:54:51 +03:00
Alexander Kuzmenkov
5c8013b083
Merge pull request #13892 from ClickHouse/aku/timeout-perf
Avoid timeouts in perf test
2020-08-20 18:14:26 +03:00
Yatsishin Ilya
6f6f3cb05f fix 2020-08-20 17:30:35 +03:00
Yatsishin Ilya
251f9651e2 Merge remote-tracking branch 'origin' into unbundled-packager 2020-08-20 13:13:47 +03:00
Alexander Kuzmenkov
3a0bdfa5f3 Publish list of tests that failed the concurrent fast test 2020-08-20 03:13:44 +03:00
Alexander Kuzmenkov
f43457454e warn on undefined shell variables 2020-08-19 18:34:23 +03:00
Alexander Kuzmenkov
e9ad81b362 shellcheck 2020-08-19 18:31:13 +03:00
Alexander Kuzmenkov
000326b627 Avoid timeouts in perf test 2020-08-19 18:08:23 +03:00
Yatsishin Ilya
677b313b4f Merge remote-tracking branch 'origin' into unbundled-packager 2020-08-19 11:21:34 +03:00
Yatsishin Ilya
31d31359f7 update dependencies 2020-08-19 10:55:40 +03:00
tavplubix
d95470f7c3
Update docker/test/stress/run.sh 2020-08-18 20:52:54 +03:00
Yatsishin Ilya
8fd70835d5 Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-08-18 17:31:41 +03:00
Yatsishin Ilya
ab3b2c865d lost chages 2020-08-18 17:30:21 +03:00
Yatsishin Ilya
41078d67c5 Merge remote-tracking branch 'origin' into unbundled-packager 2020-08-18 17:16:49 +03:00
Yatsishin Ilya
ccbfd2e5df Update deb-builder ubuntu version. Add clang-11, gcc-10. Add unbundled docker. Add test-base image. 2020-08-18 17:16:40 +03:00
Nikita Mikhaylov
e7f8c0af52 done 2020-08-18 15:28:38 +03:00
Alexander Kuzmenkov
ce0dfe3fea Fix server restart in fasttest
Remove the server data before sequential test run, so that there is no
interference from the failed parallel run.

Also fix some shellcheck warning.
2020-08-18 13:24:37 +03:00
alexey-milovidov
3e6acf1329
Experiment with start/stop in stress test (#13779)
* Experiment with start/stop in stress test

* Support other installation options in "clickhouse start"

* Better diagnostics in install script

* Fixup

* Fixup

* Better diagnostics in stress test

* Update run.sh
2020-08-18 12:43:02 +03:00
Alexey Milovidov
47889b0f2b Install codespell 2020-08-16 14:59:16 +03:00
alexey-milovidov
3fac908dc7
Revert "Added separate docker image for unbundled build. Added clang-11, gcc-10 in packager image. Updated packager image to ubuntu 20.04" 2020-08-15 15:43:58 +03:00
Ivan A. Torgashov
1006c4f11b Update tests for Redis dictionary requirepass authorization support 2020-08-15 14:18:17 +05:00
alexey-milovidov
d0eeedd322
Merge pull request #13749 from ClickHouse/fix-fast-test
Fix fast test failure due to "Memory limit (for user) exceeded"
2020-08-15 11:26:10 +03:00
alexey-milovidov
18b0c46b30
Merge pull request #13723 from qoega/unbundled-packager
Added separate docker image for unbundled build. Added clang-11, gcc-10 in packager image. Updated packager image to ubuntu 20.04
2020-08-15 11:05:55 +03:00
alexey-milovidov
c241e42db0
Update Dockerfile 2020-08-15 11:05:38 +03:00
Alexey Milovidov
0140093b17 Fix fast test 2020-08-15 10:11:19 +03:00
Alexander Kuzmenkov
ecc40b7c75
Merge pull request #13724 from qoega/docker-style
Add docker image for style check, add check for docker files placement
2020-08-15 03:01:39 +03:00
Alexander Kuzmenkov
1cbfd1327a
trigger the CI 2020-08-15 01:40:40 +03:00
Yatsishin Ilya
ab337b243a Add docker for style check 2020-08-14 16:09:23 +03:00
Ilya Yatsishin
b74ded3dc0
Update build.sh 2020-08-14 15:34:00 +03:00
Yatsishin Ilya
22938a7152 Add separate docker container for unbundled build 2020-08-14 15:22:47 +03:00
Alexander Tokmakov
128b19fdba Merge branch 'master' into use_atomic_engine_for_system_db 2020-08-14 13:47:44 +03:00
Yatsishin Ilya
73e9f4d421 update test_materialize_mysql_database test 2020-08-13 21:20:47 +03:00
Alexander Tokmakov
a5d74c44f1 run stress tests with Atomic database 2020-08-13 20:55:12 +03:00
Ilya Yatsishin
e6420c82ca
mysql/postgresql: move Dockerfiles and docker_compose to docker/test (#13448)
* mysql/postgresql: move Dockerfiles and docker_compose to docker/test
* Build client containers in CI
* pass tag to docker_compose
2020-08-12 18:04:36 +03:00
Yatsishin Ilya
730056a9f0 fix 2020-08-12 15:22:31 +03:00
Mikhail Filimonov
a0ae1b2b42 tzdata improvements
Expose version of embedded tzdata via TZDATA_VERSION in system.build_options.
Autogenerate list of shipped timezones. Script to check tzdb updates.
2020-08-12 14:21:40 +02:00
Yatsishin Ilya
f663f794b0 Merge remote-tracking branch 'qoega/integration-explicit-configs' into integration-explicit-configs 2020-08-12 14:58:41 +03:00
Alexander Kuzmenkov
6fdfe65694 performance comparison 2020-08-12 11:55:51 +03:00
Yatsishin Ilya
160776f183 Add explicit main_configs, user_configs and dictionaries in integration tests. 2020-08-12 11:55:04 +03:00
Alexander Kuzmenkov
89b712a180 performance comparison 2020-08-12 08:40:03 +03:00
Yatsishin Ilya
fdd18e540d move reference files 2020-08-12 07:06:23 +03:00
Alexey Milovidov
33197fee5b Build ClickHouse with fresh tzdata 2020-08-11 22:03:04 +03:00
Alexander Kuzmenkov
7547b850d6 performance comparison 2020-08-11 17:14:24 +03:00
Alexander Kuzmenkov
5a97f0c19e performance comparison 2020-08-11 14:53:25 +03:00
Yatsishin Ilya
e3f7fea33a fix 2020-08-11 11:31:26 +03:00
Yatsishin Ilya
1d0e4ca670 pass tag to docker_compose 2020-08-10 16:35:08 +03:00
Yatsishin Ilya
1884cfe110 Merge remote-tracking branch 'origin/master' into docker-mysql-postgres 2020-08-10 11:12:22 +03:00
robot-clickhouse
a82c0f5371 Auto version update to [20.8.1.1] [54438] 2020-08-07 21:45:49 +03:00
alesapin
91fec04cdd
Merge pull request #13494 from ClickHouse/fix_deb_builder
New version of dpkg-deb in deb builder.
2020-08-07 20:20:45 +03:00
alesapin
48466c0960 New version of dpkg-deb 2020-08-07 19:07:52 +03:00
Yatsishin Ilya
5d8acc3b1e Build client containers in CI 2020-08-07 11:47:56 +03:00
Yatsishin Ilya
70fca95a5a mysql/postgresql: move Dockerfiles and docker_compose to docker/test 2020-08-07 11:42:04 +03:00
Alexander Kuzmenkov
11727864dd performance comparison 2020-08-07 04:25:45 +03:00
Alexander Kuzmenkov
dbb65a8bd7 performance comparison 2020-08-06 16:28:51 +03:00
Alexander Kuzmenkov
a92438eff2 performance comparison 2020-08-06 02:33:32 +03:00
Alexander Kuzmenkov
88aa371e0c performance comparison 2020-08-06 02:02:52 +03:00
Alexander Kuzmenkov
d1554e76ec Merge remote-tracking branch 'origin/master' into HEAD 2020-08-06 00:59:25 +03:00
Alexander Kuzmenkov
ff3f378e8a try to rebuild package for 2b7c0167cb 2020-08-06 00:58:56 +03:00
Alexander Kuzmenkov
9cac8a7244 performance comparison 2020-08-05 19:07:37 +03:00
Alexander Kuzmenkov
7945041a9a perf test error summary 2020-08-05 18:56:51 +03:00
alesapin
63391bbb66
Merge pull request #13382 from Enmk/fasttest-fix-query_masking_rules.xml
Keep original query_masking_rules.xml when performing fasttests
2020-08-05 17:47:33 +03:00
alesapin
a18461091f
Merge pull request #13384 from ClickHouse/fix_fast_test_server_kill
Better kill in fast test
2020-08-05 17:42:52 +03:00
alesapin
87c56f9556 Symlink for server logs 2020-08-05 16:15:06 +03:00
alesapin
c862ae93d1 Replace backticks with modern alternative 2020-08-05 16:10:47 +03:00
alesapin
68a9499e92 Simplier kill clickhouse server 2020-08-05 15:59:52 +03:00
alesapin
cdad1e718f Better kill in fast test 2020-08-05 15:37:54 +03:00
Vasily Nemkov
baed365c19 Keep original query_masking_rules.xml when performing fasttests 2020-08-05 15:14:20 +03:00
alexey-milovidov
d94e556455
Merge pull request #13321 from ClickHouse/restart_server_with_timeout
Restart server in stress test with timeout
2020-08-05 00:43:45 +03:00
alexey-milovidov
18ef0c0c96
Update run.sh, thanks @azat 2020-08-04 20:54:09 +03:00
alesapin
bd0322421b Better timeout 2020-08-04 17:28:35 +03:00
alexey-milovidov
5c51162b29
Update README.md 2020-08-04 17:26:02 +03:00
alesapin
caf0bcdc86 More timeouts 2020-08-04 11:48:47 +03:00
alesapin
ee5153bbc4 Restart server in stress test with timeout 2020-08-04 11:47:20 +03:00
alesapin
b69e6b935b
Wait with retries in fast test (#13284) 2020-08-03 21:05:35 +03:00
alexey-milovidov
935533e841
Merge pull request #13193 from ClickHouse/aku/spurious-perf
Fix some spurious perf test failures
2020-08-03 01:02:53 +03:00
Azat Khuzhin
8cbcd4027a Exclude 01413_rows_events from the fasttest (TRUNCATE query_log) 2020-08-02 13:30:00 +03:00
Azat Khuzhin
37c3f44dbe fasttest: use arrays for skip list (to make it more patch friendly)
Plus it looks better.
2020-08-02 13:29:31 +03:00
Vitaly Baranov
18b21511a9
Merge pull request #13013 from vitlibar/implement-custom-settings
Implement custom settings
2020-08-02 05:01:14 +03:00
Alexander Kuzmenkov
dd475fe82c
Update report.py 2020-08-01 13:10:36 +03:00
Alexander Kuzmenkov
a317f995be performance comparison 2020-07-31 22:58:38 +03:00
Vitaly Baranov
0fcee34322 Add test. 2020-07-31 20:57:49 +03:00
Alexander Kuzmenkov
1d954581eb Fix some spurious perf test failures 2020-07-31 19:28:04 +03:00
Alexander Kuzmenkov
6f861294f4 query fuzzer 2020-07-31 18:57:01 +03:00
Ilya Yatsishin
1566c8a92b
Merge pull request #12285 from qoega/rework-integrational
Rework integrational configuration paths
2020-07-31 15:34:21 +03:00
Alexander Kuzmenkov
e2e4fc9848 align numbers to the right in perf report 2020-07-31 13:59:15 +03:00
Alexander Kuzmenkov
42e5f8ec44
Update compare.sh 2020-07-31 03:49:36 +03:00
Alexander Kuzmenkov
db15108005 add times speedup/slowdown to changed tests table 2020-07-31 01:14:20 +03:00
Alexander Kuzmenkov
0e70e21b58
Update run-fuzzer.sh 2020-07-30 22:04:15 +03:00
Alexander Kuzmenkov
3d13da1c24 query fuzzer 2020-07-30 20:07:10 +03:00
Alexander Kuzmenkov
96125111fe
Merge pull request #13085 from ClickHouse/aku/fuzzer-error-code
Fix the AST fuzzer error message
2020-07-30 19:53:21 +03:00
Alexander Kuzmenkov
0e20507539
Update compare.sh 2020-07-30 17:26:47 +03:00
Alexander Kuzmenkov
f0fda359de pipefail 2020-07-30 16:43:22 +03:00
Alexander Kuzmenkov
b2b94ba13d
Update run-fuzzer.sh 2020-07-30 16:35:24 +03:00
Alexander Kuzmenkov
65771ad516 Fix the AST fuzzer error message 2020-07-29 20:05:38 +03:00
alesapin
5c1aa52f40 Better check for failed tests 2020-07-29 14:39:08 +03:00
alesapin
26ff008898 Remove test 2020-07-29 14:34:42 +03:00
alesapin
3a0d44b5b9 Merge branch 'master' into rerun_failed_in_fast_test 2020-07-29 12:54:18 +03:00
Yatsishin Ilya
58b6621dd3 Merge remote-tracking branch 'origin' into rework-integrational 2020-07-29 10:24:26 +03:00
Alexander Kuzmenkov
e0c207d6b4
Update entrypoint.sh 2020-07-28 16:15:41 +03:00
Yatsishin Ilya
b5722493f5 less changes 2020-07-28 16:11:29 +03:00
Yatsishin Ilya
7ca2a54e74 fix 2020-07-28 16:08:08 +03:00
Yatsishin Ilya
99ff6cae27 Merge remote-tracking branch 'origin/master' into rework-integrational 2020-07-28 14:35:51 +03:00
alesapin
d39318c8fe Grep in correct file 2020-07-28 14:23:49 +03:00
alesapin
3eb77ab076 Better kill 2020-07-28 14:22:25 +03:00
alesapin
a75657d88e Better 2020-07-28 14:18:08 +03:00
alesapin
8ff9e6c9de Rerun tests in fast test 2020-07-28 14:16:06 +03:00
alesapin
ff358be3d6
Merge pull request #12739 from ClickHouse/qoega-patch-1
Fix MySQL broken link
2020-07-27 19:51:01 +03:00
Alexander Kuzmenkov
b6f2fde37e performance comparison 2020-07-27 14:20:45 +03:00
Ilya Yatsishin
0517449e28
Update docker/test/integration/base/Dockerfile 2020-07-27 13:01:26 +03:00
alexey-milovidov
49beef860d
Merge pull request #12733 from ClickHouse/aku/perf-version
Choose proper old version for perf comparison
2020-07-24 15:24:00 +03:00
Alexander Kuzmenkov
9475b27936
Update run-fuzzer.sh 2020-07-24 00:07:23 +03:00
Ilya Yatsishin
c2e0954f26
Fix MySQL broken link 2020-07-23 22:33:55 +03:00
Alexander Kuzmenkov
acf1e5fe7e Choose proper old version for perf comparison 2020-07-23 18:17:11 +03:00
Alexander Kuzmenkov
de8328b2b0
Merge pull request #12729 from ClickHouse/aku/repo-snapshot
More branches in perf test repo snapshot
2020-07-23 18:08:47 +03:00
Alexander Kuzmenkov
15cd448afa
Update compare.sh 2020-07-23 17:59:32 +03:00
Alexander Kuzmenkov
186b2c3b1b Support different query log format in perf test 2020-07-23 16:32:03 +03:00
Alexander Kuzmenkov
8f5c4a25c9 More branches in perf test repo snapshot 2020-07-23 15:51:12 +03:00
Alexander Kuzmenkov
2b7c0167cb
Update compare.sh 2020-07-22 21:02:56 +03:00
Alexander Kuzmenkov
c25348ded9 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-22 16:19:20 +03:00
Alexander Kuzmenkov
72167aa746
Update Dockerfile 2020-07-22 16:18:57 +03:00
alesapin
26a6f7993d
Merge pull request #12637 from qoega/helper_container
Do not build helper_container image inside integrational tests. Part 1: build helper_container in CI
2020-07-22 11:50:51 +03:00
Alexander Kuzmenkov
9f49bf2d82 fixup 2020-07-22 01:09:54 +03:00
Alexander Kuzmenkov
9956285091
Update run-fuzzer.sh 2020-07-22 01:02:05 +03:00
Yatsishin Ilya
9633215684 Do not build helper_container image inside integrational tests. Part 1: build helper_container in CI 2020-07-21 17:40:48 +03:00
Alexander Kuzmenkov
b26de8d2d1 Query fuzzer 2020-07-21 16:53:50 +03:00
Alexander Kuzmenkov
3d89f0e9df Perf test: bind server to one NUMA node 2020-07-21 15:41:14 +03:00
alesapin
e7a4bc8dae Even less tests in fasttest 2020-07-20 19:55:36 +03:00
alesapin
619f5f6180 Less tests in fast test 2020-07-20 19:44:48 +03:00
Alexander Kuzmenkov
abec684daf query fuzzer 2020-07-20 14:57:16 +03:00
Alexander Kuzmenkov
37b3cef4cb
Update run-fuzzer.sh 2020-07-17 21:41:33 +03:00
Alexander Kuzmenkov
039cf36acb Minor fixes for query fuzzer 2020-07-16 21:05:34 +03:00
alesapin
a4666df090 Even less tests in fasttest 2020-07-16 14:16:08 +03:00
alesapin
f7ffd2da36 Remove memory limiting tests 2020-07-16 14:12:47 +03:00
Vitaly Baranov
000b197ad1
Merge pull request #11234 from traceon/ldap-per-user-authentication
Add LDAP authentication support
2020-07-16 13:17:21 +03:00
alesapin
f7792d0145
Merge pull request #12294 from ClickHouse/fasttest
Add image for fast tests run (with clone, build, etc.)
2020-07-16 11:21:53 +03:00
alesapin
c86b2a407f
Merge pull request #12526 from Enmk/test_config_fix
Retain existing config.d/query_masking_rules.xml from server package
2020-07-16 11:16:56 +03:00
Denis Glazachev
59cb758cf7 Merge branch 'master' into ldap-per-user-authentication 2020-07-16 02:29:24 +04:00
Vitaliy Zakaznikov
0ef9fc9022 Moving to TestFlows version 1.6.39 2020-07-15 22:13:43 +02:00
alesapin
e35c49faa2 Merge branch 'master' into fasttest 2020-07-15 22:35:46 +03:00
alesapin
d6da417e71 Disable live view tests 2020-07-15 22:34:44 +03:00
alexey-milovidov
e7cf3f4e70
Merge pull request #12464 from ianton-ru/s3_profile_events
add profiling events from S3 request to system.events and system.quer…
2020-07-15 19:33:15 +03:00
alesapin
74181a30ae One more test to skip 2020-07-15 17:56:21 +03:00
alesapin
4892706d95 Simplify build configuration 2020-07-15 17:40:51 +03:00
alesapin
54255c10e1
Merge pull request #12496 from ClickHouse/restart_server_after_stress
Check server able to restart after stress
2020-07-15 17:23:27 +03:00
Alexander Kuzmenkov
00acf4173c Fixes for perf test after #12469 2020-07-15 16:38:02 +03:00
Vasily Nemkov
78f69bbfc4 Retain existing config.d/query_masking_rules.xml that come from server package 2020-07-15 16:11:43 +03:00
alesapin
3ab7bdbbbb One more test to skip 2020-07-15 15:16:59 +03:00
alesapin
ba05bb1b39 Better tests for parallel run 2020-07-15 14:47:51 +03:00
Anton Ivashkin
4c8498c115 Merge master 2020-07-15 14:16:10 +03:00
alesapin
530ad951bc Less tests 2020-07-15 12:29:31 +03:00
alesapin
a061418dab Remove redundant cmd 2020-07-15 12:23:50 +03:00
alesapin
ecea1e0292 Run tests in parallel 2020-07-15 11:49:50 +03:00
alesapin
00d2219808 Merge branch 'master' into fasttest 2020-07-15 11:35:15 +03:00
alesapin
43ba417132 Better submodules update 2020-07-15 11:34:38 +03:00
Alexander Kuzmenkov
cdca798d2a
Update build.sh 2020-07-15 00:56:35 +03:00
alesapin
a31109f023 Better submdoules 2020-07-14 21:44:57 +03:00
Alexander Kuzmenkov
6498fe8123 Publish repo snapshot in perf test package 2020-07-14 18:12:53 +03:00
alesapin
c483de8a35 Check result in separate file 2020-07-14 18:00:24 +03:00
alesapin
c400048a48 Check server able to restart in stateless tests 2020-07-14 17:47:23 +03:00
Alexander Kuzmenkov
57ad000c62
Update README.md 2020-07-14 16:46:19 +03:00
Anton Ivashkin
52fea6a5a3 Merge master 2020-07-14 15:56:38 +03:00
alesapin
0740b88d6b Merge branch 'master' into fasttest 2020-07-14 15:19:05 +03:00
alesapin
86a6a5e2c6 Less tests to run 2020-07-14 15:17:35 +03:00
robot-clickhouse
0f23642a3d Auto version update to [20.7.1.1] [54437] 2020-07-13 18:26:03 +03:00
Alexander Kuzmenkov
d9ac91b34d query fuzzer 2020-07-13 18:16:54 +03:00
Alexander Kuzmenkov
028abb9dc4 query fuzzer 2020-07-13 16:58:48 +03:00
Alexander Kuzmenkov
5a15e03400 Improve data layout in perf test
Also fix a bad test query found with new data.
2020-07-13 14:31:15 +03:00
Alexander Kuzmenkov
c13425f0e9 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-13 14:29:10 +03:00
Anton Ivashkin
26fca949bd add profiling events from S3 request to system.events and system.query_log 2020-07-13 11:27:11 +03:00
alexey-milovidov
26d32f2ce5
Merge pull request #12412 from Jokser/s3-https
S3 HTTPS integration tests
2020-07-12 03:36:37 +03:00
Pavel Kovalenko
5a42dca252 Trigger integration-test-runner image rebuild. 2020-07-11 12:16:10 +03:00
Pavel Kovalenko
d4826a3df7 Replace build with proper images in docker_compose_minio.yml 2020-07-10 23:38:48 +03:00
Pavel Kovalenko
f43428a4d5 S3 HTTPS integration test. 2020-07-10 22:42:18 +03:00
alesapin
d69f925c30 Fix build 2020-07-10 22:28:21 +03:00
alesapin
d2fcbe1f4e Fix build 2020-07-10 22:27:12 +03:00
alesapin
69d6ad0a62 Disable bunch of tests 2020-07-10 22:12:25 +03:00
alesapin
a9824fd650 Better cmake and less libraries 2020-07-10 22:08:18 +03:00
alesapin
df176c633e Disable msgpack 2020-07-10 21:27:10 +03:00
alesapin
b70c3b607f No long tests 2020-07-10 20:44:29 +03:00
alesapin
0b1a1867a6 Less dependencies 2020-07-10 20:21:24 +03:00
alesapin
57d03bfbc0 Disable secure ports 2020-07-10 18:47:20 +03:00
Alexander Kuzmenkov
cd09cf8c0b Merge remote-tracking branch 'origin/master' into HEAD 2020-07-10 17:18:24 +03:00
Alexander Kuzmenkov
eb6fbdfd4b query fuzzer 2020-07-10 17:16:16 +03:00
alesapin
ce96262a2c
Update run.sh 2020-07-10 16:21:58 +03:00
Alexander Kuzmenkov
0fe4c37033 query fuzzer 2020-07-10 14:11:49 +03:00
alesapin
4ab5edadb7 Less libraries 2020-07-10 12:47:50 +03:00
Alexander Kuzmenkov
7af916e44a fuzzer docker image 2020-07-09 21:30:22 +03:00
Alexander Kuzmenkov
bbcdf12e4f fuzzer container fix 2020-07-09 20:19:36 +03:00
alesapin
51aaa8800d Don't skip libs 2020-07-09 18:34:19 +03:00
Alexander Kuzmenkov
e06b675801 fixes in fuzzer docker image 2020-07-09 14:55:54 +03:00
Alexander Kuzmenkov
761b03f17d add docker image for fuzzer 2020-07-09 14:21:55 +03:00
Alexander Kuzmenkov
394cf20673 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-09 13:46:54 +03:00
alesapin
960a730c7a Merge branch 'master' into fasttest 2020-07-09 13:14:09 +03:00
alexey-milovidov
1536e89abe
Merge pull request #12287 from ClickHouse/fix_skip_list_option_old_branches
Fix skip lists for old branches
2020-07-09 04:25:35 +03:00
alesapin
e0ff6bd6d7 Less libraries to build 2020-07-08 19:59:47 +03:00
alesapin
6378c79539 Fix script 2020-07-08 19:02:19 +03:00
alesapin
f30e2ea464 Tmp version 2020-07-08 18:25:02 +03:00
alesapin
80d9816e00 Add brotli 2020-07-08 17:22:17 +03:00
alesapin
6e79e88149 Add curl 2020-07-08 16:49:09 +03:00
alesapin
069880a003 Prototype 2020-07-08 16:06:35 +03:00
alesapin
c0dea3ab1c Ignore testflows exit code 2020-07-08 15:52:54 +03:00
Alexander Kuzmenkov
cec35a0e1d
Update README.md 2020-07-08 15:07:01 +03:00
Alexander Kuzmenkov
c9162f6e77
Update README.md 2020-07-08 15:05:49 +03:00
Alexander Kuzmenkov
344e2713fa
Update README.md 2020-07-08 14:52:06 +03:00
Alexander Kuzmenkov
bd14d06476
Update README.md 2020-07-08 14:25:43 +03:00
Alexander Kuzmenkov
41addf9173 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-08 13:22:06 +03:00
Alexander Kuzmenkov
76ef8feb04
Update packager 2020-07-08 12:52:03 +03:00
alesapin
dc8051f737 Fixes 2020-07-08 12:47:14 +03:00
Alexander Kuzmenkov
08762dc825
Update build.sh 2020-07-08 12:46:44 +03:00
alesapin
9ea3bdd054 Fix skip lists for old branches 2020-07-08 11:41:39 +03:00
Yatsishin Ilya
79e4c6ff83 Merge remote-tracking branch 'origin' into rework-integrational 2020-07-08 10:36:38 +03:00
alesapin
f54351635a
Merge pull request #12090 from vzakaznikov/adding-tests-in-testflows
Adding a simple example of using TestFlows.
2020-07-07 22:58:11 +03:00
Alexander Kuzmenkov
f514d0da77
Revert "Run perf tests with memory sampling (for allocations >1M)" 2020-07-07 19:59:42 +03:00
alesapin
a7348ed2c8 Add to images.json 2020-07-07 18:48:47 +03:00
alesapin
042a3aa8d1
Merge pull request #12168 from qoega/compose-inside-docker
Place common docker compose files to integration docker container
2020-07-07 18:43:27 +03:00
alesapin
e89ccfd5bf No color 2020-07-07 16:11:19 +03:00
alesapin
f5a7d8a5c7 Add runner for testflows 2020-07-07 15:35:06 +03:00
Alexander Kuzmenkov
a3826e5443
Merge pull request #12142 from azat/perf-memory-sampling
Run perf tests with memory sampling (for allocations >1M)
2020-07-07 01:35:33 +03:00
alexey-milovidov
e60b8885e8
Merge pull request #12124 from ClickHouse/docker-apt-get-upgrade-1
[experiment] apt-get upgrade in docker/server/Dockerfile
2020-07-06 23:28:04 +03:00
alesapin
7ce3464810 Remove -v from ninja 2020-07-06 18:13:08 +03:00
Yatsishin Ilya
0c7a261bc6 Place common docker compose files to integration docker container 2020-07-06 16:45:54 +03:00
Yatsishin Ilya
d23f0008ee Merge branch 'master', remote-tracking branch 'origin' into rework-integrational 2020-07-06 14:51:15 +03:00
Ivan Blinkov
9b26afc885
Update Dockerfile 2020-07-06 13:44:47 +03:00
Alexander Kuzmenkov
432cadae15 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-06 11:44:09 +03:00
Ivan Blinkov
96eb38121e
Update Dockerfile 2020-07-06 11:20:56 +03:00
alexey-milovidov
1719ab1ec5
Merge pull request #12041 from azat/curl-proper-cmake
Rewrite curl dependency in a more ch compatible way
2020-07-06 06:31:51 +03:00
Azat Khuzhin
307c3c92a5 Run perf tests with memory sampling (for allocations >1M)
This is to know the memory allocation size distribution, that can be
obtained later from left-metric-log.tsv.

This is an attempt to tune tcmalloc (new CPP version by google) to use
lock-free part of the allocator for typical allocations (and it is a bad
idea just to increase kMaxSize there, since number of allocation for
each size class is also important).

P.S. hope that this file will be applied, if no, then the same effect
can be reached by tunning defaults in Settings.h

Refs: #11590
Cc: @akuzm
2020-07-05 12:43:12 +03:00
Azat Khuzhin
f91e34b2e8 Include libcurl4-openssl-dev into yandex/clickhouse-deb-builder 2020-07-05 00:56:48 +03:00
alexey-milovidov
5382b6ce2e
Merge pull request #12126 from ClickHouse/minimal-docker-image
Added a showcase of minimal Docker image
2020-07-04 17:48:02 +03:00
alesapin
a2b6d58053
Merge pull request #11069 from kssenii/add-storage-rabbitmq-read-only
Add storage RabbitMQ
2020-07-04 10:38:50 +03:00
Alexey Milovidov
e922fb9f67 Added a comment 2020-07-04 02:01:33 +03:00
Alexey Milovidov
a41e5740a9 Added a comment 2020-07-04 01:52:19 +03:00
Alexey Milovidov
5d68bc57b9 Added a comment 2020-07-04 01:52:15 +03:00
Alexey Milovidov
08dfc140a3 Added a showcase of minimal Docker image 2020-07-04 01:45:17 +03:00
Ivan Blinkov
99443057b6
Update Dockerfile 2020-07-04 00:55:00 +03:00
Yatsishin Ilya
3790c8ccd9 wip 2020-07-03 18:43:48 +03:00
alesapin
5098df8d0b Make skip-list optional 2020-07-03 14:15:30 +03:00
Alexander Kuzmenkov
10b6f98ca6 fixup 2020-07-03 11:39:43 +03:00
Alexander Kuzmenkov
7d8a31aff3 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-03 10:09:20 +03:00
Azat Khuzhin
0700a705bc Rewrite curl dependency in a more ch compatible way
- add support of unbundled curl
- add CURL::libcurl libraries
- avoid explicit linkage of daemon with curl (added with sentry)
- set CACHE variables for non-direct users:
  - mariadb-connector-c
  - aws-s3-cmake
  - sentry-native

Cc: @alexey-milovidov
Cc: @alesapin (requires docker image update)
Cc: @abyss7

Refs: #11300
Refs: #8011
Refs: #8905

v2: replace cmake/find/curl.cmake with proper contrib/curl-cmake (as
pointed by @abyss7, cmake/find/*.cmake is deprecated)
2020-07-03 00:57:08 +03:00
Ivan Blinkov
b81c66a031
[docker] install ca-certificates before the first apt-get update (#12095)
* [docker] install ca-certificates before first apt-get update

* Update Dockerfile
2020-07-02 22:16:21 +03:00
Alexander Kuzmenkov
9e02a0d879
Merge pull request #11991 from ClickHouse/aku/perf-partial
perf test: report queries with new functions separately
2020-07-02 17:12:46 +03:00
alesapin
923c7e7c2d
Remove pvs studio from images list 2020-07-02 16:19:25 +03:00
alesapin
64583ceb22 Merge branch 'master' into add-storage-rabbitmq-read-only 2020-07-02 16:08:29 +03:00
alesapin
1fb90f3811
Merge pull request #12052 from ClickHouse/test_image_changes
Test image changes
2020-07-02 15:01:06 +03:00
Ivan Blinkov
b9b7abe816
revert e9d3c48f56 2020-07-02 12:31:18 +03:00
Ivan Blinkov
e9d3c48f56
Update Dockerfile 2020-07-02 12:28:23 +03:00
alesapin
4c3ae82273 Better PVS image 2020-07-02 12:02:15 +03:00
Alexander Kuzmenkov
f50f8d936e Merge remote-tracking branch 'origin/master' into HEAD 2020-07-02 10:19:26 +03:00
Alexander Kuzmenkov
41088c3416 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-02 10:13:11 +03:00
Alexander Kuzmenkov
99514a7e24 fixup 2020-07-02 10:13:02 +03:00
alesapin
f0b012c94b Remove garbage from images 2020-07-01 23:07:11 +03:00
alesapin
29178a1df4 Don't download image twice 2020-07-01 21:51:11 +03:00
alesapin
faaf3536ea Update deb image 2020-07-01 18:00:07 +03:00
Alexander Kuzmenkov
baec4093dd
Merge pull request #11993 from ClickHouse/aku/more-jemalloc-tweaks
jemalloc: set muzzy_decay_ms = 10s
2020-06-30 22:51:21 +03:00
alesapin
29c528235e Add ability to run any image version from packager and runner 2020-06-30 16:08:12 +03:00
alesapin
4262fec1bb Add pvs studio to images 2020-06-30 13:52:02 +03:00
alesapin
41142c5e95 Test image changes 2020-06-30 13:34:20 +03:00
Alexander Kuzmenkov
7e2f6937e0 fixup 2020-06-30 12:45:19 +03:00
Alexander Kuzmenkov
b5f9e9de78 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-30 12:28:14 +03:00
Alexander Kuzmenkov
a4152cfb00 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-30 08:55:56 +03:00
Alexander Kuzmenkov
588ff8fcc1
Merge pull request #11989 from ClickHouse/aku/long-perf
Try to enable long perf tests
2020-06-30 08:52:29 +03:00
Alexander Kuzmenkov
6d67c77e68 fixup 2020-06-29 17:09:51 +03:00
alesapin
db79278981 Fake change in dockerfile 2020-06-29 16:13:20 +03:00
alesapin
58c12a8428 Better docker images list 2020-06-29 13:52:25 +03:00
Alexander Kuzmenkov
1b49feae6b Fixup 2020-06-29 11:29:40 +03:00
alesapin
fb891ee4eb
Revert "[experiment] maybe fix warnings in integration tests" 2020-06-28 16:20:57 +03:00
Alexander Kuzmenkov
960c455e0e performance comparison 2020-06-27 04:15:58 +03:00
Alexander Kuzmenkov
8b82ff215f muzzy decay 10 ms 2020-06-27 04:08:21 +03:00
Alexander Kuzmenkov
7e88cc15f1 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-27 04:00:26 +03:00
Alexander Kuzmenkov
459ebf1ea0 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-27 03:59:36 +03:00
Alexander Kuzmenkov
e0c4cc9135 performance comparison 2020-06-27 03:53:54 +03:00
Alexander Kuzmenkov
be57bc56d7 perf test: report queries with new functions separately 2020-06-27 03:45:00 +03:00
Alexander Kuzmenkov
c8b633fe47 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-26 21:01:40 +03:00
alesapin
ca5278b40f
Merge pull request #11903 from ClickHouse/blinkov-patch-20
[experiment] maybe fix warnings in integration tests
2020-06-26 15:43:54 +03:00
Alexander Kuzmenkov
41659e38ce Update path to perf test package 2020-06-26 03:46:44 +03:00
Alexander Kuzmenkov
beb386674d Update path to performance tests build 2020-06-26 00:58:38 +03:00
Alexander Kuzmenkov
e521d616fe performance comparison 2020-06-25 23:42:29 +03:00
Alexander Kuzmenkov
01344d7b87 More verbose CMake in build docker 2020-06-25 22:16:48 +03:00
Alexander Kuzmenkov
593a0181bd
Merge pull request #11616 from ClickHouse/aku/perf-benchmark
Add concurrent benchmark to performance test
2020-06-25 09:36:52 +03:00
Alexander Kuzmenkov
58747df00c
Update docker/test/performance-comparison/perf.py 2020-06-25 09:35:21 +03:00
Alexander Kuzmenkov
4a8349cad9 Less layers in docker file 2020-06-25 09:26:10 +03:00
Alexander Kuzmenkov
63a8a8453a Less layers in docker file 2020-06-25 09:23:25 +03:00
Alexander Kuzmenkov
865ebcda16 variadic return value was too new python 2020-06-25 01:21:02 +03:00
alesapin
3fc65b3269 Merge branch 'master' into kssenii-rabbit-mq 2020-06-24 20:14:28 +03:00
alesapin
e7ff0cb8e4 Update pvs-studio version 2020-06-24 20:02:25 +03:00
Ivan Blinkov
d154ba227c
Update Dockerfile 2020-06-24 19:33:17 +03:00
Alexander Kuzmenkov
ce36da838c for the love of God just update this container already, i'm begging you 2020-06-24 19:12:05 +03:00
Alexander Kuzmenkov
3255a37b9f Do not update PVS Studio docker automatically.
They keep removing the old image every couple of weeks, and the entire
docker update fails.
2020-06-24 18:55:49 +03:00
Alexander Kuzmenkov
751319d0ef show build commands 2020-06-24 16:16:54 +03:00
Ivan Blinkov
aac17eb48d
[experiment] maybe fix warnings in integration tests 2020-06-24 11:38:00 +03:00
Alexander Kuzmenkov
e0bdbe73d2 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-23 15:31:09 +03:00
Alexander Kuzmenkov
ab809f59b9 memory usage settings 2020-06-23 15:30:45 +03:00
Alexander Kuzmenkov
bfba15d512 Explicitly mark short perftest queries 2020-06-23 15:09:54 +03:00
alexey-milovidov
3e71b6ae07
Merge pull request #11845 from ClickHouse/loose-odbc-connection-string-validation
Slightly relax the validation of ODBC connection string
2020-06-22 21:19:30 +03:00
robot-clickhouse
4bd47b8adc Auto version update to [20.6.1.1] [54436] 2020-06-22 20:40:26 +03:00
alesapin
afcf63ad89 Add alias for postgesql container 2020-06-22 16:29:35 +03:00
Alexander Kuzmenkov
eac6eb8c5a report 2020-06-22 15:22:09 +03:00
Alexey Milovidov
25f55bb5dd Remove duplicate entry 2020-06-20 15:39:02 +03:00
Alexey Milovidov
bba0cf6064 Remove dependency on tzdata 2020-06-20 15:31:18 +03:00
Alexander Kuzmenkov
fbecf42dfc report the number of errors 2020-06-20 01:41:15 +03:00
Alexander Kuzmenkov
cec65ce30d Merge remote-tracking branch 'origin/master' into HEAD 2020-06-19 22:34:50 +03:00
Alexander Kuzmenkov
1a3a19391c
Merge pull request #11711 from ClickHouse/fix_path_in_perftest
Try fix performance test of Values format
2020-06-19 15:57:32 +03:00
Alexander Tokmakov
73af3befe6 Revert "specify path in config" 2020-06-19 01:45:45 +03:00
Alexander Tokmakov
53b9f15f53 fix 2020-06-18 13:20:01 +03:00
Alexander Kuzmenkov
2bc6de4b4e performance comparison 2020-06-18 06:14:18 +03:00
Alexander Tokmakov
660ed26389 Merge branch 'master' into fix_path_in_perftest 2020-06-18 00:22:36 +03:00
Alexander Tokmakov
50b4671867 specify path in config 2020-06-16 21:29:55 +03:00
Alexander Kuzmenkov
29bf9aa128 update pvs studio 2020-06-16 19:22:06 +03:00
Alexander Tokmakov
1e50bae76e override user_files_path 2020-06-16 18:13:28 +03:00
Alexander Kuzmenkov
8509079021 performance comparison 2020-06-16 14:06:11 +03:00
Alexander Kuzmenkov
cd769e5ebf fixup 2020-06-16 11:21:15 +03:00
Alexander Kuzmenkov
4dc6254357 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-15 17:26:15 +03:00
Alexander Kuzmenkov
56869228a2 add flag to continue on errors 2020-06-12 21:28:07 +03:00
Alexander Kuzmenkov
5101708831 fixup 2020-06-12 18:11:33 +03:00
Alexander Kuzmenkov
0da6e1c9de typo 2020-06-12 15:12:12 +03:00
Alexander Kuzmenkov
10a8021418 performance comparison 2020-06-12 00:58:45 +03:00
Alexander Kuzmenkov
7ba5063b7a Add concurrent benchmark to performance test
After the main test, run queries from `website.xml` in parallel using
`clickhouse-benchmark`. This can be useful to test the effects of
concurrency on performance. Comparison test can miss some effects
because it always runs queries sequentially, and many of them are even
single-threaded.
2020-06-12 00:24:56 +03:00
alesapin
29311f71bf
Merge pull request #11585 from azat/unbundled-boost
Add unbundled boost support
2020-06-11 23:43:28 +03:00
Alexander Kuzmenkov
d840a9990c performance comparison 2020-06-11 23:39:26 +03:00
giordyb
d61da39c10
Update entrypoint.sh
without -q option the database does not get created at startup
2020-06-11 17:23:02 +02:00
alesapin
225380f849
Merge pull request #11586 from blinkov/repo-links
Update remaining links to old repo without CDN
2020-06-11 16:40:53 +03:00
Alexander Kuzmenkov
e354bbc78c
Merge pull request #11588 from ClickHouse/aku/async-log
Add system.asynchronous_metric_log
2020-06-11 16:10:35 +03:00
alesapin
36ea4abb48 Add several boost libraries to deb image 2020-06-11 15:54:29 +03:00
Azat Khuzhin
0731f2293d Add missing boost libraries into docker image 2020-06-11 11:47:30 +03:00
kssenii
18820814f5 Merge 2020-06-10 23:25:33 +00:00
Alexander Kuzmenkov
1bd375c25e performance comparison 2020-06-11 00:38:26 +03:00
Ivan Blinkov
e5cd2716da
Update Dockerfile 2020-06-10 22:27:05 +03:00
Alexander Kuzmenkov
7b54ff02f0 Collect async metric log in perf test 2020-06-10 22:27:05 +03:00
Ivan Blinkov
f6b5cd7de2
Update Dockerfile 2020-06-10 22:26:44 +03:00
Ivan Blinkov
a07b296ee4
Update Dockerfile 2020-06-10 22:26:25 +03:00
Ivan Blinkov
3d9424fd5a perl -pi -e 's/repo\.yandex\.ru\/clickhouse/repo.clickhouse.tech/g' {} 2020-06-10 21:54:55 +03:00
Azat Khuzhin
1f3c640da2 Use unbundled boost for unbundled builds 2020-06-10 20:56:47 +03:00
Alexander Kuzmenkov
04b0089776
Merge pull request #11515 from ClickHouse/aku/more-stable-perf-tests
More stable perf tests
2020-06-10 13:25:52 +03:00
tavplubix
a93ae46ac1
Merge pull request #11079 from ClickHouse/merging_external_source_cassandra
Merging #4978
2020-06-10 10:39:18 +03:00
Alexander Kuzmenkov
af1c8f8a5f fixup 2020-06-10 02:57:31 +03:00
Alexander Kuzmenkov
f6136ec279 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-10 02:37:52 +03:00
alexey-milovidov
13b225799e
Merge pull request #11550 from realadvisor/master
Fix ClickHouse init process failed in docker if any script is added into docker-entrypoint-initdb.d
2020-06-10 01:48:58 +03:00
Alexander Tokmakov
6bb68329f8 Merge branch 'master' into merging_external_source_cassandra 2020-06-09 19:51:14 +03:00
Nikolai Kochetov
e0de3aa7c9
Revert "Addition to #11184" 2020-06-09 19:39:26 +03:00
Ivan Starkov
bdcf1170ce
Instead of forcing IPv4 protocol force wget to use protocols in order 2020-06-09 16:32:49 +03:00
Alexander Kuzmenkov
5719549ee1 fixup 2020-06-09 16:29:07 +03:00
Alexander Kuzmenkov
6071b9b9d9 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-09 15:06:32 +03:00
Ivan
47ad338cb2
Refactor CMake build files (#11390)
* Get rid of lib_name.cmake
* Refactor Boost and HyperScan libraries
* Refactor lz4
* Fix build with xxHash
2020-06-09 13:54:49 +03:00
Ivan Starkov
32772073ea
Fix docker-entrypoint-initdb.d wait
Fixes 'Address family not supported by protocol' for any docker-entrypoint-initdb.d script.

wget uses 'localhost' which resolves for both ipv4 and ipv6 with current config (/etc/hosts) and so the wget fails _(Address family not supported by protocol)_ and does not retry.

Forcing it to use IPv4 fixes the issue
2020-06-09 13:52:21 +03:00
Alexander Kuzmenkov
6a3df071a2 fixup 2020-06-09 01:13:08 +03:00
Alexander Kuzmenkov
e2e5e1d5f8 More stable perf tests 2020-06-08 16:57:33 +03:00
Ivan
1e1b30dc05
Add libhyperscan-dev to deb Dockerfile 2020-06-07 10:19:56 +03:00
alesapin
d8de91ea4d Don't build redundant garbage in binary builds 2020-06-06 17:00:47 +03:00
Alexander Kuzmenkov
b14cc1dc56
Merge pull request #11449 from ClickHouse/check-for-incorrect-settings
Added a check for incorrect settings
2020-06-06 00:15:27 +03:00
Alexander Kuzmenkov
d17a435fb6
Merge pull request #11226 from ClickHouse/aku/merge-perf-events
Merge Perf events metrics #9545
2020-06-05 23:10:54 +03:00
alesapin
e22a711d2b
Merge pull request #11450 from ClickHouse/trying_to_increase_ccache
Trying to increase ccache size
2020-06-05 19:21:00 +03:00
Alexander Kuzmenkov
29adb1cbcf performance comparison 2020-06-05 17:30:26 +03:00
Alexander Kuzmenkov
14c55b940e
peftest settings: use_uncompressed_cache goes to profile 2020-06-05 16:32:21 +03:00
Alexander Kuzmenkov
5523444d91 cleanup 2020-06-05 15:53:47 +03:00
alesapin
5038733abf
bump2 2020-06-05 14:20:54 +03:00
alesapin
3d48c10bc6
bump CI 2020-06-05 12:22:23 +03:00