Commit Graph

924 Commits

Author SHA1 Message Date
alesapin
57d03bfbc0 Disable secure ports 2020-07-10 18:47:20 +03:00
Alexander Kuzmenkov
cd09cf8c0b Merge remote-tracking branch 'origin/master' into HEAD 2020-07-10 17:18:24 +03:00
Alexander Kuzmenkov
eb6fbdfd4b query fuzzer 2020-07-10 17:16:16 +03:00
alesapin
ce96262a2c
Update run.sh 2020-07-10 16:21:58 +03:00
Alexander Kuzmenkov
0fe4c37033 query fuzzer 2020-07-10 14:11:49 +03:00
alesapin
4ab5edadb7 Less libraries 2020-07-10 12:47:50 +03:00
Alexander Kuzmenkov
7af916e44a fuzzer docker image 2020-07-09 21:30:22 +03:00
Alexander Kuzmenkov
bbcdf12e4f fuzzer container fix 2020-07-09 20:19:36 +03:00
alesapin
51aaa8800d Don't skip libs 2020-07-09 18:34:19 +03:00
Alexander Kuzmenkov
e06b675801 fixes in fuzzer docker image 2020-07-09 14:55:54 +03:00
Alexander Kuzmenkov
761b03f17d add docker image for fuzzer 2020-07-09 14:21:55 +03:00
Alexander Kuzmenkov
394cf20673 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-09 13:46:54 +03:00
alesapin
960a730c7a Merge branch 'master' into fasttest 2020-07-09 13:14:09 +03:00
alexey-milovidov
1536e89abe
Merge pull request #12287 from ClickHouse/fix_skip_list_option_old_branches
Fix skip lists for old branches
2020-07-09 04:25:35 +03:00
alesapin
e0ff6bd6d7 Less libraries to build 2020-07-08 19:59:47 +03:00
alesapin
6378c79539 Fix script 2020-07-08 19:02:19 +03:00
alesapin
f30e2ea464 Tmp version 2020-07-08 18:25:02 +03:00
alesapin
80d9816e00 Add brotli 2020-07-08 17:22:17 +03:00
alesapin
6e79e88149 Add curl 2020-07-08 16:49:09 +03:00
alesapin
069880a003 Prototype 2020-07-08 16:06:35 +03:00
alesapin
c0dea3ab1c Ignore testflows exit code 2020-07-08 15:52:54 +03:00
Alexander Kuzmenkov
cec35a0e1d
Update README.md 2020-07-08 15:07:01 +03:00
Alexander Kuzmenkov
c9162f6e77
Update README.md 2020-07-08 15:05:49 +03:00
Alexander Kuzmenkov
344e2713fa
Update README.md 2020-07-08 14:52:06 +03:00
Alexander Kuzmenkov
bd14d06476
Update README.md 2020-07-08 14:25:43 +03:00
Alexander Kuzmenkov
41addf9173 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-08 13:22:06 +03:00
Alexander Kuzmenkov
76ef8feb04
Update packager 2020-07-08 12:52:03 +03:00
alesapin
dc8051f737 Fixes 2020-07-08 12:47:14 +03:00
Alexander Kuzmenkov
08762dc825
Update build.sh 2020-07-08 12:46:44 +03:00
alesapin
9ea3bdd054 Fix skip lists for old branches 2020-07-08 11:41:39 +03:00
Yatsishin Ilya
79e4c6ff83 Merge remote-tracking branch 'origin' into rework-integrational 2020-07-08 10:36:38 +03:00
alesapin
f54351635a
Merge pull request #12090 from vzakaznikov/adding-tests-in-testflows
Adding a simple example of using TestFlows.
2020-07-07 22:58:11 +03:00
Alexander Kuzmenkov
f514d0da77
Revert "Run perf tests with memory sampling (for allocations >1M)" 2020-07-07 19:59:42 +03:00
alesapin
a7348ed2c8 Add to images.json 2020-07-07 18:48:47 +03:00
alesapin
042a3aa8d1
Merge pull request #12168 from qoega/compose-inside-docker
Place common docker compose files to integration docker container
2020-07-07 18:43:27 +03:00
alesapin
e89ccfd5bf No color 2020-07-07 16:11:19 +03:00
alesapin
f5a7d8a5c7 Add runner for testflows 2020-07-07 15:35:06 +03:00
Alexander Kuzmenkov
a3826e5443
Merge pull request #12142 from azat/perf-memory-sampling
Run perf tests with memory sampling (for allocations >1M)
2020-07-07 01:35:33 +03:00
alexey-milovidov
e60b8885e8
Merge pull request #12124 from ClickHouse/docker-apt-get-upgrade-1
[experiment] apt-get upgrade in docker/server/Dockerfile
2020-07-06 23:28:04 +03:00
alesapin
7ce3464810 Remove -v from ninja 2020-07-06 18:13:08 +03:00
Yatsishin Ilya
0c7a261bc6 Place common docker compose files to integration docker container 2020-07-06 16:45:54 +03:00
Yatsishin Ilya
d23f0008ee Merge branch 'master', remote-tracking branch 'origin' into rework-integrational 2020-07-06 14:51:15 +03:00
Ivan Blinkov
9b26afc885
Update Dockerfile 2020-07-06 13:44:47 +03:00
Alexander Kuzmenkov
432cadae15 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-06 11:44:09 +03:00
Ivan Blinkov
96eb38121e
Update Dockerfile 2020-07-06 11:20:56 +03:00
alexey-milovidov
1719ab1ec5
Merge pull request #12041 from azat/curl-proper-cmake
Rewrite curl dependency in a more ch compatible way
2020-07-06 06:31:51 +03:00
Azat Khuzhin
307c3c92a5 Run perf tests with memory sampling (for allocations >1M)
This is to know the memory allocation size distribution, that can be
obtained later from left-metric-log.tsv.

This is an attempt to tune tcmalloc (new CPP version by google) to use
lock-free part of the allocator for typical allocations (and it is a bad
idea just to increase kMaxSize there, since number of allocation for
each size class is also important).

P.S. hope that this file will be applied, if no, then the same effect
can be reached by tunning defaults in Settings.h

Refs: #11590
Cc: @akuzm
2020-07-05 12:43:12 +03:00
Azat Khuzhin
f91e34b2e8 Include libcurl4-openssl-dev into yandex/clickhouse-deb-builder 2020-07-05 00:56:48 +03:00
alexey-milovidov
5382b6ce2e
Merge pull request #12126 from ClickHouse/minimal-docker-image
Added a showcase of minimal Docker image
2020-07-04 17:48:02 +03:00
alesapin
a2b6d58053
Merge pull request #11069 from kssenii/add-storage-rabbitmq-read-only
Add storage RabbitMQ
2020-07-04 10:38:50 +03:00
Alexey Milovidov
e922fb9f67 Added a comment 2020-07-04 02:01:33 +03:00
Alexey Milovidov
a41e5740a9 Added a comment 2020-07-04 01:52:19 +03:00
Alexey Milovidov
5d68bc57b9 Added a comment 2020-07-04 01:52:15 +03:00
Alexey Milovidov
08dfc140a3 Added a showcase of minimal Docker image 2020-07-04 01:45:17 +03:00
Ivan Blinkov
99443057b6
Update Dockerfile 2020-07-04 00:55:00 +03:00
Yatsishin Ilya
3790c8ccd9 wip 2020-07-03 18:43:48 +03:00
alesapin
5098df8d0b Make skip-list optional 2020-07-03 14:15:30 +03:00
Alexander Kuzmenkov
10b6f98ca6 fixup 2020-07-03 11:39:43 +03:00
Alexander Kuzmenkov
7d8a31aff3 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-03 10:09:20 +03:00
Azat Khuzhin
0700a705bc Rewrite curl dependency in a more ch compatible way
- add support of unbundled curl
- add CURL::libcurl libraries
- avoid explicit linkage of daemon with curl (added with sentry)
- set CACHE variables for non-direct users:
  - mariadb-connector-c
  - aws-s3-cmake
  - sentry-native

Cc: @alexey-milovidov
Cc: @alesapin (requires docker image update)
Cc: @abyss7

Refs: #11300
Refs: #8011
Refs: #8905

v2: replace cmake/find/curl.cmake with proper contrib/curl-cmake (as
pointed by @abyss7, cmake/find/*.cmake is deprecated)
2020-07-03 00:57:08 +03:00
Ivan Blinkov
b81c66a031
[docker] install ca-certificates before the first apt-get update (#12095)
* [docker] install ca-certificates before first apt-get update

* Update Dockerfile
2020-07-02 22:16:21 +03:00
Alexander Kuzmenkov
9e02a0d879
Merge pull request #11991 from ClickHouse/aku/perf-partial
perf test: report queries with new functions separately
2020-07-02 17:12:46 +03:00
alesapin
923c7e7c2d
Remove pvs studio from images list 2020-07-02 16:19:25 +03:00
alesapin
64583ceb22 Merge branch 'master' into add-storage-rabbitmq-read-only 2020-07-02 16:08:29 +03:00
alesapin
1fb90f3811
Merge pull request #12052 from ClickHouse/test_image_changes
Test image changes
2020-07-02 15:01:06 +03:00
Ivan Blinkov
b9b7abe816
revert e9d3c48f56 2020-07-02 12:31:18 +03:00
Ivan Blinkov
e9d3c48f56
Update Dockerfile 2020-07-02 12:28:23 +03:00
alesapin
4c3ae82273 Better PVS image 2020-07-02 12:02:15 +03:00
Alexander Kuzmenkov
f50f8d936e Merge remote-tracking branch 'origin/master' into HEAD 2020-07-02 10:19:26 +03:00
Alexander Kuzmenkov
41088c3416 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-02 10:13:11 +03:00
Alexander Kuzmenkov
99514a7e24 fixup 2020-07-02 10:13:02 +03:00
alesapin
f0b012c94b Remove garbage from images 2020-07-01 23:07:11 +03:00
alesapin
29178a1df4 Don't download image twice 2020-07-01 21:51:11 +03:00
alesapin
faaf3536ea Update deb image 2020-07-01 18:00:07 +03:00
Alexander Kuzmenkov
baec4093dd
Merge pull request #11993 from ClickHouse/aku/more-jemalloc-tweaks
jemalloc: set muzzy_decay_ms = 10s
2020-06-30 22:51:21 +03:00
alesapin
29c528235e Add ability to run any image version from packager and runner 2020-06-30 16:08:12 +03:00
alesapin
4262fec1bb Add pvs studio to images 2020-06-30 13:52:02 +03:00
alesapin
41142c5e95 Test image changes 2020-06-30 13:34:20 +03:00
Alexander Kuzmenkov
7e2f6937e0 fixup 2020-06-30 12:45:19 +03:00
Alexander Kuzmenkov
b5f9e9de78 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-30 12:28:14 +03:00
Alexander Kuzmenkov
a4152cfb00 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-30 08:55:56 +03:00
Alexander Kuzmenkov
588ff8fcc1
Merge pull request #11989 from ClickHouse/aku/long-perf
Try to enable long perf tests
2020-06-30 08:52:29 +03:00
Alexander Kuzmenkov
6d67c77e68 fixup 2020-06-29 17:09:51 +03:00
alesapin
db79278981 Fake change in dockerfile 2020-06-29 16:13:20 +03:00
alesapin
58c12a8428 Better docker images list 2020-06-29 13:52:25 +03:00
Alexander Kuzmenkov
1b49feae6b Fixup 2020-06-29 11:29:40 +03:00
alesapin
fb891ee4eb
Revert "[experiment] maybe fix warnings in integration tests" 2020-06-28 16:20:57 +03:00
Alexander Kuzmenkov
960c455e0e performance comparison 2020-06-27 04:15:58 +03:00
Alexander Kuzmenkov
8b82ff215f muzzy decay 10 ms 2020-06-27 04:08:21 +03:00
Alexander Kuzmenkov
7e88cc15f1 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-27 04:00:26 +03:00
Alexander Kuzmenkov
459ebf1ea0 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-27 03:59:36 +03:00
Alexander Kuzmenkov
e0c4cc9135 performance comparison 2020-06-27 03:53:54 +03:00
Alexander Kuzmenkov
be57bc56d7 perf test: report queries with new functions separately 2020-06-27 03:45:00 +03:00
Alexander Kuzmenkov
c8b633fe47 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-26 21:01:40 +03:00
alesapin
ca5278b40f
Merge pull request #11903 from ClickHouse/blinkov-patch-20
[experiment] maybe fix warnings in integration tests
2020-06-26 15:43:54 +03:00
Alexander Kuzmenkov
41659e38ce Update path to perf test package 2020-06-26 03:46:44 +03:00
Alexander Kuzmenkov
beb386674d Update path to performance tests build 2020-06-26 00:58:38 +03:00
Alexander Kuzmenkov
e521d616fe performance comparison 2020-06-25 23:42:29 +03:00
Alexander Kuzmenkov
01344d7b87 More verbose CMake in build docker 2020-06-25 22:16:48 +03:00
Alexander Kuzmenkov
593a0181bd
Merge pull request #11616 from ClickHouse/aku/perf-benchmark
Add concurrent benchmark to performance test
2020-06-25 09:36:52 +03:00
Alexander Kuzmenkov
58747df00c
Update docker/test/performance-comparison/perf.py 2020-06-25 09:35:21 +03:00
Alexander Kuzmenkov
4a8349cad9 Less layers in docker file 2020-06-25 09:26:10 +03:00
Alexander Kuzmenkov
63a8a8453a Less layers in docker file 2020-06-25 09:23:25 +03:00
Alexander Kuzmenkov
865ebcda16 variadic return value was too new python 2020-06-25 01:21:02 +03:00
alesapin
3fc65b3269 Merge branch 'master' into kssenii-rabbit-mq 2020-06-24 20:14:28 +03:00
alesapin
e7ff0cb8e4 Update pvs-studio version 2020-06-24 20:02:25 +03:00
Ivan Blinkov
d154ba227c
Update Dockerfile 2020-06-24 19:33:17 +03:00
Alexander Kuzmenkov
ce36da838c for the love of God just update this container already, i'm begging you 2020-06-24 19:12:05 +03:00
Alexander Kuzmenkov
3255a37b9f Do not update PVS Studio docker automatically.
They keep removing the old image every couple of weeks, and the entire
docker update fails.
2020-06-24 18:55:49 +03:00
Alexander Kuzmenkov
751319d0ef show build commands 2020-06-24 16:16:54 +03:00
Ivan Blinkov
aac17eb48d
[experiment] maybe fix warnings in integration tests 2020-06-24 11:38:00 +03:00
Alexander Kuzmenkov
e0bdbe73d2 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-23 15:31:09 +03:00
Alexander Kuzmenkov
ab809f59b9 memory usage settings 2020-06-23 15:30:45 +03:00
Alexander Kuzmenkov
bfba15d512 Explicitly mark short perftest queries 2020-06-23 15:09:54 +03:00
alexey-milovidov
3e71b6ae07
Merge pull request #11845 from ClickHouse/loose-odbc-connection-string-validation
Slightly relax the validation of ODBC connection string
2020-06-22 21:19:30 +03:00
robot-clickhouse
4bd47b8adc Auto version update to [20.6.1.1] [54436] 2020-06-22 20:40:26 +03:00
alesapin
afcf63ad89 Add alias for postgesql container 2020-06-22 16:29:35 +03:00
Alexander Kuzmenkov
eac6eb8c5a report 2020-06-22 15:22:09 +03:00
Alexey Milovidov
25f55bb5dd Remove duplicate entry 2020-06-20 15:39:02 +03:00
Alexey Milovidov
bba0cf6064 Remove dependency on tzdata 2020-06-20 15:31:18 +03:00
Alexander Kuzmenkov
fbecf42dfc report the number of errors 2020-06-20 01:41:15 +03:00
Alexander Kuzmenkov
cec65ce30d Merge remote-tracking branch 'origin/master' into HEAD 2020-06-19 22:34:50 +03:00
Alexander Kuzmenkov
1a3a19391c
Merge pull request #11711 from ClickHouse/fix_path_in_perftest
Try fix performance test of Values format
2020-06-19 15:57:32 +03:00
Alexander Tokmakov
73af3befe6 Revert "specify path in config" 2020-06-19 01:45:45 +03:00
Alexander Tokmakov
53b9f15f53 fix 2020-06-18 13:20:01 +03:00
Alexander Kuzmenkov
2bc6de4b4e performance comparison 2020-06-18 06:14:18 +03:00
Alexander Tokmakov
660ed26389 Merge branch 'master' into fix_path_in_perftest 2020-06-18 00:22:36 +03:00
Alexander Tokmakov
50b4671867 specify path in config 2020-06-16 21:29:55 +03:00
Alexander Kuzmenkov
29bf9aa128 update pvs studio 2020-06-16 19:22:06 +03:00
Alexander Tokmakov
1e50bae76e override user_files_path 2020-06-16 18:13:28 +03:00
Alexander Kuzmenkov
8509079021 performance comparison 2020-06-16 14:06:11 +03:00
Alexander Kuzmenkov
cd769e5ebf fixup 2020-06-16 11:21:15 +03:00
Alexander Kuzmenkov
4dc6254357 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-15 17:26:15 +03:00
Alexander Kuzmenkov
56869228a2 add flag to continue on errors 2020-06-12 21:28:07 +03:00
Alexander Kuzmenkov
5101708831 fixup 2020-06-12 18:11:33 +03:00
Alexander Kuzmenkov
0da6e1c9de typo 2020-06-12 15:12:12 +03:00
Alexander Kuzmenkov
10a8021418 performance comparison 2020-06-12 00:58:45 +03:00
Alexander Kuzmenkov
7ba5063b7a Add concurrent benchmark to performance test
After the main test, run queries from `website.xml` in parallel using
`clickhouse-benchmark`. This can be useful to test the effects of
concurrency on performance. Comparison test can miss some effects
because it always runs queries sequentially, and many of them are even
single-threaded.
2020-06-12 00:24:56 +03:00
alesapin
29311f71bf
Merge pull request #11585 from azat/unbundled-boost
Add unbundled boost support
2020-06-11 23:43:28 +03:00
Alexander Kuzmenkov
d840a9990c performance comparison 2020-06-11 23:39:26 +03:00
giordyb
d61da39c10
Update entrypoint.sh
without -q option the database does not get created at startup
2020-06-11 17:23:02 +02:00
alesapin
225380f849
Merge pull request #11586 from blinkov/repo-links
Update remaining links to old repo without CDN
2020-06-11 16:40:53 +03:00
Alexander Kuzmenkov
e354bbc78c
Merge pull request #11588 from ClickHouse/aku/async-log
Add system.asynchronous_metric_log
2020-06-11 16:10:35 +03:00
alesapin
36ea4abb48 Add several boost libraries to deb image 2020-06-11 15:54:29 +03:00
Azat Khuzhin
0731f2293d Add missing boost libraries into docker image 2020-06-11 11:47:30 +03:00
kssenii
18820814f5 Merge 2020-06-10 23:25:33 +00:00
Alexander Kuzmenkov
1bd375c25e performance comparison 2020-06-11 00:38:26 +03:00
Ivan Blinkov
e5cd2716da
Update Dockerfile 2020-06-10 22:27:05 +03:00
Alexander Kuzmenkov
7b54ff02f0 Collect async metric log in perf test 2020-06-10 22:27:05 +03:00
Ivan Blinkov
f6b5cd7de2
Update Dockerfile 2020-06-10 22:26:44 +03:00