Azat Khuzhin
de7909211d
Try using top_level_domains from the patched performance archive
...
If there is top_level_domains list in the upstream/master, use from the
patched version (this is required to run all performance tests for
upstream/master in the PR).
2021-01-02 17:27:03 +03:00
Azat Khuzhin
469b631ca6
Fix performance comparison
...
In #18113 the top_level_domains list copying was moved into
docker/packager/binary/build.sh, this was done to avoid symlinks (since
Dockerfile cannot dereference them).
But the patch was wrong, since it copied into the root (/), which is not
included into performance.tgz and also compare.sh was not modified.
This wasn't showed up with CI checks since the docker image wasn't
updated and it still included that top_level_domains, once it was
modified the image was updated and it became broken.
Cc: @akuzm
2021-01-02 17:09:20 +03:00
Azat Khuzhin
95c35b318e
Avoid using symlinks for top_level_domains
...
Move the main copy into the tests/config and ship it to the perf tests
via the perf package.
2020-12-15 21:58:46 +03:00
Alexander Kuzmenkov
5f424f7c5c
Update zzz-perf-comparison-tweaks-config.xml
2020-12-14 20:08:32 +03:00
Alexander Kuzmenkov
e7f93b5563
Merge pull request #18058 from azat/perf-test-zk-port-fix
...
Remove test_keeper_server in perf tests
2020-12-14 17:54:47 +03:00
Alexander Kuzmenkov
2edabd5519
Update zzz-perf-comparison-tweaks-config.xml
2020-12-14 17:45:58 +03:00
Azat Khuzhin
653ddab63e
Remove test_keeper_server in perf tests
...
To avoid port overlaps for right and left server (anyway it is not
used).
2020-12-14 10:59:01 +03:00
Azat Khuzhin
6f2c559398
Convert top_level_domains_lists.xml into regular file
...
docker/test/performance-comparison/config/config.d is not allowed to has
symlinks, since it is copied with the COPY docker command.
2020-12-10 21:01:17 +03:00
Azat Khuzhin
0f1d9f3a6f
Put top_level_domains into the docker/test/performance-comparison/config
...
Since in docker/test/performance-comparison there is Dockerfile that is
runned from that directory, so it cannot COPY anything outside of it.
2020-12-09 21:08:31 +03:00
Azat Khuzhin
8a4b29495b
perf: override top_level_domains_path via command line arguments
2020-12-09 21:08:31 +03:00
Azat Khuzhin
7b0c720922
Add top_level_domains into perf tests
...
And change Dockerfile to trigger image rebuild
2020-12-09 21:08:31 +03:00
Azat Khuzhin
79e6348282
perf: load overrides last of all
2020-12-09 07:31:54 +03:00
Azat Khuzhin
d33b0ad33b
Use interserver_http_port remove=remove over auto-port
...
Revert "perf: fix port conflict for tcp_with_proxy_port"
This reverts commit 89b3566824e5c0a87b6310fc4b6f9d300d2e17db.
2020-12-09 00:11:12 +03:00
Azat Khuzhin
75f9640fc2
perf: fix port conflict for tcp_with_proxy_port
...
Simply use zero port to do auto allocation, anyway it is not used in
perf tests.
2020-12-08 23:29:38 +03:00
Azat Khuzhin
f1ac8775db
perf: override config directives via command line over sed by config.xml
2020-12-08 21:25:03 +03:00
Azat Khuzhin
3696916f44
perf: add setuptools into docker image (to built clikchouse-driver)
2020-11-27 07:20:41 +03:00
Azat Khuzhin
04a93f18e8
perf: fail on unknown settings
2020-11-27 00:16:41 +03:00
Azat Khuzhin
a591886740
perf: remove outdated comments from perf.py
...
Refs: https://github.com/ClickHouse/ClickHouse/pull/17255#discussion_r528822709
2020-11-27 00:16:41 +03:00
Azat Khuzhin
a38628d967
perf: use the latest available clickhouse-driver (from git)
...
Since later setting_is_important will be used, but there is no release
with this feature included.
2020-11-27 00:16:41 +03:00
myrrc
fbb0e6e6aa
Merge remote-tracking branch 'upstream/master' into improvement/diff-types-in-avg-weighted
2020-11-24 16:04:17 +03:00
Alexander Kuzmenkov
a543c8e468
Add an option to use existing tables to perf.py
2020-11-23 21:05:54 +03:00
Azat Khuzhin
d676e2f5c5
Pass settings for perf tests via protocol over SET query
...
Thus they will be applied on reconnects, since clickhouse-driver may
implicitly do it if the connection has been failed.
2020-11-21 14:02:33 +03:00
Azat Khuzhin
3ddb0ac53e
Configure logging for perf test runner
2020-11-21 14:02:33 +03:00
Azat Khuzhin
f6d16ee43e
Force clickhouse-driver >= 1.1.5 for settings-as-strings support for perf-tests image
2020-11-21 14:02:33 +03:00
Alexander Kuzmenkov
b0e660651a
cleanup
2020-11-16 19:09:58 +03:00
Alexander Kuzmenkov
030419db90
Try 12 threads max in perf test.
...
This will allow us to use more machines, not only Gold 6320.
2020-11-09 19:14:05 +03:00
Alexander Kuzmenkov
dc665d7c43
Update compare.sh
2020-11-06 13:45:42 +03:00
Alexander Kuzmenkov
ac487ab26a
Update compare.sh
2020-11-05 23:45:58 +03:00
Alexander Kuzmenkov
8d5fe1148c
add client config
2020-11-04 18:07:34 +03:00
Alexander Kuzmenkov
5cb708a50a
fixup
2020-11-04 04:19:53 +03:00
Alexander Kuzmenkov
4245c470ac
fixes
2020-11-03 17:37:54 +03:00
Alexander Kuzmenkov
a25996ed8d
Upload perf test results to the CI database
2020-11-03 02:10:19 +03:00
Mikhail Filimonov
41971e073a
Fix typos reported by codespell
2020-10-27 12:04:03 +01:00
Alexander Kuzmenkov
e27dd538fd
performance comparison
2020-10-26 19:35:37 +03:00
Alexander Kuzmenkov
0275e9c010
work around docker weirdness
2020-10-22 19:42:31 +03:00
Alexander Kuzmenkov
ac7af67ede
fixup
2020-10-22 15:52:43 +03:00
Alexander Kuzmenkov
6293d1dbbe
Merge remote-tracking branch 'origin/master' into HEAD
2020-10-21 18:39:59 +03:00
Alexander Kuzmenkov
a678f03229
fixup
2020-10-21 18:21:54 +03:00
Alexander Kuzmenkov
c10dada3d4
try node 1
2020-10-21 18:06:42 +03:00
Alexander Kuzmenkov
abcb3c2ff9
Update report.py
2020-10-20 20:06:51 +03:00
Alexander Kuzmenkov
6b0225ab8c
Update README.md
2020-10-20 19:52:37 +03:00
Alexander Kuzmenkov
242ec7e56c
make some tests faster
2020-10-20 15:12:06 +03:00
Alexander Kuzmenkov
764f19820b
max threads
2020-10-19 17:39:52 +03:00
Alexander Kuzmenkov
38a2dd55ce
fix numactl parameters
2020-10-19 17:31:02 +03:00
Alexander Kuzmenkov
2241ea9f33
not sure what's going on...
2020-10-16 17:44:59 +03:00
Alexander Kuzmenkov
0825b8f4c2
Merge remote-tracking branch 'origin/master' into HEAD
2020-10-16 17:41:40 +03:00
Azat Khuzhin
9cb3c743bd
Convert to python3 ( #15007 )
2020-10-02 19:54:07 +03:00
Alexander Kuzmenkov
13c325597a
Merge remote-tracking branch 'origin/master' into HEAD
2020-10-01 13:57:04 +03:00
Alexander Kuzmenkov
74f8e41b55
calculate on all nodes
2020-10-01 13:56:56 +03:00
Alexander Kuzmenkov
499e0766e5
Check docker scripts with shellcheck
2020-09-30 20:06:46 +03:00
