Commit Graph

277 Commits

Author SHA1 Message Date
Alexander Kuzmenkov
1d954581eb Fix some spurious perf test failures 2020-07-31 19:28:04 +03:00
Alexander Kuzmenkov
e2e4fc9848 align numbers to the right in perf report 2020-07-31 13:59:15 +03:00
Alexander Kuzmenkov
db15108005 add times speedup/slowdown to changed tests table 2020-07-31 01:14:20 +03:00
Alexander Kuzmenkov
e0c207d6b4
Update entrypoint.sh 2020-07-28 16:15:41 +03:00
Alexander Kuzmenkov
b6f2fde37e performance comparison 2020-07-27 14:20:45 +03:00
Alexander Kuzmenkov
acf1e5fe7e Choose proper old version for perf comparison 2020-07-23 18:17:11 +03:00
Alexander Kuzmenkov
186b2c3b1b Support different query log format in perf test 2020-07-23 16:32:03 +03:00
Alexander Kuzmenkov
72167aa746
Update Dockerfile 2020-07-22 16:18:57 +03:00
Alexander Kuzmenkov
00acf4173c Fixes for perf test after #12469 2020-07-15 16:38:02 +03:00
Alexander Kuzmenkov
57ad000c62
Update README.md 2020-07-14 16:46:19 +03:00
Alexander Kuzmenkov
5a15e03400 Improve data layout in perf test
Also fix a bad test query found with new data.
2020-07-13 14:31:15 +03:00
Alexander Kuzmenkov
394cf20673 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-09 13:46:54 +03:00
Alexander Kuzmenkov
cec35a0e1d
Update README.md 2020-07-08 15:07:01 +03:00
Alexander Kuzmenkov
c9162f6e77
Update README.md 2020-07-08 15:05:49 +03:00
Alexander Kuzmenkov
344e2713fa
Update README.md 2020-07-08 14:52:06 +03:00
Alexander Kuzmenkov
bd14d06476
Update README.md 2020-07-08 14:25:43 +03:00
Alexander Kuzmenkov
f514d0da77
Revert "Run perf tests with memory sampling (for allocations >1M)" 2020-07-07 19:59:42 +03:00
Azat Khuzhin
307c3c92a5 Run perf tests with memory sampling (for allocations >1M)
This is to know the memory allocation size distribution, that can be
obtained later from left-metric-log.tsv.

This is an attempt to tune tcmalloc (new CPP version by google) to use
lock-free part of the allocator for typical allocations (and it is a bad
idea just to increase kMaxSize there, since number of allocation for
each size class is also important).

P.S. hope that this file will be applied, if no, then the same effect
can be reached by tunning defaults in Settings.h

Refs: #11590
Cc: @akuzm
2020-07-05 12:43:12 +03:00
Alexander Kuzmenkov
10b6f98ca6 fixup 2020-07-03 11:39:43 +03:00
Alexander Kuzmenkov
7d8a31aff3 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-03 10:09:20 +03:00
Alexander Kuzmenkov
f50f8d936e Merge remote-tracking branch 'origin/master' into HEAD 2020-07-02 10:19:26 +03:00
Alexander Kuzmenkov
41088c3416 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-02 10:13:11 +03:00
Alexander Kuzmenkov
99514a7e24 fixup 2020-07-02 10:13:02 +03:00
Alexander Kuzmenkov
baec4093dd
Merge pull request #11993 from ClickHouse/aku/more-jemalloc-tweaks
jemalloc: set muzzy_decay_ms = 10s
2020-06-30 22:51:21 +03:00
Alexander Kuzmenkov
7e2f6937e0 fixup 2020-06-30 12:45:19 +03:00
Alexander Kuzmenkov
b5f9e9de78 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-30 12:28:14 +03:00
Alexander Kuzmenkov
a4152cfb00 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-30 08:55:56 +03:00
Alexander Kuzmenkov
588ff8fcc1
Merge pull request #11989 from ClickHouse/aku/long-perf
Try to enable long perf tests
2020-06-30 08:52:29 +03:00
Alexander Kuzmenkov
6d67c77e68 fixup 2020-06-29 17:09:51 +03:00
Alexander Kuzmenkov
1b49feae6b Fixup 2020-06-29 11:29:40 +03:00
Alexander Kuzmenkov
960c455e0e performance comparison 2020-06-27 04:15:58 +03:00
Alexander Kuzmenkov
8b82ff215f muzzy decay 10 ms 2020-06-27 04:08:21 +03:00
Alexander Kuzmenkov
7e88cc15f1 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-27 04:00:26 +03:00
Alexander Kuzmenkov
459ebf1ea0 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-27 03:59:36 +03:00
Alexander Kuzmenkov
e0c4cc9135 performance comparison 2020-06-27 03:53:54 +03:00
Alexander Kuzmenkov
be57bc56d7 perf test: report queries with new functions separately 2020-06-27 03:45:00 +03:00
Alexander Kuzmenkov
c8b633fe47 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-26 21:01:40 +03:00
Alexander Kuzmenkov
41659e38ce Update path to perf test package 2020-06-26 03:46:44 +03:00
Alexander Kuzmenkov
beb386674d Update path to performance tests build 2020-06-26 00:58:38 +03:00
Alexander Kuzmenkov
e521d616fe performance comparison 2020-06-25 23:42:29 +03:00
Alexander Kuzmenkov
58747df00c
Update docker/test/performance-comparison/perf.py 2020-06-25 09:35:21 +03:00
Alexander Kuzmenkov
865ebcda16 variadic return value was too new python 2020-06-25 01:21:02 +03:00
Alexander Kuzmenkov
ab809f59b9 memory usage settings 2020-06-23 15:30:45 +03:00
Alexander Kuzmenkov
bfba15d512 Explicitly mark short perftest queries 2020-06-23 15:09:54 +03:00
Alexander Kuzmenkov
eac6eb8c5a report 2020-06-22 15:22:09 +03:00
Alexander Kuzmenkov
fbecf42dfc report the number of errors 2020-06-20 01:41:15 +03:00
Alexander Kuzmenkov
cec65ce30d Merge remote-tracking branch 'origin/master' into HEAD 2020-06-19 22:34:50 +03:00
Alexander Kuzmenkov
1a3a19391c
Merge pull request #11711 from ClickHouse/fix_path_in_perftest
Try fix performance test of Values format
2020-06-19 15:57:32 +03:00
Alexander Tokmakov
73af3befe6 Revert "specify path in config" 2020-06-19 01:45:45 +03:00
Alexander Tokmakov
53b9f15f53 fix 2020-06-18 13:20:01 +03:00
Alexander Kuzmenkov
2bc6de4b4e performance comparison 2020-06-18 06:14:18 +03:00
Alexander Tokmakov
660ed26389 Merge branch 'master' into fix_path_in_perftest 2020-06-18 00:22:36 +03:00
Alexander Tokmakov
50b4671867 specify path in config 2020-06-16 21:29:55 +03:00
Alexander Tokmakov
1e50bae76e override user_files_path 2020-06-16 18:13:28 +03:00
Alexander Kuzmenkov
8509079021 performance comparison 2020-06-16 14:06:11 +03:00
Alexander Kuzmenkov
cd769e5ebf fixup 2020-06-16 11:21:15 +03:00
Alexander Kuzmenkov
4dc6254357 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-15 17:26:15 +03:00
Alexander Kuzmenkov
56869228a2 add flag to continue on errors 2020-06-12 21:28:07 +03:00
Alexander Kuzmenkov
5101708831 fixup 2020-06-12 18:11:33 +03:00
Alexander Kuzmenkov
0da6e1c9de typo 2020-06-12 15:12:12 +03:00
Alexander Kuzmenkov
10a8021418 performance comparison 2020-06-12 00:58:45 +03:00
Alexander Kuzmenkov
7ba5063b7a Add concurrent benchmark to performance test
After the main test, run queries from `website.xml` in parallel using
`clickhouse-benchmark`. This can be useful to test the effects of
concurrency on performance. Comparison test can miss some effects
because it always runs queries sequentially, and many of them are even
single-threaded.
2020-06-12 00:24:56 +03:00
Alexander Kuzmenkov
d840a9990c performance comparison 2020-06-11 23:39:26 +03:00
Alexander Kuzmenkov
e354bbc78c
Merge pull request #11588 from ClickHouse/aku/async-log
Add system.asynchronous_metric_log
2020-06-11 16:10:35 +03:00
Alexander Kuzmenkov
1bd375c25e performance comparison 2020-06-11 00:38:26 +03:00
Alexander Kuzmenkov
7b54ff02f0 Collect async metric log in perf test 2020-06-10 22:27:05 +03:00
Alexander Kuzmenkov
af1c8f8a5f fixup 2020-06-10 02:57:31 +03:00
Alexander Kuzmenkov
5719549ee1 fixup 2020-06-09 16:29:07 +03:00
Alexander Kuzmenkov
6a3df071a2 fixup 2020-06-09 01:13:08 +03:00
Alexander Kuzmenkov
e2e5e1d5f8 More stable perf tests 2020-06-08 16:57:33 +03:00
Alexander Kuzmenkov
b14cc1dc56
Merge pull request #11449 from ClickHouse/check-for-incorrect-settings
Added a check for incorrect settings
2020-06-06 00:15:27 +03:00
Alexander Kuzmenkov
d17a435fb6
Merge pull request #11226 from ClickHouse/aku/merge-perf-events
Merge Perf events metrics #9545
2020-06-05 23:10:54 +03:00
Alexander Kuzmenkov
29adb1cbcf performance comparison 2020-06-05 17:30:26 +03:00
Alexander Kuzmenkov
14c55b940e
peftest settings: use_uncompressed_cache goes to profile 2020-06-05 16:32:21 +03:00
Alexander Kuzmenkov
5523444d91 cleanup 2020-06-05 15:53:47 +03:00
Alexander Kuzmenkov
377da4656d cleanup 2020-06-04 18:51:34 +03:00
Alexander Kuzmenkov
03d8bf9242 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-01 20:15:25 +03:00
Alexander Kuzmenkov
aa1f552a8f build fixes 2020-06-01 20:13:54 +03:00
Alexander Kuzmenkov
ca5d7cf5bb fix some broken performance tests 2020-05-28 10:45:03 +03:00
Alexander Kuzmenkov
db84f0e892 Merge remote-tracking branch 'origin/master' into HEAD 2020-05-27 16:30:13 +03:00
Alexander Kuzmenkov
f1fb7245e5 Merge remote-tracking branch 'origin/master' into HEAD 2020-05-25 06:21:27 +03:00
Alexander Kuzmenkov
09129a6d21 Function for printing array of Asts 2020-05-25 06:19:46 +03:00
Alexander Kuzmenkov
bf3f76be7f performance comparison 2020-05-25 04:42:56 +03:00
Alexander Kuzmenkov
5a9f47e6b0 performance comparison 2020-05-25 04:03:46 +03:00
Alexander Kuzmenkov
f6dd8d3f78
Enable perf event metrics in performance test 2020-05-23 04:40:57 +03:00
Alexander Kuzmenkov
36c7a486a1 performance comparison 2020-05-23 03:27:56 +03:00
Alexander Kuzmenkov
a2ed8267ad
Rename performance_comparison.md to README.md 2020-05-23 00:30:17 +03:00
Alexander Kuzmenkov
51a064aa75 performance comparison 2020-05-22 23:09:44 +03:00
Alexander Kuzmenkov
f04c5c6100 performance comparison 2020-05-22 11:54:35 +03:00
Alexander Kuzmenkov
86da115018 performance comparison 2020-05-22 11:40:20 +03:00
Alexander Kuzmenkov
3073fc9eb0 performance comparison 2020-05-22 05:51:26 +03:00
Alexander Kuzmenkov
432648ca1e performance comparison 2020-05-22 03:51:56 +03:00
Alexander Kuzmenkov
7b747fabe2 performance comparison 2020-05-22 02:04:04 +03:00
Alexander Kuzmenkov
ebb29d48fa
Update perf.py 2020-05-21 21:06:08 +03:00
Alexander Kuzmenkov
34508b8f64 [wip] Add memory stats to performance test 2020-05-21 05:12:55 +03:00
Alexander Kuzmenkov
ef6f386ee6
Merge pull request #11026 from ClickHouse/aku/trace-log
Add more logs to debug trace_log overflow
2020-05-19 17:56:06 +03:00
Alexander Kuzmenkov
a700b527ce fixup 2020-05-19 17:51:51 +03:00
Alexander Kuzmenkov
c34ea27362 performance comparison 2020-05-19 00:15:33 +03:00
Alexander Kuzmenkov
a54773f947 Add more logs to debug trace_log overflow 2020-05-18 22:33:12 +03:00
Alexander Kuzmenkov
bb726b2d8d
Update compare.sh 2020-05-14 13:54:07 +03:00