Commit Graph

390 Commits

Author SHA1 Message Date
Alexander Kuzmenkov
41659e38ce Update path to perf test package 2020-06-26 03:46:44 +03:00
Alexander Kuzmenkov
beb386674d Update path to performance tests build 2020-06-26 00:58:38 +03:00
Alexander Kuzmenkov
e521d616fe performance comparison 2020-06-25 23:42:29 +03:00
Alexander Kuzmenkov
58747df00c
Update docker/test/performance-comparison/perf.py 2020-06-25 09:35:21 +03:00
Alexander Kuzmenkov
865ebcda16 variadic return value was too new python 2020-06-25 01:21:02 +03:00
Alexander Kuzmenkov
ab809f59b9 memory usage settings 2020-06-23 15:30:45 +03:00
Alexander Kuzmenkov
bfba15d512 Explicitly mark short perftest queries 2020-06-23 15:09:54 +03:00
Alexander Kuzmenkov
eac6eb8c5a report 2020-06-22 15:22:09 +03:00
Alexander Kuzmenkov
fbecf42dfc report the number of errors 2020-06-20 01:41:15 +03:00
Alexander Kuzmenkov
cec65ce30d Merge remote-tracking branch 'origin/master' into HEAD 2020-06-19 22:34:50 +03:00
Alexander Kuzmenkov
1a3a19391c
Merge pull request #11711 from ClickHouse/fix_path_in_perftest
Try fix performance test of Values format
2020-06-19 15:57:32 +03:00
Alexander Tokmakov
73af3befe6 Revert "specify path in config" 2020-06-19 01:45:45 +03:00
Alexander Tokmakov
53b9f15f53 fix 2020-06-18 13:20:01 +03:00
Alexander Kuzmenkov
2bc6de4b4e performance comparison 2020-06-18 06:14:18 +03:00
Alexander Tokmakov
660ed26389 Merge branch 'master' into fix_path_in_perftest 2020-06-18 00:22:36 +03:00
Alexander Tokmakov
50b4671867 specify path in config 2020-06-16 21:29:55 +03:00
Alexander Tokmakov
1e50bae76e override user_files_path 2020-06-16 18:13:28 +03:00
Alexander Kuzmenkov
8509079021 performance comparison 2020-06-16 14:06:11 +03:00
Alexander Kuzmenkov
cd769e5ebf fixup 2020-06-16 11:21:15 +03:00
Alexander Kuzmenkov
4dc6254357 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-15 17:26:15 +03:00
Alexander Kuzmenkov
56869228a2 add flag to continue on errors 2020-06-12 21:28:07 +03:00
Alexander Kuzmenkov
5101708831 fixup 2020-06-12 18:11:33 +03:00
Alexander Kuzmenkov
0da6e1c9de typo 2020-06-12 15:12:12 +03:00
Alexander Kuzmenkov
10a8021418 performance comparison 2020-06-12 00:58:45 +03:00
Alexander Kuzmenkov
7ba5063b7a Add concurrent benchmark to performance test
After the main test, run queries from `website.xml` in parallel using
`clickhouse-benchmark`. This can be useful to test the effects of
concurrency on performance. Comparison test can miss some effects
because it always runs queries sequentially, and many of them are even
single-threaded.
2020-06-12 00:24:56 +03:00
Alexander Kuzmenkov
d840a9990c performance comparison 2020-06-11 23:39:26 +03:00
Alexander Kuzmenkov
e354bbc78c
Merge pull request #11588 from ClickHouse/aku/async-log
Add system.asynchronous_metric_log
2020-06-11 16:10:35 +03:00
Alexander Kuzmenkov
1bd375c25e performance comparison 2020-06-11 00:38:26 +03:00
Alexander Kuzmenkov
7b54ff02f0 Collect async metric log in perf test 2020-06-10 22:27:05 +03:00
Alexander Kuzmenkov
af1c8f8a5f fixup 2020-06-10 02:57:31 +03:00
Alexander Kuzmenkov
5719549ee1 fixup 2020-06-09 16:29:07 +03:00
Alexander Kuzmenkov
6a3df071a2 fixup 2020-06-09 01:13:08 +03:00
Alexander Kuzmenkov
e2e5e1d5f8 More stable perf tests 2020-06-08 16:57:33 +03:00
Alexander Kuzmenkov
b14cc1dc56
Merge pull request #11449 from ClickHouse/check-for-incorrect-settings
Added a check for incorrect settings
2020-06-06 00:15:27 +03:00
Alexander Kuzmenkov
d17a435fb6
Merge pull request #11226 from ClickHouse/aku/merge-perf-events
Merge Perf events metrics #9545
2020-06-05 23:10:54 +03:00
Alexander Kuzmenkov
29adb1cbcf performance comparison 2020-06-05 17:30:26 +03:00
Alexander Kuzmenkov
14c55b940e
peftest settings: use_uncompressed_cache goes to profile 2020-06-05 16:32:21 +03:00
Alexander Kuzmenkov
5523444d91 cleanup 2020-06-05 15:53:47 +03:00
Alexander Kuzmenkov
377da4656d cleanup 2020-06-04 18:51:34 +03:00
Alexander Kuzmenkov
03d8bf9242 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-01 20:15:25 +03:00
Alexander Kuzmenkov
aa1f552a8f build fixes 2020-06-01 20:13:54 +03:00
Alexander Kuzmenkov
ca5d7cf5bb fix some broken performance tests 2020-05-28 10:45:03 +03:00
Alexander Kuzmenkov
db84f0e892 Merge remote-tracking branch 'origin/master' into HEAD 2020-05-27 16:30:13 +03:00
Alexander Kuzmenkov
f1fb7245e5 Merge remote-tracking branch 'origin/master' into HEAD 2020-05-25 06:21:27 +03:00
Alexander Kuzmenkov
09129a6d21 Function for printing array of Asts 2020-05-25 06:19:46 +03:00
Alexander Kuzmenkov
bf3f76be7f performance comparison 2020-05-25 04:42:56 +03:00
Alexander Kuzmenkov
5a9f47e6b0 performance comparison 2020-05-25 04:03:46 +03:00
Alexander Kuzmenkov
f6dd8d3f78
Enable perf event metrics in performance test 2020-05-23 04:40:57 +03:00
Alexander Kuzmenkov
36c7a486a1 performance comparison 2020-05-23 03:27:56 +03:00
Alexander Kuzmenkov
a2ed8267ad
Rename performance_comparison.md to README.md 2020-05-23 00:30:17 +03:00
Alexander Kuzmenkov
51a064aa75 performance comparison 2020-05-22 23:09:44 +03:00
Alexander Kuzmenkov
f04c5c6100 performance comparison 2020-05-22 11:54:35 +03:00
Alexander Kuzmenkov
86da115018 performance comparison 2020-05-22 11:40:20 +03:00
Alexander Kuzmenkov
3073fc9eb0 performance comparison 2020-05-22 05:51:26 +03:00
Alexander Kuzmenkov
432648ca1e performance comparison 2020-05-22 03:51:56 +03:00
Alexander Kuzmenkov
7b747fabe2 performance comparison 2020-05-22 02:04:04 +03:00
Alexander Kuzmenkov
ebb29d48fa
Update perf.py 2020-05-21 21:06:08 +03:00
Alexander Kuzmenkov
34508b8f64 [wip] Add memory stats to performance test 2020-05-21 05:12:55 +03:00
Alexander Kuzmenkov
ef6f386ee6
Merge pull request #11026 from ClickHouse/aku/trace-log
Add more logs to debug trace_log overflow
2020-05-19 17:56:06 +03:00
Alexander Kuzmenkov
a700b527ce fixup 2020-05-19 17:51:51 +03:00
Alexander Kuzmenkov
c34ea27362 performance comparison 2020-05-19 00:15:33 +03:00
Alexander Kuzmenkov
a54773f947 Add more logs to debug trace_log overflow 2020-05-18 22:33:12 +03:00
Alexander Kuzmenkov
bb726b2d8d
Update compare.sh 2020-05-14 13:54:07 +03:00
Alexey Milovidov
4e891091df Allow expected number of failures in performance test 2020-05-13 06:57:19 +03:00
Alexander Kuzmenkov
9edb0ba293
Update performance_comparison.md 2020-05-12 18:45:48 +03:00
Alexey Milovidov
ec73ff6151 Do not show unstable queries as error 2020-05-09 18:58:47 +03:00
Alexey Milovidov
2e58cbd1b5 Minor modifications 2020-05-09 18:55:25 +03:00
Alexey Milovidov
33f1fd3836 Fix bad markup 2020-05-09 18:50:28 +03:00
Alexey Milovidov
2000008438 Fix bad markup 2020-05-09 18:47:14 +03:00
Alexander Kuzmenkov
5aadd628f1 performance comparison 2020-04-30 11:36:51 +03:00
Alexander Kuzmenkov
18d4563b5c
Update performance_comparison.md 2020-04-30 10:28:14 +03:00
Alexander Kuzmenkov
d952e5aba2 performance comparison 2020-04-29 20:26:28 +03:00
Alexander Kuzmenkov
095ef4b32c performance comparison 2020-04-29 19:28:00 +03:00
Alexander Kuzmenkov
884db5c12e performance comparison 2020-04-29 12:47:17 +03:00
Alexander Kuzmenkov
a5911277b0 performance comparison 2020-04-29 12:28:35 +03:00
Alexander Kuzmenkov
15e94d3de9 performance comparison 2020-04-29 09:30:37 +03:00
Alexander Kuzmenkov
cf63174139 performance comparison 2020-04-28 17:27:24 +03:00
Alexander Kuzmenkov
ed1576507b performance comparison 2020-04-28 10:45:56 +03:00
Alexander Kuzmenkov
9480210236 performance comparison 2020-04-27 15:48:17 +03:00
tavplubix
7928f2eaa1
Merge pull request #7512 from ClickHouse/database_atomic
DatabaseAtomic
2020-04-24 22:28:18 +03:00
Alexander Kuzmenkov
93e49ae10f performance comparison 2020-04-24 10:19:50 +03:00
Alexander Kuzmenkov
79c5b7cc9f performance comparison 2020-04-24 06:23:38 +03:00
Alexander Kuzmenkov
1bf02d459c performance comparison 2020-04-23 23:19:04 +03:00
Alexander Tokmakov
04d6b59ac0 Merge branch 'master' into database_atomic 2020-04-23 17:31:37 +03:00
Alexander Kuzmenkov
d99f516fa6 performance comparison 2020-04-23 11:44:49 +03:00
Alexander Kuzmenkov
631c810500 performance comparison 2020-04-22 22:42:00 +03:00
Alexander Tokmakov
fefbbd37df Merge branch 'master' into database_atomic 2020-04-22 17:02:30 +03:00
Alexander Kuzmenkov
3b1334ee1b performance comparison 2020-04-22 16:11:46 +03:00
Alexander Kuzmenkov
627dfe103f performance comparison 2020-04-22 04:50:21 +03:00
Alexander Kuzmenkov
1c997dcb7c performance comparison 2020-04-22 01:08:24 +03:00
Alexander Kuzmenkov
f2290bf2ee performance comparison 2020-04-21 21:46:45 +03:00
Alexander Tokmakov
b29bddac12 Merge branch 'master' into database_atomic 2020-04-20 14:09:09 +03:00
Alexander Kuzmenkov
c8d70d714a
Merge pull request #9985 from ClickHouse/fix-perftest-distributed-aggregation
Try fix perftest distributed_aggregation.xml
2020-04-18 03:08:34 +03:00
Alexander Kuzmenkov
fb790ef82c
Update report.py 2020-04-18 02:59:03 +03:00
Alexander Kuzmenkov
41473d090d performance comparison 2020-04-17 18:47:01 +03:00
Alexander Kuzmenkov
e59aaa88f8
Update compare.sh 2020-04-17 16:32:59 +03:00
Alexander Kuzmenkov
9b66f33eb5 performance comparison 2020-04-17 01:25:08 +03:00
Alexander Kuzmenkov
1e5a33bcfb Merge remote-tracking branch 'origin/master' into HEAD 2020-04-16 23:03:17 +03:00
Alexander Kuzmenkov
93e0313ed4
boop the CI 2020-04-14 01:40:07 +03:00
Alexander Kuzmenkov
def6817ede
Update compare.sh 2020-04-13 22:06:07 +03:00
Alexander Tokmakov
d1024e76bd fix 2020-04-13 18:46:36 +03:00
Alexander Kuzmenkov
aadb05cbe3
performance comparison 2020-04-07 20:55:39 +03:00
Alexander Kuzmenkov
2e804173a9 performance comparison 2020-04-07 03:29:44 +03:00
Alexander Kuzmenkov
2a8867f330 Convenient defaults for perf test runner. 2020-04-06 23:48:26 +03:00
Alexander Kuzmenkov
bcc77fc96a
Update perf-comparison-tweaks-config.xml 2020-04-06 23:42:20 +03:00
Alexander Kuzmenkov
9465f97832 performance comparison 2020-04-03 21:23:11 +03:00
Alexander Kuzmenkov
882e0d8b4e
Update compare.sh 2020-04-03 13:00:23 +03:00
Alexander Kuzmenkov
cd88b5380c Performance comparison fixes 2020-04-02 21:44:58 +03:00
Ivan
97f2a2213e
Move all folders inside /dbms one level up (#9974)
* Move some code outside dbms/src folder
* Fix paths
2020-04-02 02:51:21 +03:00
Nikolai Kochetov
8e18f56d4f Try fix perftest distributed_aggregation.xml 2020-04-01 14:53:09 +03:00
Alexander Kuzmenkov
f576cab761 performance comparison 2020-03-26 03:09:43 +03:00
Alexander Kuzmenkov
5fd5b15c36 performance comparison 2020-03-24 20:33:42 +03:00
Alexander Kuzmenkov
fe1eb691fd
Update perf-comparison-tweaks-config.xml 2020-03-23 23:53:25 +03:00
Alexander Kuzmenkov
d396a7c650 Some tweaks for performance comparison 2020-03-23 12:39:12 +03:00
Alexander Kuzmenkov
26fcc0f0f8
Update report.py 2020-03-18 22:06:15 +03:00
Alexander Kuzmenkov
48a2b46499 performance comparison 2020-03-18 06:25:16 +03:00
Alexander Kuzmenkov
56c4b49844 performance comparison 2020-03-18 04:29:32 +03:00
Alexander Kuzmenkov
f4ea37fa3b peformance comparison 2020-03-17 19:37:26 +03:00
Alexander Kuzmenkov
f6d745de7f performance comparison 2020-03-17 05:42:13 +03:00
Alexander Kuzmenkov
811d0e00d5 performance comparison 2020-03-16 17:54:17 +03:00
Alexander Kuzmenkov
beac0769bc
github doesn't like cute animals in check status 2020-03-14 02:04:40 +03:00
alexey-milovidov
930f2bae54
Merge pull request #9611 from ClickHouse/aku/fix-some-perf-tests
Fix some performance tests
2020-03-13 22:30:26 +03:00
Alexander Kuzmenkov
7e6585328f fixup 2020-03-13 16:30:54 +03:00
Alexander Kuzmenkov
9b4e45748a fixup 2020-03-12 21:26:02 +03:00
Alexander Kuzmenkov
e8f9e4d5fd performance comparison 2020-03-12 19:21:58 +03:00
Alexander Kuzmenkov
e9a2534e30 performance comparison 2020-03-12 17:52:48 +03:00
Alexander Kuzmenkov
553e5a8867 performance comparison 2020-03-12 17:24:18 +03:00
Alexander Kuzmenkov
a89ccd5eb7 performance comparison 2020-03-12 17:17:24 +03:00
Alexander Kuzmenkov
7f8b2b0c41 performance comparison 2020-03-12 16:56:26 +03:00
Alexander Kuzmenkov
ca1dd5a357 performance comparison 2020-03-12 15:51:09 +03:00
Alexander Kuzmenkov
299c0d4da9 Fix some performance tests 2020-03-12 00:08:08 +03:00
Alexander Kuzmenkov
f2ca21e1ee performance comparison 2020-03-03 16:39:23 +03:00
Alexander Kuzmenkov
662ce64c99 performance comparison 2020-03-03 13:47:57 +03:00
Alexander Kuzmenkov
ac7860dc49 performance comparison 2020-03-02 21:47:59 +03:00
Alexander Kuzmenkov
35dc08ccda performance comparison 2020-03-02 20:06:14 +03:00
Alexander Kuzmenkov
5bc45f96b5 performance comparison 2020-03-02 19:14:12 +03:00
Alexander Kuzmenkov
de407f17cb performance comparison 2020-03-02 18:55:28 +03:00
Alexander Kuzmenkov
657d96d283 performance comparison 2020-03-02 18:06:09 +03:00
Alexander Kuzmenkov
4407d203d5 performance comparison 2020-02-28 23:40:26 +03:00
Alexander Kuzmenkov
be221a2f1a perf comparison -- more filtering 2020-02-28 23:00:28 +03:00
Alexander Kuzmenkov
8f5ad14cc5 performance comparison - 7 runs 2020-02-28 20:08:51 +03:00
Alexander Kuzmenkov
1c2fe333d2 performance comparison 2020-02-28 19:22:33 +03:00
Alexander Kuzmenkov
01c36f8b33 Fix shellcheck warnings. 2020-02-27 23:56:32 +03:00
Alexander Kuzmenkov
aab320d656 performance comparison 2020-02-27 22:44:03 +03:00
Alexander Kuzmenkov
90ee601eb0 performance comparison 2020-02-27 20:57:27 +03:00
Alexander Kuzmenkov
9ed1c7ea22 performance comparison 2020-02-26 19:18:58 +03:00
Alexander Kuzmenkov
ea67cba608 performance comparison 2020-02-25 22:51:27 +03:00
Alexander Kuzmenkov
ebe70f5bcb performance comparison 2020-02-25 16:12:26 +03:00
Alexander Kuzmenkov
8d46eb6ecc
Update compare.sh 2020-02-25 15:18:50 +03:00
Alexander Kuzmenkov
0a83353068
Update compare.sh 2020-02-22 20:52:49 +03:00
Alexander Kuzmenkov
eabfdf4ce0
Update compare.sh 2020-02-22 15:02:45 +03:00
Alexander Kuzmenkov
49c68012bf performance comparison 2020-02-21 23:00:44 +03:00
Alexander Kuzmenkov
3ae2282209 performance comparison 2020-02-20 19:33:19 +03:00
Alexander Kuzmenkov
8017220004 performance comparison 2020-02-18 20:30:38 +03:00
Alexander Kuzmenkov
84237befef
Update entrypoint.sh 2020-02-17 22:52:35 +03:00
Alexander Kuzmenkov
73c4204e95 performance comparison 2020-02-17 22:33:08 +03:00
Alexander Kuzmenkov
3e03b1591c
Update entrypoint.sh 2020-02-14 23:31:57 +03:00
Alexander Kuzmenkov
de351bad39 performance comparison 2020-02-14 22:39:36 +03:00
Alexander Kuzmenkov
3c754113f1 performance comparison 2020-02-14 15:55:47 +03:00
Alexander Kuzmenkov
551cd4776b Move the documentation draft out of public docs. 2020-02-14 15:14:33 +03:00
Alexander Kuzmenkov
e818b2e67a performance comparison 2020-02-12 19:10:07 +03:00
Alexander Kuzmenkov
0de8e7cf1a performance comparison 2020-02-11 23:01:39 +03:00
Alexander Kuzmenkov
ca61b57183 performance comparison 2020-02-11 18:01:33 +03:00
Alexander Kuzmenkov
1e8097da7f
Update entrypoint.sh 2020-02-10 21:41:00 +03:00
Alexander Kuzmenkov
0353a55e3d performance comparison 2020-02-10 21:37:46 +03:00
Alexander Kuzmenkov
8c383f240a performance comparison 2020-02-10 21:12:52 +03:00
Alexander Kuzmenkov
8ff0083335 performance comparison 2020-02-10 19:34:19 +03:00
Alexander Kuzmenkov
1380bceae2 performance comparison report 2020-02-07 21:37:43 +03:00
Alexander Kuzmenkov
0c5b63aba1
Update entrypoint.sh 2020-02-06 22:26:06 +03:00
Alexander Kuzmenkov
9a2fe8041c performance comparison 2020-02-06 15:57:26 +03:00
Alexander Kuzmenkov
d19addacae performance comparison 2020-02-06 15:47:17 +03:00
Alexander Kuzmenkov
66b66b00db
Use new performance test files for comparison
We're going to change a lot of tests to make them less flappy, so we must have  some way to test them in PRs. A downside is that the new test might have some functions that are not supported by the old version, and the comparison will fail.
2020-02-05 23:06:23 +03:00
Alexander Kuzmenkov
009d3dc78a performance comparison 2020-02-03 20:07:10 +03:00
Alexander Kuzmenkov
bbfce95f40 [wip] performance comparison 2020-02-03 17:20:58 +03:00
Alexander Kuzmenkov
7970067ecf [wip] performance comparison 2020-01-28 21:43:18 +03:00
Alexander Kuzmenkov
62fdc6c879 [wip] performance comparison 2020-01-28 18:13:37 +03:00
Alexander Kuzmenkov
507692fb1c [wip] performance comparison 2020-01-27 15:36:09 +03:00
Alexander Kuzmenkov
c7616ff11a [wip] performance comparison 2020-01-23 20:49:11 +03:00
Alexander Kuzmenkov
754c206203 [wip] performance comparison 2020-01-21 21:15:50 +03:00
Alexander Kuzmenkov
e96021cefe [wip] performance comparison 2020-01-21 16:42:35 +03:00
Alexander Kuzmenkov
7ae38a3400 [wip] performance comparison test 2020-01-16 22:39:07 +03:00
Alexander Kuzmenkov
f81aa1c9f0 [wip] performance comparison test 2020-01-16 17:29:53 +03:00
Alexander Kuzmenkov
d6ce1d7a67 [wip] Performance comparison test. 2020-01-14 22:07:38 +03:00
Alexander Kuzmenkov
9f42674007 Performance comparison improvements 2020-01-10 17:10:00 +03:00
Alexander Kuzmenkov
10ba9d38c0 Revert "Performance comparison improvements."
This reverts commit 52dff20d91.
2020-01-10 17:08:40 +03:00
Alexander Kuzmenkov
52dff20d91 Performance comparison improvements. 2020-01-10 17:08:08 +03:00
Alexander Kuzmenkov
9c8f52c058 Performance comparison improvements. 2020-01-10 17:06:44 +03:00
Alexander Kuzmenkov
b7df029fa6 [wip] performance comparison fixes 2019-12-27 19:05:45 +03:00
Alexander Kuzmenkov
fd3889b817 [wip] perf comparison: docker + some tweaks 2019-12-26 23:51:53 +03:00
Alexander Kuzmenkov
8a3ddb67ef [wip] some experimental scripts for peformance comparison 2019-12-26 20:37:10 +03:00