Commit Graph

271 Commits

Author SHA1 Message Date
Alexander Kuzmenkov
26abe8cb30
Update compare.sh 2020-09-24 12:24:30 +03:00
Alexander Kuzmenkov
d96c89972c
Update compare.sh 2020-09-23 12:04:13 +03:00
Alexander Kuzmenkov
bb51aade56
Update docker/test/performance-comparison/compare.sh
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2020-09-23 12:02:22 +03:00
Alexander Kuzmenkov
833c07f1f7
Update compare.sh 2020-09-23 11:31:18 +03:00
Alexander Kuzmenkov
2b6f4134eb Parallel create/fill in perf test 2020-09-23 11:22:54 +03:00
Alexander Kuzmenkov
0b01e62050 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-22 14:29:54 +03:00
Alexander Kuzmenkov
4937159f85
Merge pull request #14990 from ClickHouse/aku/longer-perf
If perf test definition changed, run everything + longer (as in master)
2020-09-22 13:25:49 +03:00
Alexander Kuzmenkov
679c5278e4 reword the diagnostic about short queries in perf test 2020-09-21 15:14:47 +03:00
Alexander Kuzmenkov
2f8d7ae208 fix the conditions 2020-09-21 15:01:27 +03:00
Alexander Kuzmenkov
8995140ffb Merge remote-tracking branch 'origin/master' into HEAD 2020-09-18 18:06:41 +03:00
Alexander Kuzmenkov
840586bd98
Merge pull request #14386 from ClickHouse/aku/perf-short
[wip] an experiment with short queries in perf test
2020-09-18 17:54:50 +03:00
Alexander Kuzmenkov
e7b9319e12 If perf test definition changed, run everything + longer (as in master)
Also some other perf test fixes
2020-09-18 16:28:46 +03:00
Alexander Kuzmenkov
4fc86f05da some fixes + docs + report queries that are not short 2020-09-17 19:21:59 +03:00
Alexander Kuzmenkov
dda88eebd1
test again 2020-09-16 18:35:27 +03:00
Alexander Kuzmenkov
3b8ca1f262
Update compare.sh 2020-09-16 12:16:07 +03:00
Alexander Kuzmenkov
c5c5faf8ee fixup 2020-09-16 12:06:42 +03:00
Alexander Kuzmenkov
e333a7bad4 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-16 12:05:22 +03:00
Alexander Kuzmenkov
df95f91d7c Merge remote-tracking branch 'origin/master' into HEAD 2020-09-15 13:53:50 +03:00
Alexander Kuzmenkov
24dd33d5cb
Update compare.sh 2020-09-15 13:44:21 +03:00
Alexander Kuzmenkov
ab6bc1ed59
Update compare.sh 2020-09-14 20:25:17 +03:00
Alexander Kuzmenkov
b3138605c7 performance comparison 2020-09-14 19:16:59 +03:00
Alexander Kuzmenkov
3113aa6cfe Avoid extra error in perf report on broken queries 2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov
8689797efc Run only some queries in perf tests, not all combos 2020-09-10 19:57:26 +03:00
Alexander Kuzmenkov
1978968067 performance comparison 2020-09-07 02:49:34 +03:00
Alexander Kuzmenkov
a321d6970c adjust report and increase time 2020-09-03 04:42:25 +03:00
Alexander Kuzmenkov
8e8e195e45 geomean 2020-09-03 03:58:40 +03:00
Alexander Kuzmenkov
00c924b0dd whitespace 2020-09-02 06:31:53 +03:00
Alexander Kuzmenkov
0db5b4a72c Remove concurrent benchmark from the perf test
It's not stable enough and has only secondary utility.
2020-09-02 02:43:23 +03:00
Alexander Kuzmenkov
a6486490a2 performance comparison 2020-09-01 22:05:57 +03:00
Alexander Kuzmenkov
a348bc4641 performance comparison 2020-08-24 17:15:11 +03:00
Alexander Kuzmenkov
f43457454e warn on undefined shell variables 2020-08-19 18:34:23 +03:00
Alexander Kuzmenkov
e9ad81b362 shellcheck 2020-08-19 18:31:13 +03:00
Alexander Kuzmenkov
000326b627 Avoid timeouts in perf test 2020-08-19 18:08:23 +03:00
Alexander Kuzmenkov
5a97f0c19e performance comparison 2020-08-11 14:53:25 +03:00
Alexander Kuzmenkov
88aa371e0c performance comparison 2020-08-06 02:02:52 +03:00
Alexander Kuzmenkov
d1554e76ec Merge remote-tracking branch 'origin/master' into HEAD 2020-08-06 00:59:25 +03:00
Alexander Kuzmenkov
ff3f378e8a try to rebuild package for 2b7c0167cb 2020-08-06 00:58:56 +03:00
alexey-milovidov
935533e841
Merge pull request #13193 from ClickHouse/aku/spurious-perf
Fix some spurious perf test failures
2020-08-03 01:02:53 +03:00
Alexander Kuzmenkov
a317f995be performance comparison 2020-07-31 22:58:38 +03:00
Alexander Kuzmenkov
1d954581eb Fix some spurious perf test failures 2020-07-31 19:28:04 +03:00
Alexander Kuzmenkov
42e5f8ec44
Update compare.sh 2020-07-31 03:49:36 +03:00
Alexander Kuzmenkov
db15108005 add times speedup/slowdown to changed tests table 2020-07-31 01:14:20 +03:00
Alexander Kuzmenkov
0e20507539
Update compare.sh 2020-07-30 17:26:47 +03:00
Alexander Kuzmenkov
15cd448afa
Update compare.sh 2020-07-23 17:59:32 +03:00
Alexander Kuzmenkov
186b2c3b1b Support different query log format in perf test 2020-07-23 16:32:03 +03:00
Alexander Kuzmenkov
2b7c0167cb
Update compare.sh 2020-07-22 21:02:56 +03:00
Alexander Kuzmenkov
3d89f0e9df Perf test: bind server to one NUMA node 2020-07-21 15:41:14 +03:00
Alexander Kuzmenkov
00acf4173c Fixes for perf test after #12469 2020-07-15 16:38:02 +03:00
Alexander Kuzmenkov
5a15e03400 Improve data layout in perf test
Also fix a bad test query found with new data.
2020-07-13 14:31:15 +03:00
Alexander Kuzmenkov
10b6f98ca6 fixup 2020-07-03 11:39:43 +03:00
Alexander Kuzmenkov
7d8a31aff3 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-03 10:09:20 +03:00
Alexander Kuzmenkov
99514a7e24 fixup 2020-07-02 10:13:02 +03:00
Alexander Kuzmenkov
b5f9e9de78 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-30 12:28:14 +03:00
Alexander Kuzmenkov
a4152cfb00 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-30 08:55:56 +03:00
Alexander Kuzmenkov
1b49feae6b Fixup 2020-06-29 11:29:40 +03:00
Alexander Kuzmenkov
960c455e0e performance comparison 2020-06-27 04:15:58 +03:00
Alexander Kuzmenkov
7e88cc15f1 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-27 04:00:26 +03:00
Alexander Kuzmenkov
459ebf1ea0 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-27 03:59:36 +03:00
Alexander Kuzmenkov
e0c4cc9135 performance comparison 2020-06-27 03:53:54 +03:00
Alexander Kuzmenkov
be57bc56d7 perf test: report queries with new functions separately 2020-06-27 03:45:00 +03:00
Alexander Kuzmenkov
c8b633fe47 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-26 21:01:40 +03:00
Alexander Kuzmenkov
e521d616fe performance comparison 2020-06-25 23:42:29 +03:00
Alexander Kuzmenkov
ab809f59b9 memory usage settings 2020-06-23 15:30:45 +03:00
Alexander Kuzmenkov
bfba15d512 Explicitly mark short perftest queries 2020-06-23 15:09:54 +03:00
Alexander Kuzmenkov
cec65ce30d Merge remote-tracking branch 'origin/master' into HEAD 2020-06-19 22:34:50 +03:00
Alexander Tokmakov
73af3befe6 Revert "specify path in config" 2020-06-19 01:45:45 +03:00
Alexander Tokmakov
53b9f15f53 fix 2020-06-18 13:20:01 +03:00
Alexander Tokmakov
50b4671867 specify path in config 2020-06-16 21:29:55 +03:00
Alexander Tokmakov
1e50bae76e override user_files_path 2020-06-16 18:13:28 +03:00
Alexander Kuzmenkov
cd769e5ebf fixup 2020-06-16 11:21:15 +03:00
Alexander Kuzmenkov
56869228a2 add flag to continue on errors 2020-06-12 21:28:07 +03:00
Alexander Kuzmenkov
5101708831 fixup 2020-06-12 18:11:33 +03:00
Alexander Kuzmenkov
0da6e1c9de typo 2020-06-12 15:12:12 +03:00
Alexander Kuzmenkov
7ba5063b7a Add concurrent benchmark to performance test
After the main test, run queries from `website.xml` in parallel using
`clickhouse-benchmark`. This can be useful to test the effects of
concurrency on performance. Comparison test can miss some effects
because it always runs queries sequentially, and many of them are even
single-threaded.
2020-06-12 00:24:56 +03:00
Alexander Kuzmenkov
7b54ff02f0 Collect async metric log in perf test 2020-06-10 22:27:05 +03:00
Alexander Kuzmenkov
af1c8f8a5f fixup 2020-06-10 02:57:31 +03:00
Alexander Kuzmenkov
5719549ee1 fixup 2020-06-09 16:29:07 +03:00
Alexander Kuzmenkov
6a3df071a2 fixup 2020-06-09 01:13:08 +03:00
Alexander Kuzmenkov
e2e5e1d5f8 More stable perf tests 2020-06-08 16:57:33 +03:00
Alexander Kuzmenkov
29adb1cbcf performance comparison 2020-06-05 17:30:26 +03:00
Alexander Kuzmenkov
ca5d7cf5bb fix some broken performance tests 2020-05-28 10:45:03 +03:00
Alexander Kuzmenkov
bf3f76be7f performance comparison 2020-05-25 04:42:56 +03:00
Alexander Kuzmenkov
5a9f47e6b0 performance comparison 2020-05-25 04:03:46 +03:00
Alexander Kuzmenkov
51a064aa75 performance comparison 2020-05-22 23:09:44 +03:00
Alexander Kuzmenkov
7b747fabe2 performance comparison 2020-05-22 02:04:04 +03:00
Alexander Kuzmenkov
34508b8f64 [wip] Add memory stats to performance test 2020-05-21 05:12:55 +03:00
Alexander Kuzmenkov
ef6f386ee6
Merge pull request #11026 from ClickHouse/aku/trace-log
Add more logs to debug trace_log overflow
2020-05-19 17:56:06 +03:00
Alexander Kuzmenkov
a700b527ce fixup 2020-05-19 17:51:51 +03:00
Alexander Kuzmenkov
c34ea27362 performance comparison 2020-05-19 00:15:33 +03:00
Alexander Kuzmenkov
a54773f947 Add more logs to debug trace_log overflow 2020-05-18 22:33:12 +03:00
Alexander Kuzmenkov
bb726b2d8d
Update compare.sh 2020-05-14 13:54:07 +03:00
Alexander Kuzmenkov
5aadd628f1 performance comparison 2020-04-30 11:36:51 +03:00
Alexander Kuzmenkov
d952e5aba2 performance comparison 2020-04-29 20:26:28 +03:00
Alexander Kuzmenkov
095ef4b32c performance comparison 2020-04-29 19:28:00 +03:00
Alexander Kuzmenkov
884db5c12e performance comparison 2020-04-29 12:47:17 +03:00
Alexander Kuzmenkov
cf63174139 performance comparison 2020-04-28 17:27:24 +03:00
Alexander Kuzmenkov
ed1576507b performance comparison 2020-04-28 10:45:56 +03:00
Alexander Kuzmenkov
9480210236 performance comparison 2020-04-27 15:48:17 +03:00
tavplubix
7928f2eaa1
Merge pull request #7512 from ClickHouse/database_atomic
DatabaseAtomic
2020-04-24 22:28:18 +03:00
Alexander Kuzmenkov
93e49ae10f performance comparison 2020-04-24 10:19:50 +03:00
Alexander Kuzmenkov
79c5b7cc9f performance comparison 2020-04-24 06:23:38 +03:00
Alexander Kuzmenkov
1bf02d459c performance comparison 2020-04-23 23:19:04 +03:00
Alexander Tokmakov
04d6b59ac0 Merge branch 'master' into database_atomic 2020-04-23 17:31:37 +03:00
Alexander Kuzmenkov
d99f516fa6 performance comparison 2020-04-23 11:44:49 +03:00
Alexander Kuzmenkov
631c810500 performance comparison 2020-04-22 22:42:00 +03:00
Alexander Tokmakov
fefbbd37df Merge branch 'master' into database_atomic 2020-04-22 17:02:30 +03:00
Alexander Kuzmenkov
3b1334ee1b performance comparison 2020-04-22 16:11:46 +03:00
Alexander Kuzmenkov
627dfe103f performance comparison 2020-04-22 04:50:21 +03:00
Alexander Kuzmenkov
1c997dcb7c performance comparison 2020-04-22 01:08:24 +03:00
Alexander Kuzmenkov
f2290bf2ee performance comparison 2020-04-21 21:46:45 +03:00
Alexander Tokmakov
b29bddac12 Merge branch 'master' into database_atomic 2020-04-20 14:09:09 +03:00
Alexander Kuzmenkov
41473d090d performance comparison 2020-04-17 18:47:01 +03:00
Alexander Kuzmenkov
e59aaa88f8
Update compare.sh 2020-04-17 16:32:59 +03:00
Alexander Kuzmenkov
def6817ede
Update compare.sh 2020-04-13 22:06:07 +03:00
Alexander Tokmakov
d1024e76bd fix 2020-04-13 18:46:36 +03:00
Alexander Kuzmenkov
aadb05cbe3
performance comparison 2020-04-07 20:55:39 +03:00
Alexander Kuzmenkov
2e804173a9 performance comparison 2020-04-07 03:29:44 +03:00
Alexander Kuzmenkov
9465f97832 performance comparison 2020-04-03 21:23:11 +03:00
Alexander Kuzmenkov
882e0d8b4e
Update compare.sh 2020-04-03 13:00:23 +03:00
Alexander Kuzmenkov
cd88b5380c Performance comparison fixes 2020-04-02 21:44:58 +03:00
Alexander Kuzmenkov
f576cab761 performance comparison 2020-03-26 03:09:43 +03:00
Alexander Kuzmenkov
5fd5b15c36 performance comparison 2020-03-24 20:33:42 +03:00
Alexander Kuzmenkov
d396a7c650 Some tweaks for performance comparison 2020-03-23 12:39:12 +03:00
Alexander Kuzmenkov
56c4b49844 performance comparison 2020-03-18 04:29:32 +03:00
Alexander Kuzmenkov
f4ea37fa3b peformance comparison 2020-03-17 19:37:26 +03:00
Alexander Kuzmenkov
f6d745de7f performance comparison 2020-03-17 05:42:13 +03:00
alexey-milovidov
930f2bae54
Merge pull request #9611 from ClickHouse/aku/fix-some-perf-tests
Fix some performance tests
2020-03-13 22:30:26 +03:00
Alexander Kuzmenkov
7e6585328f fixup 2020-03-13 16:30:54 +03:00
Alexander Kuzmenkov
e8f9e4d5fd performance comparison 2020-03-12 19:21:58 +03:00
Alexander Kuzmenkov
553e5a8867 performance comparison 2020-03-12 17:24:18 +03:00
Alexander Kuzmenkov
a89ccd5eb7 performance comparison 2020-03-12 17:17:24 +03:00
Alexander Kuzmenkov
ca1dd5a357 performance comparison 2020-03-12 15:51:09 +03:00
Alexander Kuzmenkov
662ce64c99 performance comparison 2020-03-03 13:47:57 +03:00
Alexander Kuzmenkov
ac7860dc49 performance comparison 2020-03-02 21:47:59 +03:00
Alexander Kuzmenkov
35dc08ccda performance comparison 2020-03-02 20:06:14 +03:00
Alexander Kuzmenkov
de407f17cb performance comparison 2020-03-02 18:55:28 +03:00
Alexander Kuzmenkov
657d96d283 performance comparison 2020-03-02 18:06:09 +03:00
Alexander Kuzmenkov
4407d203d5 performance comparison 2020-02-28 23:40:26 +03:00
Alexander Kuzmenkov
be221a2f1a perf comparison -- more filtering 2020-02-28 23:00:28 +03:00
Alexander Kuzmenkov
8f5ad14cc5 performance comparison - 7 runs 2020-02-28 20:08:51 +03:00
Alexander Kuzmenkov
1c2fe333d2 performance comparison 2020-02-28 19:22:33 +03:00
Alexander Kuzmenkov
01c36f8b33 Fix shellcheck warnings. 2020-02-27 23:56:32 +03:00
Alexander Kuzmenkov
aab320d656 performance comparison 2020-02-27 22:44:03 +03:00
Alexander Kuzmenkov
90ee601eb0 performance comparison 2020-02-27 20:57:27 +03:00
Alexander Kuzmenkov
ea67cba608 performance comparison 2020-02-25 22:51:27 +03:00
Alexander Kuzmenkov
8d46eb6ecc
Update compare.sh 2020-02-25 15:18:50 +03:00
Alexander Kuzmenkov
0a83353068
Update compare.sh 2020-02-22 20:52:49 +03:00
Alexander Kuzmenkov
eabfdf4ce0
Update compare.sh 2020-02-22 15:02:45 +03:00
Alexander Kuzmenkov
49c68012bf performance comparison 2020-02-21 23:00:44 +03:00
Alexander Kuzmenkov
3ae2282209 performance comparison 2020-02-20 19:33:19 +03:00