86 Commits

Author	SHA1	Message	Date
Azat Khuzhin	9cb3c743bd	Convert to python3 (#15007)	2020-10-02 19:54:07 +03:00
Alexander Kuzmenkov	9f63e882c7	fixup	2020-09-30 15:03:52 +03:00
Alexander Kuzmenkov	c2b11221a3	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-23 23:56:15 +03:00
Alexander Kuzmenkov	179807b0b4	performance comparison	2020-09-23 23:45:39 +03:00
Alexander Kuzmenkov	2b6f4134eb	Parallel create/fill in perf test	2020-09-23 11:22:54 +03:00
Alexander Kuzmenkov	5eaa2a08d4	Update report.py	2020-09-23 10:28:28 +03:00
Alexander Kuzmenkov	4937159f85	Merge pull request #14990 from ClickHouse/aku/longer-perf ... If perf test definition changed, run everything + longer (as in master)	2020-09-22 13:25:49 +03:00
Alexander Kuzmenkov	679c5278e4	reword the diagnostic about short queries in perf test	2020-09-21 15:14:47 +03:00
Alexander Kuzmenkov	8995140ffb	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-18 18:06:41 +03:00
Alexander Kuzmenkov	e7b9319e12	If perf test definition changed, run everything + longer (as in master) ... Also some other perf test fixes	2020-09-18 16:28:46 +03:00
Alexander Kuzmenkov	4fc86f05da	some fixes + docs + report queries that are not short	2020-09-17 19:21:59 +03:00
Alexander Kuzmenkov	df95f91d7c	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-15 13:53:50 +03:00
Alexander Kuzmenkov	c701a15271	fixup	2020-09-14 10:27:46 +03:00
Alexander Kuzmenkov	26348ad014	fixup	2020-09-10 18:48:39 +03:00
Alexander Kuzmenkov	a321d6970c	adjust report and increase time	2020-09-03 04:42:25 +03:00
Alexander Kuzmenkov	8e8e195e45	geomean	2020-09-03 03:58:40 +03:00
Alexander Kuzmenkov	0db5b4a72c	Remove concurrent benchmark from the perf test ... It's not stable enough and has only secondary utility.	2020-09-02 02:43:23 +03:00
Alexander Kuzmenkov	a6486490a2	performance comparison	2020-09-01 22:05:57 +03:00
Alexander Kuzmenkov	b601dd4596	cosmetic fixes for performance report	2020-08-29 01:46:04 +03:00
Alexander Kuzmenkov	bb28320107	cosmetic fixes in performance report	2020-08-29 01:14:48 +03:00
Alexander Kuzmenkov	6fdfe65694	performance comparison	2020-08-12 11:55:51 +03:00
Alexander Kuzmenkov	11727864dd	performance comparison	2020-08-07 04:25:45 +03:00
Alexander Kuzmenkov	dbb65a8bd7	performance comparison	2020-08-06 16:28:51 +03:00
Alexander Kuzmenkov	9cac8a7244	performance comparison	2020-08-05 19:07:37 +03:00
Alexander Kuzmenkov	7945041a9a	perf test error summary	2020-08-05 18:56:51 +03:00
Alexander Kuzmenkov	dd475fe82c	Update report.py	2020-08-01 13:10:36 +03:00
Alexander Kuzmenkov	a317f995be	performance comparison	2020-07-31 22:58:38 +03:00
Alexander Kuzmenkov	e2e4fc9848	align numbers to the right in perf report	2020-07-31 13:59:15 +03:00
Alexander Kuzmenkov	db15108005	add times speedup/slowdown to changed tests table	2020-07-31 01:14:20 +03:00
Alexander Kuzmenkov	7d8a31aff3	Merge remote-tracking branch 'origin/master' into HEAD	2020-07-03 10:09:20 +03:00
Alexander Kuzmenkov	b5f9e9de78	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-30 12:28:14 +03:00
Alexander Kuzmenkov	a4152cfb00	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-30 08:55:56 +03:00
Alexander Kuzmenkov	6d67c77e68	fixup	2020-06-29 17:09:51 +03:00
Alexander Kuzmenkov	be57bc56d7	perf test: report queries with new functions separately	2020-06-27 03:45:00 +03:00
Alexander Kuzmenkov	c8b633fe47	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-26 21:01:40 +03:00
Alexander Kuzmenkov	e521d616fe	performance comparison	2020-06-25 23:42:29 +03:00
Alexander Kuzmenkov	bfba15d512	Explicitly mark short perftest queries	2020-06-23 15:09:54 +03:00
Alexander Kuzmenkov	eac6eb8c5a	report	2020-06-22 15:22:09 +03:00
Alexander Kuzmenkov	fbecf42dfc	report the number of errors	2020-06-20 01:41:15 +03:00
Alexander Kuzmenkov	cd769e5ebf	fixup	2020-06-16 11:21:15 +03:00
Alexander Kuzmenkov	7ba5063b7a	Add concurrent benchmark to performance test ... After the main test, run queries from `website.xml` in parallel using `clickhouse-benchmark`. This can be useful to test the effects of concurrency on performance. Comparison test can miss some effects because it always runs queries sequentially, and many of them are even single-threaded.	2020-06-12 00:24:56 +03:00
Alexander Kuzmenkov	1bd375c25e	performance comparison	2020-06-11 00:38:26 +03:00
Alexander Kuzmenkov	5719549ee1	fixup	2020-06-09 16:29:07 +03:00
Alexander Kuzmenkov	e2e5e1d5f8	More stable perf tests	2020-06-08 16:57:33 +03:00
Alexander Kuzmenkov	ca5d7cf5bb	fix some broken performance tests	2020-05-28 10:45:03 +03:00
Alexander Kuzmenkov	3073fc9eb0	performance comparison	2020-05-22 05:51:26 +03:00
Alexander Kuzmenkov	34508b8f64	[wip] Add memory stats to performance test	2020-05-21 05:12:55 +03:00
Alexey Milovidov	4e891091df	Allow expected number of failures in performance test	2020-05-13 06:57:19 +03:00
Alexey Milovidov	ec73ff6151	Do not show unstable queries as error	2020-05-09 18:58:47 +03:00
Alexey Milovidov	2e58cbd1b5	Minor modifications	2020-05-09 18:55:25 +03:00