106 Commits

Author	SHA1	Message	Date
Robert Schulze	40ced78a7e	Update report.py	2023-01-22 20:01:55 +01:00
Robert Schulze	de8fc04b03	Performance report: "Partial queries" --> "Backward-incompatible queries	2023-01-22 17:43:27 +00:00
Alexey Milovidov	0349d9da96	Change font in CI reports just in case (might be worse)	2022-08-08 07:25:29 +02:00
Mikhail f. Shiryaev	37533eb14b	Improve comment FIXME for errors report	2022-05-04 16:56:43 +02:00
Mikhail f. Shiryaev	2b67208dea	Ignore slow query as errors in performance tests report	2022-05-04 13:02:48 +02:00
Alexey Milovidov	2d7d67e7bc	Remove special handling of "short" queries - the logic is too ad-hoc, it pollutes the code and is difficult to handle	2022-04-29 04:27:57 +02:00
Mikhail f. Shiryaev	e6f5a3f98b	Apply black formatter to all *.py files in the repo	2022-03-22 17:39:58 +01:00
alexey-milovidov	e8b29cab6e	Update report.py	2021-11-25 15:37:00 +03:00
Raúl Marín	a6c34fdbc9	Improve how queries are output in the performance dashboard	2021-11-25 11:22:47 +01:00
Alexey Milovidov	ebc2fbfd63	Performance test: be more generous	2021-06-27 03:14:42 +03:00
Alexey Milovidov	779f5eca94	Relax max test time for performance test; fix comment	2021-06-16 11:26:00 +03:00
Alexander Kuzmenkov	1c5e069d0d	fixes	2021-06-04 18:27:21 +03:00
Alexander Kuzmenkov	5da54c2745	calculate perf test precision thresholds from historical data	2021-05-26 16:30:43 +03:00
Alexander Kuzmenkov	a1749cf5c3	fix	2021-05-20 15:05:20 +03:00
Alexander Kuzmenkov	15564f32b2	Merge remote-tracking branch 'origin/master' into HEAD	2021-05-14 13:16:31 +03:00
Alexander Kuzmenkov	3aa919b498	fixes	2021-05-13 12:16:43 +03:00
Alexander Kuzmenkov	d7b726045a	fixes	2021-05-13 01:32:53 +03:00
Alexander Kuzmenkov	8629b29083	complain about unstable perf test queries ... We don't want to introduce more of them. The old ones should be all marked by now.	2021-05-12 12:48:13 +03:00
Alexander Kuzmenkov	e51c844e2c	add more info to perf test report	2021-04-23 16:47:33 +03:00
Alexander Kuzmenkov	abcb3c2ff9	Update report.py	2020-10-20 20:06:51 +03:00
Azat Khuzhin	9cb3c743bd	Convert to python3 (#15007)	2020-10-02 19:54:07 +03:00
Alexander Kuzmenkov	9f63e882c7	fixup	2020-09-30 15:03:52 +03:00
Alexander Kuzmenkov	c2b11221a3	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-23 23:56:15 +03:00
Alexander Kuzmenkov	179807b0b4	performance comparison	2020-09-23 23:45:39 +03:00
Alexander Kuzmenkov	2b6f4134eb	Parallel create/fill in perf test	2020-09-23 11:22:54 +03:00
Alexander Kuzmenkov	5eaa2a08d4	Update report.py	2020-09-23 10:28:28 +03:00
Alexander Kuzmenkov	4937159f85	Merge pull request #14990 from ClickHouse/aku/longer-perf ... If perf test definition changed, run everything + longer (as in master)	2020-09-22 13:25:49 +03:00
Alexander Kuzmenkov	679c5278e4	reword the diagnostic about short queries in perf test	2020-09-21 15:14:47 +03:00
Alexander Kuzmenkov	8995140ffb	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-18 18:06:41 +03:00
Alexander Kuzmenkov	e7b9319e12	If perf test definition changed, run everything + longer (as in master) ... Also some other perf test fixes	2020-09-18 16:28:46 +03:00
Alexander Kuzmenkov	4fc86f05da	some fixes + docs + report queries that are not short	2020-09-17 19:21:59 +03:00
Alexander Kuzmenkov	df95f91d7c	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-15 13:53:50 +03:00
Alexander Kuzmenkov	c701a15271	fixup	2020-09-14 10:27:46 +03:00
Alexander Kuzmenkov	26348ad014	fixup	2020-09-10 18:48:39 +03:00
Alexander Kuzmenkov	a321d6970c	adjust report and increase time	2020-09-03 04:42:25 +03:00
Alexander Kuzmenkov	8e8e195e45	geomean	2020-09-03 03:58:40 +03:00
Alexander Kuzmenkov	0db5b4a72c	Remove concurrent benchmark from the perf test ... It's not stable enough and has only secondary utility.	2020-09-02 02:43:23 +03:00
Alexander Kuzmenkov	a6486490a2	performance comparison	2020-09-01 22:05:57 +03:00
Alexander Kuzmenkov	b601dd4596	cosmetic fixes for performance report	2020-08-29 01:46:04 +03:00
Alexander Kuzmenkov	bb28320107	cosmetic fixes in performance report	2020-08-29 01:14:48 +03:00
Alexander Kuzmenkov	6fdfe65694	performance comparison	2020-08-12 11:55:51 +03:00
Alexander Kuzmenkov	11727864dd	performance comparison	2020-08-07 04:25:45 +03:00
Alexander Kuzmenkov	dbb65a8bd7	performance comparison	2020-08-06 16:28:51 +03:00
Alexander Kuzmenkov	9cac8a7244	performance comparison	2020-08-05 19:07:37 +03:00
Alexander Kuzmenkov	7945041a9a	perf test error summary	2020-08-05 18:56:51 +03:00
Alexander Kuzmenkov	dd475fe82c	Update report.py	2020-08-01 13:10:36 +03:00
Alexander Kuzmenkov	a317f995be	performance comparison	2020-07-31 22:58:38 +03:00
Alexander Kuzmenkov	e2e4fc9848	align numbers to the right in perf report	2020-07-31 13:59:15 +03:00
Alexander Kuzmenkov	db15108005	add times speedup/slowdown to changed tests table	2020-07-31 01:14:20 +03:00
Alexander Kuzmenkov	7d8a31aff3	Merge remote-tracking branch 'origin/master' into HEAD	2020-07-03 10:09:20 +03:00