358 Commits

Author	SHA1	Message	Date
Alexander Kuzmenkov	651518566a	performance comparison	2020-09-24 16:24:44 +03:00
Alexander Kuzmenkov	dee34a834f	debug perf test run time	2020-09-24 14:46:03 +03:00
Alexander Kuzmenkov	26abe8cb30	Update compare.sh	2020-09-24 12:24:30 +03:00
Alexander Kuzmenkov	c2b11221a3	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-23 23:56:15 +03:00
Alexander Kuzmenkov	21f9cc65c9	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-23 23:54:55 +03:00
Alexander Kuzmenkov	179807b0b4	performance comparison	2020-09-23 23:45:39 +03:00
Alexander Kuzmenkov	d96c89972c	Update compare.sh	2020-09-23 12:04:13 +03:00
Alexander Kuzmenkov	bb51aade56	Update docker/test/performance-comparison/compare.sh ... Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>	2020-09-23 12:02:22 +03:00
Alexander Kuzmenkov	833c07f1f7	Update compare.sh	2020-09-23 11:31:18 +03:00
Alexander Kuzmenkov	2b6f4134eb	Parallel create/fill in perf test	2020-09-23 11:22:54 +03:00
Alexander Kuzmenkov	5eaa2a08d4	Update report.py	2020-09-23 10:28:28 +03:00
Alexander Kuzmenkov	0b01e62050	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-22 14:29:54 +03:00
Alexander Kuzmenkov	4937159f85	Merge pull request #14990 from ClickHouse/aku/longer-perf ... If perf test definition changed, run everything + longer (as in master)	2020-09-22 13:25:49 +03:00
Alexander Kuzmenkov	4696e22799	Update perf.py	2020-09-21 22:08:41 +03:00
alexey-milovidov	5e56f14d5f	Merge pull request #15027 from ClickHouse/perf-test-separate-profiler ... Separate profile runs in performance test	2020-09-21 21:07:14 +03:00
Alexander Kuzmenkov	679c5278e4	reword the diagnostic about short queries in perf test	2020-09-21 15:14:47 +03:00
Alexander Kuzmenkov	2f8d7ae208	fix the conditions	2020-09-21 15:01:27 +03:00
Alexander Kuzmenkov	85be1f1685	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-21 14:57:25 +03:00
Alexey Milovidov	ef800b5083	Perf test: development	2020-09-19 21:21:29 +03:00
Alexey Milovidov	35e8a895b6	Calculate profiler data in separate query runs	2020-09-19 20:38:21 +03:00
Alexey Milovidov	03aec83aec	Remove obsolete code from performance test	2020-09-19 19:27:37 +03:00
Alexander Kuzmenkov	8995140ffb	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-18 18:06:41 +03:00
Alexander Kuzmenkov	840586bd98	Merge pull request #14386 from ClickHouse/aku/perf-short ... [wip] an experiment with short queries in perf test	2020-09-18 17:54:50 +03:00
Alexander Kuzmenkov	e7b9319e12	If perf test definition changed, run everything + longer (as in master) ... Also some other perf test fixes	2020-09-18 16:28:46 +03:00
Alexander Kuzmenkov	7f029ee03c	Update perf.py	2020-09-18 11:27:27 +03:00
Alexander Kuzmenkov	4fc86f05da	some fixes + docs + report queries that are not short	2020-09-17 19:21:59 +03:00
Alexander Kuzmenkov	b1d7df80cd	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-17 18:20:14 +03:00
Alexander Kuzmenkov	ada1c7c4a0	fixup	2020-09-17 13:15:46 +03:00
Alexander Kuzmenkov	dda88eebd1	test again	2020-09-16 18:35:27 +03:00
Alexander Kuzmenkov	d55e3cd214	Update perf.py	2020-09-16 14:39:44 +03:00
Alexander Kuzmenkov	3b8ca1f262	Update compare.sh	2020-09-16 12:16:07 +03:00
Alexander Kuzmenkov	c5c5faf8ee	fixup	2020-09-16 12:06:42 +03:00
Alexander Kuzmenkov	e333a7bad4	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-16 12:05:22 +03:00
Alexander Kuzmenkov	df95f91d7c	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-15 13:53:50 +03:00
Alexander Kuzmenkov	24dd33d5cb	Update compare.sh	2020-09-15 13:44:21 +03:00
Alexey Milovidov	b87c108246	Enable remap in performance tests	2020-09-14 21:14:28 +03:00
Alexander Kuzmenkov	ab6bc1ed59	Update compare.sh	2020-09-14 20:25:17 +03:00
Alexander Kuzmenkov	9e3797b252	Merge pull request #14710 from ClickHouse/aku/faster-perf ... Do less runs in perf test	2020-09-14 19:17:34 +03:00
Alexander Kuzmenkov	b3138605c7	performance comparison	2020-09-14 19:16:59 +03:00
Alexander Kuzmenkov	3113aa6cfe	Avoid extra error in perf report on broken queries	2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov	c701a15271	fixup	2020-09-14 10:27:46 +03:00
Alexander Kuzmenkov	8689797efc	Run only some queries in perf tests, not all combos	2020-09-10 19:57:26 +03:00
Alexander Kuzmenkov	26348ad014	fixup	2020-09-10 18:48:39 +03:00
Alexander Kuzmenkov	ca2a33008b	faster	2020-09-10 17:55:54 +03:00
Alexander Kuzmenkov	0904433c87	Temporarily remove UInt256 perf test broken in https://github.com/ClickHouse/ClickHouse/pull/14229 ... Also add one more timeout to perf test runner.	2020-09-07 09:33:57 +03:00
Alexander Kuzmenkov	1978968067	performance comparison	2020-09-07 02:49:34 +03:00
Alexander Kuzmenkov	a321d6970c	adjust report and increase time	2020-09-03 04:42:25 +03:00
Alexander Kuzmenkov	8e8e195e45	geomean	2020-09-03 03:58:40 +03:00
Alexander Kuzmenkov	00c924b0dd	whitespace	2020-09-02 06:31:53 +03:00
Alexander Kuzmenkov	5fcb9bd163	short queries	2020-09-02 06:29:36 +03:00
Alexander Kuzmenkov	e622e108f7	readme	2020-09-02 06:29:16 +03:00
Alexander Kuzmenkov	0db5b4a72c	Remove concurrent benchmark from the perf test ... It's not stable enough and has only secondary utility.	2020-09-02 02:43:23 +03:00
Alexander Kuzmenkov	a6486490a2	performance comparison	2020-09-01 22:05:57 +03:00
Alexander Kuzmenkov	b601dd4596	cosmetic fixes for performance report	2020-08-29 01:46:04 +03:00
Alexander Kuzmenkov	bb28320107	cosmetic fixes in performance report	2020-08-29 01:14:48 +03:00
alexey-milovidov	5d31442fa8	Delete perf.py.orig	2020-08-26 03:26:54 +03:00
Alexander Kuzmenkov	a348bc4641	performance comparison	2020-08-24 17:15:11 +03:00
Alexander Kuzmenkov	f43457454e	warn on undefined shell variables	2020-08-19 18:34:23 +03:00
Alexander Kuzmenkov	e9ad81b362	shellcheck	2020-08-19 18:31:13 +03:00
Alexander Kuzmenkov	000326b627	Avoid timeouts in perf test	2020-08-19 18:08:23 +03:00
Alexander Kuzmenkov	6fdfe65694	performance comparison	2020-08-12 11:55:51 +03:00
Alexander Kuzmenkov	89b712a180	performance comparison	2020-08-12 08:40:03 +03:00
Alexander Kuzmenkov	7547b850d6	performance comparison	2020-08-11 17:14:24 +03:00
Alexander Kuzmenkov	5a97f0c19e	performance comparison	2020-08-11 14:53:25 +03:00
Alexander Kuzmenkov	11727864dd	performance comparison	2020-08-07 04:25:45 +03:00
Alexander Kuzmenkov	dbb65a8bd7	performance comparison	2020-08-06 16:28:51 +03:00
Alexander Kuzmenkov	a92438eff2	performance comparison	2020-08-06 02:33:32 +03:00
Alexander Kuzmenkov	88aa371e0c	performance comparison	2020-08-06 02:02:52 +03:00
Alexander Kuzmenkov	d1554e76ec	Merge remote-tracking branch 'origin/master' into HEAD	2020-08-06 00:59:25 +03:00
Alexander Kuzmenkov	ff3f378e8a	try to rebuild package for 2b7c0167cb	2020-08-06 00:58:56 +03:00
Alexander Kuzmenkov	9cac8a7244	performance comparison	2020-08-05 19:07:37 +03:00
Alexander Kuzmenkov	7945041a9a	perf test error summary	2020-08-05 18:56:51 +03:00
alexey-milovidov	935533e841	Merge pull request #13193 from ClickHouse/aku/spurious-perf ... Fix some spurious perf test failures	2020-08-03 01:02:53 +03:00
Alexander Kuzmenkov	dd475fe82c	Update report.py	2020-08-01 13:10:36 +03:00
Alexander Kuzmenkov	a317f995be	performance comparison	2020-07-31 22:58:38 +03:00
Alexander Kuzmenkov	1d954581eb	Fix some spurious perf test failures	2020-07-31 19:28:04 +03:00
Alexander Kuzmenkov	e2e4fc9848	align numbers to the right in perf report	2020-07-31 13:59:15 +03:00
Alexander Kuzmenkov	42e5f8ec44	Update compare.sh	2020-07-31 03:49:36 +03:00
Alexander Kuzmenkov	db15108005	add times speedup/slowdown to changed tests table	2020-07-31 01:14:20 +03:00
Alexander Kuzmenkov	0e20507539	Update compare.sh	2020-07-30 17:26:47 +03:00
Alexander Kuzmenkov	e0c207d6b4	Update entrypoint.sh	2020-07-28 16:15:41 +03:00
Alexander Kuzmenkov	b6f2fde37e	performance comparison	2020-07-27 14:20:45 +03:00
Alexander Kuzmenkov	acf1e5fe7e	Choose proper old version for perf comparison	2020-07-23 18:17:11 +03:00
Alexander Kuzmenkov	15cd448afa	Update compare.sh	2020-07-23 17:59:32 +03:00
Alexander Kuzmenkov	186b2c3b1b	Support different query log format in perf test	2020-07-23 16:32:03 +03:00
Alexander Kuzmenkov	2b7c0167cb	Update compare.sh	2020-07-22 21:02:56 +03:00
Alexander Kuzmenkov	72167aa746	Update Dockerfile	2020-07-22 16:18:57 +03:00
Alexander Kuzmenkov	9f49bf2d82	fixup	2020-07-22 01:09:54 +03:00
Alexander Kuzmenkov	3d89f0e9df	Perf test: bind server to one NUMA node	2020-07-21 15:41:14 +03:00
Alexander Kuzmenkov	00acf4173c	Fixes for perf test after #12469	2020-07-15 16:38:02 +03:00
Alexander Kuzmenkov	57ad000c62	Update README.md	2020-07-14 16:46:19 +03:00
Alexander Kuzmenkov	5a15e03400	Improve data layout in perf test ... Also fix a bad test query found with new data.	2020-07-13 14:31:15 +03:00
Alexander Kuzmenkov	394cf20673	Merge remote-tracking branch 'origin/master' into HEAD	2020-07-09 13:46:54 +03:00
Alexander Kuzmenkov	cec35a0e1d	Update README.md	2020-07-08 15:07:01 +03:00
Alexander Kuzmenkov	c9162f6e77	Update README.md	2020-07-08 15:05:49 +03:00
Alexander Kuzmenkov	344e2713fa	Update README.md	2020-07-08 14:52:06 +03:00
Alexander Kuzmenkov	bd14d06476	Update README.md	2020-07-08 14:25:43 +03:00
Alexander Kuzmenkov	f514d0da77	Revert "Run perf tests with memory sampling (for allocations >1M)"	2020-07-07 19:59:42 +03:00
Azat Khuzhin	307c3c92a5	Run perf tests with memory sampling (for allocations >1M) ... This is to know the memory allocation size distribution, that can be obtained later from left-metric-log.tsv. This is an attempt to tune tcmalloc (new CPP version by google) to use lock-free part of the allocator for typical allocations (and it is a bad idea just to increase kMaxSize there, since number of allocation for each size class is also important). P.S. hope that this file will be applied, if no, then the same effect can be reached by tunning defaults in Settings.h Refs: #11590 Cc: @akuzm	2020-07-05 12:43:12 +03:00
Alexander Kuzmenkov	10b6f98ca6	fixup	2020-07-03 11:39:43 +03:00