407 Commits

Author	SHA1	Message	Date
Azat Khuzhin	04a93f18e8	perf: fail on unknown settings	2020-11-27 00:16:41 +03:00
Azat Khuzhin	a591886740	perf: remove outdated comments from perf.py ... Refs: https://github.com/ClickHouse/ClickHouse/pull/17255#discussion_r528822709	2020-11-27 00:16:41 +03:00
Azat Khuzhin	a38628d967	perf: use the latest available clickhouse-driver (from git) ... Since later setting_is_important will be used, but there is no release with this feature included.	2020-11-27 00:16:41 +03:00
myrrc	fbb0e6e6aa	Merge remote-tracking branch 'upstream/master' into improvement/diff-types-in-avg-weighted	2020-11-24 16:04:17 +03:00
Alexander Kuzmenkov	a543c8e468	Add an option to use existing tables to perf.py	2020-11-23 21:05:54 +03:00
Azat Khuzhin	d676e2f5c5	Pass settings for perf tests via protocol over SET query ... Thus they will be applied on reconnects, since clickhouse-driver may implicitly do it if the connection has been failed.	2020-11-21 14:02:33 +03:00
Azat Khuzhin	3ddb0ac53e	Configure logging for perf test runner	2020-11-21 14:02:33 +03:00
Azat Khuzhin	f6d16ee43e	Force clickhouse-driver >= 1.1.5 for settings-as-strings support for perf-tests image	2020-11-21 14:02:33 +03:00
Alexander Kuzmenkov	b0e660651a	cleanup	2020-11-16 19:09:58 +03:00
Alexander Kuzmenkov	030419db90	Try 12 threads max in perf test. ... This will allow us to use more machines, not only Gold 6320.	2020-11-09 19:14:05 +03:00
Alexander Kuzmenkov	dc665d7c43	Update compare.sh	2020-11-06 13:45:42 +03:00
Alexander Kuzmenkov	ac487ab26a	Update compare.sh	2020-11-05 23:45:58 +03:00
Alexander Kuzmenkov	8d5fe1148c	add client config	2020-11-04 18:07:34 +03:00
Alexander Kuzmenkov	5cb708a50a	fixup	2020-11-04 04:19:53 +03:00
Alexander Kuzmenkov	4245c470ac	fixes	2020-11-03 17:37:54 +03:00
Alexander Kuzmenkov	a25996ed8d	Upload perf test results to the CI database	2020-11-03 02:10:19 +03:00
Mikhail Filimonov	41971e073a	Fix typos reported by codespell	2020-10-27 12:04:03 +01:00
Alexander Kuzmenkov	e27dd538fd	performance comparison	2020-10-26 19:35:37 +03:00
Alexander Kuzmenkov	0275e9c010	work around docker weirdness	2020-10-22 19:42:31 +03:00
Alexander Kuzmenkov	ac7af67ede	fixup	2020-10-22 15:52:43 +03:00
Alexander Kuzmenkov	6293d1dbbe	Merge remote-tracking branch 'origin/master' into HEAD	2020-10-21 18:39:59 +03:00
Alexander Kuzmenkov	a678f03229	fixup	2020-10-21 18:21:54 +03:00
Alexander Kuzmenkov	c10dada3d4	try node 1	2020-10-21 18:06:42 +03:00
Alexander Kuzmenkov	abcb3c2ff9	Update report.py	2020-10-20 20:06:51 +03:00
Alexander Kuzmenkov	6b0225ab8c	Update README.md	2020-10-20 19:52:37 +03:00
Alexander Kuzmenkov	242ec7e56c	make some tests faster	2020-10-20 15:12:06 +03:00
Alexander Kuzmenkov	764f19820b	max threads	2020-10-19 17:39:52 +03:00
Alexander Kuzmenkov	38a2dd55ce	fix numactl parameters	2020-10-19 17:31:02 +03:00
Alexander Kuzmenkov	2241ea9f33	not sure what's going on...	2020-10-16 17:44:59 +03:00
Alexander Kuzmenkov	0825b8f4c2	Merge remote-tracking branch 'origin/master' into HEAD	2020-10-16 17:41:40 +03:00
Azat Khuzhin	9cb3c743bd	Convert to python3 (#15007)	2020-10-02 19:54:07 +03:00
Alexander Kuzmenkov	13c325597a	Merge remote-tracking branch 'origin/master' into HEAD	2020-10-01 13:57:04 +03:00
Alexander Kuzmenkov	74f8e41b55	calculate on all nodes	2020-10-01 13:56:56 +03:00
Alexander Kuzmenkov	499e0766e5	Check docker scripts with shellcheck	2020-09-30 20:06:46 +03:00
Alexander Kuzmenkov	aa543a2d3d	quotes	2020-09-30 17:40:24 +03:00
Alexander Kuzmenkov	9f63e882c7	fixup	2020-09-30 15:03:52 +03:00
Alexander Kuzmenkov	1617442242	fixup	2020-09-30 14:55:24 +03:00
Alexander Kuzmenkov	824d5b093c	bind everything to node 0	2020-09-30 14:32:49 +03:00
Alexander Kuzmenkov	b1abed7d37	Merge remote-tracking branch 'origin/aku/debug-perf' into HEAD	2020-09-30 14:22:20 +03:00
Alexander Kuzmenkov	f8047102fe	fixup	2020-09-29 22:06:45 +03:00
Alexander Kuzmenkov	dc15bceadc	Merge remote-tracking branch 'origin/aku/debug-perf' into HEAD	2020-09-29 16:41:38 +03:00
Alexander Kuzmenkov	ac4f0cdf22	fix	2020-09-29 14:07:31 +03:00
Alexander Kuzmenkov	6671b26f20	fixes	2020-09-28 21:43:47 +03:00
Alexander Kuzmenkov	3d1456a55d	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-28 21:19:53 +03:00
Alexander Kuzmenkov	c48d212320	performance comparison	2020-09-28 15:09:08 +03:00
Alexander Kuzmenkov	1e7a0f0e5f	typo	2020-09-28 14:44:49 +03:00
Alexander Kuzmenkov	425150e783	bind to different nodes	2020-09-25 13:19:37 +03:00
Alexander Kuzmenkov	3ff16325d8	fix the profiler	2020-09-25 12:52:09 +03:00
Alexander Kuzmenkov	40209f9ed2	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-25 11:28:47 +03:00
Alexander Kuzmenkov	651518566a	performance comparison	2020-09-24 16:24:44 +03:00
Alexander Kuzmenkov	dee34a834f	debug perf test run time	2020-09-24 14:46:03 +03:00
Alexander Kuzmenkov	26abe8cb30	Update compare.sh	2020-09-24 12:24:30 +03:00
Alexander Kuzmenkov	c2b11221a3	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-23 23:56:15 +03:00
Alexander Kuzmenkov	21f9cc65c9	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-23 23:54:55 +03:00
Alexander Kuzmenkov	179807b0b4	performance comparison	2020-09-23 23:45:39 +03:00
Alexander Kuzmenkov	d96c89972c	Update compare.sh	2020-09-23 12:04:13 +03:00
Alexander Kuzmenkov	bb51aade56	Update docker/test/performance-comparison/compare.sh ... Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>	2020-09-23 12:02:22 +03:00
Alexander Kuzmenkov	833c07f1f7	Update compare.sh	2020-09-23 11:31:18 +03:00
Alexander Kuzmenkov	2b6f4134eb	Parallel create/fill in perf test	2020-09-23 11:22:54 +03:00
Alexander Kuzmenkov	5eaa2a08d4	Update report.py	2020-09-23 10:28:28 +03:00
Alexander Kuzmenkov	0b01e62050	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-22 14:29:54 +03:00
Alexander Kuzmenkov	4937159f85	Merge pull request #14990 from ClickHouse/aku/longer-perf ... If perf test definition changed, run everything + longer (as in master)	2020-09-22 13:25:49 +03:00
Alexander Kuzmenkov	4696e22799	Update perf.py	2020-09-21 22:08:41 +03:00
alexey-milovidov	5e56f14d5f	Merge pull request #15027 from ClickHouse/perf-test-separate-profiler ... Separate profile runs in performance test	2020-09-21 21:07:14 +03:00
Alexander Kuzmenkov	679c5278e4	reword the diagnostic about short queries in perf test	2020-09-21 15:14:47 +03:00
Alexander Kuzmenkov	2f8d7ae208	fix the conditions	2020-09-21 15:01:27 +03:00
Alexander Kuzmenkov	85be1f1685	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-21 14:57:25 +03:00
Alexey Milovidov	ef800b5083	Perf test: development	2020-09-19 21:21:29 +03:00
Alexey Milovidov	35e8a895b6	Calculate profiler data in separate query runs	2020-09-19 20:38:21 +03:00
Alexey Milovidov	03aec83aec	Remove obsolete code from performance test	2020-09-19 19:27:37 +03:00
Alexander Kuzmenkov	8995140ffb	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-18 18:06:41 +03:00
Alexander Kuzmenkov	840586bd98	Merge pull request #14386 from ClickHouse/aku/perf-short ... [wip] an experiment with short queries in perf test	2020-09-18 17:54:50 +03:00
Alexander Kuzmenkov	e7b9319e12	If perf test definition changed, run everything + longer (as in master) ... Also some other perf test fixes	2020-09-18 16:28:46 +03:00
Alexander Kuzmenkov	7f029ee03c	Update perf.py	2020-09-18 11:27:27 +03:00
Alexander Kuzmenkov	4fc86f05da	some fixes + docs + report queries that are not short	2020-09-17 19:21:59 +03:00
Alexander Kuzmenkov	b1d7df80cd	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-17 18:20:14 +03:00
Alexander Kuzmenkov	ada1c7c4a0	fixup	2020-09-17 13:15:46 +03:00
Alexander Kuzmenkov	dda88eebd1	test again	2020-09-16 18:35:27 +03:00
Alexander Kuzmenkov	d55e3cd214	Update perf.py	2020-09-16 14:39:44 +03:00
Alexander Kuzmenkov	3b8ca1f262	Update compare.sh	2020-09-16 12:16:07 +03:00
Alexander Kuzmenkov	c5c5faf8ee	fixup	2020-09-16 12:06:42 +03:00
Alexander Kuzmenkov	e333a7bad4	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-16 12:05:22 +03:00
Alexander Kuzmenkov	df95f91d7c	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-15 13:53:50 +03:00
Alexander Kuzmenkov	24dd33d5cb	Update compare.sh	2020-09-15 13:44:21 +03:00
Alexey Milovidov	b87c108246	Enable remap in performance tests	2020-09-14 21:14:28 +03:00
Alexander Kuzmenkov	ab6bc1ed59	Update compare.sh	2020-09-14 20:25:17 +03:00
Alexander Kuzmenkov	9e3797b252	Merge pull request #14710 from ClickHouse/aku/faster-perf ... Do less runs in perf test	2020-09-14 19:17:34 +03:00
Alexander Kuzmenkov	b3138605c7	performance comparison	2020-09-14 19:16:59 +03:00
Alexander Kuzmenkov	3113aa6cfe	Avoid extra error in perf report on broken queries	2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov	c701a15271	fixup	2020-09-14 10:27:46 +03:00
Alexander Kuzmenkov	8689797efc	Run only some queries in perf tests, not all combos	2020-09-10 19:57:26 +03:00
Alexander Kuzmenkov	26348ad014	fixup	2020-09-10 18:48:39 +03:00
Alexander Kuzmenkov	ca2a33008b	faster	2020-09-10 17:55:54 +03:00
Alexander Kuzmenkov	0904433c87	Temporarily remove UInt256 perf test broken in https://github.com/ClickHouse/ClickHouse/pull/14229 ... Also add one more timeout to perf test runner.	2020-09-07 09:33:57 +03:00
Alexander Kuzmenkov	1978968067	performance comparison	2020-09-07 02:49:34 +03:00
Alexander Kuzmenkov	a321d6970c	adjust report and increase time	2020-09-03 04:42:25 +03:00
Alexander Kuzmenkov	8e8e195e45	geomean	2020-09-03 03:58:40 +03:00
Alexander Kuzmenkov	00c924b0dd	whitespace	2020-09-02 06:31:53 +03:00
Alexander Kuzmenkov	5fcb9bd163	short queries	2020-09-02 06:29:36 +03:00
Alexander Kuzmenkov	e622e108f7	readme	2020-09-02 06:29:16 +03:00