468 Commits

Author	SHA1	Message	Date
Alexander Kuzmenkov	2edabd5519	Update zzz-perf-comparison-tweaks-config.xml	2020-12-14 17:45:58 +03:00
Azat Khuzhin	653ddab63e	Remove test_keeper_server in perf tests ... To avoid port overlaps for right and left server (anyway it is not used).	2020-12-14 10:59:01 +03:00
Azat Khuzhin	6f2c559398	Convert top_level_domains_lists.xml into regular file ... docker/test/performance-comparison/config/config.d is not allowed to has symlinks, since it is copied with the COPY docker command.	2020-12-10 21:01:17 +03:00
Azat Khuzhin	0f1d9f3a6f	Put top_level_domains into the docker/test/performance-comparison/config ... Since in docker/test/performance-comparison there is Dockerfile that is runned from that directory, so it cannot COPY anything outside of it.	2020-12-09 21:08:31 +03:00
Azat Khuzhin	8a4b29495b	perf: override top_level_domains_path via command line arguments	2020-12-09 21:08:31 +03:00
Azat Khuzhin	7b0c720922	Add top_level_domains into perf tests ... And change Dockerfile to trigger image rebuild	2020-12-09 21:08:31 +03:00
Azat Khuzhin	79e6348282	perf: load overrides last of all	2020-12-09 07:31:54 +03:00
Azat Khuzhin	d33b0ad33b	Use interserver_http_port remove=remove over auto-port ... Revert "perf: fix port conflict for tcp_with_proxy_port" This reverts commit 89b3566824e5c0a87b6310fc4b6f9d300d2e17db.	2020-12-09 00:11:12 +03:00
Azat Khuzhin	75f9640fc2	perf: fix port conflict for tcp_with_proxy_port ... Simply use zero port to do auto allocation, anyway it is not used in perf tests.	2020-12-08 23:29:38 +03:00
Azat Khuzhin	f1ac8775db	perf: override config directives via command line over sed by config.xml	2020-12-08 21:25:03 +03:00
Azat Khuzhin	3696916f44	perf: add setuptools into docker image (to built clikchouse-driver)	2020-11-27 07:20:41 +03:00
Azat Khuzhin	04a93f18e8	perf: fail on unknown settings	2020-11-27 00:16:41 +03:00
Azat Khuzhin	a591886740	perf: remove outdated comments from perf.py ... Refs: https://github.com/ClickHouse/ClickHouse/pull/17255#discussion_r528822709	2020-11-27 00:16:41 +03:00
Azat Khuzhin	a38628d967	perf: use the latest available clickhouse-driver (from git) ... Since later setting_is_important will be used, but there is no release with this feature included.	2020-11-27 00:16:41 +03:00
myrrc	fbb0e6e6aa	Merge remote-tracking branch 'upstream/master' into improvement/diff-types-in-avg-weighted	2020-11-24 16:04:17 +03:00
Alexander Kuzmenkov	a543c8e468	Add an option to use existing tables to perf.py	2020-11-23 21:05:54 +03:00
Azat Khuzhin	d676e2f5c5	Pass settings for perf tests via protocol over SET query ... Thus they will be applied on reconnects, since clickhouse-driver may implicitly do it if the connection has been failed.	2020-11-21 14:02:33 +03:00
Azat Khuzhin	3ddb0ac53e	Configure logging for perf test runner	2020-11-21 14:02:33 +03:00
Azat Khuzhin	f6d16ee43e	Force clickhouse-driver >= 1.1.5 for settings-as-strings support for perf-tests image	2020-11-21 14:02:33 +03:00
Alexander Kuzmenkov	b0e660651a	cleanup	2020-11-16 19:09:58 +03:00
Alexander Kuzmenkov	030419db90	Try 12 threads max in perf test. ... This will allow us to use more machines, not only Gold 6320.	2020-11-09 19:14:05 +03:00
Alexander Kuzmenkov	dc665d7c43	Update compare.sh	2020-11-06 13:45:42 +03:00
Alexander Kuzmenkov	ac487ab26a	Update compare.sh	2020-11-05 23:45:58 +03:00
Alexander Kuzmenkov	8d5fe1148c	add client config	2020-11-04 18:07:34 +03:00
Alexander Kuzmenkov	5cb708a50a	fixup	2020-11-04 04:19:53 +03:00
Alexander Kuzmenkov	4245c470ac	fixes	2020-11-03 17:37:54 +03:00
Alexander Kuzmenkov	a25996ed8d	Upload perf test results to the CI database	2020-11-03 02:10:19 +03:00
Mikhail Filimonov	41971e073a	Fix typos reported by codespell	2020-10-27 12:04:03 +01:00
Alexander Kuzmenkov	e27dd538fd	performance comparison	2020-10-26 19:35:37 +03:00
Alexander Kuzmenkov	0275e9c010	work around docker weirdness	2020-10-22 19:42:31 +03:00
Alexander Kuzmenkov	ac7af67ede	fixup	2020-10-22 15:52:43 +03:00
Alexander Kuzmenkov	6293d1dbbe	Merge remote-tracking branch 'origin/master' into HEAD	2020-10-21 18:39:59 +03:00
Alexander Kuzmenkov	a678f03229	fixup	2020-10-21 18:21:54 +03:00
Alexander Kuzmenkov	c10dada3d4	try node 1	2020-10-21 18:06:42 +03:00
Alexander Kuzmenkov	abcb3c2ff9	Update report.py	2020-10-20 20:06:51 +03:00
Alexander Kuzmenkov	6b0225ab8c	Update README.md	2020-10-20 19:52:37 +03:00
Alexander Kuzmenkov	242ec7e56c	make some tests faster	2020-10-20 15:12:06 +03:00
Alexander Kuzmenkov	764f19820b	max threads	2020-10-19 17:39:52 +03:00
Alexander Kuzmenkov	38a2dd55ce	fix numactl parameters	2020-10-19 17:31:02 +03:00
Alexander Kuzmenkov	2241ea9f33	not sure what's going on...	2020-10-16 17:44:59 +03:00
Alexander Kuzmenkov	0825b8f4c2	Merge remote-tracking branch 'origin/master' into HEAD	2020-10-16 17:41:40 +03:00
Azat Khuzhin	9cb3c743bd	Convert to python3 (#15007)	2020-10-02 19:54:07 +03:00
Alexander Kuzmenkov	13c325597a	Merge remote-tracking branch 'origin/master' into HEAD	2020-10-01 13:57:04 +03:00
Alexander Kuzmenkov	74f8e41b55	calculate on all nodes	2020-10-01 13:56:56 +03:00
Alexander Kuzmenkov	499e0766e5	Check docker scripts with shellcheck	2020-09-30 20:06:46 +03:00
Alexander Kuzmenkov	aa543a2d3d	quotes	2020-09-30 17:40:24 +03:00
Alexander Kuzmenkov	9f63e882c7	fixup	2020-09-30 15:03:52 +03:00
Alexander Kuzmenkov	1617442242	fixup	2020-09-30 14:55:24 +03:00
Alexander Kuzmenkov	824d5b093c	bind everything to node 0	2020-09-30 14:32:49 +03:00
Alexander Kuzmenkov	b1abed7d37	Merge remote-tracking branch 'origin/aku/debug-perf' into HEAD	2020-09-30 14:22:20 +03:00
Alexander Kuzmenkov	f8047102fe	fixup	2020-09-29 22:06:45 +03:00
Alexander Kuzmenkov	dc15bceadc	Merge remote-tracking branch 'origin/aku/debug-perf' into HEAD	2020-09-29 16:41:38 +03:00
Alexander Kuzmenkov	ac4f0cdf22	fix	2020-09-29 14:07:31 +03:00
Alexander Kuzmenkov	6671b26f20	fixes	2020-09-28 21:43:47 +03:00
Alexander Kuzmenkov	3d1456a55d	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-28 21:19:53 +03:00
Alexander Kuzmenkov	c48d212320	performance comparison	2020-09-28 15:09:08 +03:00
Alexander Kuzmenkov	1e7a0f0e5f	typo	2020-09-28 14:44:49 +03:00
Alexander Kuzmenkov	425150e783	bind to different nodes	2020-09-25 13:19:37 +03:00
Alexander Kuzmenkov	3ff16325d8	fix the profiler	2020-09-25 12:52:09 +03:00
Alexander Kuzmenkov	40209f9ed2	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-25 11:28:47 +03:00
Alexander Kuzmenkov	651518566a	performance comparison	2020-09-24 16:24:44 +03:00
Alexander Kuzmenkov	dee34a834f	debug perf test run time	2020-09-24 14:46:03 +03:00
Alexander Kuzmenkov	26abe8cb30	Update compare.sh	2020-09-24 12:24:30 +03:00
Alexander Kuzmenkov	c2b11221a3	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-23 23:56:15 +03:00
Alexander Kuzmenkov	21f9cc65c9	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-23 23:54:55 +03:00
Alexander Kuzmenkov	179807b0b4	performance comparison	2020-09-23 23:45:39 +03:00
Alexander Kuzmenkov	d96c89972c	Update compare.sh	2020-09-23 12:04:13 +03:00
Alexander Kuzmenkov	bb51aade56	Update docker/test/performance-comparison/compare.sh ... Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>	2020-09-23 12:02:22 +03:00
Alexander Kuzmenkov	833c07f1f7	Update compare.sh	2020-09-23 11:31:18 +03:00
Alexander Kuzmenkov	2b6f4134eb	Parallel create/fill in perf test	2020-09-23 11:22:54 +03:00
Alexander Kuzmenkov	5eaa2a08d4	Update report.py	2020-09-23 10:28:28 +03:00
Alexander Kuzmenkov	0b01e62050	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-22 14:29:54 +03:00
Alexander Kuzmenkov	4937159f85	Merge pull request #14990 from ClickHouse/aku/longer-perf ... If perf test definition changed, run everything + longer (as in master)	2020-09-22 13:25:49 +03:00
Alexander Kuzmenkov	4696e22799	Update perf.py	2020-09-21 22:08:41 +03:00
alexey-milovidov	5e56f14d5f	Merge pull request #15027 from ClickHouse/perf-test-separate-profiler ... Separate profile runs in performance test	2020-09-21 21:07:14 +03:00
Alexander Kuzmenkov	679c5278e4	reword the diagnostic about short queries in perf test	2020-09-21 15:14:47 +03:00
Alexander Kuzmenkov	2f8d7ae208	fix the conditions	2020-09-21 15:01:27 +03:00
Alexander Kuzmenkov	85be1f1685	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-21 14:57:25 +03:00
Alexey Milovidov	ef800b5083	Perf test: development	2020-09-19 21:21:29 +03:00
Alexey Milovidov	35e8a895b6	Calculate profiler data in separate query runs	2020-09-19 20:38:21 +03:00
Alexey Milovidov	03aec83aec	Remove obsolete code from performance test	2020-09-19 19:27:37 +03:00
Alexander Kuzmenkov	8995140ffb	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-18 18:06:41 +03:00
Alexander Kuzmenkov	840586bd98	Merge pull request #14386 from ClickHouse/aku/perf-short ... [wip] an experiment with short queries in perf test	2020-09-18 17:54:50 +03:00
Alexander Kuzmenkov	e7b9319e12	If perf test definition changed, run everything + longer (as in master) ... Also some other perf test fixes	2020-09-18 16:28:46 +03:00
Alexander Kuzmenkov	7f029ee03c	Update perf.py	2020-09-18 11:27:27 +03:00
Alexander Kuzmenkov	4fc86f05da	some fixes + docs + report queries that are not short	2020-09-17 19:21:59 +03:00
Alexander Kuzmenkov	b1d7df80cd	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-17 18:20:14 +03:00
Alexander Kuzmenkov	ada1c7c4a0	fixup	2020-09-17 13:15:46 +03:00
Alexander Kuzmenkov	dda88eebd1	test again	2020-09-16 18:35:27 +03:00
Alexander Kuzmenkov	d55e3cd214	Update perf.py	2020-09-16 14:39:44 +03:00
Alexander Kuzmenkov	3b8ca1f262	Update compare.sh	2020-09-16 12:16:07 +03:00
Alexander Kuzmenkov	c5c5faf8ee	fixup	2020-09-16 12:06:42 +03:00
Alexander Kuzmenkov	e333a7bad4	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-16 12:05:22 +03:00
Alexander Kuzmenkov	df95f91d7c	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-15 13:53:50 +03:00
Alexander Kuzmenkov	24dd33d5cb	Update compare.sh	2020-09-15 13:44:21 +03:00
Alexey Milovidov	b87c108246	Enable remap in performance tests	2020-09-14 21:14:28 +03:00
Alexander Kuzmenkov	ab6bc1ed59	Update compare.sh	2020-09-14 20:25:17 +03:00
Alexander Kuzmenkov	9e3797b252	Merge pull request #14710 from ClickHouse/aku/faster-perf ... Do less runs in perf test	2020-09-14 19:17:34 +03:00
Alexander Kuzmenkov	b3138605c7	performance comparison	2020-09-14 19:16:59 +03:00
Alexander Kuzmenkov	3113aa6cfe	Avoid extra error in perf report on broken queries	2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov	c701a15271	fixup	2020-09-14 10:27:46 +03:00
Alexander Kuzmenkov	8689797efc	Run only some queries in perf tests, not all combos	2020-09-10 19:57:26 +03:00
Alexander Kuzmenkov	26348ad014	fixup	2020-09-10 18:48:39 +03:00
Alexander Kuzmenkov	ca2a33008b	faster	2020-09-10 17:55:54 +03:00
Alexander Kuzmenkov	0904433c87	Temporarily remove UInt256 perf test broken in https://github.com/ClickHouse/ClickHouse/pull/14229 ... Also add one more timeout to perf test runner.	2020-09-07 09:33:57 +03:00
Alexander Kuzmenkov	1978968067	performance comparison	2020-09-07 02:49:34 +03:00
Alexander Kuzmenkov	a321d6970c	adjust report and increase time	2020-09-03 04:42:25 +03:00
Alexander Kuzmenkov	8e8e195e45	geomean	2020-09-03 03:58:40 +03:00
Alexander Kuzmenkov	00c924b0dd	whitespace	2020-09-02 06:31:53 +03:00
Alexander Kuzmenkov	5fcb9bd163	short queries	2020-09-02 06:29:36 +03:00
Alexander Kuzmenkov	e622e108f7	readme	2020-09-02 06:29:16 +03:00
Alexander Kuzmenkov	0db5b4a72c	Remove concurrent benchmark from the perf test ... It's not stable enough and has only secondary utility.	2020-09-02 02:43:23 +03:00
Alexander Kuzmenkov	a6486490a2	performance comparison	2020-09-01 22:05:57 +03:00
Alexander Kuzmenkov	b601dd4596	cosmetic fixes for performance report	2020-08-29 01:46:04 +03:00
Alexander Kuzmenkov	bb28320107	cosmetic fixes in performance report	2020-08-29 01:14:48 +03:00
alexey-milovidov	5d31442fa8	Delete perf.py.orig	2020-08-26 03:26:54 +03:00
Alexander Kuzmenkov	a348bc4641	performance comparison	2020-08-24 17:15:11 +03:00
Alexander Kuzmenkov	f43457454e	warn on undefined shell variables	2020-08-19 18:34:23 +03:00
Alexander Kuzmenkov	e9ad81b362	shellcheck	2020-08-19 18:31:13 +03:00
Alexander Kuzmenkov	000326b627	Avoid timeouts in perf test	2020-08-19 18:08:23 +03:00
Alexander Kuzmenkov	6fdfe65694	performance comparison	2020-08-12 11:55:51 +03:00
Alexander Kuzmenkov	89b712a180	performance comparison	2020-08-12 08:40:03 +03:00
Alexander Kuzmenkov	7547b850d6	performance comparison	2020-08-11 17:14:24 +03:00
Alexander Kuzmenkov	5a97f0c19e	performance comparison	2020-08-11 14:53:25 +03:00
Alexander Kuzmenkov	11727864dd	performance comparison	2020-08-07 04:25:45 +03:00
Alexander Kuzmenkov	dbb65a8bd7	performance comparison	2020-08-06 16:28:51 +03:00
Alexander Kuzmenkov	a92438eff2	performance comparison	2020-08-06 02:33:32 +03:00
Alexander Kuzmenkov	88aa371e0c	performance comparison	2020-08-06 02:02:52 +03:00
Alexander Kuzmenkov	d1554e76ec	Merge remote-tracking branch 'origin/master' into HEAD	2020-08-06 00:59:25 +03:00
Alexander Kuzmenkov	ff3f378e8a	try to rebuild package for 2b7c0167cb	2020-08-06 00:58:56 +03:00
Alexander Kuzmenkov	9cac8a7244	performance comparison	2020-08-05 19:07:37 +03:00
Alexander Kuzmenkov	7945041a9a	perf test error summary	2020-08-05 18:56:51 +03:00
alexey-milovidov	935533e841	Merge pull request #13193 from ClickHouse/aku/spurious-perf ... Fix some spurious perf test failures	2020-08-03 01:02:53 +03:00
Alexander Kuzmenkov	dd475fe82c	Update report.py	2020-08-01 13:10:36 +03:00
Alexander Kuzmenkov	a317f995be	performance comparison	2020-07-31 22:58:38 +03:00
Alexander Kuzmenkov	1d954581eb	Fix some spurious perf test failures	2020-07-31 19:28:04 +03:00
Alexander Kuzmenkov	e2e4fc9848	align numbers to the right in perf report	2020-07-31 13:59:15 +03:00
Alexander Kuzmenkov	42e5f8ec44	Update compare.sh	2020-07-31 03:49:36 +03:00
Alexander Kuzmenkov	db15108005	add times speedup/slowdown to changed tests table	2020-07-31 01:14:20 +03:00
Alexander Kuzmenkov	0e20507539	Update compare.sh	2020-07-30 17:26:47 +03:00
Alexander Kuzmenkov	e0c207d6b4	Update entrypoint.sh	2020-07-28 16:15:41 +03:00
Alexander Kuzmenkov	b6f2fde37e	performance comparison	2020-07-27 14:20:45 +03:00
Alexander Kuzmenkov	acf1e5fe7e	Choose proper old version for perf comparison	2020-07-23 18:17:11 +03:00
Alexander Kuzmenkov	15cd448afa	Update compare.sh	2020-07-23 17:59:32 +03:00
Alexander Kuzmenkov	186b2c3b1b	Support different query log format in perf test	2020-07-23 16:32:03 +03:00
Alexander Kuzmenkov	2b7c0167cb	Update compare.sh	2020-07-22 21:02:56 +03:00
Alexander Kuzmenkov	72167aa746	Update Dockerfile	2020-07-22 16:18:57 +03:00
Alexander Kuzmenkov	9f49bf2d82	fixup	2020-07-22 01:09:54 +03:00
Alexander Kuzmenkov	3d89f0e9df	Perf test: bind server to one NUMA node	2020-07-21 15:41:14 +03:00
Alexander Kuzmenkov	00acf4173c	Fixes for perf test after #12469	2020-07-15 16:38:02 +03:00