571 Commits

Author	SHA1	Message	Date
Azat Khuzhin	95c35b318e	Avoid using symlinks for top_level_domains ... Move the main copy into the tests/config and ship it to the perf tests via the perf package.	2020-12-15 21:58:46 +03:00
Alexander Kuzmenkov	5f424f7c5c	Update zzz-perf-comparison-tweaks-config.xml	2020-12-14 20:08:32 +03:00
Alexander Kuzmenkov	e7f93b5563	Merge pull request #18058 from azat/perf-test-zk-port-fix ... Remove test_keeper_server in perf tests	2020-12-14 17:54:47 +03:00
Alexander Kuzmenkov	2edabd5519	Update zzz-perf-comparison-tweaks-config.xml	2020-12-14 17:45:58 +03:00
Azat Khuzhin	653ddab63e	Remove test_keeper_server in perf tests ... To avoid port overlaps for right and left server (anyway it is not used).	2020-12-14 10:59:01 +03:00
Azat Khuzhin	6f2c559398	Convert top_level_domains_lists.xml into regular file ... docker/test/performance-comparison/config/config.d is not allowed to has symlinks, since it is copied with the COPY docker command.	2020-12-10 21:01:17 +03:00
Azat Khuzhin	0f1d9f3a6f	Put top_level_domains into the docker/test/performance-comparison/config ... Since in docker/test/performance-comparison there is Dockerfile that is runned from that directory, so it cannot COPY anything outside of it.	2020-12-09 21:08:31 +03:00
Azat Khuzhin	8a4b29495b	perf: override top_level_domains_path via command line arguments	2020-12-09 21:08:31 +03:00
Azat Khuzhin	7b0c720922	Add top_level_domains into perf tests ... And change Dockerfile to trigger image rebuild	2020-12-09 21:08:31 +03:00
Azat Khuzhin	79e6348282	perf: load overrides last of all	2020-12-09 07:31:54 +03:00
Azat Khuzhin	d33b0ad33b	Use interserver_http_port remove=remove over auto-port ... Revert "perf: fix port conflict for tcp_with_proxy_port" This reverts commit 89b3566824e5c0a87b6310fc4b6f9d300d2e17db.	2020-12-09 00:11:12 +03:00
Azat Khuzhin	75f9640fc2	perf: fix port conflict for tcp_with_proxy_port ... Simply use zero port to do auto allocation, anyway it is not used in perf tests.	2020-12-08 23:29:38 +03:00
Azat Khuzhin	f1ac8775db	perf: override config directives via command line over sed by config.xml	2020-12-08 21:25:03 +03:00
Azat Khuzhin	3696916f44	perf: add setuptools into docker image (to built clikchouse-driver)	2020-11-27 07:20:41 +03:00
Azat Khuzhin	04a93f18e8	perf: fail on unknown settings	2020-11-27 00:16:41 +03:00
Azat Khuzhin	a591886740	perf: remove outdated comments from perf.py ... Refs: https://github.com/ClickHouse/ClickHouse/pull/17255#discussion_r528822709	2020-11-27 00:16:41 +03:00
Azat Khuzhin	a38628d967	perf: use the latest available clickhouse-driver (from git) ... Since later setting_is_important will be used, but there is no release with this feature included.	2020-11-27 00:16:41 +03:00
myrrc	fbb0e6e6aa	Merge remote-tracking branch 'upstream/master' into improvement/diff-types-in-avg-weighted	2020-11-24 16:04:17 +03:00
Alexander Kuzmenkov	a543c8e468	Add an option to use existing tables to perf.py	2020-11-23 21:05:54 +03:00
Azat Khuzhin	d676e2f5c5	Pass settings for perf tests via protocol over SET query ... Thus they will be applied on reconnects, since clickhouse-driver may implicitly do it if the connection has been failed.	2020-11-21 14:02:33 +03:00
Azat Khuzhin	3ddb0ac53e	Configure logging for perf test runner	2020-11-21 14:02:33 +03:00
Azat Khuzhin	f6d16ee43e	Force clickhouse-driver >= 1.1.5 for settings-as-strings support for perf-tests image	2020-11-21 14:02:33 +03:00
Alexander Kuzmenkov	b0e660651a	cleanup	2020-11-16 19:09:58 +03:00
Alexander Kuzmenkov	030419db90	Try 12 threads max in perf test. ... This will allow us to use more machines, not only Gold 6320.	2020-11-09 19:14:05 +03:00
Alexander Kuzmenkov	dc665d7c43	Update compare.sh	2020-11-06 13:45:42 +03:00
Alexander Kuzmenkov	ac487ab26a	Update compare.sh	2020-11-05 23:45:58 +03:00
Alexander Kuzmenkov	8d5fe1148c	add client config	2020-11-04 18:07:34 +03:00
Alexander Kuzmenkov	5cb708a50a	fixup	2020-11-04 04:19:53 +03:00
Alexander Kuzmenkov	4245c470ac	fixes	2020-11-03 17:37:54 +03:00
Alexander Kuzmenkov	a25996ed8d	Upload perf test results to the CI database	2020-11-03 02:10:19 +03:00
Mikhail Filimonov	41971e073a	Fix typos reported by codespell	2020-10-27 12:04:03 +01:00
Alexander Kuzmenkov	e27dd538fd	performance comparison	2020-10-26 19:35:37 +03:00
Alexander Kuzmenkov	0275e9c010	work around docker weirdness	2020-10-22 19:42:31 +03:00
Alexander Kuzmenkov	ac7af67ede	fixup	2020-10-22 15:52:43 +03:00
Alexander Kuzmenkov	6293d1dbbe	Merge remote-tracking branch 'origin/master' into HEAD	2020-10-21 18:39:59 +03:00
Alexander Kuzmenkov	a678f03229	fixup	2020-10-21 18:21:54 +03:00
Alexander Kuzmenkov	c10dada3d4	try node 1	2020-10-21 18:06:42 +03:00
Alexander Kuzmenkov	abcb3c2ff9	Update report.py	2020-10-20 20:06:51 +03:00
Alexander Kuzmenkov	6b0225ab8c	Update README.md	2020-10-20 19:52:37 +03:00
Alexander Kuzmenkov	242ec7e56c	make some tests faster	2020-10-20 15:12:06 +03:00
Alexander Kuzmenkov	764f19820b	max threads	2020-10-19 17:39:52 +03:00
Alexander Kuzmenkov	38a2dd55ce	fix numactl parameters	2020-10-19 17:31:02 +03:00
Alexander Kuzmenkov	2241ea9f33	not sure what's going on...	2020-10-16 17:44:59 +03:00
Alexander Kuzmenkov	0825b8f4c2	Merge remote-tracking branch 'origin/master' into HEAD	2020-10-16 17:41:40 +03:00
Azat Khuzhin	9cb3c743bd	Convert to python3 (#15007)	2020-10-02 19:54:07 +03:00
Alexander Kuzmenkov	13c325597a	Merge remote-tracking branch 'origin/master' into HEAD	2020-10-01 13:57:04 +03:00
Alexander Kuzmenkov	74f8e41b55	calculate on all nodes	2020-10-01 13:56:56 +03:00
Alexander Kuzmenkov	499e0766e5	Check docker scripts with shellcheck	2020-09-30 20:06:46 +03:00
Alexander Kuzmenkov	aa543a2d3d	quotes	2020-09-30 17:40:24 +03:00
Alexander Kuzmenkov	9f63e882c7	fixup	2020-09-30 15:03:52 +03:00
Alexander Kuzmenkov	1617442242	fixup	2020-09-30 14:55:24 +03:00
Alexander Kuzmenkov	824d5b093c	bind everything to node 0	2020-09-30 14:32:49 +03:00
Alexander Kuzmenkov	b1abed7d37	Merge remote-tracking branch 'origin/aku/debug-perf' into HEAD	2020-09-30 14:22:20 +03:00
Alexander Kuzmenkov	f8047102fe	fixup	2020-09-29 22:06:45 +03:00
Alexander Kuzmenkov	dc15bceadc	Merge remote-tracking branch 'origin/aku/debug-perf' into HEAD	2020-09-29 16:41:38 +03:00
Alexander Kuzmenkov	ac4f0cdf22	fix	2020-09-29 14:07:31 +03:00
Alexander Kuzmenkov	6671b26f20	fixes	2020-09-28 21:43:47 +03:00
Alexander Kuzmenkov	3d1456a55d	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-28 21:19:53 +03:00
Alexander Kuzmenkov	c48d212320	performance comparison	2020-09-28 15:09:08 +03:00
Alexander Kuzmenkov	1e7a0f0e5f	typo	2020-09-28 14:44:49 +03:00
Alexander Kuzmenkov	425150e783	bind to different nodes	2020-09-25 13:19:37 +03:00
Alexander Kuzmenkov	3ff16325d8	fix the profiler	2020-09-25 12:52:09 +03:00
Alexander Kuzmenkov	40209f9ed2	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-25 11:28:47 +03:00
Alexander Kuzmenkov	651518566a	performance comparison	2020-09-24 16:24:44 +03:00
Alexander Kuzmenkov	dee34a834f	debug perf test run time	2020-09-24 14:46:03 +03:00
Alexander Kuzmenkov	26abe8cb30	Update compare.sh	2020-09-24 12:24:30 +03:00
Alexander Kuzmenkov	c2b11221a3	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-23 23:56:15 +03:00
Alexander Kuzmenkov	21f9cc65c9	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-23 23:54:55 +03:00
Alexander Kuzmenkov	179807b0b4	performance comparison	2020-09-23 23:45:39 +03:00
Alexander Kuzmenkov	d96c89972c	Update compare.sh	2020-09-23 12:04:13 +03:00
Alexander Kuzmenkov	bb51aade56	Update docker/test/performance-comparison/compare.sh ... Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>	2020-09-23 12:02:22 +03:00
Alexander Kuzmenkov	833c07f1f7	Update compare.sh	2020-09-23 11:31:18 +03:00
Alexander Kuzmenkov	2b6f4134eb	Parallel create/fill in perf test	2020-09-23 11:22:54 +03:00
Alexander Kuzmenkov	5eaa2a08d4	Update report.py	2020-09-23 10:28:28 +03:00
Alexander Kuzmenkov	0b01e62050	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-22 14:29:54 +03:00
Alexander Kuzmenkov	4937159f85	Merge pull request #14990 from ClickHouse/aku/longer-perf ... If perf test definition changed, run everything + longer (as in master)	2020-09-22 13:25:49 +03:00
Alexander Kuzmenkov	4696e22799	Update perf.py	2020-09-21 22:08:41 +03:00
alexey-milovidov	5e56f14d5f	Merge pull request #15027 from ClickHouse/perf-test-separate-profiler ... Separate profile runs in performance test	2020-09-21 21:07:14 +03:00
Alexander Kuzmenkov	679c5278e4	reword the diagnostic about short queries in perf test	2020-09-21 15:14:47 +03:00
Alexander Kuzmenkov	2f8d7ae208	fix the conditions	2020-09-21 15:01:27 +03:00
Alexander Kuzmenkov	85be1f1685	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-21 14:57:25 +03:00
Alexey Milovidov	ef800b5083	Perf test: development	2020-09-19 21:21:29 +03:00
Alexey Milovidov	35e8a895b6	Calculate profiler data in separate query runs	2020-09-19 20:38:21 +03:00
Alexey Milovidov	03aec83aec	Remove obsolete code from performance test	2020-09-19 19:27:37 +03:00
Alexander Kuzmenkov	8995140ffb	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-18 18:06:41 +03:00
Alexander Kuzmenkov	840586bd98	Merge pull request #14386 from ClickHouse/aku/perf-short ... [wip] an experiment with short queries in perf test	2020-09-18 17:54:50 +03:00
Alexander Kuzmenkov	e7b9319e12	If perf test definition changed, run everything + longer (as in master) ... Also some other perf test fixes	2020-09-18 16:28:46 +03:00
Alexander Kuzmenkov	7f029ee03c	Update perf.py	2020-09-18 11:27:27 +03:00
Alexander Kuzmenkov	4fc86f05da	some fixes + docs + report queries that are not short	2020-09-17 19:21:59 +03:00
Alexander Kuzmenkov	b1d7df80cd	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-17 18:20:14 +03:00
Alexander Kuzmenkov	ada1c7c4a0	fixup	2020-09-17 13:15:46 +03:00
Alexander Kuzmenkov	dda88eebd1	test again	2020-09-16 18:35:27 +03:00
Alexander Kuzmenkov	d55e3cd214	Update perf.py	2020-09-16 14:39:44 +03:00
Alexander Kuzmenkov	3b8ca1f262	Update compare.sh	2020-09-16 12:16:07 +03:00
Alexander Kuzmenkov	c5c5faf8ee	fixup	2020-09-16 12:06:42 +03:00
Alexander Kuzmenkov	e333a7bad4	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-16 12:05:22 +03:00
Alexander Kuzmenkov	df95f91d7c	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-15 13:53:50 +03:00
Alexander Kuzmenkov	24dd33d5cb	Update compare.sh	2020-09-15 13:44:21 +03:00
Alexey Milovidov	b87c108246	Enable remap in performance tests	2020-09-14 21:14:28 +03:00
Alexander Kuzmenkov	ab6bc1ed59	Update compare.sh	2020-09-14 20:25:17 +03:00
Alexander Kuzmenkov	9e3797b252	Merge pull request #14710 from ClickHouse/aku/faster-perf ... Do less runs in perf test	2020-09-14 19:17:34 +03:00
Alexander Kuzmenkov	b3138605c7	performance comparison	2020-09-14 19:16:59 +03:00
Alexander Kuzmenkov	3113aa6cfe	Avoid extra error in perf report on broken queries	2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov	c701a15271	fixup	2020-09-14 10:27:46 +03:00
Alexander Kuzmenkov	8689797efc	Run only some queries in perf tests, not all combos	2020-09-10 19:57:26 +03:00
Alexander Kuzmenkov	26348ad014	fixup	2020-09-10 18:48:39 +03:00
Alexander Kuzmenkov	ca2a33008b	faster	2020-09-10 17:55:54 +03:00
Alexander Kuzmenkov	0904433c87	Temporarily remove UInt256 perf test broken in https://github.com/ClickHouse/ClickHouse/pull/14229 ... Also add one more timeout to perf test runner.	2020-09-07 09:33:57 +03:00
Alexander Kuzmenkov	1978968067	performance comparison	2020-09-07 02:49:34 +03:00
Alexander Kuzmenkov	a321d6970c	adjust report and increase time	2020-09-03 04:42:25 +03:00
Alexander Kuzmenkov	8e8e195e45	geomean	2020-09-03 03:58:40 +03:00
Alexander Kuzmenkov	00c924b0dd	whitespace	2020-09-02 06:31:53 +03:00
Alexander Kuzmenkov	5fcb9bd163	short queries	2020-09-02 06:29:36 +03:00
Alexander Kuzmenkov	e622e108f7	readme	2020-09-02 06:29:16 +03:00
Alexander Kuzmenkov	0db5b4a72c	Remove concurrent benchmark from the perf test ... It's not stable enough and has only secondary utility.	2020-09-02 02:43:23 +03:00
Alexander Kuzmenkov	a6486490a2	performance comparison	2020-09-01 22:05:57 +03:00
Alexander Kuzmenkov	b601dd4596	cosmetic fixes for performance report	2020-08-29 01:46:04 +03:00
Alexander Kuzmenkov	bb28320107	cosmetic fixes in performance report	2020-08-29 01:14:48 +03:00
alexey-milovidov	5d31442fa8	Delete perf.py.orig	2020-08-26 03:26:54 +03:00
Alexander Kuzmenkov	a348bc4641	performance comparison	2020-08-24 17:15:11 +03:00
Alexander Kuzmenkov	f43457454e	warn on undefined shell variables	2020-08-19 18:34:23 +03:00
Alexander Kuzmenkov	e9ad81b362	shellcheck	2020-08-19 18:31:13 +03:00
Alexander Kuzmenkov	000326b627	Avoid timeouts in perf test	2020-08-19 18:08:23 +03:00
Alexander Kuzmenkov	6fdfe65694	performance comparison	2020-08-12 11:55:51 +03:00
Alexander Kuzmenkov	89b712a180	performance comparison	2020-08-12 08:40:03 +03:00
Alexander Kuzmenkov	7547b850d6	performance comparison	2020-08-11 17:14:24 +03:00
Alexander Kuzmenkov	5a97f0c19e	performance comparison	2020-08-11 14:53:25 +03:00
Alexander Kuzmenkov	11727864dd	performance comparison	2020-08-07 04:25:45 +03:00
Alexander Kuzmenkov	dbb65a8bd7	performance comparison	2020-08-06 16:28:51 +03:00
Alexander Kuzmenkov	a92438eff2	performance comparison	2020-08-06 02:33:32 +03:00
Alexander Kuzmenkov	88aa371e0c	performance comparison	2020-08-06 02:02:52 +03:00
Alexander Kuzmenkov	d1554e76ec	Merge remote-tracking branch 'origin/master' into HEAD	2020-08-06 00:59:25 +03:00
Alexander Kuzmenkov	ff3f378e8a	try to rebuild package for 2b7c0167cb	2020-08-06 00:58:56 +03:00
Alexander Kuzmenkov	9cac8a7244	performance comparison	2020-08-05 19:07:37 +03:00
Alexander Kuzmenkov	7945041a9a	perf test error summary	2020-08-05 18:56:51 +03:00
alexey-milovidov	935533e841	Merge pull request #13193 from ClickHouse/aku/spurious-perf ... Fix some spurious perf test failures	2020-08-03 01:02:53 +03:00
Alexander Kuzmenkov	dd475fe82c	Update report.py	2020-08-01 13:10:36 +03:00
Alexander Kuzmenkov	a317f995be	performance comparison	2020-07-31 22:58:38 +03:00
Alexander Kuzmenkov	1d954581eb	Fix some spurious perf test failures	2020-07-31 19:28:04 +03:00
Alexander Kuzmenkov	e2e4fc9848	align numbers to the right in perf report	2020-07-31 13:59:15 +03:00
Alexander Kuzmenkov	42e5f8ec44	Update compare.sh	2020-07-31 03:49:36 +03:00
Alexander Kuzmenkov	db15108005	add times speedup/slowdown to changed tests table	2020-07-31 01:14:20 +03:00
Alexander Kuzmenkov	0e20507539	Update compare.sh	2020-07-30 17:26:47 +03:00
Alexander Kuzmenkov	e0c207d6b4	Update entrypoint.sh	2020-07-28 16:15:41 +03:00
Alexander Kuzmenkov	b6f2fde37e	performance comparison	2020-07-27 14:20:45 +03:00
Alexander Kuzmenkov	acf1e5fe7e	Choose proper old version for perf comparison	2020-07-23 18:17:11 +03:00
Alexander Kuzmenkov	15cd448afa	Update compare.sh	2020-07-23 17:59:32 +03:00
Alexander Kuzmenkov	186b2c3b1b	Support different query log format in perf test	2020-07-23 16:32:03 +03:00
Alexander Kuzmenkov	2b7c0167cb	Update compare.sh	2020-07-22 21:02:56 +03:00
Alexander Kuzmenkov	72167aa746	Update Dockerfile	2020-07-22 16:18:57 +03:00
Alexander Kuzmenkov	9f49bf2d82	fixup	2020-07-22 01:09:54 +03:00
Alexander Kuzmenkov	3d89f0e9df	Perf test: bind server to one NUMA node	2020-07-21 15:41:14 +03:00
Alexander Kuzmenkov	00acf4173c	Fixes for perf test after #12469	2020-07-15 16:38:02 +03:00
Alexander Kuzmenkov	57ad000c62	Update README.md	2020-07-14 16:46:19 +03:00
Alexander Kuzmenkov	5a15e03400	Improve data layout in perf test ... Also fix a bad test query found with new data.	2020-07-13 14:31:15 +03:00
Alexander Kuzmenkov	394cf20673	Merge remote-tracking branch 'origin/master' into HEAD	2020-07-09 13:46:54 +03:00
Alexander Kuzmenkov	cec35a0e1d	Update README.md	2020-07-08 15:07:01 +03:00
Alexander Kuzmenkov	c9162f6e77	Update README.md	2020-07-08 15:05:49 +03:00
Alexander Kuzmenkov	344e2713fa	Update README.md	2020-07-08 14:52:06 +03:00
Alexander Kuzmenkov	bd14d06476	Update README.md	2020-07-08 14:25:43 +03:00
Alexander Kuzmenkov	f514d0da77	Revert "Run perf tests with memory sampling (for allocations >1M)"	2020-07-07 19:59:42 +03:00
Azat Khuzhin	307c3c92a5	Run perf tests with memory sampling (for allocations >1M) ... This is to know the memory allocation size distribution, that can be obtained later from left-metric-log.tsv. This is an attempt to tune tcmalloc (new CPP version by google) to use lock-free part of the allocator for typical allocations (and it is a bad idea just to increase kMaxSize there, since number of allocation for each size class is also important). P.S. hope that this file will be applied, if no, then the same effect can be reached by tunning defaults in Settings.h Refs: #11590 Cc: @akuzm	2020-07-05 12:43:12 +03:00
Alexander Kuzmenkov	10b6f98ca6	fixup	2020-07-03 11:39:43 +03:00
Alexander Kuzmenkov	7d8a31aff3	Merge remote-tracking branch 'origin/master' into HEAD	2020-07-03 10:09:20 +03:00
Alexander Kuzmenkov	f50f8d936e	Merge remote-tracking branch 'origin/master' into HEAD	2020-07-02 10:19:26 +03:00
Alexander Kuzmenkov	41088c3416	Merge remote-tracking branch 'origin/master' into HEAD	2020-07-02 10:13:11 +03:00
Alexander Kuzmenkov	99514a7e24	fixup	2020-07-02 10:13:02 +03:00
Alexander Kuzmenkov	baec4093dd	Merge pull request #11993 from ClickHouse/aku/more-jemalloc-tweaks ... jemalloc: set muzzy_decay_ms = 10s	2020-06-30 22:51:21 +03:00
Alexander Kuzmenkov	7e2f6937e0	fixup	2020-06-30 12:45:19 +03:00
Alexander Kuzmenkov	b5f9e9de78	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-30 12:28:14 +03:00
Alexander Kuzmenkov	a4152cfb00	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-30 08:55:56 +03:00
Alexander Kuzmenkov	588ff8fcc1	Merge pull request #11989 from ClickHouse/aku/long-perf ... Try to enable long perf tests	2020-06-30 08:52:29 +03:00
Alexander Kuzmenkov	6d67c77e68	fixup	2020-06-29 17:09:51 +03:00
Alexander Kuzmenkov	1b49feae6b	Fixup	2020-06-29 11:29:40 +03:00
Alexander Kuzmenkov	960c455e0e	performance comparison	2020-06-27 04:15:58 +03:00
Alexander Kuzmenkov	8b82ff215f	muzzy decay 10 ms	2020-06-27 04:08:21 +03:00
Alexander Kuzmenkov	7e88cc15f1	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-27 04:00:26 +03:00
Alexander Kuzmenkov	459ebf1ea0	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-27 03:59:36 +03:00
Alexander Kuzmenkov	e0c4cc9135	performance comparison	2020-06-27 03:53:54 +03:00
Alexander Kuzmenkov	be57bc56d7	perf test: report queries with new functions separately	2020-06-27 03:45:00 +03:00
Alexander Kuzmenkov	c8b633fe47	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-26 21:01:40 +03:00
Alexander Kuzmenkov	41659e38ce	Update path to perf test package	2020-06-26 03:46:44 +03:00
Alexander Kuzmenkov	beb386674d	Update path to performance tests build	2020-06-26 00:58:38 +03:00
Alexander Kuzmenkov	e521d616fe	performance comparison	2020-06-25 23:42:29 +03:00
Alexander Kuzmenkov	58747df00c	Update docker/test/performance-comparison/perf.py	2020-06-25 09:35:21 +03:00
Alexander Kuzmenkov	865ebcda16	variadic return value was too new python	2020-06-25 01:21:02 +03:00
Alexander Kuzmenkov	ab809f59b9	memory usage settings	2020-06-23 15:30:45 +03:00
Alexander Kuzmenkov	bfba15d512	Explicitly mark short perftest queries	2020-06-23 15:09:54 +03:00
Alexander Kuzmenkov	eac6eb8c5a	report	2020-06-22 15:22:09 +03:00
Alexander Kuzmenkov	fbecf42dfc	report the number of errors	2020-06-20 01:41:15 +03:00
Alexander Kuzmenkov	cec65ce30d	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-19 22:34:50 +03:00
Alexander Kuzmenkov	1a3a19391c	Merge pull request #11711 from ClickHouse/fix_path_in_perftest ... Try fix performance test of Values format	2020-06-19 15:57:32 +03:00
Alexander Tokmakov	73af3befe6	Revert "specify path in config"	2020-06-19 01:45:45 +03:00
Alexander Tokmakov	53b9f15f53	fix	2020-06-18 13:20:01 +03:00
Alexander Kuzmenkov	2bc6de4b4e	performance comparison	2020-06-18 06:14:18 +03:00
Alexander Tokmakov	660ed26389	Merge branch 'master' into fix_path_in_perftest	2020-06-18 00:22:36 +03:00
Alexander Tokmakov	50b4671867	specify path in config	2020-06-16 21:29:55 +03:00
Alexander Tokmakov	1e50bae76e	override user_files_path	2020-06-16 18:13:28 +03:00
Alexander Kuzmenkov	8509079021	performance comparison	2020-06-16 14:06:11 +03:00
Alexander Kuzmenkov	cd769e5ebf	fixup	2020-06-16 11:21:15 +03:00
Alexander Kuzmenkov	4dc6254357	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-15 17:26:15 +03:00
Alexander Kuzmenkov	56869228a2	add flag to continue on errors	2020-06-12 21:28:07 +03:00
Alexander Kuzmenkov	5101708831	fixup	2020-06-12 18:11:33 +03:00
Alexander Kuzmenkov	0da6e1c9de	typo	2020-06-12 15:12:12 +03:00
Alexander Kuzmenkov	10a8021418	performance comparison	2020-06-12 00:58:45 +03:00
Alexander Kuzmenkov	7ba5063b7a	Add concurrent benchmark to performance test ... After the main test, run queries from `website.xml` in parallel using `clickhouse-benchmark`. This can be useful to test the effects of concurrency on performance. Comparison test can miss some effects because it always runs queries sequentially, and many of them are even single-threaded.	2020-06-12 00:24:56 +03:00
Alexander Kuzmenkov	d840a9990c	performance comparison	2020-06-11 23:39:26 +03:00
Alexander Kuzmenkov	e354bbc78c	Merge pull request #11588 from ClickHouse/aku/async-log ... Add system.asynchronous_metric_log	2020-06-11 16:10:35 +03:00
Alexander Kuzmenkov	1bd375c25e	performance comparison	2020-06-11 00:38:26 +03:00
Alexander Kuzmenkov	7b54ff02f0	Collect async metric log in perf test	2020-06-10 22:27:05 +03:00
Alexander Kuzmenkov	af1c8f8a5f	fixup	2020-06-10 02:57:31 +03:00
Alexander Kuzmenkov	5719549ee1	fixup	2020-06-09 16:29:07 +03:00
Alexander Kuzmenkov	6a3df071a2	fixup	2020-06-09 01:13:08 +03:00
Alexander Kuzmenkov	e2e5e1d5f8	More stable perf tests	2020-06-08 16:57:33 +03:00
Alexander Kuzmenkov	b14cc1dc56	Merge pull request #11449 from ClickHouse/check-for-incorrect-settings ... Added a check for incorrect settings	2020-06-06 00:15:27 +03:00
Alexander Kuzmenkov	d17a435fb6	Merge pull request #11226 from ClickHouse/aku/merge-perf-events ... Merge Perf events metrics #9545	2020-06-05 23:10:54 +03:00
Alexander Kuzmenkov	29adb1cbcf	performance comparison	2020-06-05 17:30:26 +03:00
Alexander Kuzmenkov	14c55b940e	peftest settings: use_uncompressed_cache goes to profile	2020-06-05 16:32:21 +03:00
Alexander Kuzmenkov	5523444d91	cleanup	2020-06-05 15:53:47 +03:00
Alexander Kuzmenkov	377da4656d	cleanup	2020-06-04 18:51:34 +03:00
Alexander Kuzmenkov	03d8bf9242	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-01 20:15:25 +03:00
Alexander Kuzmenkov	aa1f552a8f	build fixes	2020-06-01 20:13:54 +03:00
Alexander Kuzmenkov	ca5d7cf5bb	fix some broken performance tests	2020-05-28 10:45:03 +03:00
Alexander Kuzmenkov	db84f0e892	Merge remote-tracking branch 'origin/master' into HEAD	2020-05-27 16:30:13 +03:00
Alexander Kuzmenkov	f1fb7245e5	Merge remote-tracking branch 'origin/master' into HEAD	2020-05-25 06:21:27 +03:00
Alexander Kuzmenkov	09129a6d21	Function for printing array of Asts	2020-05-25 06:19:46 +03:00
Alexander Kuzmenkov	bf3f76be7f	performance comparison	2020-05-25 04:42:56 +03:00
Alexander Kuzmenkov	5a9f47e6b0	performance comparison	2020-05-25 04:03:46 +03:00
Alexander Kuzmenkov	f6dd8d3f78	Enable perf event metrics in performance test	2020-05-23 04:40:57 +03:00
Alexander Kuzmenkov	36c7a486a1	performance comparison	2020-05-23 03:27:56 +03:00
Alexander Kuzmenkov	a2ed8267ad	Rename performance_comparison.md to README.md	2020-05-23 00:30:17 +03:00
Alexander Kuzmenkov	51a064aa75	performance comparison	2020-05-22 23:09:44 +03:00
Alexander Kuzmenkov	f04c5c6100	performance comparison	2020-05-22 11:54:35 +03:00
Alexander Kuzmenkov	86da115018	performance comparison	2020-05-22 11:40:20 +03:00
Alexander Kuzmenkov	3073fc9eb0	performance comparison	2020-05-22 05:51:26 +03:00
Alexander Kuzmenkov	432648ca1e	performance comparison	2020-05-22 03:51:56 +03:00
Alexander Kuzmenkov	7b747fabe2	performance comparison	2020-05-22 02:04:04 +03:00
Alexander Kuzmenkov	ebb29d48fa	Update perf.py	2020-05-21 21:06:08 +03:00
Alexander Kuzmenkov	34508b8f64	[wip] Add memory stats to performance test	2020-05-21 05:12:55 +03:00
Alexander Kuzmenkov	ef6f386ee6	Merge pull request #11026 from ClickHouse/aku/trace-log ... Add more logs to debug trace_log overflow	2020-05-19 17:56:06 +03:00
Alexander Kuzmenkov	a700b527ce	fixup	2020-05-19 17:51:51 +03:00
Alexander Kuzmenkov	c34ea27362	performance comparison	2020-05-19 00:15:33 +03:00
Alexander Kuzmenkov	a54773f947	Add more logs to debug trace_log overflow	2020-05-18 22:33:12 +03:00
Alexander Kuzmenkov	bb726b2d8d	Update compare.sh	2020-05-14 13:54:07 +03:00
Alexey Milovidov	4e891091df	Allow expected number of failures in performance test	2020-05-13 06:57:19 +03:00
Alexander Kuzmenkov	9edb0ba293	Update performance_comparison.md	2020-05-12 18:45:48 +03:00
Alexey Milovidov	ec73ff6151	Do not show unstable queries as error	2020-05-09 18:58:47 +03:00
Alexey Milovidov	2e58cbd1b5	Minor modifications	2020-05-09 18:55:25 +03:00
Alexey Milovidov	33f1fd3836	Fix bad markup	2020-05-09 18:50:28 +03:00
Alexey Milovidov	2000008438	Fix bad markup	2020-05-09 18:47:14 +03:00