307 Commits

Author	SHA1	Message	Date
Alexander Kuzmenkov	26348ad014	fixup	2020-09-10 18:48:39 +03:00
Alexander Kuzmenkov	ca2a33008b	faster	2020-09-10 17:55:54 +03:00
Alexander Kuzmenkov	0904433c87	Temporarily remove UInt256 perf test broken in https://github.com/ClickHouse/ClickHouse/pull/14229 ... Also add one more timeout to perf test runner.	2020-09-07 09:33:57 +03:00
Alexander Kuzmenkov	1978968067	performance comparison	2020-09-07 02:49:34 +03:00
Alexander Kuzmenkov	a321d6970c	adjust report and increase time	2020-09-03 04:42:25 +03:00
Alexander Kuzmenkov	8e8e195e45	geomean	2020-09-03 03:58:40 +03:00
Alexander Kuzmenkov	00c924b0dd	whitespace	2020-09-02 06:31:53 +03:00
Alexander Kuzmenkov	5fcb9bd163	short queries	2020-09-02 06:29:36 +03:00
Alexander Kuzmenkov	e622e108f7	readme	2020-09-02 06:29:16 +03:00
Alexander Kuzmenkov	0db5b4a72c	Remove concurrent benchmark from the perf test ... It's not stable enough and has only secondary utility.	2020-09-02 02:43:23 +03:00
Alexander Kuzmenkov	a6486490a2	performance comparison	2020-09-01 22:05:57 +03:00
Alexander Kuzmenkov	b601dd4596	cosmetic fixes for performance report	2020-08-29 01:46:04 +03:00
Alexander Kuzmenkov	bb28320107	cosmetic fixes in performance report	2020-08-29 01:14:48 +03:00
Alexander Kuzmenkov	a348bc4641	performance comparison	2020-08-24 17:15:11 +03:00
Alexander Kuzmenkov	f43457454e	warn on undefined shell variables	2020-08-19 18:34:23 +03:00
Alexander Kuzmenkov	e9ad81b362	shellcheck	2020-08-19 18:31:13 +03:00
Alexander Kuzmenkov	000326b627	Avoid timeouts in perf test	2020-08-19 18:08:23 +03:00
Alexander Kuzmenkov	6fdfe65694	performance comparison	2020-08-12 11:55:51 +03:00
Alexander Kuzmenkov	89b712a180	performance comparison	2020-08-12 08:40:03 +03:00
Alexander Kuzmenkov	7547b850d6	performance comparison	2020-08-11 17:14:24 +03:00
Alexander Kuzmenkov	5a97f0c19e	performance comparison	2020-08-11 14:53:25 +03:00
Alexander Kuzmenkov	11727864dd	performance comparison	2020-08-07 04:25:45 +03:00
Alexander Kuzmenkov	dbb65a8bd7	performance comparison	2020-08-06 16:28:51 +03:00
Alexander Kuzmenkov	a92438eff2	performance comparison	2020-08-06 02:33:32 +03:00
Alexander Kuzmenkov	88aa371e0c	performance comparison	2020-08-06 02:02:52 +03:00
Alexander Kuzmenkov	9cac8a7244	performance comparison	2020-08-05 19:07:37 +03:00
Alexander Kuzmenkov	7945041a9a	perf test error summary	2020-08-05 18:56:51 +03:00
alexey-milovidov	935533e841	Merge pull request #13193 from ClickHouse/aku/spurious-perf ... Fix some spurious perf test failures	2020-08-03 01:02:53 +03:00
Alexander Kuzmenkov	dd475fe82c	Update report.py	2020-08-01 13:10:36 +03:00
Alexander Kuzmenkov	a317f995be	performance comparison	2020-07-31 22:58:38 +03:00
Alexander Kuzmenkov	1d954581eb	Fix some spurious perf test failures	2020-07-31 19:28:04 +03:00
Alexander Kuzmenkov	e2e4fc9848	align numbers to the right in perf report	2020-07-31 13:59:15 +03:00
Alexander Kuzmenkov	db15108005	add times speedup/slowdown to changed tests table	2020-07-31 01:14:20 +03:00
Alexander Kuzmenkov	e0c207d6b4	Update entrypoint.sh	2020-07-28 16:15:41 +03:00
Alexander Kuzmenkov	b6f2fde37e	performance comparison	2020-07-27 14:20:45 +03:00
Alexander Kuzmenkov	acf1e5fe7e	Choose proper old version for perf comparison	2020-07-23 18:17:11 +03:00
Alexander Kuzmenkov	186b2c3b1b	Support different query log format in perf test	2020-07-23 16:32:03 +03:00
Alexander Kuzmenkov	72167aa746	Update Dockerfile	2020-07-22 16:18:57 +03:00
Alexander Kuzmenkov	00acf4173c	Fixes for perf test after #12469	2020-07-15 16:38:02 +03:00
Alexander Kuzmenkov	57ad000c62	Update README.md	2020-07-14 16:46:19 +03:00
Alexander Kuzmenkov	5a15e03400	Improve data layout in perf test ... Also fix a bad test query found with new data.	2020-07-13 14:31:15 +03:00
Alexander Kuzmenkov	394cf20673	Merge remote-tracking branch 'origin/master' into HEAD	2020-07-09 13:46:54 +03:00
Alexander Kuzmenkov	cec35a0e1d	Update README.md	2020-07-08 15:07:01 +03:00
Alexander Kuzmenkov	c9162f6e77	Update README.md	2020-07-08 15:05:49 +03:00
Alexander Kuzmenkov	344e2713fa	Update README.md	2020-07-08 14:52:06 +03:00
Alexander Kuzmenkov	bd14d06476	Update README.md	2020-07-08 14:25:43 +03:00
Alexander Kuzmenkov	f514d0da77	Revert "Run perf tests with memory sampling (for allocations >1M)"	2020-07-07 19:59:42 +03:00
Azat Khuzhin	307c3c92a5	Run perf tests with memory sampling (for allocations >1M) ... This is to know the memory allocation size distribution, that can be obtained later from left-metric-log.tsv. This is an attempt to tune tcmalloc (new CPP version by google) to use lock-free part of the allocator for typical allocations (and it is a bad idea just to increase kMaxSize there, since number of allocation for each size class is also important). P.S. hope that this file will be applied, if no, then the same effect can be reached by tunning defaults in Settings.h Refs: #11590 Cc: @akuzm	2020-07-05 12:43:12 +03:00
Alexander Kuzmenkov	10b6f98ca6	fixup	2020-07-03 11:39:43 +03:00
Alexander Kuzmenkov	7d8a31aff3	Merge remote-tracking branch 'origin/master' into HEAD	2020-07-03 10:09:20 +03:00
Alexander Kuzmenkov	f50f8d936e	Merge remote-tracking branch 'origin/master' into HEAD	2020-07-02 10:19:26 +03:00
Alexander Kuzmenkov	41088c3416	Merge remote-tracking branch 'origin/master' into HEAD	2020-07-02 10:13:11 +03:00
Alexander Kuzmenkov	99514a7e24	fixup	2020-07-02 10:13:02 +03:00
Alexander Kuzmenkov	baec4093dd	Merge pull request #11993 from ClickHouse/aku/more-jemalloc-tweaks ... jemalloc: set muzzy_decay_ms = 10s	2020-06-30 22:51:21 +03:00
Alexander Kuzmenkov	7e2f6937e0	fixup	2020-06-30 12:45:19 +03:00
Alexander Kuzmenkov	b5f9e9de78	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-30 12:28:14 +03:00
Alexander Kuzmenkov	a4152cfb00	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-30 08:55:56 +03:00
Alexander Kuzmenkov	588ff8fcc1	Merge pull request #11989 from ClickHouse/aku/long-perf ... Try to enable long perf tests	2020-06-30 08:52:29 +03:00
Alexander Kuzmenkov	6d67c77e68	fixup	2020-06-29 17:09:51 +03:00
Alexander Kuzmenkov	1b49feae6b	Fixup	2020-06-29 11:29:40 +03:00
Alexander Kuzmenkov	960c455e0e	performance comparison	2020-06-27 04:15:58 +03:00
Alexander Kuzmenkov	8b82ff215f	muzzy decay 10 ms	2020-06-27 04:08:21 +03:00
Alexander Kuzmenkov	7e88cc15f1	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-27 04:00:26 +03:00
Alexander Kuzmenkov	459ebf1ea0	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-27 03:59:36 +03:00
Alexander Kuzmenkov	e0c4cc9135	performance comparison	2020-06-27 03:53:54 +03:00
Alexander Kuzmenkov	be57bc56d7	perf test: report queries with new functions separately	2020-06-27 03:45:00 +03:00
Alexander Kuzmenkov	c8b633fe47	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-26 21:01:40 +03:00
Alexander Kuzmenkov	41659e38ce	Update path to perf test package	2020-06-26 03:46:44 +03:00
Alexander Kuzmenkov	beb386674d	Update path to performance tests build	2020-06-26 00:58:38 +03:00
Alexander Kuzmenkov	e521d616fe	performance comparison	2020-06-25 23:42:29 +03:00
Alexander Kuzmenkov	58747df00c	Update docker/test/performance-comparison/perf.py	2020-06-25 09:35:21 +03:00
Alexander Kuzmenkov	865ebcda16	variadic return value was too new python	2020-06-25 01:21:02 +03:00
Alexander Kuzmenkov	ab809f59b9	memory usage settings	2020-06-23 15:30:45 +03:00
Alexander Kuzmenkov	bfba15d512	Explicitly mark short perftest queries	2020-06-23 15:09:54 +03:00
Alexander Kuzmenkov	eac6eb8c5a	report	2020-06-22 15:22:09 +03:00
Alexander Kuzmenkov	fbecf42dfc	report the number of errors	2020-06-20 01:41:15 +03:00
Alexander Kuzmenkov	cec65ce30d	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-19 22:34:50 +03:00
Alexander Kuzmenkov	1a3a19391c	Merge pull request #11711 from ClickHouse/fix_path_in_perftest ... Try fix performance test of Values format	2020-06-19 15:57:32 +03:00
Alexander Tokmakov	73af3befe6	Revert "specify path in config"	2020-06-19 01:45:45 +03:00
Alexander Tokmakov	53b9f15f53	fix	2020-06-18 13:20:01 +03:00
Alexander Kuzmenkov	2bc6de4b4e	performance comparison	2020-06-18 06:14:18 +03:00
Alexander Tokmakov	660ed26389	Merge branch 'master' into fix_path_in_perftest	2020-06-18 00:22:36 +03:00
Alexander Tokmakov	50b4671867	specify path in config	2020-06-16 21:29:55 +03:00
Alexander Tokmakov	1e50bae76e	override user_files_path	2020-06-16 18:13:28 +03:00
Alexander Kuzmenkov	8509079021	performance comparison	2020-06-16 14:06:11 +03:00
Alexander Kuzmenkov	cd769e5ebf	fixup	2020-06-16 11:21:15 +03:00
Alexander Kuzmenkov	4dc6254357	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-15 17:26:15 +03:00
Alexander Kuzmenkov	56869228a2	add flag to continue on errors	2020-06-12 21:28:07 +03:00
Alexander Kuzmenkov	5101708831	fixup	2020-06-12 18:11:33 +03:00
Alexander Kuzmenkov	0da6e1c9de	typo	2020-06-12 15:12:12 +03:00
Alexander Kuzmenkov	10a8021418	performance comparison	2020-06-12 00:58:45 +03:00
Alexander Kuzmenkov	7ba5063b7a	Add concurrent benchmark to performance test ... After the main test, run queries from `website.xml` in parallel using `clickhouse-benchmark`. This can be useful to test the effects of concurrency on performance. Comparison test can miss some effects because it always runs queries sequentially, and many of them are even single-threaded.	2020-06-12 00:24:56 +03:00
Alexander Kuzmenkov	d840a9990c	performance comparison	2020-06-11 23:39:26 +03:00
Alexander Kuzmenkov	e354bbc78c	Merge pull request #11588 from ClickHouse/aku/async-log ... Add system.asynchronous_metric_log	2020-06-11 16:10:35 +03:00
Alexander Kuzmenkov	1bd375c25e	performance comparison	2020-06-11 00:38:26 +03:00
Alexander Kuzmenkov	7b54ff02f0	Collect async metric log in perf test	2020-06-10 22:27:05 +03:00
Alexander Kuzmenkov	af1c8f8a5f	fixup	2020-06-10 02:57:31 +03:00
Alexander Kuzmenkov	5719549ee1	fixup	2020-06-09 16:29:07 +03:00
Alexander Kuzmenkov	6a3df071a2	fixup	2020-06-09 01:13:08 +03:00
Alexander Kuzmenkov	e2e5e1d5f8	More stable perf tests	2020-06-08 16:57:33 +03:00