291 Commits

Author	SHA1	Message	Date
Alexander Kuzmenkov	8d5fe1148c	add client config	2020-11-04 18:07:34 +03:00
Alexander Kuzmenkov	5cb708a50a	fixup	2020-11-04 04:19:53 +03:00
Alexander Kuzmenkov	4245c470ac	fixes	2020-11-03 17:37:54 +03:00
Alexander Kuzmenkov	a25996ed8d	Upload perf test results to the CI database	2020-11-03 02:10:19 +03:00
Mikhail Filimonov	41971e073a	Fix typos reported by codespell	2020-10-27 12:04:03 +01:00
Alexander Kuzmenkov	e27dd538fd	performance comparison	2020-10-26 19:35:37 +03:00
Alexander Kuzmenkov	ac7af67ede	fixup	2020-10-22 15:52:43 +03:00
Alexander Kuzmenkov	c10dada3d4	try node 1	2020-10-21 18:06:42 +03:00
Alexander Kuzmenkov	242ec7e56c	make some tests faster	2020-10-20 15:12:06 +03:00
Alexander Kuzmenkov	38a2dd55ce	fix numactl parameters	2020-10-19 17:31:02 +03:00
Alexander Kuzmenkov	2241ea9f33	not sure what's going on...	2020-10-16 17:44:59 +03:00
Alexander Kuzmenkov	74f8e41b55	calculate on all nodes	2020-10-01 13:56:56 +03:00
Alexander Kuzmenkov	824d5b093c	bind everything to node 0	2020-09-30 14:32:49 +03:00
Alexander Kuzmenkov	dc15bceadc	Merge remote-tracking branch 'origin/aku/debug-perf' into HEAD	2020-09-29 16:41:38 +03:00
Alexander Kuzmenkov	ac4f0cdf22	fix	2020-09-29 14:07:31 +03:00
Alexander Kuzmenkov	6671b26f20	fixes	2020-09-28 21:43:47 +03:00
Alexander Kuzmenkov	1e7a0f0e5f	typo	2020-09-28 14:44:49 +03:00
Alexander Kuzmenkov	425150e783	bind to different nodes	2020-09-25 13:19:37 +03:00
Alexander Kuzmenkov	3ff16325d8	fix the profiler	2020-09-25 12:52:09 +03:00
Alexander Kuzmenkov	dee34a834f	debug perf test run time	2020-09-24 14:46:03 +03:00
Alexander Kuzmenkov	26abe8cb30	Update compare.sh	2020-09-24 12:24:30 +03:00
Alexander Kuzmenkov	d96c89972c	Update compare.sh	2020-09-23 12:04:13 +03:00
Alexander Kuzmenkov	bb51aade56	Update docker/test/performance-comparison/compare.sh ... Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>	2020-09-23 12:02:22 +03:00
Alexander Kuzmenkov	833c07f1f7	Update compare.sh	2020-09-23 11:31:18 +03:00
Alexander Kuzmenkov	2b6f4134eb	Parallel create/fill in perf test	2020-09-23 11:22:54 +03:00
Alexander Kuzmenkov	0b01e62050	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-22 14:29:54 +03:00
Alexander Kuzmenkov	4937159f85	Merge pull request #14990 from ClickHouse/aku/longer-perf ... If perf test definition changed, run everything + longer (as in master)	2020-09-22 13:25:49 +03:00
Alexander Kuzmenkov	679c5278e4	reword the diagnostic about short queries in perf test	2020-09-21 15:14:47 +03:00
Alexander Kuzmenkov	2f8d7ae208	fix the conditions	2020-09-21 15:01:27 +03:00
Alexander Kuzmenkov	8995140ffb	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-18 18:06:41 +03:00
Alexander Kuzmenkov	840586bd98	Merge pull request #14386 from ClickHouse/aku/perf-short ... [wip] an experiment with short queries in perf test	2020-09-18 17:54:50 +03:00
Alexander Kuzmenkov	e7b9319e12	If perf test definition changed, run everything + longer (as in master) ... Also some other perf test fixes	2020-09-18 16:28:46 +03:00
Alexander Kuzmenkov	4fc86f05da	some fixes + docs + report queries that are not short	2020-09-17 19:21:59 +03:00
Alexander Kuzmenkov	dda88eebd1	test again	2020-09-16 18:35:27 +03:00
Alexander Kuzmenkov	3b8ca1f262	Update compare.sh	2020-09-16 12:16:07 +03:00
Alexander Kuzmenkov	c5c5faf8ee	fixup	2020-09-16 12:06:42 +03:00
Alexander Kuzmenkov	e333a7bad4	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-16 12:05:22 +03:00
Alexander Kuzmenkov	df95f91d7c	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-15 13:53:50 +03:00
Alexander Kuzmenkov	24dd33d5cb	Update compare.sh	2020-09-15 13:44:21 +03:00
Alexander Kuzmenkov	ab6bc1ed59	Update compare.sh	2020-09-14 20:25:17 +03:00
Alexander Kuzmenkov	b3138605c7	performance comparison	2020-09-14 19:16:59 +03:00
Alexander Kuzmenkov	3113aa6cfe	Avoid extra error in perf report on broken queries	2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov	8689797efc	Run only some queries in perf tests, not all combos	2020-09-10 19:57:26 +03:00
Alexander Kuzmenkov	1978968067	performance comparison	2020-09-07 02:49:34 +03:00
Alexander Kuzmenkov	a321d6970c	adjust report and increase time	2020-09-03 04:42:25 +03:00
Alexander Kuzmenkov	8e8e195e45	geomean	2020-09-03 03:58:40 +03:00
Alexander Kuzmenkov	00c924b0dd	whitespace	2020-09-02 06:31:53 +03:00
Alexander Kuzmenkov	0db5b4a72c	Remove concurrent benchmark from the perf test ... It's not stable enough and has only secondary utility.	2020-09-02 02:43:23 +03:00
Alexander Kuzmenkov	a6486490a2	performance comparison	2020-09-01 22:05:57 +03:00
Alexander Kuzmenkov	a348bc4641	performance comparison	2020-08-24 17:15:11 +03:00
Alexander Kuzmenkov	f43457454e	warn on undefined shell variables	2020-08-19 18:34:23 +03:00
Alexander Kuzmenkov	e9ad81b362	shellcheck	2020-08-19 18:31:13 +03:00
Alexander Kuzmenkov	000326b627	Avoid timeouts in perf test	2020-08-19 18:08:23 +03:00
Alexander Kuzmenkov	5a97f0c19e	performance comparison	2020-08-11 14:53:25 +03:00
Alexander Kuzmenkov	88aa371e0c	performance comparison	2020-08-06 02:02:52 +03:00
Alexander Kuzmenkov	d1554e76ec	Merge remote-tracking branch 'origin/master' into HEAD	2020-08-06 00:59:25 +03:00
Alexander Kuzmenkov	ff3f378e8a	try to rebuild package for 2b7c0167cb	2020-08-06 00:58:56 +03:00
alexey-milovidov	935533e841	Merge pull request #13193 from ClickHouse/aku/spurious-perf ... Fix some spurious perf test failures	2020-08-03 01:02:53 +03:00
Alexander Kuzmenkov	a317f995be	performance comparison	2020-07-31 22:58:38 +03:00
Alexander Kuzmenkov	1d954581eb	Fix some spurious perf test failures	2020-07-31 19:28:04 +03:00
Alexander Kuzmenkov	42e5f8ec44	Update compare.sh	2020-07-31 03:49:36 +03:00
Alexander Kuzmenkov	db15108005	add times speedup/slowdown to changed tests table	2020-07-31 01:14:20 +03:00
Alexander Kuzmenkov	0e20507539	Update compare.sh	2020-07-30 17:26:47 +03:00
Alexander Kuzmenkov	15cd448afa	Update compare.sh	2020-07-23 17:59:32 +03:00
Alexander Kuzmenkov	186b2c3b1b	Support different query log format in perf test	2020-07-23 16:32:03 +03:00
Alexander Kuzmenkov	2b7c0167cb	Update compare.sh	2020-07-22 21:02:56 +03:00
Alexander Kuzmenkov	3d89f0e9df	Perf test: bind server to one NUMA node	2020-07-21 15:41:14 +03:00
Alexander Kuzmenkov	00acf4173c	Fixes for perf test after #12469	2020-07-15 16:38:02 +03:00
Alexander Kuzmenkov	5a15e03400	Improve data layout in perf test ... Also fix a bad test query found with new data.	2020-07-13 14:31:15 +03:00
Alexander Kuzmenkov	10b6f98ca6	fixup	2020-07-03 11:39:43 +03:00
Alexander Kuzmenkov	7d8a31aff3	Merge remote-tracking branch 'origin/master' into HEAD	2020-07-03 10:09:20 +03:00
Alexander Kuzmenkov	99514a7e24	fixup	2020-07-02 10:13:02 +03:00
Alexander Kuzmenkov	b5f9e9de78	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-30 12:28:14 +03:00
Alexander Kuzmenkov	a4152cfb00	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-30 08:55:56 +03:00
Alexander Kuzmenkov	1b49feae6b	Fixup	2020-06-29 11:29:40 +03:00
Alexander Kuzmenkov	960c455e0e	performance comparison	2020-06-27 04:15:58 +03:00
Alexander Kuzmenkov	7e88cc15f1	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-27 04:00:26 +03:00
Alexander Kuzmenkov	459ebf1ea0	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-27 03:59:36 +03:00
Alexander Kuzmenkov	e0c4cc9135	performance comparison	2020-06-27 03:53:54 +03:00
Alexander Kuzmenkov	be57bc56d7	perf test: report queries with new functions separately	2020-06-27 03:45:00 +03:00
Alexander Kuzmenkov	c8b633fe47	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-26 21:01:40 +03:00
Alexander Kuzmenkov	e521d616fe	performance comparison	2020-06-25 23:42:29 +03:00
Alexander Kuzmenkov	ab809f59b9	memory usage settings	2020-06-23 15:30:45 +03:00
Alexander Kuzmenkov	bfba15d512	Explicitly mark short perftest queries	2020-06-23 15:09:54 +03:00
Alexander Kuzmenkov	cec65ce30d	Merge remote-tracking branch 'origin/master' into HEAD	2020-06-19 22:34:50 +03:00
Alexander Tokmakov	73af3befe6	Revert "specify path in config"	2020-06-19 01:45:45 +03:00
Alexander Tokmakov	53b9f15f53	fix	2020-06-18 13:20:01 +03:00
Alexander Tokmakov	50b4671867	specify path in config	2020-06-16 21:29:55 +03:00
Alexander Tokmakov	1e50bae76e	override user_files_path	2020-06-16 18:13:28 +03:00
Alexander Kuzmenkov	cd769e5ebf	fixup	2020-06-16 11:21:15 +03:00
Alexander Kuzmenkov	56869228a2	add flag to continue on errors	2020-06-12 21:28:07 +03:00
Alexander Kuzmenkov	5101708831	fixup	2020-06-12 18:11:33 +03:00
Alexander Kuzmenkov	0da6e1c9de	typo	2020-06-12 15:12:12 +03:00
Alexander Kuzmenkov	7ba5063b7a	Add concurrent benchmark to performance test ... After the main test, run queries from `website.xml` in parallel using `clickhouse-benchmark`. This can be useful to test the effects of concurrency on performance. Comparison test can miss some effects because it always runs queries sequentially, and many of them are even single-threaded.	2020-06-12 00:24:56 +03:00
Alexander Kuzmenkov	7b54ff02f0	Collect async metric log in perf test	2020-06-10 22:27:05 +03:00
Alexander Kuzmenkov	af1c8f8a5f	fixup	2020-06-10 02:57:31 +03:00
Alexander Kuzmenkov	5719549ee1	fixup	2020-06-09 16:29:07 +03:00
Alexander Kuzmenkov	6a3df071a2	fixup	2020-06-09 01:13:08 +03:00
Alexander Kuzmenkov	e2e5e1d5f8	More stable perf tests	2020-06-08 16:57:33 +03:00
Alexander Kuzmenkov	29adb1cbcf	performance comparison	2020-06-05 17:30:26 +03:00
Alexander Kuzmenkov	ca5d7cf5bb	fix some broken performance tests	2020-05-28 10:45:03 +03:00
Alexander Kuzmenkov	bf3f76be7f	performance comparison	2020-05-25 04:42:56 +03:00
Alexander Kuzmenkov	5a9f47e6b0	performance comparison	2020-05-25 04:03:46 +03:00
Alexander Kuzmenkov	51a064aa75	performance comparison	2020-05-22 23:09:44 +03:00
Alexander Kuzmenkov	7b747fabe2	performance comparison	2020-05-22 02:04:04 +03:00
Alexander Kuzmenkov	34508b8f64	[wip] Add memory stats to performance test	2020-05-21 05:12:55 +03:00
Alexander Kuzmenkov	ef6f386ee6	Merge pull request #11026 from ClickHouse/aku/trace-log ... Add more logs to debug trace_log overflow	2020-05-19 17:56:06 +03:00
Alexander Kuzmenkov	a700b527ce	fixup	2020-05-19 17:51:51 +03:00
Alexander Kuzmenkov	c34ea27362	performance comparison	2020-05-19 00:15:33 +03:00
Alexander Kuzmenkov	a54773f947	Add more logs to debug trace_log overflow	2020-05-18 22:33:12 +03:00
Alexander Kuzmenkov	bb726b2d8d	Update compare.sh	2020-05-14 13:54:07 +03:00
Alexander Kuzmenkov	5aadd628f1	performance comparison	2020-04-30 11:36:51 +03:00
Alexander Kuzmenkov	d952e5aba2	performance comparison	2020-04-29 20:26:28 +03:00
Alexander Kuzmenkov	095ef4b32c	performance comparison	2020-04-29 19:28:00 +03:00
Alexander Kuzmenkov	884db5c12e	performance comparison	2020-04-29 12:47:17 +03:00
Alexander Kuzmenkov	cf63174139	performance comparison	2020-04-28 17:27:24 +03:00
Alexander Kuzmenkov	ed1576507b	performance comparison	2020-04-28 10:45:56 +03:00
Alexander Kuzmenkov	9480210236	performance comparison	2020-04-27 15:48:17 +03:00
tavplubix	7928f2eaa1	Merge pull request #7512 from ClickHouse/database_atomic ... DatabaseAtomic	2020-04-24 22:28:18 +03:00
Alexander Kuzmenkov	93e49ae10f	performance comparison	2020-04-24 10:19:50 +03:00
Alexander Kuzmenkov	79c5b7cc9f	performance comparison	2020-04-24 06:23:38 +03:00
Alexander Kuzmenkov	1bf02d459c	performance comparison	2020-04-23 23:19:04 +03:00
Alexander Tokmakov	04d6b59ac0	Merge branch 'master' into database_atomic	2020-04-23 17:31:37 +03:00
Alexander Kuzmenkov	d99f516fa6	performance comparison	2020-04-23 11:44:49 +03:00
Alexander Kuzmenkov	631c810500	performance comparison	2020-04-22 22:42:00 +03:00
Alexander Tokmakov	fefbbd37df	Merge branch 'master' into database_atomic	2020-04-22 17:02:30 +03:00
Alexander Kuzmenkov	3b1334ee1b	performance comparison	2020-04-22 16:11:46 +03:00
Alexander Kuzmenkov	627dfe103f	performance comparison	2020-04-22 04:50:21 +03:00
Alexander Kuzmenkov	1c997dcb7c	performance comparison	2020-04-22 01:08:24 +03:00
Alexander Kuzmenkov	f2290bf2ee	performance comparison	2020-04-21 21:46:45 +03:00
Alexander Tokmakov	b29bddac12	Merge branch 'master' into database_atomic	2020-04-20 14:09:09 +03:00
Alexander Kuzmenkov	41473d090d	performance comparison	2020-04-17 18:47:01 +03:00
Alexander Kuzmenkov	e59aaa88f8	Update compare.sh	2020-04-17 16:32:59 +03:00
Alexander Kuzmenkov	def6817ede	Update compare.sh	2020-04-13 22:06:07 +03:00
Alexander Tokmakov	d1024e76bd	fix	2020-04-13 18:46:36 +03:00
Alexander Kuzmenkov	aadb05cbe3	performance comparison	2020-04-07 20:55:39 +03:00
Alexander Kuzmenkov	2e804173a9	performance comparison	2020-04-07 03:29:44 +03:00
Alexander Kuzmenkov	9465f97832	performance comparison	2020-04-03 21:23:11 +03:00
Alexander Kuzmenkov	882e0d8b4e	Update compare.sh	2020-04-03 13:00:23 +03:00
Alexander Kuzmenkov	cd88b5380c	Performance comparison fixes	2020-04-02 21:44:58 +03:00
Alexander Kuzmenkov	f576cab761	performance comparison	2020-03-26 03:09:43 +03:00
Alexander Kuzmenkov	5fd5b15c36	performance comparison	2020-03-24 20:33:42 +03:00
Alexander Kuzmenkov	d396a7c650	Some tweaks for performance comparison	2020-03-23 12:39:12 +03:00
Alexander Kuzmenkov	56c4b49844	performance comparison	2020-03-18 04:29:32 +03:00
Alexander Kuzmenkov	f4ea37fa3b	peformance comparison	2020-03-17 19:37:26 +03:00
Alexander Kuzmenkov	f6d745de7f	performance comparison	2020-03-17 05:42:13 +03:00
alexey-milovidov	930f2bae54	Merge pull request #9611 from ClickHouse/aku/fix-some-perf-tests ... Fix some performance tests	2020-03-13 22:30:26 +03:00
Alexander Kuzmenkov	7e6585328f	fixup	2020-03-13 16:30:54 +03:00
Alexander Kuzmenkov	e8f9e4d5fd	performance comparison	2020-03-12 19:21:58 +03:00
Alexander Kuzmenkov	553e5a8867	performance comparison	2020-03-12 17:24:18 +03:00