964 Commits

Author	SHA1	Message	Date
Alexander Kuzmenkov	6671b26f20	fixes	2020-09-28 21:43:47 +03:00
Alexander Kuzmenkov	3d1456a55d	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-28 21:19:53 +03:00
alesapin	071ff6c9af	Merge pull request #15063 from azat/symbolizers-settings-for-non-server ... Set sanitizers options in the current shell too	2020-09-28 17:44:39 +03:00
Alexander Kuzmenkov	c48d212320	performance comparison	2020-09-28 15:09:08 +03:00
Alexander Kuzmenkov	1e7a0f0e5f	typo	2020-09-28 14:44:49 +03:00
alesapin	fff9e5d592	Merge branch 'master' into azat-symbolizers-settings-for-non-server	2020-09-28 12:31:05 +03:00
Alexander Tokmakov	b0d99217fb	Merge branch 'master' into write_structure_of_table_functions	2020-09-27 14:26:47 +03:00
Alexander Kuzmenkov	425150e783	bind to different nodes	2020-09-25 13:19:37 +03:00
Alexander Kuzmenkov	3ff16325d8	fix the profiler	2020-09-25 12:52:09 +03:00
Alexander Kuzmenkov	40209f9ed2	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-25 11:28:47 +03:00
Alexander Tokmakov	fb826557b7	Merge branch 'master' into enable_atomic_database_by_default	2020-09-25 02:04:01 +03:00
Alexander Kuzmenkov	4ed4205647	Update run.sh	2020-09-24 19:54:09 +03:00
tavplubix	1c9398c5ee	Merge pull request #15215 from ClickHouse/better_image_for_stateless ... Better images for CI tests	2020-09-24 18:54:34 +03:00
Vitaly Baranov	0605808ed1	Merge pull request #14492 from vitlibar/use-previous-users-xml-if-failed-to-reload ... Use previous users.xml if failed to reload	2020-09-24 16:25:19 +03:00
Alexander Kuzmenkov	651518566a	performance comparison	2020-09-24 16:24:44 +03:00
tavplubix	c298c633a7	Revert "Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka"	2020-09-24 16:10:24 +03:00
alesapin	cc305cf886	Fix fuzzer image	2020-09-24 15:34:03 +03:00
Alexander Kuzmenkov	dee34a834f	debug perf test run time	2020-09-24 14:46:03 +03:00
Alexander Kuzmenkov	41ad365eaf	Increase fast test threads to 8 ... Tests don't often fail in parallel (1/10 runs), so we can make them faster.	2020-09-24 14:11:59 +03:00
Alexander Kuzmenkov	26abe8cb30	Update compare.sh	2020-09-24 12:24:30 +03:00
alesapin	4f3eb4532a	Add missed changes	2020-09-24 11:37:20 +03:00
alesapin	bb8a2e1617	Better clickhouse-configs	2020-09-24 11:18:36 +03:00
alesapin	a85bb16c66	Remove zookeeper from CI images	2020-09-24 10:33:22 +03:00
Alexander Kuzmenkov	c2b11221a3	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-23 23:56:15 +03:00
Alexander Kuzmenkov	21f9cc65c9	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-23 23:54:55 +03:00
Alexander Kuzmenkov	179807b0b4	performance comparison	2020-09-23 23:45:39 +03:00
Alexander Tokmakov	f0f91f84af	Merge branch 'master' into enable_atomic_database_by_default	2020-09-23 21:50:15 +03:00
Ilya Yatsishin	7dad84ea6b	Merge pull request #14265 from arenadata/ADQM-160 ... Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka	2020-09-23 19:02:58 +03:00
Alexander Kuzmenkov	d96c89972c	Update compare.sh	2020-09-23 12:04:13 +03:00
Alexander Kuzmenkov	bb51aade56	Update docker/test/performance-comparison/compare.sh ... Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>	2020-09-23 12:02:22 +03:00
Alexander Kuzmenkov	833c07f1f7	Update compare.sh	2020-09-23 11:31:18 +03:00
Alexander Kuzmenkov	2b6f4134eb	Parallel create/fill in perf test	2020-09-23 11:22:54 +03:00
Alexander Kuzmenkov	5eaa2a08d4	Update report.py	2020-09-23 10:28:28 +03:00
alesapin	01237170af	Fix fast test CMakeOptions	2020-09-22 17:25:48 +03:00
Alexander Kuzmenkov	0b01e62050	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-22 14:29:54 +03:00
Alexander Kuzmenkov	4937159f85	Merge pull request #14990 from ClickHouse/aku/longer-perf ... If perf test definition changed, run everything + longer (as in master)	2020-09-22 13:25:49 +03:00
Alexander Tokmakov	dc1cc11764	Merge branch 'master' into enable_atomic_database_by_default	2020-09-22 12:40:32 +03:00
Alexander Tokmakov	639466afdb	fix docker images	2020-09-22 10:45:08 +03:00
Azat Khuzhin	3fd85430f2	Set sanitizers options in the current shell too ... /etc/environment will not be read in current shell, so export variables from that file manually, to make clickhouse-local/clickhouse-client use them too.	2020-09-21 23:57:45 +03:00
Alexander Kuzmenkov	4696e22799	Update perf.py	2020-09-21 22:08:41 +03:00
alexey-milovidov	5e56f14d5f	Merge pull request #15027 from ClickHouse/perf-test-separate-profiler ... Separate profile runs in performance test	2020-09-21 21:07:14 +03:00
Ilya Golshtein	494e59e7c1	DOCKER_KERBEROS_KDC_TAG	2020-09-21 19:12:31 +03:00
alesapin	084b40affe	Merge pull request #15069 from ClickHouse/fix_test_images ... Use llvm-symbolizer-11 in all test images.	2020-09-21 17:02:27 +03:00
Alexander Kuzmenkov	679c5278e4	reword the diagnostic about short queries in perf test	2020-09-21 15:14:47 +03:00
Alexander Kuzmenkov	2f8d7ae208	fix the conditions	2020-09-21 15:01:27 +03:00
Alexander Kuzmenkov	85be1f1685	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-21 14:57:25 +03:00
Alexander Tokmakov	13e41cdd20	try enable atomic database by default	2020-09-21 13:55:34 +03:00
alesapin	1bd76c820c	Back to 19.10	2020-09-21 12:05:10 +03:00
alesapin	fd469f1266	Remove redundant file	2020-09-21 10:41:23 +03:00
alesapin	27613f8346	Fix symbolizers path in test images	2020-09-21 10:38:11 +03:00
Vitaly Baranov	a288674867	Fix testflows tests.	2020-09-20 18:49:56 +03:00
Alexey Milovidov	ef800b5083	Perf test: development	2020-09-19 21:21:29 +03:00
Alexey Milovidov	35e8a895b6	Calculate profiler data in separate query runs	2020-09-19 20:38:21 +03:00
Alexey Milovidov	03aec83aec	Remove obsolete code from performance test	2020-09-19 19:27:37 +03:00
Alexander Tokmakov	1ca9a92b21	Merge branch 'master' into write_structure_of_table_functions	2020-09-18 21:09:23 +03:00
Alexander Kuzmenkov	8995140ffb	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-18 18:06:41 +03:00
Alexander Kuzmenkov	840586bd98	Merge pull request #14386 from ClickHouse/aku/perf-short ... [wip] an experiment with short queries in perf test	2020-09-18 17:54:50 +03:00
Alexander Kuzmenkov	e7b9319e12	If perf test definition changed, run everything + longer (as in master) ... Also some other perf test fixes	2020-09-18 16:28:46 +03:00
Alexander Kuzmenkov	cfc975d759	Merge pull request #14724 from ClickHouse/aku/perf-some ... Run only some queries in perf tests, not all combos	2020-09-18 13:13:28 +03:00
Alexander Kuzmenkov	7f029ee03c	Update perf.py	2020-09-18 11:27:27 +03:00
Alexey Milovidov	799a675b5d	Merge branch 'master' into AES_encrypt_decrypt	2020-09-17 21:42:51 +03:00
Alexander Kuzmenkov	4fc86f05da	some fixes + docs + report queries that are not short	2020-09-17 19:21:59 +03:00
Alexander Kuzmenkov	b1d7df80cd	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-17 18:20:14 +03:00
Ilya Golshtein	624a4c4d55	kdc Dockerfile integrated	2020-09-17 16:51:34 +03:00
Ilya Golshtein	c227f91636	remove_files improved, proper docker images, tiny cleanup	2020-09-17 16:51:34 +03:00
Ilya Golshtein	a2e72ec37a	test via runner is Ok, switched to custom images	2020-09-17 16:51:34 +03:00
Ilya Golshtein	7a6f7a872a	forgotten docker changes	2020-09-17 16:51:34 +03:00
Ilya Golshtein	c12fa26fe3	kerberized kafka test works	2020-09-17 16:51:34 +03:00
Alexander Kuzmenkov	ada1c7c4a0	fixup	2020-09-17 13:15:46 +03:00
alesapin	50c55eb2d2	Merge pull request #14846 from ClickHouse/add_clang_11 ... Move to clang-11 in CI builds	2020-09-17 13:14:00 +03:00
Alexander Kuzmenkov	dda88eebd1	test again	2020-09-16 18:35:27 +03:00
Alexander Kuzmenkov	d55e3cd214	Update perf.py	2020-09-16 14:39:44 +03:00
Alexander Kuzmenkov	3b8ca1f262	Update compare.sh	2020-09-16 12:16:07 +03:00
Alexander Kuzmenkov	c5c5faf8ee	fixup	2020-09-16 12:06:42 +03:00
Alexander Kuzmenkov	e333a7bad4	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-16 12:05:22 +03:00
alesapin	d144421214	Disable lto for glibc-compatibility	2020-09-16 10:46:38 +03:00
alexey-milovidov	018f596d21	Merge pull request #14685 from ClickHouse/remap-executable ... Attempt to make performance test more reliable	2020-09-15 15:09:47 +03:00
Alexander Kuzmenkov	df95f91d7c	Merge remote-tracking branch 'origin/master' into HEAD	2020-09-15 13:53:50 +03:00
Alexander Kuzmenkov	24dd33d5cb	Update compare.sh	2020-09-15 13:44:21 +03:00
Alexander Tokmakov	da6beb1a91	Merge branch 'master' into enable_some_tests_with_database_atomic	2020-09-14 23:00:14 +03:00
Alexey Milovidov	b87c108246	Enable remap in performance tests	2020-09-14 21:14:28 +03:00
Alexander Kuzmenkov	ab6bc1ed59	Update compare.sh	2020-09-14 20:25:17 +03:00
Alexander Kuzmenkov	9e3797b252	Merge pull request #14710 from ClickHouse/aku/faster-perf ... Do less runs in perf test	2020-09-14 19:17:34 +03:00
Alexander Kuzmenkov	b3138605c7	performance comparison	2020-09-14 19:16:59 +03:00
Vasily Nemkov	b980cf354a	Moving to TestFlows version 1.6.46	2020-09-14 18:24:57 +03:00
Alexander Kuzmenkov	3113aa6cfe	Avoid extra error in perf report on broken queries	2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov	c701a15271	fixup	2020-09-14 10:27:46 +03:00
Vitaliy Zakaznikov	bb1d126ce5	Updating TestFlows to 1.6.45 to fix stability issues with multi line commands.	2020-09-10 22:54:40 +03:00
Alexander Kuzmenkov	8689797efc	Run only some queries in perf tests, not all combos	2020-09-10 19:57:26 +03:00
Alexander Kuzmenkov	26348ad014	fixup	2020-09-10 18:48:39 +03:00
Alexander Kuzmenkov	ca2a33008b	faster	2020-09-10 17:55:54 +03:00
Nikita Mikhaylov	44726c37c3	Merge branch 'master' into fix-executable-dictionary-source-hangup	2020-09-09 23:01:41 +04:00
Alexander Tokmakov	d278d849e4	Merge branch 'master' into write_structure_of_table_functions	2020-09-09 17:12:35 +03:00
Alexander Tokmakov	b68782d285	enable more tests with Atomic database	2020-09-09 16:32:50 +03:00
Anton Popov	032f4ba6f3	Merge pull request #14532 from CurtizJ/fix-redis-test ... Rework test for redis dictionary	2020-09-09 02:38:09 +03:00
robot-clickhouse	8def718661	Auto version update to [20.10.1.1] [54440]	2020-09-08 17:04:41 +03:00
alesapin	c40ba48822	Raise on error	2020-09-08 11:49:24 +03:00
alesapin	1a1bccf416	Add sleeps	2020-09-08 11:45:22 +03:00
alesapin	73253f058d	Add sleep	2020-09-08 11:45:01 +03:00
alesapin	0193a132d4	Add retries to s3 downloader	2020-09-08 11:43:02 +03:00
Anton Popov	9493532fdb	rework test for redis dictionary	2020-09-07 14:16:47 +03:00
Alexander Kuzmenkov	f7d631bf82	use fasttest script from sources	2020-09-07 13:19:01 +03:00
Alexey Milovidov	04a6965006	Fix error with executable dictionary source	2020-09-07 09:40:01 +03:00
Alexander Kuzmenkov	0904433c87	Temporarily remove UInt256 perf test broken in https://github.com/ClickHouse/ClickHouse/pull/14229 ... Also add one more timeout to perf test runner.	2020-09-07 09:33:57 +03:00
Alexander Kuzmenkov	1978968067	performance comparison	2020-09-07 02:49:34 +03:00
Vitaly Baranov	81db73f066	Merge pull request #13647 from qoega/integration-explicit-configs ... Add explicit main_configs, user_configs and dictionaries in integration tests	2020-09-04 20:16:00 +03:00
Alexander Tokmakov	ed5f827708	Merge branch 'master' into write_structure_of_table_functions	2020-09-04 16:38:57 +03:00
alesapin	5d897231e1	Merge pull request #14432 from ClickHouse/minor-changes-in-stateful-tests ... Wait for clickhouse-server to start in stateful tests	2020-09-04 13:12:32 +03:00
Alexander Tokmakov	b840d741d0	Merge branch 'master' into write_structure_of_table_functions	2020-09-04 13:00:07 +03:00
Alexander Tokmakov	df09bf3cb6	add suppressions for leak sanitizer	2020-09-03 22:50:26 +03:00
alexey-milovidov	fb56d0b9a3	Update run.sh	2020-09-03 21:21:27 +03:00
Alexander Kuzmenkov	29b97ff259	Merge pull request #14430 from ClickHouse/aku/perf4 ... [wip] perf experiment no.4 -- geomean	2020-09-03 21:13:07 +03:00
Vasily Nemkov	9ba4613381	Excluding tests from fasttest runs since they depend on external libraries: OpenSSL	2020-09-03 16:12:32 +03:00
Yatsishin Ilya	14b61e87d9	mysql bin log	2020-09-03 13:27:17 +03:00
Yatsishin Ilya	fc075e65da	Merge remote-tracking branch 'origin' into integration-explicit-configs	2020-09-03 11:49:48 +03:00
Alexey Milovidov	cd812d94de	Wait for clickhouse-server to start in stateful tests	2020-09-03 04:54:50 +03:00
Alexander Kuzmenkov	a321d6970c	adjust report and increase time	2020-09-03 04:42:25 +03:00
Alexander Kuzmenkov	8e8e195e45	geomean	2020-09-03 03:58:40 +03:00
alesapin	12f76d9448	Merge pull request #14325 from azat/suppress-wget-output ... Suppress superfluous wget (-nv) output	2020-09-02 14:59:28 +03:00
Yatsishin Ilya	5ab9f249e5	Merge branch 'try-dns-fix' into integration-explicit-configs	2020-09-02 12:53:10 +03:00
Yatsishin Ilya	6902bbce50	Merge remote-tracking branch 'origin' into integration-explicit-configs	2020-09-02 12:48:07 +03:00
Yatsishin Ilya	5d39b8ce04	unnecessary change	2020-09-02 11:39:16 +03:00
Alexander Kuzmenkov	00c924b0dd	whitespace	2020-09-02 06:31:53 +03:00
Alexander Kuzmenkov	5fcb9bd163	short queries	2020-09-02 06:29:36 +03:00
Alexander Kuzmenkov	e622e108f7	readme	2020-09-02 06:29:16 +03:00
Alexander Kuzmenkov	0db5b4a72c	Remove concurrent benchmark from the perf test ... It's not stable enough and has only secondary utility.	2020-09-02 02:43:23 +03:00
Alexander Kuzmenkov	f6cfb96748	Merge pull request #14346 from ClickHouse/aku/fuzzer ... Don't let the fuzzer change max_execution_time	2020-09-02 01:59:50 +03:00
Anton Popov	7c3712c121	Merge pull request #13688 from it1804/master ... Redis dictionary support for simple Redis requirepass authorization	2020-09-02 01:43:02 +03:00
Alexander Kuzmenkov	a6486490a2	performance comparison	2020-09-01 22:05:57 +03:00
Alexander Kuzmenkov	0b70abe542	Don't let the fuzzer change max_execution_time	2020-09-01 18:51:46 +03:00
Alexander Kuzmenkov	2f3bb5844a	Merge branch 'master' into suppress-wget-output	2020-09-01 16:59:04 +03:00
Alexander Kuzmenkov	4620ac4c0d	Update docker/test/fuzzer/run-fuzzer.sh	2020-09-01 16:57:20 +03:00
Alexander Kuzmenkov	4e58f00305	Update docker/test/fuzzer/run-fuzzer.sh	2020-09-01 16:57:13 +03:00
Alexander Kuzmenkov	73d433a7dd	Merge pull request #14316 from ClickHouse/aku/html-fuzzer ... Add a HTML report for AST Fuzzer	2020-09-01 16:46:30 +03:00
Azat Khuzhin	2d7cb03120	Suppress superfluous wget (-nv) output ... Since for dowloading some of files wget logging may take 50% of overall log [1]. [1]: https://clickhouse-builds.s3.yandex.net/14315/c32ff4c98cb3b83a12f945eadd180415b7a3b269/clickhouse_build_check/build_log_761119955_1598923036.txt	2020-09-01 10:25:13 +03:00
Yatsishin Ilya	6cb893f073	Draft.	2020-09-01 09:38:23 +03:00
Alexander Kuzmenkov	33c5815eb3	Add a HTML report for AST Fuzzer	2020-09-01 02:33:42 +03:00
robot-clickhouse	e2fa0eae2f	Auto version update to [20.9.1.1] [54439]	2020-08-31 23:07:41 +03:00
Alexander Kuzmenkov	bc8765d5ad	Merge pull request #14095 from azat/DistributedFilesToInsert-fix ... Fix DistributedFilesToInsert metric (zeroed when it should not)	2020-08-31 18:58:30 +03:00
Alexander Kuzmenkov	b601dd4596	cosmetic fixes for performance report	2020-08-29 01:46:04 +03:00
Alexander Kuzmenkov	bb28320107	cosmetic fixes in performance report	2020-08-29 01:14:48 +03:00
Azat Khuzhin	a384194216	Add a test for DistributedFilesToInsert	2020-08-27 22:00:35 +03:00
Ilya Yatsishin	7509991d82	Merge pull request #14167 from qoega/docker-test-base ... Switch docker tests to use test-base	2020-08-27 16:45:55 +03:00
alexey-milovidov	e1cf919c93	Merge pull request #14112 from vzakaznikov/testflows_increase_compose_http_timeout_and_retry_docker_compose_up ... testflows: adding retry logic when bringing up docker-compose cluster	2020-08-27 15:51:16 +03:00
Alexander Tokmakov	65a69ff6ad	move docker-compose files	2020-08-27 14:46:19 +03:00
Yatsishin Ilya	bfe4e94806	Switch docker tests to use test-base	2020-08-27 13:17:17 +03:00
Alexey Milovidov	fe5cfe3151	Increase number of threads in stress test	2020-08-26 23:39:02 +03:00
Alexey Milovidov	0bfe78636c	Increase number of threads in stress test	2020-08-26 23:38:20 +03:00
alexey-milovidov	f62037e9dc	Update stress	2020-08-26 20:45:36 +03:00
Alexey Milovidov	07596b5323	Limit stress test to one hour	2020-08-26 20:44:03 +03:00