864 Commits

Author	SHA1	Message	Date
Alexander Kuzmenkov	b3138605c7	performance comparison	2020-09-14 19:16:59 +03:00
Alexander Kuzmenkov	3113aa6cfe	Avoid extra error in perf report on broken queries	2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov	c701a15271	fixup	2020-09-14 10:27:46 +03:00
Alexander Kuzmenkov	8689797efc	Run only some queries in perf tests, not all combos	2020-09-10 19:57:26 +03:00
Alexander Kuzmenkov	26348ad014	fixup	2020-09-10 18:48:39 +03:00
Alexander Kuzmenkov	ca2a33008b	faster	2020-09-10 17:55:54 +03:00
Nikita Mikhaylov	44726c37c3	Merge branch 'master' into fix-executable-dictionary-source-hangup	2020-09-09 23:01:41 +04:00
Alexander Tokmakov	b68782d285	enable more tests with Atomic database	2020-09-09 16:32:50 +03:00
Anton Popov	032f4ba6f3	Merge pull request #14532 from CurtizJ/fix-redis-test ... Rework test for redis dictionary	2020-09-09 02:38:09 +03:00
robot-clickhouse	8def718661	Auto version update to [20.10.1.1] [54440]	2020-09-08 17:04:41 +03:00
alesapin	c40ba48822	Raise on error	2020-09-08 11:49:24 +03:00
alesapin	1a1bccf416	Add sleeps	2020-09-08 11:45:22 +03:00
alesapin	73253f058d	Add sleep	2020-09-08 11:45:01 +03:00
alesapin	0193a132d4	Add retries to s3 downloader	2020-09-08 11:43:02 +03:00
Anton Popov	9493532fdb	rework test for redis dictionary	2020-09-07 14:16:47 +03:00
Alexander Kuzmenkov	f7d631bf82	use fasttest script from sources	2020-09-07 13:19:01 +03:00
Alexey Milovidov	04a6965006	Fix error with executable dictionary source	2020-09-07 09:40:01 +03:00
Alexander Kuzmenkov	0904433c87	Temporarily remove UInt256 perf test broken in https://github.com/ClickHouse/ClickHouse/pull/14229 ... Also add one more timeout to perf test runner.	2020-09-07 09:33:57 +03:00
Alexander Kuzmenkov	1978968067	performance comparison	2020-09-07 02:49:34 +03:00
Vitaly Baranov	81db73f066	Merge pull request #13647 from qoega/integration-explicit-configs ... Add explicit main_configs, user_configs and dictionaries in integration tests	2020-09-04 20:16:00 +03:00
alesapin	5d897231e1	Merge pull request #14432 from ClickHouse/minor-changes-in-stateful-tests ... Wait for clickhouse-server to start in stateful tests	2020-09-04 13:12:32 +03:00
alexey-milovidov	fb56d0b9a3	Update run.sh	2020-09-03 21:21:27 +03:00
Alexander Kuzmenkov	29b97ff259	Merge pull request #14430 from ClickHouse/aku/perf4 ... [wip] perf experiment no.4 -- geomean	2020-09-03 21:13:07 +03:00
Yatsishin Ilya	14b61e87d9	mysql bin log	2020-09-03 13:27:17 +03:00
Yatsishin Ilya	fc075e65da	Merge remote-tracking branch 'origin' into integration-explicit-configs	2020-09-03 11:49:48 +03:00
Alexey Milovidov	cd812d94de	Wait for clickhouse-server to start in stateful tests	2020-09-03 04:54:50 +03:00
Alexander Kuzmenkov	a321d6970c	adjust report and increase time	2020-09-03 04:42:25 +03:00
Alexander Kuzmenkov	8e8e195e45	geomean	2020-09-03 03:58:40 +03:00
alesapin	12f76d9448	Merge pull request #14325 from azat/suppress-wget-output ... Suppress superfluous wget (-nv) output	2020-09-02 14:59:28 +03:00
Yatsishin Ilya	5ab9f249e5	Merge branch 'try-dns-fix' into integration-explicit-configs	2020-09-02 12:53:10 +03:00
Yatsishin Ilya	6902bbce50	Merge remote-tracking branch 'origin' into integration-explicit-configs	2020-09-02 12:48:07 +03:00
Yatsishin Ilya	5d39b8ce04	unnecessary change	2020-09-02 11:39:16 +03:00
Alexander Kuzmenkov	00c924b0dd	whitespace	2020-09-02 06:31:53 +03:00
Alexander Kuzmenkov	5fcb9bd163	short queries	2020-09-02 06:29:36 +03:00
Alexander Kuzmenkov	e622e108f7	readme	2020-09-02 06:29:16 +03:00
Alexander Kuzmenkov	0db5b4a72c	Remove concurrent benchmark from the perf test ... It's not stable enough and has only secondary utility.	2020-09-02 02:43:23 +03:00
Alexander Kuzmenkov	f6cfb96748	Merge pull request #14346 from ClickHouse/aku/fuzzer ... Don't let the fuzzer change max_execution_time	2020-09-02 01:59:50 +03:00
Anton Popov	7c3712c121	Merge pull request #13688 from it1804/master ... Redis dictionary support for simple Redis requirepass authorization	2020-09-02 01:43:02 +03:00
Alexander Kuzmenkov	a6486490a2	performance comparison	2020-09-01 22:05:57 +03:00
Alexander Kuzmenkov	0b70abe542	Don't let the fuzzer change max_execution_time	2020-09-01 18:51:46 +03:00
Alexander Kuzmenkov	2f3bb5844a	Merge branch 'master' into suppress-wget-output	2020-09-01 16:59:04 +03:00
Alexander Kuzmenkov	4620ac4c0d	Update docker/test/fuzzer/run-fuzzer.sh	2020-09-01 16:57:20 +03:00
Alexander Kuzmenkov	4e58f00305	Update docker/test/fuzzer/run-fuzzer.sh	2020-09-01 16:57:13 +03:00
Alexander Kuzmenkov	73d433a7dd	Merge pull request #14316 from ClickHouse/aku/html-fuzzer ... Add a HTML report for AST Fuzzer	2020-09-01 16:46:30 +03:00
Azat Khuzhin	2d7cb03120	Suppress superfluous wget (-nv) output ... Since for dowloading some of files wget logging may take 50% of overall log [1]. [1]: https://clickhouse-builds.s3.yandex.net/14315/c32ff4c98cb3b83a12f945eadd180415b7a3b269/clickhouse_build_check/build_log_761119955_1598923036.txt	2020-09-01 10:25:13 +03:00
Yatsishin Ilya	6cb893f073	Draft.	2020-09-01 09:38:23 +03:00
Alexander Kuzmenkov	33c5815eb3	Add a HTML report for AST Fuzzer	2020-09-01 02:33:42 +03:00
robot-clickhouse	e2fa0eae2f	Auto version update to [20.9.1.1] [54439]	2020-08-31 23:07:41 +03:00
Alexander Kuzmenkov	bc8765d5ad	Merge pull request #14095 from azat/DistributedFilesToInsert-fix ... Fix DistributedFilesToInsert metric (zeroed when it should not)	2020-08-31 18:58:30 +03:00
Alexander Kuzmenkov	b601dd4596	cosmetic fixes for performance report	2020-08-29 01:46:04 +03:00
Alexander Kuzmenkov	bb28320107	cosmetic fixes in performance report	2020-08-29 01:14:48 +03:00
Azat Khuzhin	a384194216	Add a test for DistributedFilesToInsert	2020-08-27 22:00:35 +03:00
Ilya Yatsishin	7509991d82	Merge pull request #14167 from qoega/docker-test-base ... Switch docker tests to use test-base	2020-08-27 16:45:55 +03:00
alexey-milovidov	e1cf919c93	Merge pull request #14112 from vzakaznikov/testflows_increase_compose_http_timeout_and_retry_docker_compose_up ... testflows: adding retry logic when bringing up docker-compose cluster	2020-08-27 15:51:16 +03:00
Alexander Tokmakov	65a69ff6ad	move docker-compose files	2020-08-27 14:46:19 +03:00
Yatsishin Ilya	bfe4e94806	Switch docker tests to use test-base	2020-08-27 13:17:17 +03:00
Alexey Milovidov	fe5cfe3151	Increase number of threads in stress test	2020-08-26 23:39:02 +03:00
Alexey Milovidov	0bfe78636c	Increase number of threads in stress test	2020-08-26 23:38:20 +03:00
alexey-milovidov	f62037e9dc	Update stress	2020-08-26 20:45:36 +03:00
Alexey Milovidov	07596b5323	Limit stress test to one hour	2020-08-26 20:44:03 +03:00
Vitaliy Zakaznikov	eb01601944	Adding retry login when bringing docker-compose cluster ... Moving to using testflows version 1.6.42	2020-08-26 10:00:12 -04:00
Konstantin Podshumok	cda4472ebc	dockerfiles: verify 3rd party apt repos, disable LLVM in PVS check ... Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>	2020-08-25 20:16:44 +03:00
alexey-milovidov	ad64cea4aa	Merge pull request #13980 from ClickHouse/fix-stress-test-2 ... Attempt to fix stress test	2020-08-24 22:03:32 +03:00
Ilya Yatsishin	20bff27eef	Merge pull request #13995 from qoega/stateless-unbundled ... Separate stateless unbundled image	2020-08-24 19:49:27 +03:00
Alexander Kuzmenkov	a348bc4641	performance comparison	2020-08-24 17:15:11 +03:00
Yatsishin Ilya	f2182db765	Separate stateless unbundled image	2020-08-24 13:05:56 +03:00
Alexey Milovidov	d44982072c	More robust	2020-08-24 03:14:24 +03:00
Alexey Milovidov	1fb4294cdf	Attempt to fix stress test	2020-08-24 00:13:21 +03:00
Alexey Milovidov	f4bf99fadc	Better output of stress test	2020-08-23 23:48:27 +03:00
Yatsishin Ilya	7dcdde0775	Add docker test base separately to have :latest build available	2020-08-20 20:54:51 +03:00
Alexander Kuzmenkov	5c8013b083	Merge pull request #13892 from ClickHouse/aku/timeout-perf ... Avoid timeouts in perf test	2020-08-20 18:14:26 +03:00
Alexander Kuzmenkov	3a0bdfa5f3	Publish list of tests that failed the concurrent fast test	2020-08-20 03:13:44 +03:00
Alexander Kuzmenkov	f43457454e	warn on undefined shell variables	2020-08-19 18:34:23 +03:00
Alexander Kuzmenkov	e9ad81b362	shellcheck	2020-08-19 18:31:13 +03:00
Alexander Kuzmenkov	000326b627	Avoid timeouts in perf test	2020-08-19 18:08:23 +03:00
tavplubix	d95470f7c3	Update docker/test/stress/run.sh	2020-08-18 20:52:54 +03:00
Yatsishin Ilya	8fd70835d5	Merge remote-tracking branch 'origin' into integration-explicit-configs	2020-08-18 17:31:41 +03:00
Nikita Mikhaylov	e7f8c0af52	done	2020-08-18 15:28:38 +03:00
Alexander Kuzmenkov	ce0dfe3fea	Fix server restart in fasttest ... Remove the server data before sequential test run, so that there is no interference from the failed parallel run. Also fix some shellcheck warning.	2020-08-18 13:24:37 +03:00
alexey-milovidov	3e6acf1329	Experiment with start/stop in stress test (#13779) ... * Experiment with start/stop in stress test * Support other installation options in "clickhouse start" * Better diagnostics in install script * Fixup * Fixup * Better diagnostics in stress test * Update run.sh	2020-08-18 12:43:02 +03:00
Alexey Milovidov	47889b0f2b	Install codespell	2020-08-16 14:59:16 +03:00
Ivan A. Torgashov	1006c4f11b	Update tests for Redis dictionary requirepass authorization support	2020-08-15 14:18:17 +05:00
Alexey Milovidov	0140093b17	Fix fast test	2020-08-15 10:11:19 +03:00
Alexander Kuzmenkov	ecc40b7c75	Merge pull request #13724 from qoega/docker-style ... Add docker image for style check, add check for docker files placement	2020-08-15 03:01:39 +03:00
Alexander Kuzmenkov	1cbfd1327a	trigger the CI	2020-08-15 01:40:40 +03:00
Yatsishin Ilya	ab337b243a	Add docker for style check	2020-08-14 16:09:23 +03:00
Alexander Tokmakov	128b19fdba	Merge branch 'master' into use_atomic_engine_for_system_db	2020-08-14 13:47:44 +03:00
Yatsishin Ilya	73e9f4d421	update test_materialize_mysql_database test	2020-08-13 21:20:47 +03:00
Alexander Tokmakov	a5d74c44f1	run stress tests with Atomic database	2020-08-13 20:55:12 +03:00
Ilya Yatsishin	e6420c82ca	mysql/postgresql: move Dockerfiles and docker_compose to docker/test (#13448) ... * mysql/postgresql: move Dockerfiles and docker_compose to docker/test * Build client containers in CI * pass tag to docker_compose	2020-08-12 18:04:36 +03:00
Yatsishin Ilya	730056a9f0	fix	2020-08-12 15:22:31 +03:00
Yatsishin Ilya	f663f794b0	Merge remote-tracking branch 'qoega/integration-explicit-configs' into integration-explicit-configs	2020-08-12 14:58:41 +03:00
Alexander Kuzmenkov	6fdfe65694	performance comparison	2020-08-12 11:55:51 +03:00
Yatsishin Ilya	160776f183	Add explicit main_configs, user_configs and dictionaries in integration tests.	2020-08-12 11:55:04 +03:00
Alexander Kuzmenkov	89b712a180	performance comparison	2020-08-12 08:40:03 +03:00
Yatsishin Ilya	fdd18e540d	move reference files	2020-08-12 07:06:23 +03:00
Alexander Kuzmenkov	7547b850d6	performance comparison	2020-08-11 17:14:24 +03:00
Alexander Kuzmenkov	5a97f0c19e	performance comparison	2020-08-11 14:53:25 +03:00
Yatsishin Ilya	e3f7fea33a	fix	2020-08-11 11:31:26 +03:00
Yatsishin Ilya	1d0e4ca670	pass tag to docker_compose	2020-08-10 16:35:08 +03:00
Yatsishin Ilya	1884cfe110	Merge remote-tracking branch 'origin/master' into docker-mysql-postgres	2020-08-10 11:12:22 +03:00
robot-clickhouse	a82c0f5371	Auto version update to [20.8.1.1] [54438]	2020-08-07 21:45:49 +03:00
Yatsishin Ilya	70fca95a5a	mysql/postgresql: move Dockerfiles and docker_compose to docker/test	2020-08-07 11:42:04 +03:00
Alexander Kuzmenkov	11727864dd	performance comparison	2020-08-07 04:25:45 +03:00
Alexander Kuzmenkov	dbb65a8bd7	performance comparison	2020-08-06 16:28:51 +03:00
Alexander Kuzmenkov	a92438eff2	performance comparison	2020-08-06 02:33:32 +03:00
Alexander Kuzmenkov	88aa371e0c	performance comparison	2020-08-06 02:02:52 +03:00
Alexander Kuzmenkov	9cac8a7244	performance comparison	2020-08-05 19:07:37 +03:00
Alexander Kuzmenkov	7945041a9a	perf test error summary	2020-08-05 18:56:51 +03:00
alesapin	63391bbb66	Merge pull request #13382 from Enmk/fasttest-fix-query_masking_rules.xml ... Keep original query_masking_rules.xml when performing fasttests	2020-08-05 17:47:33 +03:00
alesapin	a18461091f	Merge pull request #13384 from ClickHouse/fix_fast_test_server_kill ... Better kill in fast test	2020-08-05 17:42:52 +03:00
alesapin	87c56f9556	Symlink for server logs	2020-08-05 16:15:06 +03:00
alesapin	c862ae93d1	Replace backticks with modern alternative	2020-08-05 16:10:47 +03:00
alesapin	68a9499e92	Simplier kill clickhouse server	2020-08-05 15:59:52 +03:00
alesapin	cdad1e718f	Better kill in fast test	2020-08-05 15:37:54 +03:00
Vasily Nemkov	baed365c19	Keep original query_masking_rules.xml when performing fasttests	2020-08-05 15:14:20 +03:00
alexey-milovidov	d94e556455	Merge pull request #13321 from ClickHouse/restart_server_with_timeout ... Restart server in stress test with timeout	2020-08-05 00:43:45 +03:00
alexey-milovidov	18ef0c0c96	Update run.sh, thanks @azat	2020-08-04 20:54:09 +03:00
alesapin	bd0322421b	Better timeout	2020-08-04 17:28:35 +03:00
alesapin	caf0bcdc86	More timeouts	2020-08-04 11:48:47 +03:00
alesapin	ee5153bbc4	Restart server in stress test with timeout	2020-08-04 11:47:20 +03:00
alesapin	b69e6b935b	Wait with retries in fast test (#13284)	2020-08-03 21:05:35 +03:00
alexey-milovidov	935533e841	Merge pull request #13193 from ClickHouse/aku/spurious-perf ... Fix some spurious perf test failures	2020-08-03 01:02:53 +03:00
Azat Khuzhin	8cbcd4027a	Exclude 01413_rows_events from the fasttest (TRUNCATE query_log)	2020-08-02 13:30:00 +03:00
Azat Khuzhin	37c3f44dbe	fasttest: use arrays for skip list (to make it more patch friendly) ... Plus it looks better.	2020-08-02 13:29:31 +03:00
Vitaly Baranov	18b21511a9	Merge pull request #13013 from vitlibar/implement-custom-settings ... Implement custom settings	2020-08-02 05:01:14 +03:00
Alexander Kuzmenkov	dd475fe82c	Update report.py	2020-08-01 13:10:36 +03:00
Alexander Kuzmenkov	a317f995be	performance comparison	2020-07-31 22:58:38 +03:00
Vitaly Baranov	0fcee34322	Add test.	2020-07-31 20:57:49 +03:00
Alexander Kuzmenkov	1d954581eb	Fix some spurious perf test failures	2020-07-31 19:28:04 +03:00
Alexander Kuzmenkov	6f861294f4	query fuzzer	2020-07-31 18:57:01 +03:00
Ilya Yatsishin	1566c8a92b	Merge pull request #12285 from qoega/rework-integrational ... Rework integrational configuration paths	2020-07-31 15:34:21 +03:00
Alexander Kuzmenkov	e2e4fc9848	align numbers to the right in perf report	2020-07-31 13:59:15 +03:00
Alexander Kuzmenkov	db15108005	add times speedup/slowdown to changed tests table	2020-07-31 01:14:20 +03:00
Alexander Kuzmenkov	0e70e21b58	Update run-fuzzer.sh	2020-07-30 22:04:15 +03:00
Alexander Kuzmenkov	3d13da1c24	query fuzzer	2020-07-30 20:07:10 +03:00
Alexander Kuzmenkov	96125111fe	Merge pull request #13085 from ClickHouse/aku/fuzzer-error-code ... Fix the AST fuzzer error message	2020-07-30 19:53:21 +03:00
Alexander Kuzmenkov	f0fda359de	pipefail	2020-07-30 16:43:22 +03:00
Alexander Kuzmenkov	b2b94ba13d	Update run-fuzzer.sh	2020-07-30 16:35:24 +03:00
Alexander Kuzmenkov	65771ad516	Fix the AST fuzzer error message	2020-07-29 20:05:38 +03:00
alesapin	5c1aa52f40	Better check for failed tests	2020-07-29 14:39:08 +03:00
alesapin	26ff008898	Remove test	2020-07-29 14:34:42 +03:00
alesapin	3a0d44b5b9	Merge branch 'master' into rerun_failed_in_fast_test	2020-07-29 12:54:18 +03:00
Yatsishin Ilya	58b6621dd3	Merge remote-tracking branch 'origin' into rework-integrational	2020-07-29 10:24:26 +03:00
Alexander Kuzmenkov	e0c207d6b4	Update entrypoint.sh	2020-07-28 16:15:41 +03:00
Yatsishin Ilya	b5722493f5	less changes	2020-07-28 16:11:29 +03:00
Yatsishin Ilya	7ca2a54e74	fix	2020-07-28 16:08:08 +03:00
Yatsishin Ilya	99ff6cae27	Merge remote-tracking branch 'origin/master' into rework-integrational	2020-07-28 14:35:51 +03:00
alesapin	d39318c8fe	Grep in correct file	2020-07-28 14:23:49 +03:00
alesapin	3eb77ab076	Better kill	2020-07-28 14:22:25 +03:00