132 Commits

Author	SHA1	Message	Date
Azat Khuzhin	b0c72b6104	tests/integration: add prefix match for skipped tests ... This way you can specify only file/module, or test name without parameters. Since, at least one, test that we care about (test_distributed_respect_user_timeouts/test.py::test_reconnect) was not runned sequentially [1]. [1]: https://s3.amazonaws.com/clickhouse-test-reports/37138/d7f5db4143c559bb8044058a653956945897e724/integration_tests__asan__actions__[2/3].html Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>	2022-05-13 11:19:11 +03:00
Azat Khuzhin	0fb9553e1c	tests/integration: use no-resolve and verbose for iptables --list ... Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>	2022-05-13 10:57:24 +03:00
Mikhail f. Shiryaev	76c3022029	Fix code broken in 1e82b04de3	2022-05-10 17:41:47 +02:00
alesapin	c74b6c547b	Black	2022-04-14 14:40:56 +02:00
alesapin	428753a4a7	Fix integration tests parser	2022-04-14 14:39:36 +02:00
Mikhail f. Shiryaev	e6f5a3f98b	Apply black formatter to all *.py files in the repo	2022-03-22 17:39:58 +01:00
vdimir	2551adc416	Bugfix validate meta check	2022-03-18 16:31:19 +01:00
vdimir	cf70b79f74	Revert "Bugfix check requires either functional _or_ stateless test" ... This reverts commit b8b64b1d15.	2022-03-14 15:43:15 +00:00
vdimir	b8b64b1d15	Bugfix check requires either functional _or_ stateless test	2022-03-14 13:09:53 +00:00
vdimir	23bee2c843	Do not invert result of integration bugfix check in ci-runner.py	2022-03-11 14:32:24 +00:00
vdimir	e5c63266c2	Integration test bugfix check	2022-03-11 14:14:16 +00:00
Mikhail f. Shiryaev	1e82b04de3	Apply black formatter to ci-runner to trigger license/cla	2022-02-14 01:32:22 +01:00
Mikhail f. Shiryaev	23546ab825	Use the current kerberized-haddop image	2022-02-13 22:01:45 +01:00
Azat Khuzhin	ad86dad2d1	Fix status of SKIPPED integration tests (was incorrectly marked as ERROR) ... Like here [1]. - test_jemalloc_percpu_arena/test.py::test_jemalloc_percpu_arena -- ERROR - test_input_format_parallel_parsing_memory_tracking/test.py::test_memory_tracking_total -- FAIL But test_jemalloc_percpu_arena is SKIPPED. [1]: https://s3.amazonaws.com/clickhouse-test-reports/33140/b4420cfa3e834ab9026914978697ded3180122a0/integration_tests__thread__actions__[3/4].html v2: tests/integration/ci-runner: include SKIPPED tests into "short test summary info" Otherwise they cannot be distinguished from ERRORS. v3: tests/integration/ci-runner: improve report parser v4: rewrite get_counters() to parse tests verbosity log instead of test short summary, since later does not provide test name for skipped tests	2022-01-13 22:07:40 +03:00
Alexey Milovidov	9678179ba0	Fix a typo	2022-01-03 03:03:49 +03:00
Alexey Milovidov	f790bcfe03	Add something to somewhere	2022-01-03 03:03:26 +03:00
Ilya Golshtein	2821e14492	typo fixed	2021-12-17 15:01:57 +03:00
alesapin	a6e55b00e3	Revert "Revert "Split long tests into multiple checks""	2021-12-10 18:39:02 +03:00
alesapin	dcbba460c1	Revert "Split long tests into multiple checks"	2021-12-10 18:38:42 +03:00
alesapin	2c7bb56a2c	Split integration tests into parts	2021-12-10 13:22:29 +03:00
alesapin	e426078344	Trying to debug integration tests	2021-11-16 11:59:38 +03:00
alesapin	1fcd7cedf4	Restart docker	2021-11-08 16:23:14 +03:00
alesapin	2a7e246021	Don't try to restart docker	2021-11-05 21:49:40 +03:00
alesapin	dd9446d8d3	Fix ci runner	2021-11-05 11:56:06 +03:00
alesapin	a1a6d3876b	Iptables fix	2021-11-04 23:22:13 +03:00
alesapin	2cc0b9723e	Use temp path	2021-11-04 18:53:45 +03:00
alesapin	3f11cbd31b	Rename more images	2021-09-08 13:03:54 +03:00
Alexander Tokmakov	88b4200008	fix	2021-08-12 13:40:54 +03:00
tavplubix	aa8ca01bb9	Update ci-runner.py	2021-08-11 15:17:46 +03:00
tavplubix	c93868babf	Update ci-runner.py	2021-08-11 13:12:24 +03:00
tavplubix	32e4a9a5a5	Update ci-runner.py	2021-08-10 20:58:36 +03:00
vdimir	d1b6274deb	Strip lines in runner output in _get_all_tests	2021-07-22 13:33:05 +03:00
vdimir	a8f986350c	Log errors on integration test listing error in ci-runner	2021-07-22 12:31:15 +03:00
Vitaly Baranov	618a77fafa	Improve logging in integration tests.	2021-07-04 22:24:54 +03:00
alesapin	a63da94ae4	Revert "Merge pull request #25526 from ClickHouse/revert-25459-add_run_id_option" ... This reverts commit 7c7e96f26c, reversing changes made to a54cbef5b7.	2021-06-21 11:14:26 +03:00
alesapin	feecf398fb	Revert "Add run-id option to integration tests"	2021-06-21 11:10:44 +03:00
alesapin	8a5bc2e7bc	Add run-id option to integration tests	2021-06-18 12:23:22 +03:00
alesapin	192210fea6	Consistent style	2021-06-09 16:42:20 +03:00
alesapin	46aee86d3a	Fix flaky check report in CI runner	2021-06-09 16:40:28 +03:00
alesapin	c03f54e2c3	Skip skipped tests	2021-06-04 13:15:44 +03:00
Yatsishin Ilya	7656ab3c85	try tmpfs in runner	2021-06-01 11:44:09 +03:00
Yatsishin Ilya	7bb1709185	smaller pack	2021-05-31 18:46:32 +03:00
Yatsishin Ilya	0c2318c59b	tune runner for now	2021-05-31 07:07:32 +03:00
Yatsishin Ilya	b26b97ec6c	fix	2021-05-26 07:40:53 +03:00
Yatsishin Ilya	f5e584b6af	fix	2021-05-25 19:56:03 +03:00
Yatsishin Ilya	53295f9b51	blacklist	2021-05-25 19:53:42 +03:00
Yatsishin Ilya	7a5895815b	remove tmpfs for now	2021-05-19 13:23:51 +03:00
Yatsishin Ilya	40e63646ca	more	2021-05-17 14:16:16 +03:00
Yatsishin Ilya	cfb55c2cf6	fix	2021-05-14 19:38:40 +03:00
Yatsishin Ilya	aa4c91a2b3	disable parallel in flaky check	2021-05-14 17:15:08 +03:00
Yatsishin Ilya	bb1f223e21	Merge remote-tracking branch 'origin' into integration-2	2021-04-15 06:56:27 +03:00
Yatsishin Ilya	fe406c27db	Merge remote-tracking branch 'origin' into integration-2	2021-04-14 20:33:20 +03:00
Maksim Kita	d885921100	CI runner intergation tests logs update to tar.gz	2021-04-14 18:15:35 +03:00
Yatsishin Ilya	e4d1ea846c	more	2021-04-13 13:52:22 +03:00
Yatsishin Ilya	ec6adb692d	Merge remote-tracking branch 'origin' into integration-2	2021-04-12 10:04:11 +03:00
Anton Popov	30f2d839c3	Merge pull request #22868 from CurtizJ/prettify-logs ... Prettify logs of integration tests	2021-04-09 13:10:00 +03:00
Anton Popov	00172f97da	Update ci-runner.py	2021-04-09 03:58:22 +03:00
Anton Popov	add4497502	prettify logs of integration tests	2021-04-09 00:08:49 +03:00
Yatsishin Ilya	5311278c29	Merge remote-tracking branch 'origin' into integration-2	2021-04-08 12:30:24 +03:00
Yatsishin Ilya	e79b5b57fd	try export dockerd.log	2021-03-23 14:35:45 +03:00
Yatsishin Ilya	ecc58a76d7	fix	2021-03-23 06:35:08 +03:00
Yatsishin Ilya	ee84ab2a48	fixes	2021-03-22 18:33:46 +03:00
kssenii	8a650c4408	Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge	2021-03-22 13:38:25 +00:00
Yatsishin Ilya	360887893b	fix	2021-03-22 14:51:47 +03:00
Yatsishin Ilya	fbf0fe6436	Merge remote-tracking branch 'origin' into integration-2	2021-03-20 22:47:33 +03:00
Yatsishin Ilya	880a03a9df	fix	2021-03-20 22:44:58 +03:00
Yatsishin Ilya	fd32609f38	run parallel tests	2021-03-19 19:47:59 +03:00
Alexander Tokmakov	4ea3178efc	fix	2021-03-18 17:51:09 +03:00
Alexander Tokmakov	f0c930bf9d	remove query timeouts	2021-03-17 22:28:18 +03:00
tavplubix	d42b442b83	Update ci-runner.py	2021-03-17 03:57:33 +03:00
tavplubix	ccf46d8269	Update ci-runner.py	2021-03-17 02:16:03 +03:00
tavplubix	5d73a96a51	Update ci-runner.py	2021-03-17 00:39:38 +03:00
Alexander Tokmakov	5037d2c10d	add timeout for the whole task	2021-03-16 20:48:45 +03:00
kssenii	bd38a7a021	Fix tests	2021-03-15 06:37:07 +00:00
Alexander Tokmakov	fbbb0c4b69	fix	2021-02-25 19:11:43 +03:00
Alexander Tokmakov	65384f43d8	fix	2021-02-25 10:02:45 +03:00
Alexander Tokmakov	efd50a819b	fix	2021-02-25 02:09:09 +03:00
Alexander Tokmakov	3632c1d879	add flacky check runner	2021-02-24 19:41:44 +03:00
Alexander Tokmakov	f41e68d118	fix style check	2021-02-23 23:15:11 +03:00
Alexander Tokmakov	7a6c9ceeef	fix	2021-02-23 15:25:28 +03:00
Alexander Tokmakov	7bcec2947f	fix	2021-02-23 13:48:06 +03:00
Alexander Tokmakov	d5ea345aa9	add integration tests runner	2021-02-23 10:26:23 +03:00