Commit Graph

135 Commits

Author SHA1 Message Date
Alexey Milovidov
ecfd8cb5a6 Remove trash error message from integration tests 2022-09-17 20:24:56 +02:00
Mikhail f. Shiryaev
dfae6a5634
Upload logs for getting all tests command 2022-06-23 18:14:42 +02:00
Alexander Tokmakov
153862dc31 fix tests
(cherry picked from commit ed52f463d95ac49431600f167a08507d7fcaaaf0)
2022-06-01 13:47:52 +02:00
Azat Khuzhin
b0c72b6104 tests/integration: add prefix match for skipped tests
This way you can specify only file/module, or test name without
parameters.

Since, at least one, test that we care about
(test_distributed_respect_user_timeouts/test.py::test_reconnect) was not
runned sequentially [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/37138/d7f5db4143c559bb8044058a653956945897e724/integration_tests__asan__actions__[2/3].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-13 11:19:11 +03:00
Azat Khuzhin
0fb9553e1c tests/integration: use no-resolve and verbose for iptables --list
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-13 10:57:24 +03:00
Mikhail f. Shiryaev
76c3022029
Fix code broken in 1e82b04de3 2022-05-10 17:41:47 +02:00
alesapin
c74b6c547b Black 2022-04-14 14:40:56 +02:00
alesapin
428753a4a7 Fix integration tests parser 2022-04-14 14:39:36 +02:00
Mikhail f. Shiryaev
e6f5a3f98b
Apply black formatter to all *.py files in the repo 2022-03-22 17:39:58 +01:00
vdimir
2551adc416
Bugfix validate meta check 2022-03-18 16:31:19 +01:00
vdimir
cf70b79f74
Revert "Bugfix check requires either functional _or_ stateless test"
This reverts commit b8b64b1d15.
2022-03-14 15:43:15 +00:00
vdimir
b8b64b1d15
Bugfix check requires either functional _or_ stateless test 2022-03-14 13:09:53 +00:00
vdimir
23bee2c843
Do not invert result of integration bugfix check in ci-runner.py 2022-03-11 14:32:24 +00:00
vdimir
e5c63266c2
Integration test bugfix check 2022-03-11 14:14:16 +00:00
Mikhail f. Shiryaev
1e82b04de3
Apply black formatter to ci-runner to trigger license/cla 2022-02-14 01:32:22 +01:00
Mikhail f. Shiryaev
23546ab825
Use the current kerberized-haddop image 2022-02-13 22:01:45 +01:00
Azat Khuzhin
ad86dad2d1 Fix status of SKIPPED integration tests (was incorrectly marked as ERROR)
Like here [1].

- test_jemalloc_percpu_arena/test.py::test_jemalloc_percpu_arena -- ERROR
- test_input_format_parallel_parsing_memory_tracking/test.py::test_memory_tracking_total -- FAIL

But test_jemalloc_percpu_arena is SKIPPED.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33140/b4420cfa3e834ab9026914978697ded3180122a0/integration_tests__thread__actions__[3/4].html

v2: tests/integration/ci-runner: include SKIPPED tests into "short test summary info"
    Otherwise they cannot be distinguished from ERRORS.
v3: tests/integration/ci-runner: improve report parser
v4: rewrite get_counters() to parse tests verbosity log instead of test
    short summary, since later does not provide test name for skipped
    tests
2022-01-13 22:07:40 +03:00
Alexey Milovidov
9678179ba0 Fix a typo 2022-01-03 03:03:49 +03:00
Alexey Milovidov
f790bcfe03 Add something to somewhere 2022-01-03 03:03:26 +03:00
Ilya Golshtein
2821e14492 typo fixed 2021-12-17 15:01:57 +03:00
alesapin
a6e55b00e3
Revert "Revert "Split long tests into multiple checks"" 2021-12-10 18:39:02 +03:00
alesapin
dcbba460c1
Revert "Split long tests into multiple checks" 2021-12-10 18:38:42 +03:00
alesapin
2c7bb56a2c Split integration tests into parts 2021-12-10 13:22:29 +03:00
alesapin
e426078344 Trying to debug integration tests 2021-11-16 11:59:38 +03:00
alesapin
1fcd7cedf4 Restart docker 2021-11-08 16:23:14 +03:00
alesapin
2a7e246021 Don't try to restart docker 2021-11-05 21:49:40 +03:00
alesapin
dd9446d8d3 Fix ci runner 2021-11-05 11:56:06 +03:00
alesapin
a1a6d3876b Iptables fix 2021-11-04 23:22:13 +03:00
alesapin
2cc0b9723e Use temp path 2021-11-04 18:53:45 +03:00
alesapin
3f11cbd31b Rename more images 2021-09-08 13:03:54 +03:00
Alexander Tokmakov
88b4200008 fix 2021-08-12 13:40:54 +03:00
tavplubix
aa8ca01bb9
Update ci-runner.py 2021-08-11 15:17:46 +03:00
tavplubix
c93868babf
Update ci-runner.py 2021-08-11 13:12:24 +03:00
tavplubix
32e4a9a5a5
Update ci-runner.py 2021-08-10 20:58:36 +03:00
vdimir
d1b6274deb
Strip lines in runner output in _get_all_tests 2021-07-22 13:33:05 +03:00
vdimir
a8f986350c
Log errors on integration test listing error in ci-runner 2021-07-22 12:31:15 +03:00
Vitaly Baranov
618a77fafa Improve logging in integration tests. 2021-07-04 22:24:54 +03:00
alesapin
a63da94ae4 Revert "Merge pull request #25526 from ClickHouse/revert-25459-add_run_id_option"
This reverts commit 7c7e96f26c, reversing
changes made to a54cbef5b7.
2021-06-21 11:14:26 +03:00
alesapin
feecf398fb
Revert "Add run-id option to integration tests" 2021-06-21 11:10:44 +03:00
alesapin
8a5bc2e7bc Add run-id option to integration tests 2021-06-18 12:23:22 +03:00
alesapin
192210fea6 Consistent style 2021-06-09 16:42:20 +03:00
alesapin
46aee86d3a Fix flaky check report in CI runner 2021-06-09 16:40:28 +03:00
alesapin
c03f54e2c3 Skip skipped tests 2021-06-04 13:15:44 +03:00
Yatsishin Ilya
7656ab3c85 try tmpfs in runner 2021-06-01 11:44:09 +03:00
Yatsishin Ilya
7bb1709185 smaller pack 2021-05-31 18:46:32 +03:00
Yatsishin Ilya
0c2318c59b tune runner for now 2021-05-31 07:07:32 +03:00
Yatsishin Ilya
b26b97ec6c fix 2021-05-26 07:40:53 +03:00
Yatsishin Ilya
f5e584b6af fix 2021-05-25 19:56:03 +03:00
Yatsishin Ilya
53295f9b51 blacklist 2021-05-25 19:53:42 +03:00
Yatsishin Ilya
7a5895815b remove tmpfs for now 2021-05-19 13:23:51 +03:00
Yatsishin Ilya
40e63646ca more 2021-05-17 14:16:16 +03:00
Yatsishin Ilya
cfb55c2cf6 fix 2021-05-14 19:38:40 +03:00
Yatsishin Ilya
aa4c91a2b3 disable parallel in flaky check 2021-05-14 17:15:08 +03:00
Yatsishin Ilya
bb1f223e21 Merge remote-tracking branch 'origin' into integration-2 2021-04-15 06:56:27 +03:00
Yatsishin Ilya
fe406c27db Merge remote-tracking branch 'origin' into integration-2 2021-04-14 20:33:20 +03:00
Maksim Kita
d885921100 CI runner intergation tests logs update to tar.gz 2021-04-14 18:15:35 +03:00
Yatsishin Ilya
e4d1ea846c more 2021-04-13 13:52:22 +03:00
Yatsishin Ilya
ec6adb692d Merge remote-tracking branch 'origin' into integration-2 2021-04-12 10:04:11 +03:00
Anton Popov
30f2d839c3
Merge pull request #22868 from CurtizJ/prettify-logs
Prettify logs of integration tests
2021-04-09 13:10:00 +03:00
Anton Popov
00172f97da
Update ci-runner.py 2021-04-09 03:58:22 +03:00
Anton Popov
add4497502 prettify logs of integration tests 2021-04-09 00:08:49 +03:00
Yatsishin Ilya
5311278c29 Merge remote-tracking branch 'origin' into integration-2 2021-04-08 12:30:24 +03:00
Yatsishin Ilya
e79b5b57fd try export dockerd.log 2021-03-23 14:35:45 +03:00
Yatsishin Ilya
ecc58a76d7 fix 2021-03-23 06:35:08 +03:00
Yatsishin Ilya
ee84ab2a48 fixes 2021-03-22 18:33:46 +03:00
kssenii
8a650c4408 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-22 13:38:25 +00:00
Yatsishin Ilya
360887893b fix 2021-03-22 14:51:47 +03:00
Yatsishin Ilya
fbf0fe6436 Merge remote-tracking branch 'origin' into integration-2 2021-03-20 22:47:33 +03:00
Yatsishin Ilya
880a03a9df fix 2021-03-20 22:44:58 +03:00
Yatsishin Ilya
fd32609f38 run parallel tests 2021-03-19 19:47:59 +03:00
Alexander Tokmakov
4ea3178efc fix 2021-03-18 17:51:09 +03:00
Alexander Tokmakov
f0c930bf9d remove query timeouts 2021-03-17 22:28:18 +03:00
tavplubix
d42b442b83
Update ci-runner.py 2021-03-17 03:57:33 +03:00
tavplubix
ccf46d8269
Update ci-runner.py 2021-03-17 02:16:03 +03:00
tavplubix
5d73a96a51
Update ci-runner.py 2021-03-17 00:39:38 +03:00
Alexander Tokmakov
5037d2c10d add timeout for the whole task 2021-03-16 20:48:45 +03:00
kssenii
bd38a7a021 Fix tests 2021-03-15 06:37:07 +00:00
Alexander Tokmakov
fbbb0c4b69 fix 2021-02-25 19:11:43 +03:00
Alexander Tokmakov
65384f43d8 fix 2021-02-25 10:02:45 +03:00
Alexander Tokmakov
efd50a819b fix 2021-02-25 02:09:09 +03:00
Alexander Tokmakov
3632c1d879 add flacky check runner 2021-02-24 19:41:44 +03:00
Alexander Tokmakov
f41e68d118 fix style check 2021-02-23 23:15:11 +03:00
Alexander Tokmakov
7a6c9ceeef fix 2021-02-23 15:25:28 +03:00
Alexander Tokmakov
7bcec2947f fix 2021-02-23 13:48:06 +03:00
Alexander Tokmakov
d5ea345aa9 add integration tests runner 2021-02-23 10:26:23 +03:00