Alexey Milovidov
a06d03e097
Merge pull request #44851 from qoega/green-ci-3
...
No more retries in integration tests
2023-01-03 19:40:34 +03:00
Ilya Yatsishin
8a9bb9b107
No more retries in integration tests
2023-01-02 18:56:24 +01:00
Azat Khuzhin
c3b3ae886f
tests/integration: ignore exit code for a running group
...
tee is useful there, otherwise logs are empty on CI
This reverts commit 92fd7def39
.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-02 12:08:44 +01:00
Azat Khuzhin
f2c069b852
tests/integration: allow to split parametrized tests between parallel groups
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-02 12:06:56 +01:00
Azat Khuzhin
4b71b481c7
tests/integration: do not split paramaterized tests into multiple groups
...
There is also one assumption the runner already, that leads to
misleading reports like in [1].
[1]: https://s3.amazonaws.com/clickhouse-test-reports/44762/89c071e291980e355f2c2be42dc15047caabc9bc/integration_tests__asan__%5B4/6%5D.html
Here the test test_multiple_disks/test.py::test_jbod_overflow had been
splitted into multiple groups, however because of that one assumption
it had been runned as a whole in both groups and in one it failed but
succeeded in another.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-01 23:35:21 +01:00
Azat Khuzhin
700943a2b0
tests/integration: remove logging message for undone thing
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-01 23:13:00 +01:00
Azat Khuzhin
fa78569c39
tests/integration: fix logging message
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-01 23:12:25 +01:00
Azat Khuzhin
92fd7def39
tests/integration: fix detecting exit code for a running group
...
Because of tee the exit code is the result of tee, not of the pytest.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-01 23:09:12 +01:00
Azat Khuzhin
03f80bae90
Move dmesg dumping out from runner to ci-runner.py
...
runner is used by developers to run tests, while ci-runner.py is used
only by CI scripts, and to avoid requiring CAP_SYSLOG for manual dmesg
clear/dump had been moved.
Also for manual runs this can be done manually.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-12-28 15:47:46 +01:00
Mikhail f. Shiryaev
6d0cd35cd0
Ignore exit code 1 for tar in integration tests
2022-12-23 13:08:59 +01:00
Mikhail f. Shiryaev
550c776ffe
Wait for all files are in sync before archiving them
2022-11-02 13:16:27 +01:00
robot-clickhouse
838bc678cc
Automatic style fix
2022-09-17 18:38:12 +00:00
Alexey Milovidov
ecfd8cb5a6
Remove trash error message from integration tests
2022-09-17 20:24:56 +02:00
Mikhail f. Shiryaev
dfae6a5634
Upload logs for getting all tests command
2022-06-23 18:14:42 +02:00
Alexander Tokmakov
153862dc31
fix tests
...
(cherry picked from commit ed52f463d95ac49431600f167a08507d7fcaaaf0)
2022-06-01 13:47:52 +02:00
Azat Khuzhin
b0c72b6104
tests/integration: add prefix match for skipped tests
...
This way you can specify only file/module, or test name without
parameters.
Since, at least one, test that we care about
(test_distributed_respect_user_timeouts/test.py::test_reconnect) was not
runned sequentially [1].
[1]: https://s3.amazonaws.com/clickhouse-test-reports/37138/d7f5db4143c559bb8044058a653956945897e724/integration_tests__asan__actions__[2/3].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-13 11:19:11 +03:00
Azat Khuzhin
0fb9553e1c
tests/integration: use no-resolve and verbose for iptables --list
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-13 10:57:24 +03:00
Mikhail f. Shiryaev
76c3022029
Fix code broken in 1e82b04de3
2022-05-10 17:41:47 +02:00
alesapin
c74b6c547b
Black
2022-04-14 14:40:56 +02:00
alesapin
428753a4a7
Fix integration tests parser
2022-04-14 14:39:36 +02:00
Mikhail f. Shiryaev
e6f5a3f98b
Apply black formatter to all *.py files in the repo
2022-03-22 17:39:58 +01:00
vdimir
2551adc416
Bugfix validate meta check
2022-03-18 16:31:19 +01:00
vdimir
cf70b79f74
Revert "Bugfix check requires either functional _or_ stateless test"
...
This reverts commit b8b64b1d15
.
2022-03-14 15:43:15 +00:00
vdimir
b8b64b1d15
Bugfix check requires either functional _or_ stateless test
2022-03-14 13:09:53 +00:00
vdimir
23bee2c843
Do not invert result of integration bugfix check in ci-runner.py
2022-03-11 14:32:24 +00:00
vdimir
e5c63266c2
Integration test bugfix check
2022-03-11 14:14:16 +00:00
Mikhail f. Shiryaev
1e82b04de3
Apply black formatter to ci-runner to trigger license/cla
2022-02-14 01:32:22 +01:00
Mikhail f. Shiryaev
23546ab825
Use the current kerberized-haddop image
2022-02-13 22:01:45 +01:00
Azat Khuzhin
ad86dad2d1
Fix status of SKIPPED integration tests (was incorrectly marked as ERROR)
...
Like here [1].
- test_jemalloc_percpu_arena/test.py::test_jemalloc_percpu_arena -- ERROR
- test_input_format_parallel_parsing_memory_tracking/test.py::test_memory_tracking_total -- FAIL
But test_jemalloc_percpu_arena is SKIPPED.
[1]: https://s3.amazonaws.com/clickhouse-test-reports/33140/b4420cfa3e834ab9026914978697ded3180122a0/integration_tests__thread__actions__[3/4].html
v2: tests/integration/ci-runner: include SKIPPED tests into "short test summary info"
Otherwise they cannot be distinguished from ERRORS.
v3: tests/integration/ci-runner: improve report parser
v4: rewrite get_counters() to parse tests verbosity log instead of test
short summary, since later does not provide test name for skipped
tests
2022-01-13 22:07:40 +03:00
Alexey Milovidov
9678179ba0
Fix a typo
2022-01-03 03:03:49 +03:00
Alexey Milovidov
f790bcfe03
Add something to somewhere
2022-01-03 03:03:26 +03:00
Ilya Golshtein
2821e14492
typo fixed
2021-12-17 15:01:57 +03:00
alesapin
a6e55b00e3
Revert "Revert "Split long tests into multiple checks""
2021-12-10 18:39:02 +03:00
alesapin
dcbba460c1
Revert "Split long tests into multiple checks"
2021-12-10 18:38:42 +03:00
alesapin
2c7bb56a2c
Split integration tests into parts
2021-12-10 13:22:29 +03:00
alesapin
e426078344
Trying to debug integration tests
2021-11-16 11:59:38 +03:00
alesapin
1fcd7cedf4
Restart docker
2021-11-08 16:23:14 +03:00
alesapin
2a7e246021
Don't try to restart docker
2021-11-05 21:49:40 +03:00
alesapin
dd9446d8d3
Fix ci runner
2021-11-05 11:56:06 +03:00
alesapin
a1a6d3876b
Iptables fix
2021-11-04 23:22:13 +03:00
alesapin
2cc0b9723e
Use temp path
2021-11-04 18:53:45 +03:00
alesapin
3f11cbd31b
Rename more images
2021-09-08 13:03:54 +03:00
Alexander Tokmakov
88b4200008
fix
2021-08-12 13:40:54 +03:00
tavplubix
aa8ca01bb9
Update ci-runner.py
2021-08-11 15:17:46 +03:00
tavplubix
c93868babf
Update ci-runner.py
2021-08-11 13:12:24 +03:00
tavplubix
32e4a9a5a5
Update ci-runner.py
2021-08-10 20:58:36 +03:00
vdimir
d1b6274deb
Strip lines in runner output in _get_all_tests
2021-07-22 13:33:05 +03:00
vdimir
a8f986350c
Log errors on integration test listing error in ci-runner
2021-07-22 12:31:15 +03:00
Vitaly Baranov
618a77fafa
Improve logging in integration tests.
2021-07-04 22:24:54 +03:00
alesapin
a63da94ae4
Revert "Merge pull request #25526 from ClickHouse/revert-25459-add_run_id_option"
...
This reverts commit 7c7e96f26c
, reversing
changes made to a54cbef5b7
.
2021-06-21 11:14:26 +03:00