Commit Graph

77 Commits

Author SHA1 Message Date
Max Kainov
9b55180184 CI: Move out scripts from dockers 2024-08-20 10:17:17 +02:00
Raúl Marín
b6b4b046a3 Style 2024-07-15 13:42:00 +02:00
Raúl Marín
de029e278a Add additional log masking 2024-07-15 13:30:48 +02:00
alesapin
a2626037bc Improve object storage tags in tests 2024-07-02 14:15:59 +02:00
Mikhail f. Shiryaev
5f7839740d
Use timeout from ci_config in stress tests 2024-05-29 17:22:46 +02:00
alesapin
f25a024ab3 Followup 2024-04-24 17:47:32 +02:00
alesapin
6e05e63362 To stress as well 2024-04-24 17:32:18 +02:00
Max Kainov
252d2a05a6 fix unittest 2024-04-11 16:27:25 +00:00
Max Kainov
45258bc565 CI: Add tests with Azure storage 2024-04-11 14:50:18 +00:00
Mikhail f. Shiryaev
e31078e204
Fix some issues detected by new pylint 2024-03-05 16:02:36 +01:00
Mikhail f. Shiryaev
13948cbb20
Use constants from report instead of string literals 2024-02-06 15:02:09 +01:00
Max Kainov
3247ae81e4 move out ci specific functions to ci.py
#no_merge_commit
2024-01-21 16:36:37 +00:00
Max K
84e5870b71
Reapply "improve CI with digest for docker, build and test jobs" (#57904)
* Revert "Revert "improve CI with digest for docker, build and test jobs""

* fix: docker manifest merge for missing images only
2023-12-18 09:07:22 +01:00
Max K
8c7add0334 Revert "improve CI with digest for docker, build and test jobs (#56317)"
This reverts commit 7844fcc196.
2023-12-15 15:48:01 +01:00
Max K
7844fcc196
improve CI with digest for docker, build and test jobs (#56317)
* CI with digests to tag docker images, reuse builds, reuse tests and others
2023-12-15 15:21:20 +01:00
Antonio Andelic
71adb434e3 Remove f-string 2023-10-18 09:19:09 +00:00
Antonio Andelic
be7be17352
add comment 2023-10-18 10:22:18 +02:00
Antonio Andelic
70d366a8eb Control feature flag randomization with env 2023-10-18 07:59:49 +00:00
Mikhail f. Shiryaev
2d1dba372e
Get rid of the most of os.path stuff 2023-09-28 01:20:05 +02:00
Igor Nikonov
4671901313 Update stress_check.py 2023-09-12 18:17:55 +00:00
Igor Nikonov
8a4654c39e Address review comment 2023-09-12 18:06:00 +00:00
Igor Nikonov
8db991faa0 Fix style 2023-09-12 13:41:31 +00:00
robot-clickhouse
c680c951d3 Automatic style fix 2023-09-07 13:12:53 +00:00
Igor Nikonov
27455a5882 Test timeout to fail 2023-09-07 12:57:35 +00:00
Igor Nikonov
c354fcaff7 Timeout report for stress_check 2023-09-07 12:56:22 +00:00
Mikhail f. Shiryaev
f0c18d4bd7
Rework setup of CI logs export 2023-08-30 22:04:37 +02:00
Alexey Milovidov
428a05a560
Follow-up: Do not send logs to CI if the credentials are not set (#53456)
* Follow-up

* Automatic style fix

* Update tests/ci/ast_fuzzer_check.py

* Update tests/ci/functional_test_check.py

* Update tests/ci/stress_check.py

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-08-16 14:04:14 +03:00
robot-clickhouse
a92fe25ff9 Automatic style fix 2023-08-15 07:15:58 +00:00
Alexey Milovidov
df02512ebf Do not send logs to CI if the credentials are not set 2023-08-15 08:53:08 +02:00
robot-clickhouse
e6e5a3858d Automatic style fix 2023-08-12 20:43:29 +00:00
Alexey Milovidov
176c16fcc5 Export logs from CI in stress tests 2023-08-12 22:30:18 +02:00
Alexey Milovidov
20b77e946a There is no point in detecting flaky tests 2023-07-15 23:00:23 +02:00
Mikhail f. Shiryaev
df33b99907
Rework post_commit_status, add set_status_comment there 2023-04-28 23:52:31 +02:00
Mikhail f. Shiryaev
4405459925
Refactor RerunHelper to reduce API calls 2023-04-28 23:52:30 +02:00
avogar
53a3cfc9e0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-09 13:24:19 +00:00
Alexander Tokmakov
472aa12ba3 add some context to stress test failures 2023-02-01 01:25:31 +01:00
Azat Khuzhin
b1b4aaeef6 ci: more robust results parsers
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-29 09:06:03 +01:00
avogar
d34c8f8432 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-01-20 19:28:15 +00:00
Mikhail f. Shiryaev
db96f9e3db
Rework test_results list/tuple/whatever into class 2023-01-09 12:09:47 +01:00
robot-clickhouse
c7366f7906 Automatic style fix 2023-01-03 19:32:11 +00:00
avogar
64df6ca520 Split stress test and backward compatibility check 2023-01-03 19:22:31 +00:00
Alexey Milovidov
05c27f4e15
Merge pull request #44603 from ClickHouse/runlog
Rename `runlog.log` to `run.log` in tests
2022-12-27 15:14:05 +03:00
Alexey Milovidov
6ba360be71 Rename runlog.log to run.log 2022-12-26 16:29:32 +01:00
alesapin
bb77ad8941 Disable BC check 2022-12-25 13:49:01 +01:00
Mikhail f. Shiryaev
9a422974ab
Timeout stress-tests after 2.5 hours 2022-12-14 12:51:35 +01:00
Mikhail f. Shiryaev
e1a9f2976a
Fix stress_check.py typing 2022-11-29 14:12:27 +01:00
Azat Khuzhin
25e3bebd9d Rework core collecting on CI (eliminate gcore usage)
gcore is a gdb command, that internally uses gdb to dump the core.

However with proper configuration of limits (core_dump.size_limit) it
should not be required, althought some issues is possible:
- non standard kernel.core_pattern
- sanitizers

So yes, gcore is more "universal" (you don't need to configure any
`kernel_pattern`), but it is ad-hoc, and it has drawbacks -
**it does not work when gdb fails**. For example gdb may fail with
`Dwarf Error: DW_FORM_strx1 found in non-DWO CU` in case of DWARF-5 [1].

  [1]: https://github.com/ClickHouse/ClickHouse/pull/40772#issuecomment-1236331323.

Let's try to switch to more native way.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-04 22:07:16 +02:00
Azat Khuzhin
4de309718b tests/stress: use --privileged over --cap-add syslog to obtain dmesg
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-19 13:31:05 +02:00
Azat Khuzhin
923e2f22ef tests/stress: fix dmesg reading
After #39939 there is still an error:

    + dmesg -T
    dmesg: read kernel buffer failed: Operation not permitted

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/39939/a1981f21a153810f072af67bb6007dc1f4367c22/stress_test__debug_.html

Since it is not allowed to access dmesg by default,
one of the following is required:

- --cap-add syslog
- --cap-add cap_sys_admin
- --privileged

I decided to use as little capabilities as possible, even though it is
not that important on CI, but it is a rule of thumb.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-13 21:45:09 +02:00
Mikhail f. Shiryaev
b46622cf3c
Don't use envs for static links 2022-08-12 09:46:36 +02:00