Commit Graph

65 Commits

Author SHA1 Message Date
Max K
84e5870b71
Reapply "improve CI with digest for docker, build and test jobs" (#57904)
* Revert "Revert "improve CI with digest for docker, build and test jobs""

* fix: docker manifest merge for missing images only
2023-12-18 09:07:22 +01:00
Max K
8c7add0334 Revert "improve CI with digest for docker, build and test jobs (#56317)"
This reverts commit 7844fcc196.
2023-12-15 15:48:01 +01:00
Max K
7844fcc196
improve CI with digest for docker, build and test jobs (#56317)
* CI with digests to tag docker images, reuse builds, reuse tests and others
2023-12-15 15:21:20 +01:00
Antonio Andelic
71adb434e3 Remove f-string 2023-10-18 09:19:09 +00:00
Antonio Andelic
be7be17352
add comment 2023-10-18 10:22:18 +02:00
Antonio Andelic
70d366a8eb Control feature flag randomization with env 2023-10-18 07:59:49 +00:00
Mikhail f. Shiryaev
2d1dba372e
Get rid of the most of os.path stuff 2023-09-28 01:20:05 +02:00
Igor Nikonov
4671901313 Update stress_check.py 2023-09-12 18:17:55 +00:00
Igor Nikonov
8a4654c39e Address review comment 2023-09-12 18:06:00 +00:00
Igor Nikonov
8db991faa0 Fix style 2023-09-12 13:41:31 +00:00
robot-clickhouse
c680c951d3 Automatic style fix 2023-09-07 13:12:53 +00:00
Igor Nikonov
27455a5882 Test timeout to fail 2023-09-07 12:57:35 +00:00
Igor Nikonov
c354fcaff7 Timeout report for stress_check 2023-09-07 12:56:22 +00:00
Mikhail f. Shiryaev
f0c18d4bd7
Rework setup of CI logs export 2023-08-30 22:04:37 +02:00
Alexey Milovidov
428a05a560
Follow-up: Do not send logs to CI if the credentials are not set (#53456)
* Follow-up

* Automatic style fix

* Update tests/ci/ast_fuzzer_check.py

* Update tests/ci/functional_test_check.py

* Update tests/ci/stress_check.py

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-08-16 14:04:14 +03:00
robot-clickhouse
a92fe25ff9 Automatic style fix 2023-08-15 07:15:58 +00:00
Alexey Milovidov
df02512ebf Do not send logs to CI if the credentials are not set 2023-08-15 08:53:08 +02:00
robot-clickhouse
e6e5a3858d Automatic style fix 2023-08-12 20:43:29 +00:00
Alexey Milovidov
176c16fcc5 Export logs from CI in stress tests 2023-08-12 22:30:18 +02:00
Alexey Milovidov
20b77e946a There is no point in detecting flaky tests 2023-07-15 23:00:23 +02:00
Mikhail f. Shiryaev
df33b99907
Rework post_commit_status, add set_status_comment there 2023-04-28 23:52:31 +02:00
Mikhail f. Shiryaev
4405459925
Refactor RerunHelper to reduce API calls 2023-04-28 23:52:30 +02:00
avogar
53a3cfc9e0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-09 13:24:19 +00:00
Alexander Tokmakov
472aa12ba3 add some context to stress test failures 2023-02-01 01:25:31 +01:00
Azat Khuzhin
b1b4aaeef6 ci: more robust results parsers
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-29 09:06:03 +01:00
avogar
d34c8f8432 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-01-20 19:28:15 +00:00
Mikhail f. Shiryaev
db96f9e3db
Rework test_results list/tuple/whatever into class 2023-01-09 12:09:47 +01:00
robot-clickhouse
c7366f7906 Automatic style fix 2023-01-03 19:32:11 +00:00
avogar
64df6ca520 Split stress test and backward compatibility check 2023-01-03 19:22:31 +00:00
Alexey Milovidov
05c27f4e15
Merge pull request #44603 from ClickHouse/runlog
Rename `runlog.log` to `run.log` in tests
2022-12-27 15:14:05 +03:00
Alexey Milovidov
6ba360be71 Rename runlog.log to run.log 2022-12-26 16:29:32 +01:00
alesapin
bb77ad8941 Disable BC check 2022-12-25 13:49:01 +01:00
Mikhail f. Shiryaev
9a422974ab
Timeout stress-tests after 2.5 hours 2022-12-14 12:51:35 +01:00
Mikhail f. Shiryaev
e1a9f2976a
Fix stress_check.py typing 2022-11-29 14:12:27 +01:00
Azat Khuzhin
25e3bebd9d Rework core collecting on CI (eliminate gcore usage)
gcore is a gdb command, that internally uses gdb to dump the core.

However with proper configuration of limits (core_dump.size_limit) it
should not be required, althought some issues is possible:
- non standard kernel.core_pattern
- sanitizers

So yes, gcore is more "universal" (you don't need to configure any
`kernel_pattern`), but it is ad-hoc, and it has drawbacks -
**it does not work when gdb fails**. For example gdb may fail with
`Dwarf Error: DW_FORM_strx1 found in non-DWO CU` in case of DWARF-5 [1].

  [1]: https://github.com/ClickHouse/ClickHouse/pull/40772#issuecomment-1236331323.

Let's try to switch to more native way.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-04 22:07:16 +02:00
Azat Khuzhin
4de309718b tests/stress: use --privileged over --cap-add syslog to obtain dmesg
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-19 13:31:05 +02:00
Azat Khuzhin
923e2f22ef tests/stress: fix dmesg reading
After #39939 there is still an error:

    + dmesg -T
    dmesg: read kernel buffer failed: Operation not permitted

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/39939/a1981f21a153810f072af67bb6007dc1f4367c22/stress_test__debug_.html

Since it is not allowed to access dmesg by default,
one of the following is required:

- --cap-add syslog
- --cap-add cap_sys_admin
- --privileged

I decided to use as little capabilities as possible, even though it is
not that important on CI, but it is a rule of thumb.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-13 21:45:09 +02:00
Mikhail f. Shiryaev
b46622cf3c
Don't use envs for static links 2022-08-12 09:46:36 +02:00
Mikhail f. Shiryaev
372481e770
Rework S3Helper a little bit 2022-08-11 15:01:32 +02:00
Mikhail f. Shiryaev
2fb68078e8
Replace S3 URLs by parameter 2022-08-10 15:22:04 +02:00
Yakov Olkhovskiy
1a52fa183d rename Simple Check to Mergeable Check, refactor processing 2022-08-05 10:39:58 -04:00
Vladimir C
2622791b9e
upd 2022-06-01 16:17:17 +02:00
Vladimir C
773eb15afc
Try mound instead of volume docker arg in stress_check 2022-06-01 14:36:51 +02:00
Vladimir C
42feae8940
fix stress_check.py 2022-06-01 10:44:44 +02:00
vdimir
4d336d0228
Get rid of duplicate download_previous_release 2022-05-31 17:50:29 +00:00
alesapin
cf6898d05b Merge branch 'master' into fail_build_check_in_error_status 2022-03-30 11:08:24 +02:00
Nikolai Kochetov
3849e63ab1 Change database 2022-03-29 19:06:50 +00:00
alesapin
ebd72e433d Fail checks in case of errors 2022-03-29 14:41:47 +02:00
Mikhail f. Shiryaev
74c5873be0
Do not upload runlog two times 2022-03-07 14:31:17 +01:00
Mikhail f. Shiryaev
3e852ae461
Apply black to stress tests script 2022-03-07 14:25:06 +01:00