Commit Graph

618 Commits

Author SHA1 Message Date
Mikhail f. Shiryaev
546a03281f
Rework image building:
- Make it arch-agnostic
- Add necessary packages
- Update runner version
- Get public keys of ClickHouse/core members
2021-12-15 11:19:08 +01:00
alesapin
2c78e7ed72 Fix performance build 2021-12-15 11:07:12 +03:00
alesapin
2e8b75ade4 Fix configs 2021-12-15 10:45:27 +03:00
alesapin
2753fe01a3 Merge branch 'master' into fix_special_build_check 2021-12-15 10:35:28 +03:00
Mikhail f. Shiryaev
97301a19b9
Unify init scripts in one 2021-12-14 18:44:51 +01:00
alesapin
e124e5807f Fix build performance 2021-12-14 19:29:30 +03:00
alesapin
c46c912507 Followup 2021-12-14 19:16:22 +03:00
mergify[bot]
68c96f4dd4
Merge branch 'master' into add_performance_tests 2021-12-14 11:04:41 +00:00
alesapin
7b29377338 Better control build artifacts 2021-12-14 13:40:03 +03:00
alesapin
d5925d7e2d Trying stress testers 2021-12-14 13:31:31 +03:00
Kruglov Pavel
d065b8233d
Update backport.py 2021-12-13 20:40:06 +03:00
alesapin
242149d881 Rerun release workflows 2021-12-13 18:54:14 +03:00
alesapin
949e68e2ac
Merge pull request #32696 from vdimir/trust-cont-lower
Check trusted contributors in lowercase
2021-12-13 18:20:16 +03:00
alesapin
856dd3735c Merge branch 'master' into add_performance_tests 2021-12-13 18:09:59 +03:00
vdimir
0c83b14c37
Check trusted contributors in lowercase 2021-12-13 17:34:17 +03:00
alesapin
fad904b0aa Merge branch 'master' into add_performance_tests 2021-12-13 14:32:35 +03:00
alesapin
1f5157e240
Merge pull request #32618 from ClickHouse/upload_logs_of_failed_task
CI: upload logs if task failed
2021-12-13 12:42:39 +03:00
alesapin
b34f5210e7 Followup 2021-12-13 12:04:08 +03:00
alesapin
cf281b10dc Split perf test into multiple checks 2021-12-13 11:59:58 +03:00
alesapin
c1d3323e25 Rerun workflows more times 2021-12-13 10:48:57 +03:00
Alexander Tokmakov
62015ba610 Merge branch 'master' into upload_logs_of_failed_task 2021-12-12 15:20:25 +03:00
Alexander Tokmakov
e8613ba386 upload logs of failed task 2021-12-12 15:09:44 +03:00
alesapin
eb51d9550d
Merge branch 'master' into add_performance_tests 2021-12-12 01:01:13 +03:00
alesapin
84bccb83bd Trying to add debug info 2021-12-10 19:38:20 +03:00
alesapin
a6e55b00e3
Revert "Revert "Split long tests into multiple checks"" 2021-12-10 18:39:02 +03:00
alesapin
dcbba460c1
Revert "Split long tests into multiple checks" 2021-12-10 18:38:42 +03:00
alesapin
a2aa0bc6cc
Merge pull request #32496 from ClickHouse/smaller_checks
Split long tests into multiple checks
2021-12-10 17:42:14 +03:00
alesapin
4eb2dee857 Don't use tmpfs 2021-12-10 16:09:00 +03:00
alesapin
2c7bb56a2c Split integration tests into parts 2021-12-10 13:22:29 +03:00
alesapin
f655b43f5a Merge branch 'master' into add_performance_tests 2021-12-10 12:32:43 +03:00
alesapin
94a557a80e Trying another host 2021-12-10 12:31:09 +03:00
alesapin
32f78f2ba4 Better check name 2021-12-10 12:09:11 +03:00
alesapin
4c1babee05 Split long functional tests to multiple checks 2021-12-10 12:07:24 +03:00
alesapin
dc21d423d1
Merge pull request #32494 from ClickHouse/fix_integration_tests_images
Fix integration tests docker images path
2021-12-10 10:56:15 +03:00
alesapin
db83d82f5a Fix integration tests path 2021-12-10 10:54:37 +03:00
tavplubix
85e53b1b1f
Try fix attaching gdb in tests (#32448)
* attach gdb with sudo

* fix

* Update run.sh
2021-12-10 00:12:45 +03:00
alesapin
5b06e30ea2
Merge pull request #32462 from ClickHouse/automatic_rerun
Add automatic workflow rerun
2021-12-09 18:31:59 +03:00
alesapin
19f8b416bc Add automatic workflow rerun 2021-12-09 16:28:15 +03:00
alesapin
08c699cbdd
Merge pull request #32438 from ClickHouse/fix_image_for_integration_tests
Fix images names in integration tests
2021-12-09 15:38:50 +03:00
alesapin
af6ce89e95 Better report 2021-12-09 15:02:13 +03:00
alesapin
7ea7aa8db8 Fix build check 2021-12-09 12:17:03 +03:00
alesapin
67d89929a3 Add ramdrive 2021-12-09 12:04:05 +03:00
alesapin
b62de9b2f4 Merge branch 'master' into add_performance_tests 2021-12-09 11:40:32 +03:00
alesapin
fad3158bf7 Fix images names in integration tests 2021-12-09 10:55:51 +03:00
alesapin
a625dd41e8
Merge branch 'master' into better_logs 2021-12-03 15:31:45 +03:00
Constantine Peresypkin
7c90d4f8e3 refactor CI tests 2021-12-03 12:22:50 +02:00
alesapin
caa481aba8 Use ccache in fast test 2021-12-03 12:28:17 +03:00
alesapin
99a5ca2646 Fix style (got tired of it) 2021-12-03 12:19:39 +03:00
alesapin
ec0bfa7bcf Better output for some actions 2021-12-03 11:33:16 +03:00
alesapin
7699d3f35e
Merge pull request #32162 from azat/double-gz
tests/ci: do not compress logs twice
2021-12-03 10:20:35 +03:00
Azat Khuzhin
bfaaa79cfc tests/ci: do not compress logs twice
Cc: @alesapin
2021-12-03 01:28:32 +03:00
mergify[bot]
e2cb91b560
Merge branch 'master' into add_one_more_group 2021-12-02 19:28:13 +00:00
alesapin
f2140be90b Fix CI 2021-12-02 22:03:59 +03:00
alesapin
c14086d578
Merge pull request #32064 from ClickHouse/lightweight_checks_rerun
Add ability for lightweight checks rerun
2021-12-02 20:54:27 +03:00
alesapin
9e1437a7c4 Small improvements in lambda code 2021-12-02 19:38:18 +03:00
alesapin
7ef0737edc Move fuzzers and unit tests to another group 2021-12-02 13:23:32 +03:00
alesapin
c07450a7dc Fixup one more time 2021-12-02 10:49:44 +03:00
alesapin
a29b7105da fixup 2021-12-01 22:17:23 +03:00
alesapin
bf5858a6b3 Fix build urls 2021-12-01 22:14:46 +03:00
alesapin
e298e14c3b Fix rerun helper and build report 2021-12-01 18:50:48 +03:00
alesapin
c13a72991b Fix style 2021-12-01 17:47:10 +03:00
alesapin
71e6c7e92e Add ability to rerun checks 2021-12-01 17:23:51 +03:00
alesapin
1977ab6a8e
Merge pull request #32051 from ClickHouse/cancel_checks_more_agressively
Cancel redundant checks with lambda
2021-12-01 15:39:40 +03:00
alesapin
6cdb9f65a4 Cancel redundant checks with lambda 2021-12-01 15:38:17 +03:00
Mikhail f. Shiryaev
23f9c8bbba
Fix building rpm and tgz for branch pushes 2021-12-01 12:44:39 +01:00
alesapin
8261e12a48
Merge pull request #32041 from ClickHouse/remove_most_of_old_checks
Remove most of old checks
2021-12-01 14:02:22 +03:00
alesapin
e54dc89a84
Merge pull request #32044 from ClickHouse/report_success_in_case_of_force_tests
Fix force tests label
2021-12-01 13:26:58 +03:00
alesapin
a72f7a25f1 Fix force tests label 2021-12-01 12:50:36 +03:00
mergify[bot]
ffc1f4eb92
Merge branch 'master' into remove_most_of_old_checks 2021-12-01 09:45:19 +00:00
alesapin
f76149a1ec Better scripts for runners 2021-12-01 12:39:09 +03:00
alesapin
b421d07434 Remove most of old checks 2021-12-01 12:21:01 +03:00
alesapin
fb1d5e413e
Merge pull request #31987 from ClickHouse/add_special_functional_tests
Add rest functional tests to CI
2021-12-01 12:18:36 +03:00
alesapin
37f734bd6c
Merge pull request #31991 from ClickHouse/add_special_builds_to_ci
Add special builds to CI
2021-11-30 23:03:15 +03:00
alesapin
adf6ff8477 Fix build on master 2021-11-30 18:58:45 +03:00
alesapin
4b1b92a288 Better builds report 2021-11-30 18:33:29 +03:00
alesapin
e4cb882909 Add special builds to CI 2021-11-30 15:45:18 +03:00
alesapin
208eb6563c Add rest functional tests 2021-11-30 14:40:19 +03:00
Mikhail f. Shiryaev
1ba5fd5912
Merge pull request #31952 from ClickHouse/adjust_packages_buckets
Adjust packages buckets
2021-11-30 11:20:09 +01:00
alesapin
cc3321f1ff Fix docs check 2021-11-30 10:42:02 +03:00
Mikhail f. Shiryaev
b5c9f09f9b
Push packages from master actions to a version bucket 2021-11-29 16:07:19 +01:00
Mikhail f. Shiryaev
d7cf4f78c3
Create get_event function to read event data 2021-11-29 16:07:18 +01:00
Mikhail f. Shiryaev
ecf2282476
Adjust artifactory pusher to the new S3 paths 2021-11-29 16:07:15 +01:00
alesapin
9be8e21529 Add json type to changes in documentation 2021-11-28 15:55:23 +03:00
alesapin
91ff4caba4
Merge pull request #31861 from ClickHouse/more_clear_build_paths
Get rid of build numbers and simplify builds paths in S3
2021-11-28 15:33:41 +03:00
alesapin
c2d7731544
Update ci_config.py 2021-11-26 16:37:46 +03:00
alesapin
464b943b38 fix comment 2021-11-26 13:59:38 +03:00
alesapin
081bfdfe82 Get rid of build numbers and simplify builds paths in S3 2021-11-26 13:57:36 +03:00
Nikolai Kochetov
260928cb95
Merge pull request #31724 from ClickHouse/add-another-ci-database
Try to push data into another ci database.
2021-11-26 11:22:56 +03:00
alesapin
3562264404
Merge pull request #31803 from ClickHouse/faster_tests
Shorter stress and fuzzer tests
2021-11-26 10:17:26 +03:00
alexey-milovidov
6b8f7ad03f
Merge pull request #31798 from ClickHouse/fix-31748
Fix stylecheck for tests/ci/push_to_artifactory.py
2021-11-26 00:11:32 +03:00
alesapin
55b9724fe7
Merge pull request #31821 from ClickHouse/fix_sender_check
Fix check in approve lambda
2021-11-25 19:26:32 +03:00
alesapin
bc5dcaf59c Fix check in approve lambda 2021-11-25 19:25:29 +03:00
Mikhail f. Shiryaev
4c6df59f52
Fix style check 2021-11-25 17:06:37 +01:00
alesapin
71ae890c59
Merge pull request #31544 from azat/ci-actions-fixes
Remove duplicated not compressed logs from CI (actions)
2021-11-25 18:43:44 +03:00
alesapin
c301c1a5f1 Stricter check for docs 2021-11-25 18:23:00 +03:00
alesapin
f60fdc7a8b
Merge pull request #31767 from ClickHouse/fail_fasttest_if_some_tests_was_not_successful
Fail fasttest, builds and functional checks if some tests was not successful
2021-11-25 17:47:12 +03:00
alesapin
8890dc675e
Merge pull request #31782 from ClickHouse/use_git_version_number_for_builds
Use version from git describe in builds
2021-11-25 17:45:35 +03:00
alesapin
e6e4c485bc More simple 2021-11-25 16:41:38 +03:00
alesapin
a911e65b34
Update tests/ci/version_helper.py
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2021-11-25 16:25:09 +03:00
alesapin
3d811aeec1 Use version from git describe in builds 2021-11-25 14:19:26 +03:00
Mikhail f. Shiryaev
cddccfbfff
Merge pull request #31748 from ClickHouse/migrate-to-artifactory
Add script for pushing deb and rpm packages to artifactory
2021-11-25 11:48:01 +01:00
Mikhail f. Shiryaev
3e6bc6796c
Finish the script
- add logging to rpm and deb deployment
- fix art_client name
- use dowload_build_with_progress function
- move the script to tests/ci
2021-11-25 11:36:00 +01:00
alesapin
a6a44cf8b6 Fix style 2021-11-25 13:11:47 +03:00
alesapin
c09feaf2a8 Also fail builds and functional tests 2021-11-25 13:01:29 +03:00
alesapin
b687d9515b Fail fast test check 2021-11-25 12:23:45 +03:00
alesapin
27ff9d1fc7 Trying to fix pr info for backport
(cherry picked from commit 811e0be749)
2021-11-25 12:00:19 +03:00
Nikolai Kochetov
ddcaac441a Fix style. 2021-11-25 11:52:00 +03:00
alesapin
58fad90351
Merge branch 'master' into add_performance_tests 2021-11-25 10:53:10 +03:00
alesapin
02c238ba92
Merge pull request #31654 from ClickHouse/fixes_in_ci
Integration tests flaky check and small fixes
2021-11-25 10:29:51 +03:00
alesapin
cf2f019caa Disable full run in perf tests 2021-11-24 23:05:27 +03:00
Nikolai Kochetov
3714112d57 Update helpers 2021-11-24 21:18:49 +03:00
Nikolai Kochetov
060e0d0605 Try to push data into another ci database. 2021-11-24 21:04:11 +03:00
alesapin
2f87975621 Fix set serialization 2021-11-24 17:43:17 +03:00
alexey-milovidov
2da5c6b71b
Merge pull request #31651 from ClickHouse/blinkov-patch-23
[ci] add flickerbox-tom to whitelist
2021-11-24 15:35:21 +03:00
alesapin
94ae17a3f7 Add changed files 2021-11-24 13:51:03 +03:00
alexey-milovidov
a79a0fa265
Update run_check.py 2021-11-24 00:34:57 +03:00
alexey-milovidov
155ed1d4cb
Update run_check.py 2021-11-24 00:33:48 +03:00
alesapin
42c77323e8
Merge branch 'master' into add_performance_tests 2021-11-23 22:14:32 +03:00
alexey-milovidov
341f705419
Merge pull request #30599 from ClickHouse/zlib-ng-own-cmake
Use our own CMakeLists for `zlib-ng`, `cassandra`, `mariadb-connector-c` and `xz`, `re2`, `sentry`, `gsasl`, `arrow`, `protobuf`.
2021-11-23 13:33:29 +03:00
Ivan Blinkov
726fc659fa
Update run_check.py 2021-11-23 13:21:57 +03:00
alesapin
d843f8f1a6 Remove event 2021-11-23 13:07:02 +03:00
alesapin
dc288a95b4 Small fixes in CI 2021-11-23 12:43:49 +03:00
alesapin
9efaa753be Fix images 2021-11-23 12:43:26 +03:00
Ivan Blinkov
41c4ac7ac6
[ci] add flickerbox-tom to whitelist 2021-11-23 12:34:31 +03:00
alesapin
2396f73e08 Fix performance tests comparison 2021-11-23 11:34:10 +03:00
alesapin
62b2eb6694 Merge branch 'master' into add_performance_tests 2021-11-23 11:26:45 +03:00
alesapin
2bef313f75
Merge pull request #31617 from ClickHouse/fix_unit_tests_build
Fix build requirements for unit tests
2021-11-23 10:45:37 +03:00
alesapin
32cf30059a Merge branch 'master' into add_performance_tests 2021-11-22 14:31:25 +03:00
alesapin
841141440b Fix search for PR 2021-11-22 12:56:13 +03:00
alesapin
589bb9eb92 Trying to use push event 2021-11-22 12:39:45 +03:00
alesapin
2f11ad7241 Add workflow run for release branches 2021-11-22 11:33:52 +03:00
alesapin
c2b90eeb16 Fix in old CI too 2021-11-22 11:09:21 +03:00
alesapin
8fd5ff7452 Fix build requirements for unit tests 2021-11-22 11:06:42 +03:00
alesapin
26a6faf7cc Fix test run 2021-11-21 15:35:31 +03:00
Alexey Milovidov
d604cf5573 Remove the infamous "unbundled" build 2021-11-21 13:58:26 +03:00
Ilya Yatsishin
571502354d
Merge pull request #31540 from ClickHouse/push_data_to_ci_db 2021-11-21 09:53:31 +03:00
Azat Khuzhin
686eba761c github actions: compress .log. too 2021-11-19 21:33:48 +03:00
alesapin
9179c10d14 Fix style 2021-11-19 18:42:56 +03:00
alesapin
466df39bd4 Followup 2021-11-19 18:24:39 +03:00
alesapin
d69c9f951e Fix 2021-11-19 18:09:18 +03:00
alesapin
f62a34e808 Fix typo 2021-11-19 17:56:54 +03:00
alesapin
308cc722f3 Push tests results to CI database 2021-11-19 17:47:04 +03:00
Constantine Peresypkin
315e793e6c remove hardcoded CI values 2021-11-19 14:58:26 +02:00
alesapin
fb54bd8026 Remove redundant code 2021-11-18 12:16:00 +03:00
alesapin
9fb5c26640 Fix 2021-11-18 11:07:54 +03:00
alesapin
8b052cdd25 Update perf build 2021-11-18 10:32:20 +03:00
alesapin
d0ec0c5dc8 Merge branch 'master' into add_performance_tests 2021-11-18 10:17:20 +03:00
Ivan Blinkov
864761b1be
[ci] whitelist codyrobert 2021-11-18 02:05:41 +03:00
alesapin
919089ddbe Fix 2021-11-17 15:08:46 +03:00
alesapin
1cec1d3aaa Hack for performance build 2021-11-17 14:03:09 +03:00
alesapin
a5c019b3ba Fix ci config 2021-11-17 12:41:19 +03:00
alesapin
7f09941c72 Add performance comparison check 2021-11-16 14:16:10 +03:00
alesapin
e426078344 Trying to debug integration tests 2021-11-16 11:59:38 +03:00
alesapin
5df1c080c9 Binary release 2021-11-15 16:20:48 +03:00
alesapin
6bd5540395 Fixes 2021-11-15 10:07:03 +03:00
alesapin
63a4d0b6a2 Debugging broken checks 2021-11-12 22:57:26 +03:00
alesapin
aae000372f Fix build config 2021-11-12 16:43:13 +03:00
alesapin
78c44976a4 Fix ci config 2021-11-12 16:34:33 +03:00
alesapin
17f2e61cd6 Underscores everywhere 2021-11-12 16:16:17 +03:00
alesapin
43c70c1c36 Fix build check 2021-11-12 16:08:06 +03:00
alesapin
40c323af5f Fix style 2021-11-12 16:01:41 +03:00
alesapin
d139ed5663 Fix 2021-11-12 15:50:56 +03:00
alesapin
373fda6eb8 More fixes 2021-11-12 15:36:25 +03:00
alesapin
2e6da9ea71 Fixes 2021-11-12 15:13:13 +03:00
alesapin
7a62338b0e Remove moar 2021-11-12 14:39:00 +03:00
alesapin
dc9a8f55c5 Add missed config 2021-11-12 14:12:42 +03:00
alesapin
45410b7032 Remove duplicated from CI 2021-11-12 14:11:44 +03:00
alesapin
9a437980e8 Merge branch 'master' into get_rid_of_build_number 2021-11-12 14:08:09 +03:00
alesapin
c1c1985e36 Get rid of build number 2021-11-12 14:07:54 +03:00
alesapin
e94b359bca Remove 2021-11-12 12:40:33 +03:00
alesapin
864f02dfc5 Fix run log 2021-11-12 12:33:22 +03:00
alesapin
8dc137abcd Fix check 2021-11-11 22:42:59 +03:00
alesapin
3fe15245b8 Fix special build number 2021-11-11 19:18:24 +03:00
alesapin
5046b39d58 Download tgz 2021-11-11 18:45:20 +03:00
alesapin
2a2549eb9b Add split build check 2021-11-11 16:57:17 +03:00
alesapin
c4480b366f Merge branch 'master' into add_compatibility_check 2021-11-11 14:38:25 +03:00
alesapin
e5d44befbe
Merge pull request #31287 from ClickHouse/download_ccache_in_builds
Followup to ccache build
2021-11-11 13:09:19 +03:00
alesapin
8cb3c5cb57
Merge pull request #31248 from ClickHouse/add_flaky_check
Add flaky check to new CI
2021-11-11 12:44:36 +03:00
alesapin
b059cc4f22 Followup 2021-11-11 11:53:20 +03:00
alesapin
68ed04afe4 Build check 2021-11-11 10:33:44 +03:00
alesapin
349f266c1a Add flaky check 2021-11-10 16:49:19 +03:00
alesapin
0cdc1307b8 Ongoing fix 2021-11-10 16:33:18 +03:00
alesapin
32a2493b39 Better 2021-11-10 16:31:28 +03:00
alesapin
9792b87028 Add smoke test 2021-11-10 16:28:12 +03:00
alesapin
6649881f85 Fix style: 2021-11-10 16:09:23 +03:00
alesapin
959fad161a Fix 2021-11-10 14:13:34 +03:00
alesapin
b105dab3a4 Remove ccache 2021-11-10 14:08:42 +03:00
alesapin
fc04b658bf Add compatibility check 2021-11-10 13:17:19 +03:00
alesapin
0e02ed3b89 Followup 2021-11-10 12:10:42 +03:00
alesapin
7920724a81 Moar logging 2021-11-10 12:08:43 +03:00
alesapin
2174a3d348
Merge pull request #31177 from ClickHouse/add_cherry_pick_on_actions
Debug cherry-pick CI
2021-11-10 10:28:22 +03:00
alesapin
f2eb48fe5c Fix 2021-11-09 20:56:44 +03:00
alesapin
54f953f26c Fix 2021-11-09 20:40:23 +03:00
alesapin
829dcc9a56 Trying to cheat 2021-11-09 16:09:34 +03:00
alesapin
2cfa97782c Use robot token 2021-11-09 15:40:03 +03:00
alesapin
da196c7a71 More retries 2021-11-09 14:34:08 +03:00
alesapin
5674a7df3a Fix relative imports 2021-11-09 14:14:30 +03:00
alesapin
6af1a2ee6a Trying other way 2021-11-09 14:10:57 +03:00
alesapin
dc1964aa9a Add unit tests to CI 2021-11-09 13:15:22 +03:00
alesapin
fefac35bef
Merge pull request #31158 from ClickHouse/add_cherry_pick_on_actions
Add cherry-pick on github actions
2021-11-09 10:50:56 +03:00