Commit Graph

1122 Commits

Author SHA1 Message Date
Mikhail f. Shiryaev
ff26492830
Prevent spoiling rollback_stack 2022-08-04 00:24:43 +02:00
Mikhail f. Shiryaev
c6948c3e82
Use token for all requests 2022-08-03 19:17:41 +02:00
Mikhail f. Shiryaev
61fd28e19f
Get api url from event, not from const/ENV 2022-08-03 19:17:41 +02:00
Mikhail f. Shiryaev
62a05dc10d
Add instructions for github-cli installation 2022-08-03 13:40:31 +02:00
Mikhail f. Shiryaev
2ca9df9b22
Merge pull request #39421 from ClickHouse/github-helper
GitHub helper
2022-08-03 12:04:03 +02:00
Mikhail f. Shiryaev
08474cf869
Update tweak on version part update 2022-08-03 11:43:47 +02:00
Mikhail f. Shiryaev
469b7e7668
Add notes about _is_cache_updated logic 2022-08-02 18:44:49 +02:00
Mikhail f. Shiryaev
70d97e9393
Merge pull request #39630 from ClickHouse/workflow-rerun-lambda
Attempt to fix wrong workflow_run data for rerun
2022-08-02 18:29:43 +02:00
Mikhail f. Shiryaev
f150966f10
Merge pull request #39723 from ClickHouse/cherry-pick-fix
Fix cherry-pick for cases, when assignee is not set for PR
2022-08-02 13:13:47 +02:00
Mikhail f. Shiryaev
26ef951fde
Add DNS trick to the dockerhub proxy too 2022-08-02 12:04:26 +02:00
Alexander Tokmakov
82b50e79cf
Merge branch 'master' into tsan_clang_15 2022-08-02 13:00:55 +03:00
Alexey Milovidov
b275aae95d
Update init_runner.sh 2022-08-02 03:23:53 +03:00
Alexey Milovidov
488ae32295
Update init_runner.sh 2022-08-02 03:23:05 +03:00
Robert Schulze
b33fe26d8c
Merge pull request #39759 from ClickHouse/splitted-to-shared-renaming
Rename "splitted build" to "shared libraries build" in CI tools
2022-08-01 22:39:57 +02:00
Mikhail f. Shiryaev
afcf76e899
Add cloudflare DNS as a fallback 2022-08-01 18:27:17 +02:00
robot-clickhouse
af2f1b4cc3 Automatic style fix 2022-08-01 13:22:53 +00:00
Mikhail f. Shiryaev
33b26dda05
Improve logging
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2022-08-01 15:15:48 +02:00
Mikhail f. Shiryaev
079db7f34b
Retry inserts with ClickHouseHelper 2022-08-01 14:59:13 +02:00
Robert Schulze
0e154ed1df
More renamings 2022-08-01 07:05:39 +00:00
Alexander Tokmakov
31550436e4 try clang-15 for build with tsan 2022-07-31 14:38:13 +02:00
Robert Schulze
729d19fa4f
Rename "splitted build" to "shared libraries build" in CI tools
- The old name made sense for (dev option) "-DUSE_STATIC_LIBRARIES=0
  -DSPLIT_SHARED_LIBRARIES=1 -DSPLIT_BINARY=1" but that was removed with
  #39520.

- What still exists is "-DUSE_STATIC_LIBRARIES=0
  -DSPLIT_SHARED_LIBRARIES=1" which does a shared library build
2022-07-31 12:26:51 +00:00
Alexey Milovidov
d306063a76
Merge branch 'master' into add-more-s3-tests 2022-07-31 01:15:49 +03:00
Mikhail f. Shiryaev
6126bd60ed
Fix cherry-pick for cases, when assignee is not set for PR 2022-07-29 19:27:38 +02:00
Mikhail f. Shiryaev
f0474f9e46
Improve lambda logic, don't fail on non-uniq PR 2022-07-28 14:24:42 +02:00
Mikhail f. Shiryaev
2338d01a20
Deploy workflow_approve_rerun_lambda as zip package 2022-07-28 14:23:59 +02:00
alesapin
e6d22793c9
Merge pull request #39428 from ClickHouse/block-builds-by-style
Require clear style check to continue building
2022-07-27 11:55:46 +02:00
Mikhail f. Shiryaev
0db9dda5f3
Attempt to fix wrong workflow_run data for rerun 2022-07-26 23:10:58 +02:00
Mikhail f. Shiryaev
061e61919a
Merge pull request #39450 from ClickHouse/tsal-clang-13
Build thread sanitizer binaries with clang-13
2022-07-26 15:13:17 +02:00
Mikhail f. Shiryaev
d9baa0b1f7 Finish following runs with the same exit code as the first 2022-07-26 14:22:11 +02:00
Mikhail f. Shiryaev
db0653758e Add typing to rerun and commit_status helpers 2022-07-26 14:22:11 +02:00
Alexey Milovidov
5867762258
Merge pull request #39454 from ClickHouse/status-names
Commit status names: remove "actions"
2022-07-24 17:39:16 +03:00
Mikhail f. Shiryaev
4302f583d8
Merge pull request #39467 from ClickHouse/ci-enforce-checks-2
Add Build Check and Special Build Check to SimpleCheck
2022-07-24 00:24:55 +02:00
Alexey Milovidov
b6b217d2a3
Merge branch 'master' into status-names 2022-07-24 00:34:00 +03:00
Yakov Olkhovskiy
c559cac085 add to SimpleCheck 2022-07-22 18:01:57 -04:00
Mikhail f. Shiryaev
17b504b0d4
Build thread sanitizer binaries with clang-13 2022-07-22 12:14:22 +02:00
robot-clickhouse
0d34814629 Automatic style fix 2022-07-21 16:39:14 +00:00
Mikhail f. Shiryaev
685a8f3949
Intentionally break black formatting 2022-07-21 17:01:45 +02:00
Mikhail f. Shiryaev
f60dcc30fb
Push automatic fix for black format for PRs 2022-07-21 17:01:42 +02:00
Mikhail f. Shiryaev
dacfc7886c
Improve style_check scripts style a little bit 2022-07-21 16:59:44 +02:00
Mikhail f. Shiryaev
209a5047c0
Improve caching logic, add cached NamedUser 2022-07-21 15:45:38 +02:00
Mikhail f. Shiryaev
d42018a2dc
Cleanup the rest of (actions) status names 2022-07-21 13:10:22 +02:00
Mikhail f. Shiryaev
b0eef42b9b
Remove unused Testflows and Release ci configs 2022-07-21 13:07:14 +02:00
Mikhail f. Shiryaev
31be011430
Rename bugfix checks statuses, clear unised ci config 2022-07-21 13:04:34 +02:00
Mikhail f. Shiryaev
c24800c7d5
Merge pull request #39307 from ClickHouse/ci-simple-check-fix-rerun
Simple Check should be updated on rerun
2022-07-21 13:01:59 +02:00
Mikhail f. Shiryaev
9679401a67
Rename flaky tests statuses 2022-07-21 12:58:36 +02:00
Mikhail f. Shiryaev
3ab288b095
Rename AST fuzzer statuses 2022-07-21 12:47:49 +02:00
Mikhail f. Shiryaev
8be0d9287d
Rename unit tests statuses 2022-07-21 12:45:46 +02:00
Mikhail f. Shiryaev
69f0cf19f4
Rename integration tests statuses 2022-07-21 12:43:42 +02:00
Mikhail f. Shiryaev
cc3c47c143
Rename stress tests statuses 2022-07-21 12:41:49 +02:00
Mikhail f. Shiryaev
f3ba18778d
Rename stateless tests statuses 2022-07-21 12:36:25 +02:00
Mikhail f. Shiryaev
9259e5ca77
Rename stateful tests statuses 2022-07-21 12:32:54 +02:00
Mikhail f. Shiryaev
7acf3dd624
Rename build reports statuses 2022-07-21 12:27:45 +02:00
Yakov Olkhovskiy
baff8327b9 do not recreate Simple Check if already exists 2022-07-21 01:41:55 -04:00
Yakov Olkhovskiy
f30b54a392 fail_simple_check is added 2022-07-21 01:36:13 -04:00
Yakov Olkhovskiy
c4073328fa add get_finished_status function 2022-07-21 01:36:12 -04:00
Mikhail f. Shiryaev
d100fac7ab
Use checkout -f preventing some potential issues 2022-07-20 17:29:34 +02:00
Mikhail f. Shiryaev
caef6729f4
Improve debug logging of github_helper 2022-07-18 10:32:45 +02:00
Mikhail f. Shiryaev
9cc06ea0e4
Fix found points during the review 2022-07-17 14:05:21 +02:00
Mikhail f. Shiryaev
6e48b08190
Clean-up some staff left after finishing 2022-07-15 17:58:45 +02:00
Mikhail f. Shiryaev
dc6db5b5d9
Replace sys.exit by Exception to rollback stash and clear_repo 2022-07-15 17:21:19 +02:00
Mikhail f. Shiryaev
48797660ff
Process exceptions per PR to not fail the script 2022-07-15 17:21:18 +02:00
Mikhail f. Shiryaev
30b0995532
Add early check if PR is already in a release branch 2022-07-15 17:21:18 +02:00
Mikhail f. Shiryaev
909e871c48
Rewrite cherry_pick.py to PyGithub API 2022-07-15 17:21:14 +02:00
Vladimir C
ca2e27aaa2
Merge pull request #37841 from vdimir/perf-save-to-stat
Send perf tests results to ci database
2022-07-11 13:07:40 +02:00
Alexey Milovidov
af1136c990
Merge pull request #38744 from ClickHouse/ci-required-simple-checks
Add SimpleCheck
2022-07-08 11:17:38 +03:00
mergify[bot]
7ba147bc7d
Merge branch 'master' into improve-bc-check 2022-07-07 09:38:17 +00:00
Mikhail f. Shiryaev
4410caf31d
Retry docker buildx commands with progressive sleep in between 2022-07-06 13:58:46 +02:00
Yakov Olkhovskiy
d6269c04bb style fix 2022-07-06 00:40:51 -04:00
Yakov Olkhovskiy
69d1495672 style fix 2022-07-06 00:22:50 -04:00
Yakov Olkhovskiy
19365597eb move Simple Check to python 2022-07-05 23:37:01 -04:00
mergify[bot]
ba7d48c2d7
Merge branch 'master' into improve-bc-check 2022-07-05 13:40:35 +00:00
vdimir
f701b58dd0
Update check_name in performance comparsion upload 2022-07-05 14:24:58 +02:00
vdimir
3731bd44c1
Revert "[testing] run only one perftest"
This reverts commit 3b079827b78e04ac20043346998ce9d546969746.
2022-07-05 14:00:26 +02:00
vdimir
45b2b1ca8a
[wip] persist pertest results 2022-07-05 14:00:24 +02:00
vdimir
c2d774d598
[testing] run only one perftest 2022-07-05 14:00:24 +02:00
vdimir
aac2f8aefc
Rename envs for performance comparsion 2022-07-05 14:00:24 +02:00
vdimir
b440ff83d8
fix performance_comparison_check.py 2022-07-05 14:00:24 +02:00
vdimir
0232c9267d
Pass CHPC_DATABASE_URL to perf tests 2022-07-05 14:00:15 +02:00
Mikhail f. Shiryaev
f048db23e2
Release branches run CI on pushes, fix PRInfo 2022-07-05 12:10:33 +02:00
Kruglov Pavel
6e0f27be23
Fix 2022-07-05 11:23:35 +02:00
Mikhail f. Shiryaev
04948e81cc
Get files changed in master since release is branched 2022-07-05 00:29:28 +02:00
Kruglov Pavel
315e6dcdb9
Fix style 2022-07-04 22:06:04 +02:00
Kruglov Pavel
4a557201c8
Fix style 2022-07-04 21:59:46 +02:00
avogar
fb2f60c613 Remove old script 2022-07-04 13:03:55 +00:00
avogar
17da24b584 Try to improve backward compatibility check 2022-07-04 13:02:22 +00:00
Mikhail f. Shiryaev
1018eff5b3
Merge pull request #38273 from ClickHouse/38218-oo-space
Improve runners AMI and init scripts
2022-07-04 12:39:58 +02:00
Mikhail f. Shiryaev
7c812df47e
Merge pull request #38580 from ClickHouse/artifactory-arm64
Push arm64 packages to artifactory and release assets
2022-07-04 12:31:52 +02:00
Mikhail f. Shiryaev
19516c768f
Revert "Upload to S3 compressed self-extracting clickhouse" 2022-07-04 10:15:27 +02:00
Yakov Olkhovskiy
c415543334
Merge pull request #38653 from ClickHouse/deployment-self-extracting
Upload to S3 compressed self-extracting clickhouse
2022-07-04 01:45:09 -04:00
Mikhail f. Shiryaev
27bd355525
Use cached image from the release branch for backport PRs 2022-07-01 16:49:27 +02:00
Mikhail f. Shiryaev
6a67be3195
Get a proper set of changed files for backport PRs 2022-07-01 15:34:46 +02:00
Mikhail f. Shiryaev
b8fa26f94f
Fix wrong self.changed_files type 2022-07-01 15:34:45 +02:00
Mikhail f. Shiryaev
7cc063a1d0
Fix strange backport titles issues 2022-07-01 12:46:25 +02:00
Yakov Olkhovskiy
12290dd644
upload from self-extracting directory 2022-06-30 17:35:42 -04:00
Mikhail f. Shiryaev
738769d1f7
Download arm64 packages and push to artifactory 2022-06-30 16:31:39 +02:00
Mikhail f. Shiryaev
6925bd6a03
Fix hardcoded retries for get_with_retries 2022-06-30 16:31:37 +02:00
Mikhail f. Shiryaev
e76ebdfb47
Change clickhouse-{client,server} packages architecture 2022-06-30 16:31:31 +02:00
Mikhail f. Shiryaev
498a9cc8d4
Terminate instance if docker does not start on post-hook 2022-06-29 12:54:33 +02:00
Mikhail f. Shiryaev
80e7abd0fe
Merge pull request #38548 from excitoon-favorites/ci-integration-tests-test
Don't spoil return code of integration tests runner with redundant tee
2022-06-29 11:18:53 +02:00
Vladimir Chebotarev
f7ef571842 Don't spoil return code of integration tests runner with redundant tee. 2022-06-29 06:11:09 +03:00
Mikhail f. Shiryaev
e1ac7477c9
Avoid killing terminate-instances task 2022-06-28 17:51:47 +02:00
Mikhail f. Shiryaev
94f932add1
A tiny improvement in logging 2022-06-28 10:27:25 +02:00
Mikhail f. Shiryaev
6a67ba91cf
Add public hostname for runner 2022-06-27 14:46:28 +02:00
Mikhail f. Shiryaev
f2611c3707
Refresh team keys for each runner 2022-06-27 14:45:50 +02:00
Mikhail f. Shiryaev
9dffe573bb
Reduce amount of docker logs on the runner 2022-06-27 14:44:59 +02:00
Mikhail f. Shiryaev
7297e468d5
Migrate team-keys lambda to zip archives deployment 2022-06-27 14:00:32 +02:00
Mikhail f. Shiryaev
20614b3678
Improve runners AMI and init scripts
- Install CloudWatch agent and atop
- Update runner version, that supports hooks
- Provide start and complete job hooks
- Will update docker version implicitly to 20.10.17~3
2022-06-23 18:25:15 +02:00
Mikhail f. Shiryaev
e1547058cf
Merge pull request #38086 from ClickHouse/build-artifacts-upload
Build artifacts upload
2022-06-20 11:49:04 +02:00
Mikhail f. Shiryaev
2544b0d53e
Add retries with progressive sleep and dynamic page sice decreasing 2022-06-16 16:29:48 +02:00
Mikhail f. Shiryaev
5f3de6f486
Use the best token instead of the constant 2022-06-16 16:27:49 +02:00
Mikhail f. Shiryaev
d7505d4de7
Change alignment, fix some f-strings 2022-06-16 14:33:39 +02:00
Mikhail f. Shiryaev
7ed305f9b1
Improvement of cherry-pick/backport script
- cherry_pick.py now can ba launched locally, with dry-run
- get rid of fallback import paths
- do not create a huge pile of objects for every sneezing
- the same for hidden imports in deep local functions
- improve logging
- fix imports for cherry_pick_utils entities
- Significantly reduced requests to GraphQL API
2022-06-16 14:32:32 +02:00
Mikhail f. Shiryaev
fe2231dbdb
Upload static binaries from deb builds with lto=thin 2022-06-15 13:18:26 +02:00
Mikhail f. Shiryaev
5d4e96cc30
Change order of uploaded artifacts to rebuild failed binaries 2022-06-15 13:17:45 +02:00
Mikhail f. Shiryaev
c49a96dd19
Merge pull request #38057 from ClickHouse/build-report
Use workflow URL as "link" ref
2022-06-14 22:41:12 +02:00
Mikhail f. Shiryaev
e701adbd28
Use workflow URL as "link" ref 2022-06-14 16:22:41 +02:00
Pavel Novitskiy
f4d757cd6d remove unused args 2022-06-13 17:56:35 +02:00
Mikhail f. Shiryaev
539e423744
Use git.sha to avoid 0000000 2022-06-13 17:41:05 +02:00
Pavel Novitskiy
31c084567a Add release commit hash to image labels 2022-06-13 13:39:28 +02:00
Mikhail f. Shiryaev
9ca03d09cc
Add a way to invalidate docker images cache 2022-06-08 14:47:45 +02:00
Kruglov Pavel
83418ebba2
Merge pull request #37712 from vdimir/duplicate_download_previous_release
Get rid of duplicate download_previous_release
2022-06-07 12:51:34 +02:00
Vladimir C
f7b026f31e
Merge pull request #37825 from vdimir/contrib-trigger-false 2022-06-03 15:31:18 +02:00
vdimir
8228049687
Fix submodule changed label condition 2022-06-03 13:59:34 +02:00
Alexey Milovidov
1529d47207
Merge pull request #34754 from ClickHouse/llvm-14
Switch to clang/llvm 14
2022-06-03 14:07:34 +03:00
Ilya Yatsishin
0650f7538d fix style 2022-06-02 16:17:25 +02:00
Ilya Yatsishin
2ea437de32 fix black 2022-06-02 16:13:52 +02:00
Ilya Yatsishin
a57432659a Merge remote-tracking branch 'origin/master' into aarch64-perf 2022-06-02 14:31:55 +02:00
Ilya Yatsishin
64befe9753 Filter out incompatible performance test 2022-06-02 14:29:24 +02:00
Alexey Milovidov
b5f48a7d3f Merge branch 'master' of github.com:ClickHouse/ClickHouse into llvm-14 2022-06-01 22:09:58 +02:00
Vladimir C
2622791b9e
upd 2022-06-01 16:17:17 +02:00
Vladimir C
773eb15afc
Try mound instead of volume docker arg in stress_check 2022-06-01 14:36:51 +02:00
Vladimir C
42feae8940
fix stress_check.py 2022-06-01 10:44:44 +02:00
vdimir
4d336d0228
Get rid of duplicate download_previous_release 2022-05-31 17:50:29 +00:00
vdimir
c5ac6294ae
Display entires for failed tests at the top of report 2022-05-31 16:18:16 +00:00
alesapin
0e8ab36913 Merge branch 'master' into turn_on_s3_tests 2022-05-29 14:37:10 +02:00
Alexey Milovidov
c1169019d2 Merge branch 'master' into llvm-14 2022-05-29 02:29:02 +02:00
Alexey Milovidov
e48af2efe4
Update report.py 2022-05-28 21:25:42 +03:00
Alexey Milovidov
15f2912dc9
Fix Python. 2022-05-28 05:10:29 +03:00
Alexey Milovidov
f7a5b1fdaf Remove margin in test reports and change the font 2022-05-28 03:24:56 +02:00
Alexey Milovidov
8c94b75516 Merge branch 'master' into llvm-14 2022-05-27 22:24:20 +02:00
mergify[bot]
923ad2e905
Merge branch 'master' into turn_on_s3_tests 2022-05-27 16:31:43 +00:00
alesapin
32167cb6fb Turn on s3 tests 2022-05-27 14:36:12 +02:00
Mikhail f. Shiryaev
e1ed2aa3dc
Add failed builds to the build report 2022-05-25 23:00:33 +02:00
Alexey Milovidov
a5541dc2d5 Merge branch 'master' into llvm-14 2022-05-25 01:56:24 +02:00
Ilya Yatsishin
cda88ebf9c Try to run aarch64 performance tests 2022-05-24 21:47:49 +02:00
Mikhail f. Shiryaev
b4c0f7a621
Simplify labels check 2022-05-24 12:57:06 +02:00
Mikhail f. Shiryaev
90425dedd1
Fail release on status == failure 2022-05-24 11:14:17 +02:00
Mikhail f. Shiryaev
3af9a699d5
Fix ssh-agent socket in docker image 2022-05-24 11:14:16 +02:00
Mikhail f. Shiryaev
249af9c69a
Run container as user, print stdout 2022-05-24 11:14:16 +02:00
Mikhail f. Shiryaev
21d6fc54d5
Do not check docs_release.py for changed files 2022-05-24 11:14:16 +02:00