Commit Graph

1825 Commits

Author SHA1 Message Date
Mikhail f. Shiryaev
4b7aa30017
The best effor to get the current job ID and URL
This partially addresses https://github.com/actions/runner/issues/2577
2023-05-12 19:22:52 +02:00
Mikhail f. Shiryaev
c375f948d0
Fix typing in S3Helper.fast_parallel_upload_dir 2023-05-12 19:22:52 +02:00
Mikhail f. Shiryaev
338435a52d
Additional check for FATAL in logs, do not exit with code 1 on errors 2023-05-12 19:22:51 +02:00
Mikhail f. Shiryaev
0f70ad56a9
Do not upload failed site to the S3 2023-05-12 19:22:50 +02:00
Mikhail f. Shiryaev
eb122487ad
Add logs to the report, do not chown unnecessary 2023-05-12 19:22:48 +02:00
Mikhail f. Shiryaev
6a56662f60
Improve codebrowser check
- Add sccache
- Report a proper status in report and exit code
- Launch it as a current user
- Fix report link
2023-05-12 19:22:48 +02:00
Mikhail f. Shiryaev
fba7120d3d
Fix s3_helper logging and pool setup 2023-05-12 19:22:44 +02:00
Robert Schulze
b9c185af44
Merge pull request #49678 from azat/build/llvm-16
Switch to LLVM/clang 16 (16.0.3)
2023-05-12 13:47:36 +02:00
Mikhail f. Shiryaev
8a664e2cac
Upgrade all lambdas runtime to 3.10, fix requirements
The recent update of urllib3 completely broken the world

- https://github.com/urllib3/urllib3/issues/2168
- https://github.com/boto/botocore/issues/2926
- https://github.com/psf/requests/issues/6443
2023-05-11 16:09:59 +02:00
Mikhail f. Shiryaev
d890114c5e
Print debugging information in workflow_jobs_lambda 2023-05-11 14:21:07 +02:00
Mikhail f. Shiryaev
d605f82798
Replace old release with new packages in suspicious patterns 2023-05-10 12:36:04 +02:00
Mikhail f. Shiryaev
f6372dd3fc
Do not launch PRs w/o "can be tested" 2023-05-10 12:14:44 +02:00
Azat Khuzhin
c37fe64040 Merge remote-tracking branch 'u/master' into build/llvm-16 2023-05-08 22:33:52 +02:00
Nikolai Kochetov
fc02e9efc9 update fasttest a bit 2023-05-08 17:23:46 +00:00
Alexey Milovidov
54163b87ec
Merge pull request #47977 from ClickHouse/rs/non-experimental-qc
Mark query cache as non-experimental
2023-05-06 19:49:23 +03:00
Robert Schulze
0598bfd79e
Mark query cache as non-experimental 2023-05-06 13:58:40 +00:00
Dmitry Novik
a3b3b78eb0 EXPECTED_TO_FAIL -> NOT_FAILED 2023-05-05 17:53:15 +00:00
Dmitry Novik
02520e9358 Make EXPRECTED_TO_FAIL red 2023-05-05 17:37:52 +00:00
Mikhail f. Shiryaev
90fe9dd1f2
Skip mergeable check only on a proper description 2023-05-03 22:38:34 +02:00
Mikhail f. Shiryaev
a67950d138
Check the PRs body directly in lambda, without rerun 2023-05-03 22:38:33 +02:00
Mikhail f. Shiryaev
242a210358
Create "CI running" report always 2023-05-02 14:13:23 +02:00
Mikhail f. Shiryaev
08d203e158
Sanitize "Flaky tests", remove trailing dots 2023-05-02 12:42:26 +02:00
Mikhail f. Shiryaev
b423e04ab0
Fix the global ROBOT_TOKEN, do not retry unnecessary 2023-05-02 12:37:05 +02:00
Mikhail f. Shiryaev
ca19f20aff
Do not fail the run on error updating status comment 2023-05-02 12:34:40 +02:00
Alexey Milovidov
dd7282ea5c
Update ci_config.py 2023-05-01 16:05:14 +03:00
Mikhail f. Shiryaev
b385b51f07
Merge pull request #49314 from ClickHouse/fallback-auth-gh-api
Fallback auth gh api
2023-04-29 09:36:49 +02:00
Mikhail f. Shiryaev
d336bee056
Fix the Logs header for case when only log_urls is set 2023-04-28 23:52:35 +02:00
Mikhail f. Shiryaev
886ba0b01d
Replace markdown with pure HTML for check descriptions 2023-04-28 23:52:34 +02:00
Mikhail f. Shiryaev
20c8f0f1b4
Use only one comment for all statuses in the PR 2023-04-28 23:52:34 +02:00
Mikhail f. Shiryaev
61c6c61638
Rework the status comment to be a digest with the full report available
by link
2023-04-28 23:52:33 +02:00
Mikhail f. Shiryaev
e8cf417350
Use NotSet in post_commit_status for optional arguments 2023-04-28 23:52:33 +02:00
Mikhail f. Shiryaev
c66e50f283
Remove options from S3Helper, they are global 2023-04-28 23:52:32 +02:00
Mikhail f. Shiryaev
f411be8c37
Rename Run Check to CI running 2023-04-28 23:52:31 +02:00
Mikhail f. Shiryaev
df33b99907
Rework post_commit_status, add set_status_comment there 2023-04-28 23:52:31 +02:00
Mikhail f. Shiryaev
d58abd3c37
Add a function get_repo with global state 2023-04-28 23:52:30 +02:00
Mikhail f. Shiryaev
4405459925
Refactor RerunHelper to reduce API calls 2023-04-28 23:52:30 +02:00
Mikhail f. Shiryaev
19fd5f9c3c
Add descriptions for the status comment 2023-04-28 23:52:29 +02:00
Mikhail f. Shiryaev
eb11fb02fa
Clean up ast_fuzzer_check.py 2023-04-28 23:52:29 +02:00
Mikhail f. Shiryaev
ccd4fd7e64
Use commit_status_helper.post_commit_status everywhere 2023-04-28 23:52:28 +02:00
Mikhail f. Shiryaev
144ebd3d36
Implement main() in run_check.py 2023-04-28 23:52:27 +02:00
Mikhail f. Shiryaev
e670c51680
Unify commit.create_status and post_commit_status 2023-04-28 23:52:26 +02:00
Mikhail f. Shiryaev
01e70c64c2
Add a fallback to authenticated requests to GH API 2023-04-28 18:46:33 +02:00
Mikhail f. Shiryaev
8c60b60916
Receive the best robot token only once 2023-04-28 16:01:53 +02:00
Mikhail f. Shiryaev
9a7f09bae4
Avoid splitting check_name into subdirectories 2023-04-26 01:11:05 +02:00
Mikhail f. Shiryaev
a6664e6b08
Add typing, capitalize only the first letter w/o lowering the rest 2023-04-26 00:55:05 +02:00
Mikhail f. Shiryaev
ed8ca018bd
Add a note regarding private/public repo to logs 2023-04-25 19:11:20 +02:00
alesapin
084f76ab3e
Merge pull request #49133 from ClickHouse/unanonymized-workflow-jobs-logs
Improve some lambdas
2023-04-25 12:58:18 +02:00
Mikhail f. Shiryaev
2ab313e6b4
Update the style_checker upscale speed 2023-04-25 12:42:06 +02:00
Mikhail f. Shiryaev
6032bacd0f
Get unanonymized logs in workflow_jobs_lambda 2023-04-25 12:37:26 +02:00
Dmitry Novik
0d3e896f57
Merge pull request #48719 from ClickHouse/analyzer-ci
Add CI run with new analyzer enabled
2023-04-24 17:36:18 +02:00
Mikhail f. Shiryaev
222176639d
Update pr_info.labels in commit_helper lebel helpers 2023-04-24 11:03:25 +02:00
Mikhail f. Shiryaev
caee710fcc
Enforce documentation change for a new-feature PR 2023-04-24 10:41:38 +02:00
Dmitry Novik
1fdee1a2ab
Merge branch 'master' into analyzer-ci 2023-04-21 15:43:16 +02:00
Alexey Milovidov
2dbe4f80f2 Do not allow incomplete changelog entries 2023-04-21 12:59:47 +02:00
Alexey Milovidov
95e69b6f85 Do not allow incomplete changelog entries 2023-04-21 12:59:17 +02:00
Mikhail f. Shiryaev
c28e8438e3
Fail Fast tests on next run if previous running has failed 2023-04-20 14:51:53 +02:00
Dmitry Novik
b2ed99f6b3
Merge branch 'master' into analyzer-ci 2023-04-18 13:07:45 +02:00
Dmitry Novik
5557f4524c Fix string formatting 2023-04-18 08:44:46 +00:00
robot-clickhouse
f6127a68ac Automatic style fix 2023-04-18 00:56:29 +00:00
Dmitry Novik
6197d3d55f Pass volume only for analyzer 2023-04-18 00:12:30 +00:00
Dmitry Novik
61e552d660 Fix used build 2023-04-17 15:23:02 +00:00
Sema Checherinda
0354a964cd turn on all CI back 2023-04-17 14:07:56 +02:00
Sema Checherinda
c3b9d5fe6e introduce sqllogic runner 2023-04-16 13:57:24 +02:00
Dmitry Novik
b04a4ec287 Fix used image 2023-04-14 15:25:06 +02:00
Ilya Yatsishin
d2351df69e
Update tests/ci/functional_test_check.py 2023-04-14 15:13:10 +02:00
Dmitry Novik
3df33d74f5 Get rid of another docker image 2023-04-13 17:22:12 +02:00
Aleksei Filatov
0a1815b9bb
Add new trusted contributors (#48715)
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2023-04-12 19:38:05 +02:00
Dmitry Novik
360fc59694 Handle known broken tests 2023-04-12 16:46:30 +00:00
Dmitry Novik
f8e4d6bb41 Add CI run with new analyzer enabled 2023-04-12 15:18:28 +00:00
Mikhail f. Shiryaev
cdceac6624
Reduce number of return statements 2023-04-11 16:10:52 +02:00
Mikhail f. Shiryaev
c29aa0cd49
Fail the build on a wrong changelog category 2023-04-11 15:34:33 +02:00
Mikhail f. Shiryaev
57a1919594
Partially revert e0252db8d and fix pr-bugfix labeling 2023-04-11 12:40:04 +02:00
Alexander Tokmakov
48b23dd012
Fix race between DROP MatView and RESTART REPLICAS (#47863)
* fix race between drop mv and restart replicas

* unrelated: fix bad exception messages

* fix test

* fix

* fix

* fix

* fix

* fix test

* fix

* fix test

* Update 02437_drop_mv_restart_replicas.sh

* fix tests
2023-04-01 15:26:00 +03:00
Mikhail f. Shiryaev
7ff582b963
Deprecate ENABLE_CCACHE and replace it by COMPILER_CACHE 2023-03-29 23:33:31 +02:00
Mikhail f. Shiryaev
79177e1988
Enable sccache in fasttests 2023-03-29 23:33:29 +02:00
Mikhail f. Shiryaev
fcc14ae724
Enable s3 caching 2023-03-29 23:33:27 +02:00
Alexey Milovidov
e0252db8d4 No prestable 2023-03-27 12:19:32 +02:00
robot-clickhouse
6ac86ed3e0
Merge pull request #47945 from ClickHouse/artifacts-s3-prefix
Artifacts s3 prefix
2023-03-26 00:15:50 +01:00
Mikhail f. Shiryaev
290ee6bbf1
Merge pull request #47790 from CurtizJ/apply-black-to-all-files
Apply black formatter to all python scripts
2023-03-24 14:20:50 +03:00
Mikhail f. Shiryaev
4f2c336cfc
Update black version, run it for the repository 2023-03-24 11:54:38 +01:00
Mikhail f. Shiryaev
c4870ad7bc
Move PRs artifacts to the PRs prefix in S3 2023-03-24 08:54:06 +01:00
Mikhail f. Shiryaev
8ff01429e1
Upload build reports to S3_TEST_REPORTS_BUCKET 2023-03-23 15:49:59 +01:00
Robert Schulze
b3b097286f
Merge branch 'master' into rs/randomized-qc-settings 2023-03-23 13:33:38 +01:00
robot-clickhouse
d690e0f4ec Automatic style fix 2023-03-22 12:55:24 +00:00
Robert Schulze
ea2d7e0035
Decouple QC enablement from 'join_use_nulls' 2023-03-22 12:46:22 +00:00
Robert Schulze
b019ed90be
Randomize query cache settings in stress tests 2023-03-22 11:11:03 +00:00
Mikhail f. Shiryaev
6409ca9fc9
Merge pull request #47857 from ClickHouse/cherry-pick-ping
Comment stale cherry-pick PRs once a day to remind for resolving conflicts
2023-03-22 13:36:35 +03:00
Mikhail f. Shiryaev
d88f71f2b9
Comment stale cherry-pick PRs to resolve conflicts 2023-03-21 18:28:29 +01:00
robot-ch-test-poll2
5e763ccad1
Merge pull request #47822 from ClickHouse/merge-pr-logging
Place short return before big block, improve logging
2023-03-21 13:10:57 +01:00
Mikhail f. Shiryaev
b9dca4e0df
Place short return before big block, improve logging 2023-03-21 11:29:16 +01:00
Mikhail f. Shiryaev
15d02f77cf
Decrease scale_down ratio for faster deflation 2023-03-20 21:03:47 +01:00
Mikhail f. Shiryaev
5eacb6b3be
Fix the keeping the latest review instead of the first 2023-03-20 18:40:39 +01:00
Mikhail f. Shiryaev
f881da249f
Only valid Reviews.STATES overwrite existing reviews 2023-03-20 18:39:58 +01:00
Mikhail f. Shiryaev
e39e0294de
Merge pull request #47760 from ClickHouse/backports-fuse
Add a fuse for backport branches w/o a created PR
2023-03-20 17:48:07 +03:00
Mikhail f. Shiryaev
ae88a31100
Add a fuse for backport branches w/o a created PR 2023-03-20 13:45:23 +01:00
Mikhail f. Shiryaev
a3096a4583
Clarify steps for reopened cherry-pick PRs 2023-03-20 12:36:35 +01:00
Alexey Milovidov
89a76c2d77 Use LLVM 16 2023-03-18 23:45:57 +01:00
Alexander Tokmakov
6724bfdf38
Disable grace hash join in upgrade check (#47474)
* Update stress.py

* Update stress.py

* Update stress.py
2023-03-11 19:06:07 +03:00
Alexander Tokmakov
bb8f0cb3ab
Update stress.py 2023-03-10 18:09:32 +03:00
Alexander Tokmakov
d95b69ca76
Update stress.py 2023-03-10 17:22:09 +03:00
Alexander Tokmakov
3c5cb817d7
Update stress.py 2023-03-10 17:04:38 +03:00
robot-clickhouse
ce3ab32d89 Automatic style fix 2023-03-10 13:53:47 +00:00
Alexander Tokmakov
e3d71f4f1b suppress hung check with ubsan 2023-03-10 14:36:05 +01:00
Pradeep Chhetri
433c226b1f
Revert "Revert "Add join_algorithm='grace_hash' to stress tests"" (#47372) 2023-03-09 13:51:45 +01:00
Mikhail f. Shiryaev
0eebe1ce57
Merge pull request #47107 from ClickHouse/autoscaling-lambda
Add code for autoscaling lambda
2023-03-08 13:51:42 +01:00
Robert Schulze
924caee673
Merge pull request #47063 from ClickHouse/rs/binary-compat-check-for-arm
CI: Add binary compatibility check on ARM
2023-03-07 11:20:14 +01:00
Mikhail f. Shiryaev
c13638904a
Adjust the aggregation interval 2023-03-06 14:38:54 +01:00
Mikhail f. Shiryaev
602933ce1e
Make smarter scaler based on reserve/deficit 2023-03-03 13:22:05 +01:00
Mikhail f. Shiryaev
a576464360
Reduce statisctics interval, process empty response for runners 2023-03-03 13:20:42 +01:00
Mikhail f. Shiryaev
6a746beff8
Tune style-checker scaling up and down by modifiers 2023-03-03 13:20:41 +01:00
Mikhail f. Shiryaev
a5869e25f6
Add tests for autoscale_runners_lambda 2023-03-03 13:20:39 +01:00
Mikhail f. Shiryaev
0483de0e04
Reorder status in default.workflow_jobs 2023-03-03 13:20:39 +01:00
Mikhail f. Shiryaev
e2278ca70c
Add code for autoscaling lambda 2023-03-03 13:20:36 +01:00
Robert Schulze
380e076e84
x86 --> amd64 2023-03-03 11:20:07 +00:00
robot-clickhouse
6eb2877e53 Automatic style fix 2023-03-02 20:54:45 +00:00
Mikhail f. Shiryaev
845e67af3e
Merge pull request #47064 from ClickHouse/termination-lambda
Terminate long-running offline non-busy runners in EC2
2023-03-02 21:50:49 +01:00
Robert Schulze
93861e04ae
Fix fix fix 2023-03-02 20:48:25 +00:00
Robert Schulze
a0a40fb057
nam --> name 2023-03-02 17:51:43 +00:00
Nikolai Kochetov
47cd46f590
Update tests/ci/worker/ubuntu_ami_for_ci.sh
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2023-03-02 18:19:19 +01:00
Nikolai Kochetov
e435748473
Update ubuntu_ami_for_ci.sh 2023-03-02 18:13:30 +01:00
Robert Schulze
8491325b8d
Merge branch 'master' into rs/binary-compat-check-for-arm 2023-03-02 15:08:55 +01:00
robot-clickhouse
33cafc6e89 Automatic style fix 2023-03-02 11:22:32 +00:00
Robert Schulze
5ddc9a9eed
Add binary compatibility check for Aarch64 2023-03-02 11:08:08 +00:00
Mikhail f. Shiryaev
ad50c418da
Update typing for a new PyGithub version 2023-03-02 11:49:36 +01:00
Mikhail f. Shiryaev
036eaad919
Reduce lambda time by caching access_token 2023-03-02 01:40:30 +01:00
Mikhail f. Shiryaev
0a3a60b7a1
Additionally search for inactive runners in the whole ASG 2023-03-02 01:40:28 +01:00
Mikhail f. Shiryaev
9f6b154ccf
Insignificant improvement 2023-03-01 20:51:23 +01:00
Alexander Tokmakov
bb5b17fd09 make stacktraces in hung check more readable 2023-03-01 17:34:43 +01:00
Mikhail f. Shiryaev
43dbd7bc25
Terminate long-running offline non-busy runners in EC2 2023-03-01 12:37:34 +01:00
Kruglov Pavel
a87ebae3c1
Merge pull request #44879 from ClickHouse/split-bc-check
Split stress test and backward compatibility check
2023-02-28 14:47:52 +01:00
alesapin
c5e46b09be
Merge pull request #46977 from ClickHouse/cherry-pick-body
Change the cherry-pick PR body
2023-02-28 12:29:18 +01:00
Konstantin Bogdanov
3444059649
Add thevar1able to trusted contributors (#46998)
* Add thevar1able to trusted contributors

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2023-02-28 00:42:52 +01:00
avogar
cc02de69d2 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-27 19:49:33 +00:00
Mikhail f. Shiryaev
135961acb7
Change the cherry-pick PR body 2023-02-27 17:59:19 +01:00
avogar
014a9c7961 Fix lib file 2023-02-27 13:25:28 +00:00
Mikhail f. Shiryaev
5b6e581c1a
Preset description on the tweak reset 2023-02-27 14:20:34 +01:00
avogar
3411c33fdf Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-27 13:12:35 +00:00
Mikhail f. Shiryaev
cb460c6903
Fix missing format_description 2023-02-27 13:11:17 +01:00
Alexey Milovidov
3f55782d5f
Merge pull request #46781 from ClickHouse/lazy-mergeable
Reduce updates of Mergeable Check
2023-02-27 09:14:33 +03:00
Alexey Milovidov
093eba5dfc
Merge pull request #46736 from ClickHouse/pending-on-rerun
Mark failed build reports as pending on reruns
2023-02-25 00:39:44 +03:00
Kruglov Pavel
c2a4ec11bf
Merge branch 'master' into split-bc-check 2023-02-24 19:45:39 +01:00
avogar
e52a995e46 Fix style 2023-02-24 16:58:36 +00:00
avogar
8c6cf28c01 Make better 2023-02-24 16:43:28 +00:00
avogar
6b7d3bf07b Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-24 13:52:22 +00:00
Mikhail f. Shiryaev
6fa16b7828
Add check that major is not issued in the middle of a year 2023-02-24 12:36:47 +01:00
Mikhail f. Shiryaev
ad7ec74009
Make autogenerated version independent from tweak by default 2023-02-24 12:36:46 +01:00
Mikhail f. Shiryaev
900fe7ec9a
Reduce returns for update_mergeable_check 2023-02-23 16:06:29 +01:00
Mikhail f. Shiryaev
19bea6a9e8
Add more cases when we don't need Mergeable Check 2023-02-23 15:57:10 +01:00
Mikhail f. Shiryaev
067e656ff3
Reuse code, do not update Mergeable Check unnecessary 2023-02-23 15:25:29 +01:00
Mikhail f. Shiryaev
0ab9d6787e
Add format_description for commit status descriptions 2023-02-23 15:21:19 +01:00
Mikhail f. Shiryaev
f2b1654a44
Add overwriting failed reports as pending on rerun 2023-02-23 10:38:22 +01:00
Mikhail f. Shiryaev
e290ceec52
Reorder imports 2023-02-23 10:38:21 +01:00
Mikhail f. Shiryaev
33a2e2b3d8
Set default per_page=100 for GitHub 2023-02-23 10:38:09 +01:00
Mikhail f. Shiryaev
904e6ae769
On out-of-space at returns error, we must terminate still 2023-02-23 00:45:51 +01:00
Alexey Milovidov
4adbcd4beb
Merge pull request #46665 from ClickHouse/clean-docs-release
Get rid of legacy DocsReleaseChecks
2023-02-22 00:31:17 +03:00
Mikhail f. Shiryaev
cd2ab02f22
Get rid of legacy DocsReleaseChecks 2023-02-21 17:34:16 +01:00
Mikhail f. Shiryaev
9c7fc29778
Add dedicated key for checking launching release.py from master 2023-02-20 11:16:08 +01:00
Mikhail f. Shiryaev
d39cffb3f2
Add rollback commands for the case of broad error 2023-02-20 11:16:07 +01:00
flynn
7bc153221e fix style 2023-02-17 14:36:11 +00:00
Anton Popov
5bcea2e8f5
Add myrrc to trusted contributors 2023-02-17 13:19:45 +01:00
Mikhail f. Shiryaev
b349cda25c
Fix the downloading of the recent ccache archives 2023-02-16 18:26:06 +01:00
Mikhail f. Shiryaev
cb5e5b27f2
Merge pull request #46450 from ClickHouse/dont-fetch-submodules
Do not fetch submodules in release.py
2023-02-16 14:00:38 +01:00
Mikhail f. Shiryaev
346c3e3c49
Preserve logs for failed installation tests, retry 3 times 2023-02-15 22:51:43 +01:00
Mikhail f. Shiryaev
9dba4e7cc9
Replace format with f-strings 2023-02-15 22:51:42 +01:00
Mikhail f. Shiryaev
f39d9b09b0
Preserve clickhouse binary to not redownload it 2023-02-15 22:51:41 +01:00
Mikhail f. Shiryaev
3bcd049d18
Improve download filter, group keeper mntr command 2023-02-15 22:51:41 +01:00
Mikhail f. Shiryaev
0c5648a5a6
Use OK and FAIL for tests status 2023-02-15 22:51:39 +01:00
Mikhail f. Shiryaev
fecadfab3e
Do not fetch submodules in release.py 2023-02-15 16:05:07 +01:00
Vladimir C
726fb4bebc
Merge pull request #46368 from ClickHouse/vdimir/bugfix-validate-fix 2023-02-14 14:54:07 +01:00
vdimir
19b5d21e8b
Minor fix in files locating for Bugfix validate check 2023-02-14 12:31:10 +01:00
robot-ch-test-poll3
f654174362
Merge pull request #46246 from ClickHouse/optimize-binary-builder
Optimize docker binary-builder
2023-02-14 10:06:15 +01:00
Mikhail f. Shiryaev
92f2e904ee
Merge pull request #45980 from ClickHouse/avoid-backport-contrib
Improve local running of cherry_pick.py
2023-02-13 14:16:58 +01:00
Mikhail f. Shiryaev
839dfa8c60
Merge pull request #45823 from ClickHouse/do-not-cancel-created-prs
Do not cancel created prs
2023-02-12 16:00:28 +01:00
Mikhail f. Shiryaev
d0f5b6efb5
Use both release_pr and merged_pr as additional cache 2023-02-09 21:31:12 +01:00
Mikhail f. Shiryaev
7c6bb55eca
Use TeePopen to get logs in the main log 2023-02-09 20:36:39 +01:00
Kruglov Pavel
93dfbe6617
Fix mypy style 2023-02-09 15:05:06 +01:00
Kruglov Pavel
5c62afd15e
Fix style 2023-02-09 15:01:32 +01:00
robot-clickhouse
82521bb973 Automatic style fix 2023-02-09 13:33:49 +00:00
avogar
53a3cfc9e0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-09 13:24:19 +00:00
Mikhail f. Shiryaev
3a08d865cc
Add helping logging to auto-merge script 2023-02-06 15:45:22 +01:00
Mikhail f. Shiryaev
030bd314c0
Use new label from the event instead of all PR labels 2023-02-04 01:18:13 +01:00
Mikhail f. Shiryaev
6e58339b4f
Improve readability by "elif"=>"if" 2023-02-04 01:18:11 +01:00
Mikhail f. Shiryaev
cbbef49e9a
Add early exit on freshly opened PR to not process labels 2023-02-04 01:18:09 +01:00
Mikhail f. Shiryaev
4361c666e6
Always update local release branches 2023-02-04 01:07:20 +01:00
Mikhail f. Shiryaev
0e10593037
Do not count changed submodules as needed to stash 2023-02-03 23:17:06 +01:00
Mikhail f. Shiryaev
cd2e1cfada
Merge pull request #45568 from ClickHouse/keeper-systemd
Add systemd.service for clickhouse-keeper
2023-02-03 23:08:02 +01:00
Alexander Tokmakov
352ccfb156
Merge branch 'master' into stress_report_add_context2 2023-02-03 18:44:53 +03:00
Nikita Mikhaylov
33877b5e00
Parallel replicas. Part [2] (#43772) 2023-02-03 14:34:18 +01:00
Mikhail f. Shiryaev
dd64c8bacc
Add tests for installation from binary 2023-02-03 12:16:22 +01:00
Mikhail f. Shiryaev
e41a78b67a
Improve local tests 2023-02-03 12:16:21 +01:00
Mikhail f. Shiryaev
a18a4a4502
Use Path in download helper, do not redownload exist files 2023-02-03 12:16:17 +01:00
Mikhail f. Shiryaev
fc48867bed
Get rid of odd entity 2023-02-03 12:16:17 +01:00
Mikhail f. Shiryaev
dc00bce9cf
Add tests for packages' installation 2023-02-03 12:16:16 +01:00
Mikhail f. Shiryaev
a4c2ac7e97
Commit only staged files to backport branches
Formerly all changed files were committed, and it caused changed
submodules to be committed as well
2023-02-02 18:18:37 +01:00
Mikhail f. Shiryaev
46ff77654c
Update cherrypick_pr to get mergeable state 2023-02-02 16:13:50 +01:00
robot-clickhouse
892a3ff316 Automatic style fix 2023-02-02 12:40:50 +00:00
Alexander Tokmakov
5e64cda339
Update tests/ci/report.py
Co-authored-by: Alexander Gololobov <440544+davenger@users.noreply.github.com>
2023-02-02 15:28:01 +03:00
robot-clickhouse
ddbc8ceee8 Automatic style fix 2023-02-02 00:59:49 +00:00
Alexander Tokmakov
03109f942d better context for stress tests failures 2023-02-02 01:02:12 +01:00
Alexander Tokmakov
472aa12ba3 add some context to stress test failures 2023-02-01 01:25:31 +01:00
Mikhail f. Shiryaev
ac13dc636f
Add dry-run, fix arguments 2023-01-30 23:23:30 +01:00
Mikhail f. Shiryaev
74a36a34ab
Revert "Revert "Add check for running workflows to merge_pr.py"" 2023-01-30 23:17:34 +01:00
Mikhail f. Shiryaev
1d9b917362
Revert "Add check for running workflows to merge_pr.py" 2023-01-30 23:14:29 +01:00
Mikhail f. Shiryaev
652ec7e774
Add check for running workflows to merge_pr.py 2023-01-30 22:47:32 +01:00
Alexey Milovidov
4ae2824e58
Merge pull request #44226 from azat/ci/more-robust
More robust CI parsers
2023-01-29 19:44:16 +03:00
alesapin
8d05b1ec4a
Merge pull request #45657 from ClickHouse/improve-release-script
Improve release script
2023-01-29 11:46:02 +01:00
Azat Khuzhin
b1b4aaeef6 ci: more robust results parsers
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-29 09:06:03 +01:00
Mikhail f. Shiryaev
4635a62cec
Merge pull request #45476 from ClickHouse/automerge
Another attempt to fix automerge, or at least to have debug footprint
2023-01-27 10:06:24 +01:00
Mikhail f. Shiryaev
975b3a2de8
Suppress the stderr of running commands by default 2023-01-26 15:24:38 +01:00
Mikhail f. Shiryaev
cc691c30af
Delete --no-release-branch argument, move creating release to the end 2023-01-26 15:24:37 +01:00
Mikhail f. Shiryaev
398b215556
Make Release._create_tag independent on checked out ref 2023-01-26 15:24:37 +01:00
Mikhail f. Shiryaev
81d419e4a2
Add --dry-run option for release.py 2023-01-26 15:24:36 +01:00
Mikhail f. Shiryaev
1ec9b60c27
Add fail on new minor versions>=13 2023-01-26 15:24:36 +01:00
Mikhail f. Shiryaev
bf3b497d22
Always update version and _git after new checkout 2023-01-26 15:24:35 +01:00
avogar
ced2f69a01 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-01-25 19:47:27 +00:00
Mikhail f. Shiryaev
4615f979d6
Update tests/ci/fast_test_check.py 2023-01-25 00:13:28 +01:00
Dmitry Novik
8545db9f62 Fix report sending in case of FastTest failure 2023-01-24 21:54:23 +00:00
Mikhail f. Shiryaev
23118d9418
Do not prefilter reviews in __init__ 2023-01-24 15:50:55 +01:00
Mikhail f. Shiryaev
b8474fd17f
Merge pull request #45466 from ClickHouse/cherrypick-search
CherryPick: Fix a wrong staring search date
2023-01-24 13:20:16 +01:00
Mikhail f. Shiryaev
d32a564ff0
Merge pull request #45421 from ClickHouse/chrm-releases
Get rid of artifactory in favor of r2 + ch-repos-manager
2023-01-24 13:17:48 +01:00
Mikhail f. Shiryaev
f092b46025
Improve logging for TeePopen.timeout exceeded 2023-01-23 12:50:49 +01:00
avogar
fd9b735505 Merge with master, add some fixes 2023-01-20 20:22:03 +00:00
avogar
d34c8f8432 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-01-20 19:28:15 +00:00
Mikhail f. Shiryaev
0c253326df
Add unconditional logging for approved_at 2023-01-20 17:30:32 +01:00
Mikhail f. Shiryaev
697c0b1f5b
Add a debug output for cases when approved_at==0 2023-01-20 17:30:32 +01:00
Mikhail f. Shiryaev
914af887f2
Move calculating of approved_at to Reviews.is_approved 2023-01-20 17:30:31 +01:00
Mikhail f. Shiryaev
d4f60bc9da
Fix the case when merge-base does not show the oldest commit 2023-01-20 13:55:21 +01:00
Mikhail f. Shiryaev
9d2677c2e5
Get rid of artifactory in favor of r2 + ch-repos-manager 2023-01-19 09:41:58 +01:00
kssenii
a657bbece7 Merge remote-tracking branch 'upstream/master' into slightly-better-output-for-glibc-check 2023-01-17 12:23:44 +01:00
kssenii
f3c1dc0c85 Slightly better output of glibc check 2023-01-17 12:17:57 +01:00
Mikhail f. Shiryaev
4a07d3682f
Fix wrong approved_at, simplify conditions 2023-01-16 11:36:39 +01:00
Azat Khuzhin
af1308083a tests/ci: encode HTML entities in the reports
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-15 17:03:32 +01:00
Alexey Milovidov
6698f3ccf0
Merge pull request #45008 from ClickHouse/add-dmesg-log-to-fuzzer
Add `dmesg.log` to Fuzzer
2023-01-14 14:43:30 +03:00
Alexey Milovidov
e6b3f54842
Merge pull request #41110 from ClickHouse/automerge
Automatically merge green backport PRs and green approved PRs
2023-01-13 23:16:35 +03:00
Mikhail f. Shiryaev
9dc9bb2ae6
Mention only approvals from the team members 2023-01-13 12:23:07 +01:00
Alexey Milovidov
ab8c676ea5
Merge pull request #45013 from ClickHouse/download-script-failed
Supposedly fix the "Download script failed" error
2023-01-13 05:23:09 +03:00
Alexey Milovidov
dff5e3eafd
Merge branch 'master' into add-dmesg-log-to-fuzzer 2023-01-13 05:22:18 +03:00
Ilya Yatsishin
0be3dbad3c
Merge pull request #44883 from ClickHouse/ci-report-type
Rework CI reports to have a class and clarify the logic
2023-01-12 18:20:40 +01:00
Mikhail f. Shiryaev
811f9b1e3a
Reduce the number of API requests by monkey-patching 2023-01-12 12:32:48 +01:00
Alexey Milovidov
d4c0746647
Merge branch 'master' into add-dmesg-log-to-fuzzer 2023-01-12 07:17:03 +03:00
Mikhail f. Shiryaev
e1dc38f0fe
Fix wrong report sorting and changing global BASE_HEADERS 2023-01-11 23:39:00 +01:00
Mikhail f. Shiryaev
2b9c76875b
Consider WIP in a title as blocker for automerge 2023-01-11 20:52:40 +01:00
Mikhail f. Shiryaev
f2cba45f9c
Add a script to merge a PR 2023-01-11 20:52:38 +01:00
Mikhail f. Shiryaev
1f8535ca83
Restart NightlyBuilds if the runner died 2023-01-11 18:49:01 +01:00
Mikhail f. Shiryaev
22c30ca38c
Add typing to get_previous_release_tag.py 2023-01-11 13:31:30 +01:00
Mikhail f. Shiryaev
1dc9fe6f5a
Fix the timeout, remove wrong parameters 2023-01-11 10:45:51 +01:00
Mikhail f. Shiryaev
1420c4b852
Use logging instead of printing 2023-01-11 10:44:59 +01:00
Yatsishin Ilya
a704cf804a fix 2023-01-10 22:17:28 +00:00
Yatsishin Ilya
7cb3e17419 black 2023-01-10 16:17:59 +00:00
Yatsishin Ilya
d945b72d6f Pull SQLancer image before check run 2023-01-10 15:40:31 +00:00
alesapin
dafd1de8c5
Merge pull request #45074 from ClickHouse/improve-release-scripts
Improve release scripts
2023-01-10 12:20:21 +01:00
Mikhail f. Shiryaev
98ee463fc1
Change the color of links in dark reports a little bit 2023-01-10 01:03:05 +01:00
Mikhail f. Shiryaev
acdc53a9a7
Allow to use mark_release_ready.py to manually mark commits as ready 2023-01-09 21:58:55 +01:00
Mikhail f. Shiryaev
f2004aee72
Do not attempt to get JOB_ID on wrong RUN_ID 2023-01-09 21:46:33 +01:00
Mikhail f. Shiryaev
5b45360c89
Prefetch tags at the release time 2023-01-09 21:18:35 +01:00
Mikhail f. Shiryaev
1e4fe038f5
Add logs to docker_server reports 2023-01-09 13:21:31 +01:00
Mikhail f. Shiryaev
c38bb5ec00
Add Path as an option for TeePopen log_file 2023-01-09 12:10:30 +01:00
Mikhail f. Shiryaev
425f7459d3
Improve report for docker_server.py 2023-01-09 12:10:30 +01:00
Mikhail f. Shiryaev
fc4d6e41cf
Fix possible issue in process_logs by strict typing 2023-01-09 12:10:29 +01:00
Mikhail f. Shiryaev
36e402b10d
Add typing to create_build_html_report 2023-01-09 12:10:28 +01:00
Mikhail f. Shiryaev
db96f9e3db
Rework test_results list/tuple/whatever into class 2023-01-09 12:09:47 +01:00
Mikhail f. Shiryaev
10aa2207b3
Add typing to stopwatch.py 2023-01-09 12:07:27 +01:00
Alexey Milovidov
93bfe94c86 Merge branch 'break-ci' of github.com:ClickHouse/ClickHouse into break-ci 2023-01-09 04:34:42 +01:00
Alexey Milovidov
e8d661b511 Merge branch 'master' into break-ci 2023-01-09 04:34:10 +01:00
robot-clickhouse
9a5fbcacfd Automatic style fix 2023-01-09 01:08:38 +00:00
Alexey Milovidov
03ae644ea3 Fix performance test 2023-01-09 01:58:42 +01:00
robot-clickhouse
3c9720fac7 Automatic style fix 2023-01-08 07:59:31 +01:00
Alexey Milovidov
4694dad87c Break CI 2023-01-08 07:59:31 +01:00
Alexey Milovidov
851e4ae59f Fix typos 2023-01-08 07:08:20 +01:00
Alexey Milovidov
0772a28dbd
Merge pull request #44961 from ClickHouse/hipster-html
Hipster's HTML
2023-01-08 04:44:37 +03:00
Alexey Milovidov
bf57564ec5 Merge branch 'master' into add-dmesg-log-to-fuzzer 2023-01-08 02:26:09 +01:00
Alexey Milovidov
22741ce7ca Fix Python 2023-01-07 23:23:20 +01:00
Alexey Milovidov
484af24d48 Remove the remainings of Testflows (2). 2023-01-07 21:40:13 +01:00
Alexey Milovidov
e62127c3d5 Opt-out 2023-01-07 03:40:18 +01:00
Alexey Milovidov
8ca1740c37
Update get_previous_release_tag.py 2023-01-07 04:48:42 +03:00
Alexey Milovidov
bb71ec7f0e Supposedly fix the "Download script failed" error 2023-01-07 02:47:32 +01:00
Alexey Milovidov
3211f63911 Add dmesg.log to Fuzzer 2023-01-07 01:18:35 +01:00
Alexey Milovidov
a708d24e9a
Update report.py 2023-01-06 06:56:27 +03:00
Alexey Milovidov
5ac019a6d3
Avoid flickering on scroll 2023-01-06 06:53:55 +03:00
Alexey Milovidov
d784c6d201
Update report.py 2023-01-06 06:28:51 +03:00
Alexey Milovidov
c6071f247a Hipster's HTML 2023-01-06 04:19:10 +01:00
Mikhail f. Shiryaev
fb1e7fcd7c
Merge pull request #44520 from ClickHouse/lambda-workflow-jobs
Add the lambda to collect data for workflow_jobs
2023-01-05 18:02:23 +01:00
Yatsishin Ilya
1b03a60e43 Do not report status if we failed to pull images. 2023-01-05 13:53:45 +00:00
Kruglov Pavel
c69fe38f62
Merge branch 'master' into split-bc-check 2023-01-04 15:17:02 +01:00
Kruglov Pavel
ac66dcfbe4
Merge pull request #44867 from ClickHouse/fail-performance-on-report-error
Fix non-detected Errors in performance tests message
2023-01-04 14:27:37 +01:00
Ilya Yatsishin
5794ebaa4e
Merge pull request #44871 from ClickHouse/upload-bugfix-statuses
Upload status files to S3 report for bugfix check
2023-01-04 12:52:42 +01:00
Robert Schulze
58694ff091
Fix "AttributeError: 'BuildResult' object has no attribute 'libraries'" in BuilderSpecialReport 2023-01-04 09:37:56 +00:00
avogar
467d06e89d Merge branch 'split-bc-check' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-01-03 20:13:44 +00:00
avogar
9fb8b42d37 Fix style 2023-01-03 20:13:12 +00:00
robot-clickhouse
c7366f7906 Automatic style fix 2023-01-03 19:32:11 +00:00
avogar
64df6ca520 Split stress test and backward compatibility check 2023-01-03 19:22:31 +00:00
Robert Schulze
0330276a02
The "libraries" field is no longer needed 2023-01-03 19:07:29 +00:00
Robert Schulze
cfb6feffde
What happens if I remove these 139 lines of code? 2023-01-03 18:35:31 +00:00
Mikhail f. Shiryaev
41cdf42276
Upload status files to S3 report for bugfix check 2023-01-03 16:31:14 +01:00
Mikhail f. Shiryaev
795a677aaa
Fix non-detected Errors in performance tests message 2023-01-03 15:26:02 +01:00
Alexey Milovidov
ca117d5b94
Merge branch 'master' into remove-two-lines-of-code 2023-01-02 22:15:36 +03:00
Mikhail f. Shiryaev
ec79257bb6
Add a tiny but important logging
The first commit in 2023
2023-01-02 13:27:17 +01:00
Alexey Milovidov
47ae8c5c79 Remove more lines 2023-01-02 02:06:11 +01:00
robot-clickhouse
dcfe1487ce Automatic style fix 2022-12-31 13:51:42 +00:00
Alexey Milovidov
78ed8a6d69 GitHub is unreliable; copy-paste code from Stackoverflow to solve it 2022-12-31 14:45:44 +01:00