Mikhail f. Shiryaev
8d53d558bd
Restore typing for S3Helper
2022-12-02 22:49:26 +01:00
Mikhail f. Shiryaev
8d9dbda7f2
Experiment with old upload_result_helper.py
2022-12-02 21:34:21 +01:00
Mikhail f. Shiryaev
dcdacea8e8
Revert "Add typing to upload_result_helper.py, remove stale code"
...
This reverts commit 1fb090bfe2
2022-12-02 21:33:08 +01:00
Mikhail f. Shiryaev
e2a9b226e0
Merge pull request #43894 from ClickHouse/improve-release-script
...
Improve release script
2022-12-02 20:33:34 +01:00
Mikhail f. Shiryaev
8e8068afe4
Use only PRs to our repository in pr_info on push
2022-12-02 19:17:16 +01:00
Mikhail f. Shiryaev
7356d48f67
Get rid of PyGithub dependency
2022-12-02 18:58:46 +01:00
Mikhail f. Shiryaev
ed4db129f4
Reduce dependencies from unidiff
2022-12-02 18:27:36 +01:00
Mikhail f. Shiryaev
8897aa7fe8
Merge pull request #43132 from ClickHouse/strict-typing-ci
...
Enable strict typing check in tests/ci
2022-12-01 14:37:25 +01:00
Mikhail f. Shiryaev
a6a45f98b2
Rerun DocsCheck on edited PR description
2022-12-01 13:26:29 +01:00
Mikhail f. Shiryaev
5d7cb6b85a
Change email for robot-clickhouse to immutable one
2022-12-01 13:01:35 +01:00
Mikhail f. Shiryaev
fe8107e95f
Fix type ignorance in version_helper.py
2022-11-29 17:18:29 +01:00
Mikhail f. Shiryaev
0f2704703f
Fix typing and bug in cancel_and_rerun_workflow_lambda
2022-11-29 16:50:22 +01:00
Mikhail f. Shiryaev
23002bc808
Add typing to terminate_runner_lambda
2022-11-29 16:50:21 +01:00
Mikhail f. Shiryaev
3feb8e3657
Add type hinting to ci_runners_metrics_lambda
2022-11-29 16:50:20 +01:00
Mikhail f. Shiryaev
eacf7e01a1
Fix typing in team_keys_lambda
2022-11-29 14:12:29 +01:00
Mikhail f. Shiryaev
3bf3dacb4d
Add __init__.py to lambdas for mypy
2022-11-29 14:12:28 +01:00
Mikhail f. Shiryaev
f4a7ff409e
Fix push_to_artifactory.py
2022-11-29 14:12:28 +01:00
Mikhail f. Shiryaev
db44e40989
Fix sqlancer_check.py typing
2022-11-29 14:12:27 +01:00
Mikhail f. Shiryaev
e1a9f2976a
Fix stress_check.py typing
2022-11-29 14:12:27 +01:00
Mikhail f. Shiryaev
5af2bc6660
Fix unit_tests_check.py typing
2022-11-29 14:12:26 +01:00
Mikhail f. Shiryaev
d0d23af63e
Fix integration_test_check.py typing
2022-11-29 14:12:26 +01:00
Mikhail f. Shiryaev
1e5fec1157
Fix functional_test_check.py typing
2022-11-29 14:12:25 +01:00
Mikhail f. Shiryaev
33424bc411
Add typing to fast tests
2022-11-29 14:12:25 +01:00
Mikhail f. Shiryaev
eb738fa13e
Use PRInfo and TEMP_PATH in codebrowser
2022-11-29 14:12:24 +01:00
Mikhail f. Shiryaev
40b8c8559f
Simplify finish_check.py
2022-11-29 14:12:24 +01:00
Mikhail f. Shiryaev
d4859275f4
Fix typing in version_test.py
2022-11-29 14:12:23 +01:00
Mikhail f. Shiryaev
459dde989b
A tiny fix for missing types
2022-11-29 14:12:23 +01:00
Mikhail f. Shiryaev
ba9e51d686
Fix cherry-pick.py typing issues
2022-11-29 14:12:22 +01:00
Mikhail f. Shiryaev
ec0684dfce
Fix typing issues in build_check.py
2022-11-29 14:12:22 +01:00
Mikhail f. Shiryaev
4fc5bb7a63
Fix release.py typing issue
2022-11-29 14:12:21 +01:00
Mikhail f. Shiryaev
da71dbe040
Fix issues in build_report_check.py
2022-11-29 14:12:21 +01:00
Mikhail f. Shiryaev
6e00bb2e74
Add and fix typing for docker_pull_helper, github_helper and style_check
2022-11-29 14:12:20 +01:00
Mikhail f. Shiryaev
02b8da2a0f
Add typing for TeePopen
2022-11-29 14:12:20 +01:00
Mikhail f. Shiryaev
8838102657
Fix issue in docker_manifests_merge.py
2022-11-29 14:12:19 +01:00
Mikhail f. Shiryaev
1fb090bfe2
Add typing to upload_result_helper.py, remove stale code
2022-11-29 14:12:19 +01:00
Mikhail f. Shiryaev
324c8e4b12
Use f-strings in report.py
2022-11-29 14:12:18 +01:00
Mikhail f. Shiryaev
080ff97627
Fix mypy errors in report.py
2022-11-29 14:12:17 +01:00
Mikhail f. Shiryaev
9dff6a80ab
Fix run_check.py and dependencies
2022-11-29 14:12:16 +01:00
Mikhail f. Shiryaev
78e560f78e
Fix docker_image_check and docker_test
2022-11-29 12:51:47 +01:00
Mikhail f. Shiryaev
9d173ca369
Fix version_helper.py
2022-11-29 12:51:46 +01:00
Mikhail f. Shiryaev
c058f07fab
Add mypy config, fix git_helper.py
2022-11-29 12:51:45 +01:00
alesapin
fdf1e54d1e
Merge pull request #43777 from ClickHouse/rerun-actions-on-edited
...
Rerun PullRequestCI on changed description body
2022-11-29 12:33:38 +01:00
Mikhail f. Shiryaev
fbb39cb659
Cancel workflows only on new "do not test" labels in favor of CheckLabels
2022-11-28 21:23:18 +01:00
Mikhail f. Shiryaev
ec344c91b4
Rerun PullRequestCI on changed description body
2022-11-28 20:59:20 +01:00
Mikhail f. Shiryaev
1c02cc5896
Migrate terminate-runner-lambda to zip-packages
2022-11-28 18:12:42 +01:00
Mikhail f. Shiryaev
af4d0b10bd
Delete unused code
2022-11-28 18:11:40 +01:00
Mikhail f. Shiryaev
218897e032
Rename runners_termination_lambda
2022-11-28 18:11:23 +01:00
Mikhail f. Shiryaev
9a729e3370
Migrate runner_token_rotation_lambda to zip package deployment
2022-11-28 17:40:38 +01:00
Mikhail f. Shiryaev
cf8c904b61
Fix typing errors
2022-11-28 17:31:22 +01:00
Mikhail f. Shiryaev
7cddfbe9f9
Rename token lambda to reflect the meaning
2022-11-28 17:30:53 +01:00
Mikhail f. Shiryaev
fda2c4e78a
Merge pull request #43756 from ClickHouse/terminate-lost-runners
...
Terminate lost runners
2022-11-28 16:07:28 +01:00
Mikhail f. Shiryaev
272042108d
Terminate instances that lost connection to github
2022-11-28 16:05:55 +01:00
Alexander Tokmakov
a82fec83d8
Merge pull request #43623 from ClickHouse/move_perf_tests_aarch_to_master
...
Move perf tests for Aarch64 from PRs to master
2022-11-28 17:56:35 +03:00
Mikhail f. Shiryaev
28f9f588bc
A small improvement in naming and rounding pages number
2022-11-28 14:54:00 +01:00
Mikhail f. Shiryaev
88c338c090
Merge pull request #43579 from ClickHouse/universal-runners
...
Prepare CI for universal runners preallocated pool
2022-11-25 21:30:44 +01:00
Alexander Tokmakov
5bb0a7ac38
Update performance_comparison_check.py
2022-11-25 20:43:45 +03:00
Alexander Tokmakov
eec5449c1c
run perf tests on aarch64 for pr-performance
2022-11-25 17:55:10 +01:00
Mikhail f. Shiryaev
3ac0692a3d
Fix pagination issue in GITHUB_JOB_ID()
2022-11-25 17:28:13 +01:00
Mikhail f. Shiryaev
9584487a1e
Use docker images cache from merged PRs in master and release branches
2022-11-25 14:09:21 +01:00
Mikhail f. Shiryaev
1d9570a4cb
Display runner's labels on setup step
2022-11-24 16:05:16 +01:00
Mikhail f. Shiryaev
650a9dc2c2
Use zip file for ci-runners-metrics-lambda
2022-11-24 16:05:16 +01:00
Mikhail f. Shiryaev
ebe696af80
Handle universal runners in metrics lambda
2022-11-24 16:05:15 +01:00
Mikhail f. Shiryaev
ffd18d43a6
Use docker for lambda packages building
2022-11-24 16:05:15 +01:00
Mikhail f. Shiryaev
531811575e
Rename directory for zip deployment
2022-11-24 16:05:13 +01:00
Mikhail f. Shiryaev
7048f36fc7
Save unnecessary API requests
2022-11-22 13:37:08 +01:00
Mikhail f. Shiryaev
fb95ca43d8
Use all parameters with prefixes from ssm
2022-11-22 12:43:17 +01:00
alesapin
f4ef20b5e4
Merge pull request #43295 from ClickHouse/cancel-lambda-api-url
...
Cancel lambda api url
2022-11-21 12:03:37 +01:00
Mikhail f. Shiryaev
e9e355dd82
Process optionally base64-encoded bodies
2022-11-18 15:17:36 +01:00
Mikhail f. Shiryaev
b1fcdfcaad
Preserve the whole event for debugging
2022-11-18 14:26:19 +01:00
Mikhail f. Shiryaev
3727f21ac2
Merge pull request #43019 from ClickHouse/release-only-on-marked-commits
...
Allow release only from ready commits
2022-11-17 20:51:57 +01:00
Mikhail f. Shiryaev
6d532d310d
Migrate cancel-lambda to python package
2022-11-17 15:55:48 +01:00
Mikhail f. Shiryaev
1fe095ae90
Explicitly return OK for python lambdas
2022-11-17 15:55:25 +01:00
Mikhail f. Shiryaev
2e5e9a8729
Get rid of API_URL environment
2022-11-17 13:31:41 +01:00
Mikhail f. Shiryaev
cb069d8bfa
Use authorized requests for GET
2022-11-16 15:50:26 +01:00
Mikhail f. Shiryaev
589648c444
Event data for 'labeled' has an added label data
2022-11-16 15:47:32 +01:00
Mikhail f. Shiryaev
eea23df48a
Merge pull request #43121 from ClickHouse/commit-status-improvement
...
Improve commit_status_helper.py
2022-11-14 14:48:27 +01:00
Yatsishin Ilya
dee865ce78
Fix trailing \n from SQLancer status
2022-11-11 13:48:55 +01:00
Mikhail f. Shiryaev
eec74e46e4
Move get_commit_filtered_statuses to commit_status_helper
2022-11-10 13:12:22 +01:00
Mikhail f. Shiryaev
e2de809532
Add typing to commit_status_helper.py
2022-11-10 13:12:20 +01:00
Mikhail f. Shiryaev
c12c1cdf9b
Allow release only from ready commits
2022-11-10 12:42:33 +01:00
Antonio Andelic
e512d7f036
Merge pull request #42619 from ClickHouse/jepen-multiple-tests
...
Extend Jepsen tests with support for server
2022-11-10 09:01:40 +01:00
Alexander Tokmakov
af78f4b66a
Merge branch 'master' into tavplubix-patch-5
2022-11-09 16:20:24 +03:00
Alexander Tokmakov
9edb4d779b
fix
2022-11-09 12:18:29 +01:00
Mikhail f. Shiryaev
7549b22317
Add a script to mark commit as ready for release
2022-11-08 12:21:14 +01:00
Mikhail f. Shiryaev
ff083e1b55
Forbit launching release.py from branches but master
2022-11-08 12:21:12 +01:00
Antonio Andelic
900894e251
Fix style
2022-11-07 14:03:11 +00:00
robot-clickhouse
70ce952363
Automatic style fix
2022-11-07 13:49:21 +00:00
Antonio Andelic
af09ef5351
Enable release build
2022-11-07 11:48:48 +00:00
Antonio Andelic
8e1a4bcf9a
Update CI config
2022-11-07 09:42:00 +00:00
Antonio Andelic
e751557599
Merge branch 'master' into jepen-multiple-tests
2022-11-07 08:13:49 +00:00
Mikhail f. Shiryaev
1642b2f4bd
Fix old bug to remove refs/heads from default ref
2022-11-05 14:51:26 +01:00
Antonio Andelic
51ee6ec436
Use autoscaling for keeper
2022-11-04 14:12:30 +00:00
Antonio Andelic
fee53a415a
Reuse same PR
2022-11-04 13:49:12 +00:00
Antonio Andelic
98d3b4a835
Support Jepsen for server in CI
2022-11-04 13:40:13 +00:00
Ilya Yatsishin
2e7013f439
Merge pull request #42397 from qoega/revive-sqlancer
...
Revive SQLancer
2022-11-04 14:28:21 +01:00
Mikhail f. Shiryaev
0e27039ec4
Merge pull request #42934 from ClickHouse/lambdas-cryptography
...
Pin the cryptography version to not break lambdas
2022-11-04 10:09:43 +01:00
Mikhail f. Shiryaev
43dd55798d
Pin the cryptography version to not break lambdas
2022-11-03 16:37:58 +01:00
Vladimir C
acf9a62f2e
Merge pull request #42932 from ClickHouse/vdimir/pr-bufix-check
2022-11-03 14:17:58 +01:00
vdimir
5f184359a1
Do not show status for Bugfix validate check in non bugfix PRs
2022-11-03 12:44:07 +00:00
Mikhail f. Shiryaev
3f424de022
Adjust cancel and rerun workflow names to the actual
2022-11-01 14:26:06 +01:00
vdimir
2060c2d9ac
Fix style
2022-11-01 11:20:10 +01:00
vdimir
e83d61749a
update test bugfix report
2022-11-01 11:20:10 +01:00
vdimir
63b63da214
Update bugfix_validate_check.py
2022-11-01 11:20:10 +01:00
vdimir
1b32c7d212
Update bugfix_validate_check.py
2022-11-01 11:20:10 +01:00
vdimir
c18838715d
Post status for test bugfix check
2022-11-01 11:20:10 +01:00
vdimir
9f5dcd14af
Request labels from gh api for validate bugfix check
2022-11-01 11:20:10 +01:00
vdimir
e0735e1e67
Debug TestBugfixCheck
2022-11-01 11:20:10 +01:00
Ilya Yatsishin
7c345f6094
Merge branch 'master' into revive-sqlancer
2022-10-31 17:19:27 +01:00
Yatsishin Ilya
10873dfc9f
succeess
2022-10-28 11:28:20 +00:00
Yatsishin Ilya
aa75515219
fix
2022-10-28 09:47:16 +00:00
Ilya Yatsishin
cd2f9f6e3e
Merge pull request #42678 from qoega/fix-exception-handling-clickhouse-helper
...
Fix error handling in clickhouse_helper.py
2022-10-28 08:55:56 +02:00
Yatsishin Ilya
a4626c64af
fix
2022-10-27 17:56:08 +00:00
Yatsishin Ilya
d8e8dd006f
support server fail
2022-10-27 09:06:11 +00:00
Yatsishin Ilya
ccc515bebd
Merge remote-tracking branch 'origin/master' into revive-sqlancer
2022-10-27 07:13:28 +00:00
Yatsishin Ilya
9dee90cd42
fix path
2022-10-26 15:06:01 +00:00
Yatsishin Ilya
fa402d8967
fix
2022-10-26 12:01:12 +00:00
Yatsishin Ilya
acfea0e2df
style
2022-10-26 11:21:33 +00:00
Mikhail f. Shiryaev
a8f3b39dcc
Fix execution of version_helper.py to use git tweaks
2022-10-26 12:07:42 +02:00
Ilya Yatsishin
7973b4e5e5
Fix error handling
2022-10-26 11:09:01 +02:00
Yatsishin Ilya
b096edc995
do not upload files manually
2022-10-26 08:30:20 +00:00
Yatsishin Ilya
302df3af12
fix?
2022-10-25 16:34:12 +00:00
Yatsishin Ilya
c89c14a05d
add NoREC
2022-10-25 10:34:55 +00:00
Yatsishin Ilya
db2f3baf39
fix
2022-10-21 19:43:06 +00:00
Yatsishin Ilya
6f8f7150ff
style
2022-10-21 16:42:45 +00:00
Yatsishin Ilya
13f506f7b1
minor
2022-10-21 11:48:58 +00:00
Yatsishin Ilya
548ff1d2aa
fix
2022-10-20 12:33:56 +00:00
Yatsishin Ilya
105ca72955
fix
2022-10-20 10:51:47 +00:00
Ilya Yatsishin
b768925256
Update tests/ci/sqlancer_check.py
2022-10-20 00:09:09 +02:00
Ilya Yatsishin
8ef8def9ab
Update tests/ci/sqlancer_check.py
2022-10-19 21:00:05 +02:00
Yatsishin Ilya
7d90d54af8
better reporting
2022-10-19 17:02:49 +00:00
Yatsishin Ilya
757959d087
fix bug
2022-10-18 15:14:42 +00:00
Yatsishin Ilya
8b3dc2d551
typo
2022-10-18 07:52:11 +00:00
Yatsishin Ilya
aa432fe95a
staging
2022-10-17 15:20:20 +00:00
Yatsishin Ilya
6a82d54314
add CI files
2022-10-17 14:46:50 +00:00
Mikhail f. Shiryaev
54347c890f
Add at to runner AMI, bump gh runner version
2022-10-05 11:47:30 +02:00
Mikhail f. Shiryaev
45cde6545d
Add a warning message to release.py script, require release type
2022-09-30 16:22:25 +02:00
Robert Schulze
5dcdf60f68
Merge pull request #41762 from ClickHouse/bump-llvm-to-13
...
Bump LLVM from 12 to 13
2022-09-29 19:37:46 +02:00
Mikhail f. Shiryaev
10f3df340e
Use cgroups v1 on ubuntu workers
2022-09-28 14:24:45 +02:00
Robert Schulze
a300ea6024
Try to fix binary compatibility check + extend check to library-bridge
2022-09-28 09:56:58 +00:00
Robert Schulze
a18bdf0004
Merge pull request #41775 from ClickHouse/adjust-universalsh
...
Point automatic download script to to ARMv8.0 compat build
2022-09-27 09:01:25 +02:00
Alexey Milovidov
3f3f93ae13
Merge pull request #41556 from ClickHouse/gh-runners
...
Update runners to a recent version to install on 22.04
2022-09-27 01:00:53 +03:00
Mikhail f. Shiryaev
51c9f81dce
Fix tests for docker-ci
2022-09-26 13:58:38 +02:00
Robert Schulze
c5224cd007
Point automatic download script to to ARMv8.0 compat build
...
- follow-up to #41610
- universal.sh downloads a the correct ClickHouse binary for the current
platform
- For Linux/Aarch64, point to v8.0 compat build for maximum
compatibility. Also add property static_binary_name (ci_config.py) so
that the binary can be placed into the right location.
- Remove the unsupported combinations FreeBSD Aarch64 and PPC for which
we provide no binaries.
2022-09-26 11:40:09 +00:00
Alexey Milovidov
62ebf397d2
Merge pull request #41610 from ClickHouse/upgrade-arm-requirement
...
Bump minimum required ARM ISA to v8.2 and add v8.0 compat build
2022-09-26 14:08:48 +03:00
Mikhail f. Shiryaev
a760c71a0b
Fix the typo preventing building latest images
2022-09-26 12:52:12 +02:00
Robert Schulze
bcaa66c804
Add arm-v80compat builds
2022-09-21 13:09:24 +00:00
Mikhail f. Shiryaev
2dff307770
Build latest tags ONLY from master branch
2022-09-20 14:31:04 +02:00
Mikhail f. Shiryaev
a852644de2
Update runners to a recent version to install on 22.04
2022-09-20 11:33:06 +02:00
Alexey Milovidov
ecfd8cb5a6
Remove trash error message from integration tests
2022-09-17 20:24:56 +02:00
Mikhail f. Shiryaev
c9d1b1d519
Merge pull request #41401 from ClickHouse/backported-label
...
Rename pr-backported label to avoid confusion
2022-09-16 11:48:49 +02:00
Robert Schulze
13a2bbaf5e
Merge branch 'master' into enable_constant_column_search
2022-09-16 11:09:45 +02:00
Mikhail f. Shiryaev
6a17d4e705
Delete redundant LABEL_ prefix
2022-09-16 10:23:49 +02:00
Mikhail f. Shiryaev
ab7bd95d8b
Rename pr-backported label to avoid confusion
2022-09-16 10:04:49 +02:00
Alexey Milovidov
da01982652
Merge pull request #41046 from azat/build/llvm-15
...
Switch to llvm/clang 15
2022-09-16 07:31:06 +03:00
Robert Schulze
cce4ed5496
Un-exclude constant_column_search from ARM perf tests
...
constant_column_search was excluced when ARM perf tests were set up
PR 37497. Back then we haven't had PR 41033 and regexp eval on ARM was
slow. Let's check again.
2022-09-15 10:48:47 +00:00
Mikhail f. Shiryaev
c2b02c2ae9
Download ccache from release PRs for backports
2022-09-14 18:24:55 +02:00
Azat Khuzhin
ced30a2072
Switch to llvm/clang 15
...
It had been released few hours ago, and I want to check how clang-15
generates DWARF-5
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Alexander Tokmakov
e77b9e4d0c
Merge pull request #40775 from azat/ci/core-dumps-rework
...
Rework core collecting on CI (eliminate gcore usage)
2022-09-09 20:20:10 +03:00
Mikhail f. Shiryaev
b815fdbc8c
Merge pull request #41088 from ClickHouse/darwin-releases
...
Add macos binaries to release assets
2022-09-09 17:17:15 +02:00
Robert Schulze
9d4de0cbaa
Merge pull request #40999 from ClickHouse/sse2-special-build
...
Add special x86-SSE2-only build
2022-09-08 09:06:29 +02:00
Mikhail f. Shiryaev
c0ce4c2d6f
Add macos binaries to GH release assets
2022-09-07 19:23:44 +02:00
Mikhail f. Shiryaev
a067907fbe
Add typing and order import
2022-09-07 19:23:43 +02:00
Mikhail f. Shiryaev
bd83e905d3
Fix a typo in download_build_with_progress
2022-09-07 19:23:43 +02:00
Mikhail f. Shiryaev
7cdd8c3304
Move download template to env_helper
2022-09-07 19:23:42 +02:00
Mikhail f. Shiryaev
257c4328f7
Rename get_build_urls to read_build_urls
2022-09-07 19:23:41 +02:00
Mikhail f. Shiryaev
f3cf1069dc
Fix header for autogenerated version
2022-09-07 19:23:41 +02:00
robot-clickhouse
01139d9d28
Automatic style fix
2022-09-07 08:51:02 +00:00
Robert Schulze
497b65f41d
CheckLabels: Print message that 'can be tested' is missing
2022-09-07 08:42:53 +00:00
Kseniia Sumarokova
68e013e819
Update ci_config.py
2022-09-05 22:13:07 +02:00
Robert Schulze
401747eaa7
Merge branch 'master' into sse2-special-build
2022-09-05 16:17:20 +02:00
Kseniia Sumarokova
360bc93c87
Turn off always green mode
2022-09-05 16:16:49 +02:00
Robert Schulze
e1def723f8
Add special x86-SSE2-only build
2022-09-05 12:51:44 +00:00
Alexey Milovidov
a819f2c75b
Merge branch 'master' into add-more-s3-tests
2022-09-05 05:23:17 +03:00
Azat Khuzhin
25e3bebd9d
Rework core collecting on CI (eliminate gcore usage)
...
gcore is a gdb command, that internally uses gdb to dump the core.
However with proper configuration of limits (core_dump.size_limit) it
should not be required, althought some issues is possible:
- non standard kernel.core_pattern
- sanitizers
So yes, gcore is more "universal" (you don't need to configure any
`kernel_pattern`), but it is ad-hoc, and it has drawbacks -
**it does not work when gdb fails**. For example gdb may fail with
`Dwarf Error: DW_FORM_strx1 found in non-DWO CU` in case of DWARF-5 [1].
[1]: https://github.com/ClickHouse/ClickHouse/pull/40772#issuecomment-1236331323 .
Let's try to switch to more native way.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-04 22:07:16 +02:00
Alexey Milovidov
c4adc9ed8f
Remove trash
2022-09-04 04:28:08 +02:00
Mikhail f. Shiryaev
9e4f5d5006
Merge pull request #40845 from ClickHouse/cherry-pick-assignees
...
Assign new cherry-pick and backport PRs
2022-09-01 18:32:46 +02:00
Mikhail f. Shiryaev
ca837e6755
Add a doc-string for ReleaseBranch._assign_new_pr
2022-09-01 13:06:14 +02:00
Mikhail f. Shiryaev
1da02adc8d
Assign PRs to an original merged_by too
2022-09-01 12:38:30 +02:00
Robert Schulze
d311482391
More renamings for consistency
...
AST Fuzzer (ASan) --> AST Fuzzer (asan)
AST Fuzzer (TSan) --> AST Fuzzer (tsan)
AST Fuzzer (MSan) --> AST Fuzzer (msan)
AST Fuzzer (UBSan) --> AST Fuzzer (ubsan)
2022-09-01 07:59:01 +00:00
Robert Schulze
48164b039a
Consistent sanitizer naming in CI
...
Sanitizer build/test jobs were sometimes named with full form
('undefined') - which could be confusing - and sometimes named with
abbreviated form ('ubsan'). Now always using the short form.
2022-08-31 12:45:05 +00:00
Mikhail f. Shiryaev
187b10dec5
Assign to all at once, improve logging
2022-08-31 14:09:17 +02:00
Yakov Olkhovskiy
31a7ed09a1
disable default ENABLE_CLICKHOUSE_SELF_EXTRACTING and add to env
2022-08-27 21:08:01 +00:00
Alexey Milovidov
f86242c17e
Merge pull request #40699 from ClickHouse/remove-unbundled
...
Remove the remaining parts of "unbundled" build
2022-08-27 21:54:42 +03:00
Alexey Milovidov
91ed3ebe9a
Remove the remaining parts of "unbundled" build
2022-08-27 02:18:47 +02:00
Vladimir C
cc74e3dd19
Fix performance_comparison_check.py
2022-08-26 15:49:40 +02:00
Vladimir C
f76325c439
Fix style in performance_comparison_check.py
2022-08-26 12:45:40 +02:00
vdimir
d82cab7f65
Fix env variable forwaring in performance_comparison_check.py
2022-08-26 09:21:42 +00:00
Alexey Milovidov
cb2e5f316c
Revert "Maybe make it possible"
...
This reverts commit a517d9d65f
2022-08-21 20:52:04 +02:00
Alexey Milovidov
ad8a1751ac
Merge branch 'master' into riscv-in-ci
2022-08-21 16:56:11 +03:00
Azat Khuzhin
4de309718b
tests/stress: use --privileged over --cap-add syslog to obtain dmesg
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-19 13:31:05 +02:00
Mikhail f. Shiryaev
e513ad6748
And the last tiny fix for assignees
2022-08-18 23:32:55 +02:00
Mikhail f. Shiryaev
b485afbe2c
Merge pull request #40367 from ClickHouse/cherry-pick-assignees
...
Fix wrong assignees argument passing
2022-08-18 23:28:31 +02:00
Mikhail f. Shiryaev
dce060bac4
Fix wrong assignees argument passing
2022-08-18 22:22:50 +02:00
Mikhail f. Shiryaev
13d95ebdef
Fix typo in the S3 download links for
2022-08-18 20:32:33 +02:00
robot-clickhouse
15bbb21a09
Automatic style fix
2022-08-16 13:10:28 +00:00
Yakov Olkhovskiy
dfbbc51045
add update_mergeable_check trigger
2022-08-16 09:02:03 -04:00
Yakov Olkhovskiy
b865787b3c
add Unit tests to Mergeable
2022-08-15 19:05:40 -04:00
Mikhail f. Shiryaev
9f3b2fafcc
Merge pull request #40177 from ClickHouse/cherry-pick-logging
...
Improve assignment and logging for cherry-pick and backport steps
2022-08-15 13:41:52 +02:00
Alexey Milovidov
a517d9d65f
Maybe make it possible
2022-08-15 04:23:56 +02:00
Alexey Milovidov
edc99648ad
Add build to CI
2022-08-14 06:14:43 +02:00
Azat Khuzhin
923e2f22ef
tests/stress: fix dmesg reading
...
After #39939 there is still an error:
+ dmesg -T
dmesg: read kernel buffer failed: Operation not permitted
[1]: https://s3.amazonaws.com/clickhouse-test-reports/39939/a1981f21a153810f072af67bb6007dc1f4367c22/stress_test__debug_.html
Since it is not allowed to access dmesg by default,
one of the following is required:
- --cap-add syslog
- --cap-add cap_sys_admin
- --privileged
I decided to use as little capabilities as possible, even though it is
not that important on CI, but it is a rule of thumb.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-13 21:45:09 +02:00
Mikhail f. Shiryaev
22c53e7f7b
Merge pull request #40127 from ClickHouse/s3-helper
...
Rework S3Helper a little bit
2022-08-13 16:27:00 +02:00
Mikhail f. Shiryaev
7f61f30f15
Improve assignment and logging for cherry-pick and backport steps
2022-08-12 23:30:32 +02:00
Alexey Milovidov
8c3d1f2b5b
Merge branch 'master' into server-side-time
2022-08-12 17:40:02 +03:00
Mikhail f. Shiryaev
b46622cf3c
Don't use envs for static links
2022-08-12 09:46:36 +02:00
Mikhail f. Shiryaev
372481e770
Rework S3Helper a little bit
2022-08-11 15:01:32 +02:00
Mikhail f. Shiryaev
9f45532999
Use a job ID as ref text
2022-08-11 12:05:16 +02:00
Mikhail f. Shiryaev
ac371818f7
Fix _csv.Error: field larger than field limit (131072)
2022-08-10 20:21:49 +02:00
Mikhail f. Shiryaev
2fb68078e8
Replace S3 URLs by parameter
2022-08-10 15:22:04 +02:00
Mikhail f. Shiryaev
4b2bba2ff1
Do not upload unnecessary lambda sources
2022-08-10 14:37:06 +02:00
Mikhail f. Shiryaev
5f3c7524bc
Merge pull request #40032 from ClickHouse/job-url
...
Job url
2022-08-10 09:58:30 +02:00
Alexey Milovidov
f7d995681b
Merge branch 'master' into replace-yandex-to-noto
2022-08-09 22:43:52 +03:00
Mikhail f. Shiryaev
bcf430b382
Add job url to test reports
2022-08-09 19:12:47 +02:00
Mikhail f. Shiryaev
32efae4f1b
Add JOB_ID and JOB_URL getters
2022-08-09 18:34:12 +02:00
Mikhail f. Shiryaev
a34a9b581c
Merge pull request #39871 from ClickHouse/universal-lambdas
...
Get api url from event, not from const/ENV
2022-08-08 23:34:04 +02:00
Alexey Milovidov
0349d9da96
Change font in CI reports just in case (might be worse)
2022-08-08 07:25:29 +02:00
Yakov Olkhovskiy
40463e9c47
add Stateful tests (release), Stateless tests (release) to Mergeable Check
2022-08-08 00:20:09 -04:00
Alexey Milovidov
f08952b74c
Merge pull request #39735 from ClickHouse/ci-simple-check-refactoring
...
CI: refactor Simple Check, use statuses to make it stateful
2022-08-06 02:04:36 +03:00
Yakov Olkhovskiy
1a52fa183d
rename Simple Check to Mergeable Check, refactor processing
2022-08-05 10:39:58 -04:00
alesapin
48e55ff4c7
Merge pull request #39795 from ClickHouse/cloudflare-dns-fallback
...
Add cloudflare DNS as a fallback
2022-08-05 12:14:45 +02:00
Mikhail f. Shiryaev
0d1c31a869
Merge branch 'master' into release-tweak-generate
2022-08-04 21:33:54 +02:00
Alexey Milovidov
f474eb957d
Merge pull request #39758 from ClickHouse/tsan_clang_15
...
Try clang-15 for build with tsan
2022-08-04 01:56:52 +03:00
Mikhail f. Shiryaev
8919fd6e58
Add handful notes to a post-release logging
2022-08-04 00:40:32 +02:00
Mikhail f. Shiryaev
ff26492830
Prevent spoiling rollback_stack
2022-08-04 00:24:43 +02:00
Mikhail f. Shiryaev
c6948c3e82
Use token for all requests
2022-08-03 19:17:41 +02:00
Mikhail f. Shiryaev
61fd28e19f
Get api url from event, not from const/ENV
2022-08-03 19:17:41 +02:00
Mikhail f. Shiryaev
62a05dc10d
Add instructions for github-cli installation
2022-08-03 13:40:31 +02:00
Mikhail f. Shiryaev
2ca9df9b22
Merge pull request #39421 from ClickHouse/github-helper
...
GitHub helper
2022-08-03 12:04:03 +02:00
Mikhail f. Shiryaev
08474cf869
Update tweak on version part update
2022-08-03 11:43:47 +02:00
Mikhail f. Shiryaev
469b7e7668
Add notes about _is_cache_updated logic
2022-08-02 18:44:49 +02:00
Mikhail f. Shiryaev
70d97e9393
Merge pull request #39630 from ClickHouse/workflow-rerun-lambda
...
Attempt to fix wrong workflow_run data for rerun
2022-08-02 18:29:43 +02:00
Mikhail f. Shiryaev
f150966f10
Merge pull request #39723 from ClickHouse/cherry-pick-fix
...
Fix cherry-pick for cases, when assignee is not set for PR
2022-08-02 13:13:47 +02:00
Mikhail f. Shiryaev
26ef951fde
Add DNS trick to the dockerhub proxy too
2022-08-02 12:04:26 +02:00
Alexander Tokmakov
82b50e79cf
Merge branch 'master' into tsan_clang_15
2022-08-02 13:00:55 +03:00
Alexey Milovidov
b275aae95d
Update init_runner.sh
2022-08-02 03:23:53 +03:00
Alexey Milovidov
488ae32295
Update init_runner.sh
2022-08-02 03:23:05 +03:00
Robert Schulze
b33fe26d8c
Merge pull request #39759 from ClickHouse/splitted-to-shared-renaming
...
Rename "splitted build" to "shared libraries build" in CI tools
2022-08-01 22:39:57 +02:00
Mikhail f. Shiryaev
afcf76e899
Add cloudflare DNS as a fallback
2022-08-01 18:27:17 +02:00
robot-clickhouse
af2f1b4cc3
Automatic style fix
2022-08-01 13:22:53 +00:00
Mikhail f. Shiryaev
33b26dda05
Improve logging
...
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2022-08-01 15:15:48 +02:00
Mikhail f. Shiryaev
079db7f34b
Retry inserts with ClickHouseHelper
2022-08-01 14:59:13 +02:00
Robert Schulze
0e154ed1df
More renamings
2022-08-01 07:05:39 +00:00
Alexander Tokmakov
31550436e4
try clang-15 for build with tsan
2022-07-31 14:38:13 +02:00
Robert Schulze
729d19fa4f
Rename "splitted build" to "shared libraries build" in CI tools
...
- The old name made sense for (dev option) "-DUSE_STATIC_LIBRARIES=0
-DSPLIT_SHARED_LIBRARIES=1 -DSPLIT_BINARY=1" but that was removed with
#39520 .
- What still exists is "-DUSE_STATIC_LIBRARIES=0
-DSPLIT_SHARED_LIBRARIES=1" which does a shared library build
2022-07-31 12:26:51 +00:00
Alexey Milovidov
d306063a76
Merge branch 'master' into add-more-s3-tests
2022-07-31 01:15:49 +03:00
Mikhail f. Shiryaev
6126bd60ed
Fix cherry-pick for cases, when assignee is not set for PR
2022-07-29 19:27:38 +02:00
Mikhail f. Shiryaev
f0474f9e46
Improve lambda logic, don't fail on non-uniq PR
2022-07-28 14:24:42 +02:00
Mikhail f. Shiryaev
2338d01a20
Deploy workflow_approve_rerun_lambda as zip package
2022-07-28 14:23:59 +02:00
alesapin
e6d22793c9
Merge pull request #39428 from ClickHouse/block-builds-by-style
...
Require clear style check to continue building
2022-07-27 11:55:46 +02:00
Mikhail f. Shiryaev
0db9dda5f3
Attempt to fix wrong workflow_run data for rerun
2022-07-26 23:10:58 +02:00
Mikhail f. Shiryaev
061e61919a
Merge pull request #39450 from ClickHouse/tsal-clang-13
...
Build thread sanitizer binaries with clang-13
2022-07-26 15:13:17 +02:00
Mikhail f. Shiryaev
d9baa0b1f7
Finish following runs with the same exit code as the first
2022-07-26 14:22:11 +02:00
Mikhail f. Shiryaev
db0653758e
Add typing to rerun and commit_status helpers
2022-07-26 14:22:11 +02:00
Alexey Milovidov
5867762258
Merge pull request #39454 from ClickHouse/status-names
...
Commit status names: remove "actions"
2022-07-24 17:39:16 +03:00
Mikhail f. Shiryaev
4302f583d8
Merge pull request #39467 from ClickHouse/ci-enforce-checks-2
...
Add Build Check and Special Build Check to SimpleCheck
2022-07-24 00:24:55 +02:00
Alexey Milovidov
b6b217d2a3
Merge branch 'master' into status-names
2022-07-24 00:34:00 +03:00
Yakov Olkhovskiy
c559cac085
add to SimpleCheck
2022-07-22 18:01:57 -04:00
Mikhail f. Shiryaev
17b504b0d4
Build thread sanitizer binaries with clang-13
2022-07-22 12:14:22 +02:00
robot-clickhouse
0d34814629
Automatic style fix
2022-07-21 16:39:14 +00:00
Mikhail f. Shiryaev
685a8f3949
Intentionally break black formatting
2022-07-21 17:01:45 +02:00
Mikhail f. Shiryaev
f60dcc30fb
Push automatic fix for black format for PRs
2022-07-21 17:01:42 +02:00
Mikhail f. Shiryaev
dacfc7886c
Improve style_check scripts style a little bit
2022-07-21 16:59:44 +02:00
Mikhail f. Shiryaev
209a5047c0
Improve caching logic, add cached NamedUser
2022-07-21 15:45:38 +02:00
Mikhail f. Shiryaev
d42018a2dc
Cleanup the rest of (actions) status names
2022-07-21 13:10:22 +02:00
Mikhail f. Shiryaev
b0eef42b9b
Remove unused Testflows and Release ci configs
2022-07-21 13:07:14 +02:00
Mikhail f. Shiryaev
31be011430
Rename bugfix checks statuses, clear unised ci config
2022-07-21 13:04:34 +02:00
Mikhail f. Shiryaev
c24800c7d5
Merge pull request #39307 from ClickHouse/ci-simple-check-fix-rerun
...
Simple Check should be updated on rerun
2022-07-21 13:01:59 +02:00
Mikhail f. Shiryaev
9679401a67
Rename flaky tests statuses
2022-07-21 12:58:36 +02:00
Mikhail f. Shiryaev
3ab288b095
Rename AST fuzzer statuses
2022-07-21 12:47:49 +02:00
Mikhail f. Shiryaev
8be0d9287d
Rename unit tests statuses
2022-07-21 12:45:46 +02:00
Mikhail f. Shiryaev
69f0cf19f4
Rename integration tests statuses
2022-07-21 12:43:42 +02:00
Mikhail f. Shiryaev
cc3c47c143
Rename stress tests statuses
2022-07-21 12:41:49 +02:00
Mikhail f. Shiryaev
f3ba18778d
Rename stateless tests statuses
2022-07-21 12:36:25 +02:00
Mikhail f. Shiryaev
9259e5ca77
Rename stateful tests statuses
2022-07-21 12:32:54 +02:00
Mikhail f. Shiryaev
7acf3dd624
Rename build reports statuses
2022-07-21 12:27:45 +02:00
Yakov Olkhovskiy
baff8327b9
do not recreate Simple Check if already exists
2022-07-21 01:41:55 -04:00
Yakov Olkhovskiy
f30b54a392
fail_simple_check is added
2022-07-21 01:36:13 -04:00
Yakov Olkhovskiy
c4073328fa
add get_finished_status function
2022-07-21 01:36:12 -04:00
Mikhail f. Shiryaev
d100fac7ab
Use checkout -f preventing some potential issues
2022-07-20 17:29:34 +02:00
Mikhail f. Shiryaev
caef6729f4
Improve debug logging of github_helper
2022-07-18 10:32:45 +02:00
Mikhail f. Shiryaev
9cc06ea0e4
Fix found points during the review
2022-07-17 14:05:21 +02:00
Mikhail f. Shiryaev
6e48b08190
Clean-up some staff left after finishing
2022-07-15 17:58:45 +02:00
Mikhail f. Shiryaev
dc6db5b5d9
Replace sys.exit by Exception to rollback stash and clear_repo
2022-07-15 17:21:19 +02:00
Mikhail f. Shiryaev
48797660ff
Process exceptions per PR to not fail the script
2022-07-15 17:21:18 +02:00
Mikhail f. Shiryaev
30b0995532
Add early check if PR is already in a release branch
2022-07-15 17:21:18 +02:00
Mikhail f. Shiryaev
909e871c48
Rewrite cherry_pick.py to PyGithub API
2022-07-15 17:21:14 +02:00
Vladimir C
ca2e27aaa2
Merge pull request #37841 from vdimir/perf-save-to-stat
...
Send perf tests results to ci database
2022-07-11 13:07:40 +02:00
Alexey Milovidov
af1136c990
Merge pull request #38744 from ClickHouse/ci-required-simple-checks
...
Add SimpleCheck
2022-07-08 11:17:38 +03:00
mergify[bot]
7ba147bc7d
Merge branch 'master' into improve-bc-check
2022-07-07 09:38:17 +00:00
Mikhail f. Shiryaev
4410caf31d
Retry docker buildx commands with progressive sleep in between
2022-07-06 13:58:46 +02:00
Yakov Olkhovskiy
d6269c04bb
style fix
2022-07-06 00:40:51 -04:00
Yakov Olkhovskiy
69d1495672
style fix
2022-07-06 00:22:50 -04:00
Yakov Olkhovskiy
19365597eb
move Simple Check to python
2022-07-05 23:37:01 -04:00
mergify[bot]
ba7d48c2d7
Merge branch 'master' into improve-bc-check
2022-07-05 13:40:35 +00:00
vdimir
f701b58dd0
Update check_name in performance comparsion upload
2022-07-05 14:24:58 +02:00
vdimir
3731bd44c1
Revert "[testing] run only one perftest"
...
This reverts commit 3b079827b78e04ac20043346998ce9d546969746.
2022-07-05 14:00:26 +02:00
vdimir
45b2b1ca8a
[wip] persist pertest results
2022-07-05 14:00:24 +02:00
vdimir
c2d774d598
[testing] run only one perftest
2022-07-05 14:00:24 +02:00
vdimir
aac2f8aefc
Rename envs for performance comparsion
2022-07-05 14:00:24 +02:00
vdimir
b440ff83d8
fix performance_comparison_check.py
2022-07-05 14:00:24 +02:00
vdimir
0232c9267d
Pass CHPC_DATABASE_URL to perf tests
2022-07-05 14:00:15 +02:00
Mikhail f. Shiryaev
f048db23e2
Release branches run CI on pushes, fix PRInfo
2022-07-05 12:10:33 +02:00
Kruglov Pavel
6e0f27be23
Fix
2022-07-05 11:23:35 +02:00
Mikhail f. Shiryaev
04948e81cc
Get files changed in master since release is branched
2022-07-05 00:29:28 +02:00
Kruglov Pavel
315e6dcdb9
Fix style
2022-07-04 22:06:04 +02:00
Kruglov Pavel
4a557201c8
Fix style
2022-07-04 21:59:46 +02:00
avogar
fb2f60c613
Remove old script
2022-07-04 13:03:55 +00:00
avogar
17da24b584
Try to improve backward compatibility check
2022-07-04 13:02:22 +00:00
Mikhail f. Shiryaev
1018eff5b3
Merge pull request #38273 from ClickHouse/38218-oo-space
...
Improve runners AMI and init scripts
2022-07-04 12:39:58 +02:00
Mikhail f. Shiryaev
7c812df47e
Merge pull request #38580 from ClickHouse/artifactory-arm64
...
Push arm64 packages to artifactory and release assets
2022-07-04 12:31:52 +02:00
Mikhail f. Shiryaev
19516c768f
Revert "Upload to S3 compressed self-extracting clickhouse"
2022-07-04 10:15:27 +02:00
Yakov Olkhovskiy
c415543334
Merge pull request #38653 from ClickHouse/deployment-self-extracting
...
Upload to S3 compressed self-extracting clickhouse
2022-07-04 01:45:09 -04:00
Mikhail f. Shiryaev
27bd355525
Use cached image from the release branch for backport PRs
2022-07-01 16:49:27 +02:00
Mikhail f. Shiryaev
6a67be3195
Get a proper set of changed files for backport PRs
2022-07-01 15:34:46 +02:00
Mikhail f. Shiryaev
b8fa26f94f
Fix wrong self.changed_files type
2022-07-01 15:34:45 +02:00
Mikhail f. Shiryaev
7cc063a1d0
Fix strange backport titles issues
2022-07-01 12:46:25 +02:00
Yakov Olkhovskiy
12290dd644
upload from self-extracting directory
2022-06-30 17:35:42 -04:00
Mikhail f. Shiryaev
738769d1f7
Download arm64 packages and push to artifactory
2022-06-30 16:31:39 +02:00
Mikhail f. Shiryaev
6925bd6a03
Fix hardcoded retries for get_with_retries
2022-06-30 16:31:37 +02:00
Mikhail f. Shiryaev
e76ebdfb47
Change clickhouse-{client,server} packages architecture
2022-06-30 16:31:31 +02:00
Mikhail f. Shiryaev
498a9cc8d4
Terminate instance if docker does not start on post-hook
2022-06-29 12:54:33 +02:00
Mikhail f. Shiryaev
80e7abd0fe
Merge pull request #38548 from excitoon-favorites/ci-integration-tests-test
...
Don't spoil return code of integration tests runner with redundant tee
2022-06-29 11:18:53 +02:00
Vladimir Chebotarev
f7ef571842
Don't spoil return code of integration tests runner with redundant tee.
2022-06-29 06:11:09 +03:00
Mikhail f. Shiryaev
e1ac7477c9
Avoid killing terminate-instances task
2022-06-28 17:51:47 +02:00
Mikhail f. Shiryaev
94f932add1
A tiny improvement in logging
2022-06-28 10:27:25 +02:00
Mikhail f. Shiryaev
6a67ba91cf
Add public hostname for runner
2022-06-27 14:46:28 +02:00
Mikhail f. Shiryaev
f2611c3707
Refresh team keys for each runner
2022-06-27 14:45:50 +02:00
Mikhail f. Shiryaev
9dffe573bb
Reduce amount of docker logs on the runner
2022-06-27 14:44:59 +02:00
Mikhail f. Shiryaev
7297e468d5
Migrate team-keys lambda to zip archives deployment
2022-06-27 14:00:32 +02:00
Mikhail f. Shiryaev
20614b3678
Improve runners AMI and init scripts
...
- Install CloudWatch agent and atop
- Update runner version, that supports hooks
- Provide start and complete job hooks
- Will update docker version implicitly to 20.10.17~3
2022-06-23 18:25:15 +02:00
Mikhail f. Shiryaev
e1547058cf
Merge pull request #38086 from ClickHouse/build-artifacts-upload
...
Build artifacts upload
2022-06-20 11:49:04 +02:00
Mikhail f. Shiryaev
2544b0d53e
Add retries with progressive sleep and dynamic page sice decreasing
2022-06-16 16:29:48 +02:00
Mikhail f. Shiryaev
5f3de6f486
Use the best token instead of the constant
2022-06-16 16:27:49 +02:00
Mikhail f. Shiryaev
d7505d4de7
Change alignment, fix some f-strings
2022-06-16 14:33:39 +02:00
Mikhail f. Shiryaev
7ed305f9b1
Improvement of cherry-pick/backport script
...
- cherry_pick.py now can ba launched locally, with dry-run
- get rid of fallback import paths
- do not create a huge pile of objects for every sneezing
- the same for hidden imports in deep local functions
- improve logging
- fix imports for cherry_pick_utils entities
- Significantly reduced requests to GraphQL API
2022-06-16 14:32:32 +02:00
Mikhail f. Shiryaev
fe2231dbdb
Upload static binaries from deb builds with lto=thin
2022-06-15 13:18:26 +02:00
Mikhail f. Shiryaev
5d4e96cc30
Change order of uploaded artifacts to rebuild failed binaries
2022-06-15 13:17:45 +02:00
Mikhail f. Shiryaev
c49a96dd19
Merge pull request #38057 from ClickHouse/build-report
...
Use workflow URL as "link" ref
2022-06-14 22:41:12 +02:00
Mikhail f. Shiryaev
e701adbd28
Use workflow URL as "link" ref
2022-06-14 16:22:41 +02:00
Pavel Novitskiy
f4d757cd6d
remove unused args
2022-06-13 17:56:35 +02:00
Mikhail f. Shiryaev
539e423744
Use git.sha to avoid 0000000
2022-06-13 17:41:05 +02:00
Pavel Novitskiy
31c084567a
Add release commit hash to image labels
2022-06-13 13:39:28 +02:00
Mikhail f. Shiryaev
9ca03d09cc
Add a way to invalidate docker images cache
2022-06-08 14:47:45 +02:00
Kruglov Pavel
83418ebba2
Merge pull request #37712 from vdimir/duplicate_download_previous_release
...
Get rid of duplicate download_previous_release
2022-06-07 12:51:34 +02:00
Vladimir C
f7b026f31e
Merge pull request #37825 from vdimir/contrib-trigger-false
2022-06-03 15:31:18 +02:00
vdimir
8228049687
Fix submodule changed label condition
2022-06-03 13:59:34 +02:00
Alexey Milovidov
1529d47207
Merge pull request #34754 from ClickHouse/llvm-14
...
Switch to clang/llvm 14
2022-06-03 14:07:34 +03:00
Ilya Yatsishin
0650f7538d
fix style
2022-06-02 16:17:25 +02:00
Ilya Yatsishin
2ea437de32
fix black
2022-06-02 16:13:52 +02:00
Ilya Yatsishin
a57432659a
Merge remote-tracking branch 'origin/master' into aarch64-perf
2022-06-02 14:31:55 +02:00
Ilya Yatsishin
64befe9753
Filter out incompatible performance test
2022-06-02 14:29:24 +02:00
Alexey Milovidov
b5f48a7d3f
Merge branch 'master' of github.com:ClickHouse/ClickHouse into llvm-14
2022-06-01 22:09:58 +02:00
Vladimir C
2622791b9e
upd
2022-06-01 16:17:17 +02:00
Vladimir C
773eb15afc
Try mound instead of volume docker arg in stress_check
2022-06-01 14:36:51 +02:00
Vladimir C
42feae8940
fix stress_check.py
2022-06-01 10:44:44 +02:00
vdimir
4d336d0228
Get rid of duplicate download_previous_release
2022-05-31 17:50:29 +00:00
vdimir
c5ac6294ae
Display entires for failed tests at the top of report
2022-05-31 16:18:16 +00:00
alesapin
0e8ab36913
Merge branch 'master' into turn_on_s3_tests
2022-05-29 14:37:10 +02:00
Alexey Milovidov
c1169019d2
Merge branch 'master' into llvm-14
2022-05-29 02:29:02 +02:00
Alexey Milovidov
e48af2efe4
Update report.py
2022-05-28 21:25:42 +03:00
Alexey Milovidov
15f2912dc9
Fix Python.
2022-05-28 05:10:29 +03:00
Alexey Milovidov
f7a5b1fdaf
Remove margin in test reports and change the font
2022-05-28 03:24:56 +02:00
Alexey Milovidov
8c94b75516
Merge branch 'master' into llvm-14
2022-05-27 22:24:20 +02:00
mergify[bot]
923ad2e905
Merge branch 'master' into turn_on_s3_tests
2022-05-27 16:31:43 +00:00
alesapin
32167cb6fb
Turn on s3 tests
2022-05-27 14:36:12 +02:00
Mikhail f. Shiryaev
e1ed2aa3dc
Add failed builds to the build report
2022-05-25 23:00:33 +02:00
Alexey Milovidov
a5541dc2d5
Merge branch 'master' into llvm-14
2022-05-25 01:56:24 +02:00
Ilya Yatsishin
cda88ebf9c
Try to run aarch64 performance tests
2022-05-24 21:47:49 +02:00
Mikhail f. Shiryaev
b4c0f7a621
Simplify labels check
2022-05-24 12:57:06 +02:00
Mikhail f. Shiryaev
90425dedd1
Fail release on status == failure
2022-05-24 11:14:17 +02:00
Mikhail f. Shiryaev
3af9a699d5
Fix ssh-agent socket in docker image
2022-05-24 11:14:16 +02:00
Mikhail f. Shiryaev
249af9c69a
Run container as user, print stdout
2022-05-24 11:14:16 +02:00
Mikhail f. Shiryaev
21d6fc54d5
Do not check docs_release.py for changed files
2022-05-24 11:14:16 +02:00
Mikhail f. Shiryaev
501a8158a5
Don't fail docker images on dispatch or other events
2022-05-24 11:14:14 +02:00
Mikhail f. Shiryaev
cfe98c4aba
Fix publishing of content.clickhouse.com
...
- Publish only benchmarks and data
- Minimize clickhouse/docs-release
- Run it as a normal user
- Speed up running by not redownload virtual env deps
- Clean out docs and blog buildging
- Minimize docs/tools/requirements.txt
2022-05-23 11:50:02 +02:00
Alexey Milovidov
dce7a86ca9
Merge branch 'master' into llvm-14
2022-05-22 22:38:07 +02:00
Mikhail f. Shiryaev
52d81ecd86
Merge pull request #37374 from ClickHouse/docker-server-build
...
Fix docker server images building
2022-05-20 07:17:32 +02:00
Alexey Milovidov
87c6f806cf
Merge pull request #37371 from ClickHouse/safe-fail-on-cidb-down
...
Do not fail CI if events clickhouse is down
2022-05-20 03:52:04 +03:00
Mikhail f. Shiryaev
39097a4cfc
Fix automatic bucket_prefix, exit 1 on failures
2022-05-20 00:06:44 +02:00
Mikhail f. Shiryaev
de23fdccf6
Fix get_release_or_pr execution in docker_server
2022-05-19 23:00:30 +02:00
Mikhail f. Shiryaev
de39a48c33
Append performance_url to build_urls
2022-05-19 22:44:10 +02:00
Mikhail f. Shiryaev
121571ec5d
Ugly hacks for performance.tgz artifacts
2022-05-19 22:37:54 +02:00
alesapin
711b94064e
Merge pull request #36538 from ClickHouse/merge-builds
...
Merge release and performance builds
2022-05-19 19:19:18 +02:00
Mikhail f. Shiryaev
7134fc848f
Use SSL certs verification for CI DB
2022-05-19 18:23:20 +02:00
Mikhail f. Shiryaev
8a74b1cf2f
Add forgotten insert_events_into to ast-fuzzer CI
2022-05-19 17:56:35 +02:00
Mikhail f. Shiryaev
338f638557
Fix linter errors
2022-05-19 17:54:56 +02:00
Mikhail f. Shiryaev
6a9d36a9e2
Do not fail CI on events DB down, improve logging
2022-05-19 17:53:00 +02:00
Mikhail f. Shiryaev
9acb42fcdb
Add time to wait for workflow canceled
2022-05-19 15:26:02 +02:00
Mikhail f. Shiryaev
3d0e4c56e2
Fix prefetch release branch
2022-05-19 10:05:34 +02:00
Mikhail f. Shiryaev
c6e2dd1c43
Create release without draft step
2022-05-18 14:34:41 +02:00
Mikhail f. Shiryaev
1c11823935
Get rid of intermediate prestable release
2022-05-18 14:34:40 +02:00
Mikhail f. Shiryaev
b93a4e2da3
Minor improvements on variables and comments
2022-05-18 14:34:40 +02:00
Mikhail f. Shiryaev
3b1c858bff
Rollback prestable part on failed testing
2022-05-18 14:34:38 +02:00
Mikhail f. Shiryaev
6cedd2f671
Catch all Exceptions in context managers
2022-05-18 14:32:49 +02:00
Mikhail f. Shiryaev
33eed2280b
Fix linter issues
2022-05-18 01:38:46 +02:00
Mikhail f. Shiryaev
48751f5a91
Checkout master:master for performance output in packager
2022-05-18 01:38:44 +02:00
Mikhail f. Shiryaev
1f67665c95
Build performance output in release builds
2022-05-18 01:38:44 +02:00
Mikhail f. Shiryaev
b929eee8db
Remove redundant CHECK_NAME from build_check.py
2022-05-18 01:38:41 +02:00
Mikhail f. Shiryaev
e6e0f0589d
Update run-check.py to match PR template, add comments
2022-05-17 21:43:22 +02:00
Nikolai Kochetov
f1bc2bc615
Merge branch 'master' into llvm-14
2022-05-16 12:03:26 +02:00
Alexey Milovidov
3b9d8f9d19
Merge pull request #37095 from ClickHouse/upload-ppc64le-binary
...
Add PowerPC binary to universal install script
2022-05-15 04:33:06 +03:00
bkuschel
16e4b0db20
Fix coverity build
2022-05-13 10:22:23 -07:00
Mikhail f. Shiryaev
e9733f0cbe
Fix fasttest ccache permissions
2022-05-12 09:18:28 +02:00
Mikhail f. Shiryaev
3fa955aec1
Merge pull request #37057 from ClickHouse/changelog
...
Changelog script
2022-05-11 10:54:29 +02:00
Mikhail f. Shiryaev
d5b1e39bb9
Merge pull request #36866 from ClickHouse/integration-tests
...
Fix using proper image for integration tests; improve logging; fix docker volume cleaning in integration-tests-runner.
2022-05-11 10:46:51 +02:00
Alexey Milovidov
99cc8d47fe
Add PowerPC binary to universal install script
2022-05-11 03:02:01 +02:00
alesapin
0f276a0956
Merge pull request #36947 from ClickHouse/dump_ordered_sessions_map
...
Force keeper snapshot equality on different replicas
2022-05-10 23:36:09 +02:00
Mikhail f. Shiryaev
eb219ac014
Improve logging in integration_test_check.py
2022-05-10 17:41:01 +02:00
alesapin
dcf2a1d245
Turn off gcc-11
2022-05-10 13:24:20 +02:00
Mikhail f. Shiryaev
24b7a7538d
Add kwargs to runner and is_shallow function
2022-05-10 11:25:33 +02:00
wuxiaobai24
d3dca101aa
fix labels check output error
2022-05-08 14:41:03 +08:00
Mikhail f. Shiryaev
ab6c3169ac
Use ENV for API_URL customization
2022-05-06 20:50:44 +02:00
Mikhail f. Shiryaev
b85de7e3e2
Fix installation_id filter, minimize docker images diff
2022-05-06 19:15:01 +02:00
mergify[bot]
89c36a4eca
Merge branch 'master' into add-more-s3-tests
2022-05-06 11:57:50 +00:00
Mikhail f. Shiryaev
5b70f7f0dc
Fail performance comparison tests on errors
2022-05-04 13:02:46 +02:00
Alexey Milovidov
ff4e562997
Merge pull request #36641 from ClickHouse/release-prefetch
...
Simplify check_branch, prefetch target branches
2022-05-01 13:53:35 +03:00
mergify[bot]
ed2c4ecc43
Merge branch 'master' into add-more-s3-tests
2022-04-29 19:41:06 +00:00
Mikhail f. Shiryaev
5c8c5415df
Adjust docs_check to use in foreign repo
2022-04-29 15:23:24 +02:00
Mikhail f. Shiryaev
0a131b41ea
Improve release.py
...
- Improve check-dirty
- Prefetch target branches
- Prefetch release commit
- Simplify check_branch
2022-04-28 16:55:02 +02:00
Mikhail f. Shiryaev
824335ca33
Filter out sychronized events globbaly
2022-04-25 14:45:11 +02:00
Mikhail f. Shiryaev
83c02e8014
Fix version autodetection for docker_server.py
2022-04-22 16:51:29 +02:00
Mikhail f. Shiryaev
2dfdbe0afa
Update contributors each release
2022-04-21 20:10:12 +02:00
Mikhail f. Shiryaev
c65c832edb
Adjust git_helper and version_helper for shallow clone
2022-04-21 20:08:55 +02:00
Mikhail f. Shiryaev
9abd28ebc9
Prepare update_contributors for release.py step
2022-04-21 20:08:54 +02:00
Mikhail f. Shiryaev
fc5107623f
Checkout shallow repository for builds
2022-04-21 20:08:52 +02:00
Mikhail f. Shiryaev
139811b6f1
Consistent "force tests" label
2022-04-21 16:37:51 +02:00
Alexey Milovidov
dd93d5d872
Merge pull request #36422 from ClickHouse/check-revert-prs
...
Check revert prs
2022-04-21 02:25:34 +03:00
Mikhail f. Shiryaev
1e9d80a9c2
Merge pull request #36297 from ClickHouse/docs-staging
...
Docs staging
2022-04-20 10:47:54 +02:00
Mikhail f. Shiryaev
462a28a2e6
Remove innecessary requirement
2022-04-20 10:24:12 +02:00
Mikhail f. Shiryaev
8e2874328f
Prepare docs_check.py to be used in docs-clickhouse
2022-04-19 23:35:39 +02:00
Mikhail f. Shiryaev
da55ba6af2
Check Revert PRs and mark it as pr-not-for-changelog
2022-04-19 14:48:58 +02:00
Mikhail f. Shiryaev
44269d06b5
Improve some variables
2022-04-19 14:47:18 +02:00
mergify[bot]
b5058f9770
Merge branch 'master' into add-more-s3-tests
2022-04-19 10:11:08 +00:00
Mikhail f. Shiryaev
40dafbe015
Don't put built documentation to output path
2022-04-19 10:43:12 +02:00
Mikhail f. Shiryaev
c1014aa60c
Use a new builder as a check image
2022-04-19 10:43:11 +02:00
Mikhail f. Shiryaev
e96ba17c30
Fallback to a default event data when API is broken
2022-04-19 09:45:40 +02:00
Alexey Milovidov
73b52859df
Merge branch 'master' into llvm-14
2022-04-16 00:46:58 +02:00
Mikhail f. Shiryaev
401efa5fd4
Improve docker building and logging for approve lambda
2022-04-15 01:28:14 +02:00
Mikhail f. Shiryaev
e689322980
Improve logic to decide cancelling workflow
2022-04-15 01:28:13 +02:00
Mikhail f. Shiryaev
fad0aeb0d3
Fix some linter issues
2022-04-15 01:28:13 +02:00
Mikhail f. Shiryaev
646fd45645
Request unfiltered workflows in threads
2022-04-15 01:28:12 +02:00
Mikhail f. Shiryaev
3e6dc24a7b
Do not fail the whole lambda if one page failed
2022-04-15 01:28:12 +02:00
Mikhail f. Shiryaev
52a7544aa4
Fix cancel-lambda for closed PRs
...
- Create a fallback function for some edge cases
- Process synchronized PRs as help for cancel-workflow action
2022-04-15 01:28:12 +02:00
Mikhail f. Shiryaev
323cf6c5bf
Merge TRUSTED_CONTRIBUTORS in lambda and import in check
2022-04-14 13:25:54 +02:00
alesapin
df5453874a
Merge pull request #36214 from ClickHouse/tavplubix-patch-4
...
Make stateless tests with s3 always green
2022-04-14 12:04:15 +02:00
Tyler Hannan
d2a7c4541e
whitespace
2022-04-14 00:36:38 +02:00
Tyler Hannan
4cce325941
Add Tyler Hannan to contributors
2022-04-14 00:25:14 +02:00
tavplubix
01a1babd3b
Update ci_config.py
2022-04-13 23:56:34 +03:00
mergify[bot]
75a16d3801
Merge branch 'master' into add-more-s3-tests
2022-04-13 12:30:47 +00:00
Mikhail f. Shiryaev
693711544c
Use a proper image in fasttest
2022-04-13 14:06:50 +02:00
kssenii
6f3373b37e
Mark as always green
2022-04-13 12:04:31 +02:00
mergify[bot]
02445f1f44
Merge branch 'master' into add-more-s3-tests
2022-04-12 16:52:39 +00:00
alesapin
34b920adb0
Merge pull request #36159 from ClickHouse/cancel-lambda
...
Fix a logical error left after debugging
2022-04-12 11:33:13 +02:00
Mikhail f. Shiryaev
30a9fce67a
Rebuild the least docker layer
2022-04-12 11:01:25 +02:00
Mikhail f. Shiryaev
abf8c3c5ad
Fix and improve cancel-rerun lambda
...
- Fix rerun for DocsCheck
- Additional check for workflow head sha1
- Fix workflow debug info
- Fix event_data parsing
- Always print debug info
2022-04-12 11:00:01 +02:00
Mikhail f. Shiryaev
280a2d847c
Merge pull request #36139 from ClickHouse/fasttest-ccache
...
Upload ccache for the first run in PR
2022-04-12 08:37:21 +02:00
Mikhail f. Shiryaev
faa26b4377
Improve report and variables naming
2022-04-11 20:05:43 +02:00
Mikhail f. Shiryaev
11897d56b9
Upload ccache for the first run in PR
2022-04-11 17:03:46 +02:00
Mikhail f. Shiryaev
9a946c0213
Add typing
2022-04-11 15:35:13 +02:00
Alexey Milovidov
836fd2dd87
Merge pull request #36080 from nvartolomei/nv/trusted-tonickkozlov
...
Add tonickkozlov to trusted users for auto ci run
2022-04-09 02:55:50 +03:00
Mikhail f. Shiryaev
a09fcdac1f
Do not fail on a poisoned ccache
2022-04-09 00:41:39 +02:00
Mikhail f. Shiryaev
cb962b8ad5
Stop rewriting BUILD_NAME env in build_check.py
2022-04-08 22:34:58 +02:00
Mikhail f. Shiryaev
f506b6c1a3
Fix linter issues and missed formatting
2022-04-08 19:50:41 +02:00
Nicolae Vartolomei
081de5b086
Add tonickkozlov to trusted users for auto ci run
...
Cloudflare employee contributing to ClickHouse
2022-04-08 15:21:36 +00:00
Mikhail f. Shiryaev
44c80a388f
Merge pull request #36064 from ClickHouse/fix-rerun-lambda
...
Add debug and fix cancel_rerun lambda
2022-04-08 13:33:37 +02:00
Mikhail f. Shiryaev
90a863bbc2
Merge pull request #36029 from ClickHouse/fix-release-workflow
...
Fix release workflow
2022-04-08 13:09:01 +02:00
vdimir
1322fab333
Fix style in run_check.py
2022-04-08 12:51:58 +02:00
Mikhail f. Shiryaev
811178da54
Add debug and fix cancel_rerun lambda
2022-04-08 12:28:25 +02:00
Vladimir C
608f4c3b70
Merge pull request #35991 from vdimir/run-check-debug-labels
2022-04-08 12:00:37 +02:00
Mikhail f. Shiryaev
a5b1a0620c
Add default IMAGES_PATH value
2022-04-07 18:35:59 +02:00
Mikhail f. Shiryaev
dd4bd4abba
Simplify and fix coverity
2022-04-07 18:35:58 +02:00
Mikhail f. Shiryaev
44895e5287
Improve build cache for docker images
...
- Save all layer's cache
- Use cache with fallback to a latest tags
2022-04-07 17:16:43 +02:00
mergify[bot]
a9c6e82814
Merge branch 'master' into add-more-s3-tests
2022-04-07 14:40:58 +00:00
Mikhail f. Shiryaev
a7145cf087
Move version_arg to version_helper, add tests
2022-04-07 13:48:52 +02:00
Mikhail f. Shiryaev
58d381de5c
A temporary fix for artifactory push before multiple architectures
2022-04-07 12:48:54 +02:00
Mikhail f. Shiryaev
eb62b18845
Improve and fix edge cases for docker_server.py
...
- Allow define version as file
- Add inline cache
- Fix auto_release_type function
2022-04-07 12:48:53 +02:00
Mikhail f. Shiryaev
846e4b94fb
Tiny improvements to git and version helpers
2022-04-07 12:48:51 +02:00
Mikhail f. Shiryaev
2d87e3587d
Merge pull request #34895 from DevTeamBK/coverity_scan
...
Attempt at Nightly Coverity Scan and upload
2022-04-06 19:07:00 +02:00
Mikhail f. Shiryaev
12442fd0a5
Add description for missing builds
2022-04-06 15:16:16 +02:00
Mikhail f. Shiryaev
1323c3617f
Fix linter points
2022-04-06 15:16:16 +02:00
Mikhail f. Shiryaev
19e0e6e765
Fix failing BuilderReport
2022-04-06 15:16:15 +02:00
kssenii
cb622fbef2
Merge master
2022-04-06 12:20:33 +02:00
vdimir
670fad56fc
Print labels to log in run_check.py
2022-04-06 11:57:11 +02:00
Mikhail f. Shiryaev
62fa528e7d
Fix syntax error in build_check.py
2022-04-06 10:15:36 +02:00
Boris Kuschel
2298b80ed8
Add coverity scan
...
Signed-off-by: Boris Kuschel <Boris.Kuschel@ibm.com>
2022-04-05 19:52:33 +02:00
Mikhail f. Shiryaev
a665861f5f
Improve descriptrion check logging
2022-04-05 01:06:46 +02:00
Mikhail f. Shiryaev
1d60824d6a
Highlight headers in PR template
2022-04-05 00:59:44 +02:00
Mikhail f. Shiryaev
6b83e2b2a7
Fix automatic bucket prefix for master
2022-04-01 17:53:43 +02:00
Mikhail f. Shiryaev
98aa8bf579
Improve version_helper.py
...
- Add helper functions
- Add __lt__ and __eq__ to compare versions between each other
2022-04-01 12:32:26 +02:00
Mikhail f. Shiryaev
66851b28b7
Make _check_tag public
2022-04-01 12:32:25 +02:00
Mikhail f. Shiryaev
00a3734078
Cosmetic improvement
2022-04-01 12:32:24 +02:00
Mikhail f. Shiryaev
9aab7e9910
Create a script to build and push server images
2022-04-01 12:32:23 +02:00
Mikhail f. Shiryaev
3e7c46075a
Clean out dead code from version_helper
2022-04-01 11:59:49 +02:00
Mikhail f. Shiryaev
93cfc4d590
Add validate_version function to version_helper.py
2022-04-01 11:59:48 +02:00
Mikhail f. Shiryaev
5212ff0146
Improve docker_images_check logging
2022-04-01 11:59:48 +02:00
Mikhail f. Shiryaev
90be03c750
Rework env_helper to return correct paths
2022-04-01 11:59:47 +02:00
Alexey Milovidov
93edf05259
Merge branch 'master' into llvm-14
2022-04-01 04:49:03 +03:00
Mikhail f. Shiryaev
4ba7cf6d1b
Fix latest_error referenced before assignment
2022-03-31 15:40:32 +02:00
alesapin
02574bd05b
Merge pull request #35766 from ClickHouse/resurrect_official_flag
...
Resurrect build hash
2022-03-30 19:34:19 +02:00
alesapin
b388bb8448
Merge pull request #35718 from ClickHouse/fail_build_check_in_error_status
...
Fail CI checks in case of errors in checks (not failed tests)
2022-03-30 19:28:22 +02:00
