Mikhail f. Shiryaev
9bd0a53e7c
Get only online instances in get_lost_ec2_instances
2023-06-02 12:27:29 +02:00
Mikhail f. Shiryaev
3c13eaa159
Simplify get_dead_runners_in_ec2 a little bit, update runners
2023-06-02 12:27:28 +02:00
Mikhail f. Shiryaev
b775b5cfd6
Move all CI runners metrics into one namespace
2023-06-02 12:27:27 +02:00
Mikhail f. Shiryaev
e657e2ba10
Additional logging in autoscale_runners_lambda
2023-06-02 12:27:26 +02:00
Mikhail f. Shiryaev
b7c5fdab77
Move lambda package building to public.ecr.aws/lambda/python for compatibility
2023-06-02 12:27:26 +02:00
Mikhail f. Shiryaev
0ddd53088d
Add a new runner type for ci metrics and autoscaling
2023-06-02 12:27:24 +02:00
Mikhail f. Shiryaev
e8b03d7498
Move insert part for ClickHouseHelper to shared
2023-06-01 21:03:57 +02:00
Mikhail f. Shiryaev
2dca0eac1b
Delete __init__.py in lambda directories to break subpackage
2023-06-01 21:03:56 +02:00
Mikhail f. Shiryaev
acb9531ebf
Unify and put GH access token to the lambda_shared
2023-06-01 21:03:56 +02:00
Mikhail f. Shiryaev
0fa6a84161
Move the stuff related to runners to lambda_shared
2023-06-01 21:03:55 +02:00
Mikhail f. Shiryaev
7f08f218d9
Create lambda_shared package for lambdas
2023-06-01 21:03:53 +02:00
Mikhail f. Shiryaev
484c91c47e
Add DRY_RUN and configurable PY_VERSION to lambda deployment
2023-06-01 21:03:53 +02:00
Mikhail f. Shiryaev
27941b4d26
Decrease the time window for autoscale_runners_lambda
2023-06-01 21:03:52 +02:00
Mikhail f. Shiryaev
db02938411
Do not count unfinished tasks with conclusion=None
2023-06-01 21:03:51 +02:00
Mikhail f. Shiryaev
855afb56f9
Get instances for the region to not kill a fresh one
2023-06-01 21:03:50 +02:00
Mikhail f. Shiryaev
bf9b563e0b
Improve caching mechanism for token, add cached instances
2023-06-01 21:03:50 +02:00
Mikhail f. Shiryaev
7bf9089dcd
Increase access_token cached time
2023-06-01 21:03:49 +02:00
Mikhail f. Shiryaev
985cd8fc8a
Improve events logging
2023-06-01 21:03:48 +02:00
Nikita Taranov
e5c21e588a
Update app.py ( #50407 )
2023-06-01 15:19:47 +02:00
Mikhail f. Shiryaev
9089360688
Merge pull request #50415 from ClickHouse/build-report-pending
...
Mark the builds without results as pending
2023-06-01 14:53:09 +02:00
Mikhail f. Shiryaev
de7179876e
Merge pull request #47151 from ClickHouse/increase-vm-max_map_count
...
Update ubuntu_ami_for_ci.sh
2023-06-01 13:54:21 +02:00
Mikhail f. Shiryaev
6a5ae6558a
Add comment for usage of prepare-ci-ami.sh
2023-06-01 12:58:03 +02:00
Mikhail f. Shiryaev
bcbce15cde
Mark the builds without results as pending
2023-06-01 08:51:44 +02:00
Mikhail f. Shiryaev
653da5f002
Reduce the unzip verbosity
2023-05-31 18:23:21 +02:00
Mikhail f. Shiryaev
a96a845e23
Add comment to prepare-ci-ami.sh, add a success at the end
2023-05-31 17:12:49 +02:00
pufit
08d3887832
Add re-creation for cherry-pick PRs ( #50373 )
...
* Add recreation for cherry-pick PRs.
Small PR comment fix.
* Automatic style fix
---------
Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2023-05-31 13:04:29 +02:00
Mikhail f. Shiryaev
db3a050911
Seems like buildx needs explicit install since some time
2023-05-31 00:22:12 +02:00
Mikhail f. Shiryaev
56dc35d563
Merge branch 'master' into increase-vm-max_map_count
2023-05-30 19:24:18 +02:00
Mikhail f. Shiryaev
bcd57078ce
Update the runner version
2023-05-30 16:36:54 +02:00
pufit
4ce722854b
Fix URL in backport comment
2023-05-25 11:51:47 -04:00
Mikhail f. Shiryaev
a9d5b68946
Merge pull request #50197 from ClickHouse/fix-codebrowser
...
Fix codebrowser by using clang-15 image
2023-05-24 23:39:13 +02:00
Mikhail f. Shiryaev
e117347ca0
Attempt to fix codebrowser with using clang-15
2023-05-24 23:15:38 +02:00
Alexander Tokmakov
2c0c1ba4af
add comments to build reports ( #50200 )
2023-05-24 23:29:36 +03:00
pufit
8875b98e2a
Added default value for --from-repo
arg
2023-05-24 13:47:50 -04:00
pufit
8df7a69147
Automatic backports of important fixes to cloud-release
...
* Automatic backports to cloud-release
---------
Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2023-05-24 18:59:18 +02:00
Timur Solodovnikov
c7ab59302f
Set allow_experimental_query_cache setting as obsolete ( #49934 )
...
* set allow_experimental_query_cache as obsolete
* add tsolodov to trusted contributors
* CI linter
---------
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2023-05-17 20:03:42 +02:00
Mikhail f. Shiryaev
4b7aa30017
The best effor to get the current job ID and URL
...
This partially addresses https://github.com/actions/runner/issues/2577
2023-05-12 19:22:52 +02:00
Mikhail f. Shiryaev
c375f948d0
Fix typing in S3Helper.fast_parallel_upload_dir
2023-05-12 19:22:52 +02:00
Mikhail f. Shiryaev
338435a52d
Additional check for FATAL in logs, do not exit with code 1 on errors
2023-05-12 19:22:51 +02:00
Mikhail f. Shiryaev
0f70ad56a9
Do not upload failed site to the S3
2023-05-12 19:22:50 +02:00
Mikhail f. Shiryaev
eb122487ad
Add logs to the report, do not chown unnecessary
2023-05-12 19:22:48 +02:00
Mikhail f. Shiryaev
6a56662f60
Improve codebrowser check
...
- Add sccache
- Report a proper status in report and exit code
- Launch it as a current user
- Fix report link
2023-05-12 19:22:48 +02:00
Mikhail f. Shiryaev
fba7120d3d
Fix s3_helper logging and pool setup
2023-05-12 19:22:44 +02:00
Robert Schulze
b9c185af44
Merge pull request #49678 from azat/build/llvm-16
...
Switch to LLVM/clang 16 (16.0.3)
2023-05-12 13:47:36 +02:00
Mikhail f. Shiryaev
8a664e2cac
Upgrade all lambdas runtime to 3.10, fix requirements
...
The recent update of urllib3 completely broken the world
- https://github.com/urllib3/urllib3/issues/2168
- https://github.com/boto/botocore/issues/2926
- https://github.com/psf/requests/issues/6443
2023-05-11 16:09:59 +02:00
Mikhail f. Shiryaev
d890114c5e
Print debugging information in workflow_jobs_lambda
2023-05-11 14:21:07 +02:00
Mikhail f. Shiryaev
d605f82798
Replace old release with new packages in suspicious patterns
2023-05-10 12:36:04 +02:00
Mikhail f. Shiryaev
f6372dd3fc
Do not launch PRs w/o "can be tested"
2023-05-10 12:14:44 +02:00
Azat Khuzhin
c37fe64040
Merge remote-tracking branch 'u/master' into build/llvm-16
2023-05-08 22:33:52 +02:00
Alexey Milovidov
54163b87ec
Merge pull request #47977 from ClickHouse/rs/non-experimental-qc
...
Mark query cache as non-experimental
2023-05-06 19:49:23 +03:00