Commit Graph

81 Commits

Author SHA1 Message Date
Alexey Milovidov
0d29df0fba
Update prepare-ci-ami.sh 2024-06-28 16:56:34 +02:00
Max Kainov
0fe0bc8c8d AMI image with gh and jwt 2024-06-27 19:34:41 +00:00
Azat Khuzhin
64a308013f Tune mmap_rnd_bits to workaround sanitizers issues
v1: vm.mmap_rnd_bits=28
v2: rebase with clang 18.1.6 + kernel.randomize_va_space=0
v3: leave only vm.mmap_rnd_bits=28 + use pre-run.sh (hope that it will
    be used), that way docker will not require --privileged and by some
    reason this breaks ASAN (though I cannot reproduce it)
v4: use actions/common_setup over init_runner.sh (it requires some
    manual deploy)
2024-05-19 22:37:16 +02:00
Gabriel Martinez
bbbc721508
chore(ci-workers): remove reusable from tailscale key 2024-05-16 22:22:30 +01:00
Mikhail f. Shiryaev
baffd31423
Fix typos 2024-05-13 14:21:15 +02:00
Mikhail f. Shiryaev
dab1e5002e
Upgrade the runner version to the latest 2024-05-13 14:21:14 +02:00
Mikhail f. Shiryaev
599c512e0b
Patch runner helpers and check the exit code for attempts 2024-05-13 14:21:13 +02:00
Mikhail f. Shiryaev
cbf02f69d5
Add a fallback for autoupdate if GH actions runner fails to start 2024-05-13 14:21:13 +02:00
Mikhail f. Shiryaev
ee49e237da
Clean github runner's temporary _work derectory between runs 2024-05-13 14:21:12 +02:00
Mikhail f. Shiryaev
b74ce036fa
Make init-network.sh sourceable, tune runner's tailscale hostname 2024-05-13 14:21:11 +02:00
Max Kainov
98c1cc7747 new gh runner version 2.315.0 2024-04-09 17:09:04 +00:00
Mikhail f. Shiryaev
03b9bca8a4
Terminate EC2 on spot event if runner isn't running 2024-03-14 14:31:55 +01:00
Mikhail f. Shiryaev
ff353823b6
Update the GH actions runner version 2024-02-23 17:18:53 +01:00
Mikhail f. Shiryaev
758acd4268
Setup tailscale on instances, create a common network script 2024-02-23 17:18:52 +01:00
Mikhail f. Shiryaev
a768f40adc
Add tailscale installation to the AMI preparation 2024-02-22 14:58:51 +01:00
Mikhail f. Shiryaev
9307a87118
Tune network memory for dockerhub proxy hosts 2023-12-11 12:56:52 +01:00
Mikhail f. Shiryaev
f02ed02e4a
Terminate spot instances older than 1h 2023-11-16 16:35:34 +01:00
Mikhail f. Shiryaev
7c758d1b2d
Define the INIT_ENVIRONMENT through instances tags 2023-11-16 15:53:34 +01:00
Mikhail f. Shiryaev
8fbc0d3d51
Disable autoupdate for GH runners to speed-up boot 2023-11-14 15:48:01 +01:00
Mikhail f. Shiryaev
556e0faad2
Make sleep in init_runner loop global 2023-11-14 15:48:00 +01:00
Mikhail f. Shiryaev
b4cc55ea34
Deploy cloud-init script to S3 for following usage 2023-11-14 15:48:00 +01:00
Mikhail f. Shiryaev
5f9704a3c1
Kill forgotten Runner.Listener too 2023-11-14 15:47:59 +01:00
Mikhail f. Shiryaev
e77c9fbd53
Add TOE in the comment, find and fix possible issues for the second run 2023-11-14 15:47:59 +01:00
Mikhail f. Shiryaev
0c0f70d26d
Add the installing of azure cli 2023-11-14 15:47:58 +01:00
Mikhail f. Shiryaev
094eebde4f
Update the runner version 2023-11-14 15:47:57 +01:00
Mikhail f. Shiryaev
b382705c2d
Use diff object again, since JSON API limits the files 2023-10-17 17:49:06 +02:00
Max Kainov
fc9a5a725c Revert "Revert "Integration check script fix ups""
This reverts commit 67b9407530.
2023-10-17 08:18:17 +00:00
alesapin
67b9407530
Revert "Integration check script fix ups" 2023-10-16 22:01:44 +02:00
Max Kainov
4d1edc2780 return back unidiff module 2023-10-16 15:00:13 +00:00
Max Kainov
f1c316b79b ci script to use git hub api urls, readme for test 2023-10-16 10:35:13 +00:00
Mikhail f. Shiryaev
a117997d5b
Show the runner type in the job logs 2023-07-21 18:32:31 +02:00
Mikhail f. Shiryaev
da37f32d4b
Attempt to delete the runner before shutting down 2023-07-21 18:32:30 +02:00
Mikhail f. Shiryaev
538d1f7c17
Kill the runner process with all subprocesses 2023-07-21 18:32:28 +02:00
Mikhail f. Shiryaev
1a8571c465
Check and proceed spot termination on runner setup 2023-06-19 15:40:32 +02:00
Mikhail f. Shiryaev
4d5160a3ba
Improve determination of job received 2023-06-19 15:40:32 +02:00
Mikhail f. Shiryaev
d8e3d5c803
Kill the instance proactively on spot termination 2023-06-19 15:40:30 +02:00
Mikhail f. Shiryaev
d672bd3382
Stop the runner if there are no running jobs for long 2023-06-19 15:40:30 +02:00
Mikhail f. Shiryaev
915f431b95
Tune the shutting down on rebalance signal 2023-06-19 15:40:28 +02:00
Mikhail f. Shiryaev
1688ba5cf5
Use ephemeral runners for GH actions 2023-06-19 15:40:25 +02:00
Mikhail f. Shiryaev
47ea742076
Do not kill runner on the fly, delay 3 seconds 2023-06-19 15:40:25 +02:00
Mikhail f. Shiryaev
6cecdb8fca
Shutdown runner process and do not restart it on termination 2023-06-19 15:40:24 +02:00
Mikhail f. Shiryaev
197d0d1314
Process lifecycle hook in post-running action hook 2023-06-19 15:40:24 +02:00
Mikhail f. Shiryaev
d45092d63b
Process the rebalance recomendation event on post-run 2023-06-19 15:40:23 +02:00
Mikhail f. Shiryaev
6a5ae6558a
Add comment for usage of prepare-ci-ami.sh 2023-06-01 12:58:03 +02:00
Mikhail f. Shiryaev
653da5f002
Reduce the unzip verbosity 2023-05-31 18:23:21 +02:00
Mikhail f. Shiryaev
a96a845e23
Add comment to prepare-ci-ami.sh, add a success at the end 2023-05-31 17:12:49 +02:00
Mikhail f. Shiryaev
db3a050911
Seems like buildx needs explicit install since some time 2023-05-31 00:22:12 +02:00
Mikhail f. Shiryaev
bcd57078ce
Update the runner version 2023-05-30 16:36:54 +02:00
Nikolai Kochetov
47cd46f590
Update tests/ci/worker/ubuntu_ami_for_ci.sh
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2023-03-02 18:19:19 +01:00
Nikolai Kochetov
e435748473
Update ubuntu_ami_for_ci.sh 2023-03-02 18:13:30 +01:00