Commit Graph

20 Commits

Author SHA1 Message Date
Max K
f5ba4ef9b3
Tune autoscale to scale for single job in the queue (#57742)
* tune setting desired capacity

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2023-12-11 13:07:56 +01:00
Max K
a12c685015
Update tests/ci/autoscale_runners_lambda/test_autoscale.py
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2023-12-08 10:40:16 +01:00
robot-clickhouse
33fd370c94 Automatic style fix 2023-12-06 19:18:26 +00:00
Max Kainov
e2daad2065 tune scale up/down multipliers 2023-12-06 18:55:57 +00:00
Mikhail f. Shiryaev
4df3a7cc8b
Make autoscaling more responsive 2023-11-07 17:49:22 +01:00
Mikhail f. Shiryaev
4fe3d10604
Unify all workflows for python unit tests, follow naming best practices 2023-11-06 11:14:57 +01:00
Mikhail f. Shiryaev
23d843d379
Experiment with decreasing scale_up for style-checkers 2023-06-20 15:17:33 +02:00
Mikhail f. Shiryaev
026ab3d4ce
Calculate current capacity according to HealthStatus 2023-06-19 15:40:27 +02:00
Mikhail f. Shiryaev
e657e2ba10
Additional logging in autoscale_runners_lambda 2023-06-02 12:27:26 +02:00
Mikhail f. Shiryaev
0ddd53088d
Add a new runner type for ci metrics and autoscaling 2023-06-02 12:27:24 +02:00
Mikhail f. Shiryaev
7f08f218d9
Create lambda_shared package for lambdas 2023-06-01 21:03:53 +02:00
Mikhail f. Shiryaev
27941b4d26
Decrease the time window for autoscale_runners_lambda 2023-06-01 21:03:52 +02:00
Mikhail f. Shiryaev
8a664e2cac
Upgrade all lambdas runtime to 3.10, fix requirements
The recent update of urllib3 completely broken the world

- https://github.com/urllib3/urllib3/issues/2168
- https://github.com/boto/botocore/issues/2926
- https://github.com/psf/requests/issues/6443
2023-05-11 16:09:59 +02:00
Mikhail f. Shiryaev
2ab313e6b4
Update the style_checker upscale speed 2023-04-25 12:42:06 +02:00
Mikhail f. Shiryaev
15d02f77cf
Decrease scale_down ratio for faster deflation 2023-03-20 21:03:47 +01:00
Mikhail f. Shiryaev
c13638904a
Adjust the aggregation interval 2023-03-06 14:38:54 +01:00
Mikhail f. Shiryaev
602933ce1e
Make smarter scaler based on reserve/deficit 2023-03-03 13:22:05 +01:00
Mikhail f. Shiryaev
a576464360
Reduce statisctics interval, process empty response for runners 2023-03-03 13:20:42 +01:00
Mikhail f. Shiryaev
6a746beff8
Tune style-checker scaling up and down by modifiers 2023-03-03 13:20:41 +01:00
Mikhail f. Shiryaev
e2278ca70c
Add code for autoscaling lambda 2023-03-03 13:20:36 +01:00