thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-04 13:32:13 +00:00
Code Issues Packages Projects Releases Wiki Activity
140,181 Commits 9,179 Branches 1,782 Tags 2.3 GiB
5ea95cbbec
Commit Graph

2468 Commits

Author SHA1 Message Date
Alexey Milovidov
bc1f80dd82 Remove Coverity (part 2) 2023-07-30 10:25:44 +02:00
robot-clickhouse
358773c620 Automatic style fix 2023-07-30 07:45:27 +00:00
Alexey Milovidov
448756d148 Add machine_type information to the CI database 2023-07-30 09:31:21 +02:00
Alexey Milovidov
41ffc09771 Upload build statistics to the CI database 2023-07-30 09:18:06 +02:00
Kruglov Pavel
93e10077ba
Fix attaching gdb in stress tests (#51445) 
* Fix attaching gdb in stress tests

* Fix

* Update run.sh

* Try remove run_with_retry

* Return run_with_retry

* Don't set -e in run_with_retry if it was't set before

* Update tests/ci/utils.lib

* Fix bash

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
 2023-07-26 12:53:19 +03:00
Azat Khuzhin
0b258dda4e Reproducible builds for Rust 
From now on cargo will not download anything from the internet during
builds. This step had been moved for docker image builds (via cargo
vendor).

And now cargo inside docker.io/clickhouse/binary-builder will not use
any crates from the internet, so we don't need to add --offline for
cargo commands in cmake (corrosion_import_crate()).

Also the docker build command had been adjusted to allow following
symlinks inside build context, by using tar, this is required for Rust
packages.

Note, that to make proper Cargo.lock that could be vendored I did the
following:
- per-project locks had been removed (since there is no automatic way to
  sync the workspace Cargo.lock with per-project Cargo.lock, since cargo
  update/generate-lockfile will use only per-project Cargo.toml files
  apparently, -Z minimal-versions does not helps either)
- and to generate Cargo.lock with less changes I've pinned version in
  the Cargo.toml strictly, i.e. not 'foo = "0.1"' but 'foo = "=0.1"'
  then the Cargo.lock for workspace had been generated and afterwards
  I've reverted this part.

Plus I have to update the dependencies afterwards, since otherwise there
are conflicts with dependencies for std library. Non trivial.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-22 22:46:22 +02:00
Alexey Milovidov
c3c8ea9c27 Do something 2023-07-22 17:30:55 +02:00
Mikhail f. Shiryaev
c6e9f621f1 Replace kssenii/nginx-test:1.1 by clickhouse/nginx-dav 2023-07-22 15:45:47 +02:00
Alexey Milovidov
3398355e46 Add something with unclear purpose 2023-07-22 02:04:30 +02:00
Mikhail f. Shiryaev
101214cb8f
Fix broken termination lambda by caching runners for at most 15 seconds 2023-07-21 18:32:32 +02:00
Mikhail f. Shiryaev
083be24a74
Improve logic of checking valid cached values in lambdas 2023-07-21 18:32:31 +02:00
Mikhail f. Shiryaev
a117997d5b
Show the runner type in the job logs 2023-07-21 18:32:31 +02:00
Mikhail f. Shiryaev
da37f32d4b
Attempt to delete the runner before shutting down 2023-07-21 18:32:30 +02:00
Mikhail f. Shiryaev
538d1f7c17
Kill the runner process with all subprocesses 2023-07-21 18:32:28 +02:00
Antonio Andelic
e181e602a7
Update ci_config.py 2023-07-21 12:43:32 +02:00
Alexey Milovidov
f458108c44 Fix style 2023-07-19 22:15:23 +02:00
Alexey Milovidov
29094a22cf Fix Docker 2023-07-19 20:00:00 +02:00
Alexey Milovidov
f7fcf079a4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into sqltest 2023-07-19 19:58:10 +02:00
Mikhail f. Shiryaev
9c4005b33f
Add logging about all found workflows for merge_pr.py 2023-07-19 15:12:58 +02:00
Alexey Milovidov
8e3bd222f0 Add SQLTest 2023-07-19 03:42:32 +02:00
Antonio Andelic
3c2507ad7d
Merge branch 'master' into fix-packager 2023-07-18 09:18:03 +02:00
Alexey Milovidov
20b77e946a There is no point in detecting flaky tests 2023-07-15 23:00:23 +02:00
Dmitry Novik
ee2392bf8e Merge remote-tracking branch 'origin/master' into analyzer-integration-tests 2023-07-11 08:55:31 +00:00
Alexey Milovidov
6cfeef00d7
Merge pull request #31398 from ClickHouse/riscv-in-ci 
Add Linux RISC-V 64 build to CI
 2023-07-06 22:49:16 +03:00
Antonio Andelic
f825c85c72
Merge branch 'master' into fix-packager 2023-07-06 08:36:43 +02:00
Alexey Milovidov
5a3aadacde Fix error 2023-07-05 23:40:37 +02:00
Antonio Andelic
3dc0afd52f Correctly grep archives 2023-07-05 11:19:15 +00:00
Alexey Milovidov
3021180e01 Update 2023-07-04 21:33:12 +02:00
Alexey Milovidov
1eafba60d2 Merge branch 'master' into riscv-in-ci 2023-07-04 21:28:05 +02:00
Antonio Andelic
5b31c714a0
Merge branch 'master' into fix-packager 2023-07-04 15:48:31 +02:00
Alexey Milovidov
aa2b8aa893
Merge pull request #51769 from ClickHouse/mypy-1.4.0 
Version mypy=1.4.1 falsly reports unused ignore comment
 2023-07-04 16:45:57 +03:00
Yatsishin Ilya
5230503651 remove unused type: ignore 2023-07-04 12:59:25 +00:00
Antonio Andelic
6d3dbae8aa Merge remote-tracking branch 'origin/docs-packaging' into fix-packager 2023-07-04 11:21:53 +00:00
Alexey Milovidov
463c2ba5ce
Revert "Add documentation for building in docker" 2023-07-04 14:07:10 +03:00
Mikhail f. Shiryaev
c715ee5cef
Replace --build-type=debug by --debug-build 2023-07-03 19:58:47 +02:00
Mikhail f. Shiryaev
469da1831a
Replace --build-type=debug by --debug-build 2023-07-03 17:42:15 +02:00
Antonio Andelic
c06afc53b4 Make scripts backwards compatible 2023-07-02 09:57:06 +00:00
Antonio Andelic
00aeb407e5 Wait with retries 2023-06-30 14:52:21 +00:00
Alexey Milovidov
1e6f6b522c
Merge pull request #51180 from ClickHouse/update-tests-docker 
Update tests' docker containers
 2023-06-30 11:24:59 +03:00
Alexey Milovidov
b6a37fbf18
Merge branch 'master' into many-fixes-2 2023-06-29 22:36:33 +03:00
Mikhail f. Shiryaev
953f1c7885
Upload fast test binaries to builds bucket 2023-06-28 22:19:33 +02:00
Mikhail f. Shiryaev
eeb8cdbc19
Add way to define additional urls in test reports 2023-06-28 22:19:00 +02:00
vdimir
e2241b8c7c
Merge branch 'grace_hash_join_debug_2306' into many-fixes-2 2023-06-28 09:35:20 +00:00
robot-clickhouse
9d8b996f68 Automatic style fix 2023-06-27 04:30:56 +00:00
Alexey Milovidov
b5635887c3 Merge remote-tracking branch 'origin/refactor-subqueries-for-in' into many-fixes 2023-06-27 05:39:44 +02:00
Alexey Milovidov
e0ac127bdd Merge branch 'two-tests-are-longer-with-analyzer' into many-fixes 2023-06-27 05:23:23 +02:00
Alexey Milovidov
d37b1c17f5 Merge branch 'fix-fasttest' into many-fixes 2023-06-27 05:21:43 +02:00
lgbo-ustc
179a7ce202 debug 2023-06-26 20:43:19 +08:00
Mikhail f. Shiryaev
065b87aa30
Improve logging a little bit, avoid double labeling 2023-06-26 13:25:49 +02:00
Mikhail f. Shiryaev
c64f929b9c
Fix broken labeling for manual approve 2023-06-26 13:25:48 +02:00
Alexey Milovidov
b8e6bd3299
Merge branch 'master' into refactor-subqueries-for-in 2023-06-26 06:05:12 +03:00
Alexey Milovidov
4ee74ec213 Two tests are twice longer in average with Analyzer and sometimes failing 2023-06-26 02:19:52 +02:00
Alexey Milovidov
4fd1fc4507 Fix typo 2023-06-25 06:14:31 +02:00
Alexey Milovidov
511b2cdc21 Increase timeout of fast test 2023-06-25 06:10:57 +02:00
Ilya Yatsishin
9a75faad77
Merge pull request #51340 from ClickHouse/qoega-patch-4 2023-06-24 14:22:32 +02:00
Ilya Yatsishin
7e3eaadaac
Make SQLancer check not "always green" 2023-06-23 18:55:04 +02:00
Alexey Milovidov
b6e7f4cf6c Require more checks 2023-06-22 23:24:27 +02:00
Nikolai Kochetov
a940031878 Merge branch 'master' into refactor-subqueries-for-in 2023-06-22 12:18:48 +02:00
Mikhail f. Shiryaev
02776b8a15
Merge pull request #51163 from ClickHouse/fasttest-ignore-chown-fail 
Ignore errors for `chown` in fasttests
 2023-06-22 09:51:57 +02:00
Mikhail f. Shiryaev
1591633d72
Merge pull request #49283 from ClickHouse/runners-survival 
Attempt to increase the general runners' survival rate
 2023-06-22 00:16:11 +02:00
Mikhail f. Shiryaev
118c3af4d6
Ignore errors for chown in fasttests 2023-06-21 12:59:21 +02:00
Robert Schulze
bc7df2baca
Merge branch 'master' into non-experimental-qpl-deflate 2023-06-20 20:06:01 +02:00
Mikhail f. Shiryaev
23d843d379
Experiment with decreasing scale_up for style-checkers 2023-06-20 15:17:33 +02:00
Mikhail f. Shiryaev
1a8571c465
Check and proceed spot termination on runner setup 2023-06-19 15:40:32 +02:00
Mikhail f. Shiryaev
4d5160a3ba
Improve determination of job received 2023-06-19 15:40:32 +02:00
Mikhail f. Shiryaev
d782b05845
Continue LCH for terminated instances, add logging 2023-06-19 15:40:31 +02:00
Mikhail f. Shiryaev
d8e3d5c803
Kill the instance proactively on spot termination 2023-06-19 15:40:30 +02:00
Mikhail f. Shiryaev
d672bd3382
Stop the runner if there are no running jobs for long 2023-06-19 15:40:30 +02:00
Mikhail f. Shiryaev
915f431b95
Tune the shutting down on rebalance signal 2023-06-19 15:40:28 +02:00
Mikhail f. Shiryaev
026ab3d4ce
Calculate current capacity according to HealthStatus 2023-06-19 15:40:27 +02:00
Mikhail f. Shiryaev
8feb5146fc
Do not "update" the token and the instances infinitely 2023-06-19 15:40:27 +02:00
Mikhail f. Shiryaev
a5e31e98de
Decouple cleaning part from metrics lambda to a new one 2023-06-19 15:40:26 +02:00
Mikhail f. Shiryaev
1688ba5cf5
Use ephemeral runners for GH actions 2023-06-19 15:40:25 +02:00
Mikhail f. Shiryaev
47ea742076
Do not kill runner on the fly, delay 3 seconds 2023-06-19 15:40:25 +02:00
Mikhail f. Shiryaev
6cecdb8fca
Shutdown runner process and do not restart it on termination 2023-06-19 15:40:24 +02:00
Mikhail f. Shiryaev
197d0d1314
Process lifecycle hook in post-running action hook 2023-06-19 15:40:24 +02:00
Mikhail f. Shiryaev
d45092d63b
Process the rebalance recomendation event on post-run 2023-06-19 15:40:23 +02:00
Mikhail f. Shiryaev
ee5ca7337e
Add reset to Stopwatch, improve codebrowser report 2023-06-16 12:51:31 +02:00
Dmitry Novik
49f88f5873 Fix ENV variable name 2023-06-15 14:15:01 +00:00
Mikhail f. Shiryaev
eb2a5c31a3
Do not mock git_helper.Git, suppress git describe error for ignore_no_tags 2023-06-15 15:35:03 +02:00
Mikhail f. Shiryaev
2ac95ccfce
Adjust version_helper test cases to proper tags 2023-06-15 14:48:10 +02:00
Mikhail f. Shiryaev
07203a4542
Fix a versions' tweak for tagged commits, improve version_helper 2023-06-15 14:48:09 +02:00
robot-clickhouse
1230519bec Automatic style fix 2023-06-14 13:38:44 +00:00
Dmitry Novik
fe8172fbd9 Review fixes 2023-06-14 13:17:04 +00:00
Dmitry Novik
afcc3aca36 Update ci_config.py 2023-06-14 13:14:59 +00:00
Dmitry Novik
1207085dec
Merge branch 'master' into analyzer-integration-tests 2023-06-13 17:09:29 +02:00
Nikita Mikhaylov
52a460df67
Tests with parallel replicas are no more "always green" (#50896) 2023-06-13 16:43:35 +02:00
Alexander Tokmakov
5368fa72ca
Merge pull request #50487 from Avogar/add-gdb-to-stateless-tests 
Attach gdb in stateless tests
 2023-06-13 17:04:17 +03:00
Dmitry Novik
9e8ca5f5ae Add integration test check with enabled analyzer 2023-06-13 13:09:39 +00:00
Robert Schulze
8222861f2e
Merge remote-tracking branch 'rschu1ze/master' into non-experimental-qpl-deflate 2023-06-11 14:39:30 +00:00
Nikolai Kochetov
6ce8329bda Merge branch 'master' into refactor-subqueries-for-in 2023-06-09 20:04:27 +02:00
Nikolai Kochetov
a878312fdf
Merge pull request #50693 from ClickHouse/vdimir/disable_grace_hash_stress 
Disable grace_hash join in stress tests
 2023-06-09 17:57:34 +02:00
Robert Schulze
1aa158909e
enable_qpl_deflate_codec --> enable_deflate_qpl_codec 2023-06-09 12:43:33 +00:00
jinjunzh
f1192d59af
refine patch according to comments 2023-06-09 12:43:15 +00:00
jinjunzh
31173ab55b
add sections of deflate_qpl for stress test and performance test 2023-06-09 12:43:08 +00:00
Mikhail f. Shiryaev
2aaaec2abe
Catch issues with dockerd during the build 2023-06-08 14:01:41 +02:00
vdimir
2297995c1a
Disable grace_hash join in stress tests 
Until https://github.com/ClickHouse/ClickHouse/issues/50220 is fixed
 2023-06-08 07:15:11 +00:00
Antonio Andelic
26fb80b540
Merge pull request #50615 from ClickHouse/fix-jepsen-check 
Fix Jepsen runs in PRs
 2023-06-07 08:43:51 +02:00
Sema Checherinda
990652119e
Merge pull request #50361 from nickitat/fail_perf_on_too_many_slow 
Fail perf tests when too many queries slowed down
 2023-06-06 11:33:04 +02:00
Antonio Andelic
0bc31a7288 Fix jepsen runs in PRs 2023-06-06 07:17:30 +00:00
robot-clickhouse-ci-1
4cf5a13e5b
Merge pull request #50160 from ClickHouse/prio-runners 
Refactor lambdas, prepare to prio runners
 2023-06-06 07:29:28 +02:00
avogar
e8c6c7967b Move attaching gdb to separate lib 2023-06-05 18:21:40 +00:00
Nikita Taranov
e548dce123 fix 2023-06-03 00:08:47 +02:00
Nikita Taranov
4506299d73 impl 2023-06-02 23:14:09 +02:00
pufit
0d98a46326 Fix KeyError in cherry-pick 2023-06-02 13:02:18 -04:00
Mikhail f. Shiryaev
9bd0a53e7c
Get only online instances in get_lost_ec2_instances 2023-06-02 12:27:29 +02:00
Mikhail f. Shiryaev
3c13eaa159
Simplify get_dead_runners_in_ec2 a little bit, update runners 2023-06-02 12:27:28 +02:00
Mikhail f. Shiryaev
b775b5cfd6
Move all CI runners metrics into one namespace 2023-06-02 12:27:27 +02:00
Mikhail f. Shiryaev
e657e2ba10
Additional logging in autoscale_runners_lambda 2023-06-02 12:27:26 +02:00
Mikhail f. Shiryaev
b7c5fdab77
Move lambda package building to public.ecr.aws/lambda/python for compatibility 2023-06-02 12:27:26 +02:00
Mikhail f. Shiryaev
0ddd53088d
Add a new runner type for ci metrics and autoscaling 2023-06-02 12:27:24 +02:00
Mikhail f. Shiryaev
e8b03d7498
Move insert part for ClickHouseHelper to shared 2023-06-01 21:03:57 +02:00
Mikhail f. Shiryaev
2dca0eac1b
Delete __init__.py in lambda directories to break subpackage 2023-06-01 21:03:56 +02:00
Mikhail f. Shiryaev
acb9531ebf
Unify and put GH access token to the lambda_shared 2023-06-01 21:03:56 +02:00
Mikhail f. Shiryaev
0fa6a84161
Move the stuff related to runners to lambda_shared 2023-06-01 21:03:55 +02:00
Mikhail f. Shiryaev
7f08f218d9
Create lambda_shared package for lambdas 2023-06-01 21:03:53 +02:00
Mikhail f. Shiryaev
484c91c47e
Add DRY_RUN and configurable PY_VERSION to lambda deployment 2023-06-01 21:03:53 +02:00
Mikhail f. Shiryaev
27941b4d26
Decrease the time window for autoscale_runners_lambda 2023-06-01 21:03:52 +02:00
Mikhail f. Shiryaev
db02938411
Do not count unfinished tasks with conclusion=None 2023-06-01 21:03:51 +02:00
Mikhail f. Shiryaev
855afb56f9
Get instances for the region to not kill a fresh one 2023-06-01 21:03:50 +02:00
Mikhail f. Shiryaev
bf9b563e0b
Improve caching mechanism for token, add cached instances 2023-06-01 21:03:50 +02:00
Mikhail f. Shiryaev
7bf9089dcd
Increase access_token cached time 2023-06-01 21:03:49 +02:00
Mikhail f. Shiryaev
985cd8fc8a
Improve events logging 2023-06-01 21:03:48 +02:00
Nikita Taranov
e5c21e588a
Update app.py (#50407) 2023-06-01 15:19:47 +02:00
Mikhail f. Shiryaev
9089360688
Merge pull request #50415 from ClickHouse/build-report-pending 
Mark the builds without results as pending
 2023-06-01 14:53:09 +02:00
Mikhail f. Shiryaev
de7179876e
Merge pull request #47151 from ClickHouse/increase-vm-max_map_count 
Update ubuntu_ami_for_ci.sh
 2023-06-01 13:54:21 +02:00
Mikhail f. Shiryaev
6a5ae6558a
Add comment for usage of prepare-ci-ami.sh 2023-06-01 12:58:03 +02:00
Mikhail f. Shiryaev
bcbce15cde
Mark the builds without results as pending 2023-06-01 08:51:44 +02:00
Mikhail f. Shiryaev
653da5f002
Reduce the unzip verbosity 2023-05-31 18:23:21 +02:00
Mikhail f. Shiryaev
a96a845e23
Add comment to prepare-ci-ami.sh, add a success at the end 2023-05-31 17:12:49 +02:00
pufit
08d3887832
Add re-creation for cherry-pick PRs (#50373) 
* Add recreation for cherry-pick PRs.
Small PR comment fix.

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2023-05-31 13:04:29 +02:00
Mikhail f. Shiryaev
db3a050911
Seems like buildx needs explicit install since some time 2023-05-31 00:22:12 +02:00
Mikhail f. Shiryaev
56dc35d563
Merge branch 'master' into increase-vm-max_map_count 2023-05-30 19:24:18 +02:00
Mikhail f. Shiryaev
bcd57078ce
Update the runner version 2023-05-30 16:36:54 +02:00
Nikolai Kochetov
b5b261b22c Merge branch 'master' into refactor-subqueries-for-in 2023-05-25 21:22:06 +02:00
pufit
4ce722854b Fix URL in backport comment 2023-05-25 11:51:47 -04:00
Mikhail f. Shiryaev
a9d5b68946
Merge pull request #50197 from ClickHouse/fix-codebrowser 
Fix codebrowser by using clang-15 image
 2023-05-24 23:39:13 +02:00
Mikhail f. Shiryaev
e117347ca0
Attempt to fix codebrowser with using clang-15 2023-05-24 23:15:38 +02:00
Alexander Tokmakov
2c0c1ba4af
add comments to build reports (#50200) 2023-05-24 23:29:36 +03:00
pufit
8875b98e2a Added default value for --from-repo arg 2023-05-24 13:47:50 -04:00
pufit
8df7a69147
Automatic backports of important fixes to cloud-release 
* Automatic backports to cloud-release

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
 2023-05-24 18:59:18 +02:00
Nikolai Kochetov
ff6400f91a Merge branch 'master' into refactor-subqueries-for-in 2023-05-22 13:07:51 +02:00
Timur Solodovnikov
c7ab59302f
Set allow_experimental_query_cache setting as obsolete (#49934) 
* set allow_experimental_query_cache as obsolete

* add tsolodov to trusted contributors

* CI linter

---------

Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2023-05-17 20:03:42 +02:00
Mikhail f. Shiryaev
4b7aa30017
The best effor to get the current job ID and URL 
This partially addresses https://github.com/actions/runner/issues/2577
 2023-05-12 19:22:52 +02:00
Mikhail f. Shiryaev
c375f948d0
Fix typing in S3Helper.fast_parallel_upload_dir 2023-05-12 19:22:52 +02:00
Mikhail f. Shiryaev
338435a52d
Additional check for FATAL in logs, do not exit with code 1 on errors 2023-05-12 19:22:51 +02:00
Mikhail f. Shiryaev
0f70ad56a9
Do not upload failed site to the S3 2023-05-12 19:22:50 +02:00
Mikhail f. Shiryaev
eb122487ad
Add logs to the report, do not chown unnecessary 2023-05-12 19:22:48 +02:00
Mikhail f. Shiryaev
6a56662f60
Improve codebrowser check 
- Add sccache
- Report a proper status in report and exit code
- Launch it as a current user
- Fix report link
 2023-05-12 19:22:48 +02:00
Mikhail f. Shiryaev
fba7120d3d
Fix s3_helper logging and pool setup 2023-05-12 19:22:44 +02:00
Robert Schulze
b9c185af44
Merge pull request #49678 from azat/build/llvm-16 
Switch to LLVM/clang 16 (16.0.3)
 2023-05-12 13:47:36 +02:00
Mikhail f. Shiryaev
8a664e2cac
Upgrade all lambdas runtime to 3.10, fix requirements 
The recent update of urllib3 completely broken the world

- https://github.com/urllib3/urllib3/issues/2168
- https://github.com/boto/botocore/issues/2926
- https://github.com/psf/requests/issues/6443
 2023-05-11 16:09:59 +02:00
Mikhail f. Shiryaev
d890114c5e
Print debugging information in workflow_jobs_lambda 2023-05-11 14:21:07 +02:00
Mikhail f. Shiryaev
d605f82798
Replace old release with new packages in suspicious patterns 2023-05-10 12:36:04 +02:00
Mikhail f. Shiryaev
f6372dd3fc
Do not launch PRs w/o "can be tested" 2023-05-10 12:14:44 +02:00
Azat Khuzhin
c37fe64040 Merge remote-tracking branch 'u/master' into build/llvm-16 2023-05-08 22:33:52 +02:00
Nikolai Kochetov
fc02e9efc9 update fasttest a bit 2023-05-08 17:23:46 +00:00
Alexey Milovidov
54163b87ec
Merge pull request #47977 from ClickHouse/rs/non-experimental-qc 
Mark query cache as non-experimental
 2023-05-06 19:49:23 +03:00
Robert Schulze
0598bfd79e
Mark query cache as non-experimental 2023-05-06 13:58:40 +00:00
Dmitry Novik
a3b3b78eb0 EXPECTED_TO_FAIL -> NOT_FAILED 2023-05-05 17:53:15 +00:00
Dmitry Novik
02520e9358 Make EXPRECTED_TO_FAIL red 2023-05-05 17:37:52 +00:00
Mikhail f. Shiryaev
90fe9dd1f2
Skip mergeable check only on a proper description 2023-05-03 22:38:34 +02:00
Mikhail f. Shiryaev
a67950d138
Check the PRs body directly in lambda, without rerun 2023-05-03 22:38:33 +02:00
Mikhail f. Shiryaev
242a210358
Create "CI running" report always 2023-05-02 14:13:23 +02:00
Mikhail f. Shiryaev
08d203e158
Sanitize "Flaky tests", remove trailing dots 2023-05-02 12:42:26 +02:00
Mikhail f. Shiryaev
b423e04ab0
Fix the global ROBOT_TOKEN, do not retry unnecessary 2023-05-02 12:37:05 +02:00
Mikhail f. Shiryaev
ca19f20aff
Do not fail the run on error updating status comment 2023-05-02 12:34:40 +02:00
Alexey Milovidov
dd7282ea5c
Update ci_config.py 2023-05-01 16:05:14 +03:00
Mikhail f. Shiryaev
b385b51f07
Merge pull request #49314 from ClickHouse/fallback-auth-gh-api 
Fallback auth gh api
 2023-04-29 09:36:49 +02:00
Mikhail f. Shiryaev
d336bee056
Fix the Logs header for case when only log_urls is set 2023-04-28 23:52:35 +02:00
Mikhail f. Shiryaev
886ba0b01d
Replace markdown with pure HTML for check descriptions 2023-04-28 23:52:34 +02:00
Mikhail f. Shiryaev
20c8f0f1b4
Use only one comment for all statuses in the PR 2023-04-28 23:52:34 +02:00
Mikhail f. Shiryaev
61c6c61638
Rework the status comment to be a digest with the full report available 
by link
 2023-04-28 23:52:33 +02:00
Mikhail f. Shiryaev
e8cf417350
Use NotSet in post_commit_status for optional arguments 2023-04-28 23:52:33 +02:00
Mikhail f. Shiryaev
c66e50f283
Remove options from S3Helper, they are global 2023-04-28 23:52:32 +02:00
Mikhail f. Shiryaev
f411be8c37
Rename Run Check to CI running 2023-04-28 23:52:31 +02:00
Mikhail f. Shiryaev
df33b99907
Rework post_commit_status, add set_status_comment there 2023-04-28 23:52:31 +02:00
Mikhail f. Shiryaev
d58abd3c37
Add a function get_repo with global state 2023-04-28 23:52:30 +02:00
Mikhail f. Shiryaev
4405459925
Refactor RerunHelper to reduce API calls 2023-04-28 23:52:30 +02:00
Mikhail f. Shiryaev
19fd5f9c3c
Add descriptions for the status comment 2023-04-28 23:52:29 +02:00
Mikhail f. Shiryaev
eb11fb02fa
Clean up ast_fuzzer_check.py 2023-04-28 23:52:29 +02:00
Mikhail f. Shiryaev
ccd4fd7e64
Use commit_status_helper.post_commit_status everywhere 2023-04-28 23:52:28 +02:00
Mikhail f. Shiryaev
144ebd3d36
Implement main() in run_check.py 2023-04-28 23:52:27 +02:00
Mikhail f. Shiryaev
e670c51680
Unify commit.create_status and post_commit_status 2023-04-28 23:52:26 +02:00
Mikhail f. Shiryaev
01e70c64c2
Add a fallback to authenticated requests to GH API 2023-04-28 18:46:33 +02:00
Mikhail f. Shiryaev
8c60b60916
Receive the best robot token only once 2023-04-28 16:01:53 +02:00
Mikhail f. Shiryaev
9a7f09bae4
Avoid splitting check_name into subdirectories 2023-04-26 01:11:05 +02:00
Mikhail f. Shiryaev
a6664e6b08
Add typing, capitalize only the first letter w/o lowering the rest 2023-04-26 00:55:05 +02:00
Mikhail f. Shiryaev
ed8ca018bd
Add a note regarding private/public repo to logs 2023-04-25 19:11:20 +02:00
alesapin
084f76ab3e
Merge pull request #49133 from ClickHouse/unanonymized-workflow-jobs-logs 
Improve some lambdas
 2023-04-25 12:58:18 +02:00
Mikhail f. Shiryaev
2ab313e6b4
Update the style_checker upscale speed 2023-04-25 12:42:06 +02:00
Mikhail f. Shiryaev
6032bacd0f
Get unanonymized logs in workflow_jobs_lambda 2023-04-25 12:37:26 +02:00
Dmitry Novik
0d3e896f57
Merge pull request #48719 from ClickHouse/analyzer-ci 
Add CI run with new analyzer enabled
 2023-04-24 17:36:18 +02:00
Mikhail f. Shiryaev
222176639d
Update pr_info.labels in commit_helper lebel helpers 2023-04-24 11:03:25 +02:00
Mikhail f. Shiryaev
caee710fcc
Enforce documentation change for a new-feature PR 2023-04-24 10:41:38 +02:00
Dmitry Novik
1fdee1a2ab
Merge branch 'master' into analyzer-ci 2023-04-21 15:43:16 +02:00
Alexey Milovidov
2dbe4f80f2 Do not allow incomplete changelog entries 2023-04-21 12:59:47 +02:00
Alexey Milovidov
95e69b6f85 Do not allow incomplete changelog entries 2023-04-21 12:59:17 +02:00
Mikhail f. Shiryaev
c28e8438e3
Fail Fast tests on next run if previous running has failed 2023-04-20 14:51:53 +02:00
Dmitry Novik
b2ed99f6b3
Merge branch 'master' into analyzer-ci 2023-04-18 13:07:45 +02:00
Dmitry Novik
5557f4524c Fix string formatting 2023-04-18 08:44:46 +00:00
robot-clickhouse
f6127a68ac Automatic style fix 2023-04-18 00:56:29 +00:00
Dmitry Novik
6197d3d55f Pass volume only for analyzer 2023-04-18 00:12:30 +00:00
Dmitry Novik
61e552d660 Fix used build 2023-04-17 15:23:02 +00:00
Sema Checherinda
0354a964cd turn on all CI back 2023-04-17 14:07:56 +02:00
Sema Checherinda
c3b9d5fe6e introduce sqllogic runner 2023-04-16 13:57:24 +02:00
Dmitry Novik
b04a4ec287 Fix used image 2023-04-14 15:25:06 +02:00
Ilya Yatsishin
d2351df69e
Update tests/ci/functional_test_check.py 2023-04-14 15:13:10 +02:00
Dmitry Novik
3df33d74f5 Get rid of another docker image 2023-04-13 17:22:12 +02:00
Aleksei Filatov
0a1815b9bb
Add new trusted contributors (#48715) 
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2023-04-12 19:38:05 +02:00
Dmitry Novik
360fc59694 Handle known broken tests 2023-04-12 16:46:30 +00:00
Dmitry Novik
f8e4d6bb41 Add CI run with new analyzer enabled 2023-04-12 15:18:28 +00:00
Mikhail f. Shiryaev
cdceac6624
Reduce number of return statements 2023-04-11 16:10:52 +02:00
Mikhail f. Shiryaev
c29aa0cd49
Fail the build on a wrong changelog category 2023-04-11 15:34:33 +02:00
Mikhail f. Shiryaev
57a1919594
Partially revert e0252db8d and fix pr-bugfix labeling 2023-04-11 12:40:04 +02:00
Alexander Tokmakov
48b23dd012
Fix race between DROP MatView and RESTART REPLICAS (#47863) 
* fix race between drop mv and restart replicas

* unrelated: fix bad exception messages

* fix test

* fix

* fix

* fix

* fix

* fix test

* fix

* fix test

* Update 02437_drop_mv_restart_replicas.sh

* fix tests
 2023-04-01 15:26:00 +03:00
Mikhail f. Shiryaev
7ff582b963
Deprecate ENABLE_CCACHE and replace it by COMPILER_CACHE 2023-03-29 23:33:31 +02:00
Mikhail f. Shiryaev
79177e1988
Enable sccache in fasttests 2023-03-29 23:33:29 +02:00
Mikhail f. Shiryaev
fcc14ae724
Enable s3 caching 2023-03-29 23:33:27 +02:00
Alexey Milovidov
e0252db8d4 No prestable 2023-03-27 12:19:32 +02:00
robot-clickhouse
6ac86ed3e0
Merge pull request #47945 from ClickHouse/artifacts-s3-prefix 
Artifacts s3 prefix
 2023-03-26 00:15:50 +01:00
Mikhail f. Shiryaev
290ee6bbf1
Merge pull request #47790 from CurtizJ/apply-black-to-all-files 
Apply black formatter to all python scripts
 2023-03-24 14:20:50 +03:00
Mikhail f. Shiryaev
4f2c336cfc
Update black version, run it for the repository 2023-03-24 11:54:38 +01:00
Mikhail f. Shiryaev
c4870ad7bc
Move PRs artifacts to the PRs prefix in S3 2023-03-24 08:54:06 +01:00
Mikhail f. Shiryaev
8ff01429e1
Upload build reports to S3_TEST_REPORTS_BUCKET 2023-03-23 15:49:59 +01:00
Robert Schulze
b3b097286f
Merge branch 'master' into rs/randomized-qc-settings 2023-03-23 13:33:38 +01:00
robot-clickhouse
d690e0f4ec Automatic style fix 2023-03-22 12:55:24 +00:00
Robert Schulze
ea2d7e0035
Decouple QC enablement from 'join_use_nulls' 2023-03-22 12:46:22 +00:00
Robert Schulze
b019ed90be
Randomize query cache settings in stress tests 2023-03-22 11:11:03 +00:00
Mikhail f. Shiryaev
6409ca9fc9
Merge pull request #47857 from ClickHouse/cherry-pick-ping 
Comment stale cherry-pick PRs once a day to remind for resolving conflicts
 2023-03-22 13:36:35 +03:00
Mikhail f. Shiryaev
d88f71f2b9
Comment stale cherry-pick PRs to resolve conflicts 2023-03-21 18:28:29 +01:00
robot-ch-test-poll2
5e763ccad1
Merge pull request #47822 from ClickHouse/merge-pr-logging 
Place short return before big block, improve logging
 2023-03-21 13:10:57 +01:00
Mikhail f. Shiryaev
b9dca4e0df
Place short return before big block, improve logging 2023-03-21 11:29:16 +01:00
Mikhail f. Shiryaev
15d02f77cf
Decrease scale_down ratio for faster deflation 2023-03-20 21:03:47 +01:00
Mikhail f. Shiryaev
5eacb6b3be
Fix the keeping the latest review instead of the first 2023-03-20 18:40:39 +01:00
Mikhail f. Shiryaev
f881da249f
Only valid Reviews.STATES overwrite existing reviews 2023-03-20 18:39:58 +01:00
Mikhail f. Shiryaev
e39e0294de
Merge pull request #47760 from ClickHouse/backports-fuse 
Add a fuse for backport branches w/o a created PR
 2023-03-20 17:48:07 +03:00
Mikhail f. Shiryaev
ae88a31100
Add a fuse for backport branches w/o a created PR 2023-03-20 13:45:23 +01:00
Mikhail f. Shiryaev
a3096a4583
Clarify steps for reopened cherry-pick PRs 2023-03-20 12:36:35 +01:00
Alexey Milovidov
89a76c2d77 Use LLVM 16 2023-03-18 23:45:57 +01:00
Alexander Tokmakov
6724bfdf38
Disable grace hash join in upgrade check (#47474) 
* Update stress.py

* Update stress.py

* Update stress.py
 2023-03-11 19:06:07 +03:00
Alexander Tokmakov
bb8f0cb3ab
Update stress.py 2023-03-10 18:09:32 +03:00
Alexander Tokmakov
d95b69ca76
Update stress.py 2023-03-10 17:22:09 +03:00
Alexander Tokmakov
3c5cb817d7
Update stress.py 2023-03-10 17:04:38 +03:00
robot-clickhouse
ce3ab32d89 Automatic style fix 2023-03-10 13:53:47 +00:00
Alexander Tokmakov
e3d71f4f1b suppress hung check with ubsan 2023-03-10 14:36:05 +01:00
Pradeep Chhetri
433c226b1f
Revert "Revert "Add join_algorithm='grace_hash' to stress tests"" (#47372) 2023-03-09 13:51:45 +01:00
Mikhail f. Shiryaev
0eebe1ce57
Merge pull request #47107 from ClickHouse/autoscaling-lambda 
Add code for autoscaling lambda
 2023-03-08 13:51:42 +01:00
Robert Schulze
924caee673
Merge pull request #47063 from ClickHouse/rs/binary-compat-check-for-arm 
CI: Add binary compatibility check on ARM
 2023-03-07 11:20:14 +01:00
Mikhail f. Shiryaev
c13638904a
Adjust the aggregation interval 2023-03-06 14:38:54 +01:00
Mikhail f. Shiryaev
602933ce1e
Make smarter scaler based on reserve/deficit 2023-03-03 13:22:05 +01:00
Mikhail f. Shiryaev
a576464360
Reduce statisctics interval, process empty response for runners 2023-03-03 13:20:42 +01:00
Mikhail f. Shiryaev
6a746beff8
Tune style-checker scaling up and down by modifiers 2023-03-03 13:20:41 +01:00
Mikhail f. Shiryaev
a5869e25f6
Add tests for autoscale_runners_lambda 2023-03-03 13:20:39 +01:00
Mikhail f. Shiryaev
0483de0e04
Reorder status in default.workflow_jobs 2023-03-03 13:20:39 +01:00
Mikhail f. Shiryaev
e2278ca70c
Add code for autoscaling lambda 2023-03-03 13:20:36 +01:00
Robert Schulze
380e076e84
x86 --> amd64 2023-03-03 11:20:07 +00:00
robot-clickhouse
6eb2877e53 Automatic style fix 2023-03-02 20:54:45 +00:00
Mikhail f. Shiryaev
845e67af3e
Merge pull request #47064 from ClickHouse/termination-lambda 
Terminate long-running offline non-busy runners in EC2
 2023-03-02 21:50:49 +01:00
Robert Schulze
93861e04ae
Fix fix fix 2023-03-02 20:48:25 +00:00
Robert Schulze
a0a40fb057
nam --> name 2023-03-02 17:51:43 +00:00
Nikolai Kochetov
47cd46f590
Update tests/ci/worker/ubuntu_ami_for_ci.sh 
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
 2023-03-02 18:19:19 +01:00
Nikolai Kochetov
e435748473
Update ubuntu_ami_for_ci.sh 2023-03-02 18:13:30 +01:00
Robert Schulze
8491325b8d
Merge branch 'master' into rs/binary-compat-check-for-arm 2023-03-02 15:08:55 +01:00
robot-clickhouse
33cafc6e89 Automatic style fix 2023-03-02 11:22:32 +00:00
Robert Schulze
5ddc9a9eed
Add binary compatibility check for Aarch64 2023-03-02 11:08:08 +00:00
Mikhail f. Shiryaev
ad50c418da
Update typing for a new PyGithub version 2023-03-02 11:49:36 +01:00
Mikhail f. Shiryaev
036eaad919
Reduce lambda time by caching access_token 2023-03-02 01:40:30 +01:00
Mikhail f. Shiryaev
0a3a60b7a1
Additionally search for inactive runners in the whole ASG 2023-03-02 01:40:28 +01:00
Mikhail f. Shiryaev
9f6b154ccf
Insignificant improvement 2023-03-01 20:51:23 +01:00
Alexander Tokmakov
bb5b17fd09 make stacktraces in hung check more readable 2023-03-01 17:34:43 +01:00
Mikhail f. Shiryaev
43dbd7bc25
Terminate long-running offline non-busy runners in EC2 2023-03-01 12:37:34 +01:00
Kruglov Pavel
a87ebae3c1
Merge pull request #44879 from ClickHouse/split-bc-check 
Split stress test and backward compatibility check
 2023-02-28 14:47:52 +01:00
alesapin
c5e46b09be
Merge pull request #46977 from ClickHouse/cherry-pick-body 
Change the cherry-pick PR body
 2023-02-28 12:29:18 +01:00
Konstantin Bogdanov
3444059649
Add thevar1able to trusted contributors (#46998) 
* Add thevar1able to trusted contributors

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
 2023-02-28 00:42:52 +01:00
avogar
cc02de69d2 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-27 19:49:33 +00:00
Mikhail f. Shiryaev
135961acb7
Change the cherry-pick PR body 2023-02-27 17:59:19 +01:00
avogar
014a9c7961 Fix lib file 2023-02-27 13:25:28 +00:00
Mikhail f. Shiryaev
5b6e581c1a
Preset description on the tweak reset 2023-02-27 14:20:34 +01:00
avogar
3411c33fdf Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-27 13:12:35 +00:00
Mikhail f. Shiryaev
cb460c6903
Fix missing format_description 2023-02-27 13:11:17 +01:00
Alexey Milovidov
3f55782d5f
Merge pull request #46781 from ClickHouse/lazy-mergeable 
Reduce updates of Mergeable Check
 2023-02-27 09:14:33 +03:00
Alexey Milovidov
093eba5dfc
Merge pull request #46736 from ClickHouse/pending-on-rerun 
Mark failed build reports as pending on reruns
 2023-02-25 00:39:44 +03:00
Kruglov Pavel
c2a4ec11bf
Merge branch 'master' into split-bc-check 2023-02-24 19:45:39 +01:00
avogar
e52a995e46 Fix style 2023-02-24 16:58:36 +00:00
avogar
8c6cf28c01 Make better 2023-02-24 16:43:28 +00:00
avogar
6b7d3bf07b Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-24 13:52:22 +00:00
Mikhail f. Shiryaev
6fa16b7828
Add check that major is not issued in the middle of a year 2023-02-24 12:36:47 +01:00
Mikhail f. Shiryaev
ad7ec74009
Make autogenerated version independent from tweak by default 2023-02-24 12:36:46 +01:00
Mikhail f. Shiryaev
900fe7ec9a
Reduce returns for update_mergeable_check 2023-02-23 16:06:29 +01:00
Mikhail f. Shiryaev
19bea6a9e8
Add more cases when we don't need Mergeable Check 2023-02-23 15:57:10 +01:00
Mikhail f. Shiryaev
067e656ff3
Reuse code, do not update Mergeable Check unnecessary 2023-02-23 15:25:29 +01:00
Mikhail f. Shiryaev
0ab9d6787e
Add format_description for commit status descriptions 2023-02-23 15:21:19 +01:00
Mikhail f. Shiryaev
f2b1654a44
Add overwriting failed reports as pending on rerun 2023-02-23 10:38:22 +01:00
Mikhail f. Shiryaev
e290ceec52
Reorder imports 2023-02-23 10:38:21 +01:00
Mikhail f. Shiryaev
33a2e2b3d8
Set default per_page=100 for GitHub 2023-02-23 10:38:09 +01:00
Mikhail f. Shiryaev
904e6ae769
On out-of-space at returns error, we must terminate still 2023-02-23 00:45:51 +01:00
Alexey Milovidov
4adbcd4beb
Merge pull request #46665 from ClickHouse/clean-docs-release 
Get rid of legacy DocsReleaseChecks
 2023-02-22 00:31:17 +03:00
Mikhail f. Shiryaev
cd2ab02f22
Get rid of legacy DocsReleaseChecks 2023-02-21 17:34:16 +01:00
Mikhail f. Shiryaev
9c7fc29778
Add dedicated key for checking launching release.py from master 2023-02-20 11:16:08 +01:00
Mikhail f. Shiryaev
d39cffb3f2
Add rollback commands for the case of broad error 2023-02-20 11:16:07 +01:00
flynn
7bc153221e fix style 2023-02-17 14:36:11 +00:00
Anton Popov
5bcea2e8f5
Add myrrc to trusted contributors 2023-02-17 13:19:45 +01:00
Mikhail f. Shiryaev
b349cda25c
Fix the downloading of the recent ccache archives 2023-02-16 18:26:06 +01:00
Mikhail f. Shiryaev
cb5e5b27f2
Merge pull request #46450 from ClickHouse/dont-fetch-submodules 
Do not fetch submodules in release.py
 2023-02-16 14:00:38 +01:00
Mikhail f. Shiryaev
346c3e3c49
Preserve logs for failed installation tests, retry 3 times 2023-02-15 22:51:43 +01:00
Mikhail f. Shiryaev
9dba4e7cc9
Replace format with f-strings 2023-02-15 22:51:42 +01:00
Mikhail f. Shiryaev
f39d9b09b0
Preserve clickhouse binary to not redownload it 2023-02-15 22:51:41 +01:00
Mikhail f. Shiryaev
3bcd049d18
Improve download filter, group keeper mntr command 2023-02-15 22:51:41 +01:00
Mikhail f. Shiryaev
0c5648a5a6
Use OK and FAIL for tests status 2023-02-15 22:51:39 +01:00
Mikhail f. Shiryaev
fecadfab3e
Do not fetch submodules in release.py 2023-02-15 16:05:07 +01:00
Vladimir C
726fb4bebc
Merge pull request #46368 from ClickHouse/vdimir/bugfix-validate-fix 2023-02-14 14:54:07 +01:00
vdimir
19b5d21e8b
Minor fix in files locating for Bugfix validate check 2023-02-14 12:31:10 +01:00
robot-ch-test-poll3
f654174362
Merge pull request #46246 from ClickHouse/optimize-binary-builder 
Optimize docker binary-builder
 2023-02-14 10:06:15 +01:00
Mikhail f. Shiryaev
92f2e904ee
Merge pull request #45980 from ClickHouse/avoid-backport-contrib 
Improve local running of cherry_pick.py
 2023-02-13 14:16:58 +01:00
Mikhail f. Shiryaev
839dfa8c60
Merge pull request #45823 from ClickHouse/do-not-cancel-created-prs 
Do not cancel created prs
 2023-02-12 16:00:28 +01:00
Mikhail f. Shiryaev
d0f5b6efb5
Use both release_pr and merged_pr as additional cache 2023-02-09 21:31:12 +01:00
Mikhail f. Shiryaev
7c6bb55eca
Use TeePopen to get logs in the main log 2023-02-09 20:36:39 +01:00
Kruglov Pavel
93dfbe6617
Fix mypy style 2023-02-09 15:05:06 +01:00
Kruglov Pavel
5c62afd15e
Fix style 2023-02-09 15:01:32 +01:00
robot-clickhouse
82521bb973 Automatic style fix 2023-02-09 13:33:49 +00:00
avogar
53a3cfc9e0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-09 13:24:19 +00:00
Mikhail f. Shiryaev
3a08d865cc
Add helping logging to auto-merge script 2023-02-06 15:45:22 +01:00
Mikhail f. Shiryaev
030bd314c0
Use new label from the event instead of all PR labels 2023-02-04 01:18:13 +01:00
Mikhail f. Shiryaev
6e58339b4f
Improve readability by "elif"=>"if" 2023-02-04 01:18:11 +01:00
Mikhail f. Shiryaev
cbbef49e9a
Add early exit on freshly opened PR to not process labels 2023-02-04 01:18:09 +01:00
Mikhail f. Shiryaev
4361c666e6
Always update local release branches 2023-02-04 01:07:20 +01:00
Mikhail f. Shiryaev
0e10593037
Do not count changed submodules as needed to stash 2023-02-03 23:17:06 +01:00
Mikhail f. Shiryaev
cd2e1cfada
Merge pull request #45568 from ClickHouse/keeper-systemd 
Add systemd.service for clickhouse-keeper
 2023-02-03 23:08:02 +01:00
Alexander Tokmakov
352ccfb156
Merge branch 'master' into stress_report_add_context2 2023-02-03 18:44:53 +03:00
Nikita Mikhaylov
33877b5e00
Parallel replicas. Part [2] (#43772) 2023-02-03 14:34:18 +01:00
Mikhail f. Shiryaev
dd64c8bacc
Add tests for installation from binary 2023-02-03 12:16:22 +01:00
Mikhail f. Shiryaev
e41a78b67a
Improve local tests 2023-02-03 12:16:21 +01:00
Mikhail f. Shiryaev
a18a4a4502
Use Path in download helper, do not redownload exist files 2023-02-03 12:16:17 +01:00
Mikhail f. Shiryaev
fc48867bed
Get rid of odd entity 2023-02-03 12:16:17 +01:00
Mikhail f. Shiryaev
dc00bce9cf
Add tests for packages' installation 2023-02-03 12:16:16 +01:00
Mikhail f. Shiryaev
a4c2ac7e97
Commit only staged files to backport branches 
Formerly all changed files were committed, and it caused changed
submodules to be committed as well
 2023-02-02 18:18:37 +01:00
Mikhail f. Shiryaev
46ff77654c
Update cherrypick_pr to get mergeable state 2023-02-02 16:13:50 +01:00
robot-clickhouse
892a3ff316 Automatic style fix 2023-02-02 12:40:50 +00:00
Alexander Tokmakov
5e64cda339
Update tests/ci/report.py 
Co-authored-by: Alexander Gololobov <440544+davenger@users.noreply.github.com>
 2023-02-02 15:28:01 +03:00
robot-clickhouse
ddbc8ceee8 Automatic style fix 2023-02-02 00:59:49 +00:00
Alexander Tokmakov
03109f942d better context for stress tests failures 2023-02-02 01:02:12 +01:00
Alexander Tokmakov
472aa12ba3 add some context to stress test failures 2023-02-01 01:25:31 +01:00
Mikhail f. Shiryaev
ac13dc636f
Add dry-run, fix arguments 2023-01-30 23:23:30 +01:00
Mikhail f. Shiryaev
74a36a34ab
Revert "Revert "Add check for running workflows to merge_pr.py"" 2023-01-30 23:17:34 +01:00
Mikhail f. Shiryaev
1d9b917362
Revert "Add check for running workflows to merge_pr.py" 2023-01-30 23:14:29 +01:00
Mikhail f. Shiryaev
652ec7e774
Add check for running workflows to merge_pr.py 2023-01-30 22:47:32 +01:00
Alexey Milovidov
4ae2824e58
Merge pull request #44226 from azat/ci/more-robust 
More robust CI parsers
 2023-01-29 19:44:16 +03:00
alesapin
8d05b1ec4a
Merge pull request #45657 from ClickHouse/improve-release-script 
Improve release script
 2023-01-29 11:46:02 +01:00
Azat Khuzhin
b1b4aaeef6 ci: more robust results parsers 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-29 09:06:03 +01:00
Mikhail f. Shiryaev
4635a62cec
Merge pull request #45476 from ClickHouse/automerge 
Another attempt to fix automerge, or at least to have debug footprint
 2023-01-27 10:06:24 +01:00
Mikhail f. Shiryaev
975b3a2de8
Suppress the stderr of running commands by default 2023-01-26 15:24:38 +01:00
Mikhail f. Shiryaev
cc691c30af
Delete --no-release-branch argument, move creating release to the end 2023-01-26 15:24:37 +01:00
Mikhail f. Shiryaev
398b215556
Make Release._create_tag independent on checked out ref 2023-01-26 15:24:37 +01:00
Mikhail f. Shiryaev
81d419e4a2
Add --dry-run option for release.py 2023-01-26 15:24:36 +01:00
Mikhail f. Shiryaev
1ec9b60c27
Add fail on new minor versions>=13 2023-01-26 15:24:36 +01:00
Mikhail f. Shiryaev
bf3b497d22
Always update version and _git after new checkout 2023-01-26 15:24:35 +01:00
avogar
ced2f69a01 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-01-25 19:47:27 +00:00
Mikhail f. Shiryaev
4615f979d6
Update tests/ci/fast_test_check.py 2023-01-25 00:13:28 +01:00
Dmitry Novik
8545db9f62 Fix report sending in case of FastTest failure 2023-01-24 21:54:23 +00:00
Mikhail f. Shiryaev
23118d9418
Do not prefilter reviews in __init__ 2023-01-24 15:50:55 +01:00
Mikhail f. Shiryaev
b8474fd17f
Merge pull request #45466 from ClickHouse/cherrypick-search 
CherryPick: Fix a wrong staring search date
 2023-01-24 13:20:16 +01:00
Mikhail f. Shiryaev
d32a564ff0
Merge pull request #45421 from ClickHouse/chrm-releases 
Get rid of artifactory in favor of r2 + ch-repos-manager
 2023-01-24 13:17:48 +01:00
Mikhail f. Shiryaev
f092b46025
Improve logging for TeePopen.timeout exceeded 2023-01-23 12:50:49 +01:00
avogar
fd9b735505 Merge with master, add some fixes 2023-01-20 20:22:03 +00:00
avogar
d34c8f8432 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-01-20 19:28:15 +00:00
Mikhail f. Shiryaev
0c253326df
Add unconditional logging for approved_at 2023-01-20 17:30:32 +01:00
Mikhail f. Shiryaev
697c0b1f5b
Add a debug output for cases when approved_at==0 2023-01-20 17:30:32 +01:00
Mikhail f. Shiryaev
914af887f2
Move calculating of approved_at to Reviews.is_approved 2023-01-20 17:30:31 +01:00
Mikhail f. Shiryaev
d4f60bc9da
Fix the case when merge-base does not show the oldest commit 2023-01-20 13:55:21 +01:00
Mikhail f. Shiryaev
9d2677c2e5
Get rid of artifactory in favor of r2 + ch-repos-manager 2023-01-19 09:41:58 +01:00
kssenii
a657bbece7 Merge remote-tracking branch 'upstream/master' into slightly-better-output-for-glibc-check 2023-01-17 12:23:44 +01:00
kssenii
f3c1dc0c85 Slightly better output of glibc check 2023-01-17 12:17:57 +01:00
Mikhail f. Shiryaev
4a07d3682f
Fix wrong approved_at, simplify conditions 2023-01-16 11:36:39 +01:00
Azat Khuzhin
af1308083a tests/ci: encode HTML entities in the reports 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-15 17:03:32 +01:00
Alexey Milovidov
6698f3ccf0
Merge pull request #45008 from ClickHouse/add-dmesg-log-to-fuzzer 
Add `dmesg.log` to Fuzzer
 2023-01-14 14:43:30 +03:00
Alexey Milovidov
e6b3f54842
Merge pull request #41110 from ClickHouse/automerge 
Automatically merge green backport PRs and green approved PRs
 2023-01-13 23:16:35 +03:00
Mikhail f. Shiryaev
9dc9bb2ae6
Mention only approvals from the team members 2023-01-13 12:23:07 +01:00
Alexey Milovidov
ab8c676ea5
Merge pull request #45013 from ClickHouse/download-script-failed 
Supposedly fix the "Download script failed" error
 2023-01-13 05:23:09 +03:00
Alexey Milovidov
dff5e3eafd
Merge branch 'master' into add-dmesg-log-to-fuzzer 2023-01-13 05:22:18 +03:00
Ilya Yatsishin
0be3dbad3c
Merge pull request #44883 from ClickHouse/ci-report-type 
Rework CI reports to have a class and clarify the logic
 2023-01-12 18:20:40 +01:00
Mikhail f. Shiryaev
811f9b1e3a
Reduce the number of API requests by monkey-patching 2023-01-12 12:32:48 +01:00
Alexey Milovidov
d4c0746647
Merge branch 'master' into add-dmesg-log-to-fuzzer 2023-01-12 07:17:03 +03:00
Mikhail f. Shiryaev
e1dc38f0fe
Fix wrong report sorting and changing global BASE_HEADERS 2023-01-11 23:39:00 +01:00
Mikhail f. Shiryaev
2b9c76875b
Consider WIP in a title as blocker for automerge 2023-01-11 20:52:40 +01:00
Mikhail f. Shiryaev
f2cba45f9c
Add a script to merge a PR 2023-01-11 20:52:38 +01:00
Mikhail f. Shiryaev
1f8535ca83
Restart NightlyBuilds if the runner died 2023-01-11 18:49:01 +01:00
Mikhail f. Shiryaev
22c30ca38c
Add typing to get_previous_release_tag.py 2023-01-11 13:31:30 +01:00
Mikhail f. Shiryaev
1dc9fe6f5a
Fix the timeout, remove wrong parameters 2023-01-11 10:45:51 +01:00
Mikhail f. Shiryaev
1420c4b852
Use logging instead of printing 2023-01-11 10:44:59 +01:00
Yatsishin Ilya
a704cf804a fix 2023-01-10 22:17:28 +00:00
Yatsishin Ilya
7cb3e17419 black 2023-01-10 16:17:59 +00:00
Yatsishin Ilya
d945b72d6f Pull SQLancer image before check run 2023-01-10 15:40:31 +00:00
alesapin
dafd1de8c5
Merge pull request #45074 from ClickHouse/improve-release-scripts 
Improve release scripts
 2023-01-10 12:20:21 +01:00
Mikhail f. Shiryaev
98ee463fc1
Change the color of links in dark reports a little bit 2023-01-10 01:03:05 +01:00
Mikhail f. Shiryaev
acdc53a9a7
Allow to use mark_release_ready.py to manually mark commits as ready 2023-01-09 21:58:55 +01:00
Mikhail f. Shiryaev
f2004aee72
Do not attempt to get JOB_ID on wrong RUN_ID 2023-01-09 21:46:33 +01:00
Mikhail f. Shiryaev
5b45360c89
Prefetch tags at the release time 2023-01-09 21:18:35 +01:00
Mikhail f. Shiryaev
1e4fe038f5
Add logs to docker_server reports 2023-01-09 13:21:31 +01:00
Mikhail f. Shiryaev
c38bb5ec00
Add Path as an option for TeePopen log_file 2023-01-09 12:10:30 +01:00
Mikhail f. Shiryaev
425f7459d3
Improve report for docker_server.py 2023-01-09 12:10:30 +01:00
Mikhail f. Shiryaev
fc4d6e41cf
Fix possible issue in process_logs by strict typing 2023-01-09 12:10:29 +01:00
Mikhail f. Shiryaev
36e402b10d
Add typing to create_build_html_report 2023-01-09 12:10:28 +01:00
Mikhail f. Shiryaev
db96f9e3db
Rework test_results list/tuple/whatever into class 2023-01-09 12:09:47 +01:00
Mikhail f. Shiryaev
10aa2207b3
Add typing to stopwatch.py 2023-01-09 12:07:27 +01:00
Alexey Milovidov
93bfe94c86 Merge branch 'break-ci' of github.com:ClickHouse/ClickHouse into break-ci 2023-01-09 04:34:42 +01:00
Alexey Milovidov
e8d661b511 Merge branch 'master' into break-ci 2023-01-09 04:34:10 +01:00
robot-clickhouse
9a5fbcacfd Automatic style fix 2023-01-09 01:08:38 +00:00
Alexey Milovidov
03ae644ea3 Fix performance test 2023-01-09 01:58:42 +01:00
robot-clickhouse
3c9720fac7 Automatic style fix 2023-01-08 07:59:31 +01:00
Alexey Milovidov
4694dad87c Break CI 2023-01-08 07:59:31 +01:00
Alexey Milovidov
851e4ae59f Fix typos 2023-01-08 07:08:20 +01:00
Alexey Milovidov
0772a28dbd
Merge pull request #44961 from ClickHouse/hipster-html 
Hipster's HTML
 2023-01-08 04:44:37 +03:00
Alexey Milovidov
bf57564ec5 Merge branch 'master' into add-dmesg-log-to-fuzzer 2023-01-08 02:26:09 +01:00
Alexey Milovidov
22741ce7ca Fix Python 2023-01-07 23:23:20 +01:00
Alexey Milovidov
484af24d48 Remove the remainings of Testflows (2). 2023-01-07 21:40:13 +01:00
Alexey Milovidov
e62127c3d5 Opt-out 2023-01-07 03:40:18 +01:00
Alexey Milovidov
8ca1740c37
Update get_previous_release_tag.py 2023-01-07 04:48:42 +03:00
Alexey Milovidov
bb71ec7f0e Supposedly fix the "Download script failed" error 2023-01-07 02:47:32 +01:00
Alexey Milovidov
3211f63911 Add dmesg.log to Fuzzer 2023-01-07 01:18:35 +01:00
Alexey Milovidov
a708d24e9a
Update report.py 2023-01-06 06:56:27 +03:00
Alexey Milovidov
5ac019a6d3
Avoid flickering on scroll 2023-01-06 06:53:55 +03:00
Alexey Milovidov
d784c6d201
Update report.py 2023-01-06 06:28:51 +03:00
Alexey Milovidov
c6071f247a Hipster's HTML 2023-01-06 04:19:10 +01:00
Mikhail f. Shiryaev
fb1e7fcd7c
Merge pull request #44520 from ClickHouse/lambda-workflow-jobs 
Add the lambda to collect data for workflow_jobs
 2023-01-05 18:02:23 +01:00
Yatsishin Ilya
1b03a60e43 Do not report status if we failed to pull images. 2023-01-05 13:53:45 +00:00
Kruglov Pavel
c69fe38f62
Merge branch 'master' into split-bc-check 2023-01-04 15:17:02 +01:00
Kruglov Pavel
ac66dcfbe4
Merge pull request #44867 from ClickHouse/fail-performance-on-report-error 
Fix non-detected Errors in performance tests message
 2023-01-04 14:27:37 +01:00
Ilya Yatsishin
5794ebaa4e
Merge pull request #44871 from ClickHouse/upload-bugfix-statuses 
Upload status files to S3 report for bugfix check
 2023-01-04 12:52:42 +01:00
Robert Schulze
58694ff091
Fix "AttributeError: 'BuildResult' object has no attribute 'libraries'" in BuilderSpecialReport 2023-01-04 09:37:56 +00:00
avogar
467d06e89d Merge branch 'split-bc-check' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-01-03 20:13:44 +00:00
avogar
9fb8b42d37 Fix style 2023-01-03 20:13:12 +00:00
robot-clickhouse
c7366f7906 Automatic style fix 2023-01-03 19:32:11 +00:00
avogar
64df6ca520 Split stress test and backward compatibility check 2023-01-03 19:22:31 +00:00
Robert Schulze
0330276a02
The "libraries" field is no longer needed 2023-01-03 19:07:29 +00:00
Robert Schulze
cfb6feffde
What happens if I remove these 139 lines of code? 2023-01-03 18:35:31 +00:00
Mikhail f. Shiryaev
41cdf42276
Upload status files to S3 report for bugfix check 2023-01-03 16:31:14 +01:00
Mikhail f. Shiryaev
795a677aaa
Fix non-detected Errors in performance tests message 2023-01-03 15:26:02 +01:00
Alexey Milovidov
ca117d5b94
Merge branch 'master' into remove-two-lines-of-code 2023-01-02 22:15:36 +03:00
Mikhail f. Shiryaev
ec79257bb6
Add a tiny but important logging 
The first commit in 2023
 2023-01-02 13:27:17 +01:00
Alexey Milovidov
47ae8c5c79 Remove more lines 2023-01-02 02:06:11 +01:00
robot-clickhouse
dcfe1487ce Automatic style fix 2022-12-31 13:51:42 +00:00
Alexey Milovidov
78ed8a6d69 GitHub is unreliable; copy-paste code from Stackoverflow to solve it 2022-12-31 14:45:44 +01:00
Alexey Milovidov
d4a35f7682 Fix typo in stress test 2022-12-31 14:31:40 +01:00
Alexey Milovidov
79ae191611 A few improvements to AST Fuzzer 2022-12-29 18:55:28 +01:00
Pradeep Chhetri
d36f2d7ad9 Fix minor typo: replace validate_bugix_check with validate_bugfix_check 
Signed-off-by: Pradeep Chhetri <pradeepchhetri4444@gmail.com>
 2022-12-28 20:53:32 +08:00
Alexey Milovidov
2892d447d4
Merge pull request #44626 from ClickHouse/alexey-milovidov-patch-5 
Sometimes spot instances fail more than 20 times in a row
 2022-12-27 23:20:05 +03:00
Mikhail f. Shiryaev
93af1f3f7c
Restart failing workflows up to 30 times 2022-12-27 14:50:37 +01:00
Mikhail f. Shiryaev
d6ebb5fca8
Merge pull request #44399 from ClickHouse/checkout-action 
Implement a custom central checkout action
 2022-12-27 14:15:22 +01:00
Alexey Milovidov
43376af340
Merge branch 'master' into alexey-milovidov-patch-5 2022-12-27 15:14:37 +03:00
Alexey Milovidov
05c27f4e15
Merge pull request #44603 from ClickHouse/runlog 
Rename `runlog.log` to `run.log` in tests
 2022-12-27 15:14:05 +03:00
Alexey Milovidov
cb0a91d865
Sometimes spot instances fail more than 20 times in a row 2022-12-27 15:05:11 +03:00
Alexey Milovidov
6ba360be71 Rename runlog.log to run.log 2022-12-26 16:29:32 +01:00
alesapin
bb77ad8941 Disable BC check 2022-12-25 13:49:01 +01:00
Mikhail f. Shiryaev
e9829b0d46
Change the scheme to have rows ordered by updated_at 2022-12-23 12:05:05 +01:00
Mikhail f. Shiryaev
7d7efcbccd
Add the lambda to collect data for workflow_jobs 2022-12-22 18:03:40 +01:00
Mikhail f. Shiryaev
6646950f3c
Get rid of unused set-output 2022-12-20 11:40:22 +01:00
Robert Schulze
a6019fec70
Merge branch 'master' into sse2-in-universal 2022-12-20 10:24:50 +01:00
Robert Schulze
2b9a0824fe
Cosmetics: Rename "amd64-sse2" builds to "amd64-compat" builds 
... a bit of consistency with "aarch64-v80compat"
 2022-12-19 19:00:21 +00:00
Mikhail f. Shiryaev
ab0aab2c15
Fix false success rerun on similar prefix for another builds 2022-12-16 14:23:31 +01:00
Mikhail f. Shiryaev
3907b64d09
Get rid of global Git object 2022-12-15 17:43:48 +01:00
Mikhail f. Shiryaev
9a422974ab
Timeout stress-tests after 2.5 hours 2022-12-14 12:51:35 +01:00
Mikhail f. Shiryaev
16b2d5dfd1
Improve TeePopen typing and structure 2022-12-14 12:51:34 +01:00
Mikhail f. Shiryaev
092f87a60d
Merge pull request #44079 from ClickHouse/gh-helper-cache 
Fix the CACHE_PATH creation for default value
 2022-12-12 11:05:36 +01:00
Alexey Milovidov
268bfea2fc Fix typo 2022-12-10 23:42:53 +01:00
Mikhail f. Shiryaev
fe44b514b7
Create GitHub cache directory optionally by default 2022-12-09 21:33:06 +01:00
Mikhail f. Shiryaev
9c934bf68a
Improve logging of the ci_runners_metrics_lambda 2022-12-09 20:15:29 +01:00
Mikhail f. Shiryaev
eb9ea6d0b9
Do not remove runners from GH in advance 2022-12-09 20:15:27 +01:00
Mikhail f. Shiryaev
c11cec605d
Fix the CACHE_PATH creation for default value 2022-12-09 16:11:03 +01:00
Mikhail f. Shiryaev
820d362466
Assign the new-version PR to the author, add "do not test" 2022-12-08 20:55:50 +01:00
Mikhail f. Shiryaev
e1584c5d3a
Provide sha512 hashsums for tgz artifacts 2022-12-07 21:44:19 +01:00
vdimir
8f05cb58f0
Fix typo in tests/ci/bugfix_validate_check.py 2022-12-06 11:13:22 +01:00
Alexander Gololobov
472c5a835b
Merge pull request #43862 from ClickHouse/rerun-docs-check-on-edited 
Rerun DocsCheck on edited PR description
 2022-12-05 13:58:32 +01:00
Mikhail f. Shiryaev
8d53d558bd
Restore typing for S3Helper 2022-12-02 22:49:26 +01:00
Mikhail f. Shiryaev
8d9dbda7f2
Experiment with old upload_result_helper.py 2022-12-02 21:34:21 +01:00
Mikhail f. Shiryaev
dcdacea8e8
Revert "Add typing to upload_result_helper.py, remove stale code" 
This reverts commit 1fb090bfe2.
 2022-12-02 21:33:08 +01:00
Mikhail f. Shiryaev
e2a9b226e0
Merge pull request #43894 from ClickHouse/improve-release-script 
Improve release script
 2022-12-02 20:33:34 +01:00
Mikhail f. Shiryaev
8e8068afe4
Use only PRs to our repository in pr_info on push 2022-12-02 19:17:16 +01:00
Mikhail f. Shiryaev
7356d48f67
Get rid of PyGithub dependency 2022-12-02 18:58:46 +01:00
Mikhail f. Shiryaev
ed4db129f4
Reduce dependencies from unidiff 2022-12-02 18:27:36 +01:00
Mikhail f. Shiryaev
8897aa7fe8
Merge pull request #43132 from ClickHouse/strict-typing-ci 
Enable strict typing check in tests/ci
 2022-12-01 14:37:25 +01:00
Mikhail f. Shiryaev
a6a45f98b2
Rerun DocsCheck on edited PR description 2022-12-01 13:26:29 +01:00
Mikhail f. Shiryaev
5d7cb6b85a
Change email for robot-clickhouse to immutable one 2022-12-01 13:01:35 +01:00
Mikhail f. Shiryaev
fe8107e95f
Fix type ignorance in version_helper.py 2022-11-29 17:18:29 +01:00
Mikhail f. Shiryaev
0f2704703f
Fix typing and bug in cancel_and_rerun_workflow_lambda 2022-11-29 16:50:22 +01:00
Mikhail f. Shiryaev
23002bc808
Add typing to terminate_runner_lambda 2022-11-29 16:50:21 +01:00
Mikhail f. Shiryaev
3feb8e3657
Add type hinting to ci_runners_metrics_lambda 2022-11-29 16:50:20 +01:00
Mikhail f. Shiryaev
eacf7e01a1
Fix typing in team_keys_lambda 2022-11-29 14:12:29 +01:00
Mikhail f. Shiryaev
3bf3dacb4d
Add __init__.py to lambdas for mypy 2022-11-29 14:12:28 +01:00
Mikhail f. Shiryaev
f4a7ff409e
Fix push_to_artifactory.py 2022-11-29 14:12:28 +01:00
Mikhail f. Shiryaev
db44e40989
Fix sqlancer_check.py typing 2022-11-29 14:12:27 +01:00
Mikhail f. Shiryaev
e1a9f2976a
Fix stress_check.py typing 2022-11-29 14:12:27 +01:00
Mikhail f. Shiryaev
5af2bc6660
Fix unit_tests_check.py typing 2022-11-29 14:12:26 +01:00
Mikhail f. Shiryaev
d0d23af63e
Fix integration_test_check.py typing 2022-11-29 14:12:26 +01:00
Mikhail f. Shiryaev
1e5fec1157
Fix functional_test_check.py typing 2022-11-29 14:12:25 +01:00
Mikhail f. Shiryaev
33424bc411
Add typing to fast tests 2022-11-29 14:12:25 +01:00
Mikhail f. Shiryaev
eb738fa13e
Use PRInfo and TEMP_PATH in codebrowser 2022-11-29 14:12:24 +01:00
Mikhail f. Shiryaev
40b8c8559f
Simplify finish_check.py 2022-11-29 14:12:24 +01:00
Mikhail f. Shiryaev
d4859275f4
Fix typing in version_test.py 2022-11-29 14:12:23 +01:00
Mikhail f. Shiryaev
459dde989b
A tiny fix for missing types 2022-11-29 14:12:23 +01:00
Mikhail f. Shiryaev
ba9e51d686
Fix cherry-pick.py typing issues 2022-11-29 14:12:22 +01:00
Mikhail f. Shiryaev
ec0684dfce
Fix typing issues in build_check.py 2022-11-29 14:12:22 +01:00
Mikhail f. Shiryaev
4fc5bb7a63
Fix release.py typing issue 2022-11-29 14:12:21 +01:00
Mikhail f. Shiryaev
da71dbe040
Fix issues in build_report_check.py 2022-11-29 14:12:21 +01:00
Mikhail f. Shiryaev
6e00bb2e74
Add and fix typing for docker_pull_helper, github_helper and style_check 2022-11-29 14:12:20 +01:00
Mikhail f. Shiryaev
02b8da2a0f
Add typing for TeePopen 2022-11-29 14:12:20 +01:00
Mikhail f. Shiryaev
8838102657
Fix issue in docker_manifests_merge.py 2022-11-29 14:12:19 +01:00
Mikhail f. Shiryaev
1fb090bfe2
Add typing to upload_result_helper.py, remove stale code 2022-11-29 14:12:19 +01:00
Mikhail f. Shiryaev
324c8e4b12
Use f-strings in report.py 2022-11-29 14:12:18 +01:00
Mikhail f. Shiryaev
080ff97627
Fix mypy errors in report.py 2022-11-29 14:12:17 +01:00
Mikhail f. Shiryaev
9dff6a80ab
Fix run_check.py and dependencies 2022-11-29 14:12:16 +01:00
Mikhail f. Shiryaev
78e560f78e
Fix docker_image_check and docker_test 2022-11-29 12:51:47 +01:00
Mikhail f. Shiryaev
9d173ca369
Fix version_helper.py 2022-11-29 12:51:46 +01:00
Mikhail f. Shiryaev
c058f07fab
Add mypy config, fix git_helper.py 2022-11-29 12:51:45 +01:00
alesapin
fdf1e54d1e
Merge pull request #43777 from ClickHouse/rerun-actions-on-edited 
Rerun PullRequestCI on changed description body
 2022-11-29 12:33:38 +01:00
Mikhail f. Shiryaev
fbb39cb659
Cancel workflows only on new "do not test" labels in favor of CheckLabels 2022-11-28 21:23:18 +01:00
Mikhail f. Shiryaev
ec344c91b4
Rerun PullRequestCI on changed description body 2022-11-28 20:59:20 +01:00
Mikhail f. Shiryaev
1c02cc5896
Migrate terminate-runner-lambda to zip-packages 2022-11-28 18:12:42 +01:00
Mikhail f. Shiryaev
af4d0b10bd
Delete unused code 2022-11-28 18:11:40 +01:00
Mikhail f. Shiryaev
218897e032
Rename runners_termination_lambda 2022-11-28 18:11:23 +01:00
Mikhail f. Shiryaev
9a729e3370
Migrate runner_token_rotation_lambda to zip package deployment 2022-11-28 17:40:38 +01:00
Mikhail f. Shiryaev
cf8c904b61
Fix typing errors 2022-11-28 17:31:22 +01:00
Mikhail f. Shiryaev
7cddfbe9f9
Rename token lambda to reflect the meaning 2022-11-28 17:30:53 +01:00
Mikhail f. Shiryaev
fda2c4e78a
Merge pull request #43756 from ClickHouse/terminate-lost-runners 
Terminate lost runners
 2022-11-28 16:07:28 +01:00
Mikhail f. Shiryaev
272042108d
Terminate instances that lost connection to github 2022-11-28 16:05:55 +01:00
Alexander Tokmakov
a82fec83d8
Merge pull request #43623 from ClickHouse/move_perf_tests_aarch_to_master 
Move perf tests for Aarch64 from PRs to master
 2022-11-28 17:56:35 +03:00
Mikhail f. Shiryaev
28f9f588bc
A small improvement in naming and rounding pages number 2022-11-28 14:54:00 +01:00
Mikhail f. Shiryaev
88c338c090
Merge pull request #43579 from ClickHouse/universal-runners 
Prepare CI for universal runners preallocated pool
 2022-11-25 21:30:44 +01:00
Alexander Tokmakov
5bb0a7ac38
Update performance_comparison_check.py 2022-11-25 20:43:45 +03:00
Alexander Tokmakov
eec5449c1c run perf tests on aarch64 for pr-performance 2022-11-25 17:55:10 +01:00
Mikhail f. Shiryaev
3ac0692a3d
Fix pagination issue in GITHUB_JOB_ID() 2022-11-25 17:28:13 +01:00
Mikhail f. Shiryaev
9584487a1e
Use docker images cache from merged PRs in master and release branches 2022-11-25 14:09:21 +01:00
Mikhail f. Shiryaev
1d9570a4cb
Display runner's labels on setup step 2022-11-24 16:05:16 +01:00
Mikhail f. Shiryaev
650a9dc2c2
Use zip file for ci-runners-metrics-lambda 2022-11-24 16:05:16 +01:00
Mikhail f. Shiryaev
ebe696af80
Handle universal runners in metrics lambda 2022-11-24 16:05:15 +01:00
Mikhail f. Shiryaev
ffd18d43a6
Use docker for lambda packages building 2022-11-24 16:05:15 +01:00
Mikhail f. Shiryaev
531811575e
Rename directory for zip deployment 2022-11-24 16:05:13 +01:00
Mikhail f. Shiryaev
7048f36fc7
Save unnecessary API requests 2022-11-22 13:37:08 +01:00
Mikhail f. Shiryaev
fb95ca43d8
Use all parameters with prefixes from ssm 2022-11-22 12:43:17 +01:00
alesapin
f4ef20b5e4
Merge pull request #43295 from ClickHouse/cancel-lambda-api-url 
Cancel lambda api url
 2022-11-21 12:03:37 +01:00
Mikhail f. Shiryaev
e9e355dd82
Process optionally base64-encoded bodies 2022-11-18 15:17:36 +01:00
Mikhail f. Shiryaev
b1fcdfcaad
Preserve the whole event for debugging 2022-11-18 14:26:19 +01:00
Mikhail f. Shiryaev
3727f21ac2
Merge pull request #43019 from ClickHouse/release-only-on-marked-commits 
Allow release only from ready commits
 2022-11-17 20:51:57 +01:00
Mikhail f. Shiryaev
6d532d310d
Migrate cancel-lambda to python package 2022-11-17 15:55:48 +01:00
Mikhail f. Shiryaev
1fe095ae90
Explicitly return OK for python lambdas 2022-11-17 15:55:25 +01:00
Mikhail f. Shiryaev
2e5e9a8729
Get rid of API_URL environment 2022-11-17 13:31:41 +01:00
Mikhail f. Shiryaev
cb069d8bfa
Use authorized requests for GET 2022-11-16 15:50:26 +01:00
Mikhail f. Shiryaev
589648c444
Event data for 'labeled' has an added label data 2022-11-16 15:47:32 +01:00
Mikhail f. Shiryaev
eea23df48a
Merge pull request #43121 from ClickHouse/commit-status-improvement 
Improve commit_status_helper.py
 2022-11-14 14:48:27 +01:00
Yatsishin Ilya
dee865ce78 Fix trailing \n from SQLancer status 2022-11-11 13:48:55 +01:00
Mikhail f. Shiryaev
eec74e46e4
Move get_commit_filtered_statuses to commit_status_helper 2022-11-10 13:12:22 +01:00
Mikhail f. Shiryaev
e2de809532
Add typing to commit_status_helper.py 2022-11-10 13:12:20 +01:00
Mikhail f. Shiryaev
c12c1cdf9b
Allow release only from ready commits 2022-11-10 12:42:33 +01:00
Antonio Andelic
e512d7f036
Merge pull request #42619 from ClickHouse/jepen-multiple-tests 
Extend Jepsen tests with support for server
 2022-11-10 09:01:40 +01:00
Alexander Tokmakov
af78f4b66a
Merge branch 'master' into tavplubix-patch-5 2022-11-09 16:20:24 +03:00
Alexander Tokmakov
9edb4d779b fix 2022-11-09 12:18:29 +01:00
Mikhail f. Shiryaev
7549b22317
Add a script to mark commit as ready for release 2022-11-08 12:21:14 +01:00
Mikhail f. Shiryaev
ff083e1b55
Forbit launching release.py from branches but master 2022-11-08 12:21:12 +01:00
Antonio Andelic
900894e251 Fix style 2022-11-07 14:03:11 +00:00
robot-clickhouse
70ce952363 Automatic style fix 2022-11-07 13:49:21 +00:00
Antonio Andelic
af09ef5351 Enable release build 2022-11-07 11:48:48 +00:00
Antonio Andelic
8e1a4bcf9a Update CI config 2022-11-07 09:42:00 +00:00
Antonio Andelic
e751557599 Merge branch 'master' into jepen-multiple-tests 2022-11-07 08:13:49 +00:00
Mikhail f. Shiryaev
1642b2f4bd
Fix old bug to remove refs/heads from default ref 2022-11-05 14:51:26 +01:00
Antonio Andelic
51ee6ec436 Use autoscaling for keeper 2022-11-04 14:12:30 +00:00
Antonio Andelic
fee53a415a Reuse same PR 2022-11-04 13:49:12 +00:00
Antonio Andelic
98d3b4a835 Support Jepsen for server in CI 2022-11-04 13:40:13 +00:00
Ilya Yatsishin
2e7013f439
Merge pull request #42397 from qoega/revive-sqlancer 
Revive SQLancer
 2022-11-04 14:28:21 +01:00
Mikhail f. Shiryaev
0e27039ec4
Merge pull request #42934 from ClickHouse/lambdas-cryptography 
Pin the cryptography version to not break lambdas
 2022-11-04 10:09:43 +01:00
Mikhail f. Shiryaev
43dd55798d
Pin the cryptography version to not break lambdas 2022-11-03 16:37:58 +01:00
Vladimir C
acf9a62f2e
Merge pull request #42932 from ClickHouse/vdimir/pr-bufix-check 2022-11-03 14:17:58 +01:00
vdimir
5f184359a1
Do not show status for Bugfix validate check in non bugfix PRs 2022-11-03 12:44:07 +00:00
Mikhail f. Shiryaev
3f424de022
Adjust cancel and rerun workflow names to the actual 2022-11-01 14:26:06 +01:00
vdimir
2060c2d9ac Fix style 2022-11-01 11:20:10 +01:00
vdimir
e83d61749a update test bugfix report 2022-11-01 11:20:10 +01:00
vdimir
63b63da214 Update bugfix_validate_check.py 2022-11-01 11:20:10 +01:00
vdimir
1b32c7d212 Update bugfix_validate_check.py 2022-11-01 11:20:10 +01:00
vdimir
c18838715d Post status for test bugfix check 2022-11-01 11:20:10 +01:00
vdimir
9f5dcd14af Request labels from gh api for validate bugfix check 2022-11-01 11:20:10 +01:00
vdimir
e0735e1e67 Debug TestBugfixCheck 2022-11-01 11:20:10 +01:00
Ilya Yatsishin
7c345f6094
Merge branch 'master' into revive-sqlancer 2022-10-31 17:19:27 +01:00
Yatsishin Ilya
10873dfc9f succeess 2022-10-28 11:28:20 +00:00
Yatsishin Ilya
aa75515219 fix 2022-10-28 09:47:16 +00:00
Ilya Yatsishin
cd2f9f6e3e
Merge pull request #42678 from qoega/fix-exception-handling-clickhouse-helper 
Fix error handling in clickhouse_helper.py
 2022-10-28 08:55:56 +02:00
Yatsishin Ilya
a4626c64af fix 2022-10-27 17:56:08 +00:00
Yatsishin Ilya
d8e8dd006f support server fail 2022-10-27 09:06:11 +00:00
Yatsishin Ilya
ccc515bebd Merge remote-tracking branch 'origin/master' into revive-sqlancer 2022-10-27 07:13:28 +00:00
Yatsishin Ilya
9dee90cd42 fix path 2022-10-26 15:06:01 +00:00
Yatsishin Ilya
fa402d8967 fix 2022-10-26 12:01:12 +00:00
Yatsishin Ilya
acfea0e2df style 2022-10-26 11:21:33 +00:00
Mikhail f. Shiryaev
a8f3b39dcc
Fix execution of version_helper.py to use git tweaks 2022-10-26 12:07:42 +02:00
Ilya Yatsishin
7973b4e5e5 Fix error handling 2022-10-26 11:09:01 +02:00
Yatsishin Ilya
b096edc995 do not upload files manually 2022-10-26 08:30:20 +00:00
Yatsishin Ilya
302df3af12 fix? 2022-10-25 16:34:12 +00:00
Yatsishin Ilya
c89c14a05d add NoREC 2022-10-25 10:34:55 +00:00
Yatsishin Ilya
db2f3baf39 fix 2022-10-21 19:43:06 +00:00
Yatsishin Ilya
6f8f7150ff style 2022-10-21 16:42:45 +00:00
Yatsishin Ilya
13f506f7b1 minor 2022-10-21 11:48:58 +00:00
Yatsishin Ilya
548ff1d2aa fix 2022-10-20 12:33:56 +00:00
Yatsishin Ilya
105ca72955 fix 2022-10-20 10:51:47 +00:00
Ilya Yatsishin
b768925256
Update tests/ci/sqlancer_check.py 2022-10-20 00:09:09 +02:00
Ilya Yatsishin
8ef8def9ab
Update tests/ci/sqlancer_check.py 2022-10-19 21:00:05 +02:00
Yatsishin Ilya
7d90d54af8 better reporting 2022-10-19 17:02:49 +00:00
Yatsishin Ilya
757959d087 fix bug 2022-10-18 15:14:42 +00:00
Yatsishin Ilya
8b3dc2d551 typo 2022-10-18 07:52:11 +00:00
Yatsishin Ilya
aa432fe95a staging 2022-10-17 15:20:20 +00:00
Yatsishin Ilya
6a82d54314 add CI files 2022-10-17 14:46:50 +00:00
Mikhail f. Shiryaev
54347c890f
Add at to runner AMI, bump gh runner version 2022-10-05 11:47:30 +02:00
Mikhail f. Shiryaev
45cde6545d
Add a warning message to release.py script, require release type 2022-09-30 16:22:25 +02:00
Robert Schulze
5dcdf60f68
Merge pull request #41762 from ClickHouse/bump-llvm-to-13 
Bump LLVM from 12 to 13
 2022-09-29 19:37:46 +02:00
Mikhail f. Shiryaev
10f3df340e
Use cgroups v1 on ubuntu workers 2022-09-28 14:24:45 +02:00
Robert Schulze
a300ea6024
Try to fix binary compatibility check + extend check to library-bridge 2022-09-28 09:56:58 +00:00
Robert Schulze
a18bdf0004
Merge pull request #41775 from ClickHouse/adjust-universalsh 
Point automatic download script to to ARMv8.0 compat build
 2022-09-27 09:01:25 +02:00
Alexey Milovidov
3f3f93ae13
Merge pull request #41556 from ClickHouse/gh-runners 
Update runners to a recent version to install on 22.04
 2022-09-27 01:00:53 +03:00
Mikhail f. Shiryaev
51c9f81dce
Fix tests for docker-ci 2022-09-26 13:58:38 +02:00
Robert Schulze
c5224cd007
Point automatic download script to to ARMv8.0 compat build 
- follow-up to #41610

- universal.sh downloads a the correct ClickHouse binary for the current
  platform

- For Linux/Aarch64, point to v8.0 compat build for maximum
  compatibility. Also add property static_binary_name (ci_config.py) so
  that the binary can be placed into the right location.

- Remove the unsupported combinations FreeBSD Aarch64 and PPC for which
  we provide no binaries.
 2022-09-26 11:40:09 +00:00
Alexey Milovidov
62ebf397d2
Merge pull request #41610 from ClickHouse/upgrade-arm-requirement 
Bump minimum required ARM ISA to v8.2 and add v8.0 compat build
 2022-09-26 14:08:48 +03:00
Mikhail f. Shiryaev
a760c71a0b
Fix the typo preventing building latest images 2022-09-26 12:52:12 +02:00
Robert Schulze
bcaa66c804
Add arm-v80compat builds 2022-09-21 13:09:24 +00:00
Mikhail f. Shiryaev
2dff307770
Build latest tags ONLY from master branch 2022-09-20 14:31:04 +02:00
Mikhail f. Shiryaev
a852644de2
Update runners to a recent version to install on 22.04 2022-09-20 11:33:06 +02:00
Alexey Milovidov
ecfd8cb5a6 Remove trash error message from integration tests 2022-09-17 20:24:56 +02:00
Mikhail f. Shiryaev
c9d1b1d519
Merge pull request #41401 from ClickHouse/backported-label 
Rename pr-backported label to avoid confusion
 2022-09-16 11:48:49 +02:00
Robert Schulze
13a2bbaf5e
Merge branch 'master' into enable_constant_column_search 2022-09-16 11:09:45 +02:00
Mikhail f. Shiryaev
6a17d4e705
Delete redundant LABEL_ prefix 2022-09-16 10:23:49 +02:00
Mikhail f. Shiryaev
ab7bd95d8b
Rename pr-backported label to avoid confusion 2022-09-16 10:04:49 +02:00
Alexey Milovidov
da01982652
Merge pull request #41046 from azat/build/llvm-15 
Switch to llvm/clang 15
 2022-09-16 07:31:06 +03:00
Robert Schulze
cce4ed5496
Un-exclude constant_column_search from ARM perf tests 
constant_column_search was excluced when ARM perf tests were set up
PR 37497. Back then we haven't had PR 41033 and regexp eval on ARM was
slow. Let's check again.
 2022-09-15 10:48:47 +00:00
Mikhail f. Shiryaev
c2b02c2ae9
Download ccache from release PRs for backports 2022-09-14 18:24:55 +02:00
Azat Khuzhin
ced30a2072 Switch to llvm/clang 15 
It had been released few hours ago, and I want to check how clang-15
generates DWARF-5

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-09-10 21:38:34 +02:00
Alexander Tokmakov
e77b9e4d0c
Merge pull request #40775 from azat/ci/core-dumps-rework 
Rework core collecting on CI (eliminate gcore usage)
 2022-09-09 20:20:10 +03:00
Mikhail f. Shiryaev
b815fdbc8c
Merge pull request #41088 from ClickHouse/darwin-releases 
Add macos binaries to release assets
 2022-09-09 17:17:15 +02:00
Robert Schulze
9d4de0cbaa
Merge pull request #40999 from ClickHouse/sse2-special-build 
Add special x86-SSE2-only build
 2022-09-08 09:06:29 +02:00
Mikhail f. Shiryaev
c0ce4c2d6f
Add macos binaries to GH release assets 2022-09-07 19:23:44 +02:00
Mikhail f. Shiryaev
a067907fbe
Add typing and order import 2022-09-07 19:23:43 +02:00
Mikhail f. Shiryaev
bd83e905d3
Fix a typo in download_build_with_progress 2022-09-07 19:23:43 +02:00
Mikhail f. Shiryaev
7cdd8c3304
Move download template to env_helper 2022-09-07 19:23:42 +02:00
Mikhail f. Shiryaev
257c4328f7
Rename get_build_urls to read_build_urls 2022-09-07 19:23:41 +02:00
Mikhail f. Shiryaev
f3cf1069dc
Fix header for autogenerated version 2022-09-07 19:23:41 +02:00
robot-clickhouse
01139d9d28 Automatic style fix 2022-09-07 08:51:02 +00:00
Robert Schulze
497b65f41d
CheckLabels: Print message that 'can be tested' is missing 2022-09-07 08:42:53 +00:00
Kseniia Sumarokova
68e013e819
Update ci_config.py 2022-09-05 22:13:07 +02:00
Robert Schulze
401747eaa7
Merge branch 'master' into sse2-special-build 2022-09-05 16:17:20 +02:00
Kseniia Sumarokova
360bc93c87
Turn off always green mode 2022-09-05 16:16:49 +02:00
Robert Schulze
e1def723f8
Add special x86-SSE2-only build 2022-09-05 12:51:44 +00:00
Alexey Milovidov
a819f2c75b
Merge branch 'master' into add-more-s3-tests 2022-09-05 05:23:17 +03:00
Azat Khuzhin
25e3bebd9d Rework core collecting on CI (eliminate gcore usage) 
gcore is a gdb command, that internally uses gdb to dump the core.

However with proper configuration of limits (core_dump.size_limit) it
should not be required, althought some issues is possible:
- non standard kernel.core_pattern
- sanitizers

So yes, gcore is more "universal" (you don't need to configure any
`kernel_pattern`), but it is ad-hoc, and it has drawbacks -
**it does not work when gdb fails**. For example gdb may fail with
`Dwarf Error: DW_FORM_strx1 found in non-DWO CU` in case of DWARF-5 [1].

  [1]: https://github.com/ClickHouse/ClickHouse/pull/40772#issuecomment-1236331323.

Let's try to switch to more native way.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-09-04 22:07:16 +02:00
Alexey Milovidov
c4adc9ed8f Remove trash 2022-09-04 04:28:08 +02:00
Mikhail f. Shiryaev
9e4f5d5006
Merge pull request #40845 from ClickHouse/cherry-pick-assignees 
Assign new cherry-pick and backport PRs
 2022-09-01 18:32:46 +02:00
Mikhail f. Shiryaev
ca837e6755
Add a doc-string for ReleaseBranch._assign_new_pr 2022-09-01 13:06:14 +02:00
Mikhail f. Shiryaev
1da02adc8d
Assign PRs to an original merged_by too 2022-09-01 12:38:30 +02:00
Robert Schulze
d311482391
More renamings for consistency 
AST Fuzzer (ASan)  --> AST Fuzzer (asan)
AST Fuzzer (TSan)  --> AST Fuzzer (tsan)
AST Fuzzer (MSan)  --> AST Fuzzer (msan)
AST Fuzzer (UBSan) --> AST Fuzzer (ubsan)
 2022-09-01 07:59:01 +00:00
Robert Schulze
48164b039a
Consistent sanitizer naming in CI 
Sanitizer build/test jobs were sometimes named with full form
('undefined') - which could be confusing - and sometimes named with
abbreviated form ('ubsan'). Now always using the short form.
 2022-08-31 12:45:05 +00:00
Mikhail f. Shiryaev
187b10dec5
Assign to all at once, improve logging 2022-08-31 14:09:17 +02:00
Yakov Olkhovskiy
31a7ed09a1 disable default ENABLE_CLICKHOUSE_SELF_EXTRACTING and add to env 2022-08-27 21:08:01 +00:00
Alexey Milovidov
f86242c17e
Merge pull request #40699 from ClickHouse/remove-unbundled 
Remove the remaining parts of "unbundled" build
 2022-08-27 21:54:42 +03:00
Alexey Milovidov
91ed3ebe9a Remove the remaining parts of "unbundled" build 2022-08-27 02:18:47 +02:00
Vladimir C
cc74e3dd19
Fix performance_comparison_check.py 2022-08-26 15:49:40 +02:00
Vladimir C
f76325c439
Fix style in performance_comparison_check.py 2022-08-26 12:45:40 +02:00
vdimir
d82cab7f65
Fix env variable forwaring in performance_comparison_check.py 2022-08-26 09:21:42 +00:00
Alexey Milovidov
cb2e5f316c Revert "Maybe make it possible" 
This reverts commit a517d9d65f.
 2022-08-21 20:52:04 +02:00
Alexey Milovidov
ad8a1751ac
Merge branch 'master' into riscv-in-ci 2022-08-21 16:56:11 +03:00
Azat Khuzhin
4de309718b tests/stress: use --privileged over --cap-add syslog to obtain dmesg 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-08-19 13:31:05 +02:00
Mikhail f. Shiryaev
e513ad6748
And the last tiny fix for assignees 2022-08-18 23:32:55 +02:00
Mikhail f. Shiryaev
b485afbe2c
Merge pull request #40367 from ClickHouse/cherry-pick-assignees 
Fix wrong assignees argument passing
 2022-08-18 23:28:31 +02:00
Mikhail f. Shiryaev
dce060bac4
Fix wrong assignees argument passing 2022-08-18 22:22:50 +02:00
Mikhail f. Shiryaev
13d95ebdef
Fix typo in the S3 download links for 2022-08-18 20:32:33 +02:00
robot-clickhouse
15bbb21a09 Automatic style fix 2022-08-16 13:10:28 +00:00
Yakov Olkhovskiy
dfbbc51045
add update_mergeable_check trigger 2022-08-16 09:02:03 -04:00
Yakov Olkhovskiy
b865787b3c
add Unit tests to Mergeable 2022-08-15 19:05:40 -04:00
Mikhail f. Shiryaev
9f3b2fafcc
Merge pull request #40177 from ClickHouse/cherry-pick-logging 
Improve assignment and logging for cherry-pick and backport steps
 2022-08-15 13:41:52 +02:00
Alexey Milovidov
a517d9d65f Maybe make it possible 2022-08-15 04:23:56 +02:00
Alexey Milovidov
edc99648ad Add build to CI 2022-08-14 06:14:43 +02:00
Azat Khuzhin
923e2f22ef tests/stress: fix dmesg reading 
After #39939 there is still an error:

    + dmesg -T
    dmesg: read kernel buffer failed: Operation not permitted

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/39939/a1981f21a153810f072af67bb6007dc1f4367c22/stress_test__debug_.html

Since it is not allowed to access dmesg by default,
one of the following is required:

- --cap-add syslog
- --cap-add cap_sys_admin
- --privileged

I decided to use as little capabilities as possible, even though it is
not that important on CI, but it is a rule of thumb.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-08-13 21:45:09 +02:00
Mikhail f. Shiryaev
22c53e7f7b
Merge pull request #40127 from ClickHouse/s3-helper 
Rework S3Helper a little bit
 2022-08-13 16:27:00 +02:00
Mikhail f. Shiryaev
7f61f30f15
Improve assignment and logging for cherry-pick and backport steps 2022-08-12 23:30:32 +02:00
Alexey Milovidov
8c3d1f2b5b
Merge branch 'master' into server-side-time 2022-08-12 17:40:02 +03:00
Mikhail f. Shiryaev
b46622cf3c
Don't use envs for static links 2022-08-12 09:46:36 +02:00
Mikhail f. Shiryaev
372481e770
Rework S3Helper a little bit 2022-08-11 15:01:32 +02:00
Mikhail f. Shiryaev
9f45532999
Use a job ID as ref text 2022-08-11 12:05:16 +02:00
Mikhail f. Shiryaev
ac371818f7
Fix _csv.Error: field larger than field limit (131072) 2022-08-10 20:21:49 +02:00
Mikhail f. Shiryaev
2fb68078e8
Replace S3 URLs by parameter 2022-08-10 15:22:04 +02:00
Mikhail f. Shiryaev
4b2bba2ff1
Do not upload unnecessary lambda sources 2022-08-10 14:37:06 +02:00
Mikhail f. Shiryaev
5f3c7524bc
Merge pull request #40032 from ClickHouse/job-url 
Job url
 2022-08-10 09:58:30 +02:00
Alexey Milovidov
f7d995681b
Merge branch 'master' into replace-yandex-to-noto 2022-08-09 22:43:52 +03:00
Mikhail f. Shiryaev
bcf430b382
Add job url to test reports 2022-08-09 19:12:47 +02:00
Mikhail f. Shiryaev
32efae4f1b
Add JOB_ID and JOB_URL getters 2022-08-09 18:34:12 +02:00
Mikhail f. Shiryaev
a34a9b581c
Merge pull request #39871 from ClickHouse/universal-lambdas 
Get api url from event, not from const/ENV
 2022-08-08 23:34:04 +02:00
Alexey Milovidov
0349d9da96 Change font in CI reports just in case (might be worse) 2022-08-08 07:25:29 +02:00
Yakov Olkhovskiy
40463e9c47 add Stateful tests (release), Stateless tests (release) to Mergeable Check 2022-08-08 00:20:09 -04:00
Alexey Milovidov
f08952b74c
Merge pull request #39735 from ClickHouse/ci-simple-check-refactoring 
CI: refactor Simple Check, use statuses to make it stateful
 2022-08-06 02:04:36 +03:00
Yakov Olkhovskiy
1a52fa183d rename Simple Check to Mergeable Check, refactor processing 2022-08-05 10:39:58 -04:00
alesapin
48e55ff4c7
Merge pull request #39795 from ClickHouse/cloudflare-dns-fallback 
Add cloudflare DNS as a fallback
 2022-08-05 12:14:45 +02:00
Mikhail f. Shiryaev
0d1c31a869
Merge branch 'master' into release-tweak-generate 2022-08-04 21:33:54 +02:00
Alexey Milovidov
f474eb957d
Merge pull request #39758 from ClickHouse/tsan_clang_15 
Try clang-15 for build with tsan
 2022-08-04 01:56:52 +03:00
Mikhail f. Shiryaev
8919fd6e58
Add handful notes to a post-release logging 2022-08-04 00:40:32 +02:00
Mikhail f. Shiryaev
ff26492830
Prevent spoiling rollback_stack 2022-08-04 00:24:43 +02:00
Mikhail f. Shiryaev
c6948c3e82
Use token for all requests 2022-08-03 19:17:41 +02:00
Mikhail f. Shiryaev
61fd28e19f
Get api url from event, not from const/ENV 2022-08-03 19:17:41 +02:00
Mikhail f. Shiryaev
62a05dc10d
Add instructions for github-cli installation 2022-08-03 13:40:31 +02:00
Mikhail f. Shiryaev
2ca9df9b22
Merge pull request #39421 from ClickHouse/github-helper 
GitHub helper
 2022-08-03 12:04:03 +02:00
Mikhail f. Shiryaev
08474cf869
Update tweak on version part update 2022-08-03 11:43:47 +02:00
Mikhail f. Shiryaev
469b7e7668
Add notes about _is_cache_updated logic 2022-08-02 18:44:49 +02:00
Mikhail f. Shiryaev
70d97e9393
Merge pull request #39630 from ClickHouse/workflow-rerun-lambda 
Attempt to fix wrong workflow_run data for rerun
 2022-08-02 18:29:43 +02:00
Mikhail f. Shiryaev
f150966f10
Merge pull request #39723 from ClickHouse/cherry-pick-fix 
Fix cherry-pick for cases, when assignee is not set for PR
 2022-08-02 13:13:47 +02:00
Mikhail f. Shiryaev
26ef951fde
Add DNS trick to the dockerhub proxy too 2022-08-02 12:04:26 +02:00
Alexander Tokmakov
82b50e79cf
Merge branch 'master' into tsan_clang_15 2022-08-02 13:00:55 +03:00
Alexey Milovidov
b275aae95d
Update init_runner.sh 2022-08-02 03:23:53 +03:00
Alexey Milovidov
488ae32295
Update init_runner.sh 2022-08-02 03:23:05 +03:00
Robert Schulze
b33fe26d8c
Merge pull request #39759 from ClickHouse/splitted-to-shared-renaming 
Rename "splitted build" to "shared libraries build" in CI tools
 2022-08-01 22:39:57 +02:00
Mikhail f. Shiryaev
afcf76e899
Add cloudflare DNS as a fallback 2022-08-01 18:27:17 +02:00
robot-clickhouse
af2f1b4cc3 Automatic style fix 2022-08-01 13:22:53 +00:00
Mikhail f. Shiryaev
33b26dda05
Improve logging 
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
 2022-08-01 15:15:48 +02:00
Mikhail f. Shiryaev
079db7f34b
Retry inserts with ClickHouseHelper 2022-08-01 14:59:13 +02:00
Robert Schulze
0e154ed1df
More renamings 2022-08-01 07:05:39 +00:00
Alexander Tokmakov
31550436e4 try clang-15 for build with tsan 2022-07-31 14:38:13 +02:00
Robert Schulze
729d19fa4f
Rename "splitted build" to "shared libraries build" in CI tools 
- The old name made sense for (dev option) "-DUSE_STATIC_LIBRARIES=0
  -DSPLIT_SHARED_LIBRARIES=1 -DSPLIT_BINARY=1" but that was removed with
  #39520.

- What still exists is "-DUSE_STATIC_LIBRARIES=0
  -DSPLIT_SHARED_LIBRARIES=1" which does a shared library build
 2022-07-31 12:26:51 +00:00
Alexey Milovidov
d306063a76
Merge branch 'master' into add-more-s3-tests 2022-07-31 01:15:49 +03:00
Mikhail f. Shiryaev
6126bd60ed
Fix cherry-pick for cases, when assignee is not set for PR 2022-07-29 19:27:38 +02:00
Mikhail f. Shiryaev
f0474f9e46
Improve lambda logic, don't fail on non-uniq PR 2022-07-28 14:24:42 +02:00
Mikhail f. Shiryaev
2338d01a20
Deploy workflow_approve_rerun_lambda as zip package 2022-07-28 14:23:59 +02:00
alesapin
e6d22793c9
Merge pull request #39428 from ClickHouse/block-builds-by-style 
Require clear style check to continue building
 2022-07-27 11:55:46 +02:00
Mikhail f. Shiryaev
0db9dda5f3
Attempt to fix wrong workflow_run data for rerun 2022-07-26 23:10:58 +02:00
Mikhail f. Shiryaev
061e61919a
Merge pull request #39450 from ClickHouse/tsal-clang-13 
Build thread sanitizer binaries with clang-13
 2022-07-26 15:13:17 +02:00
Mikhail f. Shiryaev
d9baa0b1f7 Finish following runs with the same exit code as the first 2022-07-26 14:22:11 +02:00
Mikhail f. Shiryaev
db0653758e Add typing to rerun and commit_status helpers 2022-07-26 14:22:11 +02:00
Alexey Milovidov
5867762258
Merge pull request #39454 from ClickHouse/status-names 
Commit status names: remove "actions"
 2022-07-24 17:39:16 +03:00
Mikhail f. Shiryaev
4302f583d8
Merge pull request #39467 from ClickHouse/ci-enforce-checks-2 
Add Build Check and Special Build Check to SimpleCheck
 2022-07-24 00:24:55 +02:00
Alexey Milovidov
b6b217d2a3
Merge branch 'master' into status-names 2022-07-24 00:34:00 +03:00
Yakov Olkhovskiy
c559cac085 add to SimpleCheck 2022-07-22 18:01:57 -04:00
Mikhail f. Shiryaev
17b504b0d4
Build thread sanitizer binaries with clang-13 2022-07-22 12:14:22 +02:00
robot-clickhouse
0d34814629 Automatic style fix 2022-07-21 16:39:14 +00:00
Mikhail f. Shiryaev
685a8f3949
Intentionally break black formatting 2022-07-21 17:01:45 +02:00
Mikhail f. Shiryaev
f60dcc30fb
Push automatic fix for black format for PRs 2022-07-21 17:01:42 +02:00
Mikhail f. Shiryaev
dacfc7886c
Improve style_check scripts style a little bit 2022-07-21 16:59:44 +02:00
Mikhail f. Shiryaev
209a5047c0
Improve caching logic, add cached NamedUser 2022-07-21 15:45:38 +02:00
Mikhail f. Shiryaev
d42018a2dc
Cleanup the rest of (actions) status names 2022-07-21 13:10:22 +02:00
Mikhail f. Shiryaev
b0eef42b9b
Remove unused Testflows and Release ci configs 2022-07-21 13:07:14 +02:00
Mikhail f. Shiryaev
31be011430
Rename bugfix checks statuses, clear unised ci config 2022-07-21 13:04:34 +02:00
Mikhail f. Shiryaev
c24800c7d5
Merge pull request #39307 from ClickHouse/ci-simple-check-fix-rerun 
Simple Check should be updated on rerun
 2022-07-21 13:01:59 +02:00
Mikhail f. Shiryaev
9679401a67
Rename flaky tests statuses 2022-07-21 12:58:36 +02:00
Mikhail f. Shiryaev
3ab288b095
Rename AST fuzzer statuses 2022-07-21 12:47:49 +02:00
Mikhail f. Shiryaev
8be0d9287d
Rename unit tests statuses 2022-07-21 12:45:46 +02:00
Mikhail f. Shiryaev
69f0cf19f4
Rename integration tests statuses 2022-07-21 12:43:42 +02:00
Mikhail f. Shiryaev
cc3c47c143
Rename stress tests statuses 2022-07-21 12:41:49 +02:00
Mikhail f. Shiryaev
f3ba18778d
Rename stateless tests statuses 2022-07-21 12:36:25 +02:00
Mikhail f. Shiryaev
9259e5ca77
Rename stateful tests statuses 2022-07-21 12:32:54 +02:00
Mikhail f. Shiryaev
7acf3dd624
Rename build reports statuses 2022-07-21 12:27:45 +02:00
Yakov Olkhovskiy
baff8327b9 do not recreate Simple Check if already exists 2022-07-21 01:41:55 -04:00
Yakov Olkhovskiy
f30b54a392 fail_simple_check is added 2022-07-21 01:36:13 -04:00
Yakov Olkhovskiy
c4073328fa add get_finished_status function 2022-07-21 01:36:12 -04:00
Mikhail f. Shiryaev
d100fac7ab
Use checkout -f preventing some potential issues 2022-07-20 17:29:34 +02:00
Mikhail f. Shiryaev
caef6729f4
Improve debug logging of github_helper 2022-07-18 10:32:45 +02:00
Mikhail f. Shiryaev
9cc06ea0e4
Fix found points during the review 2022-07-17 14:05:21 +02:00
Mikhail f. Shiryaev
6e48b08190
Clean-up some staff left after finishing 2022-07-15 17:58:45 +02:00
Mikhail f. Shiryaev
dc6db5b5d9
Replace sys.exit by Exception to rollback stash and clear_repo 2022-07-15 17:21:19 +02:00
Mikhail f. Shiryaev
48797660ff
Process exceptions per PR to not fail the script 2022-07-15 17:21:18 +02:00
Mikhail f. Shiryaev
30b0995532
Add early check if PR is already in a release branch 2022-07-15 17:21:18 +02:00
Mikhail f. Shiryaev
909e871c48
Rewrite cherry_pick.py to PyGithub API 2022-07-15 17:21:14 +02:00
Vladimir C
ca2e27aaa2
Merge pull request #37841 from vdimir/perf-save-to-stat 
Send perf tests results to ci database
 2022-07-11 13:07:40 +02:00
Alexey Milovidov
af1136c990
Merge pull request #38744 from ClickHouse/ci-required-simple-checks 
Add SimpleCheck
 2022-07-08 11:17:38 +03:00
mergify[bot]
7ba147bc7d
Merge branch 'master' into improve-bc-check 2022-07-07 09:38:17 +00:00
Mikhail f. Shiryaev
4410caf31d
Retry docker buildx commands with progressive sleep in between 2022-07-06 13:58:46 +02:00
Yakov Olkhovskiy
d6269c04bb style fix 2022-07-06 00:40:51 -04:00
Yakov Olkhovskiy
69d1495672 style fix 2022-07-06 00:22:50 -04:00
Yakov Olkhovskiy
19365597eb move Simple Check to python 2022-07-05 23:37:01 -04:00
mergify[bot]
ba7d48c2d7
Merge branch 'master' into improve-bc-check 2022-07-05 13:40:35 +00:00
vdimir
f701b58dd0
Update check_name in performance comparsion upload 2022-07-05 14:24:58 +02:00
vdimir
3731bd44c1
Revert "[testing] run only one perftest" 
This reverts commit 3b079827b78e04ac20043346998ce9d546969746.
 2022-07-05 14:00:26 +02:00
vdimir
45b2b1ca8a
[wip] persist pertest results 2022-07-05 14:00:24 +02:00
vdimir
c2d774d598
[testing] run only one perftest 2022-07-05 14:00:24 +02:00
vdimir
aac2f8aefc
Rename envs for performance comparsion 2022-07-05 14:00:24 +02:00
vdimir
b440ff83d8
fix performance_comparison_check.py 2022-07-05 14:00:24 +02:00
vdimir
0232c9267d
Pass CHPC_DATABASE_URL to perf tests 2022-07-05 14:00:15 +02:00
Mikhail f. Shiryaev
f048db23e2
Release branches run CI on pushes, fix PRInfo 2022-07-05 12:10:33 +02:00
Kruglov Pavel
6e0f27be23
Fix 2022-07-05 11:23:35 +02:00
Mikhail f. Shiryaev
04948e81cc
Get files changed in master since release is branched 2022-07-05 00:29:28 +02:00
Kruglov Pavel
315e6dcdb9
Fix style 2022-07-04 22:06:04 +02:00
Kruglov Pavel
4a557201c8
Fix style 2022-07-04 21:59:46 +02:00
avogar
fb2f60c613 Remove old script 2022-07-04 13:03:55 +00:00
avogar
17da24b584 Try to improve backward compatibility check 2022-07-04 13:02:22 +00:00
Mikhail f. Shiryaev
1018eff5b3
Merge pull request #38273 from ClickHouse/38218-oo-space 
Improve runners AMI and init scripts
 2022-07-04 12:39:58 +02:00
Mikhail f. Shiryaev
7c812df47e
Merge pull request #38580 from ClickHouse/artifactory-arm64 
Push arm64 packages to artifactory and release assets
 2022-07-04 12:31:52 +02:00
Mikhail f. Shiryaev
19516c768f
Revert "Upload to S3 compressed self-extracting clickhouse" 2022-07-04 10:15:27 +02:00
Yakov Olkhovskiy
c415543334
Merge pull request #38653 from ClickHouse/deployment-self-extracting 
Upload to S3 compressed self-extracting clickhouse
 2022-07-04 01:45:09 -04:00
Mikhail f. Shiryaev
27bd355525
Use cached image from the release branch for backport PRs 2022-07-01 16:49:27 +02:00
Mikhail f. Shiryaev
6a67be3195
Get a proper set of changed files for backport PRs 2022-07-01 15:34:46 +02:00
Mikhail f. Shiryaev
b8fa26f94f
Fix wrong self.changed_files type 2022-07-01 15:34:45 +02:00
Mikhail f. Shiryaev
7cc063a1d0
Fix strange backport titles issues 2022-07-01 12:46:25 +02:00
Yakov Olkhovskiy
12290dd644
upload from self-extracting directory 2022-06-30 17:35:42 -04:00
Mikhail f. Shiryaev
738769d1f7
Download arm64 packages and push to artifactory 2022-06-30 16:31:39 +02:00
Mikhail f. Shiryaev
6925bd6a03
Fix hardcoded retries for get_with_retries 2022-06-30 16:31:37 +02:00
Mikhail f. Shiryaev
e76ebdfb47
Change clickhouse-{client,server} packages architecture 2022-06-30 16:31:31 +02:00
Mikhail f. Shiryaev
498a9cc8d4
Terminate instance if docker does not start on post-hook 2022-06-29 12:54:33 +02:00
Mikhail f. Shiryaev
80e7abd0fe
Merge pull request #38548 from excitoon-favorites/ci-integration-tests-test 
Don't spoil return code of integration tests runner with redundant tee
 2022-06-29 11:18:53 +02:00
Vladimir Chebotarev
f7ef571842 Don't spoil return code of integration tests runner with redundant tee. 2022-06-29 06:11:09 +03:00
Mikhail f. Shiryaev
e1ac7477c9
Avoid killing terminate-instances task 2022-06-28 17:51:47 +02:00
Mikhail f. Shiryaev
94f932add1
A tiny improvement in logging 2022-06-28 10:27:25 +02:00
Mikhail f. Shiryaev
6a67ba91cf
Add public hostname for runner 2022-06-27 14:46:28 +02:00
Mikhail f. Shiryaev
f2611c3707
Refresh team keys for each runner 2022-06-27 14:45:50 +02:00