Commit Graph

2416 Commits

Author SHA1 Message Date
Mikhail f. Shiryaev
2232663216
Insignificant typing improvements 2024-01-08 15:31:57 +01:00
Mikhail f. Shiryaev
f38510be86
Do not fail the CI on an expired token 2024-01-08 10:43:55 +01:00
Robert Schulze
53965bb9f1
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main 2024-01-07 14:11:22 +00:00
Max Kainov
deda52b611 add packager script to build digest 2024-01-06 16:23:20 +00:00
Sema Checherinda
c59a72b987 fix special build, add randomization to stateless tests 2024-01-05 13:42:30 +00:00
Mikhail f. Shiryaev
dd7aca4d69
Revert "Fix an error in the release script - it didn't allow to make 23.12." 2023-12-30 18:35:42 +01:00
Alexey Milovidov
9d1e124102 Let me do the release 2023-12-28 11:21:58 +01:00
Mikhail f. Shiryaev
74dd63f956
Add a hack to un-/mark PR as a draft
#job_package_debug
2023-12-22 22:26:38 +01:00
Mikhail f. Shiryaev
e7c22fef7b
Rename ccache_utils to cache_utils 2023-12-22 22:26:37 +01:00
Mikhail f. Shiryaev
b386674ede
Add GitHubCache class, generalize Cache class 2023-12-22 22:26:36 +01:00
jinjunzh
aaf98f0ed7 refine setting with enable_zstd_qat_codec 2023-12-22 14:24:15 -05:00
Mikhail f. Shiryaev
a54dfabf0e
Add full repo name to the PR cache name 2023-12-22 17:52:15 +01:00
Alexey Milovidov
7f7e80ea56
Merge pull request #58130 from ClickHouse/integration-tests-images
Use the single images list for integration tests everywhere
2023-12-22 06:04:43 +01:00
Max K
8ac13b3e26
Support "do not test" label with ci.py (#58128)
* support "do not test" label with ci.py


Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2023-12-21 18:08:25 +01:00
Mikhail f. Shiryaev
4a04a1316f
Add a tag processing for python-bottle 2023-12-21 16:11:54 +01:00
Mikhail f. Shiryaev
177f8f7d0d
Create a single point of true for integration tests images 2023-12-21 16:09:56 +01:00
Max K
2dcffcc41c
fix (#58125) 2023-12-21 14:14:51 +01:00
Max Kainov
afdc0548e5 limited ci on master for docs only 2023-12-21 11:37:39 +00:00
Max K
cb53ee63be
Add GH status for PR formatting (#58050)
* add GH status for PR formatting
 #no-merge-commit
2023-12-21 11:53:01 +01:00
Max K
e0a790de1e
Fix for nightly job for digest-ci (#58079)
* Fix for run_always job - do not set done
 #no-merge-commit
2023-12-20 21:28:54 +01:00
Julia Kartseva
2c32589949
Merge pull request #58019 from jkartseva/fix-build-errno-exception
fix freebsd build
2023-12-19 11:16:45 -08:00
Max K
d8383377ea
always run ast_fuzz and sqllancer #no-merge-commit (#58049) 2023-12-19 20:14:47 +01:00
vdimir
252cb8a507
Merge pull request #54602 from fionera/issue-49028
Add setting http_make_head_request
2023-12-19 13:33:59 +01:00
Max Kainov
276f040dd0 ci fix
https://github.com/ClickHouse/ClickHouse/actions/runs/7256640256/job/19769624432?pr=58015#step:8:5466
```
Dec 19 03:09:41 /build/src/IO/AIO.cpp:140:15: error: use of undeclared identifier 'ErrnoException'; did you mean 'DB::ErrnoException'?
Dec 19 03:09:41   140 |         throw ErrnoException(DB::ErrorCodes::CANNOT_IOSETUP, "io_setup failed");
```
2023-12-19 10:24:36 +00:00
Max K
528df04b87
add needs_changed_files flag for pr_info (#58003) 2023-12-18 17:54:27 +01:00
Max K
b9408125cc
CI for docs only fix (#57992)
* run only docs related jobs if changes are in docs only (fix after applying CI with digest)
2023-12-18 17:06:10 +01:00
Mikhail f. Shiryaev
e0ffd3726d
Avoid situations with too long status descriptions 2023-12-18 13:45:15 +01:00
Mikhail f. Shiryaev
7441fe45cc
Apply isort for imports 2023-12-18 13:44:11 +01:00
Mikhail f. Shiryaev
9a2ee55b5e
Fix style-check checkout head-ref 2023-12-18 13:21:13 +01:00
Max K
84e5870b71
Reapply "improve CI with digest for docker, build and test jobs" (#57904)
* Revert "Revert "improve CI with digest for docker, build and test jobs""

* fix: docker manifest merge for missing images only
2023-12-18 09:07:22 +01:00
Max K
8c7add0334 Revert "improve CI with digest for docker, build and test jobs (#56317)"
This reverts commit 7844fcc196.
2023-12-15 15:48:01 +01:00
Max K
7844fcc196
improve CI with digest for docker, build and test jobs (#56317)
* CI with digests to tag docker images, reuse builds, reuse tests and others
2023-12-15 15:21:20 +01:00
Mikhail f. Shiryaev
deb054dc7e
Add logging for the search PRs to backport query 2023-12-15 13:28:25 +01:00
Mikhail f. Shiryaev
e11fa23032
Add argument to fill the gap in cherry-pick 2023-12-15 12:56:35 +01:00
Alexey Milovidov
62b6d1ef5e iMerge branch 'master' of github.com:ClickHouse/ClickHouse into clickbench-ci 2023-12-13 01:41:27 +01:00
Mikhail f. Shiryaev
88566b57db
Merge pull request #57600 from ClickHouse/fix-killed-jobs-detection
Identify failed jobs in lambda and mark as steps=0
2023-12-12 15:30:49 +01:00
Alexey Milovidov
7ff3021112 Fix Docker 2023-12-12 14:12:10 +01:00
Mikhail f. Shiryaev
cfe6bc2cc5
Replace len by sum for generator 2023-12-12 14:05:59 +01:00
Alexey Milovidov
8a68a4247e Style 2023-12-12 07:58:54 +01:00
Alexey Milovidov
9789c2caa2 Review fixes 2023-12-12 05:48:09 +01:00
Alexey Milovidov
0c81892463
Update tests/ci/clickbench.py
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2023-12-12 00:43:06 +03:00
Alexey Milovidov
a3262003f3
Update tests/ci/integration_test_check.py
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2023-12-12 00:42:47 +03:00
Alexey Milovidov
b9b6e7584e
Update tests/ci/fast_test_check.py
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2023-12-12 00:42:41 +03:00
Alexey Milovidov
fcb8ab9b63
Update tests/ci/functional_test_check.py
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2023-12-12 00:42:23 +03:00
Mikhail f. Shiryaev
7bd6b42af2
Merge pull request #57744 from ClickHouse/fix-dockerub-proxy
Tune network memory for dockerhub proxy hosts
2023-12-11 14:25:51 +01:00
Max K
f5ba4ef9b3
Tune autoscale to scale for single job in the queue (#57742)
* tune setting desired capacity

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2023-12-11 13:07:56 +01:00
Mikhail f. Shiryaev
9307a87118
Tune network memory for dockerhub proxy hosts 2023-12-11 12:56:52 +01:00
Alexey Milovidov
4b13a6d08f Fix CI 2023-12-10 22:02:05 +01:00
Alexey Milovidov
6b55c16b4e mypy 2023-12-10 20:49:03 +01:00
Alexey Milovidov
c6f1832686 Merge branch 'clickbench-ci' of github.com:ClickHouse/ClickHouse into clickbench-ci 2023-12-10 19:55:18 +01:00
Alexey Milovidov
ce894c28f3 mypy 2023-12-10 19:54:59 +01:00
Alexey Milovidov
75df8db298 Python 2023-12-10 19:52:52 +01:00
robot-clickhouse
c1e387d682 Automatic style fix 2023-12-10 18:32:09 +00:00
Alexey Milovidov
99c8430c3e mypy 2023-12-10 19:10:44 +01:00
Alexey Milovidov
11dda11f22 Python 2023-12-10 19:08:50 +01:00
Alexey Milovidov
af48cb9732 Python 2023-12-10 00:35:04 +01:00
Alexey Milovidov
ea31c8471f Python 2023-12-10 00:26:44 +01:00
Alexey Milovidov
2602a7ba81 Python 2023-12-10 00:22:19 +01:00
Alexey Milovidov
01487af489 Merge branch 'clickbench-ci' of github.com:ClickHouse/ClickHouse into clickbench-ci 2023-12-10 00:03:51 +01:00
Alexey Milovidov
17772dc41c Recommendation from @felixoid 2023-12-10 00:03:33 +01:00
robot-clickhouse
f8f42d82dd Automatic style fix 2023-12-09 22:52:58 +00:00
Alexey Milovidov
3ac3a06561 Add ClickBench to CI 2023-12-09 23:31:05 +01:00
Alexey Milovidov
0157066fc5 Merge branch 'master' into musl-7 2023-12-09 15:19:38 +01:00
Max K
a12c685015
Update tests/ci/autoscale_runners_lambda/test_autoscale.py
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2023-12-08 10:40:16 +01:00
Alexey Milovidov
15a0e6ab05 Merge branch 'master' into musl-7 2023-12-08 03:19:55 +01:00
Mikhail f. Shiryaev
b44dadc5c6
Identify failed jobs in lambda and mark as steps=0 2023-12-07 01:35:47 +01:00
robot-clickhouse
33fd370c94 Automatic style fix 2023-12-06 19:18:26 +00:00
Max Kainov
e2daad2065 tune scale up/down multipliers 2023-12-06 18:55:57 +00:00
vdimir
4e9402c3fc
Merge pull request #57413 from ClickHouse/vdimir/bugfix_validate_check_exceptions
Consider whole check failure in bugfix validate check as an error
2023-12-05 15:01:46 +01:00
vdimir
4ec21e94a5
Set http_make_head_request onlt in stress tests 2023-12-04 16:58:51 +01:00
alesapin
a5782cb56b Revert "Revert bugfix check fix attempt"
This reverts commit dcc5ae2928.
2023-12-03 16:04:22 +01:00
kssenii
dcc5ae2928 Revert bugfix check fix attempt 2023-12-01 20:23:39 +01:00
vdimir
d2bea265c9
Consider whole check failure in bugfix validate check as an error 2023-12-01 09:57:29 +00:00
kssenii
0e9aa9b1cd Try fix bugfix check 2023-11-30 14:14:32 +01:00
Mikhail f. Shiryaev
59cf90876c
Changes after a review 2023-11-28 12:19:27 +01:00
Mikhail f. Shiryaev
4aac18d651
Add another header for the wrong conflicts resolution 2023-11-28 12:01:33 +01:00
Mikhail f. Shiryaev
8c4592f5c2
Follow up recommendations from #57167 2023-11-28 11:51:06 +01:00
alesapin
b26767d5bb Add some additional groups to CI 2023-11-27 13:43:40 +01:00
Alexey Milovidov
b2d8103d19 Add special build with Musl 2023-11-26 02:27:54 +01:00
Alexey Milovidov
d7e64fa446
Merge pull request #57150 from azat/ci/no-partial-results
Remove partial results from build matrix for stress tests
2023-11-25 22:55:14 +01:00
Alexey Milovidov
91cc132feb
Merge pull request #56873 from ClickHouse/memory-for-client-in-stress-and-fuzzer
Set limit for memory usage for client in Stress tests and ASTFuzzers
2023-11-24 23:15:27 +01:00
Alexey Milovidov
13181db20e
Update stress.py 2023-11-24 23:11:23 +03:00
Mikhail f. Shiryaev
36d27d1713
Improve the cherry-pick PR description 2023-11-23 19:28:58 +01:00
Azat Khuzhin
d81fb9d117 Remove partial results from build matrix for stress tests
The feature had been reverted in #55893

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-23 16:39:52 +01:00
Michael Kolupaev
ff6dfd2490 Run CI for PRs with missing documentation if 'can be tested' label is present 2023-11-20 21:57:45 +00:00
Mikhail f. Shiryaev
362c15d9ea
Fix logging for profile JSON files 2023-11-20 15:15:38 +01:00
Mikhail f. Shiryaev
6da51942eb
Follow up the fix from #44311 2023-11-20 15:15:35 +01:00
Nikita Mikhaylov
427d9fff70 Set limit for memory 2023-11-16 19:13:25 +01:00
Mikhail f. Shiryaev
152758d6df
Merge pull request #56459 from ClickHouse/update-ami
Update the AMI receipt
2023-11-16 18:42:26 +01:00
Mikhail f. Shiryaev
f02ed02e4a
Terminate spot instances older than 1h 2023-11-16 16:35:34 +01:00
Mikhail f. Shiryaev
7c758d1b2d
Define the INIT_ENVIRONMENT through instances tags 2023-11-16 15:53:34 +01:00
Mikhail f. Shiryaev
002c4af384
Merge pull request #56785 from ClickHouse/another-digest-test
Add test for avoided recursion
2023-11-15 13:03:40 +01:00
Mikhail f. Shiryaev
e628114729
Add test for avoided recursion 2023-11-15 12:26:20 +01:00
Mikhail f. Shiryaev
30c6cea895
Fix another place with offset-aware datetime 2023-11-15 11:09:13 +01:00
Mikhail f. Shiryaev
ad3f422cff
Get rid of datetime in calculation of since_updated 2023-11-15 10:53:55 +01:00
Mikhail f. Shiryaev
eb4add06ba
Rewrite repo.organization._url to a proper repo._makeStringAttribute 2023-11-15 10:35:39 +01:00
Mikhail f. Shiryaev
8fbc0d3d51
Disable autoupdate for GH runners to speed-up boot 2023-11-14 15:48:01 +01:00
Mikhail f. Shiryaev
556e0faad2
Make sleep in init_runner loop global 2023-11-14 15:48:00 +01:00
Mikhail f. Shiryaev
b4cc55ea34
Deploy cloud-init script to S3 for following usage 2023-11-14 15:48:00 +01:00
Mikhail f. Shiryaev
5f9704a3c1
Kill forgotten Runner.Listener too 2023-11-14 15:47:59 +01:00
Mikhail f. Shiryaev
e77c9fbd53
Add TOE in the comment, find and fix possible issues for the second run 2023-11-14 15:47:59 +01:00
Mikhail f. Shiryaev
0c0f70d26d
Add the installing of azure cli 2023-11-14 15:47:58 +01:00
Mikhail f. Shiryaev
094eebde4f
Update the runner version 2023-11-14 15:47:57 +01:00
Mikhail f. Shiryaev
8a36f2fa4c
Rewrite builds reports to reusable workflow 2023-11-13 12:49:37 +01:00
Mikhail f. Shiryaev
7d3440add5
Delete codebrowser leftovers 2023-11-13 12:49:35 +01:00
Mikhail f. Shiryaev
15d27d5e85
Rewrite docs test to reusable workflow 2023-11-13 12:49:33 +01:00
Mikhail f. Shiryaev
6e00e14a45
Rewrite libfuzzer tests to reusable workflow
Update fuzzers clang version
2023-11-13 12:49:33 +01:00
Mikhail f. Shiryaev
b6a71ae6f4
Rewrite fast tests to reusable workflow 2023-11-13 12:49:33 +01:00
Mikhail f. Shiryaev
6f8baf3def
Rewrite style checks to reusable workflow 2023-11-13 12:49:32 +01:00
Mikhail f. Shiryaev
38b251946e
Add another check to CiConfig.validate, and test for it 2023-11-13 12:49:31 +01:00
Alexey Milovidov
9436209950 Fix error 2023-11-13 05:06:37 +01:00
Alexey Milovidov
7fc3cebd91 Fix error 2023-11-13 04:00:13 +01:00
Alexey Milovidov
c9f5ef0b1a Fix error 2023-11-13 03:14:29 +01:00
Alexey Milovidov
17669111fc Python 2023-11-12 08:07:14 +01:00
robot-clickhouse
c74aea08b2 Automatic style fix 2023-11-12 04:10:47 +00:00
Alexey Milovidov
fb8f9f5fed Fix error 2023-11-12 04:52:49 +01:00
Alexey Milovidov
6c30aa121c Collect information about binary sizes to the CI database 2023-11-12 04:01:59 +01:00
Alexey Milovidov
38ca18d8e7
Merge pull request #56617 from ClickHouse/publish-stripped-binary
Publish stripped binary
2023-11-11 22:18:26 +01:00
Alexey Milovidov
9824631044 Apply LowCardinality in more places 2023-11-11 07:46:35 +01:00
Alexey Milovidov
df24ef42b1 Publish stripped binary 2023-11-11 07:27:10 +01:00
Mikhail f. Shiryaev
a807a80d1e
Merge pull request #56385 from ClickHouse/modules-actions
Rewrite jobs to use callable workflow
2023-11-09 15:19:58 +01:00
Robert Schulze
949863872a
Merge pull request #56059 from rschu1ze/bump-grpc
Bump gRPC to v1.47.5
2023-11-09 11:35:38 +01:00
Robert Schulze
b9fafb5561
Try to fix sparse checkout 2023-11-08 17:18:05 +00:00
Mikhail f. Shiryaev
6dc0534143
Move sparse checkout logic to ci_config 2023-11-08 17:16:18 +01:00
Mikhail f. Shiryaev
af2795ad75
Work around issues with GH callable actions 2023-11-08 17:16:17 +01:00
Mikhail f. Shiryaev
1e981120c1
Merge pull request #56422 from ClickHouse/speed-up-autoscaling
Make autoscaling more responsive
2023-11-08 12:47:22 +01:00
Alexander Tokmakov
8fb594dd5e
Merge pull request #56388 from ClickHouse/tavplubix-patch-10
Update stress.py
2023-11-07 18:58:25 +01:00
Mikhail f. Shiryaev
4df3a7cc8b
Make autoscaling more responsive 2023-11-07 17:49:22 +01:00
Mikhail f. Shiryaev
b981a94bc7
Merge pull request #56305 from ClickHouse/digests
Implement digest helpers for different objects
2023-11-07 17:46:29 +01:00
Alexander Tokmakov
0fbb32c8ee Merge branch 'master' into tavplubix-patch-10 2023-11-06 20:59:16 +01:00
vdimir
cc25f66b03
Merge pull request #56243 from ClickHouse/vdimir/fix_check_url_in_commit_status
Fix link to failed check report in status commit
2023-11-06 20:27:18 +01:00
Alexander Tokmakov
101975705e
Update stress.py 2023-11-06 19:59:43 +01:00
robot-clickhouse
43f2b59625 Automatic style fix 2023-11-06 18:31:15 +00:00
Alexander Tokmakov
93cb51bad5
Update stress.py 2023-11-06 19:13:26 +01:00
Mikhail f. Shiryaev
53033d2347
Add a consistent digest and tests 2023-11-06 16:43:26 +01:00
Mikhail f. Shiryaev
4fe3d10604
Unify all workflows for python unit tests, follow naming best practices 2023-11-06 11:14:57 +01:00
Mikhail f. Shiryaev
e352e7bfba
Change digest API to update the single hash object 2023-11-03 17:42:09 +01:00
Mikhail f. Shiryaev
f7c5602da4
Add digest_paths 2023-11-03 17:42:09 +01:00
Mikhail f. Shiryaev
3e8ad14423
Implement digest helpers for different objects 2023-11-03 17:42:08 +01:00
Mikhail f. Shiryaev
77f4ec4422
Add evidence of failed integrations infrastructure 2023-11-02 11:36:18 +01:00
vdimir
9021667f82
Fix link to failed check report in status commit 2023-11-02 08:44:03 +00:00
Max K
a531ffc35d
Update fast_test_check.py 2023-10-31 12:47:21 +01:00
robot-clickhouse
a20f43c492 Automatic style fix 2023-10-31 11:43:32 +00:00
Max Kainov
9135d6c3eb set timeout via argparse 2023-10-31 11:32:08 +00:00
Max Kainov
9bb7de07e0 fasttest timeout set by env 2023-10-31 11:01:49 +00:00
Raúl Marín
71dfdf5bfe
Merge pull request #56009 from Algunenano/stress_cont
Stress tests: Try to wait until server is responsive after gdb detach
2023-10-26 11:37:49 +02:00
vdimir
12890eb70c
Merge pull request #55806 from canhld94/rocksdb_trivial_count
Support trivial count for rocksdb and storage join
2023-10-26 11:22:38 +02:00
Raúl Marín
ef2740052e Attempt to wait until server is responsive after gdb detach 2023-10-25 10:15:35 +00:00
vdimir
72f2288ee4
Add optimize_trivial_approximate_count_query to stress tests 2023-10-24 12:44:18 +02:00
Alexander Tokmakov
6167bf4fca
Update stress.py 2023-10-23 17:27:38 +02:00
robot-clickhouse
f377f4f594 Automatic style fix 2023-10-20 19:06:01 +00:00
Alexander Tokmakov
8a0eae21f5
Update stress.py 2023-10-20 20:45:16 +02:00
Mikhail f. Shiryaev
6a37546a6f
Merge pull request #55874 from ClickHouse/universal-diff-urls
One final leftover in diff_urls of PRInfo
2023-10-20 17:49:14 +02:00
Mikhail f. Shiryaev
849e44138a
One final leftover in diff_urls of PRInfo 2023-10-20 17:19:46 +02:00
Mikhail f. Shiryaev
fb5bc09535
Fix caching objects in pygithub, and changelogs 2023-10-19 19:45:16 +02:00
Mikhail f. Shiryaev
d8b899d22b
Use a proper tag from default.checks for enriched images 2023-10-19 11:35:35 +02:00
Mikhail f. Shiryaev
d957d60a52
Use publicly available play.clickhouse.com to search built images 2023-10-19 11:35:10 +02:00
Antonio Andelic
71adb434e3 Remove f-string 2023-10-18 09:19:09 +00:00
Antonio Andelic
be7be17352
add comment 2023-10-18 10:22:18 +02:00
Antonio Andelic
70d366a8eb Control feature flag randomization with env 2023-10-18 07:59:49 +00:00
Mikhail f. Shiryaev
b382705c2d
Use diff object again, since JSON API limits the files 2023-10-17 17:49:06 +02:00
Max Kainov
ad38c433a1 fix commit labels for diff 2023-10-17 08:48:25 +00:00
Max Kainov
fc9a5a725c Revert "Revert "Integration check script fix ups""
This reverts commit 67b9407530.
2023-10-17 08:18:17 +00:00
alesapin
67b9407530
Revert "Integration check script fix ups" 2023-10-16 22:01:44 +02:00
Max Kainov
4d1edc2780 return back unidiff module 2023-10-16 15:00:13 +00:00
Max Kainov
683437c61c fix docs and script 2023-10-16 10:35:14 +00:00
Max Kainov
60ad1c79bd fix docs 2023-10-16 10:35:14 +00:00
robot-clickhouse
7c2fee3280 Automatic style fix 2023-10-16 10:35:14 +00:00
Max Kainov
3f3fcce7e5 gh api request func update 2023-10-16 10:35:14 +00:00
Mikhail f. Shiryaev
c5ebd6f072 Use requests.gte in get_gh_api 2023-10-16 10:35:14 +00:00
Mikhail f. Shiryaev
346e8a0162 Remove recursion in favor of reset retry loop 2023-10-16 10:35:14 +00:00
Max Kainov
f1c316b79b ci script to use git hub api urls, readme for test 2023-10-16 10:35:13 +00:00
Han Fei
0167b76e98 fix structure does not match logs again 2023-10-14 16:01:32 +02:00
Han Fei
e3ceca06e0 cast extra column expression pull_request_number to Int32 2023-10-13 14:52:25 +02:00
Mikhail f. Shiryaev
e60983f5ae
Do not fail if label-to-remove does not exists in PR 2023-10-13 13:32:56 +02:00
Alexey Milovidov
8f54123901
Update pr.py 2023-10-11 20:38:37 +03:00
Alexey Milovidov
f4ccf9f94f
Update pr.py 2023-10-11 20:38:19 +03:00
Alexey Milovidov
c04a33a70a
Update pr.py 2023-10-11 20:38:01 +03:00
Mike Kot
125250b4fd add k-morozov to trusted 2023-10-11 17:25:54 +00:00
Mikhail f. Shiryaev
59a1947653
Fix broken style check get_images 2023-10-04 14:29:01 +02:00
Mikhail f. Shiryaev
d94228b718
Fix style-check errors 2023-10-04 14:29:00 +02:00
Alexey Milovidov
be9a3cea42
Merge pull request #55122 from ClickHouse/vdimir/status_comment_link
Add links to check reports in status comment
2023-09-30 08:55:54 +03:00
Mikhail f. Shiryaev
fe155c61d4
Merge pull request #54532 from ClickHouse/Fix_ci_skip_build_and_skip_tests
Fix CI skip build and skip tests checks
2023-09-29 14:01:35 +02:00
vdimir
7c471be846
Fix link in table in status comment 2023-09-29 12:00:07 +02:00
vdimir
37bd5dd7be
Add links to check reports in status comment 2023-09-29 08:46:23 +00:00
vdimir
3a9abde35d
Merge pull request #54514 from ClickHouse/vdimir/allow_experimental_partial_result
Add setting allow_experimental_partial_result
2023-09-29 10:32:57 +02:00
vdimir
fff77876f9
Add partial_result_update_duration_ms to stress tests 2023-09-28 09:41:00 +00:00
Mikhail f. Shiryaev
183af376e1
Add a digest result in the end of the report 2023-09-28 11:22:38 +02:00
Mikhail f. Shiryaev
f19c172c5e
Move to parsing json reports of google test 2023-09-28 09:39:56 +02:00
Mikhail f. Shiryaev
1dddd8f08f
Fix the failing sqllogic jobs 2023-09-28 01:24:33 +02:00
Mikhail f. Shiryaev
eb00284896
Fix DownloadException 2023-09-28 01:24:32 +02:00
Mikhail f. Shiryaev
c5b1aa4aa5
Clean even more os.path 2023-09-28 01:24:31 +02:00
Mikhail f. Shiryaev
ff58e152d8
Remove os.path from docker related scripts 2023-09-28 01:20:36 +02:00
Mikhail f. Shiryaev
2d1dba372e
Get rid of the most of os.path stuff 2023-09-28 01:20:05 +02:00
Smita Kulkarni
c3f3824562 Merge branch 'master' into Fix_ci_skip_build_and_skip_tests 2023-09-24 13:31:24 +02:00
Smita Kulkarni
91149bc5a9 Fixed sha check 2023-09-24 13:30:38 +02:00
Robert Schulze
9a91f97ac4
Merge pull request #53831 from rschu1ze/clang-17
Switch CI to Clang 17
2023-09-22 12:28:35 +02:00
Robert Schulze
5209bd2d51
Merge remote-tracking branch 'rschu1ze/master' into clang-17 2023-09-21 14:45:55 +00:00
Mikhail f. Shiryaev
78b9d00966
Decrease timeout for fast tests with a commit 2023-09-21 16:25:17 +02:00
Mikhail f. Shiryaev
6acdd65c8e
Launch fast tests as the current user 2023-09-20 22:32:19 +02:00
Mikhail f. Shiryaev
dd7096bc59
Speed up fast tests a little bit 2023-09-20 19:09:06 +02:00
vdimir
65baf129bf
Do not set PR status label 2023-09-20 09:21:58 +00:00
Robert Schulze
cbcff6ef08
Merge remote-tracking branch 'rschu1ze/master' into clang-17 2023-09-20 09:15:58 +00:00
Mikhail f. Shiryaev
4882b99715
Merge pull request #54310 from ClickHouse/ci-libfuzzer-integration
CI: libFuzzer integration
2023-09-20 10:01:39 +02:00
Yakov Olkhovskiy
b1b49f430a review suggestions 2023-09-19 15:32:58 +00:00
Smita Kulkarni
132bcbe3a4 Merge branch 'master' into Fix_ci_skip_build_and_skip_tests 2023-09-19 16:16:17 +02:00
Smita Kulkarni
d07c2dc271 Added datatype and return type to function 2023-09-18 22:09:59 +02:00
Robert Schulze
3a3a00f95e
Bump minimal required compiler to Clang 16 2023-09-18 17:44:04 +00:00
robot-clickhouse
009d22b3d7 Automatic style fix 2023-09-18 12:21:11 +00:00
Smita Kulkarni
0c26f41ac9 Fixed style 2023-09-18 14:07:31 +02:00
robot-clickhouse
0a042fc3f0 Automatic style fix 2023-09-18 09:50:17 +00:00
Smita Kulkarni
a445335d91 Fixed style check 2023-09-18 11:23:28 +02:00
robot-clickhouse
b7e0b8ca77 Automatic style fix 2023-09-18 09:01:25 +00:00
Smita Kulkarni
0b172ed173 Updated version check in integration test & updated to check test_type in functional tests 2023-09-18 10:47:33 +02:00
Yakov Olkhovskiy
dd6f12dd94 review suggestions 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
3a14bde95a cleanup, fix tee to escape non-decodable symbols 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
cd0c775355 review suggestions 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
d80ae88060 run docker 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
1ad0a77c9f unzip corpora 2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
44546458f0 add infrastructure files to the download filter 2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
0847889db6 libFuzzer infrastructure 2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
b7a17bf8dd add libFuzzer tests, initial integration 2023-09-17 16:36:49 +00:00
Mikhail f. Shiryaev
4c9f8d150b
Merge pull request #54504 from ClickHouse/s3-artifacts
S3 artifacts
2023-09-15 18:21:57 +02:00
robot-ch-test-poll
3af3114478
Merge pull request #54668 from Avogar/better-ci-libs
Move all `tests/ci/*.lib files` to `stateless-tests` image
2023-09-15 17:40:01 +02:00
Igor Nikonov
eb6fceccbb
Merge pull request #54278 from ClickHouse/ci-check-process-timeout
CI: a try to handle tests timeouts
2023-09-15 17:13:16 +02:00
Mikhail f. Shiryaev
964b9ede2d
Improve index.html for the non-CI runnings 2023-09-15 15:00:35 +02:00
Mikhail f. Shiryaev
5200a8dadc
Create directory for archives if not exists 2023-09-15 15:00:32 +02:00
Mikhail f. Shiryaev
414594a472
Decouple ArtifactsHelper commit status 2023-09-15 14:54:48 +02:00
Mikhail f. Shiryaev
40e04fee6c
Report only changed images in commit status 2023-09-15 14:54:47 +02:00
Mikhail f. Shiryaev
5ead298d53
Improve S3Helper url handling, ArtifactsHelper local artifacts 2023-09-15 14:54:47 +02:00
Mikhail f. Shiryaev
51e79e1ddf
Create commit status for Artifacts 2023-09-15 14:54:46 +02:00
Mikhail f. Shiryaev
3f350eb148
Create artifact_helper for lightweight workflow artifacts 2023-09-15 14:54:45 +02:00
Mikhail f. Shiryaev
eef15ff67a
Insignificant improvements to git_helper and compress_files 2023-09-15 14:54:44 +02:00
Mikhail f. Shiryaev
2f8f16a864
Fix git_helper import issue with git_runner.run() 2023-09-15 14:54:44 +02:00
Mikhail f. Shiryaev
fde8817fb7
Fix PRInfo and docker_images_check typing 2023-09-15 14:54:42 +02:00
avogar
d5889c8cc8 Move all tests/ci/*.lib files to stateless-tests image 2023-09-15 11:27:09 +00:00
János Benjamin Antal
13868e4d1d Fix review comments 2023-09-14 14:45:23 +00:00
János Benjamin Antal
f7ceb76dcb Fix pylint and mypy issues 2023-09-14 13:41:34 +00:00
János Benjamin Antal
699bf031c9 Remove accidentally committed code 2023-09-14 12:07:15 +00:00
János Benjamin Antal
51781a6a86 Add workflow 2023-09-14 12:05:50 +00:00
János Benjamin Antal
078c16760f Add --remote-protocol arg 2023-09-14 12:05:49 +00:00
robot-clickhouse
0fda5e4bf2 Automatic style fix 2023-09-14 11:44:34 +00:00
János Benjamin Antal
da802b2688 Do the release 2023-09-14 11:28:35 +00:00
János Benjamin Antal
b13a07863d Add gh_cache to gitignore to pass dirty check 2023-09-14 11:17:20 +00:00
János Benjamin Antal
6df371754d Fix typos in release.py 2023-09-14 10:54:17 +00:00
János Benjamin Antal
33eeb0737f Fix style errors 2023-09-14 10:23:26 +00:00
János Benjamin Antal
462f4111de Turn PoC into real script without calling release.py 2023-09-13 23:33:04 +00:00
robot-clickhouse
94b6d9ed05 Automatic style fix 2023-09-13 17:16:17 +00:00
János Benjamin Antal
84e311321d Add basic logic to find releasable commits 2023-09-13 17:05:31 +00:00
robot-clickhouse
3ed7f47af9 Automatic style fix 2023-09-13 16:56:14 +00:00
Smita Kulkarni
1ec52de797 Addressed review comments 2023-09-13 18:37:03 +02:00
robot-clickhouse
fe2240afbf Automatic style fix 2023-09-13 08:23:14 +00:00
Smita Kulkarni
176bd0e509 Fixed function call and added check for FORCE_TESTS_LABEL 2023-09-13 09:58:57 +02:00
Mikhail f. Shiryaev
397a682d1c
Merge pull request #54441 from ClickHouse/vdimir/ci-commit-statis-update
Update automated commit status comment
2023-09-12 21:18:13 +02:00
Igor Nikonov
031da054f3 Return initial timeout 2023-09-12 19:06:39 +00:00
robot-clickhouse
63f71b719d Automatic style fix 2023-09-12 18:31:34 +00:00
Igor Nikonov
4671901313 Update stress_check.py 2023-09-12 18:17:55 +00:00
Igor Nikonov
8a4654c39e Address review comment 2023-09-12 18:06:00 +00:00
vdimir
acb559ce8b
Update tests/ci/commit_status_helper.py
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2023-09-12 17:34:52 +02:00
Igor Nikonov
7f90b7983c Merge remote-tracking branch 'origin/master' into ci-check-process-timeout 2023-09-12 13:41:35 +00:00
Igor Nikonov
8db991faa0 Fix style 2023-09-12 13:41:31 +00:00
vdimir
72d5a5d094
fix report.py 2023-09-12 11:54:35 +00:00
robot-clickhouse
5a7ecbc23e Automatic style fix 2023-09-12 10:18:40 +00:00
Smita Kulkarni
135c447f07 Updated check to fix style 2023-09-12 12:01:27 +02:00
robot-clickhouse
3b4120ba55 Automatic style fix 2023-09-12 08:51:21 +00:00
Smita Kulkarni
9accebe73d Updated can_skip_builds_and_use_version_from_master, can_skip_integration_tests, can_skip_functional_tests checks in ci 2023-09-12 10:30:59 +02:00
vdimir
790d61971c
sucessfull items in report can be expandable 2023-09-11 17:06:16 +00:00
vdimir
8bb0fbfd2c
fix 2023-09-11 17:03:28 +00:00
vdimir
4a80a0f1c0
upd 2023-09-11 16:13:52 +00:00
vdimir
960ca5ebde
Show PR status in label 2023-09-11 16:13:33 +00:00
vdimir
a1ee226969
Update PR status icons 2023-09-11 16:13:11 +00:00
vdimir
61fdb63aad
fix 2023-09-11 13:53:20 +00:00
vdimir
297306b4b9
status emoji in the beginning of title 2023-09-11 13:36:02 +00:00
Alexey Milovidov
c4c41cad23 Merge branch 'ci-instance-type' of github.com:ClickHouse/ClickHouse into ci-instance-type 2023-09-09 05:52:04 +02:00
Alexey Milovidov
154ac14ef6 Fix error 2023-09-09 05:51:43 +02:00
robot-clickhouse
923d7a0bc3 Automatic style fix 2023-09-09 00:27:39 +00:00
Alexey Milovidov
0728df37e6 Add instance_type column to CI Logs and the checks table 2023-09-09 01:44:14 +02:00
vdimir
6a51d9fd7d
do not merge this commit 2023-09-08 17:04:44 +00:00
vdimir
a46d1974ac
fix 2023-09-08 15:49:13 +00:00
vdimir
465d84aba7
Set raw_logs in create_ci_report 2023-09-08 15:39:07 +00:00
vdimir
b0b8255c6f
Set PR status into title 2023-09-08 15:36:32 +00:00
vdimir
5e0caa669e
Move sucessull checks in commit status under a spoiler 2023-09-08 09:56:53 +00:00
János Benjamin Antal
5862c4ec93
Use not the absolute latest docker image tag (#54369)
* Add params for select queries in clickhouse_helper.py

* Find the latest image tags from master

* Get full git history

* Do not checkout submodules

* Automatic style fix

* Fix style errors

* Make logging pretty

* Revert accidentally committed changes

* Eliminate pformat

* Update all workflows

* Remove flag with default value

* Improve exception handling

* Utilizing the loop condition in while loop

* Make the logic robust over temporary errors

* Prettify logs

* Automatic style fix

* Add accidentally removed line

* Revert "Make the logic robust over temporary errors"

This reverts commit 91e6b5d7ba.

* Do not fail in case the tag cannot be queried from ClickHouse

* Support partial finding of tags

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2023-09-08 08:42:56 +02:00
robot-clickhouse
c680c951d3 Automatic style fix 2023-09-07 13:12:53 +00:00
Igor Nikonov
27455a5882 Test timeout to fail 2023-09-07 12:57:35 +00:00
Igor Nikonov
c354fcaff7 Timeout report for stress_check 2023-09-07 12:56:22 +00:00
Igor Nikonov
a0317e461a Better description 2023-09-07 12:41:36 +00:00
Igor Nikonov
7ab56a13b8 Polishing 2023-09-06 22:49:28 +00:00
Igor Nikonov
babbecc646 Fix 2023-09-06 15:00:32 +00:00
Igor Nikonov
e858f0b880 Fix description length 2023-09-06 13:05:56 +00:00
Igor Nikonov
32048f2a8d Merge remote-tracking branch 'origin/master' into ci-check-process-timeout 2023-09-06 12:48:43 +00:00
Igor Nikonov
f6f2e731a7 Fix state 2023-09-06 12:44:39 +00:00
robot-clickhouse
f08d445a0f Automatic style fix 2023-09-06 11:59:51 +00:00
Igor Nikonov
a22e219be9 Fix 2023-09-06 11:51:43 +00:00
Igor Nikonov
3ef6d0da39 Set status and description 2023-09-06 11:02:17 +00:00
Mikhail f. Shiryaev
7f34c8e17d
Decouple env_helper.get_job_id_url 2023-09-06 12:43:29 +02:00
Mikhail f. Shiryaev
1afc5b7e05
Use suffix from git tags as version descriptions 2023-09-06 12:43:28 +02:00
Mikhail f. Shiryaev
6fc73e0e1f
Use a single BuildResult class across builds and report checks 2023-09-06 12:43:27 +02:00
Mikhail f. Shiryaev
88664bef3f
Create report status constants 2023-09-06 12:43:25 +02:00
Mikhail f. Shiryaev
428b72e767
Combine rows for build templates with lists 2023-09-06 12:43:23 +02:00