thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-14 03:25:15 +00:00
Code Issues Packages Projects Releases Wiki Activity
135,841 Commits 9,131 Branches 1,774 Tags 2.1 GiB
0df8db5c3f
Commit Graph

2295 Commits

Author SHA1 Message Date
Mikhail f. Shiryaev
7a911997ae
Fix git_helper.Runner.__call__ typing 2024-01-18 16:11:01 +01:00
Mikhail f. Shiryaev
61a79bac53
Copy local cache archives when CI is not set 2024-01-18 15:53:04 +01:00
Mikhail f. Shiryaev
d70c72b89e
Name stash properly 2024-01-18 15:53:02 +01:00
Mikhail f. Shiryaev
15cfc9b0ef
Fix stash and clear_repo contexts 
All the cleanup should be done in `finally` block:

```
In [3]: @contextmanager
   ...: def stash():
   ...:     try:
   ...:         print("inside")
   ...:         yield
   ...:     except (Exception, KeyboardInterrupt):
   ...:         print("catched")
   ...:         raise
   ...:     finally:
   ...:         print("always")
   ...:

In [4]: with stash():
   ...:     raise ValueError("something")
   ...:
inside
catched
always
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
Cell In[4], line 2
      1 with stash():
----> 2     raise ValueError("something")

ValueError: something

In [5]: @contextmanager
   ...: def stash():
   ...:     try:
   ...:         print("inside")
   ...:         yield
   ...:     finally:
   ...:         print("always")
   ...:

In [6]: with stash():
   ...:     raise ValueError("something")
   ...:
inside
always
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
Cell In[6], line 2
      1 with stash():
----> 2     raise ValueError("something")
```

And `except` block is unnecessary if it should just re-raise an error
 2024-01-18 15:25:59 +01:00
Max Kainov
4eb7cda8fa Add pr_info event type so that jobs could know how they launched 
#no_merge_commit #ci_set_reduced
 2024-01-18 13:31:37 +00:00
Max K
a4cab68a06
Merge pull request #58881 from ClickHouse/jepsen_to_reusable_builds 
Jepsen job to reuse builds
 2024-01-18 13:47:14 +01:00
Raúl Marín
cd4aefcddb Add missing files to digests 2024-01-18 13:36:05 +01:00
robot-clickhouse
db3ffa5c86 Automatic style fix 2024-01-18 12:11:03 +00:00
Alexey Milovidov
6d6b8fcf8e Add missing comments in code 2024-01-18 12:58:50 +01:00
Max Kainov
d387c84aa4 Jepsen job to reuse builds 
#no-merge-commit
 2024-01-18 11:58:41 +00:00
vdimir
bb8986de5d
Revert "break tests/integration/test_merge_tree_s3/test.py" 
This reverts commit 5dd231ede1.
 2024-01-18 08:56:05 +00:00
vdimir
c3788c2fa1
upd 2024-01-18 08:54:31 +00:00
vdimir
5dd231ede1
break tests/integration/test_merge_tree_s3/test.py 2024-01-18 08:54:31 +00:00
vdimir
a3b4b7e880
Print another message in Bugfix check if internal check had been failed 2024-01-18 08:54:27 +00:00
Alexey Milovidov
61101d1a57 Add a release build with coverage, turn off coverage in the debug build 2024-01-18 01:16:50 +01:00
Alexey Milovidov
c098f41dbc Merge branch 'master' into enable-coverage-for-debug-build 2024-01-17 22:35:51 +01:00
Mikhail f. Shiryaev
0b52dc0e33
Merge pull request #58920 from ClickHouse/cancel-MasterCI-in-prs 
Cancel MasterCI in PRs
 2024-01-17 18:58:23 +01:00
Mikhail f. Shiryaev
1d57666b19
Cancel MasterCI in PRs 2024-01-17 17:40:23 +01:00
Alexey Milovidov
1afc5e8c01 Enable coverage for debug build 2024-01-14 03:45:42 +01:00
Mikhail f. Shiryaev
9d8290cc50
Merge pull request #58712 from ClickHouse/helper-improvements 
Some small improvements to version_helper from #57203
 2024-01-12 17:40:14 +04:00
Mikhail f. Shiryaev
7ab571f0f0
Add ClickHouseVersion.is_lts 2024-01-11 11:42:59 +01:00
Mikhail f. Shiryaev
0572bf53ea
Add a new function to version_helper to get supported version from tags 2024-01-11 11:42:49 +01:00
Robert Schulze
ced9e93ac6
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main 2024-01-09 20:36:02 +00:00
Mikhail f. Shiryaev
ac1dac4fe3
Merge pull request #58619 from ClickHouse/s3-optional-client 
Optional `client` argument for `S3Helper`
 2024-01-09 16:52:42 +04:00
Sema Checherinda
6dbf7c967c
Merge pull request #57663 from ClickHouse/CheSema-remote-blobs-naming-2 
generate object storage key by template
 2024-01-09 13:26:56 +01:00
Mikhail f. Shiryaev
5ed4cd41d9
Extend S3Helper to accept a custom s3 client and endpoint 2024-01-09 13:10:34 +01:00
Mikhail f. Shiryaev
3875f4f4b5
Fix issue with default dataclass values 2024-01-09 13:10:28 +01:00
Mikhail f. Shiryaev
a2a3783366
Small renaming to reflect the current release process 2024-01-08 15:31:59 +01:00
Mikhail f. Shiryaev
fe19f45974
Simplify --type argument for release.py 2024-01-08 15:31:58 +01:00
Mikhail f. Shiryaev
2232663216
Insignificant typing improvements 2024-01-08 15:31:57 +01:00
Mikhail f. Shiryaev
f38510be86
Do not fail the CI on an expired token 2024-01-08 10:43:55 +01:00
Robert Schulze
53965bb9f1
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main 2024-01-07 14:11:22 +00:00
Max Kainov
deda52b611 add packager script to build digest 2024-01-06 16:23:20 +00:00
Sema Checherinda
c59a72b987 fix special build, add randomization to stateless tests 2024-01-05 13:42:30 +00:00
Mikhail f. Shiryaev
dd7aca4d69
Revert "Fix an error in the release script - it didn't allow to make 23.12." 2023-12-30 18:35:42 +01:00
Alexey Milovidov
9d1e124102 Let me do the release 2023-12-28 11:21:58 +01:00
Mikhail f. Shiryaev
74dd63f956
Add a hack to un-/mark PR as a draft 
#job_package_debug
 2023-12-22 22:26:38 +01:00
Mikhail f. Shiryaev
e7c22fef7b
Rename ccache_utils to cache_utils 2023-12-22 22:26:37 +01:00
Mikhail f. Shiryaev
b386674ede
Add GitHubCache class, generalize Cache class 2023-12-22 22:26:36 +01:00
jinjunzh
aaf98f0ed7 refine setting with enable_zstd_qat_codec 2023-12-22 14:24:15 -05:00
Mikhail f. Shiryaev
a54dfabf0e
Add full repo name to the PR cache name 2023-12-22 17:52:15 +01:00
Alexey Milovidov
7f7e80ea56
Merge pull request #58130 from ClickHouse/integration-tests-images 
Use the single images list for integration tests everywhere
 2023-12-22 06:04:43 +01:00
Max K
8ac13b3e26
Support "do not test" label with ci.py (#58128) 
* support "do not test" label with ci.py


Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
 2023-12-21 18:08:25 +01:00
Mikhail f. Shiryaev
4a04a1316f
Add a tag processing for python-bottle 2023-12-21 16:11:54 +01:00
Mikhail f. Shiryaev
177f8f7d0d
Create a single point of true for integration tests images 2023-12-21 16:09:56 +01:00
Max K
2dcffcc41c
fix (#58125) 2023-12-21 14:14:51 +01:00
Max Kainov
afdc0548e5 limited ci on master for docs only 2023-12-21 11:37:39 +00:00
Max K
cb53ee63be
Add GH status for PR formatting (#58050) 
* add GH status for PR formatting
 #no-merge-commit
 2023-12-21 11:53:01 +01:00
Max K
e0a790de1e
Fix for nightly job for digest-ci (#58079) 
* Fix for run_always job - do not set done
 #no-merge-commit
 2023-12-20 21:28:54 +01:00
Julia Kartseva
2c32589949
Merge pull request #58019 from jkartseva/fix-build-errno-exception 
fix freebsd build
 2023-12-19 11:16:45 -08:00
Max K
d8383377ea
always run ast_fuzz and sqllancer #no-merge-commit (#58049) 2023-12-19 20:14:47 +01:00
vdimir
252cb8a507
Merge pull request #54602 from fionera/issue-49028 
Add setting http_make_head_request
 2023-12-19 13:33:59 +01:00
Max Kainov
276f040dd0 ci fix 
https://github.com/ClickHouse/ClickHouse/actions/runs/7256640256/job/19769624432?pr=58015#step:8:5466
```
Dec 19 03:09:41 /build/src/IO/AIO.cpp:140:15: error: use of undeclared identifier 'ErrnoException'; did you mean 'DB::ErrnoException'?
Dec 19 03:09:41   140 |         throw ErrnoException(DB::ErrorCodes::CANNOT_IOSETUP, "io_setup failed");
```
 2023-12-19 10:24:36 +00:00
Max K
528df04b87
add needs_changed_files flag for pr_info (#58003) 2023-12-18 17:54:27 +01:00
Max K
b9408125cc
CI for docs only fix (#57992) 
* run only docs related jobs if changes are in docs only (fix after applying CI with digest)
 2023-12-18 17:06:10 +01:00
Mikhail f. Shiryaev
e0ffd3726d
Avoid situations with too long status descriptions 2023-12-18 13:45:15 +01:00
Mikhail f. Shiryaev
7441fe45cc
Apply isort for imports 2023-12-18 13:44:11 +01:00
Mikhail f. Shiryaev
9a2ee55b5e
Fix style-check checkout head-ref 2023-12-18 13:21:13 +01:00
Max K
84e5870b71
Reapply "improve CI with digest for docker, build and test jobs" (#57904) 
* Revert "Revert "improve CI with digest for docker, build and test jobs""

* fix: docker manifest merge for missing images only
 2023-12-18 09:07:22 +01:00
Max K
8c7add0334 Revert "improve CI with digest for docker, build and test jobs (#56317)" 
This reverts commit 7844fcc196.
 2023-12-15 15:48:01 +01:00
Max K
7844fcc196
improve CI with digest for docker, build and test jobs (#56317) 
* CI with digests to tag docker images, reuse builds, reuse tests and others
 2023-12-15 15:21:20 +01:00
Mikhail f. Shiryaev
deb054dc7e
Add logging for the search PRs to backport query 2023-12-15 13:28:25 +01:00
Mikhail f. Shiryaev
e11fa23032
Add argument to fill the gap in cherry-pick 2023-12-15 12:56:35 +01:00
Alexey Milovidov
62b6d1ef5e iMerge branch 'master' of github.com:ClickHouse/ClickHouse into clickbench-ci 2023-12-13 01:41:27 +01:00
Mikhail f. Shiryaev
88566b57db
Merge pull request #57600 from ClickHouse/fix-killed-jobs-detection 
Identify failed jobs in lambda and mark as steps=0
 2023-12-12 15:30:49 +01:00
Alexey Milovidov
7ff3021112 Fix Docker 2023-12-12 14:12:10 +01:00
Mikhail f. Shiryaev
cfe6bc2cc5
Replace len by sum for generator 2023-12-12 14:05:59 +01:00
Alexey Milovidov
8a68a4247e Style 2023-12-12 07:58:54 +01:00
Alexey Milovidov
9789c2caa2 Review fixes 2023-12-12 05:48:09 +01:00
Alexey Milovidov
0c81892463
Update tests/ci/clickbench.py 
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
 2023-12-12 00:43:06 +03:00
Alexey Milovidov
a3262003f3
Update tests/ci/integration_test_check.py 
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
 2023-12-12 00:42:47 +03:00
Alexey Milovidov
b9b6e7584e
Update tests/ci/fast_test_check.py 
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
 2023-12-12 00:42:41 +03:00
Alexey Milovidov
fcb8ab9b63
Update tests/ci/functional_test_check.py 
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
 2023-12-12 00:42:23 +03:00
Mikhail f. Shiryaev
7bd6b42af2
Merge pull request #57744 from ClickHouse/fix-dockerub-proxy 
Tune network memory for dockerhub proxy hosts
 2023-12-11 14:25:51 +01:00
Max K
f5ba4ef9b3
Tune autoscale to scale for single job in the queue (#57742) 
* tune setting desired capacity

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
 2023-12-11 13:07:56 +01:00
Mikhail f. Shiryaev
9307a87118
Tune network memory for dockerhub proxy hosts 2023-12-11 12:56:52 +01:00
Alexey Milovidov
4b13a6d08f Fix CI 2023-12-10 22:02:05 +01:00
Alexey Milovidov
6b55c16b4e mypy 2023-12-10 20:49:03 +01:00
Alexey Milovidov
c6f1832686 Merge branch 'clickbench-ci' of github.com:ClickHouse/ClickHouse into clickbench-ci 2023-12-10 19:55:18 +01:00
Alexey Milovidov
ce894c28f3 mypy 2023-12-10 19:54:59 +01:00
Alexey Milovidov
75df8db298 Python 2023-12-10 19:52:52 +01:00
robot-clickhouse
c1e387d682 Automatic style fix 2023-12-10 18:32:09 +00:00
Alexey Milovidov
99c8430c3e mypy 2023-12-10 19:10:44 +01:00
Alexey Milovidov
11dda11f22 Python 2023-12-10 19:08:50 +01:00
Alexey Milovidov
af48cb9732 Python 2023-12-10 00:35:04 +01:00
Alexey Milovidov
ea31c8471f Python 2023-12-10 00:26:44 +01:00
Alexey Milovidov
2602a7ba81 Python 2023-12-10 00:22:19 +01:00
Alexey Milovidov
01487af489 Merge branch 'clickbench-ci' of github.com:ClickHouse/ClickHouse into clickbench-ci 2023-12-10 00:03:51 +01:00
Alexey Milovidov
17772dc41c Recommendation from @felixoid 2023-12-10 00:03:33 +01:00
robot-clickhouse
f8f42d82dd Automatic style fix 2023-12-09 22:52:58 +00:00
Alexey Milovidov
3ac3a06561 Add ClickBench to CI 2023-12-09 23:31:05 +01:00
Alexey Milovidov
0157066fc5 Merge branch 'master' into musl-7 2023-12-09 15:19:38 +01:00
Max K
a12c685015
Update tests/ci/autoscale_runners_lambda/test_autoscale.py 
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
 2023-12-08 10:40:16 +01:00
Alexey Milovidov
15a0e6ab05 Merge branch 'master' into musl-7 2023-12-08 03:19:55 +01:00
Mikhail f. Shiryaev
b44dadc5c6
Identify failed jobs in lambda and mark as steps=0 2023-12-07 01:35:47 +01:00
robot-clickhouse
33fd370c94 Automatic style fix 2023-12-06 19:18:26 +00:00
Max Kainov
e2daad2065 tune scale up/down multipliers 2023-12-06 18:55:57 +00:00
vdimir
4e9402c3fc
Merge pull request #57413 from ClickHouse/vdimir/bugfix_validate_check_exceptions 
Consider whole check failure in bugfix validate check as an error
 2023-12-05 15:01:46 +01:00
vdimir
4ec21e94a5
Set http_make_head_request onlt in stress tests 2023-12-04 16:58:51 +01:00
alesapin
a5782cb56b Revert "Revert bugfix check fix attempt" 
This reverts commit dcc5ae2928.
 2023-12-03 16:04:22 +01:00
kssenii
dcc5ae2928 Revert bugfix check fix attempt 2023-12-01 20:23:39 +01:00
vdimir
d2bea265c9
Consider whole check failure in bugfix validate check as an error 2023-12-01 09:57:29 +00:00
kssenii
0e9aa9b1cd Try fix bugfix check 2023-11-30 14:14:32 +01:00
Mikhail f. Shiryaev
59cf90876c
Changes after a review 2023-11-28 12:19:27 +01:00
Mikhail f. Shiryaev
4aac18d651
Add another header for the wrong conflicts resolution 2023-11-28 12:01:33 +01:00
Mikhail f. Shiryaev
8c4592f5c2
Follow up recommendations from #57167 2023-11-28 11:51:06 +01:00
alesapin
b26767d5bb Add some additional groups to CI 2023-11-27 13:43:40 +01:00
Alexey Milovidov
b2d8103d19 Add special build with Musl 2023-11-26 02:27:54 +01:00
Alexey Milovidov
d7e64fa446
Merge pull request #57150 from azat/ci/no-partial-results 
Remove partial results from build matrix for stress tests
 2023-11-25 22:55:14 +01:00
Alexey Milovidov
91cc132feb
Merge pull request #56873 from ClickHouse/memory-for-client-in-stress-and-fuzzer 
Set limit for memory usage for client in Stress tests and ASTFuzzers
 2023-11-24 23:15:27 +01:00
Alexey Milovidov
13181db20e
Update stress.py 2023-11-24 23:11:23 +03:00
Mikhail f. Shiryaev
36d27d1713
Improve the cherry-pick PR description 2023-11-23 19:28:58 +01:00
Azat Khuzhin
d81fb9d117 Remove partial results from build matrix for stress tests 
The feature had been reverted in #55893

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-11-23 16:39:52 +01:00
Michael Kolupaev
ff6dfd2490 Run CI for PRs with missing documentation if 'can be tested' label is present 2023-11-20 21:57:45 +00:00
Mikhail f. Shiryaev
362c15d9ea
Fix logging for profile JSON files 2023-11-20 15:15:38 +01:00
Mikhail f. Shiryaev
6da51942eb
Follow up the fix from #44311 2023-11-20 15:15:35 +01:00
Nikita Mikhaylov
427d9fff70 Set limit for memory 2023-11-16 19:13:25 +01:00
Mikhail f. Shiryaev
152758d6df
Merge pull request #56459 from ClickHouse/update-ami 
Update the AMI receipt
 2023-11-16 18:42:26 +01:00
Mikhail f. Shiryaev
f02ed02e4a
Terminate spot instances older than 1h 2023-11-16 16:35:34 +01:00
Mikhail f. Shiryaev
7c758d1b2d
Define the INIT_ENVIRONMENT through instances tags 2023-11-16 15:53:34 +01:00
Mikhail f. Shiryaev
002c4af384
Merge pull request #56785 from ClickHouse/another-digest-test 
Add test for avoided recursion
 2023-11-15 13:03:40 +01:00
Mikhail f. Shiryaev
e628114729
Add test for avoided recursion 2023-11-15 12:26:20 +01:00
Mikhail f. Shiryaev
30c6cea895
Fix another place with offset-aware datetime 2023-11-15 11:09:13 +01:00
Mikhail f. Shiryaev
ad3f422cff
Get rid of datetime in calculation of since_updated 2023-11-15 10:53:55 +01:00
Mikhail f. Shiryaev
eb4add06ba
Rewrite repo.organization._url to a proper repo._makeStringAttribute 2023-11-15 10:35:39 +01:00
Mikhail f. Shiryaev
8fbc0d3d51
Disable autoupdate for GH runners to speed-up boot 2023-11-14 15:48:01 +01:00
Mikhail f. Shiryaev
556e0faad2
Make sleep in init_runner loop global 2023-11-14 15:48:00 +01:00
Mikhail f. Shiryaev
b4cc55ea34
Deploy cloud-init script to S3 for following usage 2023-11-14 15:48:00 +01:00
Mikhail f. Shiryaev
5f9704a3c1
Kill forgotten Runner.Listener too 2023-11-14 15:47:59 +01:00
Mikhail f. Shiryaev
e77c9fbd53
Add TOE in the comment, find and fix possible issues for the second run 2023-11-14 15:47:59 +01:00
Mikhail f. Shiryaev
0c0f70d26d
Add the installing of azure cli 2023-11-14 15:47:58 +01:00
Mikhail f. Shiryaev
094eebde4f
Update the runner version 2023-11-14 15:47:57 +01:00
Mikhail f. Shiryaev
8a36f2fa4c
Rewrite builds reports to reusable workflow 2023-11-13 12:49:37 +01:00
Mikhail f. Shiryaev
7d3440add5
Delete codebrowser leftovers 2023-11-13 12:49:35 +01:00
Mikhail f. Shiryaev
15d27d5e85
Rewrite docs test to reusable workflow 2023-11-13 12:49:33 +01:00
Mikhail f. Shiryaev
6e00e14a45
Rewrite libfuzzer tests to reusable workflow 
Update fuzzers clang version
 2023-11-13 12:49:33 +01:00
Mikhail f. Shiryaev
b6a71ae6f4
Rewrite fast tests to reusable workflow 2023-11-13 12:49:33 +01:00
Mikhail f. Shiryaev
6f8baf3def
Rewrite style checks to reusable workflow 2023-11-13 12:49:32 +01:00
Mikhail f. Shiryaev
38b251946e
Add another check to CiConfig.validate, and test for it 2023-11-13 12:49:31 +01:00
Alexey Milovidov
9436209950 Fix error 2023-11-13 05:06:37 +01:00
Alexey Milovidov
7fc3cebd91 Fix error 2023-11-13 04:00:13 +01:00
Alexey Milovidov
c9f5ef0b1a Fix error 2023-11-13 03:14:29 +01:00
Alexey Milovidov
17669111fc Python 2023-11-12 08:07:14 +01:00
robot-clickhouse
c74aea08b2 Automatic style fix 2023-11-12 04:10:47 +00:00
Alexey Milovidov
fb8f9f5fed Fix error 2023-11-12 04:52:49 +01:00
Alexey Milovidov
6c30aa121c Collect information about binary sizes to the CI database 2023-11-12 04:01:59 +01:00
Alexey Milovidov
38ca18d8e7
Merge pull request #56617 from ClickHouse/publish-stripped-binary 
Publish stripped binary
 2023-11-11 22:18:26 +01:00
Alexey Milovidov
9824631044 Apply LowCardinality in more places 2023-11-11 07:46:35 +01:00
Alexey Milovidov
df24ef42b1 Publish stripped binary 2023-11-11 07:27:10 +01:00
Mikhail f. Shiryaev
a807a80d1e
Merge pull request #56385 from ClickHouse/modules-actions 
Rewrite jobs to use callable workflow
 2023-11-09 15:19:58 +01:00