thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-02 12:32:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
134,812 Commits 9,194 Branches 1,782 Tags 2.2 GiB
0552f44f70
Commit Graph

2269 Commits

Author SHA1 Message Date
Max K
bd83830cea
CI: WA for issue with perf test with artifact reuse (#59325) 
* CI: WA for issue with perf test with artifact reuse

 #do_not_test

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
 2024-01-29 12:17:38 +01:00
Alexey Milovidov
982e3ddbdd Fix Python 2024-01-28 23:11:03 +01:00
Alexey Milovidov
1ef8062c77 Split by batches 2024-01-28 22:28:09 +01:00
Alexey Milovidov
8798f469b3 Fix conflicts. 2024-01-28 22:27:21 +01:00
Alexey Milovidov
4a94ae5a1b Merge branch 'master' into enable-coverage-for-debug-build 2024-01-28 22:24:26 +01:00
Max Kainov
d36c92a219 CI: Add rust dir to build digest 2024-01-28 15:09:39 +00:00
Max Kainov
2b75836ad2 CI: fix ci configuration for nightly job 2024-01-26 09:33:04 +00:00
Mikhail f. Shiryaev
3d03c16fc8
Fix another place with special symbols in the URL 2024-01-24 21:02:22 +01:00
Mikhail f. Shiryaev
dedc889e49
Fix broken cache for non-existing temp_path 2024-01-24 18:12:30 +01:00
Mikhail f. Shiryaev
a05d22b1c1
Fix url encoding issue 2024-01-24 14:32:29 +01:00
Max Kainov
f1220c5637 CI: hot fix for reuse 2024-01-22 19:19:22 +00:00
Max K
08fcefbefd
Merge pull request #59046 from ClickHouse/job_names_refactoring 
CI: add ci_config classes for job and build names
 2024-01-22 13:46:32 +01:00
Max Kainov
5379767684 Job Naming 
#no_merge_commit #ci_set_reduced
 2024-01-22 11:16:58 +00:00
Max Kainov
6362fc1d48 fix inputs check in ci.py 2024-01-22 08:26:46 +00:00
Max K
070a55e194
Merge pull request #58516 from ClickHouse/move_out_ci_specifics_to_ci_py 
CI: move ci-specifics from job scripts to ci.py
 2024-01-21 18:24:42 +01:00
Max Kainov
3247ae81e4 move out ci specific functions to ci.py 
#no_merge_commit
 2024-01-21 16:36:37 +00:00
Alexey Milovidov
735708e9bb Merge branch 'master' into enable-coverage-for-debug-build 2024-01-20 21:40:53 +01:00
Alexey Milovidov
05609cf75d Ci to CI 2024-01-19 17:02:17 +01:00
Raúl Marín
76638fb7ba
Merge pull request #58942 from Algunenano/missing_digest 
Add missing files to digests
 2024-01-19 13:32:49 +01:00
vdimir
4509af091a
Merge pull request #58091 from ClickHouse/vdimir/bugfix_validate_check_exceptions_msg 
Print another message in Bugfix check if internal check had been failed
 2024-01-19 11:57:14 +01:00
Alexey Milovidov
7c0b167e2d Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-01-19 03:59:27 +01:00
Alexey Milovidov
5a6a89897e
Merge pull request #58960 from ClickHouse/add_a_comment_about_sparse_checkout 
Add a comment about sparse checkout
 2024-01-19 00:39:26 +01:00
robot-clickhouse
5f1f27f8c7 Automatic style fix 2024-01-18 18:34:10 +00:00
Alexander Tokmakov
01d9b9a28a add a comment about sparse checkout 2024-01-18 19:22:20 +01:00
Mikhail f. Shiryaev
7a911997ae
Fix git_helper.Runner.__call__ typing 2024-01-18 16:11:01 +01:00
Mikhail f. Shiryaev
61a79bac53
Copy local cache archives when CI is not set 2024-01-18 15:53:04 +01:00
Mikhail f. Shiryaev
d70c72b89e
Name stash properly 2024-01-18 15:53:02 +01:00
Mikhail f. Shiryaev
15cfc9b0ef
Fix stash and clear_repo contexts 
All the cleanup should be done in `finally` block:

```
In [3]: @contextmanager
   ...: def stash():
   ...:     try:
   ...:         print("inside")
   ...:         yield
   ...:     except (Exception, KeyboardInterrupt):
   ...:         print("catched")
   ...:         raise
   ...:     finally:
   ...:         print("always")
   ...:

In [4]: with stash():
   ...:     raise ValueError("something")
   ...:
inside
catched
always
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
Cell In[4], line 2
      1 with stash():
----> 2     raise ValueError("something")

ValueError: something

In [5]: @contextmanager
   ...: def stash():
   ...:     try:
   ...:         print("inside")
   ...:         yield
   ...:     finally:
   ...:         print("always")
   ...:

In [6]: with stash():
   ...:     raise ValueError("something")
   ...:
inside
always
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
Cell In[6], line 2
      1 with stash():
----> 2     raise ValueError("something")
```

And `except` block is unnecessary if it should just re-raise an error
 2024-01-18 15:25:59 +01:00
Max Kainov
4eb7cda8fa Add pr_info event type so that jobs could know how they launched 
#no_merge_commit #ci_set_reduced
 2024-01-18 13:31:37 +00:00
Max K
a4cab68a06
Merge pull request #58881 from ClickHouse/jepsen_to_reusable_builds 
Jepsen job to reuse builds
 2024-01-18 13:47:14 +01:00
Raúl Marín
cd4aefcddb Add missing files to digests 2024-01-18 13:36:05 +01:00
robot-clickhouse
db3ffa5c86 Automatic style fix 2024-01-18 12:11:03 +00:00
Alexey Milovidov
6d6b8fcf8e Add missing comments in code 2024-01-18 12:58:50 +01:00
Max Kainov
d387c84aa4 Jepsen job to reuse builds 
#no-merge-commit
 2024-01-18 11:58:41 +00:00
vdimir
bb8986de5d
Revert "break tests/integration/test_merge_tree_s3/test.py" 
This reverts commit 5dd231ede1.
 2024-01-18 08:56:05 +00:00
vdimir
c3788c2fa1
upd 2024-01-18 08:54:31 +00:00
vdimir
5dd231ede1
break tests/integration/test_merge_tree_s3/test.py 2024-01-18 08:54:31 +00:00
vdimir
a3b4b7e880
Print another message in Bugfix check if internal check had been failed 2024-01-18 08:54:27 +00:00
Alexey Milovidov
61101d1a57 Add a release build with coverage, turn off coverage in the debug build 2024-01-18 01:16:50 +01:00
Alexey Milovidov
c098f41dbc Merge branch 'master' into enable-coverage-for-debug-build 2024-01-17 22:35:51 +01:00
Mikhail f. Shiryaev
0b52dc0e33
Merge pull request #58920 from ClickHouse/cancel-MasterCI-in-prs 
Cancel MasterCI in PRs
 2024-01-17 18:58:23 +01:00
Mikhail f. Shiryaev
1d57666b19
Cancel MasterCI in PRs 2024-01-17 17:40:23 +01:00
Alexey Milovidov
1afc5e8c01 Enable coverage for debug build 2024-01-14 03:45:42 +01:00
Mikhail f. Shiryaev
9d8290cc50
Merge pull request #58712 from ClickHouse/helper-improvements 
Some small improvements to version_helper from #57203
 2024-01-12 17:40:14 +04:00
Mikhail f. Shiryaev
7ab571f0f0
Add ClickHouseVersion.is_lts 2024-01-11 11:42:59 +01:00
Mikhail f. Shiryaev
0572bf53ea
Add a new function to version_helper to get supported version from tags 2024-01-11 11:42:49 +01:00
Robert Schulze
ced9e93ac6
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main 2024-01-09 20:36:02 +00:00
Mikhail f. Shiryaev
ac1dac4fe3
Merge pull request #58619 from ClickHouse/s3-optional-client 
Optional `client` argument for `S3Helper`
 2024-01-09 16:52:42 +04:00
Sema Checherinda
6dbf7c967c
Merge pull request #57663 from ClickHouse/CheSema-remote-blobs-naming-2 
generate object storage key by template
 2024-01-09 13:26:56 +01:00
Mikhail f. Shiryaev
5ed4cd41d9
Extend S3Helper to accept a custom s3 client and endpoint 2024-01-09 13:10:34 +01:00
Mikhail f. Shiryaev
3875f4f4b5
Fix issue with default dataclass values 2024-01-09 13:10:28 +01:00
Mikhail f. Shiryaev
a2a3783366
Small renaming to reflect the current release process 2024-01-08 15:31:59 +01:00
Mikhail f. Shiryaev
fe19f45974
Simplify --type argument for release.py 2024-01-08 15:31:58 +01:00
Mikhail f. Shiryaev
2232663216
Insignificant typing improvements 2024-01-08 15:31:57 +01:00
Mikhail f. Shiryaev
f38510be86
Do not fail the CI on an expired token 2024-01-08 10:43:55 +01:00
Robert Schulze
53965bb9f1
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main 2024-01-07 14:11:22 +00:00
Max Kainov
deda52b611 add packager script to build digest 2024-01-06 16:23:20 +00:00
Sema Checherinda
c59a72b987 fix special build, add randomization to stateless tests 2024-01-05 13:42:30 +00:00
Mikhail f. Shiryaev
dd7aca4d69
Revert "Fix an error in the release script - it didn't allow to make 23.12." 2023-12-30 18:35:42 +01:00
Alexey Milovidov
9d1e124102 Let me do the release 2023-12-28 11:21:58 +01:00
Mikhail f. Shiryaev
74dd63f956
Add a hack to un-/mark PR as a draft 
#job_package_debug
 2023-12-22 22:26:38 +01:00
Mikhail f. Shiryaev
e7c22fef7b
Rename ccache_utils to cache_utils 2023-12-22 22:26:37 +01:00
Mikhail f. Shiryaev
b386674ede
Add GitHubCache class, generalize Cache class 2023-12-22 22:26:36 +01:00
jinjunzh
aaf98f0ed7 refine setting with enable_zstd_qat_codec 2023-12-22 14:24:15 -05:00
Mikhail f. Shiryaev
a54dfabf0e
Add full repo name to the PR cache name 2023-12-22 17:52:15 +01:00
Alexey Milovidov
7f7e80ea56
Merge pull request #58130 from ClickHouse/integration-tests-images 
Use the single images list for integration tests everywhere
 2023-12-22 06:04:43 +01:00
Max K
8ac13b3e26
Support "do not test" label with ci.py (#58128) 
* support "do not test" label with ci.py


Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
 2023-12-21 18:08:25 +01:00
Mikhail f. Shiryaev
4a04a1316f
Add a tag processing for python-bottle 2023-12-21 16:11:54 +01:00
Mikhail f. Shiryaev
177f8f7d0d
Create a single point of true for integration tests images 2023-12-21 16:09:56 +01:00
Max K
2dcffcc41c
fix (#58125) 2023-12-21 14:14:51 +01:00
Max Kainov
afdc0548e5 limited ci on master for docs only 2023-12-21 11:37:39 +00:00
Max K
cb53ee63be
Add GH status for PR formatting (#58050) 
* add GH status for PR formatting
 #no-merge-commit
 2023-12-21 11:53:01 +01:00
Max K
e0a790de1e
Fix for nightly job for digest-ci (#58079) 
* Fix for run_always job - do not set done
 #no-merge-commit
 2023-12-20 21:28:54 +01:00
Julia Kartseva
2c32589949
Merge pull request #58019 from jkartseva/fix-build-errno-exception 
fix freebsd build
 2023-12-19 11:16:45 -08:00
Max K
d8383377ea
always run ast_fuzz and sqllancer #no-merge-commit (#58049) 2023-12-19 20:14:47 +01:00
vdimir
252cb8a507
Merge pull request #54602 from fionera/issue-49028 
Add setting http_make_head_request
 2023-12-19 13:33:59 +01:00
Max Kainov
276f040dd0 ci fix 
https://github.com/ClickHouse/ClickHouse/actions/runs/7256640256/job/19769624432?pr=58015#step:8:5466
```
Dec 19 03:09:41 /build/src/IO/AIO.cpp:140:15: error: use of undeclared identifier 'ErrnoException'; did you mean 'DB::ErrnoException'?
Dec 19 03:09:41   140 |         throw ErrnoException(DB::ErrorCodes::CANNOT_IOSETUP, "io_setup failed");
```
 2023-12-19 10:24:36 +00:00
Max K
528df04b87
add needs_changed_files flag for pr_info (#58003) 2023-12-18 17:54:27 +01:00
Max K
b9408125cc
CI for docs only fix (#57992) 
* run only docs related jobs if changes are in docs only (fix after applying CI with digest)
 2023-12-18 17:06:10 +01:00
Mikhail f. Shiryaev
e0ffd3726d
Avoid situations with too long status descriptions 2023-12-18 13:45:15 +01:00
Mikhail f. Shiryaev
7441fe45cc
Apply isort for imports 2023-12-18 13:44:11 +01:00
Mikhail f. Shiryaev
9a2ee55b5e
Fix style-check checkout head-ref 2023-12-18 13:21:13 +01:00
Max K
84e5870b71
Reapply "improve CI with digest for docker, build and test jobs" (#57904) 
* Revert "Revert "improve CI with digest for docker, build and test jobs""

* fix: docker manifest merge for missing images only
 2023-12-18 09:07:22 +01:00
Max K
8c7add0334 Revert "improve CI with digest for docker, build and test jobs (#56317)" 
This reverts commit 7844fcc196.
 2023-12-15 15:48:01 +01:00
Max K
7844fcc196
improve CI with digest for docker, build and test jobs (#56317) 
* CI with digests to tag docker images, reuse builds, reuse tests and others
 2023-12-15 15:21:20 +01:00
Mikhail f. Shiryaev
deb054dc7e
Add logging for the search PRs to backport query 2023-12-15 13:28:25 +01:00
Mikhail f. Shiryaev
e11fa23032
Add argument to fill the gap in cherry-pick 2023-12-15 12:56:35 +01:00
Alexey Milovidov
62b6d1ef5e iMerge branch 'master' of github.com:ClickHouse/ClickHouse into clickbench-ci 2023-12-13 01:41:27 +01:00
Mikhail f. Shiryaev
88566b57db
Merge pull request #57600 from ClickHouse/fix-killed-jobs-detection 
Identify failed jobs in lambda and mark as steps=0
 2023-12-12 15:30:49 +01:00
Alexey Milovidov
7ff3021112 Fix Docker 2023-12-12 14:12:10 +01:00
Mikhail f. Shiryaev
cfe6bc2cc5
Replace len by sum for generator 2023-12-12 14:05:59 +01:00
Alexey Milovidov
8a68a4247e Style 2023-12-12 07:58:54 +01:00
Alexey Milovidov
9789c2caa2 Review fixes 2023-12-12 05:48:09 +01:00
Alexey Milovidov
0c81892463
Update tests/ci/clickbench.py 
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
 2023-12-12 00:43:06 +03:00
Alexey Milovidov
a3262003f3
Update tests/ci/integration_test_check.py 
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
 2023-12-12 00:42:47 +03:00
Alexey Milovidov
b9b6e7584e
Update tests/ci/fast_test_check.py 
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
 2023-12-12 00:42:41 +03:00
Alexey Milovidov
fcb8ab9b63
Update tests/ci/functional_test_check.py 
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
 2023-12-12 00:42:23 +03:00
Mikhail f. Shiryaev
7bd6b42af2
Merge pull request #57744 from ClickHouse/fix-dockerub-proxy 
Tune network memory for dockerhub proxy hosts
 2023-12-11 14:25:51 +01:00
Max K
f5ba4ef9b3
Tune autoscale to scale for single job in the queue (#57742) 
* tune setting desired capacity

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
 2023-12-11 13:07:56 +01:00
Mikhail f. Shiryaev
9307a87118
Tune network memory for dockerhub proxy hosts 2023-12-11 12:56:52 +01:00