Nikolai Kochetov
fb8723a15c
Update pr.py
2024-02-10 13:13:26 +01:00
Maksim Kita
8b3c27d45b
Updated a list of trusted contributors
2024-02-10 15:00:31 +03:00
Alexey Milovidov
a7c30098b6
Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build
2024-02-09 22:52:49 +01:00
Alexey Milovidov
e54fbd3367
Update tests/ci/ci_config.py
...
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2024-02-09 18:32:54 +01:00
Mikhail f. Shiryaev
f056e8b2c4
Handle different timestamp related aspects of zip-files
2024-02-09 16:54:00 +01:00
Dmitry Novik
b23ba02d4c
Enforce tests with enabled analyzer in CI
2024-02-09 16:50:37 +01:00
Max Kainov
c2320c2d16
CI: await tune ups
...
#no_ci_cache #job_package_debug
2024-02-09 13:17:49 +00:00
Max Kainov
9dfe3f5559
CI: do not reuse builds on release branches
...
#job_package_debug #job_style_check
2024-02-09 12:43:05 +00:00
robot-clickhouse
07ae125a52
Automatic style fix
2024-02-09 00:34:00 +00:00
Alexey Milovidov
ad665f9b06
Better
2024-02-09 00:46:12 +01:00
Alexey Milovidov
f386e34b91
Fix an error by rewriting the CI from Perl to Python
2024-02-09 00:45:16 +01:00
Alexey Milovidov
c12e34df19
Fix report
2024-02-08 23:28:29 +01:00
Alexey Milovidov
cd0acc512d
Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build
2024-02-08 22:08:15 +01:00
Max Kainov
b112fd1e3c
CI: ci test await
...
#do_not_test
2024-02-08 19:09:38 +00:00
Max Kainov
641c7b547d
CI: enable await
...
#no_merge_commit
2024-02-08 18:37:30 +00:00
Alexey Milovidov
85bd8d3cf0
Fix your Py
2024-02-08 00:23:04 +01:00
Alexey Milovidov
02c0b4c67f
Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build
2024-02-07 22:45:50 +01:00
Alexey Milovidov
62721fef78
Fix your Py
2024-02-07 22:45:35 +01:00
Alexey Milovidov
4d25929d74
A few missing changes
2024-02-07 20:58:40 +01:00
Mikhail f. Shiryaev
a1eb9abaf0
Add test for increase-always autoscaling lambda
2024-02-07 13:49:35 +01:00
Alexey Milovidov
d65a56d967
Merge branch 'master' into enable-coverage-for-debug-build
2024-02-07 04:58:21 +01:00
Mikhail f. Shiryaev
13948cbb20
Use constants from report instead of string literals
2024-02-06 15:02:09 +01:00
Mikhail f. Shiryaev
5b9bf80f09
Fix usage of status types to prevent API exceptions
2024-02-06 13:40:07 +01:00
Mikhail f. Shiryaev
df93062472
Apply and fix isort in scripts
2024-02-06 13:40:05 +01:00
Nikita Mikhaylov
306e739daa
Updated a list of trusted contributors ( #59616 )
...
* Updated a list of trusted contributors
* Automatic style fix
---------
Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2024-02-06 12:33:11 +01:00
Max Kainov
cbd81b506f
CI: fix ast fuzzer job report (slack bot issue)
...
#job_ast_fuzzer_debug #job_style_check
2024-02-06 09:56:15 +00:00
Max K
3ddaa1b5f1
CI: nightly job to update latest docker tag only ( #59586 )
...
* CI: nightly job to update latest docker tag only
---------
Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2024-02-05 18:09:43 +01:00
Max K
411b76cc57
Merge pull request #59241 from ClickHouse/test_arm
...
CI: Add ARM integration tests
2024-02-05 14:52:46 +01:00
Raúl Marín
08c1799f9c
Merge pull request #59383 from Algunenano/fuzz_literal
...
Add some fuzzing to ASTLiterals
2024-02-05 12:27:43 +01:00
Mikhail f. Shiryaev
31f27ad398
Merge pull request #59337 from ClickHouse/fix-fasttests-gdb
...
Some small fixes for docker images
2024-02-05 11:42:18 +01:00
Max Kainov
6504dfe0b2
CI: Enable ARM integration test
...
#ci_set_integration #no_merge_commit
2024-02-02 17:37:05 +00:00
Max K
0947d5c89e
CI: ci cache. step 1 ( #58664 )
...
* ci cache class
#no_merge_commit #ci_set_reduced
2024-02-02 18:10:47 +01:00
Raúl Marín
00096e5819
Merge remote-tracking branch 'blessed/master' into fuzz_literal
2024-02-02 17:28:47 +01:00
Aleksandr Musorin
3339a97014
Added aspell-dict.txt to only documentation list of files for CI
2024-02-01 19:49:03 +01:00
Mikhail f. Shiryaev
4ee7275f21
Improve dry run for lambda deployment
2024-02-01 11:20:16 +01:00
Mikhail f. Shiryaev
0f931057e9
Post a failure status if can not run the CI
2024-01-31 17:59:13 +01:00
Mikhail f. Shiryaev
bfa722bf62
Use JobNames.STYLE_CHECK for consistency
2024-01-31 13:58:25 +01:00
Mikhail f. Shiryaev
7af7255b90
Use JobNames.DOCS_CHECK for consistency
2024-01-31 13:58:24 +01:00
Mikhail f. Shiryaev
3dae643f19
Consistent "Fast test" job name
2024-01-31 13:58:23 +01:00
Raúl Marín
4f0c78d665
Upload one file. Save the planet
2024-01-30 20:29:59 +01:00
Raúl Marín
a3f0546f48
Handle both fuzzer.log and fuzzer.log.ztd
2024-01-30 19:44:55 +01:00
robot-clickhouse
419ddf7c9d
Automatic style fix
2024-01-30 18:34:56 +00:00
Max Kainov
e6fcc48471
CI: fix status and report for docker server jobs
...
#no_merge_commit
2024-01-30 18:24:29 +00:00
Alexey Milovidov
cb69a1b25d
Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build
2024-01-29 15:35:04 +01:00
Max K
bd83830cea
CI: WA for issue with perf test with artifact reuse ( #59325 )
...
* CI: WA for issue with perf test with artifact reuse
#do_not_test
* Automatic style fix
---------
Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2024-01-29 12:17:38 +01:00
Alexey Milovidov
982e3ddbdd
Fix Python
2024-01-28 23:11:03 +01:00
Alexey Milovidov
1ef8062c77
Split by batches
2024-01-28 22:28:09 +01:00
Alexey Milovidov
8798f469b3
Fix conflicts.
2024-01-28 22:27:21 +01:00
Alexey Milovidov
4a94ae5a1b
Merge branch 'master' into enable-coverage-for-debug-build
2024-01-28 22:24:26 +01:00
Max Kainov
d36c92a219
CI: Add rust dir to build digest
2024-01-28 15:09:39 +00:00
Max Kainov
2b75836ad2
CI: fix ci configuration for nightly job
2024-01-26 09:33:04 +00:00
Mikhail f. Shiryaev
3d03c16fc8
Fix another place with special symbols in the URL
2024-01-24 21:02:22 +01:00
Mikhail f. Shiryaev
dedc889e49
Fix broken cache for non-existing temp_path
2024-01-24 18:12:30 +01:00
Mikhail f. Shiryaev
a05d22b1c1
Fix url encoding issue
2024-01-24 14:32:29 +01:00
Max Kainov
f1220c5637
CI: hot fix for reuse
2024-01-22 19:19:22 +00:00
Max K
08fcefbefd
Merge pull request #59046 from ClickHouse/job_names_refactoring
...
CI: add ci_config classes for job and build names
2024-01-22 13:46:32 +01:00
Max Kainov
5379767684
Job Naming
...
#no_merge_commit #ci_set_reduced
2024-01-22 11:16:58 +00:00
Max Kainov
6362fc1d48
fix inputs check in ci.py
2024-01-22 08:26:46 +00:00
Max K
070a55e194
Merge pull request #58516 from ClickHouse/move_out_ci_specifics_to_ci_py
...
CI: move ci-specifics from job scripts to ci.py
2024-01-21 18:24:42 +01:00
Max Kainov
3247ae81e4
move out ci specific functions to ci.py
...
#no_merge_commit
2024-01-21 16:36:37 +00:00
Alexey Milovidov
735708e9bb
Merge branch 'master' into enable-coverage-for-debug-build
2024-01-20 21:40:53 +01:00
Alexey Milovidov
05609cf75d
Ci to CI
2024-01-19 17:02:17 +01:00
Raúl Marín
76638fb7ba
Merge pull request #58942 from Algunenano/missing_digest
...
Add missing files to digests
2024-01-19 13:32:49 +01:00
vdimir
4509af091a
Merge pull request #58091 from ClickHouse/vdimir/bugfix_validate_check_exceptions_msg
...
Print another message in Bugfix check if internal check had been failed
2024-01-19 11:57:14 +01:00
Alexey Milovidov
7c0b167e2d
Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build
2024-01-19 03:59:27 +01:00
Alexey Milovidov
5a6a89897e
Merge pull request #58960 from ClickHouse/add_a_comment_about_sparse_checkout
...
Add a comment about sparse checkout
2024-01-19 00:39:26 +01:00
robot-clickhouse
5f1f27f8c7
Automatic style fix
2024-01-18 18:34:10 +00:00
Alexander Tokmakov
01d9b9a28a
add a comment about sparse checkout
2024-01-18 19:22:20 +01:00
Mikhail f. Shiryaev
7a911997ae
Fix git_helper.Runner.__call__ typing
2024-01-18 16:11:01 +01:00
Mikhail f. Shiryaev
61a79bac53
Copy local cache archives when CI is not set
2024-01-18 15:53:04 +01:00
Mikhail f. Shiryaev
d70c72b89e
Name stash properly
2024-01-18 15:53:02 +01:00
Mikhail f. Shiryaev
15cfc9b0ef
Fix stash and clear_repo contexts
...
All the cleanup should be done in `finally` block:
```
In [3]: @contextmanager
...: def stash():
...: try:
...: print("inside")
...: yield
...: except (Exception, KeyboardInterrupt):
...: print("catched")
...: raise
...: finally:
...: print("always")
...:
In [4]: with stash():
...: raise ValueError("something")
...:
inside
catched
always
---------------------------------------------------------------------------
ValueError Traceback (most recent call last)
Cell In[4], line 2
1 with stash():
----> 2 raise ValueError("something")
ValueError: something
In [5]: @contextmanager
...: def stash():
...: try:
...: print("inside")
...: yield
...: finally:
...: print("always")
...:
In [6]: with stash():
...: raise ValueError("something")
...:
inside
always
---------------------------------------------------------------------------
ValueError Traceback (most recent call last)
Cell In[6], line 2
1 with stash():
----> 2 raise ValueError("something")
```
And `except` block is unnecessary if it should just re-raise an error
2024-01-18 15:25:59 +01:00
Max Kainov
4eb7cda8fa
Add pr_info event type so that jobs could know how they launched
...
#no_merge_commit #ci_set_reduced
2024-01-18 13:31:37 +00:00
Max K
a4cab68a06
Merge pull request #58881 from ClickHouse/jepsen_to_reusable_builds
...
Jepsen job to reuse builds
2024-01-18 13:47:14 +01:00
Raúl Marín
cd4aefcddb
Add missing files to digests
2024-01-18 13:36:05 +01:00
robot-clickhouse
db3ffa5c86
Automatic style fix
2024-01-18 12:11:03 +00:00
Alexey Milovidov
6d6b8fcf8e
Add missing comments in code
2024-01-18 12:58:50 +01:00
Max Kainov
d387c84aa4
Jepsen job to reuse builds
...
#no-merge-commit
2024-01-18 11:58:41 +00:00
vdimir
bb8986de5d
Revert "break tests/integration/test_merge_tree_s3/test.py"
...
This reverts commit 5dd231ede1
2024-01-18 08:56:05 +00:00
vdimir
c3788c2fa1
upd
2024-01-18 08:54:31 +00:00
vdimir
5dd231ede1
break tests/integration/test_merge_tree_s3/test.py
2024-01-18 08:54:31 +00:00
vdimir
a3b4b7e880
Print another message in Bugfix check if internal check had been failed
2024-01-18 08:54:27 +00:00
Alexey Milovidov
61101d1a57
Add a release build with coverage, turn off coverage in the debug build
2024-01-18 01:16:50 +01:00
Alexey Milovidov
c098f41dbc
Merge branch 'master' into enable-coverage-for-debug-build
2024-01-17 22:35:51 +01:00
Mikhail f. Shiryaev
0b52dc0e33
Merge pull request #58920 from ClickHouse/cancel-MasterCI-in-prs
...
Cancel MasterCI in PRs
2024-01-17 18:58:23 +01:00
Mikhail f. Shiryaev
1d57666b19
Cancel MasterCI in PRs
2024-01-17 17:40:23 +01:00
Alexey Milovidov
1afc5e8c01
Enable coverage for debug build
2024-01-14 03:45:42 +01:00
Mikhail f. Shiryaev
9d8290cc50
Merge pull request #58712 from ClickHouse/helper-improvements
...
Some small improvements to version_helper from #57203
2024-01-12 17:40:14 +04:00
Mikhail f. Shiryaev
7ab571f0f0
Add ClickHouseVersion.is_lts
2024-01-11 11:42:59 +01:00
Mikhail f. Shiryaev
0572bf53ea
Add a new function to version_helper to get supported version from tags
2024-01-11 11:42:49 +01:00
Robert Schulze
ced9e93ac6
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main
2024-01-09 20:36:02 +00:00
Mikhail f. Shiryaev
ac1dac4fe3
Merge pull request #58619 from ClickHouse/s3-optional-client
...
Optional `client` argument for `S3Helper`
2024-01-09 16:52:42 +04:00
Sema Checherinda
6dbf7c967c
Merge pull request #57663 from ClickHouse/CheSema-remote-blobs-naming-2
...
generate object storage key by template
2024-01-09 13:26:56 +01:00
Mikhail f. Shiryaev
5ed4cd41d9
Extend S3Helper to accept a custom s3 client and endpoint
2024-01-09 13:10:34 +01:00
Mikhail f. Shiryaev
3875f4f4b5
Fix issue with default dataclass values
2024-01-09 13:10:28 +01:00
Mikhail f. Shiryaev
a2a3783366
Small renaming to reflect the current release process
2024-01-08 15:31:59 +01:00
Mikhail f. Shiryaev
fe19f45974
Simplify --type argument for release.py
2024-01-08 15:31:58 +01:00
Mikhail f. Shiryaev
2232663216
Insignificant typing improvements
2024-01-08 15:31:57 +01:00
Mikhail f. Shiryaev
f38510be86
Do not fail the CI on an expired token
2024-01-08 10:43:55 +01:00
Robert Schulze
53965bb9f1
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main
2024-01-07 14:11:22 +00:00
Max Kainov
deda52b611
add packager script to build digest
2024-01-06 16:23:20 +00:00
Sema Checherinda
c59a72b987
fix special build, add randomization to stateless tests
2024-01-05 13:42:30 +00:00
Mikhail f. Shiryaev
dd7aca4d69
Revert "Fix an error in the release script - it didn't allow to make 23.12."
2023-12-30 18:35:42 +01:00
Alexey Milovidov
9d1e124102
Let me do the release
2023-12-28 11:21:58 +01:00
Mikhail f. Shiryaev
74dd63f956
Add a hack to un-/mark PR as a draft
...
#job_package_debug
2023-12-22 22:26:38 +01:00
Mikhail f. Shiryaev
e7c22fef7b
Rename ccache_utils to cache_utils
2023-12-22 22:26:37 +01:00
Mikhail f. Shiryaev
b386674ede
Add GitHubCache class, generalize Cache class
2023-12-22 22:26:36 +01:00
jinjunzh
aaf98f0ed7
refine setting with enable_zstd_qat_codec
2023-12-22 14:24:15 -05:00
Mikhail f. Shiryaev
a54dfabf0e
Add full repo name to the PR cache name
2023-12-22 17:52:15 +01:00
Alexey Milovidov
7f7e80ea56
Merge pull request #58130 from ClickHouse/integration-tests-images
...
Use the single images list for integration tests everywhere
2023-12-22 06:04:43 +01:00
Max K
8ac13b3e26
Support "do not test" label with ci.py ( #58128 )
...
* support "do not test" label with ci.py
Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2023-12-21 18:08:25 +01:00
Mikhail f. Shiryaev
4a04a1316f
Add a tag processing for python-bottle
2023-12-21 16:11:54 +01:00
Mikhail f. Shiryaev
177f8f7d0d
Create a single point of true for integration tests images
2023-12-21 16:09:56 +01:00
Max K
2dcffcc41c
fix ( #58125 )
2023-12-21 14:14:51 +01:00
Max Kainov
afdc0548e5
limited ci on master for docs only
2023-12-21 11:37:39 +00:00
Max K
cb53ee63be
Add GH status for PR formatting ( #58050 )
...
* add GH status for PR formatting
#no-merge-commit
2023-12-21 11:53:01 +01:00
Max K
e0a790de1e
Fix for nightly job for digest-ci ( #58079 )
...
* Fix for run_always job - do not set done
#no-merge-commit
2023-12-20 21:28:54 +01:00
Julia Kartseva
2c32589949
Merge pull request #58019 from jkartseva/fix-build-errno-exception
...
fix freebsd build
2023-12-19 11:16:45 -08:00
Max K
d8383377ea
always run ast_fuzz and sqllancer #no-merge-commit ( #58049 )
2023-12-19 20:14:47 +01:00
vdimir
252cb8a507
Merge pull request #54602 from fionera/issue-49028
...
Add setting http_make_head_request
2023-12-19 13:33:59 +01:00
Max Kainov
276f040dd0
ci fix
...
https://github.com/ClickHouse/ClickHouse/actions/runs/7256640256/job/19769624432?pr=58015#step:8:5466
```
Dec 19 03:09:41 /build/src/IO/AIO.cpp:140:15: error: use of undeclared identifier 'ErrnoException'; did you mean 'DB::ErrnoException'?
Dec 19 03:09:41 140 | throw ErrnoException(DB::ErrorCodes::CANNOT_IOSETUP, "io_setup failed");
```
2023-12-19 10:24:36 +00:00
Max K
528df04b87
add needs_changed_files flag for pr_info ( #58003 )
2023-12-18 17:54:27 +01:00
Max K
b9408125cc
CI for docs only fix ( #57992 )
...
* run only docs related jobs if changes are in docs only (fix after applying CI with digest)
2023-12-18 17:06:10 +01:00
Mikhail f. Shiryaev
e0ffd3726d
Avoid situations with too long status descriptions
2023-12-18 13:45:15 +01:00
Mikhail f. Shiryaev
7441fe45cc
Apply isort for imports
2023-12-18 13:44:11 +01:00
Mikhail f. Shiryaev
9a2ee55b5e
Fix style-check checkout head-ref
2023-12-18 13:21:13 +01:00
Max K
84e5870b71
Reapply "improve CI with digest for docker, build and test jobs" ( #57904 )
...
* Revert "Revert "improve CI with digest for docker, build and test jobs""
* fix: docker manifest merge for missing images only
2023-12-18 09:07:22 +01:00
Max K
8c7add0334
Revert "improve CI with digest for docker, build and test jobs ( #56317 )"
...
This reverts commit 7844fcc196
2023-12-15 15:48:01 +01:00
Max K
7844fcc196
improve CI with digest for docker, build and test jobs ( #56317 )
...
* CI with digests to tag docker images, reuse builds, reuse tests and others
2023-12-15 15:21:20 +01:00
Mikhail f. Shiryaev
deb054dc7e
Add logging for the search PRs to backport query
2023-12-15 13:28:25 +01:00
Mikhail f. Shiryaev
e11fa23032
Add argument to fill the gap in cherry-pick
2023-12-15 12:56:35 +01:00
Alexey Milovidov
62b6d1ef5e
iMerge branch 'master' of github.com:ClickHouse/ClickHouse into clickbench-ci
2023-12-13 01:41:27 +01:00
Mikhail f. Shiryaev
88566b57db
Merge pull request #57600 from ClickHouse/fix-killed-jobs-detection
...
Identify failed jobs in lambda and mark as steps=0
2023-12-12 15:30:49 +01:00
Alexey Milovidov
7ff3021112
Fix Docker
2023-12-12 14:12:10 +01:00
Mikhail f. Shiryaev
cfe6bc2cc5
Replace len by sum for generator
2023-12-12 14:05:59 +01:00
Alexey Milovidov
8a68a4247e
Style
2023-12-12 07:58:54 +01:00
Alexey Milovidov
9789c2caa2
Review fixes
2023-12-12 05:48:09 +01:00
Alexey Milovidov
0c81892463
Update tests/ci/clickbench.py
...
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2023-12-12 00:43:06 +03:00
Alexey Milovidov
a3262003f3
Update tests/ci/integration_test_check.py
...
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2023-12-12 00:42:47 +03:00
Alexey Milovidov
b9b6e7584e
Update tests/ci/fast_test_check.py
...
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2023-12-12 00:42:41 +03:00
Alexey Milovidov
fcb8ab9b63
Update tests/ci/functional_test_check.py
...
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2023-12-12 00:42:23 +03:00
Mikhail f. Shiryaev
7bd6b42af2
Merge pull request #57744 from ClickHouse/fix-dockerub-proxy
...
Tune network memory for dockerhub proxy hosts
2023-12-11 14:25:51 +01:00
Max K
f5ba4ef9b3
Tune autoscale to scale for single job in the queue ( #57742 )
...
* tune setting desired capacity
* Automatic style fix
---------
Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2023-12-11 13:07:56 +01:00
Mikhail f. Shiryaev
9307a87118
Tune network memory for dockerhub proxy hosts
2023-12-11 12:56:52 +01:00
Alexey Milovidov
4b13a6d08f
Fix CI
2023-12-10 22:02:05 +01:00
Alexey Milovidov
6b55c16b4e
mypy
2023-12-10 20:49:03 +01:00
Alexey Milovidov
c6f1832686
Merge branch 'clickbench-ci' of github.com:ClickHouse/ClickHouse into clickbench-ci
2023-12-10 19:55:18 +01:00
Alexey Milovidov
ce894c28f3
mypy
2023-12-10 19:54:59 +01:00
Alexey Milovidov
75df8db298
Python
2023-12-10 19:52:52 +01:00
robot-clickhouse
c1e387d682
Automatic style fix
2023-12-10 18:32:09 +00:00
