Commit Graph

1008 Commits

Author SHA1 Message Date
Max Kainov
e4d9a74057 CI: create CIOptions class to handle ci user config
CI: create CIOptions class to handle ci user config
2024-03-26 15:39:07 +00:00
Max Kainov
f9f830228a CI: MQ support 2024-03-25 17:57:03 +00:00
Dmitry Novik
d43a1a1984 Merge remote-tracking branch 'origin/master' into enable-analyzer 2024-03-22 14:15:57 +01:00
Max Kainov
7d7025a74e CI: modify it 2024-03-22 00:13:17 +00:00
Max Kainov
d6b515b6bf CI: modify CI from PR body
#do_not_test
 #job_style_check
2024-03-21 19:35:07 +00:00
Dmitry Novik
f0e7b78f8b Inverse analyzer in tests 2024-03-20 13:35:30 +01:00
Alexey Milovidov
dd2ace9a85
Merge pull request #61441 from ClickHouse/ci_fix_checout_action_version
CI: fix checkout action version
2024-03-16 13:53:30 +03:00
Mikhail f. Shiryaev
3190e4603d
Merge pull request #61433 from ClickHouse/restore-merge-approved-pr
Restore automerge for approved PRs
2024-03-15 17:31:52 +01:00
Max Kainov
20bad992a4 CI: fix checkout action version
#do_not_test
2024-03-15 12:46:15 +00:00
Alexey Milovidov
5787b7f7c8
Update nightly.yml 2024-03-15 14:46:26 +03:00
Mikhail f. Shiryaev
61870fa4b5
Disable broken SonarCloud 2024-03-15 12:43:11 +01:00
Mikhail f. Shiryaev
ad4a259068
Restore automerge for approved PRs 2024-03-15 12:13:35 +01:00
Mikhail f. Shiryaev
4d714b5d96
Merge pull request #60611 from ClickHouse/ready-for-release
Investigate and fix an issue with MarkReleaseReady
2024-03-07 14:54:36 +01:00
Max Kainov
61d64fd7e0 CI: test build's checkout step issue
#no_ci_cache
 #job_package_debug
 #job_style_check
2024-03-07 12:26:09 +00:00
Mikhail f. Shiryaev
a70b09b4e5
Investigate an issue with MarkReleaseReady
tags #no_ci_cache #job_package_release #job_package_aarch64
tags #job_binary_darwin #job_binary_darwin_aarch64
2024-03-07 10:22:02 +01:00
Max Kainov
82cc3f4339 CI: make workflow yml abstract
#no_merge_commit
 #no_ci_cache
 #job_style_check
 #job_package_debug
 #job_ClickHouse_build_check
 #job_Stateless_tests_debug
 #job_binary_release
2024-03-05 12:26:55 +00:00
Max Kainov
8785b0700c CI: build_report job remove dependsies on yml
#no_merge_comit
 #job_ClickHouse_build_check
 #job_ClickHouse_special_build_check
 #job_style_check
2024-03-03 16:08:35 +00:00
Max Kainov
bcd6e2f945 fixup! CI: remove inputs from docker_server job command
#job_style_check #job_Docker_server_image #job_Docker_keeper_image
2024-03-02 15:12:53 +00:00
Max Kainov
8abc0df7a8 CI: remove inputs from docker_server job command
#job_style_check #job_Docker_server_image #job_Docker_keeper_image
 #packege_release #package_aarch64
2024-03-01 16:44:37 +00:00
Max K
01456f3f0c
Merge pull request #60455 from ClickHouse/ci_job_scripts_wo_input_params
CI: remove input params for job scripts
2024-02-29 15:51:10 +01:00
Max Kainov
5f88a455ff CI: remove input params for job scripts
#job_style_check
 #job_Compatibility_check_amd64
 #job_Compatibility_check_aarch64
2024-02-28 22:35:47 +00:00
Max Kainov
444ff093bb CI: Auto backport for bugfix and CI changes 2024-02-28 16:02:13 +00:00
Max Kainov
30a5bb1142 PR template fix to include ci fix category 2024-02-27 16:58:06 +00:00
Max Kainov
831fee9edb CI: remove Integration tests asan, release from PR wf
#do_not_test
2024-02-22 18:35:06 +00:00
Max K
0df33c94ba
Merge pull request #60224 from ClickHouse/ci_combine_analyzer_s3_replicated_tests
CI: combine analyzer, s3, dbreplicated into one job
2024-02-22 18:41:41 +01:00
Max Kainov
da50758eb6 CI: use aarch style checker for CI config job
#do_not_test
2024-02-21 16:59:41 +00:00
Max Kainov
9fb55f1fa4 CI: combine analyzer s3 dbreplicated into one job
#job_Stateless_tests_release_analyzer_s3_DatabaseReplicated
 #job_style_check
 #no_merge_commit
2024-02-21 13:18:02 +00:00
Max K
bf6929cb4c
Merge pull request #59348 from ClickHouse/refactor_bugfix_validate_job
CI: refactor bugfix-validate job
2024-02-16 12:32:52 +01:00
Alexey Milovidov
123a34637d Disable tests with coverage 2024-02-15 23:38:32 +01:00
Max Kainov
5a3a93bea5 CI: refactor bugfix validate job
#no_merge_commit
2024-02-15 16:28:27 +00:00
Mikhail f. Shiryaev
a5e3b7982a
Use the least awful and ugly way to check if all needs succeeded 2024-02-14 18:38:00 +01:00
Alexey Milovidov
a7c30098b6 Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-02-09 22:52:49 +01:00
robot-clickhouse
548cc2577b
Merge pull request #59798 from ClickHouse/ci_fix_release_publish
CI: do not reuse builds on release branches
2024-02-09 13:55:28 +01:00
Max Kainov
9dfe3f5559 CI: do not reuse builds on release branches
#job_package_debug #job_style_check
2024-02-09 12:43:05 +00:00
Mikhail f. Shiryaev
3ee2dda511
Fix special build reports in release branches 2024-02-09 12:59:06 +01:00
Alexey Milovidov
c12e34df19 Fix report 2024-02-08 23:28:29 +01:00
Alexey Milovidov
cd0acc512d Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-02-08 22:08:15 +01:00
Max Kainov
641c7b547d CI: enable await
#no_merge_commit
2024-02-08 18:37:30 +00:00
Alexey Milovidov
d65a56d967
Merge branch 'master' into enable-coverage-for-debug-build 2024-02-07 04:58:21 +01:00
Mikhail f. Shiryaev
f7a0c38a3d
Unquote FLAG_LATEST to fix issue with empty argument 2024-02-06 21:31:44 +01:00
Alexey Milovidov
e673d8bd0c
Update 85_bug-report.md 2024-02-06 01:50:59 +03:00
Max K
3ddaa1b5f1
CI: nightly job to update latest docker tag only (#59586)
* CI: nightly job to update latest docker tag only

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2024-02-05 18:09:43 +01:00
Max Kainov
6504dfe0b2 CI: Enable ARM integration test
#ci_set_integration #no_merge_commit
2024-02-02 17:37:05 +00:00
Max K
0947d5c89e
CI: ci cache. step 1 (#58664)
* ci cache class
 #no_merge_commit #ci_set_reduced
2024-02-02 18:10:47 +01:00
Mikhail f. Shiryaev
9febc8e5b4
Update the peter-evans/create-pull-request action to v6 2024-02-02 14:39:23 +01:00
Mikhail f. Shiryaev
3dae643f19
Consistent "Fast test" job name 2024-01-31 13:58:23 +01:00
Max Kainov
e6fcc48471 CI: fix status and report for docker server jobs
#no_merge_commit
2024-01-30 18:24:29 +00:00
Alexey Milovidov
4a94ae5a1b Merge branch 'master' into enable-coverage-for-debug-build 2024-01-28 22:24:26 +01:00
Max K
070a55e194
Merge pull request #58516 from ClickHouse/move_out_ci_specifics_to_ci_py
CI: move ci-specifics from job scripts to ci.py
2024-01-21 18:24:42 +01:00
Max Kainov
3247ae81e4 move out ci specific functions to ci.py
#no_merge_commit
2024-01-21 16:36:37 +00:00
Alexey Milovidov
482229cd27 Add tests with coverage 2024-01-19 08:04:34 +01:00
Alexey Milovidov
7c0b167e2d Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-01-19 03:59:27 +01:00
Alexey Milovidov
5a6a89897e
Merge pull request #58960 from ClickHouse/add_a_comment_about_sparse_checkout
Add a comment about sparse checkout
2024-01-19 00:39:26 +01:00
Alexander Tokmakov
01d9b9a28a add a comment about sparse checkout 2024-01-18 19:22:20 +01:00
Max Kainov
4eb7cda8fa Add pr_info event type so that jobs could know how they launched
#no_merge_commit #ci_set_reduced
2024-01-18 13:31:37 +00:00
Max Kainov
d387c84aa4 Jepsen job to reuse builds
#no-merge-commit
2024-01-18 11:58:41 +00:00
Alexey Milovidov
b9f8fff623 Fix YAML 2024-01-18 01:36:48 +01:00
Alexey Milovidov
61101d1a57 Add a release build with coverage, turn off coverage in the debug build 2024-01-18 01:16:50 +01:00
Max K
8774f8097f
Run build report check job on build failures, fix (#58135)
* run build report check on build failures #no-merge-commit

* Always run post action in reusable_build

 #no-merge-commit
2023-12-21 21:30:40 +01:00
Max K
b9408125cc
CI for docs only fix (#57992)
* run only docs related jobs if changes are in docs only (fix after applying CI with digest)
2023-12-18 17:06:10 +01:00
Max K
84e5870b71
Reapply "improve CI with digest for docker, build and test jobs" (#57904)
* Revert "Revert "improve CI with digest for docker, build and test jobs""

* fix: docker manifest merge for missing images only
2023-12-18 09:07:22 +01:00
Max K
8c7add0334 Revert "improve CI with digest for docker, build and test jobs (#56317)"
This reverts commit 7844fcc196.
2023-12-15 15:48:01 +01:00
Max K
7844fcc196
improve CI with digest for docker, build and test jobs (#56317)
* CI with digests to tag docker images, reuse builds, reuse tests and others
2023-12-15 15:21:20 +01:00
Alexey Milovidov
1d70c9464e Add it to master checks 2023-12-13 18:01:18 +01:00
Alexey Milovidov
9789c2caa2 Review fixes 2023-12-12 05:48:09 +01:00
Alexey Milovidov
9a3860581c YAML 2023-12-10 00:27:11 +01:00
Alexey Milovidov
3ac3a06561 Add ClickBench to CI 2023-12-09 23:31:05 +01:00
Alexey Milovidov
15a0e6ab05 Merge branch 'master' into musl-7 2023-12-08 03:19:55 +01:00
alesapin
5a880cd0f0 Fix bugfix validate check 2023-12-03 16:08:53 +01:00
Alexey Milovidov
51fecff769 Fix style 2023-11-26 02:27:54 +01:00
Alexey Milovidov
b2d8103d19 Add special build with Musl 2023-11-26 02:27:54 +01:00
Mikhail f. Shiryaev
38d4d66998
Fix missing argument for style_check.py in master workflow 2023-11-13 18:43:42 +01:00
Mikhail f. Shiryaev
f72c628fbc
Add forgotten PYTHONUNBUFFERED global env to reusable workflows 2023-11-13 12:51:55 +01:00
Mikhail f. Shiryaev
c0a3c02564
Skip unnecessary PrepareStrategy jobs 2023-11-13 12:51:55 +01:00
Mikhail f. Shiryaev
d0e5a55fb5
Fix condition for Clean actions, execute it always 2023-11-13 12:49:38 +01:00
Mikhail f. Shiryaev
5c1ae48532
Clean all batches: 1 default values 2023-11-13 12:49:38 +01:00
Mikhail f. Shiryaev
8a36f2fa4c
Rewrite builds reports to reusable workflow 2023-11-13 12:49:37 +01:00
Mikhail f. Shiryaev
111bc9e628
Rewrite leftovers to reusable workflow 2023-11-13 12:49:36 +01:00
Mikhail f. Shiryaev
cdf417defe
Rewrite unit tests to reusable workflow 2023-11-13 12:49:36 +01:00
Mikhail f. Shiryaev
7d3440add5
Delete codebrowser leftovers 2023-11-13 12:49:35 +01:00
Mikhail f. Shiryaev
b90a27af86
Rewrite compatibility checks to reusable workflow 2023-11-13 12:49:34 +01:00
Mikhail f. Shiryaev
9937d0d5b8
Rewrite jepsen to reusable workflow 2023-11-13 12:49:34 +01:00
Mikhail f. Shiryaev
15d27d5e85
Rewrite docs test to reusable workflow 2023-11-13 12:49:33 +01:00
Mikhail f. Shiryaev
6e00e14a45
Rewrite libfuzzer tests to reusable workflow
Update fuzzers clang version
2023-11-13 12:49:33 +01:00
Mikhail f. Shiryaev
b6a71ae6f4
Rewrite fast tests to reusable workflow 2023-11-13 12:49:33 +01:00
Mikhail f. Shiryaev
6f8baf3def
Rewrite style checks to reusable workflow 2023-11-13 12:49:32 +01:00
Mikhail f. Shiryaev
a831a648cd
Move GITHUB_JOB_OVERRIDDEN to job ENV context 2023-11-13 12:49:31 +01:00
Mikhail f. Shiryaev
db8a548718
Rewrite integrations checks 2023-11-13 12:49:30 +01:00
Mikhail f. Shiryaev
e07de85497
Rewrite AST fuzzers and performance checks 2023-11-13 12:49:30 +01:00
Mikhail f. Shiryaev
4495557774
Rewrite stress and upgrade checks 2023-11-13 12:49:29 +01:00
Mikhail f. Shiryaev
b69a2608c4
Rewrite functional test to use reusable_test.yml 2023-11-13 12:49:29 +01:00
Mikhail f. Shiryaev
2aec201c78
Rewrite reusable_install_test to universal reusable_test 2023-11-13 12:49:28 +01:00
Mikhail f. Shiryaev
45e12bef4e
Use reusable_install_test.yml 2023-11-13 12:49:28 +01:00
Mikhail f. Shiryaev
b1db60abc2
Move IMAGES_PATH and REPORTS_PATH to the common_setup 2023-11-13 12:49:27 +01:00
Mikhail f. Shiryaev
dc6a61ee8f
Add reusable installation workflow 2023-11-13 12:49:27 +01:00
Mikhail f. Shiryaev
6dc0534143
Move sparse checkout logic to ci_config 2023-11-08 17:16:18 +01:00
Mikhail f. Shiryaev
614b2a1795
Rewrite build jobs to use callable workflow 2023-11-08 17:16:17 +01:00
Mikhail f. Shiryaev
23b29b00d1
Create common setup and cleanup actions 2023-11-08 17:16:16 +01:00
Mikhail f. Shiryaev
4fe3d10604
Unify all workflows for python unit tests, follow naming best practices 2023-11-06 11:14:57 +01:00
Nikita Taranov
cf44a53760 upd reference 2023-10-23 15:13:30 +02:00
Nikita Taranov
32bbee50a2
Include information about supported versions in bug report issue template 2023-10-23 13:44:43 +02:00
Mikhail f. Shiryaev
92260b7aed
Ignore docs_check.yml in pull_requests and wise versa 2023-10-17 19:27:58 +02:00
Mikhail f. Shiryaev
9c9bc3fee2
Add filter: for almost every checkout 2023-10-17 19:21:08 +02:00
Mikhail f. Shiryaev
66337c23cc
Use treeless checkout for image building 2023-10-17 19:15:24 +02:00
Mikhail f. Shiryaev
f525f05598 Merge remote-tracking branch 'origin/master' into sources-with-subs 2023-10-03 14:42:24 +02:00
Mikhail f. Shiryaev
11e3665d95
Adjust watched paths for DocsCheck CI 2023-09-28 01:20:34 +02:00
Robert Schulze
9a91f97ac4
Merge pull request #53831 from rschu1ze/clang-17
Switch CI to Clang 17
2023-09-22 12:28:35 +02:00
Max Kainov
31e6893e01 adjust path/path-ignore in docs and pr workflows 2023-09-22 09:02:09 +00:00
Robert Schulze
cbcff6ef08
Merge remote-tracking branch 'rschu1ze/master' into clang-17 2023-09-20 09:15:58 +00:00
Mikhail f. Shiryaev
4882b99715
Merge pull request #54310 from ClickHouse/ci-libfuzzer-integration
CI: libFuzzer integration
2023-09-20 10:01:39 +02:00
Robert Schulze
3a3a00f95e
Bump minimal required compiler to Clang 16 2023-09-18 17:44:04 +00:00
Yakov Olkhovskiy
dd6f12dd94 review suggestions 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
d1cd3cdd2a move on its own workflow 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
b7a17bf8dd add libFuzzer tests, initial integration 2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
46fa7dbb80 add libFuzzer build on 'libFuzzer' label, build produces artifacts 2023-09-17 16:28:50 +00:00
János Benjamin Antal
328f675473 Temporarily disable cron 2023-09-14 15:09:42 +00:00
János Benjamin Antal
51781a6a86 Add workflow 2023-09-14 12:05:50 +00:00
János Benjamin Antal
5862c4ec93
Use not the absolute latest docker image tag (#54369)
* Add params for select queries in clickhouse_helper.py

* Find the latest image tags from master

* Get full git history

* Do not checkout submodules

* Automatic style fix

* Fix style errors

* Make logging pretty

* Revert accidentally committed changes

* Eliminate pformat

* Update all workflows

* Remove flag with default value

* Improve exception handling

* Utilizing the loop condition in while loop

* Make the logic robust over temporary errors

* Prettify logs

* Automatic style fix

* Add accidentally removed line

* Revert "Make the logic robust over temporary errors"

This reverts commit 91e6b5d7ba.

* Do not fail in case the tag cannot be queried from ClickHouse

* Support partial finding of tags

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2023-09-08 08:42:56 +02:00
Mikhail f. Shiryaev
7999598ad8
Rollback testing part from #42599 2023-09-05 12:59:31 +02:00
robot-clickhouse
926c5636dd
Merge pull request #42599 from ClickHouse/build-fuzzer-protocol
libFuzzer: add CI fuzzers build, add tcp protocol fuzzer, fix other fuzzers.
2023-09-04 22:41:54 +02:00
Yakov Olkhovskiy
97317a07f1 remove oss-fuzz build, add fuzzers build 2023-09-03 17:28:44 +00:00
Mikhail f. Shiryaev
e553242957
Get rid of CLICKHOUSE_CI_LOGS_* secrets 2023-08-30 22:06:31 +02:00
Alexey Milovidov
c19a20cc23
More assertive 2023-08-29 20:33:03 +03:00
Yakov Olkhovskiy
db1a291e1e cleanup 2023-08-27 23:19:24 +00:00
Yakov Olkhovskiy
713f971b56 debug 2023-08-26 16:06:41 +00:00
Yakov Olkhovskiy
8ed7fe9846 debug 2023-08-26 15:48:48 +00:00
Yakov Olkhovskiy
06aae687a0 local oss-fuzz build_fuzzers 2023-08-26 06:01:48 +00:00
Yakov Olkhovskiy
15f77f1d4f style fix 2023-08-25 21:23:12 +00:00
Yakov Olkhovskiy
e62dc05421 fix 2023-08-25 21:06:14 +00:00
Yakov Olkhovskiy
a9ba0f3139 style 2023-08-25 14:12:17 +00:00
Yakov Olkhovskiy
5888bef8c4 fix indentation 2023-08-25 02:20:24 +00:00
Yakov Olkhovskiy
e9ccfb24f1
Merge branch 'master' into build-fuzzer-protocol 2023-08-23 17:13:35 -04:00
Yakov Olkhovskiy
95de1610b8
Update pull_request.yml 2023-08-23 17:10:18 -04:00
Alexey Milovidov
d059465389
Merge pull request #52293 from ClickHouse/sqltest
Add SQLTest
2023-08-13 00:35:46 +03:00
Alexey Milovidov
561e043868
Merge branch 'master' into sqltest 2023-08-10 21:47:56 +03:00
Alexey Milovidov
53151610a0
Merge branch 'master' into sqltest 2023-08-10 03:47:26 +03:00
Alexey Milovidov
964c407d48
Revert "Revert "Upload build time-trace data to CI database"" 2023-08-09 16:11:17 +03:00
Alexander Gololobov
63183c56f1
Revert "Upload build time-trace data to CI database" 2023-08-09 13:58:05 +02:00
Alexey Milovidov
ede1b17c48
Merge branch 'master' into sqltest 2023-08-09 05:10:47 +03:00
Yakov Olkhovskiy
d8a231e0cb Add Linux s390x build to CI 2023-08-09 00:44:01 +00:00
Alexey Milovidov
d977e221b4 Upload build time-trace data to CI database 2023-08-07 03:26:59 +02:00
Mikhail f. Shiryaev
a4185d9be0
Merge branch 'master' into sources-with-subs 2023-08-03 16:08:39 +02:00
Alexey Milovidov
b4f0d0bc2e
Update pull_request.yml 2023-08-02 21:05:39 +03:00
Alexey Milovidov
97bd68d5c7 Merge branch 'master' into sqltest 2023-08-01 22:31:18 +02:00
Alexey Milovidov
afb76101b7 Remove obsolete part of a check name 2023-07-31 05:23:28 +02:00
Alexey Milovidov
8e3bd222f0 Add SQLTest 2023-07-19 03:42:32 +02:00
Dmitry Novik
fc05187e8a Add dependencies to FinishCheck 2023-07-17 13:50:21 +00:00
Dmitry Novik
dd74ce3e1c Add integration tests check with analyzer to master 2023-07-17 13:44:52 +00:00
Mikhail f. Shiryaev
0ba38b4dde
Merge branch 'master' into sources-with-subs 2023-07-17 14:04:02 +02:00
Dmitry Novik
ee2392bf8e Merge remote-tracking branch 'origin/master' into analyzer-integration-tests 2023-07-11 08:55:31 +00:00