Commit Graph

1064 Commits

Author SHA1 Message Date
Max K
b254be6180 CI: add secrets to reusable build stage wf yml 2024-05-24 16:57:08 +02:00
Max K
cb37b098ef CI: add secrets to reusable stage wf yml 2024-05-24 16:17:25 +02:00
Max K
f1421c9e5c style fix 2024-05-24 12:27:05 +02:00
Max K
22b441ed40 fix PR template 2024-05-24 12:00:24 +02:00
Max K
d4fb2d50e9 CI: Sync, Merge check, CI gh's statuses fixes 2024-05-24 12:00:16 +02:00
Max K
3e21ff92a3 CI: master workflow with folded jobs 2024-05-24 10:53:19 +02:00
Max K
8d697123da CI: Cancel sync wf on new push 2024-05-23 18:44:12 +02:00
Max K
9a40ff033d
Merge branch 'master' into ci_disable_arm_int_tests_with_kerberazied_kafka 2024-05-22 20:35:23 +02:00
alesapin
455045056f Merge branch 'master' into ci_disable_arm_int_tests_with_kerberazied_kafka 2024-05-21 17:18:13 +02:00
Max K
ac7da1cc38 CI: cancel running PR wf after adding to MQ 2024-05-21 17:14:52 +02:00
Max K
f00f551fba
Merge pull request #64093 from ClickHouse/ci_mergeable_check_redesign
CI: mergeable check redesign
2024-05-21 08:04:50 +00:00
Max Kainov
a735ab7dd1 fix upstream commit status update in sync pr 2024-05-20 18:58:56 +00:00
Azat Khuzhin
64a308013f Tune mmap_rnd_bits to workaround sanitizers issues
v1: vm.mmap_rnd_bits=28
v2: rebase with clang 18.1.6 + kernel.randomize_va_space=0
v3: leave only vm.mmap_rnd_bits=28 + use pre-run.sh (hope that it will
    be used), that way docker will not require --privileged and by some
    reason this breaks ASAN (though I cannot reproduce it)
v4: use actions/common_setup over init_runner.sh (it requires some
    manual deploy)
2024-05-19 22:37:16 +02:00
Max K
5698ef698d check overall wf status in mergeable check 2024-05-19 18:02:15 +02:00
Max K
4e4d078786 return sync pr status to upstream from FinishCheck job 2024-05-18 20:36:04 +02:00
Max K
d5eac97d45 remove update_mergeable_check_from_ci.py 2024-05-18 19:53:06 +02:00
Max K
e3329a10f9 CI: mergeable check redesign 2024-05-18 18:25:48 +02:00
Robert Schulze
5fb8ea4c62
Merge remote-tracking branch 'ClickHouse/master' into qiangxuhui-loongarch64 2024-05-17 07:56:01 +00:00
Max K
d7f95ddfcf CI: Enable Arm integration tests job in CI 2024-05-16 13:16:01 +02:00
Max K
c6e81542e1
Merge pull request #63757 from ClickHouse/ci_remove_cancel_wf
CI: remove Cancel and Debug workflows as redundant
2024-05-14 17:03:37 +00:00
Anton Popov
c229175bc3
fix typo 2024-05-14 16:24:59 +02:00
Max K
30515e2202 CI: remove Cancel and Debus wf as redundant 2024-05-14 16:03:50 +02:00
qiangxuhui
13508de9a4 Fix code according to review suggestions 2024-05-14 10:49:09 +00:00
qiangxuhui
537b56b139 Add loongarch64 CI support 2024-05-14 08:15:28 +00:00
qiangxuhui
97a5de9653 Initial support for loongarch64
Make ClickHouse compilable and runnable on loongarch64

So far only basic functionality was tested (on real hw),
clickhouse server runs, exceptions works, client works,
simple tests works.
2024-05-14 07:45:26 +00:00
Mikhail f. Shiryaev
f9a7a50fcf
Merge pull request #63123 from ClickHouse/ci_separate_wf_file_for_mq
CI: try separate the workflows file for GitHub's Merge Queue
2024-05-11 10:46:06 +00:00
Mikhail f. Shiryaev
afe37d6095
Bring back hmarr/debug-action as agreed in slack 2024-05-11 12:22:41 +02:00
Robert Schulze
15e67fee78
Merge remote-tracking branch 'ClickHouse/master' into hlee-z-build-fix 2024-05-02 07:02:24 +00:00
Konstantin Bogdanov
a779f76b59
Hide CI options under a spoiler 2024-05-01 14:56:49 +02:00
alesapin
0b836376d1 Run azure tests in PR 2024-04-30 17:41:44 +02:00
Robert Schulze
6af89ecf12
Revert "Disable s390x build"
This reverts commit 116393c951.
2024-04-30 10:02:19 +00:00
Max Kainov
155866b262 CI: try separate wf file for MQ 2024-04-29 14:15:09 +00:00
Mikhail f. Shiryaev
fd6f17b3f3
Update the debug-action 2024-04-29 12:27:40 +02:00
alesapin
8a2ca8513d Temporary remove azure from template 2024-04-27 16:58:21 +02:00
alesapin
78e6d62ed3
Merge branch 'master' into ci_add_azure_tests 2024-04-27 12:33:42 +02:00
alesapin
b4e3880c6b Test work without azurite 2024-04-27 12:30:28 +02:00
Max Kainov
6866382326 minor update for MCheck in the MQ 2024-04-26 08:25:25 +00:00
Max Kainov
4b6227148f Fuse in Finish Check for MQ 2024-04-25 14:52:42 +00:00
Max K
a5302bf9f3 Revert "Revert "CI: add FT to MQ remove Style from master"" 2024-04-25 14:51:06 +00:00
Max K
049c429b1f
Revert "CI: add FT to MQ remove Style from master" 2024-04-24 19:19:27 +02:00
Max K
92554d9b73
Merge branch 'master' into ci_fast_t_in_mq 2024-04-24 17:53:38 +01:00
alesapin
4210c34f94 Merge branch 'master' into ci_add_azure_tests 2024-04-24 17:26:05 +02:00
Mikhail f. Shiryaev
666b269d67
Fix workflow dependencies after #62556 2024-04-17 22:37:27 +02:00
Robert Schulze
7dc05d092b
Merge remote-tracking branch 'rschu1ze/master' into be-less-boring-32 2024-04-15 16:35:10 +00:00
Mikhail f. Shiryaev
ed2e4e3f49
Merge pull request #62556 from ClickHouse/fix-integration-logs-compression
Fix integration-tests logs compression
2024-04-12 14:54:11 +00:00
Max Kainov
e2acd0e93f CI: add FT to MQ remove Style from master 2024-04-12 10:29:46 +00:00
Max Kainov
45258bc565 CI: Add tests with Azure storage 2024-04-11 14:50:18 +00:00
Mikhail f. Shiryaev
2bbd36a5b7
Run fast tests and style checks in parallel 2024-04-11 15:36:07 +02:00
Max Kainov
59d56668e9 CI: respect Sync status in the MQ 2024-04-11 13:20:20 +00:00
Max Kainov
2e4e3187d5 merge sync pr on push to master 2024-04-10 13:49:49 +00:00
Max Kainov
603824748d CI: disable finish check for mq 2024-04-08 15:03:13 +00:00
Robert Schulze
116393c951
Disable s390x build 2024-04-08 11:04:11 +00:00
Dmitry Novik
31df60be20 Merge remote-tracking branch 'origin/master' into enable-analyzer 2024-03-27 11:37:32 +01:00
robot-ch-test-poll2
5d2bc7ee34
Merge pull request #61948 from ClickHouse/ci_new_menu
CI: new ci menu in PR body
2024-03-27 01:56:17 +04:00
Max Kainov
813b60f129 Add handling for include/exclude ci filters 2024-03-26 19:34:05 +00:00
Dmitry Novik
65121b712e Merge remote-tracking branch 'origin/master' into enable-analyzer 2024-03-26 19:02:30 +01:00
Max Kainov
e4d9a74057 CI: create CIOptions class to handle ci user config
CI: create CIOptions class to handle ci user config
2024-03-26 15:39:07 +00:00
Max Kainov
f9f830228a CI: MQ support 2024-03-25 17:57:03 +00:00
Dmitry Novik
d43a1a1984 Merge remote-tracking branch 'origin/master' into enable-analyzer 2024-03-22 14:15:57 +01:00
Max Kainov
7d7025a74e CI: modify it 2024-03-22 00:13:17 +00:00
Max Kainov
d6b515b6bf CI: modify CI from PR body
#do_not_test
 #job_style_check
2024-03-21 19:35:07 +00:00
Dmitry Novik
f0e7b78f8b Inverse analyzer in tests 2024-03-20 13:35:30 +01:00
Alexey Milovidov
dd2ace9a85
Merge pull request #61441 from ClickHouse/ci_fix_checout_action_version
CI: fix checkout action version
2024-03-16 13:53:30 +03:00
Mikhail f. Shiryaev
3190e4603d
Merge pull request #61433 from ClickHouse/restore-merge-approved-pr
Restore automerge for approved PRs
2024-03-15 17:31:52 +01:00
Max Kainov
20bad992a4 CI: fix checkout action version
#do_not_test
2024-03-15 12:46:15 +00:00
Alexey Milovidov
5787b7f7c8
Update nightly.yml 2024-03-15 14:46:26 +03:00
Mikhail f. Shiryaev
61870fa4b5
Disable broken SonarCloud 2024-03-15 12:43:11 +01:00
Mikhail f. Shiryaev
ad4a259068
Restore automerge for approved PRs 2024-03-15 12:13:35 +01:00
Mikhail f. Shiryaev
4d714b5d96
Merge pull request #60611 from ClickHouse/ready-for-release
Investigate and fix an issue with MarkReleaseReady
2024-03-07 14:54:36 +01:00
Max Kainov
61d64fd7e0 CI: test build's checkout step issue
#no_ci_cache
 #job_package_debug
 #job_style_check
2024-03-07 12:26:09 +00:00
Mikhail f. Shiryaev
a70b09b4e5
Investigate an issue with MarkReleaseReady
tags #no_ci_cache #job_package_release #job_package_aarch64
tags #job_binary_darwin #job_binary_darwin_aarch64
2024-03-07 10:22:02 +01:00
Max Kainov
82cc3f4339 CI: make workflow yml abstract
#no_merge_commit
 #no_ci_cache
 #job_style_check
 #job_package_debug
 #job_ClickHouse_build_check
 #job_Stateless_tests_debug
 #job_binary_release
2024-03-05 12:26:55 +00:00
Max Kainov
8785b0700c CI: build_report job remove dependsies on yml
#no_merge_comit
 #job_ClickHouse_build_check
 #job_ClickHouse_special_build_check
 #job_style_check
2024-03-03 16:08:35 +00:00
Max Kainov
bcd6e2f945 fixup! CI: remove inputs from docker_server job command
#job_style_check #job_Docker_server_image #job_Docker_keeper_image
2024-03-02 15:12:53 +00:00
Max Kainov
8abc0df7a8 CI: remove inputs from docker_server job command
#job_style_check #job_Docker_server_image #job_Docker_keeper_image
 #packege_release #package_aarch64
2024-03-01 16:44:37 +00:00
Max K
01456f3f0c
Merge pull request #60455 from ClickHouse/ci_job_scripts_wo_input_params
CI: remove input params for job scripts
2024-02-29 15:51:10 +01:00
Max Kainov
5f88a455ff CI: remove input params for job scripts
#job_style_check
 #job_Compatibility_check_amd64
 #job_Compatibility_check_aarch64
2024-02-28 22:35:47 +00:00
Max Kainov
444ff093bb CI: Auto backport for bugfix and CI changes 2024-02-28 16:02:13 +00:00
Max Kainov
30a5bb1142 PR template fix to include ci fix category 2024-02-27 16:58:06 +00:00
Max Kainov
831fee9edb CI: remove Integration tests asan, release from PR wf
#do_not_test
2024-02-22 18:35:06 +00:00
Max K
0df33c94ba
Merge pull request #60224 from ClickHouse/ci_combine_analyzer_s3_replicated_tests
CI: combine analyzer, s3, dbreplicated into one job
2024-02-22 18:41:41 +01:00
Max Kainov
da50758eb6 CI: use aarch style checker for CI config job
#do_not_test
2024-02-21 16:59:41 +00:00
Max Kainov
9fb55f1fa4 CI: combine analyzer s3 dbreplicated into one job
#job_Stateless_tests_release_analyzer_s3_DatabaseReplicated
 #job_style_check
 #no_merge_commit
2024-02-21 13:18:02 +00:00
Max K
bf6929cb4c
Merge pull request #59348 from ClickHouse/refactor_bugfix_validate_job
CI: refactor bugfix-validate job
2024-02-16 12:32:52 +01:00
Alexey Milovidov
123a34637d Disable tests with coverage 2024-02-15 23:38:32 +01:00
Max Kainov
5a3a93bea5 CI: refactor bugfix validate job
#no_merge_commit
2024-02-15 16:28:27 +00:00
Mikhail f. Shiryaev
a5e3b7982a
Use the least awful and ugly way to check if all needs succeeded 2024-02-14 18:38:00 +01:00
Alexey Milovidov
a7c30098b6 Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-02-09 22:52:49 +01:00
robot-clickhouse
548cc2577b
Merge pull request #59798 from ClickHouse/ci_fix_release_publish
CI: do not reuse builds on release branches
2024-02-09 13:55:28 +01:00
Max Kainov
9dfe3f5559 CI: do not reuse builds on release branches
#job_package_debug #job_style_check
2024-02-09 12:43:05 +00:00
Mikhail f. Shiryaev
3ee2dda511
Fix special build reports in release branches 2024-02-09 12:59:06 +01:00
Alexey Milovidov
c12e34df19 Fix report 2024-02-08 23:28:29 +01:00
Alexey Milovidov
cd0acc512d Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-02-08 22:08:15 +01:00
Max Kainov
641c7b547d CI: enable await
#no_merge_commit
2024-02-08 18:37:30 +00:00
Alexey Milovidov
d65a56d967
Merge branch 'master' into enable-coverage-for-debug-build 2024-02-07 04:58:21 +01:00
Mikhail f. Shiryaev
f7a0c38a3d
Unquote FLAG_LATEST to fix issue with empty argument 2024-02-06 21:31:44 +01:00
Alexey Milovidov
e673d8bd0c
Update 85_bug-report.md 2024-02-06 01:50:59 +03:00
Max K
3ddaa1b5f1
CI: nightly job to update latest docker tag only (#59586)
* CI: nightly job to update latest docker tag only

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2024-02-05 18:09:43 +01:00
Max Kainov
6504dfe0b2 CI: Enable ARM integration test
#ci_set_integration #no_merge_commit
2024-02-02 17:37:05 +00:00
Max K
0947d5c89e
CI: ci cache. step 1 (#58664)
* ci cache class
 #no_merge_commit #ci_set_reduced
2024-02-02 18:10:47 +01:00
Mikhail f. Shiryaev
9febc8e5b4
Update the peter-evans/create-pull-request action to v6 2024-02-02 14:39:23 +01:00
Mikhail f. Shiryaev
3dae643f19
Consistent "Fast test" job name 2024-01-31 13:58:23 +01:00
Max Kainov
e6fcc48471 CI: fix status and report for docker server jobs
#no_merge_commit
2024-01-30 18:24:29 +00:00
Alexey Milovidov
4a94ae5a1b Merge branch 'master' into enable-coverage-for-debug-build 2024-01-28 22:24:26 +01:00
Max K
070a55e194
Merge pull request #58516 from ClickHouse/move_out_ci_specifics_to_ci_py
CI: move ci-specifics from job scripts to ci.py
2024-01-21 18:24:42 +01:00
Max Kainov
3247ae81e4 move out ci specific functions to ci.py
#no_merge_commit
2024-01-21 16:36:37 +00:00
Alexey Milovidov
482229cd27 Add tests with coverage 2024-01-19 08:04:34 +01:00
Alexey Milovidov
7c0b167e2d Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-01-19 03:59:27 +01:00
Alexey Milovidov
5a6a89897e
Merge pull request #58960 from ClickHouse/add_a_comment_about_sparse_checkout
Add a comment about sparse checkout
2024-01-19 00:39:26 +01:00
Alexander Tokmakov
01d9b9a28a add a comment about sparse checkout 2024-01-18 19:22:20 +01:00
Max Kainov
4eb7cda8fa Add pr_info event type so that jobs could know how they launched
#no_merge_commit #ci_set_reduced
2024-01-18 13:31:37 +00:00
Max Kainov
d387c84aa4 Jepsen job to reuse builds
#no-merge-commit
2024-01-18 11:58:41 +00:00
Alexey Milovidov
b9f8fff623 Fix YAML 2024-01-18 01:36:48 +01:00
Alexey Milovidov
61101d1a57 Add a release build with coverage, turn off coverage in the debug build 2024-01-18 01:16:50 +01:00
Max K
8774f8097f
Run build report check job on build failures, fix (#58135)
* run build report check on build failures #no-merge-commit

* Always run post action in reusable_build

 #no-merge-commit
2023-12-21 21:30:40 +01:00
Max K
b9408125cc
CI for docs only fix (#57992)
* run only docs related jobs if changes are in docs only (fix after applying CI with digest)
2023-12-18 17:06:10 +01:00
Max K
84e5870b71
Reapply "improve CI with digest for docker, build and test jobs" (#57904)
* Revert "Revert "improve CI with digest for docker, build and test jobs""

* fix: docker manifest merge for missing images only
2023-12-18 09:07:22 +01:00
Max K
8c7add0334 Revert "improve CI with digest for docker, build and test jobs (#56317)"
This reverts commit 7844fcc196.
2023-12-15 15:48:01 +01:00
Max K
7844fcc196
improve CI with digest for docker, build and test jobs (#56317)
* CI with digests to tag docker images, reuse builds, reuse tests and others
2023-12-15 15:21:20 +01:00
Alexey Milovidov
1d70c9464e Add it to master checks 2023-12-13 18:01:18 +01:00
Alexey Milovidov
9789c2caa2 Review fixes 2023-12-12 05:48:09 +01:00
Alexey Milovidov
9a3860581c YAML 2023-12-10 00:27:11 +01:00
Alexey Milovidov
3ac3a06561 Add ClickBench to CI 2023-12-09 23:31:05 +01:00
Alexey Milovidov
15a0e6ab05 Merge branch 'master' into musl-7 2023-12-08 03:19:55 +01:00
alesapin
5a880cd0f0 Fix bugfix validate check 2023-12-03 16:08:53 +01:00
Alexey Milovidov
51fecff769 Fix style 2023-11-26 02:27:54 +01:00
Alexey Milovidov
b2d8103d19 Add special build with Musl 2023-11-26 02:27:54 +01:00
Mikhail f. Shiryaev
38d4d66998
Fix missing argument for style_check.py in master workflow 2023-11-13 18:43:42 +01:00
Mikhail f. Shiryaev
f72c628fbc
Add forgotten PYTHONUNBUFFERED global env to reusable workflows 2023-11-13 12:51:55 +01:00
Mikhail f. Shiryaev
c0a3c02564
Skip unnecessary PrepareStrategy jobs 2023-11-13 12:51:55 +01:00
Mikhail f. Shiryaev
d0e5a55fb5
Fix condition for Clean actions, execute it always 2023-11-13 12:49:38 +01:00
Mikhail f. Shiryaev
5c1ae48532
Clean all batches: 1 default values 2023-11-13 12:49:38 +01:00
Mikhail f. Shiryaev
8a36f2fa4c
Rewrite builds reports to reusable workflow 2023-11-13 12:49:37 +01:00
Mikhail f. Shiryaev
111bc9e628
Rewrite leftovers to reusable workflow 2023-11-13 12:49:36 +01:00
Mikhail f. Shiryaev
cdf417defe
Rewrite unit tests to reusable workflow 2023-11-13 12:49:36 +01:00
Mikhail f. Shiryaev
7d3440add5
Delete codebrowser leftovers 2023-11-13 12:49:35 +01:00
Mikhail f. Shiryaev
b90a27af86
Rewrite compatibility checks to reusable workflow 2023-11-13 12:49:34 +01:00
Mikhail f. Shiryaev
9937d0d5b8
Rewrite jepsen to reusable workflow 2023-11-13 12:49:34 +01:00
Mikhail f. Shiryaev
15d27d5e85
Rewrite docs test to reusable workflow 2023-11-13 12:49:33 +01:00
Mikhail f. Shiryaev
6e00e14a45
Rewrite libfuzzer tests to reusable workflow
Update fuzzers clang version
2023-11-13 12:49:33 +01:00
Mikhail f. Shiryaev
b6a71ae6f4
Rewrite fast tests to reusable workflow 2023-11-13 12:49:33 +01:00
Mikhail f. Shiryaev
6f8baf3def
Rewrite style checks to reusable workflow 2023-11-13 12:49:32 +01:00
Mikhail f. Shiryaev
a831a648cd
Move GITHUB_JOB_OVERRIDDEN to job ENV context 2023-11-13 12:49:31 +01:00
Mikhail f. Shiryaev
db8a548718
Rewrite integrations checks 2023-11-13 12:49:30 +01:00
Mikhail f. Shiryaev
e07de85497
Rewrite AST fuzzers and performance checks 2023-11-13 12:49:30 +01:00
Mikhail f. Shiryaev
4495557774
Rewrite stress and upgrade checks 2023-11-13 12:49:29 +01:00
Mikhail f. Shiryaev
b69a2608c4
Rewrite functional test to use reusable_test.yml 2023-11-13 12:49:29 +01:00
Mikhail f. Shiryaev
2aec201c78
Rewrite reusable_install_test to universal reusable_test 2023-11-13 12:49:28 +01:00
Mikhail f. Shiryaev
45e12bef4e
Use reusable_install_test.yml 2023-11-13 12:49:28 +01:00
Mikhail f. Shiryaev
b1db60abc2
Move IMAGES_PATH and REPORTS_PATH to the common_setup 2023-11-13 12:49:27 +01:00