Commit Graph

362 Commits

Author SHA1 Message Date
Mikhail f. Shiryaev
76911c9fca
Add ci_config.StatusNames class for common statuses 2024-04-24 17:31:15 +02:00
Smita Kulkarni
d1a81e718c Merge branch 'master' into ci_add_azure_tests 2024-04-17 14:26:41 +02:00
Alexander Sapin
1e1f35fac0 Try release job 2024-04-16 10:35:18 +02:00
Alexey Milovidov
164a8d6097
Merge branch 'master' into clang-18-ci 2024-04-12 03:49:10 +02:00
Max Kainov
252d2a05a6 fix unittest 2024-04-11 16:27:25 +00:00
Max Kainov
45258bc565 CI: Add tests with Azure storage 2024-04-11 14:50:18 +00:00
Robert Schulze
116393c951
Disable s390x build 2024-04-08 11:04:11 +00:00
Dmitry Novik
65121b712e Merge remote-tracking branch 'origin/master' into enable-analyzer 2024-03-26 19:02:30 +01:00
Max Kainov
727aeb7e37 CI: set timeout for install check
#job_Install_packages_amd64 #job_style_check
2024-03-25 17:38:39 +00:00
Dmitry Novik
64301191b1 Merge remote-tracking branch 'origin/master' into enable-analyzer 2024-03-24 21:07:26 +00:00
Dmitry Novik
df88eb26a5
Merge branch 'master' into enable-analyzer 2024-03-22 15:56:32 +01:00
Max K
d3965f27c1
Merge pull request #61542 from ClickHouse/ci_arm_support_kerberos
CI: ARM integration test - skip hdfs, kerberos, kafka
2024-03-22 15:25:30 +01:00
Max Kainov
e4556ae6c1 comments 2024-03-22 14:22:53 +00:00
Max Kainov
ef0fa1963d CI: use ci-runner as module
#no_merge_commit
 #ci_set_integration
 #batch_0
2024-03-22 14:22:53 +00:00
Dmitry Novik
d43a1a1984 Merge remote-tracking branch 'origin/master' into enable-analyzer 2024-03-22 14:15:57 +01:00
Max Kainov
7d7025a74e CI: modify it 2024-03-22 00:13:17 +00:00
Dmitry Novik
20a860cf19 Update ci_config.py 2024-03-21 16:18:49 +01:00
Max K
984c7e69a0 disable test_allowed_url_with_config tests with HDFS
#no_merge_commit
 #ci_set_arm
2024-03-20 17:24:55 +00:00
Alexey Milovidov
d3872b155e Merge branch 'master' into clang-18-ci 2024-03-13 09:35:58 +01:00
Max Kainov
fb1e5923a3 CI: fix runner for arm perf tests
#do_not_test
2024-03-12 09:12:25 +00:00
Alexey Milovidov
9a880c3bb9 Merge branch 'master' into clang-18-ci 2024-03-10 06:59:27 +01:00
Max Kainov
7f061ba89c CI: add wf class in ci_config
#do_not_test
2024-03-09 14:33:34 +00:00
Mikhail f. Shiryaev
5e597228d7
Merge pull request #60408 from ClickHouse/update-style-python
Update style python
2024-03-07 09:32:28 +01:00
Max Kainov
a0d161704a CI: remove sqllancer, sqllogic, sqltest from pr wf
#do_not_test
2024-03-06 17:58:21 +00:00
Max Kainov
4dd5e4fe99 CI: fix stage config (unit test release issue)
#no_ci_cache
2024-03-06 16:52:01 +00:00
Mikhail f. Shiryaev
e31078e204
Fix some issues detected by new pylint 2024-03-05 16:02:36 +01:00
Max Kainov
82cc3f4339 CI: make workflow yml abstract
#no_merge_commit
 #no_ci_cache
 #job_style_check
 #job_package_debug
 #job_ClickHouse_build_check
 #job_Stateless_tests_debug
 #job_binary_release
2024-03-05 12:26:55 +00:00
Max Kainov
a6f5323c38 CI: Fix pending status for build report in backports
#do_not_test
2024-03-05 10:09:17 +00:00
Mikhail f. Shiryaev
bd2b0b4338
Export only str and bool for build configs 2024-03-04 20:01:26 +01:00
Alexey Milovidov
6df3179341 Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-03-03 23:02:20 +01:00
Max Kainov
8785b0700c CI: build_report job remove dependsies on yml
#no_merge_comit
 #job_ClickHouse_build_check
 #job_ClickHouse_special_build_check
 #job_style_check
2024-03-03 16:08:35 +00:00
Max Kainov
bcd6e2f945 fixup! CI: remove inputs from docker_server job command
#job_style_check #job_Docker_server_image #job_Docker_keeper_image
2024-03-02 15:12:53 +00:00
Max Kainov
8abc0df7a8 CI: remove inputs from docker_server job command
#job_style_check #job_Docker_server_image #job_Docker_keeper_image
 #packege_release #package_aarch64
2024-03-01 16:44:37 +00:00
Max K
01456f3f0c
Merge pull request #60455 from ClickHouse/ci_job_scripts_wo_input_params
CI: remove input params for job scripts
2024-02-29 15:51:10 +01:00
Max Kainov
0df8db5c3f CI: configure ci_set_analyzer
#do_not_test
2024-02-29 12:44:55 +00:00
Max Kainov
5f88a455ff CI: remove input params for job scripts
#job_style_check
 #job_Compatibility_check_amd64
 #job_Compatibility_check_aarch64
2024-02-28 22:35:47 +00:00
Alexey Milovidov
ee772aaf0f Use clang-18 in CI 2024-02-27 23:17:11 +01:00
Max Kainov
831fee9edb CI: remove Integration tests asan, release from PR wf
#do_not_test
2024-02-22 18:35:06 +00:00
Max K
0df33c94ba
Merge pull request #60224 from ClickHouse/ci_combine_analyzer_s3_replicated_tests
CI: combine analyzer, s3, dbreplicated into one job
2024-02-22 18:41:41 +01:00
Alexey Milovidov
659d960990
Merge pull request #60245 from Algunenano/enforce_cloud_sync
Make cloud sync required
2024-02-22 10:11:01 +01:00
Max K
e7a560f94d
Merge pull request #59939 from ClickHouse/ci_integration_tests_to_mysql8_migration
CI: integration tests to mysql80
2024-02-21 20:33:00 +01:00
Raúl Marín
07c9deed41 Make cloud sync required 2024-02-21 18:40:00 +01:00
Max Kainov
f827469207 CI: random sanitizer for parallel repl in PR wf 2024-02-21 16:08:03 +00:00
Max Kainov
47ab81bbab CI: support for random job pick
#no_merge_commit
 #no_ci_cache
2024-02-21 15:39:57 +00:00
Max Kainov
9fb55f1fa4 CI: combine analyzer s3 dbreplicated into one job
#job_Stateless_tests_release_analyzer_s3_DatabaseReplicated
 #job_style_check
 #no_merge_commit
2024-02-21 13:18:02 +00:00
Max Kainov
9f51e840db CI: integration tests to mysql80
#ci_set_integration
 #no_merge_commit
2024-02-21 11:05:47 +00:00
Max Kainov
5a3a93bea5 CI: refactor bugfix validate job
#no_merge_commit
2024-02-15 16:28:27 +00:00
Alexey Milovidov
789bca11e1
Merge pull request #58792 from ClickHouse/enable-coverage-for-debug-build
Add builds and tests with coverage
2024-02-10 23:52:22 +01:00
Alexey Milovidov
a7c30098b6 Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-02-09 22:52:49 +01:00
Alexey Milovidov
e54fbd3367
Update tests/ci/ci_config.py
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2024-02-09 18:32:54 +01:00
Dmitry Novik
b23ba02d4c
Enforce tests with enabled analyzer in CI 2024-02-09 16:50:37 +01:00
Max Kainov
9dfe3f5559 CI: do not reuse builds on release branches
#job_package_debug #job_style_check
2024-02-09 12:43:05 +00:00
Alexey Milovidov
c12e34df19 Fix report 2024-02-08 23:28:29 +01:00
Alexey Milovidov
cd0acc512d Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-02-08 22:08:15 +01:00
Max Kainov
641c7b547d CI: enable await
#no_merge_commit
2024-02-08 18:37:30 +00:00
Alexey Milovidov
d65a56d967
Merge branch 'master' into enable-coverage-for-debug-build 2024-02-07 04:58:21 +01:00
Max K
3ddaa1b5f1
CI: nightly job to update latest docker tag only (#59586)
* CI: nightly job to update latest docker tag only

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2024-02-05 18:09:43 +01:00
Max Kainov
6504dfe0b2 CI: Enable ARM integration test
#ci_set_integration #no_merge_commit
2024-02-02 17:37:05 +00:00
Max K
0947d5c89e
CI: ci cache. step 1 (#58664)
* ci cache class
 #no_merge_commit #ci_set_reduced
2024-02-02 18:10:47 +01:00
Mikhail f. Shiryaev
bfa722bf62
Use JobNames.STYLE_CHECK for consistency 2024-01-31 13:58:25 +01:00
Mikhail f. Shiryaev
7af7255b90
Use JobNames.DOCS_CHECK for consistency 2024-01-31 13:58:24 +01:00
Mikhail f. Shiryaev
3dae643f19
Consistent "Fast test" job name 2024-01-31 13:58:23 +01:00
robot-clickhouse
419ddf7c9d Automatic style fix 2024-01-30 18:34:56 +00:00
Max Kainov
e6fcc48471 CI: fix status and report for docker server jobs
#no_merge_commit
2024-01-30 18:24:29 +00:00
Alexey Milovidov
cb69a1b25d Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-01-29 15:35:04 +01:00
Max K
bd83830cea
CI: WA for issue with perf test with artifact reuse (#59325)
* CI: WA for issue with perf test with artifact reuse

 #do_not_test

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2024-01-29 12:17:38 +01:00
Alexey Milovidov
982e3ddbdd Fix Python 2024-01-28 23:11:03 +01:00
Alexey Milovidov
1ef8062c77 Split by batches 2024-01-28 22:28:09 +01:00
Alexey Milovidov
8798f469b3 Fix conflicts. 2024-01-28 22:27:21 +01:00
Alexey Milovidov
4a94ae5a1b Merge branch 'master' into enable-coverage-for-debug-build 2024-01-28 22:24:26 +01:00
Max Kainov
d36c92a219 CI: Add rust dir to build digest 2024-01-28 15:09:39 +00:00
Max Kainov
f1220c5637 CI: hot fix for reuse 2024-01-22 19:19:22 +00:00
Max Kainov
5379767684 Job Naming
#no_merge_commit #ci_set_reduced
2024-01-22 11:16:58 +00:00
Max K
070a55e194
Merge pull request #58516 from ClickHouse/move_out_ci_specifics_to_ci_py
CI: move ci-specifics from job scripts to ci.py
2024-01-21 18:24:42 +01:00
Max Kainov
3247ae81e4 move out ci specific functions to ci.py
#no_merge_commit
2024-01-21 16:36:37 +00:00
Alexey Milovidov
735708e9bb Merge branch 'master' into enable-coverage-for-debug-build 2024-01-20 21:40:53 +01:00
Alexey Milovidov
05609cf75d Ci to CI 2024-01-19 17:02:17 +01:00
Raúl Marín
76638fb7ba
Merge pull request #58942 from Algunenano/missing_digest
Add missing files to digests
2024-01-19 13:32:49 +01:00
Alexey Milovidov
7c0b167e2d Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-01-19 03:59:27 +01:00
Alexey Milovidov
5a6a89897e
Merge pull request #58960 from ClickHouse/add_a_comment_about_sparse_checkout
Add a comment about sparse checkout
2024-01-19 00:39:26 +01:00
robot-clickhouse
5f1f27f8c7 Automatic style fix 2024-01-18 18:34:10 +00:00
Alexander Tokmakov
01d9b9a28a add a comment about sparse checkout 2024-01-18 19:22:20 +01:00
Raúl Marín
cd4aefcddb Add missing files to digests 2024-01-18 13:36:05 +01:00
robot-clickhouse
db3ffa5c86 Automatic style fix 2024-01-18 12:11:03 +00:00
Alexey Milovidov
6d6b8fcf8e Add missing comments in code 2024-01-18 12:58:50 +01:00
Max Kainov
d387c84aa4 Jepsen job to reuse builds
#no-merge-commit
2024-01-18 11:58:41 +00:00
Alexey Milovidov
61101d1a57 Add a release build with coverage, turn off coverage in the debug build 2024-01-18 01:16:50 +01:00
Alexey Milovidov
1afc5e8c01 Enable coverage for debug build 2024-01-14 03:45:42 +01:00
Mikhail f. Shiryaev
3875f4f4b5
Fix issue with default dataclass values 2024-01-09 13:10:28 +01:00
Max Kainov
deda52b611 add packager script to build digest 2024-01-06 16:23:20 +00:00
Alexey Milovidov
7f7e80ea56
Merge pull request #58130 from ClickHouse/integration-tests-images
Use the single images list for integration tests everywhere
2023-12-22 06:04:43 +01:00
Max K
8ac13b3e26
Support "do not test" label with ci.py (#58128)
* support "do not test" label with ci.py


Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2023-12-21 18:08:25 +01:00
Mikhail f. Shiryaev
177f8f7d0d
Create a single point of true for integration tests images 2023-12-21 16:09:56 +01:00
Max K
cb53ee63be
Add GH status for PR formatting (#58050)
* add GH status for PR formatting
 #no-merge-commit
2023-12-21 11:53:01 +01:00
Max K
d8383377ea
always run ast_fuzz and sqllancer #no-merge-commit (#58049) 2023-12-19 20:14:47 +01:00
Max K
84e5870b71
Reapply "improve CI with digest for docker, build and test jobs" (#57904)
* Revert "Revert "improve CI with digest for docker, build and test jobs""

* fix: docker manifest merge for missing images only
2023-12-18 09:07:22 +01:00
Max K
8c7add0334 Revert "improve CI with digest for docker, build and test jobs (#56317)"
This reverts commit 7844fcc196.
2023-12-15 15:48:01 +01:00
Max K
7844fcc196
improve CI with digest for docker, build and test jobs (#56317)
* CI with digests to tag docker images, reuse builds, reuse tests and others
2023-12-15 15:21:20 +01:00
Alexey Milovidov
7ff3021112 Fix Docker 2023-12-12 14:12:10 +01:00
Alexey Milovidov
4b13a6d08f Fix CI 2023-12-10 22:02:05 +01:00
Alexey Milovidov
b2d8103d19 Add special build with Musl 2023-11-26 02:27:54 +01:00
Mikhail f. Shiryaev
6e00e14a45
Rewrite libfuzzer tests to reusable workflow
Update fuzzers clang version
2023-11-13 12:49:33 +01:00
Mikhail f. Shiryaev
38b251946e
Add another check to CiConfig.validate, and test for it 2023-11-13 12:49:31 +01:00
Mikhail f. Shiryaev
6dc0534143
Move sparse checkout logic to ci_config 2023-11-08 17:16:18 +01:00
Robert Schulze
cbcff6ef08
Merge remote-tracking branch 'rschu1ze/master' into clang-17 2023-09-20 09:15:58 +00:00
Robert Schulze
3a3a00f95e
Bump minimal required compiler to Clang 16 2023-09-18 17:44:04 +00:00
Yakov Olkhovskiy
b7a17bf8dd add libFuzzer tests, initial integration 2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
02a729f9c5 fix 2023-09-03 18:05:54 +00:00
Yakov Olkhovskiy
ae6b5d46be fix 2023-09-03 17:38:36 +00:00
Yakov Olkhovskiy
97317a07f1 remove oss-fuzz build, add fuzzers build 2023-09-03 17:28:44 +00:00
Alexey Milovidov
d059465389
Merge pull request #52293 from ClickHouse/sqltest
Add SQLTest
2023-08-13 00:35:46 +03:00
Yakov Olkhovskiy
fa7994de3b
Merge pull request #53181 from ClickHouse/ci-build-s390x
Add Linux s390x build to CI
2023-08-12 09:16:07 -04:00
Alexey Milovidov
aa815bfc74 Relax mergeable check 2023-08-12 01:54:11 +02:00
Alexey Milovidov
ede1b17c48
Merge branch 'master' into sqltest 2023-08-09 05:10:47 +03:00
Yakov Olkhovskiy
d8a231e0cb Add Linux s390x build to CI 2023-08-09 00:44:01 +00:00
János Benjamin Antal
55c3581242
Replace Upgrade check (debug) with a less flaky upgrade check 2023-08-07 10:27:10 +02:00
Alexey Milovidov
580f207b8d
Merge branch 'master' into sqltest 2023-08-04 22:16:56 +03:00
János Benjamin Antal
c874e5955b Remove upgrade checks with sanitizers 2023-08-04 12:33:11 +00:00
Mikhail f. Shiryaev
8499956321
Refactor CI_CONFIG from dict to dataclasses 2023-08-03 14:37:19 +02:00
Alexey Milovidov
a98e869912 Merge branch 'master' into sqltest 2023-08-02 20:08:39 +02:00
Alexey Milovidov
0641dfd7e6 Add missing modification 2023-08-01 22:33:04 +02:00
Mikhail f. Shiryaev
e5087d14ab
Merge branch 'master' into fix-packager 2023-08-01 12:04:06 +02:00
Alexey Milovidov
afb76101b7 Remove obsolete part of a check name 2023-07-31 05:23:28 +02:00
Alexey Milovidov
bc1f80dd82 Remove Coverity (part 2) 2023-07-30 10:25:44 +02:00
Antonio Andelic
e181e602a7
Update ci_config.py 2023-07-21 12:43:32 +02:00
Antonio Andelic
3c2507ad7d
Merge branch 'master' into fix-packager 2023-07-18 09:18:03 +02:00
Dmitry Novik
ee2392bf8e Merge remote-tracking branch 'origin/master' into analyzer-integration-tests 2023-07-11 08:55:31 +00:00
Alexey Milovidov
5a3aadacde Fix error 2023-07-05 23:40:37 +02:00
Alexey Milovidov
3021180e01 Update 2023-07-04 21:33:12 +02:00
Alexey Milovidov
1eafba60d2 Merge branch 'master' into riscv-in-ci 2023-07-04 21:28:05 +02:00
Alexey Milovidov
463c2ba5ce
Revert "Add documentation for building in docker" 2023-07-04 14:07:10 +03:00
Mikhail f. Shiryaev
c715ee5cef
Replace --build-type=debug by --debug-build 2023-07-03 19:58:47 +02:00
Mikhail f. Shiryaev
469da1831a
Replace --build-type=debug by --debug-build 2023-07-03 17:42:15 +02:00
Alexey Milovidov
b6e7f4cf6c Require more checks 2023-06-22 23:24:27 +02:00
Dmitry Novik
afcc3aca36 Update ci_config.py 2023-06-14 13:14:59 +00:00
Alexander Tokmakov
2c0c1ba4af
add comments to build reports (#50200) 2023-05-24 23:29:36 +03:00
Azat Khuzhin
c37fe64040 Merge remote-tracking branch 'u/master' into build/llvm-16 2023-05-08 22:33:52 +02:00
Mikhail f. Shiryaev
08d203e158
Sanitize "Flaky tests", remove trailing dots 2023-05-02 12:42:26 +02:00
Alexey Milovidov
dd7282ea5c
Update ci_config.py 2023-05-01 16:05:14 +03:00
Mikhail f. Shiryaev
886ba0b01d
Replace markdown with pure HTML for check descriptions 2023-04-28 23:52:34 +02:00
Mikhail f. Shiryaev
61c6c61638
Rework the status comment to be a digest with the full report available
by link
2023-04-28 23:52:33 +02:00
Mikhail f. Shiryaev
f411be8c37
Rename Run Check to CI running 2023-04-28 23:52:31 +02:00
Mikhail f. Shiryaev
19fd5f9c3c
Add descriptions for the status comment 2023-04-28 23:52:29 +02:00
Dmitry Novik
0d3e896f57
Merge pull request #48719 from ClickHouse/analyzer-ci
Add CI run with new analyzer enabled
2023-04-24 17:36:18 +02:00
Mikhail f. Shiryaev
caee710fcc
Enforce documentation change for a new-feature PR 2023-04-24 10:41:38 +02:00
Dmitry Novik
b2ed99f6b3
Merge branch 'master' into analyzer-ci 2023-04-18 13:07:45 +02:00
Dmitry Novik
61e552d660 Fix used build 2023-04-17 15:23:02 +00:00
Sema Checherinda
0354a964cd turn on all CI back 2023-04-17 14:07:56 +02:00
Sema Checherinda
c3b9d5fe6e introduce sqllogic runner 2023-04-16 13:57:24 +02:00
Alexey Milovidov
89a76c2d77 Use LLVM 16 2023-03-18 23:45:57 +01:00