Commit Graph

313 Commits

Author SHA1 Message Date
Alexey Milovidov
e54fbd3367
Update tests/ci/ci_config.py
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2024-02-09 18:32:54 +01:00
Dmitry Novik
b23ba02d4c
Enforce tests with enabled analyzer in CI 2024-02-09 16:50:37 +01:00
Max Kainov
9dfe3f5559 CI: do not reuse builds on release branches
#job_package_debug #job_style_check
2024-02-09 12:43:05 +00:00
Alexey Milovidov
c12e34df19 Fix report 2024-02-08 23:28:29 +01:00
Alexey Milovidov
cd0acc512d Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-02-08 22:08:15 +01:00
Max Kainov
641c7b547d CI: enable await
#no_merge_commit
2024-02-08 18:37:30 +00:00
Alexey Milovidov
d65a56d967
Merge branch 'master' into enable-coverage-for-debug-build 2024-02-07 04:58:21 +01:00
Max K
3ddaa1b5f1
CI: nightly job to update latest docker tag only (#59586)
* CI: nightly job to update latest docker tag only

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2024-02-05 18:09:43 +01:00
Max Kainov
6504dfe0b2 CI: Enable ARM integration test
#ci_set_integration #no_merge_commit
2024-02-02 17:37:05 +00:00
Max K
0947d5c89e
CI: ci cache. step 1 (#58664)
* ci cache class
 #no_merge_commit #ci_set_reduced
2024-02-02 18:10:47 +01:00
Mikhail f. Shiryaev
bfa722bf62
Use JobNames.STYLE_CHECK for consistency 2024-01-31 13:58:25 +01:00
Mikhail f. Shiryaev
7af7255b90
Use JobNames.DOCS_CHECK for consistency 2024-01-31 13:58:24 +01:00
Mikhail f. Shiryaev
3dae643f19
Consistent "Fast test" job name 2024-01-31 13:58:23 +01:00
robot-clickhouse
419ddf7c9d Automatic style fix 2024-01-30 18:34:56 +00:00
Max Kainov
e6fcc48471 CI: fix status and report for docker server jobs
#no_merge_commit
2024-01-30 18:24:29 +00:00
Alexey Milovidov
cb69a1b25d Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-01-29 15:35:04 +01:00
Max K
bd83830cea
CI: WA for issue with perf test with artifact reuse (#59325)
* CI: WA for issue with perf test with artifact reuse

 #do_not_test

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2024-01-29 12:17:38 +01:00
Alexey Milovidov
982e3ddbdd Fix Python 2024-01-28 23:11:03 +01:00
Alexey Milovidov
1ef8062c77 Split by batches 2024-01-28 22:28:09 +01:00
Alexey Milovidov
8798f469b3 Fix conflicts. 2024-01-28 22:27:21 +01:00
Alexey Milovidov
4a94ae5a1b Merge branch 'master' into enable-coverage-for-debug-build 2024-01-28 22:24:26 +01:00
Max Kainov
d36c92a219 CI: Add rust dir to build digest 2024-01-28 15:09:39 +00:00
Max Kainov
f1220c5637 CI: hot fix for reuse 2024-01-22 19:19:22 +00:00
Max Kainov
5379767684 Job Naming
#no_merge_commit #ci_set_reduced
2024-01-22 11:16:58 +00:00
Max K
070a55e194
Merge pull request #58516 from ClickHouse/move_out_ci_specifics_to_ci_py
CI: move ci-specifics from job scripts to ci.py
2024-01-21 18:24:42 +01:00
Max Kainov
3247ae81e4 move out ci specific functions to ci.py
#no_merge_commit
2024-01-21 16:36:37 +00:00
Alexey Milovidov
735708e9bb Merge branch 'master' into enable-coverage-for-debug-build 2024-01-20 21:40:53 +01:00
Alexey Milovidov
05609cf75d Ci to CI 2024-01-19 17:02:17 +01:00
Raúl Marín
76638fb7ba
Merge pull request #58942 from Algunenano/missing_digest
Add missing files to digests
2024-01-19 13:32:49 +01:00
Alexey Milovidov
7c0b167e2d Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-01-19 03:59:27 +01:00
Alexey Milovidov
5a6a89897e
Merge pull request #58960 from ClickHouse/add_a_comment_about_sparse_checkout
Add a comment about sparse checkout
2024-01-19 00:39:26 +01:00
robot-clickhouse
5f1f27f8c7 Automatic style fix 2024-01-18 18:34:10 +00:00
Alexander Tokmakov
01d9b9a28a add a comment about sparse checkout 2024-01-18 19:22:20 +01:00
Raúl Marín
cd4aefcddb Add missing files to digests 2024-01-18 13:36:05 +01:00
robot-clickhouse
db3ffa5c86 Automatic style fix 2024-01-18 12:11:03 +00:00
Alexey Milovidov
6d6b8fcf8e Add missing comments in code 2024-01-18 12:58:50 +01:00
Max Kainov
d387c84aa4 Jepsen job to reuse builds
#no-merge-commit
2024-01-18 11:58:41 +00:00
Alexey Milovidov
61101d1a57 Add a release build with coverage, turn off coverage in the debug build 2024-01-18 01:16:50 +01:00
Alexey Milovidov
1afc5e8c01 Enable coverage for debug build 2024-01-14 03:45:42 +01:00
Mikhail f. Shiryaev
3875f4f4b5
Fix issue with default dataclass values 2024-01-09 13:10:28 +01:00
Max Kainov
deda52b611 add packager script to build digest 2024-01-06 16:23:20 +00:00
Alexey Milovidov
7f7e80ea56
Merge pull request #58130 from ClickHouse/integration-tests-images
Use the single images list for integration tests everywhere
2023-12-22 06:04:43 +01:00
Max K
8ac13b3e26
Support "do not test" label with ci.py (#58128)
* support "do not test" label with ci.py


Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2023-12-21 18:08:25 +01:00
Mikhail f. Shiryaev
177f8f7d0d
Create a single point of true for integration tests images 2023-12-21 16:09:56 +01:00
Max K
cb53ee63be
Add GH status for PR formatting (#58050)
* add GH status for PR formatting
 #no-merge-commit
2023-12-21 11:53:01 +01:00
Max K
d8383377ea
always run ast_fuzz and sqllancer #no-merge-commit (#58049) 2023-12-19 20:14:47 +01:00
Max K
84e5870b71
Reapply "improve CI with digest for docker, build and test jobs" (#57904)
* Revert "Revert "improve CI with digest for docker, build and test jobs""

* fix: docker manifest merge for missing images only
2023-12-18 09:07:22 +01:00
Max K
8c7add0334 Revert "improve CI with digest for docker, build and test jobs (#56317)"
This reverts commit 7844fcc196.
2023-12-15 15:48:01 +01:00
Max K
7844fcc196
improve CI with digest for docker, build and test jobs (#56317)
* CI with digests to tag docker images, reuse builds, reuse tests and others
2023-12-15 15:21:20 +01:00
Alexey Milovidov
7ff3021112 Fix Docker 2023-12-12 14:12:10 +01:00
Alexey Milovidov
4b13a6d08f Fix CI 2023-12-10 22:02:05 +01:00
Alexey Milovidov
b2d8103d19 Add special build with Musl 2023-11-26 02:27:54 +01:00
Mikhail f. Shiryaev
6e00e14a45
Rewrite libfuzzer tests to reusable workflow
Update fuzzers clang version
2023-11-13 12:49:33 +01:00
Mikhail f. Shiryaev
38b251946e
Add another check to CiConfig.validate, and test for it 2023-11-13 12:49:31 +01:00
Mikhail f. Shiryaev
6dc0534143
Move sparse checkout logic to ci_config 2023-11-08 17:16:18 +01:00
Robert Schulze
cbcff6ef08
Merge remote-tracking branch 'rschu1ze/master' into clang-17 2023-09-20 09:15:58 +00:00
Robert Schulze
3a3a00f95e
Bump minimal required compiler to Clang 16 2023-09-18 17:44:04 +00:00
Yakov Olkhovskiy
b7a17bf8dd add libFuzzer tests, initial integration 2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
02a729f9c5 fix 2023-09-03 18:05:54 +00:00
Yakov Olkhovskiy
ae6b5d46be fix 2023-09-03 17:38:36 +00:00
Yakov Olkhovskiy
97317a07f1 remove oss-fuzz build, add fuzzers build 2023-09-03 17:28:44 +00:00
Alexey Milovidov
d059465389
Merge pull request #52293 from ClickHouse/sqltest
Add SQLTest
2023-08-13 00:35:46 +03:00
Yakov Olkhovskiy
fa7994de3b
Merge pull request #53181 from ClickHouse/ci-build-s390x
Add Linux s390x build to CI
2023-08-12 09:16:07 -04:00
Alexey Milovidov
aa815bfc74 Relax mergeable check 2023-08-12 01:54:11 +02:00
Alexey Milovidov
ede1b17c48
Merge branch 'master' into sqltest 2023-08-09 05:10:47 +03:00
Yakov Olkhovskiy
d8a231e0cb Add Linux s390x build to CI 2023-08-09 00:44:01 +00:00
János Benjamin Antal
55c3581242
Replace Upgrade check (debug) with a less flaky upgrade check 2023-08-07 10:27:10 +02:00
Alexey Milovidov
580f207b8d
Merge branch 'master' into sqltest 2023-08-04 22:16:56 +03:00
János Benjamin Antal
c874e5955b Remove upgrade checks with sanitizers 2023-08-04 12:33:11 +00:00
Mikhail f. Shiryaev
8499956321
Refactor CI_CONFIG from dict to dataclasses 2023-08-03 14:37:19 +02:00
Alexey Milovidov
a98e869912 Merge branch 'master' into sqltest 2023-08-02 20:08:39 +02:00
Alexey Milovidov
0641dfd7e6 Add missing modification 2023-08-01 22:33:04 +02:00
Mikhail f. Shiryaev
e5087d14ab
Merge branch 'master' into fix-packager 2023-08-01 12:04:06 +02:00
Alexey Milovidov
afb76101b7 Remove obsolete part of a check name 2023-07-31 05:23:28 +02:00
Alexey Milovidov
bc1f80dd82 Remove Coverity (part 2) 2023-07-30 10:25:44 +02:00
Antonio Andelic
e181e602a7
Update ci_config.py 2023-07-21 12:43:32 +02:00
Antonio Andelic
3c2507ad7d
Merge branch 'master' into fix-packager 2023-07-18 09:18:03 +02:00
Dmitry Novik
ee2392bf8e Merge remote-tracking branch 'origin/master' into analyzer-integration-tests 2023-07-11 08:55:31 +00:00
Alexey Milovidov
5a3aadacde Fix error 2023-07-05 23:40:37 +02:00
Alexey Milovidov
3021180e01 Update 2023-07-04 21:33:12 +02:00
Alexey Milovidov
1eafba60d2 Merge branch 'master' into riscv-in-ci 2023-07-04 21:28:05 +02:00
Alexey Milovidov
463c2ba5ce
Revert "Add documentation for building in docker" 2023-07-04 14:07:10 +03:00
Mikhail f. Shiryaev
c715ee5cef
Replace --build-type=debug by --debug-build 2023-07-03 19:58:47 +02:00
Mikhail f. Shiryaev
469da1831a
Replace --build-type=debug by --debug-build 2023-07-03 17:42:15 +02:00
Alexey Milovidov
b6e7f4cf6c Require more checks 2023-06-22 23:24:27 +02:00
Dmitry Novik
afcc3aca36 Update ci_config.py 2023-06-14 13:14:59 +00:00
Alexander Tokmakov
2c0c1ba4af
add comments to build reports (#50200) 2023-05-24 23:29:36 +03:00
Azat Khuzhin
c37fe64040 Merge remote-tracking branch 'u/master' into build/llvm-16 2023-05-08 22:33:52 +02:00
Mikhail f. Shiryaev
08d203e158
Sanitize "Flaky tests", remove trailing dots 2023-05-02 12:42:26 +02:00
Alexey Milovidov
dd7282ea5c
Update ci_config.py 2023-05-01 16:05:14 +03:00
Mikhail f. Shiryaev
886ba0b01d
Replace markdown with pure HTML for check descriptions 2023-04-28 23:52:34 +02:00
Mikhail f. Shiryaev
61c6c61638
Rework the status comment to be a digest with the full report available
by link
2023-04-28 23:52:33 +02:00
Mikhail f. Shiryaev
f411be8c37
Rename Run Check to CI running 2023-04-28 23:52:31 +02:00
Mikhail f. Shiryaev
19fd5f9c3c
Add descriptions for the status comment 2023-04-28 23:52:29 +02:00
Dmitry Novik
0d3e896f57
Merge pull request #48719 from ClickHouse/analyzer-ci
Add CI run with new analyzer enabled
2023-04-24 17:36:18 +02:00
Mikhail f. Shiryaev
caee710fcc
Enforce documentation change for a new-feature PR 2023-04-24 10:41:38 +02:00
Dmitry Novik
b2ed99f6b3
Merge branch 'master' into analyzer-ci 2023-04-18 13:07:45 +02:00
Dmitry Novik
61e552d660 Fix used build 2023-04-17 15:23:02 +00:00
Sema Checherinda
0354a964cd turn on all CI back 2023-04-17 14:07:56 +02:00
Sema Checherinda
c3b9d5fe6e introduce sqllogic runner 2023-04-16 13:57:24 +02:00
Alexey Milovidov
89a76c2d77 Use LLVM 16 2023-03-18 23:45:57 +01:00
Robert Schulze
380e076e84
x86 --> amd64 2023-03-03 11:20:07 +00:00
Robert Schulze
5ddc9a9eed
Add binary compatibility check for Aarch64 2023-03-02 11:08:08 +00:00
avogar
53a3cfc9e0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-09 13:24:19 +00:00
Mikhail f. Shiryaev
cd2e1cfada
Merge pull request #45568 from ClickHouse/keeper-systemd
Add systemd.service for clickhouse-keeper
2023-02-03 23:08:02 +01:00
Nikita Mikhaylov
33877b5e00
Parallel replicas. Part [2] (#43772) 2023-02-03 14:34:18 +01:00
Mikhail f. Shiryaev
dc00bce9cf
Add tests for packages' installation 2023-02-03 12:16:16 +01:00
avogar
fd9b735505 Merge with master, add some fixes 2023-01-20 20:22:03 +00:00
Robert Schulze
0330276a02
The "libraries" field is no longer needed 2023-01-03 19:07:29 +00:00
Robert Schulze
cfb6feffde
What happens if I remove these 139 lines of code? 2023-01-03 18:35:31 +00:00
Alexey Milovidov
47ae8c5c79 Remove more lines 2023-01-02 02:06:11 +01:00
Robert Schulze
2b9a0824fe
Cosmetics: Rename "amd64-sse2" builds to "amd64-compat" builds
... a bit of consistency with "aarch64-v80compat"
2022-12-19 19:00:21 +00:00
Antonio Andelic
8e1a4bcf9a Update CI config 2022-11-07 09:42:00 +00:00
Yatsishin Ilya
13f506f7b1 minor 2022-10-21 11:48:58 +00:00
Yatsishin Ilya
8b3dc2d551 typo 2022-10-18 07:52:11 +00:00
Yatsishin Ilya
6a82d54314 add CI files 2022-10-17 14:46:50 +00:00
Robert Schulze
c5224cd007
Point automatic download script to to ARMv8.0 compat build
- follow-up to #41610

- universal.sh downloads a the correct ClickHouse binary for the current
  platform

- For Linux/Aarch64, point to v8.0 compat build for maximum
  compatibility. Also add property static_binary_name (ci_config.py) so
  that the binary can be placed into the right location.

- Remove the unsupported combinations FreeBSD Aarch64 and PPC for which
  we provide no binaries.
2022-09-26 11:40:09 +00:00
Robert Schulze
bcaa66c804
Add arm-v80compat builds 2022-09-21 13:09:24 +00:00
Robert Schulze
13a2bbaf5e
Merge branch 'master' into enable_constant_column_search 2022-09-16 11:09:45 +02:00
Robert Schulze
cce4ed5496
Un-exclude constant_column_search from ARM perf tests
constant_column_search was excluced when ARM perf tests were set up
PR 37497. Back then we haven't had PR 41033 and regexp eval on ARM was
slow. Let's check again.
2022-09-15 10:48:47 +00:00
Azat Khuzhin
ced30a2072 Switch to llvm/clang 15
It had been released few hours ago, and I want to check how clang-15
generates DWARF-5

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Robert Schulze
9d4de0cbaa
Merge pull request #40999 from ClickHouse/sse2-special-build
Add special x86-SSE2-only build
2022-09-08 09:06:29 +02:00
Kseniia Sumarokova
68e013e819
Update ci_config.py 2022-09-05 22:13:07 +02:00
Robert Schulze
e1def723f8
Add special x86-SSE2-only build 2022-09-05 12:51:44 +00:00
Alexey Milovidov
a819f2c75b
Merge branch 'master' into add-more-s3-tests 2022-09-05 05:23:17 +03:00
Robert Schulze
d311482391
More renamings for consistency
AST Fuzzer (ASan)  --> AST Fuzzer (asan)
AST Fuzzer (TSan)  --> AST Fuzzer (tsan)
AST Fuzzer (MSan)  --> AST Fuzzer (msan)
AST Fuzzer (UBSan) --> AST Fuzzer (ubsan)
2022-09-01 07:59:01 +00:00
Robert Schulze
48164b039a
Consistent sanitizer naming in CI
Sanitizer build/test jobs were sometimes named with full form
('undefined') - which could be confusing - and sometimes named with
abbreviated form ('ubsan'). Now always using the short form.
2022-08-31 12:45:05 +00:00
Alexey Milovidov
91ed3ebe9a Remove the remaining parts of "unbundled" build 2022-08-27 02:18:47 +02:00
Alexey Milovidov
cb2e5f316c Revert "Maybe make it possible"
This reverts commit a517d9d65f.
2022-08-21 20:52:04 +02:00
Alexey Milovidov
ad8a1751ac
Merge branch 'master' into riscv-in-ci 2022-08-21 16:56:11 +03:00
Yakov Olkhovskiy
b865787b3c
add Unit tests to Mergeable 2022-08-15 19:05:40 -04:00
Alexey Milovidov
a517d9d65f Maybe make it possible 2022-08-15 04:23:56 +02:00
Alexey Milovidov
edc99648ad Add build to CI 2022-08-14 06:14:43 +02:00
Yakov Olkhovskiy
40463e9c47 add Stateful tests (release), Stateless tests (release) to Mergeable Check 2022-08-08 00:20:09 -04:00
Alexey Milovidov
f08952b74c
Merge pull request #39735 from ClickHouse/ci-simple-check-refactoring
CI: refactor Simple Check, use statuses to make it stateful
2022-08-06 02:04:36 +03:00
Yakov Olkhovskiy
1a52fa183d rename Simple Check to Mergeable Check, refactor processing 2022-08-05 10:39:58 -04:00
Alexander Tokmakov
82b50e79cf
Merge branch 'master' into tsan_clang_15 2022-08-02 13:00:55 +03:00
Robert Schulze
0e154ed1df
More renamings 2022-08-01 07:05:39 +00:00
Alexander Tokmakov
31550436e4 try clang-15 for build with tsan 2022-07-31 14:38:13 +02:00
Robert Schulze
729d19fa4f
Rename "splitted build" to "shared libraries build" in CI tools
- The old name made sense for (dev option) "-DUSE_STATIC_LIBRARIES=0
  -DSPLIT_SHARED_LIBRARIES=1 -DSPLIT_BINARY=1" but that was removed with
  #39520.

- What still exists is "-DUSE_STATIC_LIBRARIES=0
  -DSPLIT_SHARED_LIBRARIES=1" which does a shared library build
2022-07-31 12:26:51 +00:00
Alexey Milovidov
d306063a76
Merge branch 'master' into add-more-s3-tests 2022-07-31 01:15:49 +03:00
Mikhail f. Shiryaev
061e61919a
Merge pull request #39450 from ClickHouse/tsal-clang-13
Build thread sanitizer binaries with clang-13
2022-07-26 15:13:17 +02:00
Mikhail f. Shiryaev
17b504b0d4
Build thread sanitizer binaries with clang-13 2022-07-22 12:14:22 +02:00
Mikhail f. Shiryaev
d42018a2dc
Cleanup the rest of (actions) status names 2022-07-21 13:10:22 +02:00
Mikhail f. Shiryaev
b0eef42b9b
Remove unused Testflows and Release ci configs 2022-07-21 13:07:14 +02:00
Mikhail f. Shiryaev
31be011430
Rename bugfix checks statuses, clear unised ci config 2022-07-21 13:04:34 +02:00
Mikhail f. Shiryaev
9679401a67
Rename flaky tests statuses 2022-07-21 12:58:36 +02:00
Mikhail f. Shiryaev
3ab288b095
Rename AST fuzzer statuses 2022-07-21 12:47:49 +02:00
Mikhail f. Shiryaev
8be0d9287d
Rename unit tests statuses 2022-07-21 12:45:46 +02:00
Mikhail f. Shiryaev
69f0cf19f4
Rename integration tests statuses 2022-07-21 12:43:42 +02:00