Commit Graph

3186 Commits

Author SHA1 Message Date
Raúl Marín
fa3bdf6050 Fix style 2024-06-21 09:15:32 +00:00
Raúl Marín
8b54e4b593 Changelog improvements 2024-06-20 18:01:07 +00:00
Max K
84d282c573 CI: Rename sync status 2024-06-19 17:29:24 +02:00
Max K
cb7d97988a CI: Rename Sync status 2024-06-19 15:07:16 +02:00
Max K
b1f2b54d70
Merge pull request #65394 from alexkats/compatibility
Fix compatibility release check
2024-06-18 17:16:02 +00:00
Alex Katsman
ec855651f3 Fix compatibility release check 2024-06-18 13:54:45 +00:00
Max K
ed38f370c3 CI: Add Non-blocking (Woolen wolfdog) CI mode 2024-06-18 13:40:01 +02:00
Max K
abb88e4d60
Merge pull request #65045 from ClickHouse/ci_config_refactoring
CI: ci_config refactoring
2024-06-18 08:17:35 +00:00
robot-clickhouse
9f64e46f5e Automatic style fix 2024-06-17 10:55:44 +00:00
Max K
59b871663f More ci unit tests 2024-06-17 12:41:35 +02:00
Max K
f00750a152 do not overwrite Sync status if set 2024-06-17 08:33:31 +02:00
Max K
1d48bd7846 add SyncState class fir further adoption 2024-06-15 18:16:17 +02:00
robot-clickhouse
ed9bfbe393 Automatic style fix 2024-06-15 16:06:39 +00:00
Max K
2af2fc1486 more tests 2024-06-15 17:59:42 +02:00
Max K
0d7a4915ae align job names, add more tests 2024-06-15 17:49:05 +02:00
robot-clickhouse
9bf849ca73 Automatic style fix 2024-06-14 19:28:05 +00:00
Mikhail f. Shiryaev
799e573008
Fix silly typo that caused wrong tags messages 2024-06-14 19:03:32 +02:00
Max K
ba349ac73b ci test improvement 2024-06-14 18:50:53 +02:00
Max K
7b43ede04e style fix 2024-06-14 18:45:08 +02:00
Max K
592d704bf9 Build Report check remove pending status 2024-06-14 18:42:37 +02:00
Max K
6e3199ebea CI: ci_config refactoring 2024-06-14 11:58:29 +02:00
Max K
205cb400ab
Merge pull request #65228 from ClickHouse/ci_propagate_wf_error_to_finish_check
CI: FinishCheck to set failure if workflow failed
2024-06-14 07:39:07 +00:00
DamianMaslanka5
c1da3f1e41 Run htmltest in CI to detect invalid links with hashes 2024-06-13 21:03:29 +02:00
Max K
5bc879c07c comment 2024-06-13 20:42:30 +02:00
Max K
fc255456ce comment 2024-06-13 16:36:07 +02:00
Max K
a77eda6388 fix pylint 2024-06-13 16:27:41 +02:00
Max K
0d17f2cede CI: FinishCheck to set failure if workflow failed 2024-06-13 16:14:57 +02:00
Mikhail f. Shiryaev
f1707998d2
Fix search issues for progress_func, add zstd for GH cache 2024-06-13 15:40:38 +02:00
Mikhail f. Shiryaev
72cc6b2ba0
Merge pull request #64813 from ClickHouse/changelog-in-ci
Changelog in ci
2024-06-12 21:11:29 +00:00
Max Kainov
49977e89e0 CI: Fix not-merged cherry-picks for backports 2024-06-12 14:29:52 +00:00
Mikhail f. Shiryaev
94c82787c5
Add a progress function for searching PRs in changelog.py 2024-06-12 14:43:26 +02:00
Mikhail f. Shiryaev
c797c8105d
Allow to pass tqdm.tqdm into get_pulls_from_search 2024-06-12 14:43:26 +02:00
Mikhail f. Shiryaev
4b90e0ecd4
Improve splitting search_issues, solving pylint issues 2024-06-12 14:43:25 +02:00
Mikhail f. Shiryaev
f4630e9dae
Fix Backported in for not-for-changelog PRs 2024-06-12 14:43:25 +02:00
Mikhail f. Shiryaev
335ec8f3e1
Parse changelog entry is not required properly 2024-06-12 14:43:24 +02:00
Mikhail f. Shiryaev
3cc099a88e
Adjust changelog.py to a new release model with v24.6.1.1-new tags 2024-06-12 14:43:24 +02:00
Mikhail f. Shiryaev
55350a3338
Fix style issues 2024-06-12 14:43:23 +02:00
Mikhail f. Shiryaev
0803e87a93
Use GitHubCache in changelog.py 2024-06-12 14:43:23 +02:00
Mikhail f. Shiryaev
dcd3e9d151
Move changelog script to tests/ci 2024-06-12 14:43:22 +02:00
Mikhail f. Shiryaev
b1a10e23a1
Merge pull request #64759 from ClickHouse/new-release-scheme
Adjust the `version_helper` and script to a new release scheme
2024-06-11 13:37:51 +00:00
Mikhail f. Shiryaev
221ac1414d
Merge pull request #64904 from ClickHouse/improve-pr-info-diff
Persistent PRInfo diff url
2024-06-10 18:24:16 +00:00
Mikhail f. Shiryaev
d984a80b57
Create tag in dry-run to check the order of commands 2024-06-10 14:38:40 +02:00
Mikhail f. Shiryaev
3d07f72927
Create tags v{version}-new for new releases 2024-06-10 14:38:40 +02:00
Mikhail f. Shiryaev
43b0866ed6
Make Release._create_tag more flexible 2024-06-10 14:38:39 +02:00
Mikhail f. Shiryaev
d506220f8c
Fix possible issues in Release._checkout 2024-06-10 14:38:39 +02:00
Mikhail f. Shiryaev
0cd1cf6533
Do not require "Ready for release" status for new release 2024-06-10 14:38:39 +02:00
Mikhail f. Shiryaev
c8e00d987e
Changes in version_helper.py should change the builds 2024-06-10 14:38:38 +02:00
Mikhail f. Shiryaev
76842d4e1b
Use pathlib.Path in version_helper 2024-06-10 14:38:37 +02:00
Mikhail f. Shiryaev
569a03d30d
Ignore files in tests/ci/tmp 2024-06-10 14:38:37 +02:00
Mikhail f. Shiryaev
da2c3b7332
Support *-new tags in version_helper.py 2024-06-10 14:38:36 +02:00
Mikhail f. Shiryaev
aa2a08c157
Some improvements for CHVersion.tweak type 2024-06-10 14:38:36 +02:00
Mikhail f. Shiryaev
61f547b08d
Support -new tags in git_helper, clean helper, add tests 2024-06-10 14:38:35 +02:00
Mikhail f. Shiryaev
05ad1e1b18
Remove unused Git.new_branch 2024-06-10 14:38:34 +02:00
Max K
d80cba90fb CI: Remove fuzzer build from normal CI run (bugfix) 2024-06-10 11:22:06 +02:00
SmitaRKulkarni
b49322de32
Merge pull request #63160 from ClickHouse/Azure_fix_stateless_tests
Fix flaky stateless test with azure
2024-06-10 08:34:07 +00:00
Max K
a0f3d233d7
Merge pull request #65010 from ClickHouse/ci_backport_fixes
CI: Fix backports
2024-06-08 16:45:08 +00:00
Max K
9f90f2463a fix 2024-06-08 18:06:10 +02:00
Max K
f7505bb6c3
Merge pull request #64987 from ClickHouse/ci_fix_nightly
CI: Fix nightly workflow
2024-06-07 19:23:54 +00:00
robot-clickhouse
18e12c48a4 Automatic style fix 2024-06-07 19:03:23 +00:00
Max K
ca756b4d51 CI: Fix backports 2024-06-07 20:42:07 +02:00
Max K
d993fa5cc6 CI: Fix backports 2024-06-07 20:33:31 +02:00
Max K
4c2783a0d8 CI: Builds in CI settings 2024-06-07 19:09:21 +02:00
Mikhail f. Shiryaev
8c4f5c65aa
Use a named logger in build_download_helper 2024-06-07 17:07:06 +02:00
Max K
dd0f38db05 CI: Fix nightly workflow 2024-06-07 16:37:05 +02:00
Max K
b618b80e20
Merge pull request #64950 from ClickHouse/ci_more_fixes_for_sync_prs
CI: Minor fixes in ci scripts
2024-06-07 00:54:42 +00:00
robot-clickhouse
367d41e7f0 Automatic style fix 2024-06-06 23:41:34 +00:00
Max K
8f26f77505 fix unit test 2024-06-07 01:35:39 +02:00
Max K
0deb862c93 Re-enable Fast test in MQ 2024-06-07 01:22:47 +02:00
Max K
eb72c12b31 CI: Minor fixes in ci scripts 2024-06-07 00:51:37 +02:00
Mikhail f. Shiryaev
259e877d0d
Merge pull request #64890 from ClickHouse/fix-check-documentation
Fix documentation enforcement
2024-06-06 11:41:08 +00:00
Mikhail f. Shiryaev
0dff60821f
Add context to the get_gh_api APIException 2024-06-06 13:24:39 +02:00
Mikhail f. Shiryaev
3b593a7c5e
Make PRInfo.compare_pr_url persistent for the Github.PullReaquest objects 2024-06-06 13:24:37 +02:00
Mikhail f. Shiryaev
8ebcd88608
In imported files should be only logging, no prints 2024-06-06 13:08:40 +02:00
Mikhail f. Shiryaev
61582a9bee
Use logging where no special strings are required 2024-06-06 09:03:35 +02:00
Mikhail f. Shiryaev
a4b55985fa
Fix issue with overwriting a lack of documentation failure 2024-06-06 09:03:33 +02:00
Mikhail f. Shiryaev
4eba310527
Simplify set_auth_header 2024-06-06 07:24:59 +02:00
Mikhail f. Shiryaev
1156233ea8
Use a proper way to download packages from releases 2024-06-06 07:24:58 +02:00
Max K
eae9622921
Merge pull request #64825 from ClickHouse/ci_fix_await_in_prs
CI: fix CI await feature
2024-06-05 08:51:04 +00:00
Max K
418911c7d7 CI: fix CI await feature 2024-06-05 10:21:00 +02:00
Max K
06c9438341 CI: Move coverage build to non-special build list 2024-06-05 09:34:31 +02:00
Max K
443d06328f Merge branch 'master' into ci_py_small_refactoring 2024-06-04 19:30:37 +02:00
Max K
d68b4a46df CI: after merge fixes 2024-06-04 18:59:10 +02:00
Max K
f0f3d533c6 Merge branch 'master' into ci_py_small_refactoring 2024-06-04 18:57:43 +02:00
Mikhail f. Shiryaev
253fa03503
Merge pull request #64787 from ClickHouse/commit-status-type
Strict `StatusType`, increased `SAFE_REQUESTS_LIMIT` for get_best_robot_token
2024-06-04 16:41:58 +00:00
Mikhail f. Shiryaev
f46376de89
Add logging for skip upload build profile data, skip it for PRs 2024-06-04 15:41:33 +02:00
Mikhail f. Shiryaev
fa92393c03
Reduce the _upload_build_profile_data code level 2024-06-04 15:25:55 +02:00
Mikhail f. Shiryaev
cbd4fc7ee3
fixup! Simplify post-build insert, limit timeout to 5 seconds 2024-06-04 15:25:01 +02:00
Mikhail f. Shiryaev
8e9426f01b
Simplify post-build insert, limit timeout to 5 seconds 2024-06-04 15:22:15 +02:00
Mikhail f. Shiryaev
e64a033098
Support requests parameters in ClickHouseHelper.insert_file 2024-06-04 15:22:14 +02:00
Max K
f5757ab3a8 CI: ci.py refactoring 2024-06-04 12:58:43 +02:00
Mikhail f. Shiryaev
0cd4e0ecaa
Increase safe limits of token requests to pick it 2024-06-04 12:39:07 +02:00
Mikhail f. Shiryaev
938b5d267b
Bring back strict StatusType 2024-06-04 12:36:13 +02:00
Max K
922bbbc8c2 CI: get_best_robot_token fix to get good enough token 2024-05-31 21:52:34 +02:00
Max K
64d3a8417e CI: MergeQueue: add binary_release and unit tests 2024-05-31 17:11:01 +02:00
Max K
b180004e08
Merge pull request #64693 from ClickHouse/ci_fix_ci_running_status
CI: CI running status fix
2024-05-31 13:10:23 +00:00
Max K
ba7adb5caa CI: CI running status fix 2024-05-31 14:45:48 +02:00
robot-clickhouse
66cdde85b7 Automatic style fix 2024-05-31 11:08:03 +00:00
Max K
e0b261d129 CI: CI Settings updates 2024-05-31 12:30:40 +02:00
Max K
bc8a4a244f CI: CI Settings updates 2024-05-31 12:05:49 +02:00
Max K
ef42d0862d fix 2024-05-31 11:21:18 +02:00
Max K
50ad9c37cc CI: Build Report Check to verify only enabled builds 2024-05-31 10:57:31 +02:00
Max K
0ab728f826
Merge pull request #64653 from ClickHouse/ci_skip_binary_upload_for_special_builds_in_pr
CI: Do not upload binaries for special builds in PRs
2024-05-31 06:16:56 +00:00
Max K
a33a6f344a fix 2024-05-30 22:21:28 +02:00
Max K
89a7c9ac7d CI: add CI settings option to upload all 2024-05-30 21:52:33 +02:00
Max K
0d66d00eed CI: No binaries uploaded for special builds in PRs 2024-05-30 21:32:47 +02:00
Max K
fcb67d4c48
Merge pull request #64603 from ClickHouse/ci_cherry_pick_py_updates
CI: Backports updates
2024-05-30 17:24:01 +00:00
Max K
b93d4b32e2 fixes 2 2024-05-30 17:59:10 +02:00
Max K
4ba89c8b31 fixes 2024-05-30 17:35:44 +02:00
Mikhail f. Shiryaev
7237242576
Merge pull request #63982 from ClickHouse/expired-timeout
Implement a single point for "Check timeout expired" test result
2024-05-30 11:32:41 +00:00
Max K
3a8b95591d CI: Backports updates 2024-05-29 22:21:28 +02:00
Max K
208912e559 CI: Change Required Check list, few fixes 2024-05-29 21:41:16 +02:00
Smita Kulkarni
f2a6ca9cac Merge branch 'master' into Azure_fix_stateless_tests 2024-05-29 21:20:14 +02:00
Max K
c8cb25a79f
Merge branch 'master' into ci_few_minor_fixes 2024-05-29 21:17:59 +02:00
Max K
1e3d297346 CI: Change Required Check list, few fixes 2024-05-29 21:13:00 +02:00
Mikhail f. Shiryaev
7f3bbf5a98
Merge pull request #64569 from ClickHouse/git-ssh
Add a temporary known host for git over ssh
2024-05-29 18:59:06 +00:00
Mikhail f. Shiryaev
08be26a47b
Add timeout 900 for clickbench tests 2024-05-29 17:22:48 +02:00
Mikhail f. Shiryaev
b1253761e0
Fix all clcik typos 2024-05-29 17:22:47 +02:00
Mikhail f. Shiryaev
383147ac4f
Use timeout from ci_config in libfuzzer 2024-05-29 17:22:47 +02:00
Mikhail f. Shiryaev
5f7839740d
Use timeout from ci_config in stress tests 2024-05-29 17:22:46 +02:00
Mikhail f. Shiryaev
a2bfcabc99
Use timeout from ci_config in fast tests 2024-05-29 17:22:46 +02:00
Mikhail f. Shiryaev
31355d5e45
Add a reasonable timeout to bugfix config 2024-05-29 17:22:45 +02:00
Mikhail f. Shiryaev
92ee671310
Implement global timeout check in _test_run 2024-05-29 17:22:42 +02:00
Smita Kulkarni
1b084fcc00 Merge branch 'master' into Azure_fix_stateless_tests 2024-05-29 13:16:48 +02:00
Mikhail f. Shiryaev
87138301c4
Use copy of os.environ to not affect the global state 2024-05-29 12:56:37 +02:00
Mikhail f. Shiryaev
3052004126
Add a description for A Sync check status 2024-05-29 11:40:45 +02:00
Mikhail f. Shiryaev
db13911145
Add a temporary known host for git over ssh 2024-05-29 11:14:21 +02:00
Max K
087abfc147 fix 2024-05-28 18:45:11 +02:00
Max K
304ca95c71
Revert "Revert "CI: fix build_report selection in case of job reuse"" 2024-05-28 18:14:44 +02:00
Max K
13fa946454
Merge pull request #64516 from ClickHouse/revert-64459-ci_fix_build_report_priority
Revert "CI: fix build_report selection in case of job reuse"
2024-05-28 15:30:35 +00:00
Max K
b07ba7655d
Merge pull request #64480 from ClickHouse/ci_critical_bugfix_category_in_pr_body
CI: Critical bugfix category in PR template
2024-05-28 15:22:51 +00:00
Max K
26a6780324
Revert "CI: fix build_report selection in case of job reuse" 2024-05-28 16:43:05 +02:00
robot-clickhouse
a15db7b400 Automatic style fix 2024-05-28 11:16:51 +00:00
Max K
a858604084 CI: remove category check from lambda 2024-05-28 13:10:14 +02:00
Max K
edf8d92cf0 CI: add category to changelog.py 2024-05-28 12:53:52 +02:00
Smita Kulkarni
b22f1891de Merge branch 'master' into Azure_fix_stateless_tests 2024-05-27 19:33:05 +02:00
Max K
324bec78ff CI: Critical bugfix category in PR template 2024-05-27 18:43:24 +02:00
Max K
9eb79530f4 CI: fix build_report selection in case of job reuse 2024-05-27 17:35:42 +02:00
Smita Kulkarni
7c53d3e5e2 Merge branch 'master' into Azure_fix_stateless_tests 2024-05-27 10:35:06 +02:00
Max K
7ccb776ed9 mcheck fix 2024-05-24 12:39:35 +02:00
Max K
f1421c9e5c style fix 2024-05-24 12:27:05 +02:00
Max K
22b441ed40 fix PR template 2024-05-24 12:00:24 +02:00
Max K
d4fb2d50e9 CI: Sync, Merge check, CI gh's statuses fixes 2024-05-24 12:00:16 +02:00
Max K
bd15e1311a CI: fix 2024-05-23 22:35:21 +02:00
Max K
8d697123da CI: Cancel sync wf on new push 2024-05-23 18:44:12 +02:00
Smita Kulkarni
f66ea47a44 Merge branch 'master' into Azure_fix_stateless_tests 2024-05-23 17:23:22 +02:00
Max K
b1fe9ab5f0 CI: dependency fix for changelog.py
#do_not_test
2024-05-23 15:33:21 +02:00
Smita Kulkarni
219d2b778e Merge branch 'master' into Azure_fix_stateless_tests 2024-05-23 10:16:07 +02:00
Max K
9a40ff033d
Merge branch 'master' into ci_disable_arm_int_tests_with_kerberazied_kafka 2024-05-22 20:35:23 +02:00
Max K
5f01b14e0d add prints 2024-05-22 13:14:39 +02:00
alesapin
455045056f Merge branch 'master' into ci_disable_arm_int_tests_with_kerberazied_kafka 2024-05-21 17:18:13 +02:00
Max K
ac7da1cc38 CI: cancel running PR wf after adding to MQ 2024-05-21 17:14:52 +02:00
Max K
f00f551fba
Merge pull request #64093 from ClickHouse/ci_mergeable_check_redesign
CI: mergeable check redesign
2024-05-21 08:04:50 +00:00
Max Kainov
a735ab7dd1 fix upstream commit status update in sync pr 2024-05-20 18:58:56 +00:00
Max Kainov
c4f47b9071 set greem mergeable status in upstream pr from finish check in sync 2024-05-20 14:09:17 +00:00
Azat Khuzhin
64a308013f Tune mmap_rnd_bits to workaround sanitizers issues
v1: vm.mmap_rnd_bits=28
v2: rebase with clang 18.1.6 + kernel.randomize_va_space=0
v3: leave only vm.mmap_rnd_bits=28 + use pre-run.sh (hope that it will
    be used), that way docker will not require --privileged and by some
    reason this breaks ASAN (though I cannot reproduce it)
v4: use actions/common_setup over init_runner.sh (it requires some
    manual deploy)
2024-05-19 22:37:16 +02:00
Max K
5698ef698d check overall wf status in mergeable check 2024-05-19 18:02:15 +02:00
Max K
4e4d078786 return sync pr status to upstream from FinishCheck job 2024-05-18 20:36:04 +02:00
Max K
d5eac97d45 remove update_mergeable_check_from_ci.py 2024-05-18 19:53:06 +02:00
Max K
e3329a10f9 CI: mergeable check redesign 2024-05-18 18:25:48 +02:00
Alexey Milovidov
a2d9a32652
Merge pull request #63733 from qiangxuhui/qiangxuhui-loongarch64
Initial support for loongarch64
2024-05-18 05:26:26 +02:00
Mikhail f. Shiryaev
8980e3bb40
Merge pull request #64062 from ClickHouse/style-mimetype-fallback
Files without shebang have mime 'text/plain' or 'inode/x-empty'
2024-05-17 20:35:12 +00:00
Alexander Tokmakov
4b0df53c51
Merge pull request #63945 from ClickHouse/require-batched-jobs
Fix bug when `Required check [1/3]` is not included in Mergeable Check
2024-05-17 17:51:44 +00:00
Mikhail f. Shiryaev
d6a16b81ed
Files without shebang have mime 'text/plain' or 'inode/x-empty' 2024-05-17 19:30:18 +02:00
Mikhail f. Shiryaev
803a52ba94
Do not create new release in release branch automatically 2024-05-17 14:50:34 +02:00
Robert Schulze
5fb8ea4c62
Merge remote-tracking branch 'ClickHouse/master' into qiangxuhui-loongarch64 2024-05-17 07:56:01 +00:00
Gabriel Martinez
bbbc721508
chore(ci-workers): remove reusable from tailscale key 2024-05-16 22:22:30 +01:00
robot-clickhouse
93601066ea Automatic style fix 2024-05-16 14:54:30 +00:00
Max K
17aa799101 CI: aarh64: disable kerberos tests 2024-05-16 16:43:54 +02:00
Mikhail f. Shiryaev
1fba7c372a
Merge pull request #63195 from ClickHouse/make-gh-runner-resilient
Fallback action-runner to autoupdate when it's unable to start
2024-05-16 13:23:39 +00:00
Nikita Taranov
3415e07186
Merge pull request #63899 from nickitat/try_randomize_parallel_replicas_in_tests
Randomise `allow_experimental_parallel_reading_from_replicas` in stress tests
2024-05-16 12:59:45 +00:00
Max K
d10bf725f0 ci config update to enable job 2024-05-16 14:57:22 +02:00
Smita Kulkarni
8734a816b5 Merge branch 'master' into Azure_fix_stateless_tests 2024-05-16 14:43:56 +02:00
Max K
22573361de fixing typos and var names 2024-05-16 14:09:20 +02:00
Max K
d7f95ddfcf CI: Enable Arm integration tests job in CI 2024-05-16 13:16:01 +02:00
Mikhail f. Shiryaev
e8c2b68333
Fix bug when Required check [1/3] is not included in Mergeable Check 2024-05-16 13:09:46 +02:00
Nikita Taranov
0daf4065eb fix 2024-05-15 19:28:05 +01:00
Nikita Taranov
5102c6eff0 impl
impl

impl
2024-05-15 19:15:32 +01:00
Alexey Milovidov
a0cbbeb2c9 Follow-up for the binary_symbols table in CI 2024-05-15 04:29:01 +02:00
qiangxuhui
537b56b139 Add loongarch64 CI support 2024-05-14 08:15:28 +00:00
Mikhail f. Shiryaev
baffd31423
Fix typos 2024-05-13 14:21:15 +02:00
Mikhail f. Shiryaev
dab1e5002e
Upgrade the runner version to the latest 2024-05-13 14:21:14 +02:00
Mikhail f. Shiryaev
599c512e0b
Patch runner helpers and check the exit code for attempts 2024-05-13 14:21:13 +02:00
Mikhail f. Shiryaev
cbf02f69d5
Add a fallback for autoupdate if GH actions runner fails to start 2024-05-13 14:21:13 +02:00
Mikhail f. Shiryaev
ee49e237da
Clean github runner's temporary _work derectory between runs 2024-05-13 14:21:12 +02:00
Mikhail f. Shiryaev
b74ce036fa
Make init-network.sh sourceable, tune runner's tailscale hostname 2024-05-13 14:21:11 +02:00
Alexey Milovidov
dd58af7d4f Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-05-10 07:17:39 +02:00
Mikhail f. Shiryaev
38604eb3bc
Add more logging about the status will be post 2024-05-09 13:40:56 +02:00
Mikhail f. Shiryaev
f294f6d16f
Move update_upstream_sync_status to commit_status_helper 2024-05-09 13:40:53 +02:00
Alexey Milovidov
773654c46e Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-05-08 21:24:04 +02:00
Mikhail f. Shiryaev
47473d77ab
Find a proper commit for cumulative A Sync status 2024-05-08 20:31:02 +02:00
alesapin
dc7f515945
Merge pull request #63540 from ClickHouse/run_azure_on_master
Fix azure tests run on master
2024-05-08 16:28:09 +00:00
alesapin
bbb8cc0e93 Fix azure tests run on master 2024-05-08 18:01:50 +02:00
robot-clickhouse
71eab76f5c Automatic style fix 2024-05-08 03:31:52 +00:00
Alexey Milovidov
f9da558a2c Your lint 2024-05-08 05:20:07 +02:00
robot-clickhouse
dc0df8cfec Automatic style fix 2024-05-08 02:31:43 +00:00
Alexey Milovidov
9c449cc453 Insert symbols info to the CI database 2024-05-08 04:18:01 +02:00
Alexey Milovidov
f4e2605208 Insert symbols info to the CI database 2024-05-08 04:10:01 +02:00
Vitaly Baranov
4c0c4d1485
Merge pull request #63209 from ClickHouse/pufit/fix-sql-security-none-from-load
Correct load for SQL security defaults during startup
2024-05-06 10:52:44 +00:00
Alexey Milovidov
46bd25128c
Merge branch 'master' into clang-18-ci 2024-05-06 02:51:58 +02:00
pufit
02e83e380d Merge branch 'master' into pufit/fix-sql-security-none-from-load 2024-05-03 16:46:41 -04:00
Mikhail f. Shiryaev
27db04dbcf
Hide the mergeable_status.url from cloud CI 2024-05-03 18:21:17 +02:00
Mikhail f. Shiryaev
60336681b2
Add processing A Sync to ci.py 2024-05-03 17:57:44 +02:00
Mikhail f. Shiryaev
ba644d691e
Add a helper function to convert str into StatusType 2024-05-03 17:57:43 +02:00
Mikhail f. Shiryaev
d39f2fb2f9
Make mergeable-check related return CommitStatus 2024-05-03 17:57:42 +02:00
Mikhail f. Shiryaev
2732ce1ace
Add a way to mask RUN_URL for Mergeable Check 2024-05-03 15:37:18 +02:00
Mikhail f. Shiryaev
88f3c27953
Merge pull request #63331 from ClickHouse/fix-commit-html-url
The commit url has different pattern
2024-05-03 12:38:24 +00:00
Mikhail f. Shiryaev
d35813d7d6
The commit url has different pattern 2024-05-03 14:24:18 +02:00
Raúl Marín
a30d923672
Update cherry_pick.py 2024-05-02 21:42:49 +02:00
Raúl Marín
713467e812 Fix dev 2024-05-02 17:20:58 +00:00
Raúl Marín
245fac10aa Change must-create-backport-label to support a list
python3 cherry_pick.py --repo ClickHouse/clickhouse-private  --from-repo ClickHouse/ClickHouse --must-create-backport-label pr-must-backport-cloud pr-must-backport --backport-created-label pr-backports-created-cloud
2024-05-02 17:10:56 +00:00
Raúl Marín
7baac14e38 Create cloud backports for all pr-must-backport PRs
Even if pr-must-backport-cloud is not declared
2024-05-02 16:32:04 +00:00
Raúl Marín
e013b99709 Always try to backport to the cloud (v24.3-must-backport) 2024-05-02 16:21:26 +00:00
Mikhail f. Shiryaev
fb9b2be2f9
Leftover to fix after #62114 2024-05-02 17:00:48 +02:00
Mikhail f. Shiryaev
f685eea7c5
Get rid of fallbacks, all is too far away in 2022 2024-05-02 16:59:19 +02:00
Robert Schulze
15e67fee78
Merge remote-tracking branch 'ClickHouse/master' into hlee-z-build-fix 2024-05-02 07:02:24 +00:00
Alexander Sapin
5b0ab90199 Fxi 2024-05-01 16:29:55 +02:00
Alexander Sapin
4e1470ca56 Fxi 2024-05-01 16:29:01 +02:00
Alexander Sapin
9ad263b5ed Fxi 2024-05-01 15:56:17 +02:00
Alexander Sapin
fec4c57934 Add run with msan 2024-05-01 15:03:52 +02:00
Smita Kulkarni
286297d43f Merge branch 'master' into Azure_fix_stateless_tests 2024-05-01 08:55:32 +02:00
Smita Kulkarni
ccabc292ad Temporarily remove running azure tests only for master 2024-05-01 08:48:24 +02:00
robot-clickhouse
e0118502d5 Automatic style fix 2024-04-30 20:17:44 +00:00
Smita Kulkarni
697b5556a3 Enable azure test 2024-04-30 22:10:36 +02:00
alesapin
296527dede Fxi 2024-04-30 22:07:22 +02:00
alesapin
ca0cc9e05a Fix style 2024-04-30 19:46:50 +02:00
alesapin
b6c49af024 Fxi 2024-04-30 17:59:08 +02:00
alesapin
e1de0d4f36 Fix 2024-04-30 17:54:59 +02:00
alesapin
0b836376d1 Run azure tests in PR 2024-04-30 17:41:44 +02:00
Robert Schulze
6af89ecf12
Revert "Disable s390x build"
This reverts commit 116393c951.
2024-04-30 10:02:19 +00:00
alesapin
b54927a634
Merge pull request #63120 from ClickHouse/fix_stateful_azure
Azure always green
2024-04-29 14:05:32 +00:00
alesapin
178f4c6f60 Azure always green 2024-04-29 15:09:22 +02:00
Alexey Milovidov
d9fa3fdceb
Merge pull request #63069 from azat/tests/integration-old-analyzer
Fix integration tests with old analyzer (and fix some leftovers of enabling it)
2024-04-27 21:43:07 +00:00
alesapin
bfa9026cf4 Merge branch 'ci_add_azure_tests' of github.com:ClickHouse/ClickHouse into ci_add_azure_tests 2024-04-27 14:11:25 +02:00
alesapin
ba949f2a38 Add for master only 2024-04-27 12:36:17 +02:00
alesapin
78e6d62ed3
Merge branch 'master' into ci_add_azure_tests 2024-04-27 12:33:42 +02:00
Azat Khuzhin
52091916dc Fix leftovers of enabling new analyzer
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-04-27 11:19:03 +02:00
Nikita Mikhaylov
ed7e4291ab
Merge pull request #62937 from ClickHouse/docs-remove-replicated-experimental-tag
Remove experimental tag from Replicated database engine
2024-04-26 17:56:06 +00:00
Max Kainov
e0684dba6b CI: fix job config for MQ 2024-04-26 15:00:07 +00:00
robot-clickhouse
a1471abdcd Automatic style fix 2024-04-26 10:52:57 +00:00
Max Kainov
a45ad73544 CI: fix ci config to run FT in MQ 2024-04-26 10:48:00 +00:00
Max Kainov
6866382326 minor update for MCheck in the MQ 2024-04-26 08:25:25 +00:00
Nikita Mikhaylov
a8683a8bd5 Remove the setting from tests 2024-04-25 22:13:14 +02:00
Max Kainov
4b6227148f Fuse in Finish Check for MQ 2024-04-25 14:52:42 +00:00
Max K
a5302bf9f3 Revert "Revert "CI: add FT to MQ remove Style from master"" 2024-04-25 14:51:06 +00:00
Mikhail f. Shiryaev
cd9b75e28d
Merge pull request #62919 from ClickHouse/labels-refactoring
Refactor Labels in the CI
2024-04-25 14:30:20 +00:00
Nikita Mikhaylov
5c2fa14287
Merge branch 'master' into clang-18-ci 2024-04-25 13:19:17 +02:00
Nikita Mikhaylov
9b51476399
Merge pull request #61910 from peter279k/fix_pr_60656_install_tests
Fix PR #60656 for install check tests
2024-04-25 11:16:22 +00:00
alesapin
3df9c385a3 Switch back to asan 2024-04-24 22:28:43 +02:00
Max K
049c429b1f
Revert "CI: add FT to MQ remove Style from master" 2024-04-24 19:19:27 +02:00
Max K
92554d9b73
Merge branch 'master' into ci_fast_t_in_mq 2024-04-24 17:53:38 +01:00
alesapin
f25a024ab3 Followup 2024-04-24 17:47:32 +02:00
Mikhail f. Shiryaev
784ca58a4b
Diverge ci_config.CILabels from PRs Labels 2024-04-24 17:33:07 +02:00
alesapin
6e05e63362 To stress as well 2024-04-24 17:32:18 +02:00
Mikhail f. Shiryaev
76911c9fca
Add ci_config.StatusNames class for common statuses 2024-04-24 17:31:15 +02:00
Mikhail f. Shiryaev
2ba5b7fd23
Refactor labels in CI, move them to shared package 2024-04-24 17:31:14 +02:00
alesapin
68ff44259e Merge branch 'ci_add_azure_tests' of github.com:ClickHouse/ClickHouse into ci_add_azure_tests 2024-04-24 17:31:05 +02:00
alesapin
231f35f785 Add real azure 2024-04-24 17:30:47 +02:00
alesapin
4210c34f94 Merge branch 'master' into ci_add_azure_tests 2024-04-24 17:26:05 +02:00
Mikhail f. Shiryaev
13dca8c5c6
Merge pull request #62835 from ClickHouse/style-autofix
Get rid of merge_commit in style check autofix
2024-04-23 11:12:51 +00:00
robot-clickhouse
19dbc8d2e2 Automatic style fix 2024-04-22 10:39:56 +00:00
Mikhail f. Shiryaev
0811124d7d
Add description to the commit status on failed autofix 2024-04-22 12:29:30 +02:00
Mikhail f. Shiryaev
a39baf84cf
Get rid of merge_commit in style check autofix 2024-04-22 12:03:51 +02:00
Mikhail f. Shiryaev
48a4c40549
Merge pull request #62786 from ClickHouse/tiny-ci-improvements
Tiny CI improvements
2024-04-19 19:19:39 +00:00
Mikhail f. Shiryaev
8e2ba01600
Merge pull request #62651 from ClickHouse/get-job-id-fallback
Do not fail job on failed get_job_id_url
2024-04-19 14:45:59 +00:00
Mikhail f. Shiryaev
c9e41251a6
Fail build_report jobs on non-success statuses 2024-04-19 14:31:54 +02:00
Mikhail f. Shiryaev
eb23de3561
Fail the build reports on non-success status to restart on the next attempt 2024-04-19 11:59:15 +02:00
Mikhail f. Shiryaev
58bf18999d
Add isort configuration to not spoil imports 2024-04-19 11:43:33 +02:00
Mikhail f. Shiryaev
20ae9fdf6b
Add forgotten "raise" on non-safe GITHUB_JOB_URL 2024-04-19 10:58:47 +02:00
Mikhail f. Shiryaev
5c4c2c16dd
Convert PRInfo.is_* to properties 2024-04-17 22:23:41 +02:00
Mikhail f. Shiryaev
6b09b1f897
Use GitHub in ci.py 2024-04-17 22:07:25 +02:00
Smita Kulkarni
d1a81e718c Merge branch 'master' into ci_add_azure_tests 2024-04-17 14:26:41 +02:00
Alexander Sapin
1e1f35fac0 Try release job 2024-04-16 10:35:18 +02:00
Alexey Milovidov
e65dc63609
Merge branch 'master' into rust_vendor 2024-04-16 10:10:34 +02:00
Robert Schulze
7dc05d092b
Merge remote-tracking branch 'rschu1ze/master' into be-less-boring-32 2024-04-15 16:35:10 +00:00
Mikhail f. Shiryaev
9cbfcf4763
Do not fail job on failed get_job_id_url 2024-04-15 14:38:49 +02:00
Raúl Marín
69245545fa
Merge branch 'master' into rust_vendor 2024-04-15 10:57:01 +01:00
Mikhail f. Shiryaev
ed2e4e3f49
Merge pull request #62556 from ClickHouse/fix-integration-logs-compression
Fix integration-tests logs compression
2024-04-12 14:54:11 +00:00
Max K
707c43d17a Merge branch 'master' into ci_fast_t_in_mq 2024-04-12 13:20:50 +00:00
Max Kainov
3f10530c28 remove A sync check from MQ for a while 2024-04-12 11:36:19 +00:00
Max Kainov
0d2e0e3131 CI: MQ sync status check fix 2024-04-12 11:11:49 +00:00
Max Kainov
e2acd0e93f CI: add FT to MQ remove Style from master 2024-04-12 10:29:46 +00:00
Alexey Milovidov
164a8d6097
Merge branch 'master' into clang-18-ci 2024-04-12 03:49:10 +02:00
Raúl Marín
aa09876220 Merge remote-tracking branch 'blessed/master' into rust_vendor 2024-04-11 18:52:28 +02:00
Max Kainov
252d2a05a6 fix unittest 2024-04-11 16:27:25 +00:00
Max Kainov
e8f616e80b CI: fix for sync check status in mq 2024-04-11 15:55:25 +00:00
Max Kainov
45258bc565 CI: Add tests with Azure storage 2024-04-11 14:50:18 +00:00
robot-clickhouse
671d2a8927 Automatic style fix 2024-04-11 14:33:25 +00:00
Max Kainov
59d56668e9 CI: respect Sync status in the MQ 2024-04-11 13:20:20 +00:00
Mikhail f. Shiryaev
0b76f95e57
Remove unnecessary style-check comments 2024-04-11 15:19:32 +02:00
Mikhail f. Shiryaev
c684770ace
Use sudo to compress logs with the highest permissions 2024-04-11 15:17:56 +02:00
Raúl Marín
0273b39804 Merge remote-tracking branch 'blessed/master' into rust_vendor 2024-04-10 22:05:20 +02:00
Max K
4a7450ed2e
Merge pull request #62488 from ClickHouse/ci_auto_sync_pr_merge
CI: merge sync pr on push to master
2024-04-10 18:17:36 +00:00
Max Kainov
407f154650 comments 2024-04-10 18:07:05 +00:00
Max Kainov
2e4e3187d5 merge sync pr on push to master 2024-04-10 13:49:49 +00:00
Kruglov Pavel
8ef64b0581
Merge pull request #61476 from Avogar/better-stress-upgrade-checks
Ignore DROP queries in stress test with 1/2 probability and TRUNCATE Memory/JOIN table instead of ignoring DROP in upgrade check
2024-04-10 12:43:22 +00:00
Nikita Taranov
e34d9fb743
Merge branch 'master' into add_version_history 2024-04-10 12:48:11 +02:00
Max Kainov
98c1cc7747 new gh runner version 2.315.0 2024-04-09 17:09:04 +00:00
Max Kainov
4e344f6a93 remove ci status and reports for MQ case 2024-04-09 10:25:41 +00:00
Max Kainov
baa62cdaee CI: no CI Running status for MQ 2024-04-08 16:09:47 +00:00
Max Kainov
f3dc77ee00 disable autofix for merge queue 2024-04-08 14:28:48 +00:00
avogar
71666cb42f Merge branch 'master' of github.com:ClickHouse/ClickHouse into better-stress-upgrade-checks 2024-04-08 13:58:14 +00:00
Max Kainov
5e1c1b6b94 CI: test merge queue 2024-04-08 13:41:44 +00:00
Max Kainov
83d1f1a876 CI: fix for docs only pr 2024-04-08 11:51:59 +00:00
Robert Schulze
116393c951
Disable s390x build 2024-04-08 11:04:11 +00:00
Anita Hammer
c0ffee763c
Fix contributor name vulnerability 2024-04-06 02:48:50 +03:00
Kruglov Pavel
589034c34c
Merge branch 'master' into better-stress-upgrade-checks 2024-04-05 15:27:02 +02:00
Alexey Milovidov
0fccaafda4 Fix tests 2024-04-04 20:06:40 +02:00
Raúl Marín
6d2f952eae Linter 2024-04-04 19:44:17 +02:00
Raúl Marín
173440be9b Remove rust cache 2024-04-04 19:22:46 +02:00
avogar
d87d5a9197 Merge branch 'master' of github.com:ClickHouse/ClickHouse into better-stress-upgrade-checks 2024-04-03 12:07:22 +00:00
Alexey Milovidov
a6356c120a Add more documentation to the release script 2024-04-03 09:22:01 +02:00
Nikita Taranov
eae047cd0b
Merge branch 'master' into add_version_history 2024-03-28 20:05:24 +01:00
Max K
b5b347e86f
Merge pull request #62044 from ClickHouse/ci_fix_for_kill_timeout_env
CI: fix for timeout env variable
2024-03-28 16:35:50 +01:00
Max Kainov
863f479ff0 CI: fix for timeout env variable 2024-03-28 14:00:04 +00:00
Max K
0df3826050
Merge pull request #61991 from ClickHouse/ci_remove_job_url_from_mark_release_ready
CI: remove unnecessary job url for Mark release ready
2024-03-27 18:47:42 +01:00
Max Kainov
c9749ae586 CI: remove unnecessary job url for Mark release ready 2024-03-27 17:17:10 +00:00
robot-clickhouse
a45439ed52 Automatic style fix 2024-03-27 15:34:55 +00:00
Max Kainov
d7187a172f CI: failover for job_url request from gh 2024-03-27 15:24:16 +00:00
Dmitry Novik
104774c646 Fix CI config 2024-03-27 11:39:33 +01:00
Dmitry Novik
31df60be20 Merge remote-tracking branch 'origin/master' into enable-analyzer 2024-03-27 11:37:32 +01:00
robot-ch-test-poll2
5d2bc7ee34
Merge pull request #61948 from ClickHouse/ci_new_menu
CI: new ci menu in PR body
2024-03-27 01:56:17 +04:00
Max Kainov
813b60f129 Add handling for include/exclude ci filters 2024-03-26 19:34:05 +00:00
Dmitry Novik
65121b712e Merge remote-tracking branch 'origin/master' into enable-analyzer 2024-03-26 19:02:30 +01:00
Max Kainov
e4d9a74057 CI: create CIOptions class to handle ci user config
CI: create CIOptions class to handle ci user config
2024-03-26 15:39:07 +00:00
Nikita Taranov
34c8ec67e8 fix 2024-03-26 15:09:16 +00:00
peter279k
a47b407495
Fix PR #60656 for install check tests 2024-03-26 13:35:35 +08:00
Max K
c7e4d97e5a
Merge pull request #61881 from ClickHouse/ci_prepare_for_merge_queue
CI: merge queue support
2024-03-25 22:12:02 +01:00
Kruglov Pavel
de1229ba60
Merge branch 'master' into better-stress-upgrade-checks 2024-03-25 19:18:35 +01:00
Max Kainov
f9f830228a CI: MQ support 2024-03-25 17:57:03 +00:00
Max Kainov
727aeb7e37 CI: set timeout for install check
#job_Install_packages_amd64 #job_style_check
2024-03-25 17:38:39 +00:00
Nikita Taranov
3b87633392 better 2024-03-25 14:09:04 +00:00
Dmitry Novik
64301191b1 Merge remote-tracking branch 'origin/master' into enable-analyzer 2024-03-24 21:07:26 +00:00
Alexey Milovidov
b8a8d9994f
Merge pull request #60949 from nikmonkov/docker-version
Version has been added to docker labels
2024-03-24 01:50:50 +03:00
Dmitry Novik
df88eb26a5
Merge branch 'master' into enable-analyzer 2024-03-22 15:56:32 +01:00
Max K
d3965f27c1
Merge pull request #61542 from ClickHouse/ci_arm_support_kerberos
CI: ARM integration test - skip hdfs, kerberos, kafka
2024-03-22 15:25:30 +01:00
Max Kainov
e4556ae6c1 comments 2024-03-22 14:22:53 +00:00
Max Kainov
ef0fa1963d CI: use ci-runner as module
#no_merge_commit
 #ci_set_integration
 #batch_0
2024-03-22 14:22:53 +00:00
Dmitry Novik
d43a1a1984 Merge remote-tracking branch 'origin/master' into enable-analyzer 2024-03-22 14:15:57 +01:00
Nikolai Kochetov
0f60596f5b
Merge pull request #60548 from kitaisreal/merge-tree-read-split-ranges-into-intersecting-and-non-intersecting-fault-injection
MergeTree read split ranges into intersecting and non intersecting injection
2024-03-22 11:52:14 +01:00
Mikhail f. Shiryaev
771c549606
Process removed files, decouple _check_mime 2024-03-22 09:14:30 +01:00
Max Kainov
7d7025a74e CI: modify it 2024-03-22 00:13:17 +00:00
Max Kainov
389566f895 quick fix for style check 2024-03-21 20:24:22 +00:00
Max Kainov
d6b515b6bf CI: modify CI from PR body
#do_not_test
 #job_style_check
2024-03-21 19:35:07 +00:00
Maksim Kita
8ca9c1fb6b Merge branch 'master' into merge-tree-read-split-ranges-into-intersecting-and-non-intersecting-fault-injection 2024-03-21 21:25:18 +03:00
Dmitry Novik
20a860cf19 Update ci_config.py 2024-03-21 16:18:49 +01:00
Mikhail f. Shiryaev
15a61a998a
Fix logic for run_cpp_check, it had a bug 2024-03-21 14:34:31 +01:00
Mikhail f. Shiryaev
77e947c44f
Avoid IsADirectoryError: Is a directory contrib/azure 2024-03-21 14:09:01 +01:00
Maksim Kita
4dc985aa2f Fixed style check 2024-03-21 12:41:15 +03:00
Maksim Kita
b8c53d7cf3 Fixed tests 2024-03-21 12:41:15 +03:00
Mikhail f. Shiryaev
ff9a6d0958
Merge pull request #61197 from ClickHouse/merge-commit-style-autofix
Merge commit style autofix
2024-03-21 09:59:53 +01:00
Max K
984c7e69a0 disable test_allowed_url_with_config tests with HDFS
#no_merge_commit
 #ci_set_arm
2024-03-20 17:24:55 +00:00
Mikhail f. Shiryaev
aa1a210d5d
Fix logging of autoscaling lambda, add test for effective_capacity 2024-03-20 17:07:32 +01:00
Dmitry Novik
1524d5a451 Pass broken tests list to FastTest 2024-03-20 14:33:14 +01:00
Dmitry Novik
f0e7b78f8b Inverse analyzer in tests 2024-03-20 13:35:30 +01:00
Mikhail f. Shiryaev
661161695f
Merge pull request #61592 from ClickHouse/improve-builds-downloader
Improve build_download_helper
2024-03-20 11:56:06 +01:00
Mikhail f. Shiryaev
4efddb5ed4
Add type checking to build_download_helper 2024-03-19 14:01:31 +01:00
Mikhail f. Shiryaev
6b43d2e197
Improve logging in build_download_helper 2024-03-19 13:27:26 +01:00
Nikita Taranov
726db7361f add missing method 2024-03-18 20:04:56 +00:00
Nikita Taranov
0b2c274132 write docker tag 2024-03-18 17:50:08 +00:00
Nikita Taranov
ac352b96f0 remove copy-paste 2024-03-18 17:50:01 +00:00
Nikita Taranov
4a58705f7b impl
trigger rebuild

fix

move

fix black

trigger rebuild

trigger rebuild

fix mypy

fix

fix
2024-03-18 17:49:16 +00:00
avogar
31d5049f80 Move logic of ignoring drop queries to server 2024-03-18 16:26:05 +00:00
Raúl Marín
10dd47cf5c Separate CH and sanitizer logs 2024-03-18 16:40:03 +01:00
Raúl Marín
83c660a545 Merge remote-tracking branch 'blessed/master' into fuzz_log 2024-03-18 16:12:50 +01:00
Mikhail f. Shiryaev
41432c56a8
Enable shellcheck conditionally 2024-03-18 15:04:44 +01:00
Mikhail f. Shiryaev
c3f386d06a
Fix the autofixer 2024-03-18 15:04:43 +01:00
Mikhail f. Shiryaev
49017fc163
Run the style-check on top of the merge-commit of PRs 2024-03-18 15:04:41 +01:00
Mikhail f. Shiryaev
0240ffa5a6
Fetch the changed files only once 2024-03-18 15:04:40 +01:00
avogar
eada7e8d29 Fix server version 2024-03-18 13:18:58 +00:00
avogar
aadfc37dda Merge branch 'master' of github.com:ClickHouse/ClickHouse into better-stress-upgrade-checks 2024-03-15 20:27:16 +00:00
avogar
fa9d9ea3f7 Ignore DROP queries in stress test with 1/2 probability, use TRUNCATE instead of ignoring DROP in upgrade check for Memory/JOIN tables 2024-03-15 20:23:39 +00:00
Alexey Milovidov
2de304e00c
Merge pull request #61377 from ClickHouse/fix-spot-termination
Terminate EC2 on spot event if runner isn't running
2024-03-15 11:02:04 +03:00
Alexey Milovidov
05357bce5c Merge branch 'master' into clang-18-ci 2024-03-15 07:28:04 +01:00
Mikhail f. Shiryaev
03b9bca8a4
Terminate EC2 on spot event if runner isn't running 2024-03-14 14:31:55 +01:00
Mikhail f. Shiryaev
d465835306
Reorder hidden and shown checks in comment, change url of Mergeable check 2024-03-14 14:19:07 +01:00
Raúl Marín
f63368d83d Separate stdout and stderr in fuzzer report 2024-03-13 19:12:43 +01:00
Alexey Milovidov
d3872b155e Merge branch 'master' into clang-18-ci 2024-03-13 09:35:58 +01:00
Mikhail f. Shiryaev
ad363fe254
Merge pull request #61231 from ClickHouse/style-quick-scale
Make every style-checker runner types scaling-out very quickly
2024-03-12 18:19:03 +01:00
Mikhail f. Shiryaev
50aab0b69f
Fix annoying typo 2024-03-12 14:06:17 +01:00
Mikhail f. Shiryaev
612ff3c5bc
Make every style-checker runner types scaling-out very quickly 2024-03-12 13:00:31 +01:00
Max Kainov
fb1e5923a3 CI: fix runner for arm perf tests
#do_not_test
2024-03-12 09:12:25 +00:00
Max Kainov
b7b83085d1 CI: ci.py hot style fix
#do_not_test
2024-03-11 18:49:45 +00:00
Max K
7676d71c5d
Merge pull request #59738 from ClickHouse/ci_arm_integration_fix_1
CI: support batch specification in commit message
2024-03-11 19:01:03 +01:00
Max Kainov
f973e405ee CI: fixing ARM integration tests
#do_not_test
2024-03-11 17:20:36 +00:00
Max Kainov
f656a01538 CI: fix sync build issue with reuse
#do_not_test
2024-03-11 17:15:23 +00:00
Max K
a0a96b5580
Merge pull request #61099 from ClickHouse/ci_merge_queue_support
CI: support merge queue event in pr_info
2024-03-11 16:54:16 +01:00
Max K
23a9ac4947
Merge pull request #61160 from ClickHouse/ci_fix_nightly
CI: fix nightly job issue
2024-03-11 14:46:53 +01:00
Max Kainov
c4f29af8ec CI: fix nightly job issue
#do_not_test
2024-03-11 13:35:05 +00:00
Mikhail f. Shiryaev
8f2ff2ccd8
Enable black back 2024-03-11 13:22:18 +01:00
Max Kainov
49b78e0a0c CI: check cpp and py files style on changes only
#do_not_test
2024-03-11 09:30:26 +00:00
Alexey Milovidov
8c08fc1f57
Revert "CI: make style check faster" 2024-03-11 04:09:26 +03:00
Alexey Milovidov
36e18d7500 Merge branch 'master' into clang-18-ci 2024-03-10 23:57:00 +01:00
Max Kainov
f429f54af8 CI: make style check fast
#do_not_test
2024-03-10 17:25:51 +00:00
Alexey Milovidov
9a880c3bb9 Merge branch 'master' into clang-18-ci 2024-03-10 06:59:27 +01:00
Max Kainov
681bd28c87 CI: make style check fast
#do_not_test
2024-03-09 20:57:23 +00:00
Max Kainov
7f061ba89c CI: add wf class in ci_config
#do_not_test
2024-03-09 14:33:34 +00:00
Max Kainov
cacbd3ce34 CI: support merge queue event in pr_info
#do_not_test
2024-03-08 14:53:23 +00:00
Mikhail f. Shiryaev
e3f9fb2733
Trigger Mergeable check unconditionally in the final_check.py 2024-03-07 10:38:05 +01:00
Mikhail f. Shiryaev
5e597228d7
Merge pull request #60408 from ClickHouse/update-style-python
Update style python
2024-03-07 09:32:28 +01:00
Nikolay Monkov
fb17749b50 file has been reformatted to pass Style check 2024-03-07 09:45:24 +05:00
Max K
6c0e9e1944
Merge pull request #60958 from ClickHouse/ci_remove_rerun_check_for_build_report_jobs
CI: disable rerun check helper for build report jobs
2024-03-06 21:32:04 +01:00
Max Kainov
4e1257974c CI: disable rerun check helper for build report jobs
#do_not_test
2024-03-06 20:11:55 +00:00
Max Kainov
a0d161704a CI: remove sqllancer, sqllogic, sqltest from pr wf
#do_not_test
2024-03-06 17:58:21 +00:00
Max Kainov
4dd5e4fe99 CI: fix stage config (unit test release issue)
#no_ci_cache
2024-03-06 16:52:01 +00:00
Nikolay Monkov
d9b5f9a086 version has been added to docker labels 2024-03-06 21:37:56 +05:00
Max Kainov
ee468b0f2a CI: wait less in await to not exceed GH timeout
#do_not_test
2024-03-06 14:26:58 +00:00
Max K
561be5eb74
Merge pull request #60421 from ClickHouse/ci_abstract_workflow
CI: make workflow yml abstract
2024-03-06 15:15:02 +01:00
Mikhail f. Shiryaev
d2f92483f2
Add even more python code to pylint check, fix lambdas 2024-03-05 16:02:44 +01:00
Mikhail f. Shiryaev
34bb40583c
Install stubs for python-requests 2024-03-05 16:02:43 +01:00
Mikhail f. Shiryaev
91cff01ce0
More fixes in tests/ci 2024-03-05 16:02:41 +01:00
Mikhail f. Shiryaev
e31078e204
Fix some issues detected by new pylint 2024-03-05 16:02:36 +01:00
Mikhail f. Shiryaev
ec72800d78
Merge pull request #60383 from nickitat/upd_liburing
Enable testing with `io_uring` back
2024-03-05 15:26:35 +01:00
Max Kainov
82cc3f4339 CI: make workflow yml abstract
#no_merge_commit
 #no_ci_cache
 #job_style_check
 #job_package_debug
 #job_ClickHouse_build_check
 #job_Stateless_tests_debug
 #job_binary_release
2024-03-05 12:26:55 +00:00
Max Kainov
a6f5323c38 CI: Fix pending status for build report in backports
#do_not_test
2024-03-05 10:09:17 +00:00
Mikhail f. Shiryaev
a6caace5ec
Add a new runner type 2024-03-04 20:03:45 +01:00
Mikhail f. Shiryaev
bd2b0b4338
Export only str and bool for build configs 2024-03-04 20:01:26 +01:00
Mikhail f. Shiryaev
1443e490ea
Remove python bytecode, make consistent file-permissions
It's impossible to have persistent pyc files
Each time they are built with different content, for example:

> cmp -bl lambda-package*/charset_normalizer/__pycache__/constant.cpython-310.pyc
15582   6 ^F     4 ^D
15583 164 t    155 m
15584 141 a    142 b
15586 164 t    163 s
15587 151 i    332 M-Z
15588 163 s      6 ^F
15589 332 M-Z  164 t
15590   4 ^D   141 a
15591 155 m    143 c
15592 142 b    164 t
15593 143 c    151 i
17425  74 <     75 =
17428  76 >     46 &
17429 332 M-Z  372 M-z
17431 173 {     55 -
17434  75 =    174 |
17437  57 /     72 :
17440  54 ,     73 ;
17441 372 M-z  332 M-Z
17443 174 |    175 }
17446  55 -     54 ,
17447 372 M-z  332 M-Z
17449  46 &    173 {
17452  72 :     76 >
17455  42 "     74 <
17458  73 ;    133 [
17461 135 ]     42 "
17464 133 [    135 ]
17465 332 M-Z  372 M-z
17467 175 }     57 /
17503 332 M-Z  162 r
17504   5 ^E   130 X
17505 152 j      0 ^@
17506 157 o      0 ^@
17507 150 h      0 ^@
17508 141 a    332 M-Z
17509 142 b      5 ^E
17510 162 r    152 j
17511 130 X    157 o
17512   0 ^@   150 h
17513   0 ^@   141 a
17514   0 ^@   142 b
17536   5 ^E     2 ^B
17537 143 c    150 h
17538 160 p    172 z
17539  71 9    332 M-Z
17540  65 5      5 ^E
17541  60 0    143 c
17542 332 M-Z  160 p
17543   2 ^B    71 9
17544 150 h     65 5
17545 172 z     60 0
2024-03-04 13:37:13 +01:00
Mikhail f. Shiryaev
63e40203d1
Use python zipfile to have x-platform idempotent lambda packages 2024-03-04 13:37:11 +01:00
Alexey Milovidov
6df3179341 Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci 2024-03-03 23:02:20 +01:00
Max K
cecd2a6bac
Merge pull request #60613 from ClickHouse/ci_build_report_job_to_ci_config
CI: build_report job no dependcies on yml
2024-03-03 20:33:08 +01:00
Alexey Milovidov
c427575f72
Merge pull request #60694 from azat/ci/fix-flaky-check
Fix flaky checks
2024-03-03 19:53:12 +03:00
Max Kainov
8785b0700c CI: build_report job remove dependsies on yml
#no_merge_comit
 #job_ClickHouse_build_check
 #job_ClickHouse_special_build_check
 #job_style_check
2024-03-03 16:08:35 +00:00
Max K
2c713c2b90
Merge pull request #60602 from ClickHouse/ci_remove_docker_server_job_input_params
CI: remove inputs from docker_server job command
2024-03-03 14:25:23 +01:00
Azat Khuzhin
982f7e97c3
tests/ci/functional_test_check: move validate_bugfix_check into assert
Co-authored-by: Max K. <max.kainov@clickhouse.com>
2024-03-03 13:55:22 +01:00
Azat Khuzhin
418a6258ac Fix flaky checks
CI [1]:

    2024-03-02T22:23:37.4878824Z Going to start run command [python3 /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/ci/functional_test_check.py "$CHECK_NAME" $KILL_TIMEOUT]
    2024-03-02T22:23:37.7538256Z Runnin check [Stateless tests flaky check (asan)] with timeout [3600]
    2024-03-02T22:23:37.8790465Z Fetched info about 3 changed files
    2024-03-02T22:23:37.9160414Z Traceback (most recent call last):
    2024-03-02T22:23:37.9161715Z   File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/ci/functional_test_check.py", line 341, in <module>
    2024-03-02T22:23:37.9162714Z     main()
    2024-03-02T22:23:37.9163683Z   File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/ci/functional_test_check.py", line 235, in main
    2024-03-02T22:23:37.9164642Z     assert (
    2024-03-02T22:23:37.9165273Z AssertionError: JobReport file path must be provided with --validate-bugfix
    2024-03-02T22:23:37.9612679Z Run action failed for: [Stateless tests flaky check (asan)] with exit code [1]

  [1]: https://github.com/ClickHouse/ClickHouse/actions/runs/8125551797/job/22208766466?pr=60689

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-03 10:44:21 +01:00
Max Kainov
bcd6e2f945 fixup! CI: remove inputs from docker_server job command
#job_style_check #job_Docker_server_image #job_Docker_keeper_image
2024-03-02 15:12:53 +00:00
Max Kainov
8abc0df7a8 CI: remove inputs from docker_server job command
#job_style_check #job_Docker_server_image #job_Docker_keeper_image
 #packege_release #package_aarch64
2024-03-01 16:44:37 +00:00
Max Kainov
0b127ffba7 CI: await CI on master only
#do_not_test
2024-03-01 14:27:19 +00:00
robot-ch-test-poll1
7f0494b130
Merge pull request #60587 from ClickHouse/ci_fix_build_job_status
CI: fix for build job cache record status
2024-02-29 21:27:36 +04:00
Mikhail f. Shiryaev
af63125aaa
Merge pull request #60316 from ClickHouse/tailscale-ami
Install tailscale during AMI build and set it up on runners
2024-02-29 17:47:44 +01:00
Max Kainov
bd423c5ac5 CI: fix for build job cache record status
#job_package_release #job_style_check
2024-02-29 15:55:05 +00:00
Nikita Taranov
25347501d2
Merge branch 'master' into upd_liburing 2024-02-29 16:25:11 +01:00
Max K
01456f3f0c
Merge pull request #60455 from ClickHouse/ci_job_scripts_wo_input_params
CI: remove input params for job scripts
2024-02-29 15:51:10 +01:00
Max K
b4357d153d
Merge pull request #60554 from ClickHouse/ci_fix_docker_job_name_arch_suffix
CI: fix docker build job name
2024-02-29 15:25:51 +01:00
Max Kainov
64a2b6551a CI: fix docker build job name
#do_not_test
2024-02-29 13:32:33 +00:00
Max Kainov
0df8db5c3f CI: configure ci_set_analyzer
#do_not_test
2024-02-29 12:44:55 +00:00
Max Kainov
5f88a455ff CI: remove input params for job scripts
#job_style_check
 #job_Compatibility_check_amd64
 #job_Compatibility_check_aarch64
2024-02-28 22:35:47 +00:00
Nikita Taranov
dc135294f0 add seccomp=unconfined 2024-02-28 22:17:47 +01:00
Max Kainov
5a57b9f75e CI: remove autobackport for bugfix
#do_not_test
2024-02-28 19:30:34 +00:00
Max K
2970ca7b6d
Merge pull request #60457 from ClickHouse/ci_auto_ci_backport
CI: Auto backport for bugfix and ci-fix
2024-02-28 18:28:22 +01:00
Max Kainov
444ff093bb CI: Auto backport for bugfix and CI changes 2024-02-28 16:02:13 +00:00
Mikhail f. Shiryaev
130cd86287
Do not mark report as pending if some jobs are skipped 2024-02-28 15:15:04 +01:00
Max Kainov
92e6cbe2e8 CI: quick style fix
#do_not_test
2024-02-28 12:37:07 +00:00
Max K
a23913b277
Update tests/ci/run_check.py
#do_not_test

Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2024-02-28 12:22:19 +01:00
Max Kainov
155b5f3cff CI: fix pr check status to not fail mergeable check
#do_not_test
2024-02-28 10:33:32 +00:00
Alexey Milovidov
ee772aaf0f Use clang-18 in CI 2024-02-27 23:17:11 +01:00
Mikhail f. Shiryaev
6b24306678
Merge pull request #60444 from ClickHouse/replace-distutils
Replace deprecated distutils by vendored packaging
2024-02-27 15:50:49 +01:00
Mikhail f. Shiryaev
f49882ee17
Do not fail the build if ci-logs is not healthy 2024-02-27 13:59:01 +01:00
Mikhail f. Shiryaev
c85daf27f4
Replace deprecated distutils by vendored packaging 2024-02-27 12:49:44 +01:00
Mikhail f. Shiryaev
6ac893b565
Fix the local cache when it does not exist 2024-02-26 23:17:16 +01:00
Mikhail f. Shiryaev
6a6d6a286e
Split update_mergeable_check into two functions to force trigger the status 2024-02-26 21:31:41 +01:00
Azat Khuzhin
dd690dd05d Expose fatal.log separately for fuzzer
Otherwise you have to download the full server.log

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-24 19:23:28 +01:00
Mikhail f. Shiryaev
ff353823b6
Update the GH actions runner version 2024-02-23 17:18:53 +01:00
Mikhail f. Shiryaev
758acd4268
Setup tailscale on instances, create a common network script 2024-02-23 17:18:52 +01:00
Max K
11e4029c6b
Merge pull request #59496 from AVMusorin/skip-tests-for-docs
Avoid running all checks when `aspell-dict.txt` was changed
2024-02-23 14:13:47 +01:00
Max Kainov
831fee9edb CI: remove Integration tests asan, release from PR wf
#do_not_test
2024-02-22 18:35:06 +00:00
Max K
0df33c94ba
Merge pull request #60224 from ClickHouse/ci_combine_analyzer_s3_replicated_tests
CI: combine analyzer, s3, dbreplicated into one job
2024-02-22 18:41:41 +01:00
Mikhail f. Shiryaev
a768f40adc
Add tailscale installation to the AMI preparation 2024-02-22 14:58:51 +01:00
Alexey Milovidov
659d960990
Merge pull request #60245 from Algunenano/enforce_cloud_sync
Make cloud sync required
2024-02-22 10:11:01 +01:00
Max K
e7a560f94d
Merge pull request #59939 from ClickHouse/ci_integration_tests_to_mysql8_migration
CI: integration tests to mysql80
2024-02-21 20:33:00 +01:00
Raúl Marín
07c9deed41 Make cloud sync required 2024-02-21 18:40:00 +01:00
Max Kainov
f827469207 CI: random sanitizer for parallel repl in PR wf 2024-02-21 16:08:03 +00:00
Max Kainov
47ab81bbab CI: support for random job pick
#no_merge_commit
 #no_ci_cache
2024-02-21 15:39:57 +00:00
Max Kainov
9fb55f1fa4 CI: combine analyzer s3 dbreplicated into one job
#job_Stateless_tests_release_analyzer_s3_DatabaseReplicated
 #job_style_check
 #no_merge_commit
2024-02-21 13:18:02 +00:00
Max Kainov
9f51e840db CI: integration tests to mysql80
#ci_set_integration
 #no_merge_commit
2024-02-21 11:05:47 +00:00
Max Kainov
f928eaf10c CI: hot fix for gh statuses
#no_merge_commit
 #job_style_check
 #job_Stateless_tests_debug
2024-02-20 21:38:19 +00:00
Max K
bf6929cb4c
Merge pull request #59348 from ClickHouse/refactor_bugfix_validate_job
CI: refactor bugfix-validate job
2024-02-16 12:32:52 +01:00
Max Kainov
5a3a93bea5 CI: refactor bugfix validate job
#no_merge_commit
2024-02-15 16:28:27 +00:00
Mikhail f. Shiryaev
54b43ee3a2
Do not dump to the file, there are no pr_info locally 2024-02-14 18:33:55 +01:00
Mikhail f. Shiryaev
f5a71455b8
Do not rebuild a lambda package if it is updated 2024-02-12 18:12:25 +01:00
Alexey Milovidov
789bca11e1
Merge pull request #58792 from ClickHouse/enable-coverage-for-debug-build
Add builds and tests with coverage
2024-02-10 23:52:22 +01:00
Alexey Milovidov
ccc9637dda
Merge pull request #59814 from ClickHouse/enforce-analyzer-tests
Enforce tests with enabled analyzer in CI
2024-02-10 21:39:54 +01:00
Alexey Milovidov
61227acdc4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-02-10 19:30:22 +01:00
Nikolai Kochetov
fb8723a15c
Update pr.py 2024-02-10 13:13:26 +01:00
Maksim Kita
8b3c27d45b Updated a list of trusted contributors 2024-02-10 15:00:31 +03:00
Alexey Milovidov
a7c30098b6 Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-02-09 22:52:49 +01:00
Alexey Milovidov
e54fbd3367
Update tests/ci/ci_config.py
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2024-02-09 18:32:54 +01:00
Mikhail f. Shiryaev
f056e8b2c4
Handle different timestamp related aspects of zip-files 2024-02-09 16:54:00 +01:00
Dmitry Novik
b23ba02d4c
Enforce tests with enabled analyzer in CI 2024-02-09 16:50:37 +01:00
Max Kainov
c2320c2d16 CI: await tune ups
#no_ci_cache #job_package_debug
2024-02-09 13:17:49 +00:00
Max Kainov
9dfe3f5559 CI: do not reuse builds on release branches
#job_package_debug #job_style_check
2024-02-09 12:43:05 +00:00
robot-clickhouse
07ae125a52 Automatic style fix 2024-02-09 00:34:00 +00:00
Alexey Milovidov
ad665f9b06 Better 2024-02-09 00:46:12 +01:00
Alexey Milovidov
f386e34b91 Fix an error by rewriting the CI from Perl to Python 2024-02-09 00:45:16 +01:00
Alexey Milovidov
c12e34df19 Fix report 2024-02-08 23:28:29 +01:00
Alexey Milovidov
cd0acc512d Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-02-08 22:08:15 +01:00
Max Kainov
b112fd1e3c CI: ci test await
#do_not_test
2024-02-08 19:09:38 +00:00
Max Kainov
641c7b547d CI: enable await
#no_merge_commit
2024-02-08 18:37:30 +00:00
Alexey Milovidov
85bd8d3cf0 Fix your Py 2024-02-08 00:23:04 +01:00
Alexey Milovidov
02c0b4c67f Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build 2024-02-07 22:45:50 +01:00
Alexey Milovidov
62721fef78 Fix your Py 2024-02-07 22:45:35 +01:00
Alexey Milovidov
4d25929d74 A few missing changes 2024-02-07 20:58:40 +01:00
Mikhail f. Shiryaev
a1eb9abaf0
Add test for increase-always autoscaling lambda 2024-02-07 13:49:35 +01:00
Alexey Milovidov
d65a56d967
Merge branch 'master' into enable-coverage-for-debug-build 2024-02-07 04:58:21 +01:00
Mikhail f. Shiryaev
13948cbb20
Use constants from report instead of string literals 2024-02-06 15:02:09 +01:00
Mikhail f. Shiryaev
5b9bf80f09
Fix usage of status types to prevent API exceptions 2024-02-06 13:40:07 +01:00
Mikhail f. Shiryaev
df93062472
Apply and fix isort in scripts 2024-02-06 13:40:05 +01:00
Nikita Mikhaylov
306e739daa
Updated a list of trusted contributors (#59616)
* Updated a list of trusted contributors

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2024-02-06 12:33:11 +01:00
Max Kainov
cbd81b506f CI: fix ast fuzzer job report (slack bot issue)
#job_ast_fuzzer_debug #job_style_check
2024-02-06 09:56:15 +00:00
Max K
3ddaa1b5f1
CI: nightly job to update latest docker tag only (#59586)
* CI: nightly job to update latest docker tag only

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2024-02-05 18:09:43 +01:00