Commit Graph

2941 Commits

Author SHA1 Message Date
Max K
465e4ad73f CI: Remove aws lambda packages from oss 2024-07-18 20:58:43 +02:00
Max K.
10fb524e73
Merge pull request #66533 from ClickHouse/ci_report_job_start_and_finish_to_db
CI: Report job start and finish to CI DB
2024-07-18 18:20:47 +00:00
Max K
4249d869a9 fix tests 2024-07-18 19:48:13 +02:00
Max K
9eba5975d8 CI: Fix issue with a skipped Build report 2024-07-18 19:08:46 +02:00
Azat Khuzhin
959ac9a768 ci: dump dmesg in case of OOM
Without additional info it is unclear how to tune paralelism or maybe
split some modules.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-07-18 13:17:09 +02:00
Max K.
a5746d8145
Merge pull request #66513 from ClickHouse/ci_tests_3_block_fix
CI: Do not block Tests_3 unless MAX_FAILED_TESTS exceeded
2024-07-17 18:16:07 +00:00
Max K.
c7e0aa5671
Merge pull request #66622 from ClickHouse/ci_try_decreasing_asg_from_terminating_runners
CI: Scale down AutoScaling Groups from runners
2024-07-17 16:49:30 +00:00
Alexey Milovidov
6af5f44175
Merge pull request #66561 from XuJia0210/update-trusted-contributors
update trusted contributors
2024-07-17 16:20:39 +00:00
robot-clickhouse
c40473ff80 Automatic style fix 2024-07-17 10:51:00 +00:00
Max K
2958803255 do not decrease from lambda 2024-07-17 12:38:52 +02:00
Max K
a1a802cee9 fix deployment script 2024-07-17 01:13:42 +02:00
Max K
5ca7241865 CI: AWS ASG decrease capacity from runners 2024-07-17 00:23:14 +02:00
Alexey Milovidov
ae93cceb9e
Merge pull request #66592 from ClickHouse/very_important_fix
Fix bsdtar for @nikitamikhaylov
2024-07-16 21:23:31 +00:00
Max K
db7fb78a04 major fix 2024-07-16 21:28:35 +02:00
Max K
2af361eb14 minor fix 2024-07-16 16:18:41 +02:00
alesapin
630a29f537 Fix bsdtar for @nikitamikhaylov 2024-07-16 15:11:17 +02:00
Max K
a9b8c2a29a CI: Do not block Tests_3 unless MAX_TOTAL_FAILURES_PER_JOB_BEFORE_BLOCKING_CI 2024-07-16 11:06:09 +02:00
Alexey Milovidov
1d2f3a1ed5
Update pr.py 2024-07-16 05:56:26 +02:00
Xu Jia
5d96b684a6 update format 2024-07-16 11:31:27 +08:00
Alexey Milovidov
2c62a6b528
Update pr.py 2024-07-16 05:10:26 +02:00
Xu Jia
26f8b81081 update trusted contributors 2024-07-16 10:54:00 +08:00
Yakov Olkhovskiy
60caa20eb7
Merge pull request #66551 from ClickHouse/ci-libfuz-docker
Add dedicated runner to libfuzzer, update docker
2024-07-15 20:18:45 +00:00
Yakov Olkhovskiy
0176e0b2ae fix 2024-07-15 19:27:54 +00:00
Yakov Olkhovskiy
5361ade8e7 optimize 2024-07-15 19:10:07 +00:00
Max K.
93ef3aa7da
Merge pull request #66498 from ClickHouse/ci_create_release_workflow_updates
CI: Create release workflow updates
2024-07-15 18:42:52 +00:00
Max K
5fc4fada61 add info about previous release 2024-07-15 19:30:23 +02:00
robot-clickhouse
97c9739abc Automatic style fix 2024-07-15 17:21:59 +00:00
Yakov Olkhovskiy
50f068efe9 add dedicated runner to libfuzzer, update docker 2024-07-15 17:00:53 +00:00
Max K
d4e7188750 CI: Report job start and finish to CI DB 2024-07-15 17:46:24 +02:00
Raúl Marín
ebb5d61535
Merge pull request #66523 from Algunenano/mask_azure
Add additional log masking in CI
2024-07-15 15:31:53 +00:00
Max K
43b3a133e9 add prints to check_mergeable_state 2024-07-15 15:17:16 +02:00
Max K
f7dfa21bff style fixes 2024-07-15 14:39:29 +02:00
Max K
1e6edbd4ae ci buddy message format updates 2024-07-15 14:14:44 +02:00
Max K
31fdfbc737 add fetching exit code if job was killed 2024-07-15 14:10:31 +02:00
Max K
d768251f99 fix handling of skipped build 2024-07-15 13:43:07 +02:00
Raúl Marín
b6b4b046a3 Style 2024-07-15 13:42:00 +02:00
Max K
6f036fad59 CI: Fix ci await function 2024-07-15 13:35:20 +02:00
Raúl Marín
de029e278a Add additional log masking 2024-07-15 13:30:48 +02:00
Max K
f311612e91 check filter_out_not_affected_jobs in unit test 2024-07-15 09:59:23 +02:00
Max K
7ef89f169b CI: Fix for skipping Builds_2 in PRs' CI 2024-07-15 09:26:07 +02:00
Max K
2ddd0078dc rename reusable docker workflow 2024-07-14 21:07:41 +02:00
Max K
5bce8086a8 CI: Create release workflow updates 2024-07-14 19:02:20 +02:00
Max K
9dabf205e6 CI: Fix for await to always await for builds 2024-07-14 14:01:10 +02:00
Max K
f374cdfe69 CI: Fix for job filtering in PRs 2024-07-14 13:53:20 +02:00
Max K
379706d2d5 fix for job filtering 2024-07-14 12:08:53 +02:00
Max K
80c8511004 CI: Add retry for GH set_comment_status call 2024-07-14 11:39:31 +02:00
Alexey Milovidov
4ebd88f64a
Merge pull request #66477 from ClickHouse/ci_strict_job_check
CI: Check job's exit status and report if killed
2024-07-13 20:22:08 +00:00
Max K
09b753ecc5 CI: Check job's exit status and report if killed 2024-07-13 21:13:03 +02:00
Max K
000cd64d60
Merge pull request #66339 from ClickHouse/create_release_wf
Create release workflow
2024-07-13 18:55:47 +00:00
Max K
f9b1f2498a fix 2024-07-13 18:49:23 +02:00
Max K
162d875aee persistent job report path 2024-07-13 18:28:13 +02:00
Max K
d99c56ae8c CI: Autoskip all non-affected jobs in PRs 2024-07-13 17:25:45 +02:00
Max K
578d22ae94 style
Automatic style fix

Automatic style fix
2024-07-13 16:23:46 +02:00
Max K
9f1520ae21 do not autofix if not only black failed 2024-07-13 16:21:40 +02:00
Max K
2cd1a39ff4 style fixes
Automatic style fix
2024-07-13 16:21:33 +02:00
Max K
1050217445 add support for new release branch
Automatic style fix
2024-07-13 16:21:22 +02:00
Max K
99cd83da1f New Create Release workflow 2024-07-13 16:21:22 +02:00
Max K
2ff09bdf18
Merge pull request #66440 from ClickHouse/ci_not_block_on_few_test_failures
CI: Do not block CI on few number of test failures
2024-07-13 12:13:28 +00:00
Max K
b4369bf183
Merge pull request #66468 from ClickHouse/ci_add_digest_config_for_ast
CI: Cache AST fuzzers (run always) jobs
2024-07-13 11:31:48 +00:00
robot-clickhouse
fd9f91c796 Automatic style fix 2024-07-13 11:08:01 +00:00
Max K
11f3e406c6 CI: Cache AST fuzzers (run always) jobs in CI 2024-07-13 12:59:39 +02:00
Max K
8706145c46 fix for not success status in Sync 2024-07-13 12:17:03 +02:00
Max K
04525888f5 fix for failed workflow status 2024-07-13 11:55:25 +02:00
Max K
1495ef3218 CI: Set error status for job with OOM 2024-07-12 20:38:13 +02:00
Max K
5b1e9bebe4 change thresholds 2024-07-12 20:22:05 +02:00
Vitaly Baranov
90142b73ad
Merge pull request #66284 from vitlibar/add-stateless-test-for-grpc
Add a stateless test for gRPC protocol
2024-07-12 17:32:06 +00:00
Max K
8a5088fcc9
Merge pull request #66407 from ClickHouse/ci_skip_pending_jobs_in_prs
CI: Skip pending and not affected jobs from PR workflow run
2024-07-12 16:11:58 +00:00
Max K
05810ec76f do not skip Build_report 2024-07-12 15:40:06 +02:00
Nikita Fomichev
258ae45aa8
Merge pull request #66411 from ClickHouse/fix-hanging-on-gdb
Stateless tests: deal with hang-ups more roughly
2024-07-12 13:25:46 +00:00
Max K
666f5ffaf9 mypy fix 2024-07-12 15:17:51 +02:00
Max Kainov
a3ab1ab5ca CI: Do not block on few number of test failures 2024-07-12 13:12:50 +00:00
robot-clickhouse
ed693da2b0 Automatic style fix 2024-07-12 12:34:25 +00:00
Max K
f9eb0f9efd ci unit test 2024-07-12 14:27:18 +02:00
Max K
a4591a4dc4 CI: Skip pending and not affected jobs from PR workflow run 2024-07-12 14:27:18 +02:00
Max K
b024bb736f CI: CiBuddy to post to salck channel from release branches only 2024-07-12 10:14:41 +02:00
Max K
da741d271f
Merge pull request #66392 from ClickHouse/ci_buddy
CI Buddy bot to notify about CI events
2024-07-12 00:28:46 +00:00
Nikita Fomichev
4a56c601b2 Stateless tests: decrease CI timeout 2024-07-12 01:11:13 +02:00
Max Kainov
6868708a58 CI Buddy bot to notify about CI events 2024-07-11 15:58:56 +00:00
Vitaly Baranov
355a56d1b0 Add a stateless test for gRPC protocol. 2024-07-11 15:36:41 +02:00
Antonio Andelic
1eec1fd77f Merge branch 'master' into collect-core-dumps-stateless 2024-07-10 13:01:41 +02:00
Nikita Fomichev
eeb3561c37 Stateless tests: run sequential tests in parallel to other tests 2024-07-09 19:41:06 +02:00
Antonio Andelic
004d8e0d49 Run privileged 2024-07-09 18:39:21 +02:00
Raúl Marín
3435e25b8a Linter 2024-07-05 16:46:49 +02:00
Raúl Marín
8a1dd3c7c8 Fix download of debug files for BugFix checker 2024-07-05 16:46:49 +02:00
Max K
1641eac819
Merge pull request #66105 from ClickHouse/multiple_sync_pr_fix
CI: Fix sync pr merge
2024-07-05 09:03:31 +00:00
Nikita Mikhaylov
3a7c98399f
Merge pull request #65777 from ClickHouse/make_analyzer_important
Make `allow_experimental_analyzer` be controlled by the initiator for distributed queries
2024-07-04 20:38:40 +00:00
Max K
df0cce24ee CI: Fix sync pr merge 2024-07-04 19:34:47 +02:00
Nikita Mikhaylov
2c37cc048c Style 2024-07-04 11:12:27 +00:00
robot-clickhouse
e2553454ec Automatic style fix 2024-07-04 11:12:26 +00:00
Max K
d62454714b Make test error visible 2024-07-04 11:12:26 +00:00
alesapin
a2626037bc Improve object storage tags in tests 2024-07-02 14:15:59 +02:00
Alexey Milovidov
0d29df0fba
Update prepare-ci-ami.sh 2024-06-28 16:56:34 +02:00
Max Kainov
0fe0bc8c8d AMI image with gh and jwt 2024-06-27 19:34:41 +00:00
Max K
3e957caa30
Merge pull request #65658 from ClickHouse/ci_sync_and_mergeable_check_updates
CI: Single point of setting mergeable check status
2024-06-26 17:35:15 +00:00
Max K
2ef503ad38
Merge pull request #65554 from ClickHouse/ci_rename_build_report_jobs
CI: Rename "ClickHouse build check" job to "Builds"
2024-06-26 17:24:48 +00:00
Max K
2c37bde7f1 mypy fix 2024-06-25 16:04:17 +02:00
Max K
9481b665cc CI: Single point of setting mergeable check status 2024-06-25 15:23:02 +02:00
Max K
13a0096840 update backport and release workflow to make report for limited number of builds 2024-06-25 14:36:20 +02:00
Max K
9d99e6a8bb
Merge pull request #65553 from ClickHouse/ci_flaky_test_check_fix
CI: Skip removed test files in stateless flaky check job
2024-06-25 08:07:32 +00:00
Max K
154fbb28b4 CI: Return Job Rerun check 2024-06-24 17:33:10 +02:00
Raúl Marín
cbdb9833f2
Merge pull request #65485 from Algunenano/246_changelog
Generate 24.6 changelog
2024-06-24 12:22:53 +00:00
Max K
c30fcf5783 CI: Flaky check fix failure on deleted tests 2024-06-22 19:07:30 +02:00
robot-clickhouse
72e1eb6b46 Automatic style fix 2024-06-22 11:51:28 +00:00
Max K
58b90e15a5 CI: Rename "ClickHouse (special) build check" job 2024-06-22 13:44:12 +02:00
Max K
4064ca018f CI: Try Rerun check removal 2024-06-21 12:19:26 +02:00
Raúl Marín
26aa65b9d1 Add 'Experimental Feature' category 2024-06-21 09:49:26 +00:00
Raúl Marín
fa3bdf6050 Fix style 2024-06-21 09:15:32 +00:00
Raúl Marín
8b54e4b593 Changelog improvements 2024-06-20 18:01:07 +00:00
Max K
84d282c573 CI: Rename sync status 2024-06-19 17:29:24 +02:00
Max K
cb7d97988a CI: Rename Sync status 2024-06-19 15:07:16 +02:00
Max K
b1f2b54d70
Merge pull request #65394 from alexkats/compatibility
Fix compatibility release check
2024-06-18 17:16:02 +00:00
Alex Katsman
ec855651f3 Fix compatibility release check 2024-06-18 13:54:45 +00:00
Max K
ed38f370c3 CI: Add Non-blocking (Woolen wolfdog) CI mode 2024-06-18 13:40:01 +02:00
Max K
abb88e4d60
Merge pull request #65045 from ClickHouse/ci_config_refactoring
CI: ci_config refactoring
2024-06-18 08:17:35 +00:00
robot-clickhouse
9f64e46f5e Automatic style fix 2024-06-17 10:55:44 +00:00
Max K
59b871663f More ci unit tests 2024-06-17 12:41:35 +02:00
Max K
f00750a152 do not overwrite Sync status if set 2024-06-17 08:33:31 +02:00
Max K
1d48bd7846 add SyncState class fir further adoption 2024-06-15 18:16:17 +02:00
robot-clickhouse
ed9bfbe393 Automatic style fix 2024-06-15 16:06:39 +00:00
Max K
2af2fc1486 more tests 2024-06-15 17:59:42 +02:00
Max K
0d7a4915ae align job names, add more tests 2024-06-15 17:49:05 +02:00
robot-clickhouse
9bf849ca73 Automatic style fix 2024-06-14 19:28:05 +00:00
Mikhail f. Shiryaev
799e573008
Fix silly typo that caused wrong tags messages 2024-06-14 19:03:32 +02:00
Max K
ba349ac73b ci test improvement 2024-06-14 18:50:53 +02:00
Max K
7b43ede04e style fix 2024-06-14 18:45:08 +02:00
Max K
592d704bf9 Build Report check remove pending status 2024-06-14 18:42:37 +02:00
Max K
6e3199ebea CI: ci_config refactoring 2024-06-14 11:58:29 +02:00
Max K
205cb400ab
Merge pull request #65228 from ClickHouse/ci_propagate_wf_error_to_finish_check
CI: FinishCheck to set failure if workflow failed
2024-06-14 07:39:07 +00:00
Max K
5bc879c07c comment 2024-06-13 20:42:30 +02:00
Max K
fc255456ce comment 2024-06-13 16:36:07 +02:00
Max K
a77eda6388 fix pylint 2024-06-13 16:27:41 +02:00
Max K
0d17f2cede CI: FinishCheck to set failure if workflow failed 2024-06-13 16:14:57 +02:00
Mikhail f. Shiryaev
f1707998d2
Fix search issues for progress_func, add zstd for GH cache 2024-06-13 15:40:38 +02:00
Mikhail f. Shiryaev
72cc6b2ba0
Merge pull request #64813 from ClickHouse/changelog-in-ci
Changelog in ci
2024-06-12 21:11:29 +00:00
Max Kainov
49977e89e0 CI: Fix not-merged cherry-picks for backports 2024-06-12 14:29:52 +00:00
Mikhail f. Shiryaev
94c82787c5
Add a progress function for searching PRs in changelog.py 2024-06-12 14:43:26 +02:00
Mikhail f. Shiryaev
c797c8105d
Allow to pass tqdm.tqdm into get_pulls_from_search 2024-06-12 14:43:26 +02:00
Mikhail f. Shiryaev
4b90e0ecd4
Improve splitting search_issues, solving pylint issues 2024-06-12 14:43:25 +02:00
Mikhail f. Shiryaev
f4630e9dae
Fix Backported in for not-for-changelog PRs 2024-06-12 14:43:25 +02:00
Mikhail f. Shiryaev
335ec8f3e1
Parse changelog entry is not required properly 2024-06-12 14:43:24 +02:00
Mikhail f. Shiryaev
3cc099a88e
Adjust changelog.py to a new release model with v24.6.1.1-new tags 2024-06-12 14:43:24 +02:00
Mikhail f. Shiryaev
55350a3338
Fix style issues 2024-06-12 14:43:23 +02:00
Mikhail f. Shiryaev
0803e87a93
Use GitHubCache in changelog.py 2024-06-12 14:43:23 +02:00
Mikhail f. Shiryaev
dcd3e9d151
Move changelog script to tests/ci 2024-06-12 14:43:22 +02:00
Mikhail f. Shiryaev
b1a10e23a1
Merge pull request #64759 from ClickHouse/new-release-scheme
Adjust the `version_helper` and script to a new release scheme
2024-06-11 13:37:51 +00:00
Mikhail f. Shiryaev
221ac1414d
Merge pull request #64904 from ClickHouse/improve-pr-info-diff
Persistent PRInfo diff url
2024-06-10 18:24:16 +00:00
Mikhail f. Shiryaev
d984a80b57
Create tag in dry-run to check the order of commands 2024-06-10 14:38:40 +02:00
Mikhail f. Shiryaev
3d07f72927
Create tags v{version}-new for new releases 2024-06-10 14:38:40 +02:00
Mikhail f. Shiryaev
43b0866ed6
Make Release._create_tag more flexible 2024-06-10 14:38:39 +02:00
Mikhail f. Shiryaev
d506220f8c
Fix possible issues in Release._checkout 2024-06-10 14:38:39 +02:00