Commit Graph

3003 Commits

Author SHA1 Message Date
Max K
8214910cc7 add geesfs 2024-08-01 18:07:13 +02:00
Max K
c534cd5bc2 changelog.py to retrieve best token
s3fs fix

changelog.py to use base branch to filter prs
2024-08-01 18:07:11 +02:00
Max K
9362d1a566 CI: Create release workflow dry run fix
fix
2024-08-01 18:06:54 +02:00
Raúl Marín
bdf98cbcc0 Fix public backports 2024-07-30 10:06:01 +00:00
Max K.
7b2ec7ea33
Merge pull request #67402 from ClickHouse/ci_build_results_fix
CI: Fix build results for release branches
2024-07-29 19:46:17 +00:00
Max K
fea03cf46f Build results fix 2024-07-29 21:07:24 +02:00
Max K.
7e011fa967
Merge pull request #67075 from ClickHouse/ci_create_release_docker_fix
CI: Docker server build fix for new release workflow
2024-07-29 18:31:34 +00:00
Max K
4417a9ae6f style fix 2024-07-29 16:14:45 +02:00
Max K
fd2dc474a1 docker server fixes 2024-07-29 14:26:02 +02:00
Max K
9f8c90065e Fix docker jobs dependencies 2024-07-29 14:16:20 +02:00
Max K
918feaff9d CI: Fix reuse for release branches 2024-07-29 13:46:23 +02:00
Alexey Milovidov
9c44ceda65
Merge pull request #67327 from ClickHouse/follow-up-67301
Follow-up for #67301
2024-07-29 10:32:42 +00:00
Max K.
80a003f994
Merge pull request #67343 from ClickHouse/ci_check_docker_stdout_commands
CI: Print stdout, stderr for docker pull command
2024-07-29 09:51:38 +00:00
Max K.
37210d29ee
Merge pull request #67104 from ClickHouse/ci_rename_test_stages
CI: Rename Tests_2/3 stages to avoid confusion
2024-07-29 07:58:59 +00:00
Max K
bdcedeb3f0 CI: Add stdout, err for docker pull command 2024-07-29 09:49:18 +02:00
Alexey Milovidov
39de59a605 Follow-up for #67301 2024-07-29 02:11:55 +02:00
Alexey Milovidov
6c0cf76fad
Merge pull request #67301 from ClickHouse/better-test-report
Wrap log lines in the CI report for functional tests
2024-07-28 14:15:27 +00:00
Alexey Milovidov
29b804adf3 Wrap log lines in the CI report for functional tests 2024-07-28 14:01:17 +02:00
Raúl Marín
b23ce171c3 My black version said this was ok 2024-07-25 13:11:32 +00:00
Raúl Marín
2c83a39503 Fixes 2024-07-25 12:53:59 +00:00
Raúl Marín
b80305ba98 Improve backport script 2024-07-25 14:31:00 +02:00
Max K
86e23b346f rename test stages 2024-07-25 12:12:37 +02:00
Ilya Yatsishin
db5b4c0e96
Merge pull request #66986 from qoega/integration-flaky-check-repeat
Add hardening to integration tests flaky check: repeat test case multiple times with same environment.
2024-07-25 08:18:37 +00:00
Yatsishin Ilya
73a0811b75 Merge remote-tracking branch 'origin' into improve-integration-tests-3 2024-07-24 20:29:20 +00:00
Max K
9de43325e4 CI: Jepsen Workflow with CI buddy 2024-07-24 19:51:34 +02:00
Ilya Yatsishin
fe487a11bf Merge remote-tracking branch 'qoega/improve-integration-tests-2' into integration-flaky-check-repeat 2024-07-23 23:57:31 +02:00
Max K
2551f14141 CI: Add messages fro debugging 2024-07-23 20:42:21 +02:00
Max K
c7427e6572 CI: Fixes docker server build for release branches 2024-07-23 17:24:52 +02:00
Ilya Yatsishin
e0a7aa80af Enable repeat for flaky check for more tests hardening 2024-07-23 16:57:07 +02:00
Max K.
3f8b27d7ac
Merge pull request #66920 from ClickHouse/ci_remove_init_runner_scripts_from_oss
CI: Remove ci runners scripts from oss
2024-07-23 11:01:42 +00:00
Max K
bb28a65e98 minor fix for wf status reporting 2024-07-23 11:50:05 +02:00
Max K
b164014bf9 CI: Remove ci runners scripts from oss 2024-07-23 11:00:05 +02:00
Max K
2b56cbc1fd CI: Add ec2 instance lifecycle metadata to CIDB 2024-07-23 09:42:58 +02:00
Max K
fa0f760fd9 CI: CI Buddy to notify about fatal workflow failures 2024-07-22 18:05:13 +02:00
Max K.
217363d9a7
Merge pull request #66868 from ClickHouse/ci_runner_init_print_instance_info
CI: Print instance info in runner's init script
2024-07-22 12:38:00 +00:00
Max K
69ad8feb90 add instance type 2024-07-22 13:38:10 +02:00
Max K
cd700c59b1 minor fix 2024-07-22 13:17:25 +02:00
Max K
e708219f6a CI: Print instance info in runner's init script 2024-07-22 13:01:27 +02:00
Max K
dd9fe61d1a CI: New Release workflow updates and fixes 2024-07-21 21:21:39 +02:00
Max K.
08db9fb8f1
Merge pull request #66593 from ClickHouse/autorelease_poc
CI: POC for Auto Releases
2024-07-21 15:03:11 +00:00
Max K
d83428daaf fix in ci unittests 2024-07-21 14:52:33 +02:00
Max K
02bf9e4243 push pending records before await call 2024-07-21 12:53:07 +02:00
Max K
08353419d0 CI: Never await on BuildReport job, Skip BuildReport if no builds in workflow 2024-07-21 11:50:15 +02:00
Alexey Milovidov
ccbbe8d0af
Merge pull request #66705 from azat/ci/dump-dmesg
ci: dump dmesg in case of OOM
2024-07-21 05:24:50 +00:00
Max K
3767f72348 more info for buddy 2024-07-20 19:05:28 +02:00
Max Kainov
5d09f205e5 style fixes 2024-07-20 14:42:53 +02:00
Max K
3de472cedc add buddy, move release into action.yml
try callable wf

fix

add ci buddy
2024-07-20 14:42:50 +02:00
Max K
e3b2fbf7ec CI: POC for Auto Releases 2024-07-20 14:42:49 +02:00
Nikita Fomichev
53249a2ad1
Merge pull request #66783 from ClickHouse/tavplubix-patch-14
Update ci_config.py
2024-07-20 10:12:38 +00:00
Nikita Fomichev
fa2659a87c Increase CI timeout for stateless tests 2024-07-19 20:10:08 +02:00
Nikita Fomichev
00e14bde80 Update ci_config.py 2024-07-19 20:09:46 +02:00
Alexander Tokmakov
e57a10189c
Update ci_config.py 2024-07-19 19:09:51 +02:00
Max K.
6200cf364c
Merge pull request #66744 from ClickHouse/ci_build_include_fix
CI: Next fix for builds in CI workflow
2024-07-19 17:08:53 +00:00
Nikita Fomichev
3d00badef7
Merge pull request #66520 from ClickHouse/fix-tests-oom
Stateless tests: improvements related to OOM of test runs
2024-07-19 14:36:08 +00:00
Max K
983d2b474b CI: Next fix for builds in CI workflow 2024-07-19 12:44:31 +02:00
Max K.
a07707c56e
Merge pull request #66651 from ClickHouse/ci_remove_lambdas_from_oss
CI: Remove aws lambda packages from oss
2024-07-19 10:10:26 +00:00
Max K.
9f16c2abbc
Merge branch 'master' into ci/dump-dmesg 2024-07-19 09:54:53 +02:00
Max K
09141163b4 remove lambda unit tests 2024-07-18 23:45:52 +02:00
Max K.
2e1f00dd97
Merge pull request #66726 from ClickHouse/ci_mergeable_check_fixes
CI: Fix issue with a skipped Build report
2024-07-18 20:37:35 +00:00
Nikita Fomichev
bd10951db8 Stateless tests: tune MAX_RUN_TIME 2024-07-18 21:50:21 +02:00
Max K
465e4ad73f CI: Remove aws lambda packages from oss 2024-07-18 20:58:43 +02:00
Max K.
10fb524e73
Merge pull request #66533 from ClickHouse/ci_report_job_start_and_finish_to_db
CI: Report job start and finish to CI DB
2024-07-18 18:20:47 +00:00
Max K
4249d869a9 fix tests 2024-07-18 19:48:13 +02:00
Max K
9eba5975d8 CI: Fix issue with a skipped Build report 2024-07-18 19:08:46 +02:00
Azat Khuzhin
959ac9a768 ci: dump dmesg in case of OOM
Without additional info it is unclear how to tune paralelism or maybe
split some modules.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-07-18 13:17:09 +02:00
Max K.
a5746d8145
Merge pull request #66513 from ClickHouse/ci_tests_3_block_fix
CI: Do not block Tests_3 unless MAX_FAILED_TESTS exceeded
2024-07-17 18:16:07 +00:00
Max K.
c7e0aa5671
Merge pull request #66622 from ClickHouse/ci_try_decreasing_asg_from_terminating_runners
CI: Scale down AutoScaling Groups from runners
2024-07-17 16:49:30 +00:00
Alexey Milovidov
6af5f44175
Merge pull request #66561 from XuJia0210/update-trusted-contributors
update trusted contributors
2024-07-17 16:20:39 +00:00
robot-clickhouse
c40473ff80 Automatic style fix 2024-07-17 10:51:00 +00:00
Max K
2958803255 do not decrease from lambda 2024-07-17 12:38:52 +02:00
Yakov Olkhovskiy
f07a395bf1 Merge branch 'master' into ci-fuzzer-enable 2024-07-17 03:43:57 +00:00
Max K
a1a802cee9 fix deployment script 2024-07-17 01:13:42 +02:00
Max K
5ca7241865 CI: AWS ASG decrease capacity from runners 2024-07-17 00:23:14 +02:00
Alexey Milovidov
ae93cceb9e
Merge pull request #66592 from ClickHouse/very_important_fix
Fix bsdtar for @nikitamikhaylov
2024-07-16 21:23:31 +00:00
Max K
db7fb78a04 major fix 2024-07-16 21:28:35 +02:00
Max K
2af361eb14 minor fix 2024-07-16 16:18:41 +02:00
Yakov Olkhovskiy
9690a5a334 fix 2024-07-16 13:37:59 +00:00
alesapin
630a29f537 Fix bsdtar for @nikitamikhaylov 2024-07-16 15:11:17 +02:00
Max K
a9b8c2a29a CI: Do not block Tests_3 unless MAX_TOTAL_FAILURES_PER_JOB_BEFORE_BLOCKING_CI 2024-07-16 11:06:09 +02:00
Alexey Milovidov
1d2f3a1ed5
Update pr.py 2024-07-16 05:56:26 +02:00
Xu Jia
5d96b684a6 update format 2024-07-16 11:31:27 +08:00
Alexey Milovidov
2c62a6b528
Update pr.py 2024-07-16 05:10:26 +02:00
Xu Jia
26f8b81081 update trusted contributors 2024-07-16 10:54:00 +08:00
Yakov Olkhovskiy
60caa20eb7
Merge pull request #66551 from ClickHouse/ci-libfuz-docker
Add dedicated runner to libfuzzer, update docker
2024-07-15 20:18:45 +00:00
Yakov Olkhovskiy
0176e0b2ae fix 2024-07-15 19:27:54 +00:00
Yakov Olkhovskiy
5361ade8e7 optimize 2024-07-15 19:10:07 +00:00
Max K.
93ef3aa7da
Merge pull request #66498 from ClickHouse/ci_create_release_workflow_updates
CI: Create release workflow updates
2024-07-15 18:42:52 +00:00
Max K
5fc4fada61 add info about previous release 2024-07-15 19:30:23 +02:00
robot-clickhouse
97c9739abc Automatic style fix 2024-07-15 17:21:59 +00:00
Yakov Olkhovskiy
50f068efe9 add dedicated runner to libfuzzer, update docker 2024-07-15 17:00:53 +00:00
Max K
d4e7188750 CI: Report job start and finish to CI DB 2024-07-15 17:46:24 +02:00
Raúl Marín
ebb5d61535
Merge pull request #66523 from Algunenano/mask_azure
Add additional log masking in CI
2024-07-15 15:31:53 +00:00
Max K
43b3a133e9 add prints to check_mergeable_state 2024-07-15 15:17:16 +02:00
Max K
f7dfa21bff style fixes 2024-07-15 14:39:29 +02:00
Max K
1e6edbd4ae ci buddy message format updates 2024-07-15 14:14:44 +02:00
Max K
31fdfbc737 add fetching exit code if job was killed 2024-07-15 14:10:31 +02:00
Max K
d768251f99 fix handling of skipped build 2024-07-15 13:43:07 +02:00
Raúl Marín
b6b4b046a3 Style 2024-07-15 13:42:00 +02:00
Max K
6f036fad59 CI: Fix ci await function 2024-07-15 13:35:20 +02:00
Raúl Marín
de029e278a Add additional log masking 2024-07-15 13:30:48 +02:00
Max K
f311612e91 check filter_out_not_affected_jobs in unit test 2024-07-15 09:59:23 +02:00
Max K
7ef89f169b CI: Fix for skipping Builds_2 in PRs' CI 2024-07-15 09:26:07 +02:00
Max K
2ddd0078dc rename reusable docker workflow 2024-07-14 21:07:41 +02:00
Max K
5bce8086a8 CI: Create release workflow updates 2024-07-14 19:02:20 +02:00
Max K
9dabf205e6 CI: Fix for await to always await for builds 2024-07-14 14:01:10 +02:00
Max K
f374cdfe69 CI: Fix for job filtering in PRs 2024-07-14 13:53:20 +02:00
Max K
379706d2d5 fix for job filtering 2024-07-14 12:08:53 +02:00
Max K
80c8511004 CI: Add retry for GH set_comment_status call 2024-07-14 11:39:31 +02:00
Alexey Milovidov
4ebd88f64a
Merge pull request #66477 from ClickHouse/ci_strict_job_check
CI: Check job's exit status and report if killed
2024-07-13 20:22:08 +00:00
Max K
09b753ecc5 CI: Check job's exit status and report if killed 2024-07-13 21:13:03 +02:00
Max K
000cd64d60
Merge pull request #66339 from ClickHouse/create_release_wf
Create release workflow
2024-07-13 18:55:47 +00:00
Max K
f9b1f2498a fix 2024-07-13 18:49:23 +02:00
Max K
162d875aee persistent job report path 2024-07-13 18:28:13 +02:00
Max K
d99c56ae8c CI: Autoskip all non-affected jobs in PRs 2024-07-13 17:25:45 +02:00
Max K
578d22ae94 style
Automatic style fix

Automatic style fix
2024-07-13 16:23:46 +02:00
Max K
9f1520ae21 do not autofix if not only black failed 2024-07-13 16:21:40 +02:00
Max K
2cd1a39ff4 style fixes
Automatic style fix
2024-07-13 16:21:33 +02:00
Max K
1050217445 add support for new release branch
Automatic style fix
2024-07-13 16:21:22 +02:00
Max K
99cd83da1f New Create Release workflow 2024-07-13 16:21:22 +02:00
Max K
2ff09bdf18
Merge pull request #66440 from ClickHouse/ci_not_block_on_few_test_failures
CI: Do not block CI on few number of test failures
2024-07-13 12:13:28 +00:00
Max K
b4369bf183
Merge pull request #66468 from ClickHouse/ci_add_digest_config_for_ast
CI: Cache AST fuzzers (run always) jobs
2024-07-13 11:31:48 +00:00
robot-clickhouse
fd9f91c796 Automatic style fix 2024-07-13 11:08:01 +00:00
Max K
11f3e406c6 CI: Cache AST fuzzers (run always) jobs in CI 2024-07-13 12:59:39 +02:00
Max K
8706145c46 fix for not success status in Sync 2024-07-13 12:17:03 +02:00
Max K
04525888f5 fix for failed workflow status 2024-07-13 11:55:25 +02:00
Max K
1495ef3218 CI: Set error status for job with OOM 2024-07-12 20:38:13 +02:00
Max K
5b1e9bebe4 change thresholds 2024-07-12 20:22:05 +02:00
Vitaly Baranov
90142b73ad
Merge pull request #66284 from vitlibar/add-stateless-test-for-grpc
Add a stateless test for gRPC protocol
2024-07-12 17:32:06 +00:00
Max K
8a5088fcc9
Merge pull request #66407 from ClickHouse/ci_skip_pending_jobs_in_prs
CI: Skip pending and not affected jobs from PR workflow run
2024-07-12 16:11:58 +00:00
Max K
05810ec76f do not skip Build_report 2024-07-12 15:40:06 +02:00
Nikita Fomichev
258ae45aa8
Merge pull request #66411 from ClickHouse/fix-hanging-on-gdb
Stateless tests: deal with hang-ups more roughly
2024-07-12 13:25:46 +00:00
Max K
666f5ffaf9 mypy fix 2024-07-12 15:17:51 +02:00
Max Kainov
a3ab1ab5ca CI: Do not block on few number of test failures 2024-07-12 13:12:50 +00:00
robot-clickhouse
ed693da2b0 Automatic style fix 2024-07-12 12:34:25 +00:00
Max K
f9eb0f9efd ci unit test 2024-07-12 14:27:18 +02:00
Max K
a4591a4dc4 CI: Skip pending and not affected jobs from PR workflow run 2024-07-12 14:27:18 +02:00
Max K
b024bb736f CI: CiBuddy to post to salck channel from release branches only 2024-07-12 10:14:41 +02:00
Max K
da741d271f
Merge pull request #66392 from ClickHouse/ci_buddy
CI Buddy bot to notify about CI events
2024-07-12 00:28:46 +00:00
Nikita Fomichev
4a56c601b2 Stateless tests: decrease CI timeout 2024-07-12 01:11:13 +02:00
Max Kainov
6868708a58 CI Buddy bot to notify about CI events 2024-07-11 15:58:56 +00:00
Vitaly Baranov
355a56d1b0 Add a stateless test for gRPC protocol. 2024-07-11 15:36:41 +02:00
Antonio Andelic
1eec1fd77f Merge branch 'master' into collect-core-dumps-stateless 2024-07-10 13:01:41 +02:00
Nikita Fomichev
eeb3561c37 Stateless tests: run sequential tests in parallel to other tests 2024-07-09 19:41:06 +02:00
Antonio Andelic
004d8e0d49 Run privileged 2024-07-09 18:39:21 +02:00
Raúl Marín
3435e25b8a Linter 2024-07-05 16:46:49 +02:00
Raúl Marín
8a1dd3c7c8 Fix download of debug files for BugFix checker 2024-07-05 16:46:49 +02:00
Max K
1641eac819
Merge pull request #66105 from ClickHouse/multiple_sync_pr_fix
CI: Fix sync pr merge
2024-07-05 09:03:31 +00:00
Nikita Mikhaylov
3a7c98399f
Merge pull request #65777 from ClickHouse/make_analyzer_important
Make `allow_experimental_analyzer` be controlled by the initiator for distributed queries
2024-07-04 20:38:40 +00:00
Max K
df0cce24ee CI: Fix sync pr merge 2024-07-04 19:34:47 +02:00
Nikita Mikhaylov
2c37cc048c Style 2024-07-04 11:12:27 +00:00