Commit Graph

3067 Commits

Author SHA1 Message Date
Max Kainov
a42b12725a CI: Native build for package_aarch64 2024-08-17 18:53:43 +02:00
Max Kainov
5ff4d990e1 CI: Auto Releases in prod 2024-08-16 12:34:54 +02:00
Ilya Yatsishin
7c691cbb79 style 2024-08-16 10:44:11 +02:00
Ilya Yatsishin
1d2aa037b8 Merge remote-tracking branch 'origin/master' into improve-integration-tests-5 2024-08-15 18:48:10 +02:00
Yatsishin Ilya
d31b36ca50 Rework integration flaky check as it was timeouting too fast as run as a single group 2024-08-15 07:16:01 +00:00
Max Kainov
5e037e5ba8 CI: Minor fixes for changelog and release exceptions 2024-08-14 20:45:50 +02:00
Max Kainov
962bf1d821 CI: Fix for critical bug fix regex 2024-08-14 13:37:14 +02:00
Max K.
a51f867ce0
Merge pull request #68294 from ClickHouse/ci_create_new_release_branch
CI: Create new release branch workflow updates
2024-08-14 10:01:47 +00:00
Max Kainov
0c9e1a061f CI: Create new release branch workflow updates 2024-08-14 00:14:13 +02:00
Yakov Olkhovskiy
3e8a177622
Merge pull request #61908 from ClickHouse/ci-fuzzer-enable
CI: enable libfuzzer (fixing build and docker)
2024-08-13 14:22:09 +00:00
János Benjamin Antal
ac6826392d
Merge pull request #67554 from ClickHouse/fix-message-queue-sink-from-http-interface
Fix message queue sink from http interface
2024-08-12 21:29:14 +00:00
János Benjamin Antal
6cde029ed9 Fix style 2024-08-12 13:48:44 +00:00
János Benjamin Antal
34643ee16c Run test only from modified files 2024-08-12 13:30:25 +00:00
Robert Schulze
037a1006fd
Merge remote-tracking branch 'ClickHouse/master' into ci-fuzzer-enable 2024-08-12 12:28:32 +00:00
János Benjamin Antal
613ebe367c Only add extra cell when necessary 2024-08-10 22:05:11 +00:00
Nikita Fomichev
4a31ccd653
Merge pull request #68013 from ClickHouse/pass-job-timeout-to-tests
CI: Pass job timeout into tests config
2024-08-10 10:38:41 +00:00
János Benjamin Antal
8cf5f6d616 Add empty cell to reports when time is missing 2024-08-09 13:20:05 +00:00
Max K.
706144a4ba
Merge pull request #68022 from ClickHouse/ci_pr_filter_job_fix
CI: Fix for filtering jobs in PRs
2024-08-08 09:19:26 +00:00
Nikita Fomichev
59b737c9ac CI: set correct timeout for stateless tests 2024-08-08 10:50:14 +02:00
Max K.
01b6d4043b
Merge pull request #67978 from ClickHouse/ci_integration_tests_uncover_logs
CI: Integration tests uncover some logging
2024-08-08 08:45:23 +00:00
Max K.
beb43734ae
Merge pull request #67898 from ClickHouse/ci_mergeable_check_fix_2
CI: Fix for setting Mergeable Check from sync
2024-08-08 08:20:01 +00:00
Max Kainov
59a63cd110 CI: Fix for filtering jobs in PRs 2024-08-08 09:56:31 +02:00
Nikita Fomichev
55ad7d3094 Fix stylelint 2024-08-08 00:08:12 +02:00
Nikita Fomichev
086b3d240d CI: push CI 2024-08-07 23:34:36 +02:00
Nikita Fomichev
1dece979fe CI: pass job timout into tests 2024-08-07 23:22:05 +02:00
Alexey Milovidov
8b3e85dd8d
Merge pull request #67785 from arenadata/ADQM-FixedTestRaceCondition
Fixed session_log related tests race condition on logout
2024-08-07 20:01:48 +00:00
Yakov Olkhovskiy
b246f7c17c merge master 2024-08-07 16:25:31 +00:00
Max K.
ebc4ef393b
Merge pull request #67986 from ClickHouse/revert-67934-ci_strict_job_timeout
Revert "CI: Strict job timeout 1.5h for tests, 2h for builds"
2024-08-07 14:33:16 +00:00
Max K.
b8fec3bce4
Merge pull request #67923 from ClickHouse/ci_buddy_with_channel_dispatcher
CI: CiBuddy with channel dispatcher
2024-08-07 14:21:02 +00:00
Max K.
9a812fc535
Revert "CI: Strict job timeout 1.5h for tests, 2h for builds" 2024-08-07 15:55:03 +02:00
Max Kainov
016d1fea6d CI: Integration tests uncover some logging 2024-08-07 13:58:03 +02:00
Raúl Marín
c9340cba32
Merge pull request #67622 from Algunenano/unit_test_asan
Don't run ASAN unit tests under gdb
2024-08-07 10:48:00 +00:00
Alexey Milovidov
65297524de
Merge pull request #67934 from ClickHouse/ci_strict_job_timeout
CI: Strict job timeout 1.5h for tests, 2h for builds
2024-08-06 22:50:39 +00:00
Max K.
a15fb8be75
Merge pull request #67919 from ClickHouse/ci_no_critical_bug_fix_in_changleog
CI: Changelog: Critical Bug Fix to Bug Fix
2024-08-06 20:11:55 +00:00
Robert Schulze
4cdb6db1b7
Merge pull request #67855 from azat/ci/fix-use_query_cache-stressing
Fix query cache randomization in stress tests
2024-08-06 17:59:10 +00:00
Max Kainov
f0fdba3bbe CI: Strict job timeout 1.5h for tests, 2h for builds 2024-08-06 19:02:49 +02:00
robot-clickhouse
e1e298f14e Automatic style fix 2024-08-06 14:57:04 +00:00
Max Kainov
f2591bd1a6 CI: CiBuddy with channel dispatcher 2024-08-06 16:55:04 +02:00
Max Kainov
dbcc5cf133 CI: Changelog: Critical Bug Fix to Bug Fix 2024-08-06 15:39:08 +02:00
Max Kainov
913b902864 CI: Fix for setting Mergeable Check from sync 2024-08-06 14:11:37 +02:00
Max K.
8cca8ecb34
Merge pull request #67101 from ClickHouse/ci_mergeable_check_fix
CI: CheckReadyForMerge fixes
2024-08-06 11:08:45 +00:00
Azat Khuzhin
27569815d5 Fix query cache randomization in stress tests
Right now it fails with [1]:

    2024.08.05 12:53:53.659422 [ 3559 ] {123237a2-5f08-47e4-996e-21e20bc4a51a} <Error> executeQuery: Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS) (version 24.8.1.1356) (from [::1]:42534) (in query: SELECT version(), arrayStringConcat(groupArray(value), ' ') FROM system.build_options WHERE name IN ('GIT_HASH', 'GIT_BRANCH') ), Stack trace (when copying this message, always include the lines below):

    Uexpected exception, will not retry:  HTTPError :  Code: 500. Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS) (version 24.8.1.1356)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/67737/e68c9c8d16f37f6c25739076c9b071ed97952269/stress_test__asan_/stress_test_run_10.txt

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-06 11:38:55 +02:00
Raúl Marín
25fa63f7e6 Merge remote-tracking branch 'blessed/master' into unit_test_asan 2024-08-06 11:19:57 +02:00
Alexey Milovidov
8e19f46829
Merge pull request #67706 from ClickHouse/ci_minot_utils_refactoring
CI: Minor refactoring in ci_utils
2024-08-05 21:34:43 +00:00
Max K
529f21c6b8 CI: CheckReadyForMerge fixes 2024-08-05 20:41:16 +02:00
Raúl Marín
a296beb390 Unit test: Mark as FAILURE if retcode != 0 2024-08-05 13:31:53 +02:00
Max K
67bddde628 move Check Descriptions to commit_status_helper 2024-08-05 13:18:37 +02:00
Azat Khuzhin
cdbc4f3573 ci: fail the test if the entrypoint script failed
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-05 11:16:08 +02:00
Alexey Gerasimchuck
e5134e14ea Disabled parallel run 2024-08-05 07:59:51 +00:00
Max K
3dedd8d76b CI: Minor refactoring in ci_utils 2024-08-03 21:19:51 +02:00
Alexey Milovidov
4a10d26eb1
Merge pull request #67696 from ClickHouse/fix-test-reports
Fix check names in test reports and the CI Logs database
2024-08-03 14:55:03 +02:00
robot-clickhouse
a45ba44dba Automatic style fix 2024-08-02 18:28:46 +00:00
Max K
b282be83c5 remove old workflows 2024-08-02 20:26:04 +02:00
Alexey Milovidov
675afda172 Fix check names in the CI Logs database 2024-08-02 20:22:08 +02:00
Alexey Milovidov
bd3606dac4 Fix typos 2024-08-02 20:17:07 +02:00
Alexey Milovidov
2c9b61d047 Miscellaneous 2024-08-02 20:16:44 +02:00
Alexey Milovidov
ce39957983 Remove capitalization in test reports 2024-08-02 20:11:25 +02:00
Max K
cebb366838 more fixes 2024-08-02 18:23:52 +02:00
Raúl Marín
900e08d6e7 Try fix 2024-08-02 11:32:09 +02:00
Max K
e034558f74 add automerge prs step 2024-08-01 21:18:14 +02:00
Max K
30e0c1a1b8 try less mem for geesefs 2024-08-01 20:07:53 +02:00
Raúl Marín
4e9761acf9 Don't run ASAN unit tests under gdb 2024-08-01 18:59:17 +02:00
Max K
4802ea540a improve ci_utils' Shell 2024-08-01 18:07:13 +02:00
Max K
8214910cc7 add geesfs 2024-08-01 18:07:13 +02:00
Max K
c534cd5bc2 changelog.py to retrieve best token
s3fs fix

changelog.py to use base branch to filter prs
2024-08-01 18:07:11 +02:00
Max K
9362d1a566 CI: Create release workflow dry run fix
fix
2024-08-01 18:06:54 +02:00
Raúl Marín
bdf98cbcc0 Fix public backports 2024-07-30 10:06:01 +00:00
Max K.
7b2ec7ea33
Merge pull request #67402 from ClickHouse/ci_build_results_fix
CI: Fix build results for release branches
2024-07-29 19:46:17 +00:00
Max K
fea03cf46f Build results fix 2024-07-29 21:07:24 +02:00
Max K.
7e011fa967
Merge pull request #67075 from ClickHouse/ci_create_release_docker_fix
CI: Docker server build fix for new release workflow
2024-07-29 18:31:34 +00:00
Max K
4417a9ae6f style fix 2024-07-29 16:14:45 +02:00
Max K
fd2dc474a1 docker server fixes 2024-07-29 14:26:02 +02:00
Max K
9f8c90065e Fix docker jobs dependencies 2024-07-29 14:16:20 +02:00
Max K
918feaff9d CI: Fix reuse for release branches 2024-07-29 13:46:23 +02:00
Alexey Milovidov
9c44ceda65
Merge pull request #67327 from ClickHouse/follow-up-67301
Follow-up for #67301
2024-07-29 10:32:42 +00:00
Max K.
80a003f994
Merge pull request #67343 from ClickHouse/ci_check_docker_stdout_commands
CI: Print stdout, stderr for docker pull command
2024-07-29 09:51:38 +00:00
Max K.
37210d29ee
Merge pull request #67104 from ClickHouse/ci_rename_test_stages
CI: Rename Tests_2/3 stages to avoid confusion
2024-07-29 07:58:59 +00:00
Max K
bdcedeb3f0 CI: Add stdout, err for docker pull command 2024-07-29 09:49:18 +02:00
Alexey Milovidov
39de59a605 Follow-up for #67301 2024-07-29 02:11:55 +02:00
Alexey Milovidov
6c0cf76fad
Merge pull request #67301 from ClickHouse/better-test-report
Wrap log lines in the CI report for functional tests
2024-07-28 14:15:27 +00:00
Alexey Milovidov
29b804adf3 Wrap log lines in the CI report for functional tests 2024-07-28 14:01:17 +02:00
Raúl Marín
b23ce171c3 My black version said this was ok 2024-07-25 13:11:32 +00:00
Raúl Marín
2c83a39503 Fixes 2024-07-25 12:53:59 +00:00
Raúl Marín
b80305ba98 Improve backport script 2024-07-25 14:31:00 +02:00
Max K
86e23b346f rename test stages 2024-07-25 12:12:37 +02:00
Ilya Yatsishin
db5b4c0e96
Merge pull request #66986 from qoega/integration-flaky-check-repeat
Add hardening to integration tests flaky check: repeat test case multiple times with same environment.
2024-07-25 08:18:37 +00:00
Yatsishin Ilya
73a0811b75 Merge remote-tracking branch 'origin' into improve-integration-tests-3 2024-07-24 20:29:20 +00:00
Max K
9de43325e4 CI: Jepsen Workflow with CI buddy 2024-07-24 19:51:34 +02:00
Ilya Yatsishin
fe487a11bf Merge remote-tracking branch 'qoega/improve-integration-tests-2' into integration-flaky-check-repeat 2024-07-23 23:57:31 +02:00
Max K
2551f14141 CI: Add messages fro debugging 2024-07-23 20:42:21 +02:00
Max K
c7427e6572 CI: Fixes docker server build for release branches 2024-07-23 17:24:52 +02:00
Ilya Yatsishin
e0a7aa80af Enable repeat for flaky check for more tests hardening 2024-07-23 16:57:07 +02:00
Max K.
3f8b27d7ac
Merge pull request #66920 from ClickHouse/ci_remove_init_runner_scripts_from_oss
CI: Remove ci runners scripts from oss
2024-07-23 11:01:42 +00:00
Max K
bb28a65e98 minor fix for wf status reporting 2024-07-23 11:50:05 +02:00
Max K
b164014bf9 CI: Remove ci runners scripts from oss 2024-07-23 11:00:05 +02:00
Max K
2b56cbc1fd CI: Add ec2 instance lifecycle metadata to CIDB 2024-07-23 09:42:58 +02:00
Max K
fa0f760fd9 CI: CI Buddy to notify about fatal workflow failures 2024-07-22 18:05:13 +02:00
Max K.
217363d9a7
Merge pull request #66868 from ClickHouse/ci_runner_init_print_instance_info
CI: Print instance info in runner's init script
2024-07-22 12:38:00 +00:00
Max K
69ad8feb90 add instance type 2024-07-22 13:38:10 +02:00
Max K
cd700c59b1 minor fix 2024-07-22 13:17:25 +02:00
Max K
e708219f6a CI: Print instance info in runner's init script 2024-07-22 13:01:27 +02:00
Max K
dd9fe61d1a CI: New Release workflow updates and fixes 2024-07-21 21:21:39 +02:00
Max K.
08db9fb8f1
Merge pull request #66593 from ClickHouse/autorelease_poc
CI: POC for Auto Releases
2024-07-21 15:03:11 +00:00
Max K
d83428daaf fix in ci unittests 2024-07-21 14:52:33 +02:00
Max K
02bf9e4243 push pending records before await call 2024-07-21 12:53:07 +02:00
Max K
08353419d0 CI: Never await on BuildReport job, Skip BuildReport if no builds in workflow 2024-07-21 11:50:15 +02:00
Alexey Milovidov
ccbbe8d0af
Merge pull request #66705 from azat/ci/dump-dmesg
ci: dump dmesg in case of OOM
2024-07-21 05:24:50 +00:00
Max K
3767f72348 more info for buddy 2024-07-20 19:05:28 +02:00
Max Kainov
5d09f205e5 style fixes 2024-07-20 14:42:53 +02:00
Max K
3de472cedc add buddy, move release into action.yml
try callable wf

fix

add ci buddy
2024-07-20 14:42:50 +02:00
Max K
e3b2fbf7ec CI: POC for Auto Releases 2024-07-20 14:42:49 +02:00
Nikita Fomichev
53249a2ad1
Merge pull request #66783 from ClickHouse/tavplubix-patch-14
Update ci_config.py
2024-07-20 10:12:38 +00:00
Nikita Fomichev
fa2659a87c Increase CI timeout for stateless tests 2024-07-19 20:10:08 +02:00
Nikita Fomichev
00e14bde80 Update ci_config.py 2024-07-19 20:09:46 +02:00
Alexander Tokmakov
e57a10189c
Update ci_config.py 2024-07-19 19:09:51 +02:00
Max K.
6200cf364c
Merge pull request #66744 from ClickHouse/ci_build_include_fix
CI: Next fix for builds in CI workflow
2024-07-19 17:08:53 +00:00
Nikita Fomichev
3d00badef7
Merge pull request #66520 from ClickHouse/fix-tests-oom
Stateless tests: improvements related to OOM of test runs
2024-07-19 14:36:08 +00:00
Max K
983d2b474b CI: Next fix for builds in CI workflow 2024-07-19 12:44:31 +02:00
Max K.
a07707c56e
Merge pull request #66651 from ClickHouse/ci_remove_lambdas_from_oss
CI: Remove aws lambda packages from oss
2024-07-19 10:10:26 +00:00
Max K.
9f16c2abbc
Merge branch 'master' into ci/dump-dmesg 2024-07-19 09:54:53 +02:00
Max K
09141163b4 remove lambda unit tests 2024-07-18 23:45:52 +02:00
Max K.
2e1f00dd97
Merge pull request #66726 from ClickHouse/ci_mergeable_check_fixes
CI: Fix issue with a skipped Build report
2024-07-18 20:37:35 +00:00
Nikita Fomichev
bd10951db8 Stateless tests: tune MAX_RUN_TIME 2024-07-18 21:50:21 +02:00
Max K
465e4ad73f CI: Remove aws lambda packages from oss 2024-07-18 20:58:43 +02:00
Max K.
10fb524e73
Merge pull request #66533 from ClickHouse/ci_report_job_start_and_finish_to_db
CI: Report job start and finish to CI DB
2024-07-18 18:20:47 +00:00
Max K
4249d869a9 fix tests 2024-07-18 19:48:13 +02:00
Max K
9eba5975d8 CI: Fix issue with a skipped Build report 2024-07-18 19:08:46 +02:00
Azat Khuzhin
959ac9a768 ci: dump dmesg in case of OOM
Without additional info it is unclear how to tune paralelism or maybe
split some modules.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-07-18 13:17:09 +02:00
Max K.
a5746d8145
Merge pull request #66513 from ClickHouse/ci_tests_3_block_fix
CI: Do not block Tests_3 unless MAX_FAILED_TESTS exceeded
2024-07-17 18:16:07 +00:00
Max K.
c7e0aa5671
Merge pull request #66622 from ClickHouse/ci_try_decreasing_asg_from_terminating_runners
CI: Scale down AutoScaling Groups from runners
2024-07-17 16:49:30 +00:00
Alexey Milovidov
6af5f44175
Merge pull request #66561 from XuJia0210/update-trusted-contributors
update trusted contributors
2024-07-17 16:20:39 +00:00
robot-clickhouse
c40473ff80 Automatic style fix 2024-07-17 10:51:00 +00:00
Max K
2958803255 do not decrease from lambda 2024-07-17 12:38:52 +02:00
Yakov Olkhovskiy
f07a395bf1 Merge branch 'master' into ci-fuzzer-enable 2024-07-17 03:43:57 +00:00
Max K
a1a802cee9 fix deployment script 2024-07-17 01:13:42 +02:00
Max K
5ca7241865 CI: AWS ASG decrease capacity from runners 2024-07-17 00:23:14 +02:00
Alexey Milovidov
ae93cceb9e
Merge pull request #66592 from ClickHouse/very_important_fix
Fix bsdtar for @nikitamikhaylov
2024-07-16 21:23:31 +00:00
Max K
db7fb78a04 major fix 2024-07-16 21:28:35 +02:00
Max K
2af361eb14 minor fix 2024-07-16 16:18:41 +02:00
Yakov Olkhovskiy
9690a5a334 fix 2024-07-16 13:37:59 +00:00
alesapin
630a29f537 Fix bsdtar for @nikitamikhaylov 2024-07-16 15:11:17 +02:00
Max K
a9b8c2a29a CI: Do not block Tests_3 unless MAX_TOTAL_FAILURES_PER_JOB_BEFORE_BLOCKING_CI 2024-07-16 11:06:09 +02:00
Alexey Milovidov
1d2f3a1ed5
Update pr.py 2024-07-16 05:56:26 +02:00
Xu Jia
5d96b684a6 update format 2024-07-16 11:31:27 +08:00
Alexey Milovidov
2c62a6b528
Update pr.py 2024-07-16 05:10:26 +02:00
Xu Jia
26f8b81081 update trusted contributors 2024-07-16 10:54:00 +08:00
Yakov Olkhovskiy
60caa20eb7
Merge pull request #66551 from ClickHouse/ci-libfuz-docker
Add dedicated runner to libfuzzer, update docker
2024-07-15 20:18:45 +00:00
Yakov Olkhovskiy
0176e0b2ae fix 2024-07-15 19:27:54 +00:00
Yakov Olkhovskiy
5361ade8e7 optimize 2024-07-15 19:10:07 +00:00
Max K.
93ef3aa7da
Merge pull request #66498 from ClickHouse/ci_create_release_workflow_updates
CI: Create release workflow updates
2024-07-15 18:42:52 +00:00