Commit Graph

3027 Commits

Author SHA1 Message Date
Max K.
8cca8ecb34
Merge pull request #67101 from ClickHouse/ci_mergeable_check_fix
CI: CheckReadyForMerge fixes
2024-08-06 11:08:45 +00:00
Azat Khuzhin
27569815d5 Fix query cache randomization in stress tests
Right now it fails with [1]:

    2024.08.05 12:53:53.659422 [ 3559 ] {123237a2-5f08-47e4-996e-21e20bc4a51a} <Error> executeQuery: Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS) (version 24.8.1.1356) (from [::1]:42534) (in query: SELECT version(), arrayStringConcat(groupArray(value), ' ') FROM system.build_options WHERE name IN ('GIT_HASH', 'GIT_BRANCH') ), Stack trace (when copying this message, always include the lines below):

    Uexpected exception, will not retry:  HTTPError :  Code: 500. Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS) (version 24.8.1.1356)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/67737/e68c9c8d16f37f6c25739076c9b071ed97952269/stress_test__asan_/stress_test_run_10.txt

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-06 11:38:55 +02:00
Raúl Marín
25fa63f7e6 Merge remote-tracking branch 'blessed/master' into unit_test_asan 2024-08-06 11:19:57 +02:00
Alexey Milovidov
8e19f46829
Merge pull request #67706 from ClickHouse/ci_minot_utils_refactoring
CI: Minor refactoring in ci_utils
2024-08-05 21:34:43 +00:00
Max K
529f21c6b8 CI: CheckReadyForMerge fixes 2024-08-05 20:41:16 +02:00
Raúl Marín
a296beb390 Unit test: Mark as FAILURE if retcode != 0 2024-08-05 13:31:53 +02:00
Max K
67bddde628 move Check Descriptions to commit_status_helper 2024-08-05 13:18:37 +02:00
Azat Khuzhin
cdbc4f3573 ci: fail the test if the entrypoint script failed
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-05 11:16:08 +02:00
Alexey Gerasimchuck
e5134e14ea Disabled parallel run 2024-08-05 07:59:51 +00:00
Max K
3dedd8d76b CI: Minor refactoring in ci_utils 2024-08-03 21:19:51 +02:00
Alexey Milovidov
4a10d26eb1
Merge pull request #67696 from ClickHouse/fix-test-reports
Fix check names in test reports and the CI Logs database
2024-08-03 14:55:03 +02:00
robot-clickhouse
a45ba44dba Automatic style fix 2024-08-02 18:28:46 +00:00
Max K
b282be83c5 remove old workflows 2024-08-02 20:26:04 +02:00
Alexey Milovidov
675afda172 Fix check names in the CI Logs database 2024-08-02 20:22:08 +02:00
Alexey Milovidov
bd3606dac4 Fix typos 2024-08-02 20:17:07 +02:00
Alexey Milovidov
2c9b61d047 Miscellaneous 2024-08-02 20:16:44 +02:00
Alexey Milovidov
ce39957983 Remove capitalization in test reports 2024-08-02 20:11:25 +02:00
Max K
cebb366838 more fixes 2024-08-02 18:23:52 +02:00
Raúl Marín
900e08d6e7 Try fix 2024-08-02 11:32:09 +02:00
Max K
e034558f74 add automerge prs step 2024-08-01 21:18:14 +02:00
Max K
30e0c1a1b8 try less mem for geesefs 2024-08-01 20:07:53 +02:00
Raúl Marín
4e9761acf9 Don't run ASAN unit tests under gdb 2024-08-01 18:59:17 +02:00
Max K
4802ea540a improve ci_utils' Shell 2024-08-01 18:07:13 +02:00
Max K
8214910cc7 add geesfs 2024-08-01 18:07:13 +02:00
Max K
c534cd5bc2 changelog.py to retrieve best token
s3fs fix

changelog.py to use base branch to filter prs
2024-08-01 18:07:11 +02:00
Max K
9362d1a566 CI: Create release workflow dry run fix
fix
2024-08-01 18:06:54 +02:00
Raúl Marín
bdf98cbcc0 Fix public backports 2024-07-30 10:06:01 +00:00
Max K.
7b2ec7ea33
Merge pull request #67402 from ClickHouse/ci_build_results_fix
CI: Fix build results for release branches
2024-07-29 19:46:17 +00:00
Max K
fea03cf46f Build results fix 2024-07-29 21:07:24 +02:00
Max K.
7e011fa967
Merge pull request #67075 from ClickHouse/ci_create_release_docker_fix
CI: Docker server build fix for new release workflow
2024-07-29 18:31:34 +00:00
Max K
4417a9ae6f style fix 2024-07-29 16:14:45 +02:00
Max K
fd2dc474a1 docker server fixes 2024-07-29 14:26:02 +02:00
Max K
9f8c90065e Fix docker jobs dependencies 2024-07-29 14:16:20 +02:00
Max K
918feaff9d CI: Fix reuse for release branches 2024-07-29 13:46:23 +02:00
Alexey Milovidov
9c44ceda65
Merge pull request #67327 from ClickHouse/follow-up-67301
Follow-up for #67301
2024-07-29 10:32:42 +00:00
Max K.
80a003f994
Merge pull request #67343 from ClickHouse/ci_check_docker_stdout_commands
CI: Print stdout, stderr for docker pull command
2024-07-29 09:51:38 +00:00
Max K.
37210d29ee
Merge pull request #67104 from ClickHouse/ci_rename_test_stages
CI: Rename Tests_2/3 stages to avoid confusion
2024-07-29 07:58:59 +00:00
Max K
bdcedeb3f0 CI: Add stdout, err for docker pull command 2024-07-29 09:49:18 +02:00
Alexey Milovidov
39de59a605 Follow-up for #67301 2024-07-29 02:11:55 +02:00
Alexey Milovidov
6c0cf76fad
Merge pull request #67301 from ClickHouse/better-test-report
Wrap log lines in the CI report for functional tests
2024-07-28 14:15:27 +00:00
Alexey Milovidov
29b804adf3 Wrap log lines in the CI report for functional tests 2024-07-28 14:01:17 +02:00
Raúl Marín
b23ce171c3 My black version said this was ok 2024-07-25 13:11:32 +00:00
Raúl Marín
2c83a39503 Fixes 2024-07-25 12:53:59 +00:00
Raúl Marín
b80305ba98 Improve backport script 2024-07-25 14:31:00 +02:00
Max K
86e23b346f rename test stages 2024-07-25 12:12:37 +02:00
Ilya Yatsishin
db5b4c0e96
Merge pull request #66986 from qoega/integration-flaky-check-repeat
Add hardening to integration tests flaky check: repeat test case multiple times with same environment.
2024-07-25 08:18:37 +00:00
Yatsishin Ilya
73a0811b75 Merge remote-tracking branch 'origin' into improve-integration-tests-3 2024-07-24 20:29:20 +00:00
Max K
9de43325e4 CI: Jepsen Workflow with CI buddy 2024-07-24 19:51:34 +02:00
Ilya Yatsishin
fe487a11bf Merge remote-tracking branch 'qoega/improve-integration-tests-2' into integration-flaky-check-repeat 2024-07-23 23:57:31 +02:00
Max K
2551f14141 CI: Add messages fro debugging 2024-07-23 20:42:21 +02:00
Max K
c7427e6572 CI: Fixes docker server build for release branches 2024-07-23 17:24:52 +02:00
Ilya Yatsishin
e0a7aa80af Enable repeat for flaky check for more tests hardening 2024-07-23 16:57:07 +02:00
Max K.
3f8b27d7ac
Merge pull request #66920 from ClickHouse/ci_remove_init_runner_scripts_from_oss
CI: Remove ci runners scripts from oss
2024-07-23 11:01:42 +00:00
Max K
bb28a65e98 minor fix for wf status reporting 2024-07-23 11:50:05 +02:00
Max K
b164014bf9 CI: Remove ci runners scripts from oss 2024-07-23 11:00:05 +02:00
Max K
2b56cbc1fd CI: Add ec2 instance lifecycle metadata to CIDB 2024-07-23 09:42:58 +02:00
Max K
fa0f760fd9 CI: CI Buddy to notify about fatal workflow failures 2024-07-22 18:05:13 +02:00
Max K.
217363d9a7
Merge pull request #66868 from ClickHouse/ci_runner_init_print_instance_info
CI: Print instance info in runner's init script
2024-07-22 12:38:00 +00:00
Max K
69ad8feb90 add instance type 2024-07-22 13:38:10 +02:00
Max K
cd700c59b1 minor fix 2024-07-22 13:17:25 +02:00
Max K
e708219f6a CI: Print instance info in runner's init script 2024-07-22 13:01:27 +02:00
Max K
dd9fe61d1a CI: New Release workflow updates and fixes 2024-07-21 21:21:39 +02:00
Max K.
08db9fb8f1
Merge pull request #66593 from ClickHouse/autorelease_poc
CI: POC for Auto Releases
2024-07-21 15:03:11 +00:00
Max K
d83428daaf fix in ci unittests 2024-07-21 14:52:33 +02:00
Max K
02bf9e4243 push pending records before await call 2024-07-21 12:53:07 +02:00
Max K
08353419d0 CI: Never await on BuildReport job, Skip BuildReport if no builds in workflow 2024-07-21 11:50:15 +02:00
Alexey Milovidov
ccbbe8d0af
Merge pull request #66705 from azat/ci/dump-dmesg
ci: dump dmesg in case of OOM
2024-07-21 05:24:50 +00:00
Max K
3767f72348 more info for buddy 2024-07-20 19:05:28 +02:00
Max Kainov
5d09f205e5 style fixes 2024-07-20 14:42:53 +02:00
Max K
3de472cedc add buddy, move release into action.yml
try callable wf

fix

add ci buddy
2024-07-20 14:42:50 +02:00
Max K
e3b2fbf7ec CI: POC for Auto Releases 2024-07-20 14:42:49 +02:00
Nikita Fomichev
53249a2ad1
Merge pull request #66783 from ClickHouse/tavplubix-patch-14
Update ci_config.py
2024-07-20 10:12:38 +00:00
Nikita Fomichev
fa2659a87c Increase CI timeout for stateless tests 2024-07-19 20:10:08 +02:00
Nikita Fomichev
00e14bde80 Update ci_config.py 2024-07-19 20:09:46 +02:00
Alexander Tokmakov
e57a10189c
Update ci_config.py 2024-07-19 19:09:51 +02:00
Max K.
6200cf364c
Merge pull request #66744 from ClickHouse/ci_build_include_fix
CI: Next fix for builds in CI workflow
2024-07-19 17:08:53 +00:00
Nikita Fomichev
3d00badef7
Merge pull request #66520 from ClickHouse/fix-tests-oom
Stateless tests: improvements related to OOM of test runs
2024-07-19 14:36:08 +00:00
Max K
983d2b474b CI: Next fix for builds in CI workflow 2024-07-19 12:44:31 +02:00
Max K.
a07707c56e
Merge pull request #66651 from ClickHouse/ci_remove_lambdas_from_oss
CI: Remove aws lambda packages from oss
2024-07-19 10:10:26 +00:00
Max K.
9f16c2abbc
Merge branch 'master' into ci/dump-dmesg 2024-07-19 09:54:53 +02:00
Max K
09141163b4 remove lambda unit tests 2024-07-18 23:45:52 +02:00
Max K.
2e1f00dd97
Merge pull request #66726 from ClickHouse/ci_mergeable_check_fixes
CI: Fix issue with a skipped Build report
2024-07-18 20:37:35 +00:00
Nikita Fomichev
bd10951db8 Stateless tests: tune MAX_RUN_TIME 2024-07-18 21:50:21 +02:00
Max K
465e4ad73f CI: Remove aws lambda packages from oss 2024-07-18 20:58:43 +02:00
Max K.
10fb524e73
Merge pull request #66533 from ClickHouse/ci_report_job_start_and_finish_to_db
CI: Report job start and finish to CI DB
2024-07-18 18:20:47 +00:00
Max K
4249d869a9 fix tests 2024-07-18 19:48:13 +02:00
Max K
9eba5975d8 CI: Fix issue with a skipped Build report 2024-07-18 19:08:46 +02:00
Azat Khuzhin
959ac9a768 ci: dump dmesg in case of OOM
Without additional info it is unclear how to tune paralelism or maybe
split some modules.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-07-18 13:17:09 +02:00
Max K.
a5746d8145
Merge pull request #66513 from ClickHouse/ci_tests_3_block_fix
CI: Do not block Tests_3 unless MAX_FAILED_TESTS exceeded
2024-07-17 18:16:07 +00:00
Max K.
c7e0aa5671
Merge pull request #66622 from ClickHouse/ci_try_decreasing_asg_from_terminating_runners
CI: Scale down AutoScaling Groups from runners
2024-07-17 16:49:30 +00:00
Alexey Milovidov
6af5f44175
Merge pull request #66561 from XuJia0210/update-trusted-contributors
update trusted contributors
2024-07-17 16:20:39 +00:00
robot-clickhouse
c40473ff80 Automatic style fix 2024-07-17 10:51:00 +00:00
Max K
2958803255 do not decrease from lambda 2024-07-17 12:38:52 +02:00
Yakov Olkhovskiy
f07a395bf1 Merge branch 'master' into ci-fuzzer-enable 2024-07-17 03:43:57 +00:00
Max K
a1a802cee9 fix deployment script 2024-07-17 01:13:42 +02:00
Max K
5ca7241865 CI: AWS ASG decrease capacity from runners 2024-07-17 00:23:14 +02:00
Alexey Milovidov
ae93cceb9e
Merge pull request #66592 from ClickHouse/very_important_fix
Fix bsdtar for @nikitamikhaylov
2024-07-16 21:23:31 +00:00
Max K
db7fb78a04 major fix 2024-07-16 21:28:35 +02:00
Max K
2af361eb14 minor fix 2024-07-16 16:18:41 +02:00
Yakov Olkhovskiy
9690a5a334 fix 2024-07-16 13:37:59 +00:00
alesapin
630a29f537 Fix bsdtar for @nikitamikhaylov 2024-07-16 15:11:17 +02:00
Max K
a9b8c2a29a CI: Do not block Tests_3 unless MAX_TOTAL_FAILURES_PER_JOB_BEFORE_BLOCKING_CI 2024-07-16 11:06:09 +02:00
Alexey Milovidov
1d2f3a1ed5
Update pr.py 2024-07-16 05:56:26 +02:00
Xu Jia
5d96b684a6 update format 2024-07-16 11:31:27 +08:00
Alexey Milovidov
2c62a6b528
Update pr.py 2024-07-16 05:10:26 +02:00
Xu Jia
26f8b81081 update trusted contributors 2024-07-16 10:54:00 +08:00
Yakov Olkhovskiy
60caa20eb7
Merge pull request #66551 from ClickHouse/ci-libfuz-docker
Add dedicated runner to libfuzzer, update docker
2024-07-15 20:18:45 +00:00
Yakov Olkhovskiy
0176e0b2ae fix 2024-07-15 19:27:54 +00:00
Yakov Olkhovskiy
5361ade8e7 optimize 2024-07-15 19:10:07 +00:00
Max K.
93ef3aa7da
Merge pull request #66498 from ClickHouse/ci_create_release_workflow_updates
CI: Create release workflow updates
2024-07-15 18:42:52 +00:00
Max K
5fc4fada61 add info about previous release 2024-07-15 19:30:23 +02:00
robot-clickhouse
97c9739abc Automatic style fix 2024-07-15 17:21:59 +00:00
Yakov Olkhovskiy
50f068efe9 add dedicated runner to libfuzzer, update docker 2024-07-15 17:00:53 +00:00
Max K
d4e7188750 CI: Report job start and finish to CI DB 2024-07-15 17:46:24 +02:00
Raúl Marín
ebb5d61535
Merge pull request #66523 from Algunenano/mask_azure
Add additional log masking in CI
2024-07-15 15:31:53 +00:00
Max K
43b3a133e9 add prints to check_mergeable_state 2024-07-15 15:17:16 +02:00
Max K
f7dfa21bff style fixes 2024-07-15 14:39:29 +02:00
Max K
1e6edbd4ae ci buddy message format updates 2024-07-15 14:14:44 +02:00
Max K
31fdfbc737 add fetching exit code if job was killed 2024-07-15 14:10:31 +02:00
Max K
d768251f99 fix handling of skipped build 2024-07-15 13:43:07 +02:00
Raúl Marín
b6b4b046a3 Style 2024-07-15 13:42:00 +02:00
Max K
6f036fad59 CI: Fix ci await function 2024-07-15 13:35:20 +02:00
Raúl Marín
de029e278a Add additional log masking 2024-07-15 13:30:48 +02:00
Max K
f311612e91 check filter_out_not_affected_jobs in unit test 2024-07-15 09:59:23 +02:00
Max K
7ef89f169b CI: Fix for skipping Builds_2 in PRs' CI 2024-07-15 09:26:07 +02:00
Max K
2ddd0078dc rename reusable docker workflow 2024-07-14 21:07:41 +02:00
Max K
5bce8086a8 CI: Create release workflow updates 2024-07-14 19:02:20 +02:00
Max K
9dabf205e6 CI: Fix for await to always await for builds 2024-07-14 14:01:10 +02:00
Max K
f374cdfe69 CI: Fix for job filtering in PRs 2024-07-14 13:53:20 +02:00
Max K
379706d2d5 fix for job filtering 2024-07-14 12:08:53 +02:00
Max K
80c8511004 CI: Add retry for GH set_comment_status call 2024-07-14 11:39:31 +02:00
Alexey Milovidov
4ebd88f64a
Merge pull request #66477 from ClickHouse/ci_strict_job_check
CI: Check job's exit status and report if killed
2024-07-13 20:22:08 +00:00
Max K
09b753ecc5 CI: Check job's exit status and report if killed 2024-07-13 21:13:03 +02:00
Max K
000cd64d60
Merge pull request #66339 from ClickHouse/create_release_wf
Create release workflow
2024-07-13 18:55:47 +00:00
Max K
f9b1f2498a fix 2024-07-13 18:49:23 +02:00
Max K
162d875aee persistent job report path 2024-07-13 18:28:13 +02:00
Max K
d99c56ae8c CI: Autoskip all non-affected jobs in PRs 2024-07-13 17:25:45 +02:00
Max K
578d22ae94 style
Automatic style fix

Automatic style fix
2024-07-13 16:23:46 +02:00
Max K
9f1520ae21 do not autofix if not only black failed 2024-07-13 16:21:40 +02:00
Max K
2cd1a39ff4 style fixes
Automatic style fix
2024-07-13 16:21:33 +02:00
Max K
1050217445 add support for new release branch
Automatic style fix
2024-07-13 16:21:22 +02:00
Max K
99cd83da1f New Create Release workflow 2024-07-13 16:21:22 +02:00
Max K
2ff09bdf18
Merge pull request #66440 from ClickHouse/ci_not_block_on_few_test_failures
CI: Do not block CI on few number of test failures
2024-07-13 12:13:28 +00:00
Max K
b4369bf183
Merge pull request #66468 from ClickHouse/ci_add_digest_config_for_ast
CI: Cache AST fuzzers (run always) jobs
2024-07-13 11:31:48 +00:00
robot-clickhouse
fd9f91c796 Automatic style fix 2024-07-13 11:08:01 +00:00
Max K
11f3e406c6 CI: Cache AST fuzzers (run always) jobs in CI 2024-07-13 12:59:39 +02:00
Max K
8706145c46 fix for not success status in Sync 2024-07-13 12:17:03 +02:00
Max K
04525888f5 fix for failed workflow status 2024-07-13 11:55:25 +02:00
Max K
1495ef3218 CI: Set error status for job with OOM 2024-07-12 20:38:13 +02:00
Max K
5b1e9bebe4 change thresholds 2024-07-12 20:22:05 +02:00