Mikhail f. Shiryaev
76911c9fca
Add ci_config.StatusNames class for common statuses
2024-04-24 17:31:15 +02:00
Mikhail f. Shiryaev
2ba5b7fd23
Refactor labels in CI, move them to shared package
2024-04-24 17:31:14 +02:00
alesapin
68ff44259e
Merge branch 'ci_add_azure_tests' of github.com:ClickHouse/ClickHouse into ci_add_azure_tests
2024-04-24 17:31:05 +02:00
alesapin
231f35f785
Add real azure
2024-04-24 17:30:47 +02:00
alesapin
4210c34f94
Merge branch 'master' into ci_add_azure_tests
2024-04-24 17:26:05 +02:00
Mikhail f. Shiryaev
13dca8c5c6
Merge pull request #62835 from ClickHouse/style-autofix
...
Get rid of merge_commit in style check autofix
2024-04-23 11:12:51 +00:00
robot-clickhouse
19dbc8d2e2
Automatic style fix
2024-04-22 10:39:56 +00:00
Mikhail f. Shiryaev
0811124d7d
Add description to the commit status on failed autofix
2024-04-22 12:29:30 +02:00
Mikhail f. Shiryaev
a39baf84cf
Get rid of merge_commit in style check autofix
2024-04-22 12:03:51 +02:00
Mikhail f. Shiryaev
48a4c40549
Merge pull request #62786 from ClickHouse/tiny-ci-improvements
...
Tiny CI improvements
2024-04-19 19:19:39 +00:00
Mikhail f. Shiryaev
8e2ba01600
Merge pull request #62651 from ClickHouse/get-job-id-fallback
...
Do not fail job on failed get_job_id_url
2024-04-19 14:45:59 +00:00
Mikhail f. Shiryaev
c9e41251a6
Fail build_report jobs on non-success statuses
2024-04-19 14:31:54 +02:00
Mikhail f. Shiryaev
eb23de3561
Fail the build reports on non-success status to restart on the next attempt
2024-04-19 11:59:15 +02:00
Mikhail f. Shiryaev
58bf18999d
Add isort configuration to not spoil imports
2024-04-19 11:43:33 +02:00
Mikhail f. Shiryaev
20ae9fdf6b
Add forgotten "raise" on non-safe GITHUB_JOB_URL
2024-04-19 10:58:47 +02:00
Mikhail f. Shiryaev
5c4c2c16dd
Convert PRInfo.is_* to properties
2024-04-17 22:23:41 +02:00
Mikhail f. Shiryaev
6b09b1f897
Use GitHub in ci.py
2024-04-17 22:07:25 +02:00
Smita Kulkarni
d1a81e718c
Merge branch 'master' into ci_add_azure_tests
2024-04-17 14:26:41 +02:00
Alexander Sapin
1e1f35fac0
Try release job
2024-04-16 10:35:18 +02:00
Alexey Milovidov
e65dc63609
Merge branch 'master' into rust_vendor
2024-04-16 10:10:34 +02:00
Robert Schulze
7dc05d092b
Merge remote-tracking branch 'rschu1ze/master' into be-less-boring-32
2024-04-15 16:35:10 +00:00
Mikhail f. Shiryaev
9cbfcf4763
Do not fail job on failed get_job_id_url
2024-04-15 14:38:49 +02:00
Raúl Marín
69245545fa
Merge branch 'master' into rust_vendor
2024-04-15 10:57:01 +01:00
Mikhail f. Shiryaev
ed2e4e3f49
Merge pull request #62556 from ClickHouse/fix-integration-logs-compression
...
Fix integration-tests logs compression
2024-04-12 14:54:11 +00:00
Max K
707c43d17a
Merge branch 'master' into ci_fast_t_in_mq
2024-04-12 13:20:50 +00:00
Max Kainov
3f10530c28
remove A sync check from MQ for a while
2024-04-12 11:36:19 +00:00
Max Kainov
0d2e0e3131
CI: MQ sync status check fix
2024-04-12 11:11:49 +00:00
Max Kainov
e2acd0e93f
CI: add FT to MQ remove Style from master
2024-04-12 10:29:46 +00:00
Alexey Milovidov
164a8d6097
Merge branch 'master' into clang-18-ci
2024-04-12 03:49:10 +02:00
Raúl Marín
aa09876220
Merge remote-tracking branch 'blessed/master' into rust_vendor
2024-04-11 18:52:28 +02:00
Max Kainov
252d2a05a6
fix unittest
2024-04-11 16:27:25 +00:00
Max Kainov
e8f616e80b
CI: fix for sync check status in mq
2024-04-11 15:55:25 +00:00
Max Kainov
45258bc565
CI: Add tests with Azure storage
2024-04-11 14:50:18 +00:00
robot-clickhouse
671d2a8927
Automatic style fix
2024-04-11 14:33:25 +00:00
Max Kainov
59d56668e9
CI: respect Sync status in the MQ
2024-04-11 13:20:20 +00:00
Mikhail f. Shiryaev
0b76f95e57
Remove unnecessary style-check comments
2024-04-11 15:19:32 +02:00
Mikhail f. Shiryaev
c684770ace
Use sudo to compress logs with the highest permissions
2024-04-11 15:17:56 +02:00
Raúl Marín
0273b39804
Merge remote-tracking branch 'blessed/master' into rust_vendor
2024-04-10 22:05:20 +02:00
Max K
4a7450ed2e
Merge pull request #62488 from ClickHouse/ci_auto_sync_pr_merge
...
CI: merge sync pr on push to master
2024-04-10 18:17:36 +00:00
Max Kainov
407f154650
comments
2024-04-10 18:07:05 +00:00
Max Kainov
2e4e3187d5
merge sync pr on push to master
2024-04-10 13:49:49 +00:00
Kruglov Pavel
8ef64b0581
Merge pull request #61476 from Avogar/better-stress-upgrade-checks
...
Ignore DROP queries in stress test with 1/2 probability and TRUNCATE Memory/JOIN table instead of ignoring DROP in upgrade check
2024-04-10 12:43:22 +00:00
Nikita Taranov
e34d9fb743
Merge branch 'master' into add_version_history
2024-04-10 12:48:11 +02:00
Max Kainov
98c1cc7747
new gh runner version 2.315.0
2024-04-09 17:09:04 +00:00
Max Kainov
4e344f6a93
remove ci status and reports for MQ case
2024-04-09 10:25:41 +00:00
Max Kainov
baa62cdaee
CI: no CI Running status for MQ
2024-04-08 16:09:47 +00:00
Max Kainov
f3dc77ee00
disable autofix for merge queue
2024-04-08 14:28:48 +00:00
avogar
71666cb42f
Merge branch 'master' of github.com:ClickHouse/ClickHouse into better-stress-upgrade-checks
2024-04-08 13:58:14 +00:00
Max Kainov
5e1c1b6b94
CI: test merge queue
2024-04-08 13:41:44 +00:00
Max Kainov
83d1f1a876
CI: fix for docs only pr
2024-04-08 11:51:59 +00:00
Robert Schulze
116393c951
Disable s390x build
2024-04-08 11:04:11 +00:00
Anita Hammer
c0ffee763c
Fix contributor name vulnerability
2024-04-06 02:48:50 +03:00
Kruglov Pavel
589034c34c
Merge branch 'master' into better-stress-upgrade-checks
2024-04-05 15:27:02 +02:00
Alexey Milovidov
0fccaafda4
Fix tests
2024-04-04 20:06:40 +02:00
Raúl Marín
6d2f952eae
Linter
2024-04-04 19:44:17 +02:00
Raúl Marín
173440be9b
Remove rust cache
2024-04-04 19:22:46 +02:00
avogar
d87d5a9197
Merge branch 'master' of github.com:ClickHouse/ClickHouse into better-stress-upgrade-checks
2024-04-03 12:07:22 +00:00
Alexey Milovidov
a6356c120a
Add more documentation to the release script
2024-04-03 09:22:01 +02:00
Nikita Taranov
eae047cd0b
Merge branch 'master' into add_version_history
2024-03-28 20:05:24 +01:00
Max K
b5b347e86f
Merge pull request #62044 from ClickHouse/ci_fix_for_kill_timeout_env
...
CI: fix for timeout env variable
2024-03-28 16:35:50 +01:00
Max Kainov
863f479ff0
CI: fix for timeout env variable
2024-03-28 14:00:04 +00:00
Max K
0df3826050
Merge pull request #61991 from ClickHouse/ci_remove_job_url_from_mark_release_ready
...
CI: remove unnecessary job url for Mark release ready
2024-03-27 18:47:42 +01:00
Max Kainov
c9749ae586
CI: remove unnecessary job url for Mark release ready
2024-03-27 17:17:10 +00:00
robot-clickhouse
a45439ed52
Automatic style fix
2024-03-27 15:34:55 +00:00
Max Kainov
d7187a172f
CI: failover for job_url request from gh
2024-03-27 15:24:16 +00:00
Dmitry Novik
104774c646
Fix CI config
2024-03-27 11:39:33 +01:00
Dmitry Novik
31df60be20
Merge remote-tracking branch 'origin/master' into enable-analyzer
2024-03-27 11:37:32 +01:00
robot-ch-test-poll2
5d2bc7ee34
Merge pull request #61948 from ClickHouse/ci_new_menu
...
CI: new ci menu in PR body
2024-03-27 01:56:17 +04:00
Max Kainov
813b60f129
Add handling for include/exclude ci filters
2024-03-26 19:34:05 +00:00
Dmitry Novik
65121b712e
Merge remote-tracking branch 'origin/master' into enable-analyzer
2024-03-26 19:02:30 +01:00
Max Kainov
e4d9a74057
CI: create CIOptions class to handle ci user config
...
CI: create CIOptions class to handle ci user config
2024-03-26 15:39:07 +00:00
Nikita Taranov
34c8ec67e8
fix
2024-03-26 15:09:16 +00:00
peter279k
a47b407495
Fix PR #60656 for install check tests
2024-03-26 13:35:35 +08:00
Max K
c7e4d97e5a
Merge pull request #61881 from ClickHouse/ci_prepare_for_merge_queue
...
CI: merge queue support
2024-03-25 22:12:02 +01:00
Kruglov Pavel
de1229ba60
Merge branch 'master' into better-stress-upgrade-checks
2024-03-25 19:18:35 +01:00
Max Kainov
f9f830228a
CI: MQ support
2024-03-25 17:57:03 +00:00
Max Kainov
727aeb7e37
CI: set timeout for install check
...
#job_Install_packages_amd64 #job_style_check
2024-03-25 17:38:39 +00:00
Nikita Taranov
3b87633392
better
2024-03-25 14:09:04 +00:00
Dmitry Novik
64301191b1
Merge remote-tracking branch 'origin/master' into enable-analyzer
2024-03-24 21:07:26 +00:00
Alexey Milovidov
b8a8d9994f
Merge pull request #60949 from nikmonkov/docker-version
...
Version has been added to docker labels
2024-03-24 01:50:50 +03:00
Dmitry Novik
df88eb26a5
Merge branch 'master' into enable-analyzer
2024-03-22 15:56:32 +01:00
Max K
d3965f27c1
Merge pull request #61542 from ClickHouse/ci_arm_support_kerberos
...
CI: ARM integration test - skip hdfs, kerberos, kafka
2024-03-22 15:25:30 +01:00
Max Kainov
e4556ae6c1
comments
2024-03-22 14:22:53 +00:00
Max Kainov
ef0fa1963d
CI: use ci-runner as module
...
#no_merge_commit
#ci_set_integration
#batch_0
2024-03-22 14:22:53 +00:00
Dmitry Novik
d43a1a1984
Merge remote-tracking branch 'origin/master' into enable-analyzer
2024-03-22 14:15:57 +01:00
Nikolai Kochetov
0f60596f5b
Merge pull request #60548 from kitaisreal/merge-tree-read-split-ranges-into-intersecting-and-non-intersecting-fault-injection
...
MergeTree read split ranges into intersecting and non intersecting injection
2024-03-22 11:52:14 +01:00
Mikhail f. Shiryaev
771c549606
Process removed files, decouple _check_mime
2024-03-22 09:14:30 +01:00
Max Kainov
7d7025a74e
CI: modify it
2024-03-22 00:13:17 +00:00
Max Kainov
389566f895
quick fix for style check
2024-03-21 20:24:22 +00:00
Max Kainov
d6b515b6bf
CI: modify CI from PR body
...
#do_not_test
#job_style_check
2024-03-21 19:35:07 +00:00
Maksim Kita
8ca9c1fb6b
Merge branch 'master' into merge-tree-read-split-ranges-into-intersecting-and-non-intersecting-fault-injection
2024-03-21 21:25:18 +03:00
Dmitry Novik
20a860cf19
Update ci_config.py
2024-03-21 16:18:49 +01:00
Mikhail f. Shiryaev
15a61a998a
Fix logic for run_cpp_check, it had a bug
2024-03-21 14:34:31 +01:00
Mikhail f. Shiryaev
77e947c44f
Avoid IsADirectoryError: Is a directory contrib/azure
2024-03-21 14:09:01 +01:00
Maksim Kita
4dc985aa2f
Fixed style check
2024-03-21 12:41:15 +03:00
Maksim Kita
b8c53d7cf3
Fixed tests
2024-03-21 12:41:15 +03:00
Mikhail f. Shiryaev
ff9a6d0958
Merge pull request #61197 from ClickHouse/merge-commit-style-autofix
...
Merge commit style autofix
2024-03-21 09:59:53 +01:00
Max K
984c7e69a0
disable test_allowed_url_with_config tests with HDFS
...
#no_merge_commit
#ci_set_arm
2024-03-20 17:24:55 +00:00
Mikhail f. Shiryaev
aa1a210d5d
Fix logging of autoscaling lambda, add test for effective_capacity
2024-03-20 17:07:32 +01:00
Dmitry Novik
1524d5a451
Pass broken tests list to FastTest
2024-03-20 14:33:14 +01:00
Dmitry Novik
f0e7b78f8b
Inverse analyzer in tests
2024-03-20 13:35:30 +01:00
Mikhail f. Shiryaev
661161695f
Merge pull request #61592 from ClickHouse/improve-builds-downloader
...
Improve build_download_helper
2024-03-20 11:56:06 +01:00
Mikhail f. Shiryaev
4efddb5ed4
Add type checking to build_download_helper
2024-03-19 14:01:31 +01:00
Mikhail f. Shiryaev
6b43d2e197
Improve logging in build_download_helper
2024-03-19 13:27:26 +01:00
Nikita Taranov
726db7361f
add missing method
2024-03-18 20:04:56 +00:00
Nikita Taranov
0b2c274132
write docker tag
2024-03-18 17:50:08 +00:00
Nikita Taranov
ac352b96f0
remove copy-paste
2024-03-18 17:50:01 +00:00
Nikita Taranov
4a58705f7b
impl
...
trigger rebuild
fix
move
fix black
trigger rebuild
trigger rebuild
fix mypy
fix
fix
2024-03-18 17:49:16 +00:00
avogar
31d5049f80
Move logic of ignoring drop queries to server
2024-03-18 16:26:05 +00:00
Raúl Marín
10dd47cf5c
Separate CH and sanitizer logs
2024-03-18 16:40:03 +01:00
Raúl Marín
83c660a545
Merge remote-tracking branch 'blessed/master' into fuzz_log
2024-03-18 16:12:50 +01:00
Mikhail f. Shiryaev
41432c56a8
Enable shellcheck conditionally
2024-03-18 15:04:44 +01:00
Mikhail f. Shiryaev
c3f386d06a
Fix the autofixer
2024-03-18 15:04:43 +01:00
Mikhail f. Shiryaev
49017fc163
Run the style-check on top of the merge-commit of PRs
2024-03-18 15:04:41 +01:00
Mikhail f. Shiryaev
0240ffa5a6
Fetch the changed files only once
2024-03-18 15:04:40 +01:00
avogar
eada7e8d29
Fix server version
2024-03-18 13:18:58 +00:00
avogar
aadfc37dda
Merge branch 'master' of github.com:ClickHouse/ClickHouse into better-stress-upgrade-checks
2024-03-15 20:27:16 +00:00
avogar
fa9d9ea3f7
Ignore DROP queries in stress test with 1/2 probability, use TRUNCATE instead of ignoring DROP in upgrade check for Memory/JOIN tables
2024-03-15 20:23:39 +00:00
Alexey Milovidov
2de304e00c
Merge pull request #61377 from ClickHouse/fix-spot-termination
...
Terminate EC2 on spot event if runner isn't running
2024-03-15 11:02:04 +03:00
Alexey Milovidov
05357bce5c
Merge branch 'master' into clang-18-ci
2024-03-15 07:28:04 +01:00
Mikhail f. Shiryaev
03b9bca8a4
Terminate EC2 on spot event if runner isn't running
2024-03-14 14:31:55 +01:00
Mikhail f. Shiryaev
d465835306
Reorder hidden and shown checks in comment, change url of Mergeable check
2024-03-14 14:19:07 +01:00
Raúl Marín
f63368d83d
Separate stdout and stderr in fuzzer report
2024-03-13 19:12:43 +01:00
Alexey Milovidov
d3872b155e
Merge branch 'master' into clang-18-ci
2024-03-13 09:35:58 +01:00
Mikhail f. Shiryaev
ad363fe254
Merge pull request #61231 from ClickHouse/style-quick-scale
...
Make every style-checker runner types scaling-out very quickly
2024-03-12 18:19:03 +01:00
Mikhail f. Shiryaev
50aab0b69f
Fix annoying typo
2024-03-12 14:06:17 +01:00
Mikhail f. Shiryaev
612ff3c5bc
Make every style-checker runner types scaling-out very quickly
2024-03-12 13:00:31 +01:00
Max Kainov
fb1e5923a3
CI: fix runner for arm perf tests
...
#do_not_test
2024-03-12 09:12:25 +00:00
Max Kainov
b7b83085d1
CI: ci.py hot style fix
...
#do_not_test
2024-03-11 18:49:45 +00:00
Max K
7676d71c5d
Merge pull request #59738 from ClickHouse/ci_arm_integration_fix_1
...
CI: support batch specification in commit message
2024-03-11 19:01:03 +01:00
Max Kainov
f973e405ee
CI: fixing ARM integration tests
...
#do_not_test
2024-03-11 17:20:36 +00:00
Max Kainov
f656a01538
CI: fix sync build issue with reuse
...
#do_not_test
2024-03-11 17:15:23 +00:00
Max K
a0a96b5580
Merge pull request #61099 from ClickHouse/ci_merge_queue_support
...
CI: support merge queue event in pr_info
2024-03-11 16:54:16 +01:00
Max K
23a9ac4947
Merge pull request #61160 from ClickHouse/ci_fix_nightly
...
CI: fix nightly job issue
2024-03-11 14:46:53 +01:00
Max Kainov
c4f29af8ec
CI: fix nightly job issue
...
#do_not_test
2024-03-11 13:35:05 +00:00
Mikhail f. Shiryaev
8f2ff2ccd8
Enable black back
2024-03-11 13:22:18 +01:00
Max Kainov
49b78e0a0c
CI: check cpp and py files style on changes only
...
#do_not_test
2024-03-11 09:30:26 +00:00
Alexey Milovidov
8c08fc1f57
Revert "CI: make style check faster"
2024-03-11 04:09:26 +03:00
Alexey Milovidov
36e18d7500
Merge branch 'master' into clang-18-ci
2024-03-10 23:57:00 +01:00
Max Kainov
f429f54af8
CI: make style check fast
...
#do_not_test
2024-03-10 17:25:51 +00:00
Alexey Milovidov
9a880c3bb9
Merge branch 'master' into clang-18-ci
2024-03-10 06:59:27 +01:00
Max Kainov
681bd28c87
CI: make style check fast
...
#do_not_test
2024-03-09 20:57:23 +00:00
Max Kainov
7f061ba89c
CI: add wf class in ci_config
...
#do_not_test
2024-03-09 14:33:34 +00:00
Max Kainov
cacbd3ce34
CI: support merge queue event in pr_info
...
#do_not_test
2024-03-08 14:53:23 +00:00
Mikhail f. Shiryaev
e3f9fb2733
Trigger Mergeable check unconditionally in the final_check.py
2024-03-07 10:38:05 +01:00
Mikhail f. Shiryaev
5e597228d7
Merge pull request #60408 from ClickHouse/update-style-python
...
Update style python
2024-03-07 09:32:28 +01:00
Nikolay Monkov
fb17749b50
file has been reformatted to pass Style check
2024-03-07 09:45:24 +05:00
Max K
6c0e9e1944
Merge pull request #60958 from ClickHouse/ci_remove_rerun_check_for_build_report_jobs
...
CI: disable rerun check helper for build report jobs
2024-03-06 21:32:04 +01:00
Max Kainov
4e1257974c
CI: disable rerun check helper for build report jobs
...
#do_not_test
2024-03-06 20:11:55 +00:00
Max Kainov
a0d161704a
CI: remove sqllancer, sqllogic, sqltest from pr wf
...
#do_not_test
2024-03-06 17:58:21 +00:00
Max Kainov
4dd5e4fe99
CI: fix stage config (unit test release issue)
...
#no_ci_cache
2024-03-06 16:52:01 +00:00
Nikolay Monkov
d9b5f9a086
version has been added to docker labels
2024-03-06 21:37:56 +05:00
Max Kainov
ee468b0f2a
CI: wait less in await to not exceed GH timeout
...
#do_not_test
2024-03-06 14:26:58 +00:00
Max K
561be5eb74
Merge pull request #60421 from ClickHouse/ci_abstract_workflow
...
CI: make workflow yml abstract
2024-03-06 15:15:02 +01:00
Mikhail f. Shiryaev
d2f92483f2
Add even more python code to pylint check, fix lambdas
2024-03-05 16:02:44 +01:00
Mikhail f. Shiryaev
34bb40583c
Install stubs for python-requests
2024-03-05 16:02:43 +01:00
Mikhail f. Shiryaev
91cff01ce0
More fixes in tests/ci
2024-03-05 16:02:41 +01:00
Mikhail f. Shiryaev
e31078e204
Fix some issues detected by new pylint
2024-03-05 16:02:36 +01:00
Mikhail f. Shiryaev
ec72800d78
Merge pull request #60383 from nickitat/upd_liburing
...
Enable testing with `io_uring` back
2024-03-05 15:26:35 +01:00
Max Kainov
82cc3f4339
CI: make workflow yml abstract
...
#no_merge_commit
#no_ci_cache
#job_style_check
#job_package_debug
#job_ClickHouse_build_check
#job_Stateless_tests_debug
#job_binary_release
2024-03-05 12:26:55 +00:00
Max Kainov
a6f5323c38
CI: Fix pending status for build report in backports
...
#do_not_test
2024-03-05 10:09:17 +00:00
Mikhail f. Shiryaev
a6caace5ec
Add a new runner type
2024-03-04 20:03:45 +01:00
Mikhail f. Shiryaev
bd2b0b4338
Export only str and bool for build configs
2024-03-04 20:01:26 +01:00
Mikhail f. Shiryaev
1443e490ea
Remove python bytecode, make consistent file-permissions
...
It's impossible to have persistent pyc files
Each time they are built with different content, for example:
> cmp -bl lambda-package*/charset_normalizer/__pycache__/constant.cpython-310.pyc
15582 6 ^F 4 ^D
15583 164 t 155 m
15584 141 a 142 b
15586 164 t 163 s
15587 151 i 332 M-Z
15588 163 s 6 ^F
15589 332 M-Z 164 t
15590 4 ^D 141 a
15591 155 m 143 c
15592 142 b 164 t
15593 143 c 151 i
17425 74 < 75 =
17428 76 > 46 &
17429 332 M-Z 372 M-z
17431 173 { 55 -
17434 75 = 174 |
17437 57 / 72 :
17440 54 , 73 ;
17441 372 M-z 332 M-Z
17443 174 | 175 }
17446 55 - 54 ,
17447 372 M-z 332 M-Z
17449 46 & 173 {
17452 72 : 76 >
17455 42 " 74 <
17458 73 ; 133 [
17461 135 ] 42 "
17464 133 [ 135 ]
17465 332 M-Z 372 M-z
17467 175 } 57 /
17503 332 M-Z 162 r
17504 5 ^E 130 X
17505 152 j 0 ^@
17506 157 o 0 ^@
17507 150 h 0 ^@
17508 141 a 332 M-Z
17509 142 b 5 ^E
17510 162 r 152 j
17511 130 X 157 o
17512 0 ^@ 150 h
17513 0 ^@ 141 a
17514 0 ^@ 142 b
17536 5 ^E 2 ^B
17537 143 c 150 h
17538 160 p 172 z
17539 71 9 332 M-Z
17540 65 5 5 ^E
17541 60 0 143 c
17542 332 M-Z 160 p
17543 2 ^B 71 9
17544 150 h 65 5
17545 172 z 60 0
2024-03-04 13:37:13 +01:00
Mikhail f. Shiryaev
63e40203d1
Use python zipfile to have x-platform idempotent lambda packages
2024-03-04 13:37:11 +01:00
Alexey Milovidov
6df3179341
Merge branch 'master' of github.com:ClickHouse/ClickHouse into clang-18-ci
2024-03-03 23:02:20 +01:00
Max K
cecd2a6bac
Merge pull request #60613 from ClickHouse/ci_build_report_job_to_ci_config
...
CI: build_report job no dependcies on yml
2024-03-03 20:33:08 +01:00
Alexey Milovidov
c427575f72
Merge pull request #60694 from azat/ci/fix-flaky-check
...
Fix flaky checks
2024-03-03 19:53:12 +03:00
Max Kainov
8785b0700c
CI: build_report job remove dependsies on yml
...
#no_merge_comit
#job_ClickHouse_build_check
#job_ClickHouse_special_build_check
#job_style_check
2024-03-03 16:08:35 +00:00
Max K
2c713c2b90
Merge pull request #60602 from ClickHouse/ci_remove_docker_server_job_input_params
...
CI: remove inputs from docker_server job command
2024-03-03 14:25:23 +01:00
Azat Khuzhin
982f7e97c3
tests/ci/functional_test_check: move validate_bugfix_check into assert
...
Co-authored-by: Max K. <max.kainov@clickhouse.com>
2024-03-03 13:55:22 +01:00
Azat Khuzhin
418a6258ac
Fix flaky checks
...
CI [1]:
2024-03-02T22:23:37.4878824Z Going to start run command [python3 /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/ci/functional_test_check.py "$CHECK_NAME" $KILL_TIMEOUT]
2024-03-02T22:23:37.7538256Z Runnin check [Stateless tests flaky check (asan)] with timeout [3600]
2024-03-02T22:23:37.8790465Z Fetched info about 3 changed files
2024-03-02T22:23:37.9160414Z Traceback (most recent call last):
2024-03-02T22:23:37.9161715Z File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/ci/functional_test_check.py", line 341, in <module>
2024-03-02T22:23:37.9162714Z main()
2024-03-02T22:23:37.9163683Z File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/ci/functional_test_check.py", line 235, in main
2024-03-02T22:23:37.9164642Z assert (
2024-03-02T22:23:37.9165273Z AssertionError: JobReport file path must be provided with --validate-bugfix
2024-03-02T22:23:37.9612679Z Run action failed for: [Stateless tests flaky check (asan)] with exit code [1]
[1]: https://github.com/ClickHouse/ClickHouse/actions/runs/8125551797/job/22208766466?pr=60689
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-03 10:44:21 +01:00
Max Kainov
bcd6e2f945
fixup! CI: remove inputs from docker_server job command
...
#job_style_check #job_Docker_server_image #job_Docker_keeper_image
2024-03-02 15:12:53 +00:00
Max Kainov
8abc0df7a8
CI: remove inputs from docker_server job command
...
#job_style_check #job_Docker_server_image #job_Docker_keeper_image
#packege_release #package_aarch64
2024-03-01 16:44:37 +00:00
Max Kainov
0b127ffba7
CI: await CI on master only
...
#do_not_test
2024-03-01 14:27:19 +00:00
robot-ch-test-poll1
7f0494b130
Merge pull request #60587 from ClickHouse/ci_fix_build_job_status
...
CI: fix for build job cache record status
2024-02-29 21:27:36 +04:00
Mikhail f. Shiryaev
af63125aaa
Merge pull request #60316 from ClickHouse/tailscale-ami
...
Install tailscale during AMI build and set it up on runners
2024-02-29 17:47:44 +01:00
Max Kainov
bd423c5ac5
CI: fix for build job cache record status
...
#job_package_release #job_style_check
2024-02-29 15:55:05 +00:00
Nikita Taranov
25347501d2
Merge branch 'master' into upd_liburing
2024-02-29 16:25:11 +01:00
Max K
01456f3f0c
Merge pull request #60455 from ClickHouse/ci_job_scripts_wo_input_params
...
CI: remove input params for job scripts
2024-02-29 15:51:10 +01:00
Max K
b4357d153d
Merge pull request #60554 from ClickHouse/ci_fix_docker_job_name_arch_suffix
...
CI: fix docker build job name
2024-02-29 15:25:51 +01:00
Max Kainov
64a2b6551a
CI: fix docker build job name
...
#do_not_test
2024-02-29 13:32:33 +00:00
Max Kainov
0df8db5c3f
CI: configure ci_set_analyzer
...
#do_not_test
2024-02-29 12:44:55 +00:00
Max Kainov
5f88a455ff
CI: remove input params for job scripts
...
#job_style_check
#job_Compatibility_check_amd64
#job_Compatibility_check_aarch64
2024-02-28 22:35:47 +00:00
Nikita Taranov
dc135294f0
add seccomp=unconfined
2024-02-28 22:17:47 +01:00
Max Kainov
5a57b9f75e
CI: remove autobackport for bugfix
...
#do_not_test
2024-02-28 19:30:34 +00:00
Max K
2970ca7b6d
Merge pull request #60457 from ClickHouse/ci_auto_ci_backport
...
CI: Auto backport for bugfix and ci-fix
2024-02-28 18:28:22 +01:00
Max Kainov
444ff093bb
CI: Auto backport for bugfix and CI changes
2024-02-28 16:02:13 +00:00
Mikhail f. Shiryaev
130cd86287
Do not mark report as pending if some jobs are skipped
2024-02-28 15:15:04 +01:00
Max Kainov
92e6cbe2e8
CI: quick style fix
...
#do_not_test
2024-02-28 12:37:07 +00:00
Max K
a23913b277
Update tests/ci/run_check.py
...
#do_not_test
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2024-02-28 12:22:19 +01:00
Max Kainov
155b5f3cff
CI: fix pr check status to not fail mergeable check
...
#do_not_test
2024-02-28 10:33:32 +00:00
Alexey Milovidov
ee772aaf0f
Use clang-18 in CI
2024-02-27 23:17:11 +01:00
Mikhail f. Shiryaev
6b24306678
Merge pull request #60444 from ClickHouse/replace-distutils
...
Replace deprecated distutils by vendored packaging
2024-02-27 15:50:49 +01:00
Mikhail f. Shiryaev
f49882ee17
Do not fail the build if ci-logs is not healthy
2024-02-27 13:59:01 +01:00
Mikhail f. Shiryaev
c85daf27f4
Replace deprecated distutils by vendored packaging
2024-02-27 12:49:44 +01:00
Mikhail f. Shiryaev
6ac893b565
Fix the local cache when it does not exist
2024-02-26 23:17:16 +01:00
Mikhail f. Shiryaev
6a6d6a286e
Split update_mergeable_check into two functions to force trigger the status
2024-02-26 21:31:41 +01:00
Azat Khuzhin
dd690dd05d
Expose fatal.log separately for fuzzer
...
Otherwise you have to download the full server.log
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-24 19:23:28 +01:00
Mikhail f. Shiryaev
ff353823b6
Update the GH actions runner version
2024-02-23 17:18:53 +01:00
Mikhail f. Shiryaev
758acd4268
Setup tailscale on instances, create a common network script
2024-02-23 17:18:52 +01:00
Max K
11e4029c6b
Merge pull request #59496 from AVMusorin/skip-tests-for-docs
...
Avoid running all checks when `aspell-dict.txt` was changed
2024-02-23 14:13:47 +01:00
Max Kainov
831fee9edb
CI: remove Integration tests asan, release from PR wf
...
#do_not_test
2024-02-22 18:35:06 +00:00
Max K
0df33c94ba
Merge pull request #60224 from ClickHouse/ci_combine_analyzer_s3_replicated_tests
...
CI: combine analyzer, s3, dbreplicated into one job
2024-02-22 18:41:41 +01:00
Mikhail f. Shiryaev
a768f40adc
Add tailscale installation to the AMI preparation
2024-02-22 14:58:51 +01:00
Alexey Milovidov
659d960990
Merge pull request #60245 from Algunenano/enforce_cloud_sync
...
Make cloud sync required
2024-02-22 10:11:01 +01:00
Max K
e7a560f94d
Merge pull request #59939 from ClickHouse/ci_integration_tests_to_mysql8_migration
...
CI: integration tests to mysql80
2024-02-21 20:33:00 +01:00
Raúl Marín
07c9deed41
Make cloud sync required
2024-02-21 18:40:00 +01:00
Max Kainov
f827469207
CI: random sanitizer for parallel repl in PR wf
2024-02-21 16:08:03 +00:00
Max Kainov
47ab81bbab
CI: support for random job pick
...
#no_merge_commit
#no_ci_cache
2024-02-21 15:39:57 +00:00
Max Kainov
9fb55f1fa4
CI: combine analyzer s3 dbreplicated into one job
...
#job_Stateless_tests_release_analyzer_s3_DatabaseReplicated
#job_style_check
#no_merge_commit
2024-02-21 13:18:02 +00:00
Max Kainov
9f51e840db
CI: integration tests to mysql80
...
#ci_set_integration
#no_merge_commit
2024-02-21 11:05:47 +00:00
Max Kainov
f928eaf10c
CI: hot fix for gh statuses
...
#no_merge_commit
#job_style_check
#job_Stateless_tests_debug
2024-02-20 21:38:19 +00:00
Max K
bf6929cb4c
Merge pull request #59348 from ClickHouse/refactor_bugfix_validate_job
...
CI: refactor bugfix-validate job
2024-02-16 12:32:52 +01:00
Max Kainov
5a3a93bea5
CI: refactor bugfix validate job
...
#no_merge_commit
2024-02-15 16:28:27 +00:00
Mikhail f. Shiryaev
54b43ee3a2
Do not dump to the file, there are no pr_info locally
2024-02-14 18:33:55 +01:00
Mikhail f. Shiryaev
f5a71455b8
Do not rebuild a lambda package if it is updated
2024-02-12 18:12:25 +01:00
Alexey Milovidov
789bca11e1
Merge pull request #58792 from ClickHouse/enable-coverage-for-debug-build
...
Add builds and tests with coverage
2024-02-10 23:52:22 +01:00
Alexey Milovidov
ccc9637dda
Merge pull request #59814 from ClickHouse/enforce-analyzer-tests
...
Enforce tests with enabled analyzer in CI
2024-02-10 21:39:54 +01:00
Alexey Milovidov
61227acdc4
Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build
2024-02-10 19:30:22 +01:00
Nikolai Kochetov
fb8723a15c
Update pr.py
2024-02-10 13:13:26 +01:00
Maksim Kita
8b3c27d45b
Updated a list of trusted contributors
2024-02-10 15:00:31 +03:00
Alexey Milovidov
a7c30098b6
Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build
2024-02-09 22:52:49 +01:00
Alexey Milovidov
e54fbd3367
Update tests/ci/ci_config.py
...
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2024-02-09 18:32:54 +01:00
Mikhail f. Shiryaev
f056e8b2c4
Handle different timestamp related aspects of zip-files
2024-02-09 16:54:00 +01:00
Dmitry Novik
b23ba02d4c
Enforce tests with enabled analyzer in CI
2024-02-09 16:50:37 +01:00
Max Kainov
c2320c2d16
CI: await tune ups
...
#no_ci_cache #job_package_debug
2024-02-09 13:17:49 +00:00
Max Kainov
9dfe3f5559
CI: do not reuse builds on release branches
...
#job_package_debug #job_style_check
2024-02-09 12:43:05 +00:00
robot-clickhouse
07ae125a52
Automatic style fix
2024-02-09 00:34:00 +00:00
Alexey Milovidov
ad665f9b06
Better
2024-02-09 00:46:12 +01:00
Alexey Milovidov
f386e34b91
Fix an error by rewriting the CI from Perl to Python
2024-02-09 00:45:16 +01:00
Alexey Milovidov
c12e34df19
Fix report
2024-02-08 23:28:29 +01:00
Alexey Milovidov
cd0acc512d
Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build
2024-02-08 22:08:15 +01:00
Max Kainov
b112fd1e3c
CI: ci test await
...
#do_not_test
2024-02-08 19:09:38 +00:00
Max Kainov
641c7b547d
CI: enable await
...
#no_merge_commit
2024-02-08 18:37:30 +00:00
Alexey Milovidov
85bd8d3cf0
Fix your Py
2024-02-08 00:23:04 +01:00
Alexey Milovidov
02c0b4c67f
Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build
2024-02-07 22:45:50 +01:00
Alexey Milovidov
62721fef78
Fix your Py
2024-02-07 22:45:35 +01:00
Alexey Milovidov
4d25929d74
A few missing changes
2024-02-07 20:58:40 +01:00
Mikhail f. Shiryaev
a1eb9abaf0
Add test for increase-always autoscaling lambda
2024-02-07 13:49:35 +01:00
Alexey Milovidov
d65a56d967
Merge branch 'master' into enable-coverage-for-debug-build
2024-02-07 04:58:21 +01:00
Mikhail f. Shiryaev
13948cbb20
Use constants from report instead of string literals
2024-02-06 15:02:09 +01:00
Mikhail f. Shiryaev
5b9bf80f09
Fix usage of status types to prevent API exceptions
2024-02-06 13:40:07 +01:00
Mikhail f. Shiryaev
df93062472
Apply and fix isort in scripts
2024-02-06 13:40:05 +01:00
Nikita Mikhaylov
306e739daa
Updated a list of trusted contributors ( #59616 )
...
* Updated a list of trusted contributors
* Automatic style fix
---------
Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2024-02-06 12:33:11 +01:00
Max Kainov
cbd81b506f
CI: fix ast fuzzer job report (slack bot issue)
...
#job_ast_fuzzer_debug #job_style_check
2024-02-06 09:56:15 +00:00
Max K
3ddaa1b5f1
CI: nightly job to update latest docker tag only ( #59586 )
...
* CI: nightly job to update latest docker tag only
---------
Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2024-02-05 18:09:43 +01:00
Max K
411b76cc57
Merge pull request #59241 from ClickHouse/test_arm
...
CI: Add ARM integration tests
2024-02-05 14:52:46 +01:00
Raúl Marín
08c1799f9c
Merge pull request #59383 from Algunenano/fuzz_literal
...
Add some fuzzing to ASTLiterals
2024-02-05 12:27:43 +01:00
Mikhail f. Shiryaev
31f27ad398
Merge pull request #59337 from ClickHouse/fix-fasttests-gdb
...
Some small fixes for docker images
2024-02-05 11:42:18 +01:00
Max Kainov
6504dfe0b2
CI: Enable ARM integration test
...
#ci_set_integration #no_merge_commit
2024-02-02 17:37:05 +00:00
Max K
0947d5c89e
CI: ci cache. step 1 ( #58664 )
...
* ci cache class
#no_merge_commit #ci_set_reduced
2024-02-02 18:10:47 +01:00
Raúl Marín
00096e5819
Merge remote-tracking branch 'blessed/master' into fuzz_literal
2024-02-02 17:28:47 +01:00
Aleksandr Musorin
3339a97014
Added aspell-dict.txt to only documentation list of files for CI
2024-02-01 19:49:03 +01:00
Mikhail f. Shiryaev
4ee7275f21
Improve dry run for lambda deployment
2024-02-01 11:20:16 +01:00
Mikhail f. Shiryaev
0f931057e9
Post a failure status if can not run the CI
2024-01-31 17:59:13 +01:00
Mikhail f. Shiryaev
bfa722bf62
Use JobNames.STYLE_CHECK for consistency
2024-01-31 13:58:25 +01:00
Mikhail f. Shiryaev
7af7255b90
Use JobNames.DOCS_CHECK for consistency
2024-01-31 13:58:24 +01:00
Mikhail f. Shiryaev
3dae643f19
Consistent "Fast test" job name
2024-01-31 13:58:23 +01:00
Raúl Marín
4f0c78d665
Upload one file. Save the planet
2024-01-30 20:29:59 +01:00
Raúl Marín
a3f0546f48
Handle both fuzzer.log and fuzzer.log.ztd
2024-01-30 19:44:55 +01:00
robot-clickhouse
419ddf7c9d
Automatic style fix
2024-01-30 18:34:56 +00:00
Max Kainov
e6fcc48471
CI: fix status and report for docker server jobs
...
#no_merge_commit
2024-01-30 18:24:29 +00:00
Alexey Milovidov
cb69a1b25d
Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build
2024-01-29 15:35:04 +01:00
Max K
bd83830cea
CI: WA for issue with perf test with artifact reuse ( #59325 )
...
* CI: WA for issue with perf test with artifact reuse
#do_not_test
* Automatic style fix
---------
Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2024-01-29 12:17:38 +01:00
Alexey Milovidov
982e3ddbdd
Fix Python
2024-01-28 23:11:03 +01:00
Alexey Milovidov
1ef8062c77
Split by batches
2024-01-28 22:28:09 +01:00
Alexey Milovidov
8798f469b3
Fix conflicts.
2024-01-28 22:27:21 +01:00
Alexey Milovidov
4a94ae5a1b
Merge branch 'master' into enable-coverage-for-debug-build
2024-01-28 22:24:26 +01:00
Max Kainov
d36c92a219
CI: Add rust dir to build digest
2024-01-28 15:09:39 +00:00
Max Kainov
2b75836ad2
CI: fix ci configuration for nightly job
2024-01-26 09:33:04 +00:00
Mikhail f. Shiryaev
3d03c16fc8
Fix another place with special symbols in the URL
2024-01-24 21:02:22 +01:00
Mikhail f. Shiryaev
dedc889e49
Fix broken cache for non-existing temp_path
2024-01-24 18:12:30 +01:00
Mikhail f. Shiryaev
a05d22b1c1
Fix url encoding issue
2024-01-24 14:32:29 +01:00
Max Kainov
f1220c5637
CI: hot fix for reuse
2024-01-22 19:19:22 +00:00
Max K
08fcefbefd
Merge pull request #59046 from ClickHouse/job_names_refactoring
...
CI: add ci_config classes for job and build names
2024-01-22 13:46:32 +01:00
Max Kainov
5379767684
Job Naming
...
#no_merge_commit #ci_set_reduced
2024-01-22 11:16:58 +00:00
Max Kainov
6362fc1d48
fix inputs check in ci.py
2024-01-22 08:26:46 +00:00
Max K
070a55e194
Merge pull request #58516 from ClickHouse/move_out_ci_specifics_to_ci_py
...
CI: move ci-specifics from job scripts to ci.py
2024-01-21 18:24:42 +01:00
Max Kainov
3247ae81e4
move out ci specific functions to ci.py
...
#no_merge_commit
2024-01-21 16:36:37 +00:00
Alexey Milovidov
735708e9bb
Merge branch 'master' into enable-coverage-for-debug-build
2024-01-20 21:40:53 +01:00
Alexey Milovidov
05609cf75d
Ci to CI
2024-01-19 17:02:17 +01:00
Raúl Marín
76638fb7ba
Merge pull request #58942 from Algunenano/missing_digest
...
Add missing files to digests
2024-01-19 13:32:49 +01:00
vdimir
4509af091a
Merge pull request #58091 from ClickHouse/vdimir/bugfix_validate_check_exceptions_msg
...
Print another message in Bugfix check if internal check had been failed
2024-01-19 11:57:14 +01:00
Alexey Milovidov
7c0b167e2d
Merge branch 'master' of github.com:ClickHouse/ClickHouse into enable-coverage-for-debug-build
2024-01-19 03:59:27 +01:00
Alexey Milovidov
5a6a89897e
Merge pull request #58960 from ClickHouse/add_a_comment_about_sparse_checkout
...
Add a comment about sparse checkout
2024-01-19 00:39:26 +01:00
robot-clickhouse
5f1f27f8c7
Automatic style fix
2024-01-18 18:34:10 +00:00
Alexander Tokmakov
01d9b9a28a
add a comment about sparse checkout
2024-01-18 19:22:20 +01:00
Mikhail f. Shiryaev
7a911997ae
Fix git_helper.Runner.__call__ typing
2024-01-18 16:11:01 +01:00
Mikhail f. Shiryaev
61a79bac53
Copy local cache archives when CI is not set
2024-01-18 15:53:04 +01:00
Mikhail f. Shiryaev
d70c72b89e
Name stash properly
2024-01-18 15:53:02 +01:00
Mikhail f. Shiryaev
15cfc9b0ef
Fix stash and clear_repo contexts
...
All the cleanup should be done in `finally` block:
```
In [3]: @contextmanager
...: def stash():
...: try:
...: print("inside")
...: yield
...: except (Exception, KeyboardInterrupt):
...: print("catched")
...: raise
...: finally:
...: print("always")
...:
In [4]: with stash():
...: raise ValueError("something")
...:
inside
catched
always
---------------------------------------------------------------------------
ValueError Traceback (most recent call last)
Cell In[4], line 2
1 with stash():
----> 2 raise ValueError("something")
ValueError: something
In [5]: @contextmanager
...: def stash():
...: try:
...: print("inside")
...: yield
...: finally:
...: print("always")
...:
In [6]: with stash():
...: raise ValueError("something")
...:
inside
always
---------------------------------------------------------------------------
ValueError Traceback (most recent call last)
Cell In[6], line 2
1 with stash():
----> 2 raise ValueError("something")
```
And `except` block is unnecessary if it should just re-raise an error
2024-01-18 15:25:59 +01:00
Max Kainov
4eb7cda8fa
Add pr_info event type so that jobs could know how they launched
...
#no_merge_commit #ci_set_reduced
2024-01-18 13:31:37 +00:00
Max K
a4cab68a06
Merge pull request #58881 from ClickHouse/jepsen_to_reusable_builds
...
Jepsen job to reuse builds
2024-01-18 13:47:14 +01:00
Raúl Marín
cd4aefcddb
Add missing files to digests
2024-01-18 13:36:05 +01:00
robot-clickhouse
db3ffa5c86
Automatic style fix
2024-01-18 12:11:03 +00:00
Alexey Milovidov
6d6b8fcf8e
Add missing comments in code
2024-01-18 12:58:50 +01:00
Max Kainov
d387c84aa4
Jepsen job to reuse builds
...
#no-merge-commit
2024-01-18 11:58:41 +00:00
vdimir
bb8986de5d
Revert "break tests/integration/test_merge_tree_s3/test.py"
...
This reverts commit 5dd231ede1
.
2024-01-18 08:56:05 +00:00
vdimir
c3788c2fa1
upd
2024-01-18 08:54:31 +00:00