Commit Graph

2324 Commits

Author SHA1 Message Date
Max K
561be5eb74
Merge pull request #60421 from ClickHouse/ci_abstract_workflow
CI: make workflow yml abstract
2024-03-06 15:15:02 +01:00
Mikhail f. Shiryaev
ec72800d78
Merge pull request #60383 from nickitat/upd_liburing
Enable testing with `io_uring` back
2024-03-05 15:26:35 +01:00
Max Kainov
82cc3f4339 CI: make workflow yml abstract
#no_merge_commit
 #no_ci_cache
 #job_style_check
 #job_package_debug
 #job_ClickHouse_build_check
 #job_Stateless_tests_debug
 #job_binary_release
2024-03-05 12:26:55 +00:00
Max Kainov
a6f5323c38 CI: Fix pending status for build report in backports
#do_not_test
2024-03-05 10:09:17 +00:00
Mikhail f. Shiryaev
a6caace5ec
Add a new runner type 2024-03-04 20:03:45 +01:00
Mikhail f. Shiryaev
bd2b0b4338
Export only str and bool for build configs 2024-03-04 20:01:26 +01:00
Mikhail f. Shiryaev
1443e490ea
Remove python bytecode, make consistent file-permissions
It's impossible to have persistent pyc files
Each time they are built with different content, for example:

> cmp -bl lambda-package*/charset_normalizer/__pycache__/constant.cpython-310.pyc
15582   6 ^F     4 ^D
15583 164 t    155 m
15584 141 a    142 b
15586 164 t    163 s
15587 151 i    332 M-Z
15588 163 s      6 ^F
15589 332 M-Z  164 t
15590   4 ^D   141 a
15591 155 m    143 c
15592 142 b    164 t
15593 143 c    151 i
17425  74 <     75 =
17428  76 >     46 &
17429 332 M-Z  372 M-z
17431 173 {     55 -
17434  75 =    174 |
17437  57 /     72 :
17440  54 ,     73 ;
17441 372 M-z  332 M-Z
17443 174 |    175 }
17446  55 -     54 ,
17447 372 M-z  332 M-Z
17449  46 &    173 {
17452  72 :     76 >
17455  42 "     74 <
17458  73 ;    133 [
17461 135 ]     42 "
17464 133 [    135 ]
17465 332 M-Z  372 M-z
17467 175 }     57 /
17503 332 M-Z  162 r
17504   5 ^E   130 X
17505 152 j      0 ^@
17506 157 o      0 ^@
17507 150 h      0 ^@
17508 141 a    332 M-Z
17509 142 b      5 ^E
17510 162 r    152 j
17511 130 X    157 o
17512   0 ^@   150 h
17513   0 ^@   141 a
17514   0 ^@   142 b
17536   5 ^E     2 ^B
17537 143 c    150 h
17538 160 p    172 z
17539  71 9    332 M-Z
17540  65 5      5 ^E
17541  60 0    143 c
17542 332 M-Z  160 p
17543   2 ^B    71 9
17544 150 h     65 5
17545 172 z     60 0
2024-03-04 13:37:13 +01:00
Mikhail f. Shiryaev
63e40203d1
Use python zipfile to have x-platform idempotent lambda packages 2024-03-04 13:37:11 +01:00
Max K
cecd2a6bac
Merge pull request #60613 from ClickHouse/ci_build_report_job_to_ci_config
CI: build_report job no dependcies on yml
2024-03-03 20:33:08 +01:00
Alexey Milovidov
c427575f72
Merge pull request #60694 from azat/ci/fix-flaky-check
Fix flaky checks
2024-03-03 19:53:12 +03:00
Max Kainov
8785b0700c CI: build_report job remove dependsies on yml
#no_merge_comit
 #job_ClickHouse_build_check
 #job_ClickHouse_special_build_check
 #job_style_check
2024-03-03 16:08:35 +00:00
Max K
2c713c2b90
Merge pull request #60602 from ClickHouse/ci_remove_docker_server_job_input_params
CI: remove inputs from docker_server job command
2024-03-03 14:25:23 +01:00
Azat Khuzhin
982f7e97c3
tests/ci/functional_test_check: move validate_bugfix_check into assert
Co-authored-by: Max K. <max.kainov@clickhouse.com>
2024-03-03 13:55:22 +01:00
Azat Khuzhin
418a6258ac Fix flaky checks
CI [1]:

    2024-03-02T22:23:37.4878824Z Going to start run command [python3 /home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/ci/functional_test_check.py "$CHECK_NAME" $KILL_TIMEOUT]
    2024-03-02T22:23:37.7538256Z Runnin check [Stateless tests flaky check (asan)] with timeout [3600]
    2024-03-02T22:23:37.8790465Z Fetched info about 3 changed files
    2024-03-02T22:23:37.9160414Z Traceback (most recent call last):
    2024-03-02T22:23:37.9161715Z   File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/ci/functional_test_check.py", line 341, in <module>
    2024-03-02T22:23:37.9162714Z     main()
    2024-03-02T22:23:37.9163683Z   File "/home/ubuntu/actions-runner/_work/ClickHouse/ClickHouse/tests/ci/functional_test_check.py", line 235, in main
    2024-03-02T22:23:37.9164642Z     assert (
    2024-03-02T22:23:37.9165273Z AssertionError: JobReport file path must be provided with --validate-bugfix
    2024-03-02T22:23:37.9612679Z Run action failed for: [Stateless tests flaky check (asan)] with exit code [1]

  [1]: https://github.com/ClickHouse/ClickHouse/actions/runs/8125551797/job/22208766466?pr=60689

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-03 10:44:21 +01:00
Max Kainov
bcd6e2f945 fixup! CI: remove inputs from docker_server job command
#job_style_check #job_Docker_server_image #job_Docker_keeper_image
2024-03-02 15:12:53 +00:00
Max Kainov
8abc0df7a8 CI: remove inputs from docker_server job command
#job_style_check #job_Docker_server_image #job_Docker_keeper_image
 #packege_release #package_aarch64
2024-03-01 16:44:37 +00:00
Max Kainov
0b127ffba7 CI: await CI on master only
#do_not_test
2024-03-01 14:27:19 +00:00
robot-ch-test-poll1
7f0494b130
Merge pull request #60587 from ClickHouse/ci_fix_build_job_status
CI: fix for build job cache record status
2024-02-29 21:27:36 +04:00
Mikhail f. Shiryaev
af63125aaa
Merge pull request #60316 from ClickHouse/tailscale-ami
Install tailscale during AMI build and set it up on runners
2024-02-29 17:47:44 +01:00
Max Kainov
bd423c5ac5 CI: fix for build job cache record status
#job_package_release #job_style_check
2024-02-29 15:55:05 +00:00
Nikita Taranov
25347501d2
Merge branch 'master' into upd_liburing 2024-02-29 16:25:11 +01:00
Max K
01456f3f0c
Merge pull request #60455 from ClickHouse/ci_job_scripts_wo_input_params
CI: remove input params for job scripts
2024-02-29 15:51:10 +01:00
Max K
b4357d153d
Merge pull request #60554 from ClickHouse/ci_fix_docker_job_name_arch_suffix
CI: fix docker build job name
2024-02-29 15:25:51 +01:00
Max Kainov
64a2b6551a CI: fix docker build job name
#do_not_test
2024-02-29 13:32:33 +00:00
Max Kainov
0df8db5c3f CI: configure ci_set_analyzer
#do_not_test
2024-02-29 12:44:55 +00:00
Max Kainov
5f88a455ff CI: remove input params for job scripts
#job_style_check
 #job_Compatibility_check_amd64
 #job_Compatibility_check_aarch64
2024-02-28 22:35:47 +00:00
Nikita Taranov
dc135294f0 add seccomp=unconfined 2024-02-28 22:17:47 +01:00
Max Kainov
5a57b9f75e CI: remove autobackport for bugfix
#do_not_test
2024-02-28 19:30:34 +00:00
Max K
2970ca7b6d
Merge pull request #60457 from ClickHouse/ci_auto_ci_backport
CI: Auto backport for bugfix and ci-fix
2024-02-28 18:28:22 +01:00
Max Kainov
444ff093bb CI: Auto backport for bugfix and CI changes 2024-02-28 16:02:13 +00:00
Mikhail f. Shiryaev
130cd86287
Do not mark report as pending if some jobs are skipped 2024-02-28 15:15:04 +01:00
Max Kainov
92e6cbe2e8 CI: quick style fix
#do_not_test
2024-02-28 12:37:07 +00:00
Max K
a23913b277
Update tests/ci/run_check.py
#do_not_test

Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2024-02-28 12:22:19 +01:00
Max Kainov
155b5f3cff CI: fix pr check status to not fail mergeable check
#do_not_test
2024-02-28 10:33:32 +00:00
Mikhail f. Shiryaev
6b24306678
Merge pull request #60444 from ClickHouse/replace-distutils
Replace deprecated distutils by vendored packaging
2024-02-27 15:50:49 +01:00
Mikhail f. Shiryaev
f49882ee17
Do not fail the build if ci-logs is not healthy 2024-02-27 13:59:01 +01:00
Mikhail f. Shiryaev
c85daf27f4
Replace deprecated distutils by vendored packaging 2024-02-27 12:49:44 +01:00
Mikhail f. Shiryaev
6ac893b565
Fix the local cache when it does not exist 2024-02-26 23:17:16 +01:00
Mikhail f. Shiryaev
6a6d6a286e
Split update_mergeable_check into two functions to force trigger the status 2024-02-26 21:31:41 +01:00
Azat Khuzhin
dd690dd05d Expose fatal.log separately for fuzzer
Otherwise you have to download the full server.log

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-24 19:23:28 +01:00
Mikhail f. Shiryaev
ff353823b6
Update the GH actions runner version 2024-02-23 17:18:53 +01:00
Mikhail f. Shiryaev
758acd4268
Setup tailscale on instances, create a common network script 2024-02-23 17:18:52 +01:00
Max K
11e4029c6b
Merge pull request #59496 from AVMusorin/skip-tests-for-docs
Avoid running all checks when `aspell-dict.txt` was changed
2024-02-23 14:13:47 +01:00
Max Kainov
831fee9edb CI: remove Integration tests asan, release from PR wf
#do_not_test
2024-02-22 18:35:06 +00:00
Max K
0df33c94ba
Merge pull request #60224 from ClickHouse/ci_combine_analyzer_s3_replicated_tests
CI: combine analyzer, s3, dbreplicated into one job
2024-02-22 18:41:41 +01:00
Mikhail f. Shiryaev
a768f40adc
Add tailscale installation to the AMI preparation 2024-02-22 14:58:51 +01:00
Alexey Milovidov
659d960990
Merge pull request #60245 from Algunenano/enforce_cloud_sync
Make cloud sync required
2024-02-22 10:11:01 +01:00
Max K
e7a560f94d
Merge pull request #59939 from ClickHouse/ci_integration_tests_to_mysql8_migration
CI: integration tests to mysql80
2024-02-21 20:33:00 +01:00
Raúl Marín
07c9deed41 Make cloud sync required 2024-02-21 18:40:00 +01:00
Max Kainov
f827469207 CI: random sanitizer for parallel repl in PR wf 2024-02-21 16:08:03 +00:00