Commit Graph

907 Commits

Author SHA1 Message Date
Mikhail f. Shiryaev
44269d06b5
Improve some variables 2022-04-19 14:47:18 +02:00
Mikhail f. Shiryaev
40dafbe015
Don't put built documentation to output path 2022-04-19 10:43:12 +02:00
Mikhail f. Shiryaev
c1014aa60c
Use a new builder as a check image 2022-04-19 10:43:11 +02:00
Mikhail f. Shiryaev
e96ba17c30
Fallback to a default event data when API is broken 2022-04-19 09:45:40 +02:00
Alexey Milovidov
73b52859df Merge branch 'master' into llvm-14 2022-04-16 00:46:58 +02:00
Mikhail f. Shiryaev
401efa5fd4
Improve docker building and logging for approve lambda 2022-04-15 01:28:14 +02:00
Mikhail f. Shiryaev
e689322980
Improve logic to decide cancelling workflow 2022-04-15 01:28:13 +02:00
Mikhail f. Shiryaev
fad0aeb0d3
Fix some linter issues 2022-04-15 01:28:13 +02:00
Mikhail f. Shiryaev
646fd45645
Request unfiltered workflows in threads 2022-04-15 01:28:12 +02:00
Mikhail f. Shiryaev
3e6dc24a7b
Do not fail the whole lambda if one page failed 2022-04-15 01:28:12 +02:00
Mikhail f. Shiryaev
52a7544aa4
Fix cancel-lambda for closed PRs
- Create a fallback function for some edge cases
- Process synchronized PRs as help for cancel-workflow action
2022-04-15 01:28:12 +02:00
Mikhail f. Shiryaev
323cf6c5bf
Merge TRUSTED_CONTRIBUTORS in lambda and import in check 2022-04-14 13:25:54 +02:00
alesapin
df5453874a
Merge pull request #36214 from ClickHouse/tavplubix-patch-4
Make stateless tests with s3 always green
2022-04-14 12:04:15 +02:00
Tyler Hannan
d2a7c4541e whitespace 2022-04-14 00:36:38 +02:00
Tyler Hannan
4cce325941 Add Tyler Hannan to contributors 2022-04-14 00:25:14 +02:00
tavplubix
01a1babd3b
Update ci_config.py 2022-04-13 23:56:34 +03:00
Mikhail f. Shiryaev
693711544c
Use a proper image in fasttest 2022-04-13 14:06:50 +02:00
alesapin
34b920adb0
Merge pull request #36159 from ClickHouse/cancel-lambda
Fix a logical error left after debugging
2022-04-12 11:33:13 +02:00
Mikhail f. Shiryaev
30a9fce67a
Rebuild the least docker layer 2022-04-12 11:01:25 +02:00
Mikhail f. Shiryaev
abf8c3c5ad
Fix and improve cancel-rerun lambda
- Fix rerun for DocsCheck
- Additional check for workflow head sha1
- Fix workflow debug info
- Fix event_data parsing
- Always print debug info
2022-04-12 11:00:01 +02:00
Mikhail f. Shiryaev
280a2d847c
Merge pull request #36139 from ClickHouse/fasttest-ccache
Upload ccache for the first run in PR
2022-04-12 08:37:21 +02:00
Mikhail f. Shiryaev
faa26b4377
Improve report and variables naming 2022-04-11 20:05:43 +02:00
Mikhail f. Shiryaev
11897d56b9
Upload ccache for the first run in PR 2022-04-11 17:03:46 +02:00
Mikhail f. Shiryaev
9a946c0213
Add typing 2022-04-11 15:35:13 +02:00
Alexey Milovidov
836fd2dd87
Merge pull request #36080 from nvartolomei/nv/trusted-tonickkozlov
Add tonickkozlov to trusted users for auto ci run
2022-04-09 02:55:50 +03:00
Mikhail f. Shiryaev
a09fcdac1f
Do not fail on a poisoned ccache 2022-04-09 00:41:39 +02:00
Mikhail f. Shiryaev
cb962b8ad5
Stop rewriting BUILD_NAME env in build_check.py 2022-04-08 22:34:58 +02:00
Mikhail f. Shiryaev
f506b6c1a3
Fix linter issues and missed formatting 2022-04-08 19:50:41 +02:00
Nicolae Vartolomei
081de5b086 Add tonickkozlov to trusted users for auto ci run
Cloudflare employee contributing to ClickHouse
2022-04-08 15:21:36 +00:00
Mikhail f. Shiryaev
44c80a388f
Merge pull request #36064 from ClickHouse/fix-rerun-lambda
Add debug and fix cancel_rerun lambda
2022-04-08 13:33:37 +02:00
Mikhail f. Shiryaev
90a863bbc2
Merge pull request #36029 from ClickHouse/fix-release-workflow
Fix release workflow
2022-04-08 13:09:01 +02:00
vdimir
1322fab333
Fix style in run_check.py 2022-04-08 12:51:58 +02:00
Mikhail f. Shiryaev
811178da54
Add debug and fix cancel_rerun lambda 2022-04-08 12:28:25 +02:00
Vladimir C
608f4c3b70
Merge pull request #35991 from vdimir/run-check-debug-labels 2022-04-08 12:00:37 +02:00
Mikhail f. Shiryaev
a5b1a0620c
Add default IMAGES_PATH value 2022-04-07 18:35:59 +02:00
Mikhail f. Shiryaev
dd4bd4abba
Simplify and fix coverity 2022-04-07 18:35:58 +02:00
Mikhail f. Shiryaev
44895e5287
Improve build cache for docker images
- Save all layer's cache
- Use cache with fallback to a latest tags
2022-04-07 17:16:43 +02:00
Mikhail f. Shiryaev
a7145cf087
Move version_arg to version_helper, add tests 2022-04-07 13:48:52 +02:00
Mikhail f. Shiryaev
58d381de5c
A temporary fix for artifactory push before multiple architectures 2022-04-07 12:48:54 +02:00
Mikhail f. Shiryaev
eb62b18845
Improve and fix edge cases for docker_server.py
- Allow define version as file
- Add inline cache
- Fix auto_release_type function
2022-04-07 12:48:53 +02:00
Mikhail f. Shiryaev
846e4b94fb
Tiny improvements to git and version helpers 2022-04-07 12:48:51 +02:00
Mikhail f. Shiryaev
2d87e3587d
Merge pull request #34895 from DevTeamBK/coverity_scan
Attempt at Nightly Coverity Scan and upload
2022-04-06 19:07:00 +02:00
Mikhail f. Shiryaev
12442fd0a5
Add description for missing builds 2022-04-06 15:16:16 +02:00
Mikhail f. Shiryaev
1323c3617f
Fix linter points 2022-04-06 15:16:16 +02:00
Mikhail f. Shiryaev
19e0e6e765
Fix failing BuilderReport 2022-04-06 15:16:15 +02:00
vdimir
670fad56fc
Print labels to log in run_check.py 2022-04-06 11:57:11 +02:00
Mikhail f. Shiryaev
62fa528e7d
Fix syntax error in build_check.py 2022-04-06 10:15:36 +02:00
Boris Kuschel
2298b80ed8
Add coverity scan
Signed-off-by: Boris Kuschel <Boris.Kuschel@ibm.com>
2022-04-05 19:52:33 +02:00
Mikhail f. Shiryaev
a665861f5f
Improve descriptrion check logging 2022-04-05 01:06:46 +02:00
Mikhail f. Shiryaev
1d60824d6a
Highlight headers in PR template 2022-04-05 00:59:44 +02:00
Mikhail f. Shiryaev
6b83e2b2a7
Fix automatic bucket prefix for master 2022-04-01 17:53:43 +02:00
Mikhail f. Shiryaev
98aa8bf579
Improve version_helper.py
- Add helper functions
- Add __lt__ and __eq__ to compare versions between each other
2022-04-01 12:32:26 +02:00
Mikhail f. Shiryaev
66851b28b7
Make _check_tag public 2022-04-01 12:32:25 +02:00
Mikhail f. Shiryaev
00a3734078
Cosmetic improvement 2022-04-01 12:32:24 +02:00
Mikhail f. Shiryaev
9aab7e9910
Create a script to build and push server images 2022-04-01 12:32:23 +02:00
Mikhail f. Shiryaev
3e7c46075a
Clean out dead code from version_helper 2022-04-01 11:59:49 +02:00
Mikhail f. Shiryaev
93cfc4d590
Add validate_version function to version_helper.py 2022-04-01 11:59:48 +02:00
Mikhail f. Shiryaev
5212ff0146
Improve docker_images_check logging 2022-04-01 11:59:48 +02:00
Mikhail f. Shiryaev
90be03c750
Rework env_helper to return correct paths 2022-04-01 11:59:47 +02:00
Alexey Milovidov
93edf05259
Merge branch 'master' into llvm-14 2022-04-01 04:49:03 +03:00
Mikhail f. Shiryaev
4ba7cf6d1b
Fix latest_error referenced before assignment 2022-03-31 15:40:32 +02:00
alesapin
02574bd05b
Merge pull request #35766 from ClickHouse/resurrect_official_flag
Resurrect build hash
2022-03-30 19:34:19 +02:00
alesapin
b388bb8448
Merge pull request #35718 from ClickHouse/fail_build_check_in_error_status
Fail CI checks in case of errors in checks (not failed tests)
2022-03-30 19:28:22 +02:00
alesapin
fcd4e0be65 Black 2022-03-30 19:15:27 +02:00
alesapin
8980994faa Resurrect build hash 2022-03-30 16:29:13 +02:00
Nikolai Kochetov
d3697625a9 Fix stylecheck 2022-03-30 10:55:49 +00:00
alesapin
b19ecf60ad Fix style 2022-03-30 11:30:21 +02:00
mergify[bot]
c2d26e0dd4
Merge branch 'master' into new_branch 2022-03-30 09:22:01 +00:00
alesapin
c510ede8dd Fixup 2022-03-30 11:19:11 +02:00
alesapin
2a1b331c0d Fix build check 2022-03-30 11:15:54 +02:00
alesapin
cf6898d05b Merge branch 'master' into fail_build_check_in_error_status 2022-03-30 11:08:24 +02:00
alesapin
bcf64a73d1 Followup 2022-03-30 11:00:45 +02:00
alesapin
68ec0d92c0 Remove if category changed 2022-03-30 10:58:52 +02:00
Nikolai Kochetov
3849e63ab1 Change database 2022-03-29 19:06:50 +00:00
Nikolai Kochetov
0810737637 Fix style 2022-03-29 18:58:16 +00:00
Nikolai Kochetov
bb82f77477 Fix check. 2022-03-29 18:46:48 +00:00
Nikolai Kochetov
3995a52da6 Fix check. 2022-03-29 18:36:36 +00:00
Nikolai Kochetov
476c7f9d7e Update ci checks server. 2022-03-29 18:32:28 +00:00
alesapin
1a8b2c9637 Remove submodule changed 2022-03-29 19:50:06 +02:00
alesapin
9220bedb7d Add submodule changed 2022-03-29 19:28:18 +02:00
alesapin
d59941e4f6 Style 2022-03-29 19:15:25 +02:00
alesapin
27390799c1 Fix black 2022-03-29 18:23:18 +02:00
alesapin
bf591b971a Moar categories 2022-03-29 15:53:08 +02:00
alesapin
d0f01516db Resurrect automatic labelling 2022-03-29 15:48:57 +02:00
alesapin
ebd72e433d Fail checks in case of errors 2022-03-29 14:41:47 +02:00
Alexey Milovidov
5e262fba85
Merge pull request #35204 from azat/build-gcc
Add build with GCC
2022-03-29 04:55:15 +03:00
alesapin
7ab8d7178c
Merge pull request #35308 from ClickHouse/clickhouse-keeper
New package clickhouse-keeper
2022-03-28 21:23:17 +02:00
Mikhail f. Shiryaev
ea7939103a
Add debug information about event, rerun only failed jobs 2022-03-28 19:15:11 +02:00
alesapin
8acb5de5b5 Fix build report black 2022-03-28 14:43:15 +02:00
alesapin
6780defb42 Fix build report check 2022-03-26 22:45:45 +01:00
Azat Khuzhin
806a4bcdee Add build with GCC
v2: Add gcc build to "ClickHouse special build check (actions)"
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-03-26 23:42:46 +03:00
alesapin
2712368f78 Push only to the new CI DB 2022-03-25 17:44:53 +01:00
alesapin
137dd93ee0
Merge pull request #35583 from ClickHouse/docker-labels
Docker labels
2022-03-24 20:50:29 +01:00
Mikhail f. Shiryaev
d90627e82f
Fix version string update, fix #35518 2022-03-24 17:50:31 +01:00
Mikhail f. Shiryaev
d6fc6b9c44
Add build-url label to built docker images 2022-03-24 16:24:06 +01:00
Mikhail f. Shiryaev
3516eb0524
Make GITHUB_RUN_URL variable and use it 2022-03-24 15:37:53 +01:00
alesapin
881d5ac44f Don't put red cross if jepsen check couldn't wait for build 2022-03-23 11:32:16 +01:00
Mikhail f. Shiryaev
e6f5a3f98b
Apply black formatter to all *.py files in the repo 2022-03-22 17:39:58 +01:00
Vladimir C
ac6fef5c70
Merge pull request #35124 from vdimir/ci-bugfix-validation 2022-03-22 17:34:15 +01:00
vdimir
41c32e24fe
Skip bugfix_validate_check when no pr-bugfix 2022-03-22 12:20:27 +01:00
Mikhail f. Shiryaev
b9cb64a4a1
Add apk package and reports 2022-03-22 11:11:38 +01:00
Mikhail f. Shiryaev
a0edb3e593
Build tgz and rpm for every running 2022-03-22 11:10:01 +01:00
Mikhail f. Shiryaev
0dd1f4af76
Rename alien arguments and parameters 2022-03-22 11:10:01 +01:00
Mikhail f. Shiryaev
342f7ba567
Migrate to nfpm 2022-03-22 11:09:59 +01:00
Alexey Milovidov
159a73b6d5 Merge branch 'master' into llvm-14 2022-03-20 22:50:20 +01:00
vdimir
daa716f682
fix style 2022-03-18 21:32:59 +01:00
vdimir
2551adc416
Bugfix validate meta check 2022-03-18 16:31:19 +01:00
Mikhail f. Shiryaev
2c6ce4b4a0
Merge pull request #35382 from ClickHouse/push-artifactory-improvement
Push LTS packages to both lts and stable repos
2022-03-18 13:10:37 +01:00
Mikhail f. Shiryaev
0d259c6c29
Push LTS packages to both lts and stable repos 2022-03-17 20:59:46 +01:00
alesapin
d3a5839eb7
Merge pull request #35093 from ClickHouse/stress-test-runlog
Stress test runlog
2022-03-17 20:29:06 +01:00
Mikhail f. Shiryaev
b18daeab6f
Fix bug in push_to_artifactory.py, create a necessary dir 2022-03-17 17:44:01 +01:00
Mikhail f. Shiryaev
d593fda8d5
Fix logic for --no-prestable 2022-03-17 16:50:20 +01:00
Vladimir C
a4c410a1f5
Update tests/ci/docker_pull_helper.py
Co-authored-by: Mikhail f. Shiryaev <mr.felixoid@gmail.com>
2022-03-14 15:55:09 +00:00
vdimir
9f2feb4f0b
Use argparse in functional/integration_test_check.py 2022-03-14 15:52:46 +00:00
vdimir
cf70b79f74
Revert "Bugfix check requires either functional _or_ stateless test"
This reverts commit b8b64b1d15.
2022-03-14 15:43:15 +00:00
vdimir
6f1cf419ac
Fix typo 2022-03-14 13:24:46 +00:00
vdimir
b8b64b1d15
Bugfix check requires either functional _or_ stateless test 2022-03-14 13:09:53 +00:00
Azat Khuzhin
4b770343e1 Mark build action as failed if it was retried and there was no succeeded builds
Builder actions does not shows errors after retries, for example [1]
failed, but the check is green:

    Dump json report {
      'log_url': 'https://s3.amazonaws.com/clickhouse-builds/35204/c5a71a7f10e9d20b116b3e1db02bb444b203c32a/binary_gcc/build_log.log',
      'build_urls': [], <-- empty
      'build_config': {...},
      'elapsed_seconds': 0, 'status': False
    } to build_urls_binary_gcc.json with env build_urls_{build_name}

  [1]: https://github.com/ClickHouse/ClickHouse/runs/5510262456?check_suite_focus=true#logs

And previous build indeed failed [2]:

    Mar 11 08:19:45 ninja: build stopped: subcommand failed.

  [2]: https://s3.amazonaws.com/clickhouse-builds/35204/c5a71a7f10e9d20b116b3e1db02bb444b203c32a/binary_gcc/build_log.log

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-03-14 13:23:51 +03:00
vdimir
e5c63266c2
Integration test bugfix check 2022-03-11 14:14:16 +00:00
vdimir
e757837ec0
Different status colors in report for bugfix validation 2022-03-11 13:36:29 +00:00
vdimir
6614d6eaaf
bugfix validate integration test 2022-03-11 12:50:33 +00:00
Alexey Milovidov
415e2ff223 Remove useless file 2022-03-11 00:49:50 +01:00
vdimir
b8c7e4657f
invert check in validate bugfix 2022-03-10 16:43:44 +00:00
vdimir
000a31df3b
no-random-settings for bugfix validate 2022-03-10 16:43:43 +00:00
vdimir
fcb7e9ed36
fix CLICKHOUSE_CLIENT_DOWNLOAD_URL in download_previous_release.py 2022-03-10 16:43:42 +00:00
vdimir
4947d6db13
Use download_previous_release for bugfix validation
Should be merged with https://github.com/ClickHouse/ClickHouse/pull/27928
2022-03-10 16:43:41 +00:00
vdimir
196645679f
Add bugfix validate check to ci_config 2022-03-10 16:43:41 +00:00
vdimir
da179c607e
Add bugfux validate check 2022-03-10 16:43:40 +00:00
Mikhail f. Shiryaev
74c5873be0
Do not upload runlog two times 2022-03-07 14:31:17 +01:00
Mikhail f. Shiryaev
3e852ae461
Apply black to stress tests script 2022-03-07 14:25:06 +01:00
vdimir
202ac18e76
Skip 01086_odbc_roundtrip for aarch, disable force_tests 2022-03-07 11:04:37 +00:00
Mikhail f. Shiryaev
223ec3d0b6
Put downloaded artifacts to a temorary path 2022-03-06 14:07:47 +01:00
vdimir
9032cc6c3d
Fix stylecheck for tests/ci/release.py 2022-02-25 11:17:45 +00:00
vdimir
5c38203f7d
Argument --commit for release.py is required 2022-02-25 11:06:58 +00:00
vdimir
ef3cbdcf6a
Add check_prerequisites to release.py 2022-02-25 10:53:21 +00:00
Mikhail f. Shiryaev
af19c5c56d
Merge pull request #34828 from ClickHouse/team-keys-lambda
Comment output header for team keys
2022-02-23 10:53:28 +01:00
Mikhail f. Shiryaev
a2f025b292
Comment output header for team keys 2022-02-23 10:51:31 +01:00
Mikhail f. Shiryaev
2386e1ee54
Fix linter issues 2022-02-22 11:40:40 +01:00
Mikhail f. Shiryaev
dd180b83a8
Improve --no-* parameters for scripts 2022-02-22 11:40:39 +01:00
Mikhail f. Shiryaev
c44aeda23c
Merge pull request #34740 from ClickHouse/release-stable
Add a patch release for stable/lts packages to release.py
2022-02-22 11:39:23 +01:00
Mikhail f. Shiryaev
f0c7a7017f
Review points: update -> read_version, comment in _create_gh_label 2022-02-22 11:32:05 +01:00
Mikhail f. Shiryaev
214d35df5e
Add unit tests for git helper 2022-02-21 10:56:04 +01:00
Mikhail f. Shiryaev
b39dfc9ba6
Change regexp to be more strict 2022-02-21 10:19:59 +01:00
alesapin
a5c2ee339f
Update report.py 2022-02-21 10:29:10 +03:00
vdimir
c70901b4e7
Sort additional_html_urls in test report in CI 2022-02-20 20:36:36 +01:00
Alexey Milovidov
aa8f282ad9 Switch to clang/llvm 14 2022-02-19 18:43:02 +01:00
Mikhail f. Shiryaev
d2cbc5af40
Add patch type for stable/lts releases 2022-02-19 00:13:07 +01:00
Mikhail f. Shiryaev
df9165bbff
Refactoring of Release, add Repo
- Do not pass Namespace to Release.do
- Decouple repository to another class
2022-02-19 00:13:00 +01:00
Mikhail f. Shiryaev
0960fbad52
Set selease_branch only once as Release property 2022-02-19 00:10:21 +01:00
Mikhail f. Shiryaev
d2a8cff508
Add release_branch checker 2022-02-19 00:01:42 +01:00