Commit Graph

1004 Commits

Author SHA1 Message Date
Mikhail f. Shiryaev
5f3de6f486
Use the best token instead of the constant 2022-06-16 16:27:49 +02:00
Mikhail f. Shiryaev
d7505d4de7
Change alignment, fix some f-strings 2022-06-16 14:33:39 +02:00
Mikhail f. Shiryaev
7ed305f9b1
Improvement of cherry-pick/backport script
- cherry_pick.py now can ba launched locally, with dry-run
- get rid of fallback import paths
- do not create a huge pile of objects for every sneezing
- the same for hidden imports in deep local functions
- improve logging
- fix imports for cherry_pick_utils entities
- Significantly reduced requests to GraphQL API
2022-06-16 14:32:32 +02:00
Mikhail f. Shiryaev
fe2231dbdb
Upload static binaries from deb builds with lto=thin 2022-06-15 13:18:26 +02:00
Mikhail f. Shiryaev
5d4e96cc30
Change order of uploaded artifacts to rebuild failed binaries 2022-06-15 13:17:45 +02:00
Mikhail f. Shiryaev
c49a96dd19
Merge pull request #38057 from ClickHouse/build-report
Use workflow URL as "link" ref
2022-06-14 22:41:12 +02:00
Mikhail f. Shiryaev
e701adbd28
Use workflow URL as "link" ref 2022-06-14 16:22:41 +02:00
Pavel Novitskiy
f4d757cd6d remove unused args 2022-06-13 17:56:35 +02:00
Mikhail f. Shiryaev
539e423744
Use git.sha to avoid 0000000 2022-06-13 17:41:05 +02:00
Pavel Novitskiy
31c084567a Add release commit hash to image labels 2022-06-13 13:39:28 +02:00
Mikhail f. Shiryaev
9ca03d09cc
Add a way to invalidate docker images cache 2022-06-08 14:47:45 +02:00
Kruglov Pavel
83418ebba2
Merge pull request #37712 from vdimir/duplicate_download_previous_release
Get rid of duplicate download_previous_release
2022-06-07 12:51:34 +02:00
Vladimir C
f7b026f31e
Merge pull request #37825 from vdimir/contrib-trigger-false 2022-06-03 15:31:18 +02:00
vdimir
8228049687
Fix submodule changed label condition 2022-06-03 13:59:34 +02:00
Alexey Milovidov
1529d47207
Merge pull request #34754 from ClickHouse/llvm-14
Switch to clang/llvm 14
2022-06-03 14:07:34 +03:00
Ilya Yatsishin
0650f7538d fix style 2022-06-02 16:17:25 +02:00
Ilya Yatsishin
2ea437de32 fix black 2022-06-02 16:13:52 +02:00
Ilya Yatsishin
a57432659a Merge remote-tracking branch 'origin/master' into aarch64-perf 2022-06-02 14:31:55 +02:00
Ilya Yatsishin
64befe9753 Filter out incompatible performance test 2022-06-02 14:29:24 +02:00
Alexey Milovidov
b5f48a7d3f Merge branch 'master' of github.com:ClickHouse/ClickHouse into llvm-14 2022-06-01 22:09:58 +02:00
Vladimir C
2622791b9e
upd 2022-06-01 16:17:17 +02:00
Vladimir C
773eb15afc
Try mound instead of volume docker arg in stress_check 2022-06-01 14:36:51 +02:00
Vladimir C
42feae8940
fix stress_check.py 2022-06-01 10:44:44 +02:00
vdimir
4d336d0228
Get rid of duplicate download_previous_release 2022-05-31 17:50:29 +00:00
vdimir
c5ac6294ae
Display entires for failed tests at the top of report 2022-05-31 16:18:16 +00:00
alesapin
0e8ab36913 Merge branch 'master' into turn_on_s3_tests 2022-05-29 14:37:10 +02:00
Alexey Milovidov
c1169019d2 Merge branch 'master' into llvm-14 2022-05-29 02:29:02 +02:00
Alexey Milovidov
e48af2efe4
Update report.py 2022-05-28 21:25:42 +03:00
Alexey Milovidov
15f2912dc9
Fix Python. 2022-05-28 05:10:29 +03:00
Alexey Milovidov
f7a5b1fdaf Remove margin in test reports and change the font 2022-05-28 03:24:56 +02:00
Alexey Milovidov
8c94b75516 Merge branch 'master' into llvm-14 2022-05-27 22:24:20 +02:00
mergify[bot]
923ad2e905
Merge branch 'master' into turn_on_s3_tests 2022-05-27 16:31:43 +00:00
alesapin
32167cb6fb Turn on s3 tests 2022-05-27 14:36:12 +02:00
Mikhail f. Shiryaev
e1ed2aa3dc
Add failed builds to the build report 2022-05-25 23:00:33 +02:00
Alexey Milovidov
a5541dc2d5 Merge branch 'master' into llvm-14 2022-05-25 01:56:24 +02:00
Ilya Yatsishin
cda88ebf9c Try to run aarch64 performance tests 2022-05-24 21:47:49 +02:00
Mikhail f. Shiryaev
b4c0f7a621
Simplify labels check 2022-05-24 12:57:06 +02:00
Mikhail f. Shiryaev
90425dedd1
Fail release on status == failure 2022-05-24 11:14:17 +02:00
Mikhail f. Shiryaev
3af9a699d5
Fix ssh-agent socket in docker image 2022-05-24 11:14:16 +02:00
Mikhail f. Shiryaev
249af9c69a
Run container as user, print stdout 2022-05-24 11:14:16 +02:00
Mikhail f. Shiryaev
21d6fc54d5
Do not check docs_release.py for changed files 2022-05-24 11:14:16 +02:00
Mikhail f. Shiryaev
501a8158a5
Don't fail docker images on dispatch or other events 2022-05-24 11:14:14 +02:00
Mikhail f. Shiryaev
cfe98c4aba
Fix publishing of content.clickhouse.com
- Publish only benchmarks and data
- Minimize clickhouse/docs-release
- Run it as a normal user
- Speed up running by not redownload virtual env deps
- Clean out docs and blog buildging
- Minimize docs/tools/requirements.txt
2022-05-23 11:50:02 +02:00
Alexey Milovidov
dce7a86ca9 Merge branch 'master' into llvm-14 2022-05-22 22:38:07 +02:00
Mikhail f. Shiryaev
52d81ecd86
Merge pull request #37374 from ClickHouse/docker-server-build
Fix docker server images building
2022-05-20 07:17:32 +02:00
Alexey Milovidov
87c6f806cf
Merge pull request #37371 from ClickHouse/safe-fail-on-cidb-down
Do not fail CI if events clickhouse is down
2022-05-20 03:52:04 +03:00
Mikhail f. Shiryaev
39097a4cfc
Fix automatic bucket_prefix, exit 1 on failures 2022-05-20 00:06:44 +02:00
Mikhail f. Shiryaev
de23fdccf6
Fix get_release_or_pr execution in docker_server 2022-05-19 23:00:30 +02:00
Mikhail f. Shiryaev
de39a48c33
Append performance_url to build_urls 2022-05-19 22:44:10 +02:00
Mikhail f. Shiryaev
121571ec5d
Ugly hacks for performance.tgz artifacts 2022-05-19 22:37:54 +02:00
alesapin
711b94064e
Merge pull request #36538 from ClickHouse/merge-builds
Merge release and performance builds
2022-05-19 19:19:18 +02:00
Mikhail f. Shiryaev
7134fc848f
Use SSL certs verification for CI DB 2022-05-19 18:23:20 +02:00
Mikhail f. Shiryaev
8a74b1cf2f
Add forgotten insert_events_into to ast-fuzzer CI 2022-05-19 17:56:35 +02:00
Mikhail f. Shiryaev
338f638557
Fix linter errors 2022-05-19 17:54:56 +02:00
Mikhail f. Shiryaev
6a9d36a9e2
Do not fail CI on events DB down, improve logging 2022-05-19 17:53:00 +02:00
Mikhail f. Shiryaev
9acb42fcdb
Add time to wait for workflow canceled 2022-05-19 15:26:02 +02:00
Mikhail f. Shiryaev
3d0e4c56e2
Fix prefetch release branch 2022-05-19 10:05:34 +02:00
Mikhail f. Shiryaev
c6e2dd1c43
Create release without draft step 2022-05-18 14:34:41 +02:00
Mikhail f. Shiryaev
1c11823935
Get rid of intermediate prestable release 2022-05-18 14:34:40 +02:00
Mikhail f. Shiryaev
b93a4e2da3
Minor improvements on variables and comments 2022-05-18 14:34:40 +02:00
Mikhail f. Shiryaev
3b1c858bff
Rollback prestable part on failed testing 2022-05-18 14:34:38 +02:00
Mikhail f. Shiryaev
6cedd2f671
Catch all Exceptions in context managers 2022-05-18 14:32:49 +02:00
Mikhail f. Shiryaev
33eed2280b
Fix linter issues 2022-05-18 01:38:46 +02:00
Mikhail f. Shiryaev
48751f5a91
Checkout master:master for performance output in packager 2022-05-18 01:38:44 +02:00
Mikhail f. Shiryaev
1f67665c95
Build performance output in release builds 2022-05-18 01:38:44 +02:00
Mikhail f. Shiryaev
b929eee8db
Remove redundant CHECK_NAME from build_check.py 2022-05-18 01:38:41 +02:00
Mikhail f. Shiryaev
e6e0f0589d
Update run-check.py to match PR template, add comments 2022-05-17 21:43:22 +02:00
Nikolai Kochetov
f1bc2bc615 Merge branch 'master' into llvm-14 2022-05-16 12:03:26 +02:00
Alexey Milovidov
3b9d8f9d19
Merge pull request #37095 from ClickHouse/upload-ppc64le-binary
Add PowerPC binary to universal install script
2022-05-15 04:33:06 +03:00
bkuschel
16e4b0db20
Fix coverity build 2022-05-13 10:22:23 -07:00
Mikhail f. Shiryaev
e9733f0cbe
Fix fasttest ccache permissions 2022-05-12 09:18:28 +02:00
Mikhail f. Shiryaev
3fa955aec1
Merge pull request #37057 from ClickHouse/changelog
Changelog script
2022-05-11 10:54:29 +02:00
Mikhail f. Shiryaev
d5b1e39bb9
Merge pull request #36866 from ClickHouse/integration-tests
Fix using proper image for integration tests; improve logging; fix docker volume cleaning in integration-tests-runner.
2022-05-11 10:46:51 +02:00
Alexey Milovidov
99cc8d47fe Add PowerPC binary to universal install script 2022-05-11 03:02:01 +02:00
alesapin
0f276a0956
Merge pull request #36947 from ClickHouse/dump_ordered_sessions_map
Force keeper snapshot equality on different replicas
2022-05-10 23:36:09 +02:00
Mikhail f. Shiryaev
eb219ac014
Improve logging in integration_test_check.py 2022-05-10 17:41:01 +02:00
alesapin
dcf2a1d245 Turn off gcc-11 2022-05-10 13:24:20 +02:00
Mikhail f. Shiryaev
24b7a7538d
Add kwargs to runner and is_shallow function 2022-05-10 11:25:33 +02:00
wuxiaobai24
d3dca101aa fix labels check output error 2022-05-08 14:41:03 +08:00
Mikhail f. Shiryaev
ab6c3169ac
Use ENV for API_URL customization 2022-05-06 20:50:44 +02:00
Mikhail f. Shiryaev
b85de7e3e2
Fix installation_id filter, minimize docker images diff 2022-05-06 19:15:01 +02:00
Mikhail f. Shiryaev
5b70f7f0dc
Fail performance comparison tests on errors 2022-05-04 13:02:46 +02:00
Alexey Milovidov
ff4e562997
Merge pull request #36641 from ClickHouse/release-prefetch
Simplify check_branch, prefetch target branches
2022-05-01 13:53:35 +03:00
Mikhail f. Shiryaev
5c8c5415df
Adjust docs_check to use in foreign repo 2022-04-29 15:23:24 +02:00
Mikhail f. Shiryaev
0a131b41ea
Improve release.py
- Improve check-dirty
- Prefetch target branches
- Prefetch release commit
- Simplify check_branch
2022-04-28 16:55:02 +02:00
Mikhail f. Shiryaev
824335ca33
Filter out sychronized events globbaly 2022-04-25 14:45:11 +02:00
Mikhail f. Shiryaev
83c02e8014
Fix version autodetection for docker_server.py 2022-04-22 16:51:29 +02:00
Mikhail f. Shiryaev
2dfdbe0afa
Update contributors each release 2022-04-21 20:10:12 +02:00
Mikhail f. Shiryaev
c65c832edb
Adjust git_helper and version_helper for shallow clone 2022-04-21 20:08:55 +02:00
Mikhail f. Shiryaev
9abd28ebc9
Prepare update_contributors for release.py step 2022-04-21 20:08:54 +02:00
Mikhail f. Shiryaev
fc5107623f
Checkout shallow repository for builds 2022-04-21 20:08:52 +02:00
Mikhail f. Shiryaev
139811b6f1
Consistent "force tests" label 2022-04-21 16:37:51 +02:00
Alexey Milovidov
dd93d5d872
Merge pull request #36422 from ClickHouse/check-revert-prs
Check revert prs
2022-04-21 02:25:34 +03:00
Mikhail f. Shiryaev
1e9d80a9c2
Merge pull request #36297 from ClickHouse/docs-staging
Docs staging
2022-04-20 10:47:54 +02:00
Mikhail f. Shiryaev
462a28a2e6
Remove innecessary requirement 2022-04-20 10:24:12 +02:00
Mikhail f. Shiryaev
8e2874328f
Prepare docs_check.py to be used in docs-clickhouse 2022-04-19 23:35:39 +02:00
Mikhail f. Shiryaev
da55ba6af2
Check Revert PRs and mark it as pr-not-for-changelog 2022-04-19 14:48:58 +02:00
Mikhail f. Shiryaev
44269d06b5
Improve some variables 2022-04-19 14:47:18 +02:00
Mikhail f. Shiryaev
40dafbe015
Don't put built documentation to output path 2022-04-19 10:43:12 +02:00
Mikhail f. Shiryaev
c1014aa60c
Use a new builder as a check image 2022-04-19 10:43:11 +02:00
Mikhail f. Shiryaev
e96ba17c30
Fallback to a default event data when API is broken 2022-04-19 09:45:40 +02:00
Alexey Milovidov
73b52859df Merge branch 'master' into llvm-14 2022-04-16 00:46:58 +02:00
Mikhail f. Shiryaev
401efa5fd4
Improve docker building and logging for approve lambda 2022-04-15 01:28:14 +02:00
Mikhail f. Shiryaev
e689322980
Improve logic to decide cancelling workflow 2022-04-15 01:28:13 +02:00
Mikhail f. Shiryaev
fad0aeb0d3
Fix some linter issues 2022-04-15 01:28:13 +02:00
Mikhail f. Shiryaev
646fd45645
Request unfiltered workflows in threads 2022-04-15 01:28:12 +02:00
Mikhail f. Shiryaev
3e6dc24a7b
Do not fail the whole lambda if one page failed 2022-04-15 01:28:12 +02:00
Mikhail f. Shiryaev
52a7544aa4
Fix cancel-lambda for closed PRs
- Create a fallback function for some edge cases
- Process synchronized PRs as help for cancel-workflow action
2022-04-15 01:28:12 +02:00
Mikhail f. Shiryaev
323cf6c5bf
Merge TRUSTED_CONTRIBUTORS in lambda and import in check 2022-04-14 13:25:54 +02:00
alesapin
df5453874a
Merge pull request #36214 from ClickHouse/tavplubix-patch-4
Make stateless tests with s3 always green
2022-04-14 12:04:15 +02:00
Tyler Hannan
d2a7c4541e whitespace 2022-04-14 00:36:38 +02:00
Tyler Hannan
4cce325941 Add Tyler Hannan to contributors 2022-04-14 00:25:14 +02:00
tavplubix
01a1babd3b
Update ci_config.py 2022-04-13 23:56:34 +03:00
Mikhail f. Shiryaev
693711544c
Use a proper image in fasttest 2022-04-13 14:06:50 +02:00
alesapin
34b920adb0
Merge pull request #36159 from ClickHouse/cancel-lambda
Fix a logical error left after debugging
2022-04-12 11:33:13 +02:00
Mikhail f. Shiryaev
30a9fce67a
Rebuild the least docker layer 2022-04-12 11:01:25 +02:00
Mikhail f. Shiryaev
abf8c3c5ad
Fix and improve cancel-rerun lambda
- Fix rerun for DocsCheck
- Additional check for workflow head sha1
- Fix workflow debug info
- Fix event_data parsing
- Always print debug info
2022-04-12 11:00:01 +02:00
Mikhail f. Shiryaev
280a2d847c
Merge pull request #36139 from ClickHouse/fasttest-ccache
Upload ccache for the first run in PR
2022-04-12 08:37:21 +02:00
Mikhail f. Shiryaev
faa26b4377
Improve report and variables naming 2022-04-11 20:05:43 +02:00
Mikhail f. Shiryaev
11897d56b9
Upload ccache for the first run in PR 2022-04-11 17:03:46 +02:00
Mikhail f. Shiryaev
9a946c0213
Add typing 2022-04-11 15:35:13 +02:00
Alexey Milovidov
836fd2dd87
Merge pull request #36080 from nvartolomei/nv/trusted-tonickkozlov
Add tonickkozlov to trusted users for auto ci run
2022-04-09 02:55:50 +03:00
Mikhail f. Shiryaev
a09fcdac1f
Do not fail on a poisoned ccache 2022-04-09 00:41:39 +02:00
Mikhail f. Shiryaev
cb962b8ad5
Stop rewriting BUILD_NAME env in build_check.py 2022-04-08 22:34:58 +02:00
Mikhail f. Shiryaev
f506b6c1a3
Fix linter issues and missed formatting 2022-04-08 19:50:41 +02:00
Nicolae Vartolomei
081de5b086 Add tonickkozlov to trusted users for auto ci run
Cloudflare employee contributing to ClickHouse
2022-04-08 15:21:36 +00:00
Mikhail f. Shiryaev
44c80a388f
Merge pull request #36064 from ClickHouse/fix-rerun-lambda
Add debug and fix cancel_rerun lambda
2022-04-08 13:33:37 +02:00
Mikhail f. Shiryaev
90a863bbc2
Merge pull request #36029 from ClickHouse/fix-release-workflow
Fix release workflow
2022-04-08 13:09:01 +02:00
vdimir
1322fab333
Fix style in run_check.py 2022-04-08 12:51:58 +02:00
Mikhail f. Shiryaev
811178da54
Add debug and fix cancel_rerun lambda 2022-04-08 12:28:25 +02:00
Vladimir C
608f4c3b70
Merge pull request #35991 from vdimir/run-check-debug-labels 2022-04-08 12:00:37 +02:00
Mikhail f. Shiryaev
a5b1a0620c
Add default IMAGES_PATH value 2022-04-07 18:35:59 +02:00
Mikhail f. Shiryaev
dd4bd4abba
Simplify and fix coverity 2022-04-07 18:35:58 +02:00
Mikhail f. Shiryaev
44895e5287
Improve build cache for docker images
- Save all layer's cache
- Use cache with fallback to a latest tags
2022-04-07 17:16:43 +02:00
Mikhail f. Shiryaev
a7145cf087
Move version_arg to version_helper, add tests 2022-04-07 13:48:52 +02:00
Mikhail f. Shiryaev
58d381de5c
A temporary fix for artifactory push before multiple architectures 2022-04-07 12:48:54 +02:00
Mikhail f. Shiryaev
eb62b18845
Improve and fix edge cases for docker_server.py
- Allow define version as file
- Add inline cache
- Fix auto_release_type function
2022-04-07 12:48:53 +02:00
Mikhail f. Shiryaev
846e4b94fb
Tiny improvements to git and version helpers 2022-04-07 12:48:51 +02:00
Mikhail f. Shiryaev
2d87e3587d
Merge pull request #34895 from DevTeamBK/coverity_scan
Attempt at Nightly Coverity Scan and upload
2022-04-06 19:07:00 +02:00
Mikhail f. Shiryaev
12442fd0a5
Add description for missing builds 2022-04-06 15:16:16 +02:00
Mikhail f. Shiryaev
1323c3617f
Fix linter points 2022-04-06 15:16:16 +02:00
Mikhail f. Shiryaev
19e0e6e765
Fix failing BuilderReport 2022-04-06 15:16:15 +02:00
vdimir
670fad56fc
Print labels to log in run_check.py 2022-04-06 11:57:11 +02:00
Mikhail f. Shiryaev
62fa528e7d
Fix syntax error in build_check.py 2022-04-06 10:15:36 +02:00
Boris Kuschel
2298b80ed8
Add coverity scan
Signed-off-by: Boris Kuschel <Boris.Kuschel@ibm.com>
2022-04-05 19:52:33 +02:00
Mikhail f. Shiryaev
a665861f5f
Improve descriptrion check logging 2022-04-05 01:06:46 +02:00
Mikhail f. Shiryaev
1d60824d6a
Highlight headers in PR template 2022-04-05 00:59:44 +02:00
Mikhail f. Shiryaev
6b83e2b2a7
Fix automatic bucket prefix for master 2022-04-01 17:53:43 +02:00
Mikhail f. Shiryaev
98aa8bf579
Improve version_helper.py
- Add helper functions
- Add __lt__ and __eq__ to compare versions between each other
2022-04-01 12:32:26 +02:00
Mikhail f. Shiryaev
66851b28b7
Make _check_tag public 2022-04-01 12:32:25 +02:00