Commit Graph

1345 Commits

Author SHA1 Message Date
Ilya Yatsishin
64befe9753 Filter out incompatible performance test 2022-06-02 14:29:24 +02:00
Alexey Milovidov
b5f48a7d3f Merge branch 'master' of github.com:ClickHouse/ClickHouse into llvm-14 2022-06-01 22:09:58 +02:00
Vladimir C
2622791b9e
upd 2022-06-01 16:17:17 +02:00
Vladimir C
773eb15afc
Try mound instead of volume docker arg in stress_check 2022-06-01 14:36:51 +02:00
Vladimir C
42feae8940
fix stress_check.py 2022-06-01 10:44:44 +02:00
vdimir
4d336d0228
Get rid of duplicate download_previous_release 2022-05-31 17:50:29 +00:00
vdimir
c5ac6294ae
Display entires for failed tests at the top of report 2022-05-31 16:18:16 +00:00
alesapin
0e8ab36913 Merge branch 'master' into turn_on_s3_tests 2022-05-29 14:37:10 +02:00
Alexey Milovidov
c1169019d2 Merge branch 'master' into llvm-14 2022-05-29 02:29:02 +02:00
Alexey Milovidov
e48af2efe4
Update report.py 2022-05-28 21:25:42 +03:00
Alexey Milovidov
15f2912dc9
Fix Python. 2022-05-28 05:10:29 +03:00
Alexey Milovidov
f7a5b1fdaf Remove margin in test reports and change the font 2022-05-28 03:24:56 +02:00
Alexey Milovidov
8c94b75516 Merge branch 'master' into llvm-14 2022-05-27 22:24:20 +02:00
mergify[bot]
923ad2e905
Merge branch 'master' into turn_on_s3_tests 2022-05-27 16:31:43 +00:00
alesapin
32167cb6fb Turn on s3 tests 2022-05-27 14:36:12 +02:00
Mikhail f. Shiryaev
e1ed2aa3dc
Add failed builds to the build report 2022-05-25 23:00:33 +02:00
Alexey Milovidov
a5541dc2d5 Merge branch 'master' into llvm-14 2022-05-25 01:56:24 +02:00
Ilya Yatsishin
cda88ebf9c Try to run aarch64 performance tests 2022-05-24 21:47:49 +02:00
Mikhail f. Shiryaev
b4c0f7a621
Simplify labels check 2022-05-24 12:57:06 +02:00
Mikhail f. Shiryaev
90425dedd1
Fail release on status == failure 2022-05-24 11:14:17 +02:00
Mikhail f. Shiryaev
3af9a699d5
Fix ssh-agent socket in docker image 2022-05-24 11:14:16 +02:00
Mikhail f. Shiryaev
249af9c69a
Run container as user, print stdout 2022-05-24 11:14:16 +02:00
Mikhail f. Shiryaev
21d6fc54d5
Do not check docs_release.py for changed files 2022-05-24 11:14:16 +02:00
Mikhail f. Shiryaev
501a8158a5
Don't fail docker images on dispatch or other events 2022-05-24 11:14:14 +02:00
Mikhail f. Shiryaev
cfe98c4aba
Fix publishing of content.clickhouse.com
- Publish only benchmarks and data
- Minimize clickhouse/docs-release
- Run it as a normal user
- Speed up running by not redownload virtual env deps
- Clean out docs and blog buildging
- Minimize docs/tools/requirements.txt
2022-05-23 11:50:02 +02:00
Alexey Milovidov
dce7a86ca9 Merge branch 'master' into llvm-14 2022-05-22 22:38:07 +02:00
Mikhail f. Shiryaev
52d81ecd86
Merge pull request #37374 from ClickHouse/docker-server-build
Fix docker server images building
2022-05-20 07:17:32 +02:00
Alexey Milovidov
87c6f806cf
Merge pull request #37371 from ClickHouse/safe-fail-on-cidb-down
Do not fail CI if events clickhouse is down
2022-05-20 03:52:04 +03:00
Mikhail f. Shiryaev
39097a4cfc
Fix automatic bucket_prefix, exit 1 on failures 2022-05-20 00:06:44 +02:00
Mikhail f. Shiryaev
de23fdccf6
Fix get_release_or_pr execution in docker_server 2022-05-19 23:00:30 +02:00
Mikhail f. Shiryaev
de39a48c33
Append performance_url to build_urls 2022-05-19 22:44:10 +02:00
Mikhail f. Shiryaev
121571ec5d
Ugly hacks for performance.tgz artifacts 2022-05-19 22:37:54 +02:00
alesapin
711b94064e
Merge pull request #36538 from ClickHouse/merge-builds
Merge release and performance builds
2022-05-19 19:19:18 +02:00
Mikhail f. Shiryaev
7134fc848f
Use SSL certs verification for CI DB 2022-05-19 18:23:20 +02:00
Mikhail f. Shiryaev
8a74b1cf2f
Add forgotten insert_events_into to ast-fuzzer CI 2022-05-19 17:56:35 +02:00
Mikhail f. Shiryaev
338f638557
Fix linter errors 2022-05-19 17:54:56 +02:00
Mikhail f. Shiryaev
6a9d36a9e2
Do not fail CI on events DB down, improve logging 2022-05-19 17:53:00 +02:00
Mikhail f. Shiryaev
9acb42fcdb
Add time to wait for workflow canceled 2022-05-19 15:26:02 +02:00
Mikhail f. Shiryaev
3d0e4c56e2
Fix prefetch release branch 2022-05-19 10:05:34 +02:00
Mikhail f. Shiryaev
c6e2dd1c43
Create release without draft step 2022-05-18 14:34:41 +02:00
Mikhail f. Shiryaev
1c11823935
Get rid of intermediate prestable release 2022-05-18 14:34:40 +02:00
Mikhail f. Shiryaev
b93a4e2da3
Minor improvements on variables and comments 2022-05-18 14:34:40 +02:00
Mikhail f. Shiryaev
3b1c858bff
Rollback prestable part on failed testing 2022-05-18 14:34:38 +02:00
Mikhail f. Shiryaev
6cedd2f671
Catch all Exceptions in context managers 2022-05-18 14:32:49 +02:00
Mikhail f. Shiryaev
33eed2280b
Fix linter issues 2022-05-18 01:38:46 +02:00
Mikhail f. Shiryaev
48751f5a91
Checkout master:master for performance output in packager 2022-05-18 01:38:44 +02:00
Mikhail f. Shiryaev
1f67665c95
Build performance output in release builds 2022-05-18 01:38:44 +02:00
Mikhail f. Shiryaev
b929eee8db
Remove redundant CHECK_NAME from build_check.py 2022-05-18 01:38:41 +02:00
Mikhail f. Shiryaev
e6e0f0589d
Update run-check.py to match PR template, add comments 2022-05-17 21:43:22 +02:00
Nikolai Kochetov
f1bc2bc615 Merge branch 'master' into llvm-14 2022-05-16 12:03:26 +02:00
Alexey Milovidov
3b9d8f9d19
Merge pull request #37095 from ClickHouse/upload-ppc64le-binary
Add PowerPC binary to universal install script
2022-05-15 04:33:06 +03:00
bkuschel
16e4b0db20
Fix coverity build 2022-05-13 10:22:23 -07:00
Mikhail f. Shiryaev
e9733f0cbe
Fix fasttest ccache permissions 2022-05-12 09:18:28 +02:00
Mikhail f. Shiryaev
3fa955aec1
Merge pull request #37057 from ClickHouse/changelog
Changelog script
2022-05-11 10:54:29 +02:00
Mikhail f. Shiryaev
d5b1e39bb9
Merge pull request #36866 from ClickHouse/integration-tests
Fix using proper image for integration tests; improve logging; fix docker volume cleaning in integration-tests-runner.
2022-05-11 10:46:51 +02:00
Alexey Milovidov
99cc8d47fe Add PowerPC binary to universal install script 2022-05-11 03:02:01 +02:00
alesapin
0f276a0956
Merge pull request #36947 from ClickHouse/dump_ordered_sessions_map
Force keeper snapshot equality on different replicas
2022-05-10 23:36:09 +02:00
Mikhail f. Shiryaev
eb219ac014
Improve logging in integration_test_check.py 2022-05-10 17:41:01 +02:00
alesapin
dcf2a1d245 Turn off gcc-11 2022-05-10 13:24:20 +02:00
Mikhail f. Shiryaev
24b7a7538d
Add kwargs to runner and is_shallow function 2022-05-10 11:25:33 +02:00
wuxiaobai24
d3dca101aa fix labels check output error 2022-05-08 14:41:03 +08:00
Mikhail f. Shiryaev
ab6c3169ac
Use ENV for API_URL customization 2022-05-06 20:50:44 +02:00
Mikhail f. Shiryaev
b85de7e3e2
Fix installation_id filter, minimize docker images diff 2022-05-06 19:15:01 +02:00
mergify[bot]
89c36a4eca
Merge branch 'master' into add-more-s3-tests 2022-05-06 11:57:50 +00:00
Mikhail f. Shiryaev
5b70f7f0dc
Fail performance comparison tests on errors 2022-05-04 13:02:46 +02:00
Alexey Milovidov
ff4e562997
Merge pull request #36641 from ClickHouse/release-prefetch
Simplify check_branch, prefetch target branches
2022-05-01 13:53:35 +03:00
mergify[bot]
ed2c4ecc43
Merge branch 'master' into add-more-s3-tests 2022-04-29 19:41:06 +00:00
Mikhail f. Shiryaev
5c8c5415df
Adjust docs_check to use in foreign repo 2022-04-29 15:23:24 +02:00
Mikhail f. Shiryaev
0a131b41ea
Improve release.py
- Improve check-dirty
- Prefetch target branches
- Prefetch release commit
- Simplify check_branch
2022-04-28 16:55:02 +02:00
Mikhail f. Shiryaev
824335ca33
Filter out sychronized events globbaly 2022-04-25 14:45:11 +02:00
Mikhail f. Shiryaev
83c02e8014
Fix version autodetection for docker_server.py 2022-04-22 16:51:29 +02:00
Mikhail f. Shiryaev
2dfdbe0afa
Update contributors each release 2022-04-21 20:10:12 +02:00
Mikhail f. Shiryaev
c65c832edb
Adjust git_helper and version_helper for shallow clone 2022-04-21 20:08:55 +02:00
Mikhail f. Shiryaev
9abd28ebc9
Prepare update_contributors for release.py step 2022-04-21 20:08:54 +02:00
Mikhail f. Shiryaev
fc5107623f
Checkout shallow repository for builds 2022-04-21 20:08:52 +02:00
Mikhail f. Shiryaev
139811b6f1
Consistent "force tests" label 2022-04-21 16:37:51 +02:00
Alexey Milovidov
dd93d5d872
Merge pull request #36422 from ClickHouse/check-revert-prs
Check revert prs
2022-04-21 02:25:34 +03:00
Mikhail f. Shiryaev
1e9d80a9c2
Merge pull request #36297 from ClickHouse/docs-staging
Docs staging
2022-04-20 10:47:54 +02:00
Mikhail f. Shiryaev
462a28a2e6
Remove innecessary requirement 2022-04-20 10:24:12 +02:00
Mikhail f. Shiryaev
8e2874328f
Prepare docs_check.py to be used in docs-clickhouse 2022-04-19 23:35:39 +02:00
Mikhail f. Shiryaev
da55ba6af2
Check Revert PRs and mark it as pr-not-for-changelog 2022-04-19 14:48:58 +02:00
Mikhail f. Shiryaev
44269d06b5
Improve some variables 2022-04-19 14:47:18 +02:00
mergify[bot]
b5058f9770
Merge branch 'master' into add-more-s3-tests 2022-04-19 10:11:08 +00:00
Mikhail f. Shiryaev
40dafbe015
Don't put built documentation to output path 2022-04-19 10:43:12 +02:00
Mikhail f. Shiryaev
c1014aa60c
Use a new builder as a check image 2022-04-19 10:43:11 +02:00
Mikhail f. Shiryaev
e96ba17c30
Fallback to a default event data when API is broken 2022-04-19 09:45:40 +02:00
Alexey Milovidov
73b52859df Merge branch 'master' into llvm-14 2022-04-16 00:46:58 +02:00
Mikhail f. Shiryaev
401efa5fd4
Improve docker building and logging for approve lambda 2022-04-15 01:28:14 +02:00
Mikhail f. Shiryaev
e689322980
Improve logic to decide cancelling workflow 2022-04-15 01:28:13 +02:00
Mikhail f. Shiryaev
fad0aeb0d3
Fix some linter issues 2022-04-15 01:28:13 +02:00
Mikhail f. Shiryaev
646fd45645
Request unfiltered workflows in threads 2022-04-15 01:28:12 +02:00
Mikhail f. Shiryaev
3e6dc24a7b
Do not fail the whole lambda if one page failed 2022-04-15 01:28:12 +02:00
Mikhail f. Shiryaev
52a7544aa4
Fix cancel-lambda for closed PRs
- Create a fallback function for some edge cases
- Process synchronized PRs as help for cancel-workflow action
2022-04-15 01:28:12 +02:00
Mikhail f. Shiryaev
323cf6c5bf
Merge TRUSTED_CONTRIBUTORS in lambda and import in check 2022-04-14 13:25:54 +02:00
alesapin
df5453874a
Merge pull request #36214 from ClickHouse/tavplubix-patch-4
Make stateless tests with s3 always green
2022-04-14 12:04:15 +02:00
Tyler Hannan
d2a7c4541e whitespace 2022-04-14 00:36:38 +02:00
Tyler Hannan
4cce325941 Add Tyler Hannan to contributors 2022-04-14 00:25:14 +02:00
tavplubix
01a1babd3b
Update ci_config.py 2022-04-13 23:56:34 +03:00
mergify[bot]
75a16d3801
Merge branch 'master' into add-more-s3-tests 2022-04-13 12:30:47 +00:00
Mikhail f. Shiryaev
693711544c
Use a proper image in fasttest 2022-04-13 14:06:50 +02:00
kssenii
6f3373b37e Mark as always green 2022-04-13 12:04:31 +02:00
mergify[bot]
02445f1f44
Merge branch 'master' into add-more-s3-tests 2022-04-12 16:52:39 +00:00
alesapin
34b920adb0
Merge pull request #36159 from ClickHouse/cancel-lambda
Fix a logical error left after debugging
2022-04-12 11:33:13 +02:00
Mikhail f. Shiryaev
30a9fce67a
Rebuild the least docker layer 2022-04-12 11:01:25 +02:00
Mikhail f. Shiryaev
abf8c3c5ad
Fix and improve cancel-rerun lambda
- Fix rerun for DocsCheck
- Additional check for workflow head sha1
- Fix workflow debug info
- Fix event_data parsing
- Always print debug info
2022-04-12 11:00:01 +02:00
Mikhail f. Shiryaev
280a2d847c
Merge pull request #36139 from ClickHouse/fasttest-ccache
Upload ccache for the first run in PR
2022-04-12 08:37:21 +02:00
Mikhail f. Shiryaev
faa26b4377
Improve report and variables naming 2022-04-11 20:05:43 +02:00
Mikhail f. Shiryaev
11897d56b9
Upload ccache for the first run in PR 2022-04-11 17:03:46 +02:00
Mikhail f. Shiryaev
9a946c0213
Add typing 2022-04-11 15:35:13 +02:00
Alexey Milovidov
836fd2dd87
Merge pull request #36080 from nvartolomei/nv/trusted-tonickkozlov
Add tonickkozlov to trusted users for auto ci run
2022-04-09 02:55:50 +03:00
Mikhail f. Shiryaev
a09fcdac1f
Do not fail on a poisoned ccache 2022-04-09 00:41:39 +02:00
Mikhail f. Shiryaev
cb962b8ad5
Stop rewriting BUILD_NAME env in build_check.py 2022-04-08 22:34:58 +02:00
Mikhail f. Shiryaev
f506b6c1a3
Fix linter issues and missed formatting 2022-04-08 19:50:41 +02:00
Nicolae Vartolomei
081de5b086 Add tonickkozlov to trusted users for auto ci run
Cloudflare employee contributing to ClickHouse
2022-04-08 15:21:36 +00:00
Mikhail f. Shiryaev
44c80a388f
Merge pull request #36064 from ClickHouse/fix-rerun-lambda
Add debug and fix cancel_rerun lambda
2022-04-08 13:33:37 +02:00
Mikhail f. Shiryaev
90a863bbc2
Merge pull request #36029 from ClickHouse/fix-release-workflow
Fix release workflow
2022-04-08 13:09:01 +02:00
vdimir
1322fab333
Fix style in run_check.py 2022-04-08 12:51:58 +02:00
Mikhail f. Shiryaev
811178da54
Add debug and fix cancel_rerun lambda 2022-04-08 12:28:25 +02:00
Vladimir C
608f4c3b70
Merge pull request #35991 from vdimir/run-check-debug-labels 2022-04-08 12:00:37 +02:00
Mikhail f. Shiryaev
a5b1a0620c
Add default IMAGES_PATH value 2022-04-07 18:35:59 +02:00
Mikhail f. Shiryaev
dd4bd4abba
Simplify and fix coverity 2022-04-07 18:35:58 +02:00
Mikhail f. Shiryaev
44895e5287
Improve build cache for docker images
- Save all layer's cache
- Use cache with fallback to a latest tags
2022-04-07 17:16:43 +02:00
mergify[bot]
a9c6e82814
Merge branch 'master' into add-more-s3-tests 2022-04-07 14:40:58 +00:00
Mikhail f. Shiryaev
a7145cf087
Move version_arg to version_helper, add tests 2022-04-07 13:48:52 +02:00
Mikhail f. Shiryaev
58d381de5c
A temporary fix for artifactory push before multiple architectures 2022-04-07 12:48:54 +02:00
Mikhail f. Shiryaev
eb62b18845
Improve and fix edge cases for docker_server.py
- Allow define version as file
- Add inline cache
- Fix auto_release_type function
2022-04-07 12:48:53 +02:00
Mikhail f. Shiryaev
846e4b94fb
Tiny improvements to git and version helpers 2022-04-07 12:48:51 +02:00
Mikhail f. Shiryaev
2d87e3587d
Merge pull request #34895 from DevTeamBK/coverity_scan
Attempt at Nightly Coverity Scan and upload
2022-04-06 19:07:00 +02:00
Mikhail f. Shiryaev
12442fd0a5
Add description for missing builds 2022-04-06 15:16:16 +02:00
Mikhail f. Shiryaev
1323c3617f
Fix linter points 2022-04-06 15:16:16 +02:00
Mikhail f. Shiryaev
19e0e6e765
Fix failing BuilderReport 2022-04-06 15:16:15 +02:00
kssenii
cb622fbef2 Merge master 2022-04-06 12:20:33 +02:00
vdimir
670fad56fc
Print labels to log in run_check.py 2022-04-06 11:57:11 +02:00
Mikhail f. Shiryaev
62fa528e7d
Fix syntax error in build_check.py 2022-04-06 10:15:36 +02:00
Boris Kuschel
2298b80ed8
Add coverity scan
Signed-off-by: Boris Kuschel <Boris.Kuschel@ibm.com>
2022-04-05 19:52:33 +02:00
Mikhail f. Shiryaev
a665861f5f
Improve descriptrion check logging 2022-04-05 01:06:46 +02:00
Mikhail f. Shiryaev
1d60824d6a
Highlight headers in PR template 2022-04-05 00:59:44 +02:00
Mikhail f. Shiryaev
6b83e2b2a7
Fix automatic bucket prefix for master 2022-04-01 17:53:43 +02:00
Mikhail f. Shiryaev
98aa8bf579
Improve version_helper.py
- Add helper functions
- Add __lt__ and __eq__ to compare versions between each other
2022-04-01 12:32:26 +02:00
Mikhail f. Shiryaev
66851b28b7
Make _check_tag public 2022-04-01 12:32:25 +02:00
Mikhail f. Shiryaev
00a3734078
Cosmetic improvement 2022-04-01 12:32:24 +02:00
Mikhail f. Shiryaev
9aab7e9910
Create a script to build and push server images 2022-04-01 12:32:23 +02:00
Mikhail f. Shiryaev
3e7c46075a
Clean out dead code from version_helper 2022-04-01 11:59:49 +02:00
Mikhail f. Shiryaev
93cfc4d590
Add validate_version function to version_helper.py 2022-04-01 11:59:48 +02:00
Mikhail f. Shiryaev
5212ff0146
Improve docker_images_check logging 2022-04-01 11:59:48 +02:00
Mikhail f. Shiryaev
90be03c750
Rework env_helper to return correct paths 2022-04-01 11:59:47 +02:00
Alexey Milovidov
93edf05259
Merge branch 'master' into llvm-14 2022-04-01 04:49:03 +03:00
Mikhail f. Shiryaev
4ba7cf6d1b
Fix latest_error referenced before assignment 2022-03-31 15:40:32 +02:00
alesapin
02574bd05b
Merge pull request #35766 from ClickHouse/resurrect_official_flag
Resurrect build hash
2022-03-30 19:34:19 +02:00
alesapin
b388bb8448
Merge pull request #35718 from ClickHouse/fail_build_check_in_error_status
Fail CI checks in case of errors in checks (not failed tests)
2022-03-30 19:28:22 +02:00
alesapin
fcd4e0be65 Black 2022-03-30 19:15:27 +02:00
alesapin
8980994faa Resurrect build hash 2022-03-30 16:29:13 +02:00
Nikolai Kochetov
d3697625a9 Fix stylecheck 2022-03-30 10:55:49 +00:00
alesapin
b19ecf60ad Fix style 2022-03-30 11:30:21 +02:00
mergify[bot]
c2d26e0dd4
Merge branch 'master' into new_branch 2022-03-30 09:22:01 +00:00
alesapin
c510ede8dd Fixup 2022-03-30 11:19:11 +02:00
alesapin
2a1b331c0d Fix build check 2022-03-30 11:15:54 +02:00
alesapin
cf6898d05b Merge branch 'master' into fail_build_check_in_error_status 2022-03-30 11:08:24 +02:00
alesapin
bcf64a73d1 Followup 2022-03-30 11:00:45 +02:00
alesapin
68ec0d92c0 Remove if category changed 2022-03-30 10:58:52 +02:00
Nikolai Kochetov
3849e63ab1 Change database 2022-03-29 19:06:50 +00:00
Nikolai Kochetov
0810737637 Fix style 2022-03-29 18:58:16 +00:00
Nikolai Kochetov
bb82f77477 Fix check. 2022-03-29 18:46:48 +00:00
Nikolai Kochetov
3995a52da6 Fix check. 2022-03-29 18:36:36 +00:00
Nikolai Kochetov
476c7f9d7e Update ci checks server. 2022-03-29 18:32:28 +00:00
alesapin
1a8b2c9637 Remove submodule changed 2022-03-29 19:50:06 +02:00
alesapin
9220bedb7d Add submodule changed 2022-03-29 19:28:18 +02:00
alesapin
d59941e4f6 Style 2022-03-29 19:15:25 +02:00
alesapin
27390799c1 Fix black 2022-03-29 18:23:18 +02:00
alesapin
bf591b971a Moar categories 2022-03-29 15:53:08 +02:00
alesapin
d0f01516db Resurrect automatic labelling 2022-03-29 15:48:57 +02:00
alesapin
ebd72e433d Fail checks in case of errors 2022-03-29 14:41:47 +02:00
Alexey Milovidov
5e262fba85
Merge pull request #35204 from azat/build-gcc
Add build with GCC
2022-03-29 04:55:15 +03:00
alesapin
7ab8d7178c
Merge pull request #35308 from ClickHouse/clickhouse-keeper
New package clickhouse-keeper
2022-03-28 21:23:17 +02:00
Mikhail f. Shiryaev
ea7939103a
Add debug information about event, rerun only failed jobs 2022-03-28 19:15:11 +02:00
alesapin
8acb5de5b5 Fix build report black 2022-03-28 14:43:15 +02:00
alesapin
6780defb42 Fix build report check 2022-03-26 22:45:45 +01:00
Azat Khuzhin
806a4bcdee Add build with GCC
v2: Add gcc build to "ClickHouse special build check (actions)"
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-03-26 23:42:46 +03:00
alesapin
2712368f78 Push only to the new CI DB 2022-03-25 17:44:53 +01:00
alesapin
137dd93ee0
Merge pull request #35583 from ClickHouse/docker-labels
Docker labels
2022-03-24 20:50:29 +01:00
Mikhail f. Shiryaev
d90627e82f
Fix version string update, fix #35518 2022-03-24 17:50:31 +01:00
Mikhail f. Shiryaev
d6fc6b9c44
Add build-url label to built docker images 2022-03-24 16:24:06 +01:00
Mikhail f. Shiryaev
3516eb0524
Make GITHUB_RUN_URL variable and use it 2022-03-24 15:37:53 +01:00
alesapin
881d5ac44f Don't put red cross if jepsen check couldn't wait for build 2022-03-23 11:32:16 +01:00
Mikhail f. Shiryaev
e6f5a3f98b
Apply black formatter to all *.py files in the repo 2022-03-22 17:39:58 +01:00
Vladimir C
ac6fef5c70
Merge pull request #35124 from vdimir/ci-bugfix-validation 2022-03-22 17:34:15 +01:00
vdimir
41c32e24fe
Skip bugfix_validate_check when no pr-bugfix 2022-03-22 12:20:27 +01:00
Mikhail f. Shiryaev
b9cb64a4a1
Add apk package and reports 2022-03-22 11:11:38 +01:00
Mikhail f. Shiryaev
a0edb3e593
Build tgz and rpm for every running 2022-03-22 11:10:01 +01:00
Mikhail f. Shiryaev
0dd1f4af76
Rename alien arguments and parameters 2022-03-22 11:10:01 +01:00
Mikhail f. Shiryaev
342f7ba567
Migrate to nfpm 2022-03-22 11:09:59 +01:00
Alexey Milovidov
159a73b6d5 Merge branch 'master' into llvm-14 2022-03-20 22:50:20 +01:00
vdimir
daa716f682
fix style 2022-03-18 21:32:59 +01:00
vdimir
2551adc416
Bugfix validate meta check 2022-03-18 16:31:19 +01:00
Mikhail f. Shiryaev
2c6ce4b4a0
Merge pull request #35382 from ClickHouse/push-artifactory-improvement
Push LTS packages to both lts and stable repos
2022-03-18 13:10:37 +01:00
Mikhail f. Shiryaev
0d259c6c29
Push LTS packages to both lts and stable repos 2022-03-17 20:59:46 +01:00
alesapin
d3a5839eb7
Merge pull request #35093 from ClickHouse/stress-test-runlog
Stress test runlog
2022-03-17 20:29:06 +01:00
Mikhail f. Shiryaev
b18daeab6f
Fix bug in push_to_artifactory.py, create a necessary dir 2022-03-17 17:44:01 +01:00
Mikhail f. Shiryaev
d593fda8d5
Fix logic for --no-prestable 2022-03-17 16:50:20 +01:00
Vladimir C
a4c410a1f5
Update tests/ci/docker_pull_helper.py
Co-authored-by: Mikhail f. Shiryaev <mr.felixoid@gmail.com>
2022-03-14 15:55:09 +00:00
vdimir
9f2feb4f0b
Use argparse in functional/integration_test_check.py 2022-03-14 15:52:46 +00:00
vdimir
cf70b79f74
Revert "Bugfix check requires either functional _or_ stateless test"
This reverts commit b8b64b1d15.
2022-03-14 15:43:15 +00:00
vdimir
6f1cf419ac
Fix typo 2022-03-14 13:24:46 +00:00
vdimir
b8b64b1d15
Bugfix check requires either functional _or_ stateless test 2022-03-14 13:09:53 +00:00
Azat Khuzhin
4b770343e1 Mark build action as failed if it was retried and there was no succeeded builds
Builder actions does not shows errors after retries, for example [1]
failed, but the check is green:

    Dump json report {
      'log_url': 'https://s3.amazonaws.com/clickhouse-builds/35204/c5a71a7f10e9d20b116b3e1db02bb444b203c32a/binary_gcc/build_log.log',
      'build_urls': [], <-- empty
      'build_config': {...},
      'elapsed_seconds': 0, 'status': False
    } to build_urls_binary_gcc.json with env build_urls_{build_name}

  [1]: https://github.com/ClickHouse/ClickHouse/runs/5510262456?check_suite_focus=true#logs

And previous build indeed failed [2]:

    Mar 11 08:19:45 ninja: build stopped: subcommand failed.

  [2]: https://s3.amazonaws.com/clickhouse-builds/35204/c5a71a7f10e9d20b116b3e1db02bb444b203c32a/binary_gcc/build_log.log

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-03-14 13:23:51 +03:00
kssenii
e08f5c3d86 Add s3 tests with debug and tsan 2022-03-14 11:08:33 +01:00
vdimir
e5c63266c2
Integration test bugfix check 2022-03-11 14:14:16 +00:00
vdimir
e757837ec0
Different status colors in report for bugfix validation 2022-03-11 13:36:29 +00:00
vdimir
6614d6eaaf
bugfix validate integration test 2022-03-11 12:50:33 +00:00
Alexey Milovidov
415e2ff223 Remove useless file 2022-03-11 00:49:50 +01:00
vdimir
b8c7e4657f
invert check in validate bugfix 2022-03-10 16:43:44 +00:00
vdimir
000a31df3b
no-random-settings for bugfix validate 2022-03-10 16:43:43 +00:00
vdimir
fcb7e9ed36
fix CLICKHOUSE_CLIENT_DOWNLOAD_URL in download_previous_release.py 2022-03-10 16:43:42 +00:00
vdimir
4947d6db13
Use download_previous_release for bugfix validation
Should be merged with https://github.com/ClickHouse/ClickHouse/pull/27928
2022-03-10 16:43:41 +00:00
vdimir
196645679f
Add bugfix validate check to ci_config 2022-03-10 16:43:41 +00:00
vdimir
da179c607e
Add bugfux validate check 2022-03-10 16:43:40 +00:00
Mikhail f. Shiryaev
74c5873be0
Do not upload runlog two times 2022-03-07 14:31:17 +01:00
Mikhail f. Shiryaev
3e852ae461
Apply black to stress tests script 2022-03-07 14:25:06 +01:00
vdimir
202ac18e76
Skip 01086_odbc_roundtrip for aarch, disable force_tests 2022-03-07 11:04:37 +00:00
Mikhail f. Shiryaev
223ec3d0b6
Put downloaded artifacts to a temorary path 2022-03-06 14:07:47 +01:00
vdimir
9032cc6c3d
Fix stylecheck for tests/ci/release.py 2022-02-25 11:17:45 +00:00
vdimir
5c38203f7d
Argument --commit for release.py is required 2022-02-25 11:06:58 +00:00
vdimir
ef3cbdcf6a
Add check_prerequisites to release.py 2022-02-25 10:53:21 +00:00
Mikhail f. Shiryaev
af19c5c56d
Merge pull request #34828 from ClickHouse/team-keys-lambda
Comment output header for team keys
2022-02-23 10:53:28 +01:00
Mikhail f. Shiryaev
a2f025b292
Comment output header for team keys 2022-02-23 10:51:31 +01:00
Mikhail f. Shiryaev
2386e1ee54
Fix linter issues 2022-02-22 11:40:40 +01:00
Mikhail f. Shiryaev
dd180b83a8
Improve --no-* parameters for scripts 2022-02-22 11:40:39 +01:00
Mikhail f. Shiryaev
c44aeda23c
Merge pull request #34740 from ClickHouse/release-stable
Add a patch release for stable/lts packages to release.py
2022-02-22 11:39:23 +01:00
Mikhail f. Shiryaev
f0c7a7017f
Review points: update -> read_version, comment in _create_gh_label 2022-02-22 11:32:05 +01:00
Mikhail f. Shiryaev
214d35df5e
Add unit tests for git helper 2022-02-21 10:56:04 +01:00
Mikhail f. Shiryaev
b39dfc9ba6
Change regexp to be more strict 2022-02-21 10:19:59 +01:00
alesapin
a5c2ee339f
Update report.py 2022-02-21 10:29:10 +03:00
vdimir
c70901b4e7
Sort additional_html_urls in test report in CI 2022-02-20 20:36:36 +01:00
Alexey Milovidov
aa8f282ad9 Switch to clang/llvm 14 2022-02-19 18:43:02 +01:00
Mikhail f. Shiryaev
d2cbc5af40
Add patch type for stable/lts releases 2022-02-19 00:13:07 +01:00
Mikhail f. Shiryaev
df9165bbff
Refactoring of Release, add Repo
- Do not pass Namespace to Release.do
- Decouple repository to another class
2022-02-19 00:13:00 +01:00
Mikhail f. Shiryaev
0960fbad52
Set selease_branch only once as Release property 2022-02-19 00:10:21 +01:00
Mikhail f. Shiryaev
d2a8cff508
Add release_branch checker 2022-02-19 00:01:42 +01:00
Mikhail f. Shiryaev
0f1565a3a2
Clean-up the code a little bit 2022-02-19 00:01:39 +01:00
alexey-milovidov
9630087131
Update app.py 2022-02-19 00:26:43 +03:00
alexey-milovidov
37fbf7c329
Merge branch 'master' into add-trusted-taiyang-li 2022-02-19 00:25:52 +03:00
Vladimir C
a249819c52
Merge pull request #34730 from ucasfl/name
rename name in ci check
2022-02-18 16:17:11 +01:00
feng lv
3270e5f636 rename name in ci check 2022-02-18 14:06:16 +00:00
vdimir
4ce64891f9
Add taiyang-li to trusted contributors 2022-02-18 13:59:47 +01:00
Mikhail f. Shiryaev
462b817759
Merge pull request #34624 from ClickHouse/timeout-fast-tests
Timeout fast tests
2022-02-17 17:25:12 +01:00
Mikhail f. Shiryaev
e8f927283c
Add timeouts to TeePopen, second attempt 2022-02-17 16:44:34 +01:00
alesapin
8a0153b6d3
Merge pull request #34606 from qoega/no-clickhouse-test-deb
Remove clickhouse-test deb completely
2022-02-17 18:13:44 +03:00
Mikhail f. Shiryaev
1aff775574
Apply black formatter, fix linter notes 2022-02-17 16:11:12 +01:00
Mikhail f. Shiryaev
c3bf9eb2f9
Remove PVS test 2022-02-17 12:59:47 +01:00
Mikhail f. Shiryaev
0c41564b27
Add the rollback command logging on success run 2022-02-16 20:51:28 +01:00
Mikhail f. Shiryaev
015c0ab611
Solve the issue with wrong initial version 2022-02-16 17:46:43 +01:00
Mikhail f. Shiryaev
b2f3a4ccab
Fix issues with labeling 2022-02-16 17:42:44 +01:00
Mikhail f. Shiryaev
00c8d74878
Reorder Release class 2022-02-16 15:59:51 +01:00
Mikhail f. Shiryaev
799d0bc580
Clean stale remainings, create necessary labels for prestable 2022-02-16 15:56:49 +01:00
Mikhail f. Shiryaev
3f295f9429
Merge pull request #34644 from ClickHouse/fix-release-ci
Fix release ci
2022-02-16 14:33:55 +01:00
Mikhail f. Shiryaev
14a1fa40e7
Fix the issue with ReleaseCI PRInfo 2022-02-16 13:33:10 +01:00
Mikhail f. Shiryaev
e9c95d05b1
Create a release script 2022-02-16 12:17:08 +01:00
Mikhail f. Shiryaev
e338396a76
Use regexps from git_helper 2022-02-16 12:16:44 +01:00
Mikhail f. Shiryaev
546cee5512
Huge refactoring of version_helper 2022-02-16 12:16:42 +01:00
Mikhail f. Shiryaev
cac6f1cd69
Apply black to version_helper 2022-02-16 12:16:40 +01:00
Mikhail f. Shiryaev
0e04279e45
Revert "Timeout fast tests" 2022-02-15 23:50:21 +01:00
Maksim Kita
9b1afa6dda
Merge pull request #34614 from ClickHouse/timeout-fast-tests
Timeout fast tests
2022-02-15 20:47:19 +01:00
alesapin
bc2d0ee7c7
Merge pull request #34215 from ClickHouse/revert-34211-revert-34153-add_func_tests_over_s3
Add func tests run with s3 and fix several bugs
2022-02-15 19:07:11 +03:00
Mikhail f. Shiryaev
bf59d9c5cd
TOREMOVE: test working timeout 2022-02-15 16:52:06 +01:00
Mikhail f. Shiryaev
996f0893b8
Set timeout for fast tests to 40 minutes 2022-02-15 16:51:19 +01:00
Mikhail f. Shiryaev
a9aeca9a94
Apply black formatter, fix linter notes 2022-02-15 16:50:24 +01:00
Mikhail f. Shiryaev
c906375358
Pass timeout into Popen optionally 2022-02-15 16:48:16 +01:00
Yatsishin Ilya
bbe2c07a7b remove clickhouse-test deb completely 2022-02-15 12:03:51 +00:00
alesapin
b75d551281 Fix clang tidy and add check for master 2022-02-14 14:37:41 +03:00
Mikhail f. Shiryaev
23546ab825
Use the current kerberized-haddop image 2022-02-13 22:01:45 +01:00
alesapin
89373155fc Merge branch 'master' into revert-34211-revert-34153-add_func_tests_over_s3 2022-02-13 21:07:54 +03:00
Azat Khuzhin
4965586e7e
More gdb introspection on CI (#34517)
* test/fuzzer: preserve core

This may help to capture things like in [1]:

    Failed assertion: "bin->low_bits_full > bin->low_bits_empty" Received signal 6 Received signal Aborted (6)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33057/19216f4c0ae0f72108c147f958a708b521ad27dc/fuzzer_astfuzzerdebug,actions//report.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test: do not run 'info locals' since 'backtrace full' includes it

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test: try capture backtrace from all threads

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test/stress: fix path for core artifacts

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
Fixes: #33389

* test/fuzzer: store core file in artifacts

v2: fix report, because of undefined variable CORE_LINK
v3: fix case when there is no core file

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-13 15:02:15 +03:00
Mikhail f. Shiryaev
0f21981694
Add a flag for images architecture 2022-02-11 18:26:45 +01:00
Mikhail f. Shiryaev
bd3812a462
Add a comment 2022-02-11 18:26:44 +01:00
Mikhail f. Shiryaev
dcecbbaf81
Add argument --all for docker imabes builder 2022-02-11 18:26:42 +01:00
alesapin
ba28c2c013 Merge branch 'master' into revert-34211-revert-34153-add_func_tests_over_s3 2022-02-07 12:44:56 +03:00
Mikhail f. Shiryaev
f2725b1b22
Fix wrong OK_SKIP labels 2022-02-05 18:26:43 +01:00
alesapin
2ed45b2a98 Merge branch 'master' into revert-34211-revert-34153-add_func_tests_over_s3 2022-02-04 11:23:46 +03:00
Mikhail f. Shiryaev
37179bbc9c
Add verbosity to stylecheck 2022-02-03 17:50:35 +01:00
Mikhail f. Shiryaev
8243823d74
Mark Run Check as success for some cases 2022-02-03 13:32:22 +01:00
alesapin
e324529f17 S3 all tests 2022-02-02 20:48:36 +03:00
alesapin
80800e051e Merge branch 'master' into revert-34211-revert-34153-add_func_tests_over_s3 2022-02-02 19:42:04 +03:00
Mikhail f. Shiryaev
75adf5d12d
Merge pull request #33948 from qoega/no-clickhouse-test-deb-in-stateless
Do not use clickhouse-test.deb in stateless CI checks
2022-02-02 10:23:33 +01:00
alesapin
18f08ed932
Revert "Revert "Add func tests run with s3"" 2022-02-01 10:20:06 +03:00
alexey-milovidov
cbfcd45be3
Revert "Add func tests run with s3" 2022-02-01 05:46:13 +03:00
Mikhail f. Shiryaev
424900bf1f
Add authorisation for dockerhub proxy container 2022-01-31 15:50:05 +01:00
alesapin
9eea8e3183 Fix missed change 2022-01-30 18:22:35 +03:00
alesapin
969987e66b Merge branch 'master' into add_func_tests_over_s3 2022-01-30 18:21:32 +03:00
alesapin
c219a53b4a Add func tests run with s3 2022-01-30 17:28:52 +03:00
Mikhail f. Shiryaev
22eddff0d5
Add a comment about broken logic for skipping checks 2022-01-26 15:30:59 +01:00
Mikhail f. Shiryaev
462e95d0fa
Replace labels_from_ip by pr_event_from_api 2022-01-26 15:03:30 +01:00
Mikhail f. Shiryaev
6fa6588cb5
Add info about body for a failed check 2022-01-26 14:03:01 +01:00
Mikhail f. Shiryaev
99e0ce1ab8
Add get_with_retries helper to build_download_helper.py 2022-01-26 13:20:08 +01:00
Mikhail f. Shiryaev
7cde981531
Apply black formatter to build_download_helper.py 2022-01-26 12:10:20 +01:00
Mikhail f. Shiryaev
1ecee3aa8e
Apply black formatter to pr_info 2022-01-26 12:09:35 +01:00
alesapin
677a7f1133
Merge pull request #33990 from ClickHouse/cancel-lambda
Cancel lambda
2022-01-26 10:51:21 +03:00
Mikhail f. Shiryaev
62ddfbe4ab
Use workflow names instead of ID 2022-01-25 18:32:13 +01:00
Mikhail f. Shiryaev
604af8d3b8
Apply black to cancel lambda 2022-01-25 18:28:17 +01:00
mergify[bot]
c859945b62
Merge branch 'master' into no-clickhouse-test-deb-in-stateless 2022-01-25 11:43:54 +00:00
Mikhail f. Shiryaev
fb908a31e2
Fix dependencies tree for docker image check 2022-01-25 12:09:10 +01:00
Yatsishin Ilya
bc10e08fb4 add missing space 2022-01-25 09:07:04 +00:00
Mikhail f. Shiryaev
57b4655fa2
Fix style for pr_info 2022-01-24 16:34:01 +01:00
Mikhail f. Shiryaev
8e8ee8f8d1
Add style-checker-aarch64 to metrics lambda 2022-01-24 15:50:34 +01:00
mergify[bot]
604b85d861
Merge branch 'master' into no-clickhouse-test-deb-in-stateless 2022-01-24 14:05:17 +00:00
Mikhail f. Shiryaev
7a1f471d6f
Add tests for process_image_with_parrents 2022-01-24 14:55:57 +01:00
Mikhail f. Shiryaev
70d997cbda
Fix pylint issues 2022-01-24 14:54:37 +01:00
Mikhail f. Shiryaev
18ef029ed3
Fix issue with building from non-existing tags 2022-01-24 14:54:29 +01:00
Mikhail f. Shiryaev
3531318388
Add tests for get_changed_docker_images 2022-01-24 14:52:07 +01:00
Mikhail f. Shiryaev
aa296c36bb
Fix dummy PRInfo 2022-01-24 14:51:56 +01:00
Yatsishin Ilya
3a55f7a7d6 Do not use clickhouse-test.deb in stateless 2022-01-24 11:53:42 +00:00
Alexey Milovidov
30b436b9b1 Add more retries in CI for AWS "spot" instances 2022-01-22 13:10:45 +03:00
alexey-milovidov
97e5e71a35
Merge pull request #33872 from ClickHouse/fix_rerun_perf_tests
Fix perf comparison rerun
2022-01-22 10:40:27 +03:00
alesapin
4b93607343 Fix perf comparison 2022-01-21 18:40:03 +03:00
Mikhail f. Shiryaev
9cb136f5b0
Use workflow names in approve lambda 2022-01-19 17:00:41 +01:00
Mikhail f. Shiryaev
d9a1284f2d
Improve typing and arguments 2022-01-19 11:41:34 +01:00
Mikhail f. Shiryaev
3142ae998b
Add option to skip redownload, push tgz 2022-01-19 11:41:33 +01:00
Mikhail f. Shiryaev
13368bf708
Fix some linter issues 2022-01-19 11:41:32 +01:00
Mikhail f. Shiryaev
7fd629004b
Improve push_to_artifactory
- Add tgz archives
- Add --all argument for all packages download
- Add -n to skip pushing to artifactory
- Add help for artifactory-url
- Make 3.8 compatible
- Add cleanup `refs/tags/` from --release argument
2022-01-19 11:41:30 +01:00
Mikhail f. Shiryaev
396b504397
Add some helping comments for API endpoints 2022-01-17 11:06:40 +01:00
Mikhail f. Shiryaev
91caf07b20
Apply black to workflow_approve_rerun_lambda 2022-01-15 18:54:58 +01:00
Mikhail f. Shiryaev
4c7a8abd20
Add PullRequestCI to NEED_RERUN_WORKFLOWS 2022-01-15 18:53:37 +01:00
Maksim Kita
8aed06c922
Merge pull request #33663 from amosbird/addmyself
Add amosbird to trusted user.
2022-01-15 14:10:37 +01:00
Amos Bird
4da2a660ec
Add amosbird to trusted user. 2022-01-15 20:23:55 +08:00
alexey-milovidov
c3972f000d
Merge pull request #33614 from ClickHouse/safe-names-in-blog
Use safe page URL for a blog post
2022-01-15 02:29:37 +03:00
Mikhail f. Shiryaev
a8203dd01e
Merge pull request #33623 from ClickHouse/metrics-lambda
Add an exception message example
2022-01-14 10:06:33 +01:00
Mikhail f. Shiryaev
a63494cb66
Add an exception message example 2022-01-14 10:05:19 +01:00
alesapin
b6937f7462
Merge pull request #33616 from ClickHouse/metrics-lambda
Metrics lambda: fix deletion
2022-01-14 11:53:13 +03:00
Mikhail f. Shiryaev
bca9f56ccd
Improve logging in docs_check.py 2022-01-14 09:15:41 +01:00
Mikhail f. Shiryaev
52594179e3
Fix broken receiver get_dead_runners_in_ec2 2022-01-14 00:51:37 +01:00
Mikhail f. Shiryaev
632b87ac2b
Use key from the secret manager if possible 2022-01-14 00:49:49 +01:00
Mikhail f. Shiryaev
545bee477f
Apply black formatter 2022-01-13 20:52:02 +01:00
alesapin
0804e04558
Merge pull request #32911 from ClickHouse/deb-aarch64
Deb aarch64
2022-01-13 19:11:19 +03:00
Mikhail f. Shiryaev
92099302e7
Use stdin for docker login to not expose a password 2022-01-13 16:57:33 +01:00
Mikhail f. Shiryaev
080c56d91a
Fix pylint for build_check.py 2022-01-13 15:13:58 +01:00
Mikhail f. Shiryaev
89415ff415
Fix pylint for run_check.py 2022-01-13 14:51:48 +01:00
Mikhail f. Shiryaev
25476e2d7d
Restore existing static builds links 2022-01-13 13:55:51 +01:00
Mikhail f. Shiryaev
39012a42aa
Restore description checking 2022-01-13 12:17:09 +01:00
Mikhail f. Shiryaev
ce01dea0fe
Apply black to run_check.py 2022-01-13 12:06:50 +01:00
Mikhail f. Shiryaev
abd16ebf32
Force success aarch stateless tests 2022-01-12 17:07:59 +01:00
Mikhail f. Shiryaev
0e536d5ab0
Apply black to status_helper.py 2022-01-12 17:07:58 +01:00
Mikhail f. Shiryaev
11ede97d0d
Add func-testers-aarch64 group to metrics 2022-01-12 17:07:57 +01:00
Mikhail f. Shiryaev
6373943451
Apply black to metrics lambda app 2022-01-12 17:07:56 +01:00
Mikhail f. Shiryaev
2ae87ad0df
Build docker amd64 and arm64 separately and merge together later 2022-01-12 17:07:55 +01:00
Mikhail f. Shiryaev
341feb5945
Add necessary 'before' field for a dummy object 2022-01-12 17:07:55 +01:00
Mikhail f. Shiryaev
7bc89c4f50
Use cache feature of docker buildx 2022-01-12 17:07:53 +01:00
Mikhail f. Shiryaev
2a83a1c05d
Build dependent images from the current version 2022-01-12 17:07:52 +01:00
Mikhail f. Shiryaev
f11bfdb2ea
Add prebuilding for docker buildx builder 2022-01-12 17:07:51 +01:00
Mikhail f. Shiryaev
fe130bc547
Use buildx for docker images, improve typing 2022-01-12 17:07:50 +01:00
Mikhail f. Shiryaev
43f39bc051
Add typing to docker_images_check.py and ignore dependencies errors 2022-01-12 17:07:50 +01:00
Mikhail f. Shiryaev
3c6f14ae63
Apply black to docker_images_check.py 2022-01-12 17:07:49 +01:00
Mikhail f. Shiryaev
44e02fa075
Add functional tests for aarch64 2022-01-12 17:07:48 +01:00
Mikhail f. Shiryaev
830edf76cc
Don't upload splitted binaries to builds.clickhouse.com 2022-01-12 14:57:11 +01:00
Mikhail f. Shiryaev
9188b8afc2
Fix logic for upload upload_master_static_binaries 2022-01-12 14:30:32 +01:00
Mikhail f. Shiryaev
325c786f68
Add uploading binary builds from master to static URLs 2022-01-12 13:17:54 +01:00
Mikhail f. Shiryaev
3614b0c4ed
Slightly refactor build_check.py 2022-01-12 13:17:21 +01:00
Mikhail f. Shiryaev
eaf3bdabf5
Add typing to CI_CONFIG 2022-01-12 13:14:31 +01:00
Mikhail f. Shiryaev
b98e0be869
Use a proper branch name for PRInfo w/ number==0 2022-01-12 12:31:13 +01:00
Mikhail f. Shiryaev
80a452cca0
Apply black on build_check.py and tee_popen.py 2022-01-11 19:36:34 +01:00
alexey-milovidov
146639273f
Update app.py 2022-01-09 19:20:06 +03:00
alexey-milovidov
4477b7d2f1
Update run_check.py 2022-01-09 19:19:58 +03:00
alesapin
6a4d5a985b Rerun docs release check as well 2022-01-07 12:05:38 +03:00
Alexey Milovidov
2d3f53ec5c Merge branch 'dotnet-integration-test' of github.com:yandex/ClickHouse into dotnet-integration-test 2022-01-04 22:49:58 +03:00
Alexey Milovidov
184033b782 Trying to make it work 2022-01-04 22:49:41 +03:00
alexey-milovidov
c2ed92d75d
Update pr_info.py 2021-12-31 14:39:28 +03:00
Mikhail f. Shiryaev
fccc4dade1
Fix (?) encoding issue in #33331 2021-12-30 22:19:06 +01:00
alexey-milovidov
e879aca58b
Update run_check.py 2021-12-29 23:21:47 +03:00
alesapin
4a1819c4d2 Fix jepsen check 2021-12-29 22:44:41 +03:00
alesapin
948fde52a7 Add retries for github api 2021-12-28 13:13:51 +03:00
alesapin
d188771c05
Merge pull request #33222 from ClickHouse/fix_cancell_lambda
Fix cancel lambda
2021-12-27 13:27:40 +03:00
alesapin
33fd1a44ac Fix cancel lambda 2021-12-27 13:26:16 +03:00
alesapin
342c8231fa Better 2021-12-27 10:33:44 +03:00
alesapin
e683fa146b More debug info in jepsen check 2021-12-27 10:33:25 +03:00
alesapin
9687f1603a Better 2021-12-24 21:34:24 +03:00
alesapin
bd7f5ea50f Better 2021-12-24 21:22:29 +03:00
alesapin
46569e7a5b Better 2021-12-24 21:02:40 +03:00
alesapin
9d83b904de Add pretty print unknow event 2021-12-24 20:57:32 +03:00
alesapin
00666a6a4c
Merge pull request #32998 from ClickHouse/add_jepsen_test
Add Keeper Jepsen check to new CI
2021-12-24 17:25:20 +03:00
alesapin
05648434b9 Fix label 2021-12-24 15:56:38 +03:00
alesapin
42461f453e Add a separate workflow 2021-12-24 15:56:03 +03:00
alesapin
119b8628e5
Merge pull request #33135 from ClickHouse/fix_pvs_studio
Fix PVS check
2021-12-24 15:34:24 +03:00
alesapin
2a402f7df1
Merge pull request #33136 from ClickHouse/fix_error_report_in_build_check
Upload build artifact in case of build failures
2021-12-24 15:00:50 +03:00
alesapin
3dbf7a9da9 More clear exception 2021-12-24 13:35:40 +03:00
alesapin
9461b7dba2 Finally fix jepsen 2021-12-24 13:32:32 +03:00
alesapin
d68d26e4c1 Fix woboq codebrowser 2021-12-24 13:05:09 +03:00
alesapin
1a3cdc3388 Upload build artifact in case of build failures 2021-12-24 12:56:09 +03:00
alesapin
e3d8457a6f Fix PVS 2021-12-24 12:41:01 +03:00
alesapin
be8187df09 Fix report upload 2021-12-22 19:16:54 +03:00
alesapin
7e714641ac Add newline 2021-12-22 13:46:41 +03:00
alesapin
e63b2f0de8 Merge branch 'master' into add_jepsen_test 2021-12-22 13:30:48 +03:00
alesapin
0a716b9d9a
Merge pull request #33036 from ClickHouse/fix_can_be_tested
Make `can be tested` great again
2021-12-22 13:26:56 +03:00
alesapin
e31be8f056 Better check in lambda 2021-12-22 12:25:16 +03:00
alesapin
20e287f5b6 Followup 2021-12-22 11:15:31 +03:00
alesapin
b300de6a4a Better 2021-12-22 11:13:04 +03:00
alesapin
7a00bc96ed Make great again 2021-12-22 10:54:50 +03:00
alesapin
ca9526e3a4 Stupid fix 2021-12-22 00:39:51 +03:00
alesapin
bc03e5e10f
Merge pull request #32983 from ClickHouse/add_woboq_build
Trying to add woboq to new CI
2021-12-21 23:05:38 +03:00
alesapin
84811a55c5 Fix path 2021-12-21 18:17:53 +03:00
alesapin
3ab250a869 Add region name: 2021-12-21 16:47:23 +03:00
alesapin
37d90e071f Group params 2021-12-21 16:16:01 +03:00
alesapin
49a50bbdc9 Merge branch 'master' into add_jepsen_test 2021-12-21 16:15:40 +03:00
alesapin
45aef649a1 Add backport workflow rerun 2021-12-21 16:13:44 +03:00
alesapin
af7cd00e30 Don't use too powerful key 2021-12-21 16:05:02 +03:00
alesapin
627bd2cec4 Add Keeper Jepsen check to new CI 2021-12-21 15:07:10 +03:00
alesapin
a89a05c0da Finally woboq is ready 2021-12-21 14:16:21 +03:00
alesapin
532b01c371 Followup 2021-12-21 10:49:22 +03:00
alesapin
e194b38096 Followup 2021-12-20 22:54:04 +03:00
alesapin
62eb504029 Trying to add woboq 2021-12-20 22:43:37 +03:00
Mikhail f. Shiryaev
6f6b7c7bac
Merge pull request #32905 from ClickHouse/add_dockerhub_proxy
Add dockerhub proxy to CI
2021-12-17 14:31:50 +01:00
alesapin
f02a40bbdc Rename script and add template for dockerhub proxy 2021-12-17 13:48:42 +03:00
alesapin
47c907d41a Add dockerhub proxy 2021-12-17 13:20:48 +03:00
alesapin
25fd29619b
Merge pull request #31882 from pkit/refactor_ci_tests1
refactor CI tests
2021-12-17 11:18:35 +03:00
alexey-milovidov
e929175dae
Update run_check.py 2021-12-17 08:55:46 +03:00
alexey-milovidov
e834d655a5
Merge pull request #32415 from ClickHouse/arm64_workers
Add arm64/aarch64 tests
2021-12-17 08:46:52 +03:00
vdimir
a0afe67777
Add cwurm to TRUSTED_CONTIBUTORS 2021-12-16 16:13:40 +03:00
Mikhail f. Shiryaev
9a6e8dc615
Build rpm and tgz for aarch64 too 2021-12-16 13:00:32 +01:00
Mikhail f. Shiryaev
eb5a26891f
Add aarch64 deb package 2021-12-16 12:42:49 +01:00
Mikhail f. Shiryaev
3ae654168c
Apply black formatter 2021-12-16 12:42:48 +01:00
Mikhail f. Shiryaev
2ae5eb4cfa
Merge pull request #32205 from ClickHouse/team_keys_lambda
Add docker container for AWS lambda
2021-12-16 11:52:02 +01:00
Mikhail f. Shiryaev
31a5afe855
Use threads to speed-up parallel requests 2021-12-16 11:50:48 +01:00
Mikhail f. Shiryaev
ccf6210eb1
Add docker container for AWS lambda 2021-12-16 11:50:41 +01:00
Mikhail f. Shiryaev
1d7bd3bf9b
Merge pull request #32800 from ClickHouse/aws-workers
Improve workers init
2021-12-16 11:48:54 +01:00
alesapin
cf0241a2d5 Prevent docs release of being too smart 2021-12-16 10:59:59 +03:00
alesapin
38f2e4c8ac Prevent docs release of being too smart 2021-12-16 10:59:42 +03:00
alesapin
8d6bea91e8
Update pr_info.py 2021-12-15 16:35:53 +03:00
alesapin
5430f1a413
Update pr_info.py 2021-12-15 16:26:46 +03:00
alesapin
73a593b676
Merge branch 'master' into refactor_ci_tests1 2021-12-15 16:11:28 +03:00
alesapin
d962d92896
Merge pull request #32745 from ClickHouse/fix_special_build_check
Better control build artifacts
2021-12-15 14:51:02 +03:00
Mikhail f. Shiryaev
546a03281f
Rework image building:
- Make it arch-agnostic
- Add necessary packages
- Update runner version
- Get public keys of ClickHouse/core members
2021-12-15 11:19:08 +01:00
alesapin
2c78e7ed72 Fix performance build 2021-12-15 11:07:12 +03:00
alesapin
2e8b75ade4 Fix configs 2021-12-15 10:45:27 +03:00
alesapin
2753fe01a3 Merge branch 'master' into fix_special_build_check 2021-12-15 10:35:28 +03:00
Mikhail f. Shiryaev
97301a19b9
Unify init scripts in one 2021-12-14 18:44:51 +01:00
alesapin
e124e5807f Fix build performance 2021-12-14 19:29:30 +03:00
alesapin
c46c912507 Followup 2021-12-14 19:16:22 +03:00
mergify[bot]
68c96f4dd4
Merge branch 'master' into add_performance_tests 2021-12-14 11:04:41 +00:00
alesapin
7b29377338 Better control build artifacts 2021-12-14 13:40:03 +03:00
alesapin
d5925d7e2d Trying stress testers 2021-12-14 13:31:31 +03:00
Kruglov Pavel
d065b8233d
Update backport.py 2021-12-13 20:40:06 +03:00
alesapin
242149d881 Rerun release workflows 2021-12-13 18:54:14 +03:00
alesapin
949e68e2ac
Merge pull request #32696 from vdimir/trust-cont-lower
Check trusted contributors in lowercase
2021-12-13 18:20:16 +03:00
alesapin
856dd3735c Merge branch 'master' into add_performance_tests 2021-12-13 18:09:59 +03:00
vdimir
0c83b14c37
Check trusted contributors in lowercase 2021-12-13 17:34:17 +03:00
alesapin
fad904b0aa Merge branch 'master' into add_performance_tests 2021-12-13 14:32:35 +03:00
alesapin
1f5157e240
Merge pull request #32618 from ClickHouse/upload_logs_of_failed_task
CI: upload logs if task failed
2021-12-13 12:42:39 +03:00
alesapin
b34f5210e7 Followup 2021-12-13 12:04:08 +03:00
alesapin
cf281b10dc Split perf test into multiple checks 2021-12-13 11:59:58 +03:00
alesapin
c1d3323e25 Rerun workflows more times 2021-12-13 10:48:57 +03:00
Alexander Tokmakov
62015ba610 Merge branch 'master' into upload_logs_of_failed_task 2021-12-12 15:20:25 +03:00
Alexander Tokmakov
e8613ba386 upload logs of failed task 2021-12-12 15:09:44 +03:00
alesapin
eb51d9550d
Merge branch 'master' into add_performance_tests 2021-12-12 01:01:13 +03:00
alesapin
84bccb83bd Trying to add debug info 2021-12-10 19:38:20 +03:00
alesapin
a6e55b00e3
Revert "Revert "Split long tests into multiple checks"" 2021-12-10 18:39:02 +03:00
alesapin
dcbba460c1
Revert "Split long tests into multiple checks" 2021-12-10 18:38:42 +03:00
alesapin
a2aa0bc6cc
Merge pull request #32496 from ClickHouse/smaller_checks
Split long tests into multiple checks
2021-12-10 17:42:14 +03:00
alesapin
4eb2dee857 Don't use tmpfs 2021-12-10 16:09:00 +03:00
alesapin
2c7bb56a2c Split integration tests into parts 2021-12-10 13:22:29 +03:00
alesapin
f655b43f5a Merge branch 'master' into add_performance_tests 2021-12-10 12:32:43 +03:00
alesapin
94a557a80e Trying another host 2021-12-10 12:31:09 +03:00
alesapin
32f78f2ba4 Better check name 2021-12-10 12:09:11 +03:00
alesapin
4c1babee05 Split long functional tests to multiple checks 2021-12-10 12:07:24 +03:00
alesapin
dc21d423d1
Merge pull request #32494 from ClickHouse/fix_integration_tests_images
Fix integration tests docker images path
2021-12-10 10:56:15 +03:00
alesapin
db83d82f5a Fix integration tests path 2021-12-10 10:54:37 +03:00
tavplubix
85e53b1b1f
Try fix attaching gdb in tests (#32448)
* attach gdb with sudo

* fix

* Update run.sh
2021-12-10 00:12:45 +03:00
alesapin
5b06e30ea2
Merge pull request #32462 from ClickHouse/automatic_rerun
Add automatic workflow rerun
2021-12-09 18:31:59 +03:00
alesapin
19f8b416bc Add automatic workflow rerun 2021-12-09 16:28:15 +03:00
alesapin
08c699cbdd
Merge pull request #32438 from ClickHouse/fix_image_for_integration_tests
Fix images names in integration tests
2021-12-09 15:38:50 +03:00
alesapin
af6ce89e95 Better report 2021-12-09 15:02:13 +03:00
alesapin
7ea7aa8db8 Fix build check 2021-12-09 12:17:03 +03:00
alesapin
67d89929a3 Add ramdrive 2021-12-09 12:04:05 +03:00
alesapin
b62de9b2f4 Merge branch 'master' into add_performance_tests 2021-12-09 11:40:32 +03:00
alesapin
fad3158bf7 Fix images names in integration tests 2021-12-09 10:55:51 +03:00
alesapin
a625dd41e8
Merge branch 'master' into better_logs 2021-12-03 15:31:45 +03:00
Constantine Peresypkin
7c90d4f8e3 refactor CI tests 2021-12-03 12:22:50 +02:00
alesapin
caa481aba8 Use ccache in fast test 2021-12-03 12:28:17 +03:00
alesapin
99a5ca2646 Fix style (got tired of it) 2021-12-03 12:19:39 +03:00
alesapin
ec0bfa7bcf Better output for some actions 2021-12-03 11:33:16 +03:00
alesapin
7699d3f35e
Merge pull request #32162 from azat/double-gz
tests/ci: do not compress logs twice
2021-12-03 10:20:35 +03:00
Azat Khuzhin
bfaaa79cfc tests/ci: do not compress logs twice
Cc: @alesapin
2021-12-03 01:28:32 +03:00
mergify[bot]
e2cb91b560
Merge branch 'master' into add_one_more_group 2021-12-02 19:28:13 +00:00
alesapin
f2140be90b Fix CI 2021-12-02 22:03:59 +03:00
alesapin
c14086d578
Merge pull request #32064 from ClickHouse/lightweight_checks_rerun
Add ability for lightweight checks rerun
2021-12-02 20:54:27 +03:00
alesapin
9e1437a7c4 Small improvements in lambda code 2021-12-02 19:38:18 +03:00
alesapin
7ef0737edc Move fuzzers and unit tests to another group 2021-12-02 13:23:32 +03:00
alesapin
c07450a7dc Fixup one more time 2021-12-02 10:49:44 +03:00
alesapin
a29b7105da fixup 2021-12-01 22:17:23 +03:00
alesapin
bf5858a6b3 Fix build urls 2021-12-01 22:14:46 +03:00
alesapin
e298e14c3b Fix rerun helper and build report 2021-12-01 18:50:48 +03:00
alesapin
c13a72991b Fix style 2021-12-01 17:47:10 +03:00
alesapin
71e6c7e92e Add ability to rerun checks 2021-12-01 17:23:51 +03:00
alesapin
1977ab6a8e
Merge pull request #32051 from ClickHouse/cancel_checks_more_agressively
Cancel redundant checks with lambda
2021-12-01 15:39:40 +03:00
alesapin
6cdb9f65a4 Cancel redundant checks with lambda 2021-12-01 15:38:17 +03:00
Mikhail f. Shiryaev
23f9c8bbba
Fix building rpm and tgz for branch pushes 2021-12-01 12:44:39 +01:00
alesapin
8261e12a48
Merge pull request #32041 from ClickHouse/remove_most_of_old_checks
Remove most of old checks
2021-12-01 14:02:22 +03:00
alesapin
e54dc89a84
Merge pull request #32044 from ClickHouse/report_success_in_case_of_force_tests
Fix force tests label
2021-12-01 13:26:58 +03:00
alesapin
a72f7a25f1 Fix force tests label 2021-12-01 12:50:36 +03:00
mergify[bot]
ffc1f4eb92
Merge branch 'master' into remove_most_of_old_checks 2021-12-01 09:45:19 +00:00
alesapin
f76149a1ec Better scripts for runners 2021-12-01 12:39:09 +03:00
alesapin
b421d07434 Remove most of old checks 2021-12-01 12:21:01 +03:00
alesapin
fb1d5e413e
Merge pull request #31987 from ClickHouse/add_special_functional_tests
Add rest functional tests to CI
2021-12-01 12:18:36 +03:00
alesapin
37f734bd6c
Merge pull request #31991 from ClickHouse/add_special_builds_to_ci
Add special builds to CI
2021-11-30 23:03:15 +03:00