Commit Graph

767 Commits

Author SHA1 Message Date
Mikhail f. Shiryaev
c44aeda23c
Merge pull request #34740 from ClickHouse/release-stable
Add a patch release for stable/lts packages to release.py
2022-02-22 11:39:23 +01:00
Mikhail f. Shiryaev
f0c7a7017f
Review points: update -> read_version, comment in _create_gh_label 2022-02-22 11:32:05 +01:00
Mikhail f. Shiryaev
214d35df5e
Add unit tests for git helper 2022-02-21 10:56:04 +01:00
Mikhail f. Shiryaev
b39dfc9ba6
Change regexp to be more strict 2022-02-21 10:19:59 +01:00
alesapin
a5c2ee339f
Update report.py 2022-02-21 10:29:10 +03:00
vdimir
c70901b4e7
Sort additional_html_urls in test report in CI 2022-02-20 20:36:36 +01:00
Mikhail f. Shiryaev
d2cbc5af40
Add patch type for stable/lts releases 2022-02-19 00:13:07 +01:00
Mikhail f. Shiryaev
df9165bbff
Refactoring of Release, add Repo
- Do not pass Namespace to Release.do
- Decouple repository to another class
2022-02-19 00:13:00 +01:00
Mikhail f. Shiryaev
0960fbad52
Set selease_branch only once as Release property 2022-02-19 00:10:21 +01:00
Mikhail f. Shiryaev
d2a8cff508
Add release_branch checker 2022-02-19 00:01:42 +01:00
Mikhail f. Shiryaev
0f1565a3a2
Clean-up the code a little bit 2022-02-19 00:01:39 +01:00
alexey-milovidov
9630087131
Update app.py 2022-02-19 00:26:43 +03:00
alexey-milovidov
37fbf7c329
Merge branch 'master' into add-trusted-taiyang-li 2022-02-19 00:25:52 +03:00
Vladimir C
a249819c52
Merge pull request #34730 from ucasfl/name
rename name in ci check
2022-02-18 16:17:11 +01:00
feng lv
3270e5f636 rename name in ci check 2022-02-18 14:06:16 +00:00
vdimir
4ce64891f9
Add taiyang-li to trusted contributors 2022-02-18 13:59:47 +01:00
Mikhail f. Shiryaev
462b817759
Merge pull request #34624 from ClickHouse/timeout-fast-tests
Timeout fast tests
2022-02-17 17:25:12 +01:00
Mikhail f. Shiryaev
e8f927283c
Add timeouts to TeePopen, second attempt 2022-02-17 16:44:34 +01:00
alesapin
8a0153b6d3
Merge pull request #34606 from qoega/no-clickhouse-test-deb
Remove clickhouse-test deb completely
2022-02-17 18:13:44 +03:00
Mikhail f. Shiryaev
1aff775574
Apply black formatter, fix linter notes 2022-02-17 16:11:12 +01:00
Mikhail f. Shiryaev
c3bf9eb2f9
Remove PVS test 2022-02-17 12:59:47 +01:00
Mikhail f. Shiryaev
0c41564b27
Add the rollback command logging on success run 2022-02-16 20:51:28 +01:00
Mikhail f. Shiryaev
015c0ab611
Solve the issue with wrong initial version 2022-02-16 17:46:43 +01:00
Mikhail f. Shiryaev
b2f3a4ccab
Fix issues with labeling 2022-02-16 17:42:44 +01:00
Mikhail f. Shiryaev
00c8d74878
Reorder Release class 2022-02-16 15:59:51 +01:00
Mikhail f. Shiryaev
799d0bc580
Clean stale remainings, create necessary labels for prestable 2022-02-16 15:56:49 +01:00
Mikhail f. Shiryaev
3f295f9429
Merge pull request #34644 from ClickHouse/fix-release-ci
Fix release ci
2022-02-16 14:33:55 +01:00
Mikhail f. Shiryaev
14a1fa40e7
Fix the issue with ReleaseCI PRInfo 2022-02-16 13:33:10 +01:00
Mikhail f. Shiryaev
e9c95d05b1
Create a release script 2022-02-16 12:17:08 +01:00
Mikhail f. Shiryaev
e338396a76
Use regexps from git_helper 2022-02-16 12:16:44 +01:00
Mikhail f. Shiryaev
546cee5512
Huge refactoring of version_helper 2022-02-16 12:16:42 +01:00
Mikhail f. Shiryaev
cac6f1cd69
Apply black to version_helper 2022-02-16 12:16:40 +01:00
Mikhail f. Shiryaev
0e04279e45
Revert "Timeout fast tests" 2022-02-15 23:50:21 +01:00
Maksim Kita
9b1afa6dda
Merge pull request #34614 from ClickHouse/timeout-fast-tests
Timeout fast tests
2022-02-15 20:47:19 +01:00
alesapin
bc2d0ee7c7
Merge pull request #34215 from ClickHouse/revert-34211-revert-34153-add_func_tests_over_s3
Add func tests run with s3 and fix several bugs
2022-02-15 19:07:11 +03:00
Mikhail f. Shiryaev
bf59d9c5cd
TOREMOVE: test working timeout 2022-02-15 16:52:06 +01:00
Mikhail f. Shiryaev
996f0893b8
Set timeout for fast tests to 40 minutes 2022-02-15 16:51:19 +01:00
Mikhail f. Shiryaev
a9aeca9a94
Apply black formatter, fix linter notes 2022-02-15 16:50:24 +01:00
Mikhail f. Shiryaev
c906375358
Pass timeout into Popen optionally 2022-02-15 16:48:16 +01:00
Yatsishin Ilya
bbe2c07a7b remove clickhouse-test deb completely 2022-02-15 12:03:51 +00:00
alesapin
b75d551281 Fix clang tidy and add check for master 2022-02-14 14:37:41 +03:00
Mikhail f. Shiryaev
23546ab825
Use the current kerberized-haddop image 2022-02-13 22:01:45 +01:00
alesapin
89373155fc Merge branch 'master' into revert-34211-revert-34153-add_func_tests_over_s3 2022-02-13 21:07:54 +03:00
Azat Khuzhin
4965586e7e
More gdb introspection on CI (#34517)
* test/fuzzer: preserve core

This may help to capture things like in [1]:

    Failed assertion: "bin->low_bits_full > bin->low_bits_empty" Received signal 6 Received signal Aborted (6)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33057/19216f4c0ae0f72108c147f958a708b521ad27dc/fuzzer_astfuzzerdebug,actions//report.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test: do not run 'info locals' since 'backtrace full' includes it

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test: try capture backtrace from all threads

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test/stress: fix path for core artifacts

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
Fixes: #33389

* test/fuzzer: store core file in artifacts

v2: fix report, because of undefined variable CORE_LINK
v3: fix case when there is no core file

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-13 15:02:15 +03:00
Mikhail f. Shiryaev
0f21981694
Add a flag for images architecture 2022-02-11 18:26:45 +01:00
Mikhail f. Shiryaev
bd3812a462
Add a comment 2022-02-11 18:26:44 +01:00
Mikhail f. Shiryaev
dcecbbaf81
Add argument --all for docker imabes builder 2022-02-11 18:26:42 +01:00
alesapin
ba28c2c013 Merge branch 'master' into revert-34211-revert-34153-add_func_tests_over_s3 2022-02-07 12:44:56 +03:00
Mikhail f. Shiryaev
f2725b1b22
Fix wrong OK_SKIP labels 2022-02-05 18:26:43 +01:00
alesapin
2ed45b2a98 Merge branch 'master' into revert-34211-revert-34153-add_func_tests_over_s3 2022-02-04 11:23:46 +03:00
Mikhail f. Shiryaev
37179bbc9c
Add verbosity to stylecheck 2022-02-03 17:50:35 +01:00
Mikhail f. Shiryaev
8243823d74
Mark Run Check as success for some cases 2022-02-03 13:32:22 +01:00
alesapin
e324529f17 S3 all tests 2022-02-02 20:48:36 +03:00
alesapin
80800e051e Merge branch 'master' into revert-34211-revert-34153-add_func_tests_over_s3 2022-02-02 19:42:04 +03:00
Mikhail f. Shiryaev
75adf5d12d
Merge pull request #33948 from qoega/no-clickhouse-test-deb-in-stateless
Do not use clickhouse-test.deb in stateless CI checks
2022-02-02 10:23:33 +01:00
alesapin
18f08ed932
Revert "Revert "Add func tests run with s3"" 2022-02-01 10:20:06 +03:00
alexey-milovidov
cbfcd45be3
Revert "Add func tests run with s3" 2022-02-01 05:46:13 +03:00
Mikhail f. Shiryaev
424900bf1f
Add authorisation for dockerhub proxy container 2022-01-31 15:50:05 +01:00
alesapin
9eea8e3183 Fix missed change 2022-01-30 18:22:35 +03:00
alesapin
969987e66b Merge branch 'master' into add_func_tests_over_s3 2022-01-30 18:21:32 +03:00
alesapin
c219a53b4a Add func tests run with s3 2022-01-30 17:28:52 +03:00
Mikhail f. Shiryaev
22eddff0d5
Add a comment about broken logic for skipping checks 2022-01-26 15:30:59 +01:00
Mikhail f. Shiryaev
462e95d0fa
Replace labels_from_ip by pr_event_from_api 2022-01-26 15:03:30 +01:00
Mikhail f. Shiryaev
6fa6588cb5
Add info about body for a failed check 2022-01-26 14:03:01 +01:00
Mikhail f. Shiryaev
99e0ce1ab8
Add get_with_retries helper to build_download_helper.py 2022-01-26 13:20:08 +01:00
Mikhail f. Shiryaev
7cde981531
Apply black formatter to build_download_helper.py 2022-01-26 12:10:20 +01:00
Mikhail f. Shiryaev
1ecee3aa8e
Apply black formatter to pr_info 2022-01-26 12:09:35 +01:00
alesapin
677a7f1133
Merge pull request #33990 from ClickHouse/cancel-lambda
Cancel lambda
2022-01-26 10:51:21 +03:00
Mikhail f. Shiryaev
62ddfbe4ab
Use workflow names instead of ID 2022-01-25 18:32:13 +01:00
Mikhail f. Shiryaev
604af8d3b8
Apply black to cancel lambda 2022-01-25 18:28:17 +01:00
mergify[bot]
c859945b62
Merge branch 'master' into no-clickhouse-test-deb-in-stateless 2022-01-25 11:43:54 +00:00
Mikhail f. Shiryaev
fb908a31e2
Fix dependencies tree for docker image check 2022-01-25 12:09:10 +01:00
Yatsishin Ilya
bc10e08fb4 add missing space 2022-01-25 09:07:04 +00:00
Mikhail f. Shiryaev
57b4655fa2
Fix style for pr_info 2022-01-24 16:34:01 +01:00
Mikhail f. Shiryaev
8e8ee8f8d1
Add style-checker-aarch64 to metrics lambda 2022-01-24 15:50:34 +01:00
mergify[bot]
604b85d861
Merge branch 'master' into no-clickhouse-test-deb-in-stateless 2022-01-24 14:05:17 +00:00
Mikhail f. Shiryaev
7a1f471d6f
Add tests for process_image_with_parrents 2022-01-24 14:55:57 +01:00
Mikhail f. Shiryaev
70d997cbda
Fix pylint issues 2022-01-24 14:54:37 +01:00
Mikhail f. Shiryaev
18ef029ed3
Fix issue with building from non-existing tags 2022-01-24 14:54:29 +01:00
Mikhail f. Shiryaev
3531318388
Add tests for get_changed_docker_images 2022-01-24 14:52:07 +01:00
Mikhail f. Shiryaev
aa296c36bb
Fix dummy PRInfo 2022-01-24 14:51:56 +01:00
Yatsishin Ilya
3a55f7a7d6 Do not use clickhouse-test.deb in stateless 2022-01-24 11:53:42 +00:00
Alexey Milovidov
30b436b9b1 Add more retries in CI for AWS "spot" instances 2022-01-22 13:10:45 +03:00
alexey-milovidov
97e5e71a35
Merge pull request #33872 from ClickHouse/fix_rerun_perf_tests
Fix perf comparison rerun
2022-01-22 10:40:27 +03:00
alesapin
4b93607343 Fix perf comparison 2022-01-21 18:40:03 +03:00
Mikhail f. Shiryaev
9cb136f5b0
Use workflow names in approve lambda 2022-01-19 17:00:41 +01:00
Mikhail f. Shiryaev
d9a1284f2d
Improve typing and arguments 2022-01-19 11:41:34 +01:00
Mikhail f. Shiryaev
3142ae998b
Add option to skip redownload, push tgz 2022-01-19 11:41:33 +01:00
Mikhail f. Shiryaev
13368bf708
Fix some linter issues 2022-01-19 11:41:32 +01:00
Mikhail f. Shiryaev
7fd629004b
Improve push_to_artifactory
- Add tgz archives
- Add --all argument for all packages download
- Add -n to skip pushing to artifactory
- Add help for artifactory-url
- Make 3.8 compatible
- Add cleanup `refs/tags/` from --release argument
2022-01-19 11:41:30 +01:00
Mikhail f. Shiryaev
396b504397
Add some helping comments for API endpoints 2022-01-17 11:06:40 +01:00
Mikhail f. Shiryaev
91caf07b20
Apply black to workflow_approve_rerun_lambda 2022-01-15 18:54:58 +01:00
Mikhail f. Shiryaev
4c7a8abd20
Add PullRequestCI to NEED_RERUN_WORKFLOWS 2022-01-15 18:53:37 +01:00
Maksim Kita
8aed06c922
Merge pull request #33663 from amosbird/addmyself
Add amosbird to trusted user.
2022-01-15 14:10:37 +01:00
Amos Bird
4da2a660ec
Add amosbird to trusted user. 2022-01-15 20:23:55 +08:00
alexey-milovidov
c3972f000d
Merge pull request #33614 from ClickHouse/safe-names-in-blog
Use safe page URL for a blog post
2022-01-15 02:29:37 +03:00
Mikhail f. Shiryaev
a8203dd01e
Merge pull request #33623 from ClickHouse/metrics-lambda
Add an exception message example
2022-01-14 10:06:33 +01:00
Mikhail f. Shiryaev
a63494cb66
Add an exception message example 2022-01-14 10:05:19 +01:00
alesapin
b6937f7462
Merge pull request #33616 from ClickHouse/metrics-lambda
Metrics lambda: fix deletion
2022-01-14 11:53:13 +03:00
Mikhail f. Shiryaev
bca9f56ccd
Improve logging in docs_check.py 2022-01-14 09:15:41 +01:00
Mikhail f. Shiryaev
52594179e3
Fix broken receiver get_dead_runners_in_ec2 2022-01-14 00:51:37 +01:00
Mikhail f. Shiryaev
632b87ac2b
Use key from the secret manager if possible 2022-01-14 00:49:49 +01:00
Mikhail f. Shiryaev
545bee477f
Apply black formatter 2022-01-13 20:52:02 +01:00
alesapin
0804e04558
Merge pull request #32911 from ClickHouse/deb-aarch64
Deb aarch64
2022-01-13 19:11:19 +03:00
Mikhail f. Shiryaev
92099302e7
Use stdin for docker login to not expose a password 2022-01-13 16:57:33 +01:00
Mikhail f. Shiryaev
080c56d91a
Fix pylint for build_check.py 2022-01-13 15:13:58 +01:00
Mikhail f. Shiryaev
89415ff415
Fix pylint for run_check.py 2022-01-13 14:51:48 +01:00
Mikhail f. Shiryaev
25476e2d7d
Restore existing static builds links 2022-01-13 13:55:51 +01:00
Mikhail f. Shiryaev
39012a42aa
Restore description checking 2022-01-13 12:17:09 +01:00
Mikhail f. Shiryaev
ce01dea0fe
Apply black to run_check.py 2022-01-13 12:06:50 +01:00
Mikhail f. Shiryaev
abd16ebf32
Force success aarch stateless tests 2022-01-12 17:07:59 +01:00
Mikhail f. Shiryaev
0e536d5ab0
Apply black to status_helper.py 2022-01-12 17:07:58 +01:00
Mikhail f. Shiryaev
11ede97d0d
Add func-testers-aarch64 group to metrics 2022-01-12 17:07:57 +01:00
Mikhail f. Shiryaev
6373943451
Apply black to metrics lambda app 2022-01-12 17:07:56 +01:00
Mikhail f. Shiryaev
2ae87ad0df
Build docker amd64 and arm64 separately and merge together later 2022-01-12 17:07:55 +01:00
Mikhail f. Shiryaev
341feb5945
Add necessary 'before' field for a dummy object 2022-01-12 17:07:55 +01:00
Mikhail f. Shiryaev
7bc89c4f50
Use cache feature of docker buildx 2022-01-12 17:07:53 +01:00
Mikhail f. Shiryaev
2a83a1c05d
Build dependent images from the current version 2022-01-12 17:07:52 +01:00
Mikhail f. Shiryaev
f11bfdb2ea
Add prebuilding for docker buildx builder 2022-01-12 17:07:51 +01:00
Mikhail f. Shiryaev
fe130bc547
Use buildx for docker images, improve typing 2022-01-12 17:07:50 +01:00
Mikhail f. Shiryaev
43f39bc051
Add typing to docker_images_check.py and ignore dependencies errors 2022-01-12 17:07:50 +01:00
Mikhail f. Shiryaev
3c6f14ae63
Apply black to docker_images_check.py 2022-01-12 17:07:49 +01:00
Mikhail f. Shiryaev
44e02fa075
Add functional tests for aarch64 2022-01-12 17:07:48 +01:00
Mikhail f. Shiryaev
830edf76cc
Don't upload splitted binaries to builds.clickhouse.com 2022-01-12 14:57:11 +01:00
Mikhail f. Shiryaev
9188b8afc2
Fix logic for upload upload_master_static_binaries 2022-01-12 14:30:32 +01:00
Mikhail f. Shiryaev
325c786f68
Add uploading binary builds from master to static URLs 2022-01-12 13:17:54 +01:00
Mikhail f. Shiryaev
3614b0c4ed
Slightly refactor build_check.py 2022-01-12 13:17:21 +01:00
Mikhail f. Shiryaev
eaf3bdabf5
Add typing to CI_CONFIG 2022-01-12 13:14:31 +01:00
Mikhail f. Shiryaev
b98e0be869
Use a proper branch name for PRInfo w/ number==0 2022-01-12 12:31:13 +01:00
Mikhail f. Shiryaev
80a452cca0
Apply black on build_check.py and tee_popen.py 2022-01-11 19:36:34 +01:00
alexey-milovidov
146639273f
Update app.py 2022-01-09 19:20:06 +03:00
alexey-milovidov
4477b7d2f1
Update run_check.py 2022-01-09 19:19:58 +03:00
alesapin
6a4d5a985b Rerun docs release check as well 2022-01-07 12:05:38 +03:00
Alexey Milovidov
2d3f53ec5c Merge branch 'dotnet-integration-test' of github.com:yandex/ClickHouse into dotnet-integration-test 2022-01-04 22:49:58 +03:00
Alexey Milovidov
184033b782 Trying to make it work 2022-01-04 22:49:41 +03:00
alexey-milovidov
c2ed92d75d
Update pr_info.py 2021-12-31 14:39:28 +03:00
Mikhail f. Shiryaev
fccc4dade1
Fix (?) encoding issue in #33331 2021-12-30 22:19:06 +01:00
alexey-milovidov
e879aca58b
Update run_check.py 2021-12-29 23:21:47 +03:00
alesapin
4a1819c4d2 Fix jepsen check 2021-12-29 22:44:41 +03:00
alesapin
948fde52a7 Add retries for github api 2021-12-28 13:13:51 +03:00
alesapin
d188771c05
Merge pull request #33222 from ClickHouse/fix_cancell_lambda
Fix cancel lambda
2021-12-27 13:27:40 +03:00
alesapin
33fd1a44ac Fix cancel lambda 2021-12-27 13:26:16 +03:00
alesapin
342c8231fa Better 2021-12-27 10:33:44 +03:00
alesapin
e683fa146b More debug info in jepsen check 2021-12-27 10:33:25 +03:00
alesapin
9687f1603a Better 2021-12-24 21:34:24 +03:00
alesapin
bd7f5ea50f Better 2021-12-24 21:22:29 +03:00
alesapin
46569e7a5b Better 2021-12-24 21:02:40 +03:00
alesapin
9d83b904de Add pretty print unknow event 2021-12-24 20:57:32 +03:00
alesapin
00666a6a4c
Merge pull request #32998 from ClickHouse/add_jepsen_test
Add Keeper Jepsen check to new CI
2021-12-24 17:25:20 +03:00
alesapin
05648434b9 Fix label 2021-12-24 15:56:38 +03:00