vdimir
72f2288ee4
Add optimize_trivial_approximate_count_query to stress tests
2023-10-24 12:44:18 +02:00
Alexander Tokmakov
6167bf4fca
Update stress.py
2023-10-23 17:27:38 +02:00
robot-clickhouse
f377f4f594
Automatic style fix
2023-10-20 19:06:01 +00:00
Alexander Tokmakov
8a0eae21f5
Update stress.py
2023-10-20 20:45:16 +02:00
Mikhail f. Shiryaev
6a37546a6f
Merge pull request #55874 from ClickHouse/universal-diff-urls
...
One final leftover in diff_urls of PRInfo
2023-10-20 17:49:14 +02:00
Mikhail f. Shiryaev
849e44138a
One final leftover in diff_urls of PRInfo
2023-10-20 17:19:46 +02:00
Mikhail f. Shiryaev
fb5bc09535
Fix caching objects in pygithub, and changelogs
2023-10-19 19:45:16 +02:00
Mikhail f. Shiryaev
d8b899d22b
Use a proper tag from default.checks for enriched images
2023-10-19 11:35:35 +02:00
Mikhail f. Shiryaev
d957d60a52
Use publicly available play.clickhouse.com to search built images
2023-10-19 11:35:10 +02:00
Antonio Andelic
71adb434e3
Remove f-string
2023-10-18 09:19:09 +00:00
Antonio Andelic
be7be17352
add comment
2023-10-18 10:22:18 +02:00
Antonio Andelic
70d366a8eb
Control feature flag randomization with env
2023-10-18 07:59:49 +00:00
Mikhail f. Shiryaev
b382705c2d
Use diff object again, since JSON API limits the files
2023-10-17 17:49:06 +02:00
Max Kainov
ad38c433a1
fix commit labels for diff
2023-10-17 08:48:25 +00:00
Max Kainov
fc9a5a725c
Revert "Revert "Integration check script fix ups""
...
This reverts commit 67b9407530
2023-10-17 08:18:17 +00:00
alesapin
67b9407530
Revert "Integration check script fix ups"
2023-10-16 22:01:44 +02:00
Max Kainov
4d1edc2780
return back unidiff module
2023-10-16 15:00:13 +00:00
Max Kainov
683437c61c
fix docs and script
2023-10-16 10:35:14 +00:00
Max Kainov
60ad1c79bd
fix docs
2023-10-16 10:35:14 +00:00
robot-clickhouse
7c2fee3280
Automatic style fix
2023-10-16 10:35:14 +00:00
Max Kainov
3f3fcce7e5
gh api request func update
2023-10-16 10:35:14 +00:00
Mikhail f. Shiryaev
c5ebd6f072
Use requests.gte in get_gh_api
2023-10-16 10:35:14 +00:00
Mikhail f. Shiryaev
346e8a0162
Remove recursion in favor of reset retry loop
2023-10-16 10:35:14 +00:00
Max Kainov
f1c316b79b
ci script to use git hub api urls, readme for test
2023-10-16 10:35:13 +00:00
Han Fei
0167b76e98
fix structure does not match logs again
2023-10-14 16:01:32 +02:00
Han Fei
e3ceca06e0
cast extra column expression pull_request_number to Int32
2023-10-13 14:52:25 +02:00
Mikhail f. Shiryaev
e60983f5ae
Do not fail if label-to-remove does not exists in PR
2023-10-13 13:32:56 +02:00
Alexey Milovidov
8f54123901
Update pr.py
2023-10-11 20:38:37 +03:00
Alexey Milovidov
f4ccf9f94f
Update pr.py
2023-10-11 20:38:19 +03:00
Alexey Milovidov
c04a33a70a
Update pr.py
2023-10-11 20:38:01 +03:00
Mike Kot
125250b4fd
add k-morozov to trusted
2023-10-11 17:25:54 +00:00
Mikhail f. Shiryaev
59a1947653
Fix broken style check get_images
2023-10-04 14:29:01 +02:00
Mikhail f. Shiryaev
d94228b718
Fix style-check errors
2023-10-04 14:29:00 +02:00
Alexey Milovidov
be9a3cea42
Merge pull request #55122 from ClickHouse/vdimir/status_comment_link
...
Add links to check reports in status comment
2023-09-30 08:55:54 +03:00
Mikhail f. Shiryaev
fe155c61d4
Merge pull request #54532 from ClickHouse/Fix_ci_skip_build_and_skip_tests
...
Fix CI skip build and skip tests checks
2023-09-29 14:01:35 +02:00
vdimir
7c471be846
Fix link in table in status comment
2023-09-29 12:00:07 +02:00
vdimir
37bd5dd7be
Add links to check reports in status comment
2023-09-29 08:46:23 +00:00
vdimir
3a9abde35d
Merge pull request #54514 from ClickHouse/vdimir/allow_experimental_partial_result
...
Add setting allow_experimental_partial_result
2023-09-29 10:32:57 +02:00
vdimir
fff77876f9
Add partial_result_update_duration_ms to stress tests
2023-09-28 09:41:00 +00:00
Mikhail f. Shiryaev
183af376e1
Add a digest result in the end of the report
2023-09-28 11:22:38 +02:00
Mikhail f. Shiryaev
f19c172c5e
Move to parsing json reports of google test
2023-09-28 09:39:56 +02:00
Mikhail f. Shiryaev
1dddd8f08f
Fix the failing sqllogic jobs
2023-09-28 01:24:33 +02:00
Mikhail f. Shiryaev
eb00284896
Fix DownloadException
2023-09-28 01:24:32 +02:00
Mikhail f. Shiryaev
c5b1aa4aa5
Clean even more os.path
2023-09-28 01:24:31 +02:00
Mikhail f. Shiryaev
ff58e152d8
Remove os.path from docker related scripts
2023-09-28 01:20:36 +02:00
Mikhail f. Shiryaev
2d1dba372e
Get rid of the most of os.path stuff
2023-09-28 01:20:05 +02:00
Smita Kulkarni
c3f3824562
Merge branch 'master' into Fix_ci_skip_build_and_skip_tests
2023-09-24 13:31:24 +02:00
Smita Kulkarni
91149bc5a9
Fixed sha check
2023-09-24 13:30:38 +02:00
Robert Schulze
9a91f97ac4
Merge pull request #53831 from rschu1ze/clang-17
...
Switch CI to Clang 17
2023-09-22 12:28:35 +02:00
Robert Schulze
5209bd2d51
Merge remote-tracking branch 'rschu1ze/master' into clang-17
2023-09-21 14:45:55 +00:00
Mikhail f. Shiryaev
78b9d00966
Decrease timeout for fast tests with a commit
2023-09-21 16:25:17 +02:00
Mikhail f. Shiryaev
6acdd65c8e
Launch fast tests as the current user
2023-09-20 22:32:19 +02:00
Mikhail f. Shiryaev
dd7096bc59
Speed up fast tests a little bit
2023-09-20 19:09:06 +02:00
vdimir
65baf129bf
Do not set PR status label
2023-09-20 09:21:58 +00:00
Robert Schulze
cbcff6ef08
Merge remote-tracking branch 'rschu1ze/master' into clang-17
2023-09-20 09:15:58 +00:00
Mikhail f. Shiryaev
4882b99715
Merge pull request #54310 from ClickHouse/ci-libfuzzer-integration
...
CI: libFuzzer integration
2023-09-20 10:01:39 +02:00
Yakov Olkhovskiy
b1b49f430a
review suggestions
2023-09-19 15:32:58 +00:00
Smita Kulkarni
132bcbe3a4
Merge branch 'master' into Fix_ci_skip_build_and_skip_tests
2023-09-19 16:16:17 +02:00
Smita Kulkarni
d07c2dc271
Added datatype and return type to function
2023-09-18 22:09:59 +02:00
Robert Schulze
3a3a00f95e
Bump minimal required compiler to Clang 16
2023-09-18 17:44:04 +00:00
robot-clickhouse
009d22b3d7
Automatic style fix
2023-09-18 12:21:11 +00:00
Smita Kulkarni
0c26f41ac9
Fixed style
2023-09-18 14:07:31 +02:00
robot-clickhouse
0a042fc3f0
Automatic style fix
2023-09-18 09:50:17 +00:00
Smita Kulkarni
a445335d91
Fixed style check
2023-09-18 11:23:28 +02:00
robot-clickhouse
b7e0b8ca77
Automatic style fix
2023-09-18 09:01:25 +00:00
Smita Kulkarni
0b172ed173
Updated version check in integration test & updated to check test_type in functional tests
2023-09-18 10:47:33 +02:00
Yakov Olkhovskiy
dd6f12dd94
review suggestions
2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
3a14bde95a
cleanup, fix tee to escape non-decodable symbols
2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
cd0c775355
review suggestions
2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
d80ae88060
run docker
2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
1ad0a77c9f
unzip corpora
2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
44546458f0
add infrastructure files to the download filter
2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
0847889db6
libFuzzer infrastructure
2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
b7a17bf8dd
add libFuzzer tests, initial integration
2023-09-17 16:36:49 +00:00
Mikhail f. Shiryaev
4c9f8d150b
Merge pull request #54504 from ClickHouse/s3-artifacts
...
S3 artifacts
2023-09-15 18:21:57 +02:00
robot-ch-test-poll
3af3114478
Merge pull request #54668 from Avogar/better-ci-libs
...
Move all `tests/ci/*.lib files` to `stateless-tests` image
2023-09-15 17:40:01 +02:00
Igor Nikonov
eb6fceccbb
Merge pull request #54278 from ClickHouse/ci-check-process-timeout
...
CI: a try to handle tests timeouts
2023-09-15 17:13:16 +02:00
Mikhail f. Shiryaev
964b9ede2d
Improve index.html for the non-CI runnings
2023-09-15 15:00:35 +02:00
Mikhail f. Shiryaev
5200a8dadc
Create directory for archives if not exists
2023-09-15 15:00:32 +02:00
Mikhail f. Shiryaev
414594a472
Decouple ArtifactsHelper commit status
2023-09-15 14:54:48 +02:00
Mikhail f. Shiryaev
40e04fee6c
Report only changed images in commit status
2023-09-15 14:54:47 +02:00
Mikhail f. Shiryaev
5ead298d53
Improve S3Helper url handling, ArtifactsHelper local artifacts
2023-09-15 14:54:47 +02:00
Mikhail f. Shiryaev
51e79e1ddf
Create commit status for Artifacts
2023-09-15 14:54:46 +02:00
Mikhail f. Shiryaev
3f350eb148
Create artifact_helper for lightweight workflow artifacts
2023-09-15 14:54:45 +02:00
Mikhail f. Shiryaev
eef15ff67a
Insignificant improvements to git_helper and compress_files
2023-09-15 14:54:44 +02:00
Mikhail f. Shiryaev
2f8f16a864
Fix git_helper import issue with git_runner.run()
2023-09-15 14:54:44 +02:00
Mikhail f. Shiryaev
fde8817fb7
Fix PRInfo and docker_images_check typing
2023-09-15 14:54:42 +02:00
avogar
d5889c8cc8
Move all tests/ci/*.lib files to stateless-tests image
2023-09-15 11:27:09 +00:00
János Benjamin Antal
13868e4d1d
Fix review comments
2023-09-14 14:45:23 +00:00
János Benjamin Antal
f7ceb76dcb
Fix pylint and mypy issues
2023-09-14 13:41:34 +00:00
János Benjamin Antal
699bf031c9
Remove accidentally committed code
2023-09-14 12:07:15 +00:00
János Benjamin Antal
51781a6a86
Add workflow
2023-09-14 12:05:50 +00:00
János Benjamin Antal
078c16760f
Add --remote-protocol arg
2023-09-14 12:05:49 +00:00
robot-clickhouse
0fda5e4bf2
Automatic style fix
2023-09-14 11:44:34 +00:00
János Benjamin Antal
da802b2688
Do the release
2023-09-14 11:28:35 +00:00
János Benjamin Antal
b13a07863d
Add gh_cache to gitignore to pass dirty check
2023-09-14 11:17:20 +00:00
János Benjamin Antal
6df371754d
Fix typos in release.py
2023-09-14 10:54:17 +00:00
János Benjamin Antal
33eeb0737f
Fix style errors
2023-09-14 10:23:26 +00:00
János Benjamin Antal
462f4111de
Turn PoC into real script without calling release.py
2023-09-13 23:33:04 +00:00
robot-clickhouse
94b6d9ed05
Automatic style fix
2023-09-13 17:16:17 +00:00
János Benjamin Antal
84e311321d
Add basic logic to find releasable commits
2023-09-13 17:05:31 +00:00
robot-clickhouse
3ed7f47af9
Automatic style fix
2023-09-13 16:56:14 +00:00
Smita Kulkarni
1ec52de797
Addressed review comments
2023-09-13 18:37:03 +02:00
robot-clickhouse
fe2240afbf
Automatic style fix
2023-09-13 08:23:14 +00:00
Smita Kulkarni
176bd0e509
Fixed function call and added check for FORCE_TESTS_LABEL
2023-09-13 09:58:57 +02:00
Mikhail f. Shiryaev
397a682d1c
Merge pull request #54441 from ClickHouse/vdimir/ci-commit-statis-update
...
Update automated commit status comment
2023-09-12 21:18:13 +02:00
Igor Nikonov
031da054f3
Return initial timeout
2023-09-12 19:06:39 +00:00
robot-clickhouse
63f71b719d
Automatic style fix
2023-09-12 18:31:34 +00:00
Igor Nikonov
4671901313
Update stress_check.py
2023-09-12 18:17:55 +00:00
Igor Nikonov
8a4654c39e
Address review comment
2023-09-12 18:06:00 +00:00
vdimir
acb559ce8b
Update tests/ci/commit_status_helper.py
...
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2023-09-12 17:34:52 +02:00
Igor Nikonov
7f90b7983c
Merge remote-tracking branch 'origin/master' into ci-check-process-timeout
2023-09-12 13:41:35 +00:00
Igor Nikonov
8db991faa0
Fix style
2023-09-12 13:41:31 +00:00
vdimir
72d5a5d094
fix report.py
2023-09-12 11:54:35 +00:00
robot-clickhouse
5a7ecbc23e
Automatic style fix
2023-09-12 10:18:40 +00:00
Smita Kulkarni
135c447f07
Updated check to fix style
2023-09-12 12:01:27 +02:00
robot-clickhouse
3b4120ba55
Automatic style fix
2023-09-12 08:51:21 +00:00
Smita Kulkarni
9accebe73d
Updated can_skip_builds_and_use_version_from_master, can_skip_integration_tests, can_skip_functional_tests checks in ci
2023-09-12 10:30:59 +02:00
vdimir
790d61971c
sucessfull items in report can be expandable
2023-09-11 17:06:16 +00:00
vdimir
8bb0fbfd2c
fix
2023-09-11 17:03:28 +00:00
vdimir
4a80a0f1c0
upd
2023-09-11 16:13:52 +00:00
vdimir
960ca5ebde
Show PR status in label
2023-09-11 16:13:33 +00:00
vdimir
a1ee226969
Update PR status icons
2023-09-11 16:13:11 +00:00
vdimir
61fdb63aad
fix
2023-09-11 13:53:20 +00:00
vdimir
297306b4b9
status emoji in the beginning of title
2023-09-11 13:36:02 +00:00
Alexey Milovidov
c4c41cad23
Merge branch 'ci-instance-type' of github.com:ClickHouse/ClickHouse into ci-instance-type
2023-09-09 05:52:04 +02:00
Alexey Milovidov
154ac14ef6
Fix error
2023-09-09 05:51:43 +02:00
robot-clickhouse
923d7a0bc3
Automatic style fix
2023-09-09 00:27:39 +00:00
Alexey Milovidov
0728df37e6
Add instance_type column to CI Logs and the checks table
2023-09-09 01:44:14 +02:00
vdimir
6a51d9fd7d
do not merge this commit
2023-09-08 17:04:44 +00:00
vdimir
a46d1974ac
fix
2023-09-08 15:49:13 +00:00
vdimir
465d84aba7
Set raw_logs in create_ci_report
2023-09-08 15:39:07 +00:00
vdimir
b0b8255c6f
Set PR status into title
2023-09-08 15:36:32 +00:00
vdimir
5e0caa669e
Move sucessull checks in commit status under a spoiler
2023-09-08 09:56:53 +00:00
János Benjamin Antal
5862c4ec93
Use not the absolute latest docker image tag ( #54369 )
...
* Add params for select queries in clickhouse_helper.py
* Find the latest image tags from master
* Get full git history
* Do not checkout submodules
* Automatic style fix
* Fix style errors
* Make logging pretty
* Revert accidentally committed changes
* Eliminate pformat
* Update all workflows
* Remove flag with default value
* Improve exception handling
* Utilizing the loop condition in while loop
* Make the logic robust over temporary errors
* Prettify logs
* Automatic style fix
* Add accidentally removed line
* Revert "Make the logic robust over temporary errors"
This reverts commit 91e6b5d7ba
2023-09-08 08:42:56 +02:00
robot-clickhouse
c680c951d3
Automatic style fix
2023-09-07 13:12:53 +00:00
Igor Nikonov
27455a5882
Test timeout to fail
2023-09-07 12:57:35 +00:00
Igor Nikonov
c354fcaff7
Timeout report for stress_check
2023-09-07 12:56:22 +00:00
Igor Nikonov
a0317e461a
Better description
2023-09-07 12:41:36 +00:00
Igor Nikonov
7ab56a13b8
Polishing
2023-09-06 22:49:28 +00:00
Igor Nikonov
babbecc646
Fix
2023-09-06 15:00:32 +00:00
Igor Nikonov
e858f0b880
Fix description length
2023-09-06 13:05:56 +00:00
Igor Nikonov
32048f2a8d
Merge remote-tracking branch 'origin/master' into ci-check-process-timeout
2023-09-06 12:48:43 +00:00
Igor Nikonov
f6f2e731a7
Fix state
2023-09-06 12:44:39 +00:00
robot-clickhouse
f08d445a0f
Automatic style fix
2023-09-06 11:59:51 +00:00
Igor Nikonov
a22e219be9
Fix
2023-09-06 11:51:43 +00:00
Igor Nikonov
3ef6d0da39
Set status and description
2023-09-06 11:02:17 +00:00
Mikhail f. Shiryaev
7f34c8e17d
Decouple env_helper.get_job_id_url
2023-09-06 12:43:29 +02:00
Mikhail f. Shiryaev
1afc5b7e05
Use suffix from git tags as version descriptions
2023-09-06 12:43:28 +02:00
Mikhail f. Shiryaev
6fc73e0e1f
Use a single BuildResult class across builds and report checks
2023-09-06 12:43:27 +02:00
Mikhail f. Shiryaev
88664bef3f
Create report status constants
2023-09-06 12:43:25 +02:00
Mikhail f. Shiryaev
428b72e767
Combine rows for build templates with lists
2023-09-06 12:43:23 +02:00
Mikhail f. Shiryaev
e0f6242af8
Use the same style for all reports
2023-09-06 12:43:21 +02:00
Mikhail f. Shiryaev
e18d9d39e8
Migrate S3Helper to pathlib.Path
2023-09-06 12:43:20 +02:00
Mikhail f. Shiryaev
7999598ad8
Rollback testing part from #42599
2023-09-05 12:59:31 +02:00
robot-clickhouse
0f5c49f6b5
Automatic style fix
2023-09-04 21:23:58 +00:00
Igor Nikonov
8aeccd078b
Try to catch timeout
2023-09-04 21:16:25 +00:00
robot-clickhouse
926c5636dd
Merge pull request #42599 from ClickHouse/build-fuzzer-protocol
...
libFuzzer: add CI fuzzers build, add tcp protocol fuzzer, fix other fuzzers.
2023-09-04 22:41:54 +02:00
Mikhail f. Shiryaev
9851aebfa8
Add a note of where the lambda is deployed
2023-09-04 18:37:58 +02:00
Mikhail f. Shiryaev
4d0d161748
Use comment as a docstring
2023-09-04 17:06:52 +02:00
Mikhail f. Shiryaev
7351ac1d73
Deploy slack_bot_ci_lambda as other lambdas
2023-09-04 17:06:52 +02:00
Mikhail f. Shiryaev
5e27ca6e59
Use host network to avoid ipv6 problems
2023-09-04 17:06:51 +02:00
Mikhail f. Shiryaev
a082167d85
Move ci-slack-bot from utils to tests/ci
2023-09-04 17:06:51 +02:00
robot-clickhouse
f464effbea
Automatic style fix
2023-09-03 22:15:53 +00:00
Yakov Olkhovskiy
11b7e1467f
update build_check script
2023-09-03 21:51:12 +00:00
Yakov Olkhovskiy
02a729f9c5
fix
2023-09-03 18:05:54 +00:00
Yakov Olkhovskiy
ae6b5d46be
fix
2023-09-03 17:38:36 +00:00
Yakov Olkhovskiy
97317a07f1
remove oss-fuzz build, add fuzzers build
2023-09-03 17:28:44 +00:00
Alexey Milovidov
e7f674165a
Merge pull request #54210 from ClickHouse/fix-timezones-ci-logs
...
Fix timezones in the CI Logs database
2023-09-03 04:58:43 +03:00
Alexey Milovidov
9763a4c2d4
Fix timezones in the CI Logs database
2023-09-02 17:49:51 +02:00
Alexander Tokmakov
d9438b176c
save system tables from s3 in the report
2023-09-01 23:04:35 +02:00
Mikhail f. Shiryaev
6fb0257ee0
Use CiLogsCredentials in build_check
2023-08-30 22:06:30 +02:00
Mikhail f. Shiryaev
e113ba9024
Add vim filetype for *.lib files
2023-08-30 22:06:26 +02:00
Mikhail f. Shiryaev
f0c18d4bd7
Rework setup of CI logs export
2023-08-30 22:04:37 +02:00
Mikhail f. Shiryaev
c37c6c5220
Get rid of describe_parameters for the best robot token
2023-08-25 12:41:20 +02:00
Mikhail f. Shiryaev
0b9e7fa9c5
Reduce API calls to SSM client
2023-08-23 22:15:44 +02:00
Mikhail f. Shiryaev
eb9b452e86
Add default timeout value for ClickHouseHelper
2023-08-21 15:20:23 +02:00
Mikhail f. Shiryaev
b7866ce75f
Merge pull request #53493 from ClickHouse/update-style-checker
...
Update style checker
2023-08-17 12:56:20 +02:00
Mikhail f. Shiryaev
fd3e6c93ee
Produce standard report for cases when AST failed
2023-08-17 09:39:02 +02:00
Alexey Milovidov
857856b8b6
Leave only simplifications
2023-08-17 03:58:32 +02:00
Alexey Milovidov
64c829807c
Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci-performance
2023-08-17 03:56:27 +02:00
Alexey Milovidov
428a05a560
Follow-up: Do not send logs to CI if the credentials are not set ( #53456 )
...
* Follow-up
* Automatic style fix
* Update tests/ci/ast_fuzzer_check.py
* Update tests/ci/functional_test_check.py
* Update tests/ci/stress_check.py
* Automatic style fix
---------
Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-08-16 14:04:14 +03:00
Mikhail f. Shiryaev
651a45b04d
Add tests for initd start
2023-08-16 01:03:29 +02:00
Mikhail f. Shiryaev
3cd9fa395d
Add test for systemd + /etc/default/clickhouse
2023-08-16 00:51:44 +02:00
Mikhail f. Shiryaev
790475385a
Improve downloading: skip dbg, do not pull images on --no-download
2023-08-16 00:47:39 +02:00
Mikhail f. Shiryaev
387ce81895
Clean all containers properly
2023-08-16 00:46:53 +02:00
Nikita Mikhaylov
12ebfc9a7e
Merge pull request #53441 from ClickHouse/graceful-degradation-sending-logs-to-ci
...
Do not send logs to CI if the credentials are not set
2023-08-15 18:24:14 +02:00
Mikhail f. Shiryaev
33948a150f
Restart killed PublishedReleaseCI workflows
2023-08-15 11:50:11 +02:00
robot-clickhouse
a92fe25ff9
Automatic style fix
2023-08-15 07:15:58 +00:00
Alexey Milovidov
df02512ebf
Do not send logs to CI if the credentials are not set
2023-08-15 08:53:08 +02:00
Mikhail f. Shiryaev
56a8818cf2
Fix logic of Mergeable Check
2023-08-14 14:31:26 +02:00
Mikhail f. Shiryaev
900e38a676
Fail early on missed documentation for new features
2023-08-14 14:20:40 +02:00
Mikhail f. Shiryaev
310ac6feaf
Tune PRInfo.has_changes_in_documentation
2023-08-14 14:19:08 +02:00
Alexey Milovidov
748a65b2bb
Fix error
2023-08-13 06:35:32 +02:00
Alexey Milovidov
25fefbe144
Fix error
2023-08-13 06:32:48 +02:00
Alexey Milovidov
3ca59e9b19
Fix a typo
2023-08-13 06:25:55 +02:00
Alexey Milovidov
df6fe897c6
Better logs in CI
2023-08-13 06:17:45 +02:00
Alexey Milovidov
645834ffb6
Fix errors
2023-08-13 04:54:20 +02:00
Alexey Milovidov
fd3d0f7fa4
Merge branch 'master' into export-logs-in-ci-performance
2023-08-13 02:43:37 +02:00
Alexey Milovidov
077cd535e2
Improvements
2023-08-13 02:38:48 +02:00
Alexey Milovidov
b84132f4cd
Merge branch 'master' into export-logs-in-ci-fuzz
2023-08-13 02:17:30 +02:00
Alexey Milovidov
6fadb8e883
Merge pull request #53353 from ClickHouse/export-logs-in-ci-stress
...
Export logs from CI in stress tests
2023-08-13 03:07:46 +03:00
Alexey Milovidov
221dd53d37
Fixup
2023-08-13 00:36:50 +02:00
Alexey Milovidov
32778e0407
Export logs from CI in performance (part 3)
2023-08-13 00:34:01 +02:00
Alexey Milovidov
5df03dd12f
Better
2023-08-13 00:19:58 +02:00
Alexey Milovidov
d059465389
Merge pull request #52293 from ClickHouse/sqltest
...
Add SQLTest
2023-08-13 00:35:46 +03:00
robot-clickhouse
7d7ed06010
Automatic style fix
2023-08-12 20:53:33 +00:00
robot-clickhouse
e6e5a3858d
Automatic style fix
2023-08-12 20:43:29 +00:00
Alexey Milovidov
afbb91600e
Export logs from CI in fuzzer
2023-08-12 22:41:56 +02:00
Alexey Milovidov
176c16fcc5
Export logs from CI in stress tests
2023-08-12 22:30:18 +02:00
Alexey Milovidov
fc6fc234b2
Merge pull request #53086 from ClickHouse/export-logs-in-ci
...
Add a script to export logs in CI
2023-08-12 17:35:36 +03:00
Yakov Olkhovskiy
fa7994de3b
Merge pull request #53181 from ClickHouse/ci-build-s390x
...
Add Linux s390x build to CI
2023-08-12 09:16:07 -04:00
Alexey Milovidov
01e9f32fdf
Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci
2023-08-12 02:46:06 +02:00
Alexey Milovidov
3232993eeb
Merge pull request #53344 from ClickHouse/relax-mergeable-check
...
Relax mergeable check
2023-08-12 03:38:12 +03:00
Alexey Milovidov
1ae186b679
Merge branch 'export-logs-in-ci' of github.com:ClickHouse/ClickHouse into export-logs-in-ci
2023-08-12 02:11:48 +02:00
Alexey Milovidov
38c60430f4
Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci
2023-08-12 02:11:43 +02:00
Alexey Milovidov
62b3485cd8
Merge pull request #53283 from ClickHouse/fix-00906_low_cardinality_cache
...
Inhibit randomization in `00906_low_cardinality_cache`
2023-08-12 03:01:43 +03:00
Alexey Milovidov
aa815bfc74
Relax mergeable check
2023-08-12 01:54:11 +02:00
robot-clickhouse
2b852e55b6
Automatic style fix
2023-08-11 21:13:53 +00:00
Alexey Milovidov
af74bc9564
Merge branch 'export-logs-in-ci' of github.com:ClickHouse/ClickHouse into export-logs-in-ci
2023-08-11 22:57:23 +02:00
Alexey Milovidov
ddb7fb2ce9
Update tests/ci/functional_test_check.py
...
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2023-08-11 23:56:23 +03:00
Alexey Milovidov
9b7fcf17bc
Merge branch 'allow-creating-system-tables-at-startup' into export-logs-in-ci
2023-08-11 22:54:24 +02:00
Alexey Milovidov
b6c47ee157
Merge branch 'master' into export-logs-in-ci
2023-08-11 03:44:18 +02:00
Mikhail f. Shiryaev
dcb1d3ed00
Rewrite compress_file to pathlib.Path
2023-08-10 22:41:57 +02:00
Mikhail f. Shiryaev
c8d5deda83
Add typing to compress_files
2023-08-10 22:41:56 +02:00
Mikhail f. Shiryaev
18a291a4c7
Upload cargo cache for rust to S3 and reuse
2023-08-10 22:41:55 +02:00
Mikhail f. Shiryaev
dbd3fdd437
Clean ccache_utils a little bit
2023-08-10 22:09:20 +02:00
Mikhail f. Shiryaev
cbd81b3758
Partially revert changes from #52395
2023-08-10 22:09:19 +02:00
Alexey Milovidov
3acb10b8bc
Inhibit randomization in 00906_low_cardinality_cache
2023-08-10 20:51:03 +02:00
Alexey Milovidov
561e043868
Merge branch 'master' into sqltest
2023-08-10 21:47:56 +03:00
Alexey Milovidov
269f54b49e
Merge branch 'master' into export-logs-in-ci
2023-08-10 16:56:14 +03:00
Alexey Milovidov
47b5d13367
Merge branch 'master' into fix-stress-test
2023-08-10 16:55:49 +03:00
Alexey Milovidov
e4fbca2e2e
Apply review recommendations
2023-08-10 04:47:44 +02:00
Alexey Milovidov
cfdccb95d5
Merge branch 'master' into export-logs-in-ci
2023-08-10 04:30:23 +02:00
Alexey Milovidov
53151610a0
Merge branch 'master' into sqltest
2023-08-10 03:47:26 +03:00
Mikhail f. Shiryaev
ce30b93b34
Move repeated code for ClickHouseHelper to _insert_post
2023-08-09 23:46:45 +02:00
Mikhail f. Shiryaev
c7b045fdde
Process build profiles in the python script, not in docker
2023-08-09 21:48:05 +02:00
Mikhail f. Shiryaev
239d198cf2
Add insert_file to ClickHouseHelper, make insert_json_str public
2023-08-09 21:11:21 +02:00
Mikhail f. Shiryaev
1405346830
Rewrite build_check to use pathlib.Path
2023-08-09 18:56:19 +02:00
Mikhail f. Shiryaev
5341c5c8dd
Use CMAKE_FLAGS and args for cmake profiler
2023-08-09 18:26:25 +02:00
Alexey Milovidov
964c407d48
Revert "Revert "Upload build time-trace data to CI database""
2023-08-09 16:11:17 +03:00
Alexander Gololobov
63183c56f1
Revert "Upload build time-trace data to CI database"
2023-08-09 13:58:05 +02:00
Alexey Milovidov
10bc51514b
Merge branch 'allow-creating-system-tables-at-startup' into export-logs-in-ci
2023-08-09 04:28:50 +02:00
Alexey Milovidov
ede1b17c48
Merge branch 'master' into sqltest
2023-08-09 05:10:47 +03:00
Yakov Olkhovskiy
d8a231e0cb
Add Linux s390x build to CI
2023-08-09 00:44:01 +00:00
Alexey Milovidov
acb43266ad
Merge branch 'master' into fix-stress-test
2023-08-08 23:41:59 +03:00
robot-clickhouse
b397d11c91
Automatic style fix
2023-08-08 19:26:19 +00:00
Alexey Milovidov
23eee8d10d
Merge branch 'master' of github.com:ClickHouse/ClickHouse into upload-build-profile
2023-08-08 21:02:26 +02:00
Alexey Milovidov
2b59c1778c
More info
2023-08-08 21:02:13 +02:00
Alexey Milovidov
ed34f3c46f
Fix error
2023-08-08 21:00:30 +02:00
robot-clickhouse
2eff5928d9
Automatic style fix
2023-08-08 13:44:10 +00:00
Alexey Milovidov
7ce8266c8a
Fix errors
2023-08-08 15:17:20 +02:00
János Benjamin Antal
67a87a4b95
Merge pull request #53051 from ClickHouse/only-debug-upgrade-check
...
Require only ASAN based upgrade check to minimize false positives
2023-08-08 11:44:11 +02:00
Alexey Milovidov
a91edb8b55
Fix mypy
2023-08-08 04:11:32 +02:00
Alexey Milovidov
161de7c12f
Fix error
2023-08-08 03:34:44 +02:00
Alexey Milovidov
5644216429
Fix whitespace
2023-08-07 23:40:34 +02:00
Alexey Milovidov
27559b0349
Adjust a test
2023-08-07 23:09:34 +02:00
Alexey Milovidov
cafe4354c5
Merge branch 'master' into export-logs-in-ci
2023-08-07 23:08:26 +02:00
Alexey Milovidov
77e1693f3c
Fix mypy
2023-08-07 21:18:56 +02:00
Alexey Milovidov
8ce4ff0f95
Merge branch 'master' of github.com:ClickHouse/ClickHouse into upload-build-profile
2023-08-07 21:18:30 +02:00
Alexey Milovidov
ab64845740
Fix mypy
2023-08-07 18:45:32 +02:00
Alexey Milovidov
5275062eaf
Fix trailing whitespaces
2023-08-07 18:44:25 +02:00
Mikhail f. Shiryaev
2347f5886b
Update Mergeable Check at the finishing CI
2023-08-07 18:06:50 +02:00
Alexey Milovidov
9cb949b60b
Fix style
2023-08-07 14:53:38 +02:00
János Benjamin Antal
55c3581242
Replace Upgrade check (debug) with a less flaky upgrade check
2023-08-07 10:27:10 +02:00
robot-clickhouse
19ad81dabd
Automatic style fix
2023-08-07 01:50:29 +00:00
Alexey Milovidov
d977e221b4
Upload build time-trace data to CI database
2023-08-07 03:26:59 +02:00
robot-clickhouse
333ed6425c
Automatic style fix
2023-08-06 11:30:50 +00:00
Alexey Milovidov
9428040d05
Fix hung check in stress test
2023-08-06 13:07:48 +02:00
Alexey Milovidov
fbb2be21cc
Slightly better
2023-08-06 13:04:35 +02:00
robot-clickhouse
2edda961d2
Automatic style fix
2023-08-06 02:55:26 +00:00
Alexey Milovidov
f1eee292c9
Enable export (first try)
2023-08-06 04:38:04 +02:00
Alexey Milovidov
580f207b8d
Merge branch 'master' into sqltest
2023-08-04 22:16:56 +03:00
János Benjamin Antal
c874e5955b
Remove upgrade checks with sanitizers
2023-08-04 12:33:11 +00:00
robot-ch-test-poll2
c556ad96f6
Merge pull request #52948 from ClickHouse/refactor-ci-config
...
Refactor CI_CONFIG
2023-08-04 11:10:12 +02:00
Alexey Milovidov
388feb953d
Fix paths
2023-08-03 19:28:59 +02:00
Mikhail f. Shiryaev
ca67576720
Do not use inline cache in server images
2023-08-03 18:06:00 +02:00
Alexey Milovidov
65e8ee8fb7
Fix paths
2023-08-03 15:28:18 +02:00
Mikhail f. Shiryaev
8499956321
Refactor CI_CONFIG from dict to dataclasses
2023-08-03 14:37:19 +02:00
Alexey Milovidov
5ec6a4695f
Fix log paths
2023-08-02 23:22:15 +02:00
Alexey Milovidov
a98e869912
Merge branch 'master' into sqltest
2023-08-02 20:08:39 +02:00
Mikhail f. Shiryaev
6dcdc4cd38
Remove mark_failed_report_pending, it's already in builds_report_config
2023-08-02 19:20:22 +02:00
Mikhail f. Shiryaev
40cdfa2384
Merge branch 'master' into fix-packager
2023-08-02 11:21:54 +02:00
Mikhail f. Shiryaev
3a07b80f34
Merge pull request #52277 from ClickHouse/kill-runner-with-subprocesses
...
Kill the runner process with all subprocesses
2023-08-02 11:18:56 +02:00
alesapin
0abd5a058b
Merge pull request #52871 from ClickHouse/cont-server-after-gdb-killed
...
Try to continue clickhouse process in stress test after terminating gdb.
2023-08-02 10:55:38 +02:00
Mikhail f. Shiryaev
8537b32de1
Merge branch 'master' into docker-improvements
2023-08-02 08:40:24 +02:00
Alexey Milovidov
3b6247e3f5
Merge branch 'sqltest' of github.com:ClickHouse/ClickHouse into sqltest
2023-08-01 22:33:19 +02:00
Alexey Milovidov
0641dfd7e6
Add missing modification
2023-08-01 22:33:04 +02:00
Alexey Milovidov
97bd68d5c7
Merge branch 'master' into sqltest
2023-08-01 22:31:18 +02:00
Mikhail f. Shiryaev
f87e53c042
Merge branch 'master' into sqltest
2023-08-01 17:42:58 +02:00
Mikhail f. Shiryaev
6b29cccf3e
Rename docker_images.json to docker_images_for_tests.json
2023-08-01 17:30:54 +02:00
Mikhail f. Shiryaev
79d49a006c
Fix the PR body check for Reverts #number
2023-08-01 17:06:23 +02:00
Nikolai Kochetov
09cb5cbe87
Try to continue clickhouse process in stress test after terminating gdb.
2023-08-01 14:30:41 +00:00
Mikhail f. Shiryaev
0931e87989
Merge branch 'master' into sqltest
2023-08-01 16:14:28 +02:00
Alexey Milovidov
8646eefc9c
Update docker_test.py
2023-08-01 17:05:24 +03:00
Mikhail f. Shiryaev
e5087d14ab
Merge branch 'master' into fix-packager
2023-08-01 12:04:06 +02:00
Kseniia Sumarokova
40ce9cf9ed
Merge pull request #51843 from ClickHouse/kssenii-nginx
...
Replace kssenii/nginx-test by clickhouse/nginx-dav
2023-08-01 11:36:20 +02:00
Alexey Milovidov
afb76101b7
Remove obsolete part of a check name
2023-07-31 05:23:28 +02:00
Alexey Milovidov
d243602e74
Merge pull request #52773 from ClickHouse/upload-build-check-statistics
...
Upload build statistics to the CI database
2023-07-31 06:18:41 +03:00
Alexey Milovidov
8155659f87
Merge pull request #52775 from ClickHouse/remove-coverity-2
...
Remove Coverity (part 2)
2023-07-30 12:49:04 +03:00
Alexey Milovidov
bc1f80dd82
Remove Coverity (part 2)
2023-07-30 10:25:44 +02:00
robot-clickhouse
358773c620
Automatic style fix
2023-07-30 07:45:27 +00:00
Alexey Milovidov
448756d148
Add machine_type information to the CI database
2023-07-30 09:31:21 +02:00
Alexey Milovidov
41ffc09771
Upload build statistics to the CI database
2023-07-30 09:18:06 +02:00
Kruglov Pavel
93e10077ba
Fix attaching gdb in stress tests ( #51445 )
...
* Fix attaching gdb in stress tests
* Fix
* Update run.sh
* Try remove run_with_retry
* Return run_with_retry
* Don't set -e in run_with_retry if it was't set before
* Update tests/ci/utils.lib
* Fix bash
---------
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-07-26 12:53:19 +03:00
Azat Khuzhin
0b258dda4e
Reproducible builds for Rust
...
From now on cargo will not download anything from the internet during
builds. This step had been moved for docker image builds (via cargo
vendor).
And now cargo inside docker.io/clickhouse/binary-builder will not use
any crates from the internet, so we don't need to add --offline for
cargo commands in cmake (corrosion_import_crate()).
Also the docker build command had been adjusted to allow following
symlinks inside build context, by using tar, this is required for Rust
packages.
Note, that to make proper Cargo.lock that could be vendored I did the
following:
- per-project locks had been removed (since there is no automatic way to
sync the workspace Cargo.lock with per-project Cargo.lock, since cargo
update/generate-lockfile will use only per-project Cargo.toml files
apparently, -Z minimal-versions does not helps either)
- and to generate Cargo.lock with less changes I've pinned version in
the Cargo.toml strictly, i.e. not 'foo = "0.1"' but 'foo = "=0.1"'
then the Cargo.lock for workspace had been generated and afterwards
I've reverted this part.
Plus I have to update the dependencies afterwards, since otherwise there
are conflicts with dependencies for std library. Non trivial.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-22 22:46:22 +02:00
Alexey Milovidov
c3c8ea9c27
Do something
2023-07-22 17:30:55 +02:00
Mikhail f. Shiryaev
c6e9f621f1
Replace kssenii/nginx-test:1.1 by clickhouse/nginx-dav
2023-07-22 15:45:47 +02:00
Alexey Milovidov
3398355e46
Add something with unclear purpose
2023-07-22 02:04:30 +02:00
Mikhail f. Shiryaev
101214cb8f
Fix broken termination lambda by caching runners for at most 15 seconds
2023-07-21 18:32:32 +02:00
Mikhail f. Shiryaev
083be24a74
Improve logic of checking valid cached values in lambdas
2023-07-21 18:32:31 +02:00
Mikhail f. Shiryaev
a117997d5b
Show the runner type in the job logs
2023-07-21 18:32:31 +02:00
Mikhail f. Shiryaev
da37f32d4b
Attempt to delete the runner before shutting down
2023-07-21 18:32:30 +02:00
Mikhail f. Shiryaev
538d1f7c17
Kill the runner process with all subprocesses
2023-07-21 18:32:28 +02:00
Antonio Andelic
e181e602a7
Update ci_config.py
2023-07-21 12:43:32 +02:00
Alexey Milovidov
f458108c44
Fix style
2023-07-19 22:15:23 +02:00
Alexey Milovidov
29094a22cf
Fix Docker
2023-07-19 20:00:00 +02:00
Alexey Milovidov
f7fcf079a4
Merge branch 'master' of github.com:ClickHouse/ClickHouse into sqltest
2023-07-19 19:58:10 +02:00
Mikhail f. Shiryaev
9c4005b33f
Add logging about all found workflows for merge_pr.py
2023-07-19 15:12:58 +02:00
Alexey Milovidov
8e3bd222f0
Add SQLTest
2023-07-19 03:42:32 +02:00
Antonio Andelic
3c2507ad7d
Merge branch 'master' into fix-packager
2023-07-18 09:18:03 +02:00
Alexey Milovidov
20b77e946a
There is no point in detecting flaky tests
2023-07-15 23:00:23 +02:00
Dmitry Novik
ee2392bf8e
Merge remote-tracking branch 'origin/master' into analyzer-integration-tests
2023-07-11 08:55:31 +00:00
Alexey Milovidov
6cfeef00d7
Merge pull request #31398 from ClickHouse/riscv-in-ci
...
Add Linux RISC-V 64 build to CI
2023-07-06 22:49:16 +03:00
Antonio Andelic
f825c85c72
Merge branch 'master' into fix-packager
2023-07-06 08:36:43 +02:00
Alexey Milovidov
5a3aadacde
Fix error
2023-07-05 23:40:37 +02:00
Antonio Andelic
3dc0afd52f
Correctly grep archives
2023-07-05 11:19:15 +00:00
Alexey Milovidov
3021180e01
Update
2023-07-04 21:33:12 +02:00
Alexey Milovidov
1eafba60d2
Merge branch 'master' into riscv-in-ci
2023-07-04 21:28:05 +02:00
Antonio Andelic
5b31c714a0
Merge branch 'master' into fix-packager
2023-07-04 15:48:31 +02:00
Alexey Milovidov
aa2b8aa893
Merge pull request #51769 from ClickHouse/mypy-1.4.0
...
Version mypy=1.4.1 falsly reports unused ignore comment
2023-07-04 16:45:57 +03:00
Yatsishin Ilya
5230503651
remove unused type: ignore
2023-07-04 12:59:25 +00:00
Antonio Andelic
6d3dbae8aa
Merge remote-tracking branch 'origin/docs-packaging' into fix-packager
2023-07-04 11:21:53 +00:00
Alexey Milovidov
463c2ba5ce
Revert "Add documentation for building in docker"
2023-07-04 14:07:10 +03:00
Mikhail f. Shiryaev
c715ee5cef
Replace --build-type=debug by --debug-build
2023-07-03 19:58:47 +02:00
Mikhail f. Shiryaev
469da1831a
Replace --build-type=debug by --debug-build
2023-07-03 17:42:15 +02:00
Antonio Andelic
c06afc53b4
Make scripts backwards compatible
2023-07-02 09:57:06 +00:00
Antonio Andelic
00aeb407e5
Wait with retries
2023-06-30 14:52:21 +00:00
Alexey Milovidov
1e6f6b522c
Merge pull request #51180 from ClickHouse/update-tests-docker
...
Update tests' docker containers
2023-06-30 11:24:59 +03:00
Alexey Milovidov
b6a37fbf18
Merge branch 'master' into many-fixes-2
2023-06-29 22:36:33 +03:00
Mikhail f. Shiryaev
953f1c7885
Upload fast test binaries to builds bucket
2023-06-28 22:19:33 +02:00
Mikhail f. Shiryaev
eeb8cdbc19
Add way to define additional urls in test reports
2023-06-28 22:19:00 +02:00
vdimir
e2241b8c7c
Merge branch 'grace_hash_join_debug_2306' into many-fixes-2
2023-06-28 09:35:20 +00:00
robot-clickhouse
9d8b996f68
Automatic style fix
2023-06-27 04:30:56 +00:00
Alexey Milovidov
b5635887c3
Merge remote-tracking branch 'origin/refactor-subqueries-for-in' into many-fixes
2023-06-27 05:39:44 +02:00
Alexey Milovidov
e0ac127bdd
Merge branch 'two-tests-are-longer-with-analyzer' into many-fixes
2023-06-27 05:23:23 +02:00
Alexey Milovidov
d37b1c17f5
Merge branch 'fix-fasttest' into many-fixes
2023-06-27 05:21:43 +02:00
lgbo-ustc
179a7ce202
debug
2023-06-26 20:43:19 +08:00
Mikhail f. Shiryaev
065b87aa30
Improve logging a little bit, avoid double labeling
2023-06-26 13:25:49 +02:00
Mikhail f. Shiryaev
c64f929b9c
Fix broken labeling for manual approve
2023-06-26 13:25:48 +02:00
Alexey Milovidov
b8e6bd3299
Merge branch 'master' into refactor-subqueries-for-in
2023-06-26 06:05:12 +03:00
Alexey Milovidov
4ee74ec213
Two tests are twice longer in average with Analyzer and sometimes failing
2023-06-26 02:19:52 +02:00
Alexey Milovidov
4fd1fc4507
Fix typo
2023-06-25 06:14:31 +02:00
Alexey Milovidov
511b2cdc21
Increase timeout of fast test
2023-06-25 06:10:57 +02:00
Ilya Yatsishin
9a75faad77
Merge pull request #51340 from ClickHouse/qoega-patch-4
2023-06-24 14:22:32 +02:00
Ilya Yatsishin
7e3eaadaac
Make SQLancer check not "always green"
2023-06-23 18:55:04 +02:00
Alexey Milovidov
b6e7f4cf6c
Require more checks
2023-06-22 23:24:27 +02:00
Nikolai Kochetov
a940031878
Merge branch 'master' into refactor-subqueries-for-in
2023-06-22 12:18:48 +02:00
Mikhail f. Shiryaev
02776b8a15
Merge pull request #51163 from ClickHouse/fasttest-ignore-chown-fail
...
Ignore errors for `chown` in fasttests
2023-06-22 09:51:57 +02:00
Mikhail f. Shiryaev
1591633d72
Merge pull request #49283 from ClickHouse/runners-survival
...
Attempt to increase the general runners' survival rate
2023-06-22 00:16:11 +02:00
Mikhail f. Shiryaev
118c3af4d6
Ignore errors for chown in fasttests
2023-06-21 12:59:21 +02:00
Robert Schulze
bc7df2baca
Merge branch 'master' into non-experimental-qpl-deflate
2023-06-20 20:06:01 +02:00
Mikhail f. Shiryaev
23d843d379
Experiment with decreasing scale_up for style-checkers
2023-06-20 15:17:33 +02:00
Mikhail f. Shiryaev
1a8571c465
Check and proceed spot termination on runner setup
2023-06-19 15:40:32 +02:00
Mikhail f. Shiryaev
4d5160a3ba
Improve determination of job received
2023-06-19 15:40:32 +02:00
Mikhail f. Shiryaev
d782b05845
Continue LCH for terminated instances, add logging
2023-06-19 15:40:31 +02:00
Mikhail f. Shiryaev
d8e3d5c803
Kill the instance proactively on spot termination
2023-06-19 15:40:30 +02:00
Mikhail f. Shiryaev
d672bd3382
Stop the runner if there are no running jobs for long
2023-06-19 15:40:30 +02:00
Mikhail f. Shiryaev
915f431b95
Tune the shutting down on rebalance signal
2023-06-19 15:40:28 +02:00
Mikhail f. Shiryaev
026ab3d4ce
Calculate current capacity according to HealthStatus
2023-06-19 15:40:27 +02:00
Mikhail f. Shiryaev
8feb5146fc
Do not "update" the token and the instances infinitely
2023-06-19 15:40:27 +02:00
Mikhail f. Shiryaev
a5e31e98de
Decouple cleaning part from metrics lambda to a new one
2023-06-19 15:40:26 +02:00
Mikhail f. Shiryaev
1688ba5cf5
Use ephemeral runners for GH actions
2023-06-19 15:40:25 +02:00
Mikhail f. Shiryaev
47ea742076
Do not kill runner on the fly, delay 3 seconds
2023-06-19 15:40:25 +02:00
Mikhail f. Shiryaev
6cecdb8fca
Shutdown runner process and do not restart it on termination
2023-06-19 15:40:24 +02:00
Mikhail f. Shiryaev
197d0d1314
Process lifecycle hook in post-running action hook
2023-06-19 15:40:24 +02:00
Mikhail f. Shiryaev
d45092d63b
Process the rebalance recomendation event on post-run
2023-06-19 15:40:23 +02:00
Mikhail f. Shiryaev
ee5ca7337e
Add reset to Stopwatch, improve codebrowser report
2023-06-16 12:51:31 +02:00
Dmitry Novik
49f88f5873
Fix ENV variable name
2023-06-15 14:15:01 +00:00
Mikhail f. Shiryaev
eb2a5c31a3
Do not mock git_helper.Git, suppress git describe error for ignore_no_tags
2023-06-15 15:35:03 +02:00
Mikhail f. Shiryaev
2ac95ccfce
Adjust version_helper test cases to proper tags
2023-06-15 14:48:10 +02:00
Mikhail f. Shiryaev
07203a4542
Fix a versions' tweak for tagged commits, improve version_helper
2023-06-15 14:48:09 +02:00
robot-clickhouse
1230519bec
Automatic style fix
2023-06-14 13:38:44 +00:00
Dmitry Novik
fe8172fbd9
Review fixes
2023-06-14 13:17:04 +00:00
Dmitry Novik
afcc3aca36
Update ci_config.py
2023-06-14 13:14:59 +00:00
Dmitry Novik
1207085dec
Merge branch 'master' into analyzer-integration-tests
2023-06-13 17:09:29 +02:00
Nikita Mikhaylov
52a460df67
Tests with parallel replicas are no more "always green" ( #50896 )
2023-06-13 16:43:35 +02:00
Alexander Tokmakov
5368fa72ca
Merge pull request #50487 from Avogar/add-gdb-to-stateless-tests
...
Attach gdb in stateless tests
2023-06-13 17:04:17 +03:00
Dmitry Novik
9e8ca5f5ae
Add integration test check with enabled analyzer
2023-06-13 13:09:39 +00:00
Robert Schulze
8222861f2e
Merge remote-tracking branch 'rschu1ze/master' into non-experimental-qpl-deflate
2023-06-11 14:39:30 +00:00
Nikolai Kochetov
6ce8329bda
Merge branch 'master' into refactor-subqueries-for-in
2023-06-09 20:04:27 +02:00
Nikolai Kochetov
a878312fdf
Merge pull request #50693 from ClickHouse/vdimir/disable_grace_hash_stress
...
Disable grace_hash join in stress tests
2023-06-09 17:57:34 +02:00
Robert Schulze
1aa158909e
enable_qpl_deflate_codec --> enable_deflate_qpl_codec
2023-06-09 12:43:33 +00:00
jinjunzh
f1192d59af
refine patch according to comments
2023-06-09 12:43:15 +00:00
jinjunzh
31173ab55b
add sections of deflate_qpl for stress test and performance test
2023-06-09 12:43:08 +00:00
Mikhail f. Shiryaev
2aaaec2abe
Catch issues with dockerd during the build
2023-06-08 14:01:41 +02:00
vdimir
2297995c1a
Disable grace_hash join in stress tests
...
Until https://github.com/ClickHouse/ClickHouse/issues/50220 is fixed
2023-06-08 07:15:11 +00:00
Antonio Andelic
26fb80b540
Merge pull request #50615 from ClickHouse/fix-jepsen-check
...
Fix Jepsen runs in PRs
2023-06-07 08:43:51 +02:00
Sema Checherinda
990652119e
Merge pull request #50361 from nickitat/fail_perf_on_too_many_slow
...
Fail perf tests when too many queries slowed down
2023-06-06 11:33:04 +02:00
Antonio Andelic
0bc31a7288
Fix jepsen runs in PRs
2023-06-06 07:17:30 +00:00
robot-clickhouse-ci-1
4cf5a13e5b
Merge pull request #50160 from ClickHouse/prio-runners
...
Refactor lambdas, prepare to prio runners
2023-06-06 07:29:28 +02:00
avogar
e8c6c7967b
Move attaching gdb to separate lib
2023-06-05 18:21:40 +00:00
Nikita Taranov
e548dce123
fix
2023-06-03 00:08:47 +02:00
Nikita Taranov
4506299d73
impl
2023-06-02 23:14:09 +02:00
pufit
0d98a46326
Fix KeyError in cherry-pick
2023-06-02 13:02:18 -04:00
Mikhail f. Shiryaev
9bd0a53e7c
Get only online instances in get_lost_ec2_instances
2023-06-02 12:27:29 +02:00
Mikhail f. Shiryaev
3c13eaa159
Simplify get_dead_runners_in_ec2 a little bit, update runners
2023-06-02 12:27:28 +02:00
Mikhail f. Shiryaev
b775b5cfd6
Move all CI runners metrics into one namespace
2023-06-02 12:27:27 +02:00
Mikhail f. Shiryaev
e657e2ba10
Additional logging in autoscale_runners_lambda
2023-06-02 12:27:26 +02:00
Mikhail f. Shiryaev
b7c5fdab77
Move lambda package building to public.ecr.aws/lambda/python for compatibility
2023-06-02 12:27:26 +02:00
Mikhail f. Shiryaev
0ddd53088d
Add a new runner type for ci metrics and autoscaling
2023-06-02 12:27:24 +02:00
Mikhail f. Shiryaev
e8b03d7498
Move insert part for ClickHouseHelper to shared
2023-06-01 21:03:57 +02:00
Mikhail f. Shiryaev
2dca0eac1b
Delete __init__.py in lambda directories to break subpackage
2023-06-01 21:03:56 +02:00
Mikhail f. Shiryaev
acb9531ebf
Unify and put GH access token to the lambda_shared
2023-06-01 21:03:56 +02:00
Mikhail f. Shiryaev
0fa6a84161
Move the stuff related to runners to lambda_shared
2023-06-01 21:03:55 +02:00
Mikhail f. Shiryaev
7f08f218d9
Create lambda_shared package for lambdas
2023-06-01 21:03:53 +02:00
Mikhail f. Shiryaev
484c91c47e
Add DRY_RUN and configurable PY_VERSION to lambda deployment
2023-06-01 21:03:53 +02:00
Mikhail f. Shiryaev
27941b4d26
Decrease the time window for autoscale_runners_lambda
2023-06-01 21:03:52 +02:00
Mikhail f. Shiryaev
db02938411
Do not count unfinished tasks with conclusion=None
2023-06-01 21:03:51 +02:00
Mikhail f. Shiryaev
855afb56f9
Get instances for the region to not kill a fresh one
2023-06-01 21:03:50 +02:00
Mikhail f. Shiryaev
bf9b563e0b
Improve caching mechanism for token, add cached instances
2023-06-01 21:03:50 +02:00
Mikhail f. Shiryaev
7bf9089dcd
Increase access_token cached time
2023-06-01 21:03:49 +02:00
Mikhail f. Shiryaev
985cd8fc8a
Improve events logging
2023-06-01 21:03:48 +02:00
Nikita Taranov
e5c21e588a
Update app.py ( #50407 )
2023-06-01 15:19:47 +02:00
Mikhail f. Shiryaev
9089360688
Merge pull request #50415 from ClickHouse/build-report-pending
...
Mark the builds without results as pending
2023-06-01 14:53:09 +02:00
Mikhail f. Shiryaev
de7179876e
Merge pull request #47151 from ClickHouse/increase-vm-max_map_count
...
Update ubuntu_ami_for_ci.sh
2023-06-01 13:54:21 +02:00
Mikhail f. Shiryaev
6a5ae6558a
Add comment for usage of prepare-ci-ami.sh
2023-06-01 12:58:03 +02:00
Mikhail f. Shiryaev
bcbce15cde
Mark the builds without results as pending
2023-06-01 08:51:44 +02:00
Mikhail f. Shiryaev
653da5f002
Reduce the unzip verbosity
2023-05-31 18:23:21 +02:00
Mikhail f. Shiryaev
a96a845e23
Add comment to prepare-ci-ami.sh, add a success at the end
2023-05-31 17:12:49 +02:00
pufit
08d3887832
Add re-creation for cherry-pick PRs ( #50373 )
...
* Add recreation for cherry-pick PRs.
Small PR comment fix.
* Automatic style fix
---------
Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2023-05-31 13:04:29 +02:00
Mikhail f. Shiryaev
db3a050911
Seems like buildx needs explicit install since some time
2023-05-31 00:22:12 +02:00
Mikhail f. Shiryaev
56dc35d563
Merge branch 'master' into increase-vm-max_map_count
2023-05-30 19:24:18 +02:00
Mikhail f. Shiryaev
bcd57078ce
Update the runner version
2023-05-30 16:36:54 +02:00
Nikolai Kochetov
b5b261b22c
Merge branch 'master' into refactor-subqueries-for-in
2023-05-25 21:22:06 +02:00
pufit
4ce722854b
Fix URL in backport comment
2023-05-25 11:51:47 -04:00
Mikhail f. Shiryaev
a9d5b68946
Merge pull request #50197 from ClickHouse/fix-codebrowser
...
Fix codebrowser by using clang-15 image
2023-05-24 23:39:13 +02:00
Mikhail f. Shiryaev
e117347ca0
Attempt to fix codebrowser with using clang-15
2023-05-24 23:15:38 +02:00
Alexander Tokmakov
2c0c1ba4af
add comments to build reports ( #50200 )
2023-05-24 23:29:36 +03:00
pufit
8875b98e2a
Added default value for --from-repo arg
2023-05-24 13:47:50 -04:00
pufit
8df7a69147
Automatic backports of important fixes to cloud-release
...
* Automatic backports to cloud-release
---------
Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2023-05-24 18:59:18 +02:00
Nikolai Kochetov
ff6400f91a
Merge branch 'master' into refactor-subqueries-for-in
2023-05-22 13:07:51 +02:00
Timur Solodovnikov
c7ab59302f
Set allow_experimental_query_cache setting as obsolete ( #49934 )
...
* set allow_experimental_query_cache as obsolete
* add tsolodov to trusted contributors
* CI linter
---------
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2023-05-17 20:03:42 +02:00
Mikhail f. Shiryaev
4b7aa30017
The best effor to get the current job ID and URL
...
This partially addresses https://github.com/actions/runner/issues/2577
2023-05-12 19:22:52 +02:00
Mikhail f. Shiryaev
c375f948d0
Fix typing in S3Helper.fast_parallel_upload_dir
2023-05-12 19:22:52 +02:00
Mikhail f. Shiryaev
338435a52d
Additional check for FATAL in logs, do not exit with code 1 on errors
2023-05-12 19:22:51 +02:00
Mikhail f. Shiryaev
0f70ad56a9
Do not upload failed site to the S3
2023-05-12 19:22:50 +02:00
Mikhail f. Shiryaev
eb122487ad
Add logs to the report, do not chown unnecessary
2023-05-12 19:22:48 +02:00
Mikhail f. Shiryaev
6a56662f60
Improve codebrowser check
...
- Add sccache
- Report a proper status in report and exit code
- Launch it as a current user
- Fix report link
2023-05-12 19:22:48 +02:00
Mikhail f. Shiryaev
fba7120d3d
Fix s3_helper logging and pool setup
2023-05-12 19:22:44 +02:00
Robert Schulze
b9c185af44
Merge pull request #49678 from azat/build/llvm-16
...
Switch to LLVM/clang 16 (16.0.3)
2023-05-12 13:47:36 +02:00
Mikhail f. Shiryaev
8a664e2cac
Upgrade all lambdas runtime to 3.10, fix requirements
...
The recent update of urllib3 completely broken the world
- https://github.com/urllib3/urllib3/issues/2168
- https://github.com/boto/botocore/issues/2926
- https://github.com/psf/requests/issues/6443
2023-05-11 16:09:59 +02:00
Mikhail f. Shiryaev
d890114c5e
Print debugging information in workflow_jobs_lambda
2023-05-11 14:21:07 +02:00
Mikhail f. Shiryaev
d605f82798
Replace old release with new packages in suspicious patterns
2023-05-10 12:36:04 +02:00
Mikhail f. Shiryaev
f6372dd3fc
Do not launch PRs w/o "can be tested"
2023-05-10 12:14:44 +02:00
Azat Khuzhin
c37fe64040
Merge remote-tracking branch 'u/master' into build/llvm-16
2023-05-08 22:33:52 +02:00
Nikolai Kochetov
fc02e9efc9
update fasttest a bit
2023-05-08 17:23:46 +00:00
Alexey Milovidov
54163b87ec
Merge pull request #47977 from ClickHouse/rs/non-experimental-qc
...
Mark query cache as non-experimental
2023-05-06 19:49:23 +03:00
Robert Schulze
0598bfd79e
Mark query cache as non-experimental
2023-05-06 13:58:40 +00:00
Dmitry Novik
a3b3b78eb0
EXPECTED_TO_FAIL -> NOT_FAILED
2023-05-05 17:53:15 +00:00
Dmitry Novik
02520e9358
Make EXPRECTED_TO_FAIL red
2023-05-05 17:37:52 +00:00
Mikhail f. Shiryaev
90fe9dd1f2
Skip mergeable check only on a proper description
2023-05-03 22:38:34 +02:00
Mikhail f. Shiryaev
a67950d138
Check the PRs body directly in lambda, without rerun
2023-05-03 22:38:33 +02:00
Mikhail f. Shiryaev
242a210358
Create "CI running" report always
2023-05-02 14:13:23 +02:00
Mikhail f. Shiryaev
08d203e158
Sanitize "Flaky tests", remove trailing dots
2023-05-02 12:42:26 +02:00
Mikhail f. Shiryaev
b423e04ab0
Fix the global ROBOT_TOKEN, do not retry unnecessary
2023-05-02 12:37:05 +02:00
Mikhail f. Shiryaev
ca19f20aff
Do not fail the run on error updating status comment
2023-05-02 12:34:40 +02:00
Alexey Milovidov
dd7282ea5c
Update ci_config.py
2023-05-01 16:05:14 +03:00
Mikhail f. Shiryaev
b385b51f07
Merge pull request #49314 from ClickHouse/fallback-auth-gh-api
...
Fallback auth gh api
2023-04-29 09:36:49 +02:00
Mikhail f. Shiryaev
d336bee056
Fix the Logs header for case when only log_urls is set
2023-04-28 23:52:35 +02:00
Mikhail f. Shiryaev
886ba0b01d
Replace markdown with pure HTML for check descriptions
2023-04-28 23:52:34 +02:00
Mikhail f. Shiryaev
20c8f0f1b4
Use only one comment for all statuses in the PR
2023-04-28 23:52:34 +02:00
Mikhail f. Shiryaev
61c6c61638
Rework the status comment to be a digest with the full report available
...
by link
2023-04-28 23:52:33 +02:00
Mikhail f. Shiryaev
e8cf417350
Use NotSet in post_commit_status for optional arguments
2023-04-28 23:52:33 +02:00
Mikhail f. Shiryaev
c66e50f283
Remove options from S3Helper, they are global
2023-04-28 23:52:32 +02:00
Mikhail f. Shiryaev
f411be8c37
Rename Run Check to CI running
2023-04-28 23:52:31 +02:00
Mikhail f. Shiryaev
df33b99907
Rework post_commit_status, add set_status_comment there
2023-04-28 23:52:31 +02:00
Mikhail f. Shiryaev
d58abd3c37
Add a function get_repo with global state
2023-04-28 23:52:30 +02:00
Mikhail f. Shiryaev
4405459925
Refactor RerunHelper to reduce API calls
2023-04-28 23:52:30 +02:00
Mikhail f. Shiryaev
19fd5f9c3c
Add descriptions for the status comment
2023-04-28 23:52:29 +02:00
Mikhail f. Shiryaev
eb11fb02fa
Clean up ast_fuzzer_check.py
2023-04-28 23:52:29 +02:00
Mikhail f. Shiryaev
ccd4fd7e64
Use commit_status_helper.post_commit_status everywhere
2023-04-28 23:52:28 +02:00
Mikhail f. Shiryaev
144ebd3d36
Implement main() in run_check.py
2023-04-28 23:52:27 +02:00
Mikhail f. Shiryaev
e670c51680
Unify commit.create_status and post_commit_status
2023-04-28 23:52:26 +02:00
Mikhail f. Shiryaev
01e70c64c2
Add a fallback to authenticated requests to GH API
2023-04-28 18:46:33 +02:00
Mikhail f. Shiryaev
8c60b60916
Receive the best robot token only once
2023-04-28 16:01:53 +02:00
Mikhail f. Shiryaev
9a7f09bae4
Avoid splitting check_name into subdirectories
2023-04-26 01:11:05 +02:00
Mikhail f. Shiryaev
a6664e6b08
Add typing, capitalize only the first letter w/o lowering the rest
2023-04-26 00:55:05 +02:00
Mikhail f. Shiryaev
ed8ca018bd
Add a note regarding private/public repo to logs
2023-04-25 19:11:20 +02:00
alesapin
084f76ab3e
Merge pull request #49133 from ClickHouse/unanonymized-workflow-jobs-logs
...
Improve some lambdas
2023-04-25 12:58:18 +02:00
Mikhail f. Shiryaev
2ab313e6b4
Update the style_checker upscale speed
2023-04-25 12:42:06 +02:00
Mikhail f. Shiryaev
6032bacd0f
Get unanonymized logs in workflow_jobs_lambda
2023-04-25 12:37:26 +02:00
Dmitry Novik
0d3e896f57
Merge pull request #48719 from ClickHouse/analyzer-ci
...
Add CI run with new analyzer enabled
2023-04-24 17:36:18 +02:00
Mikhail f. Shiryaev
222176639d
Update pr_info.labels in commit_helper lebel helpers
2023-04-24 11:03:25 +02:00
Mikhail f. Shiryaev
caee710fcc
Enforce documentation change for a new-feature PR
2023-04-24 10:41:38 +02:00
Dmitry Novik
1fdee1a2ab
Merge branch 'master' into analyzer-ci
2023-04-21 15:43:16 +02:00
Alexey Milovidov
2dbe4f80f2
Do not allow incomplete changelog entries
2023-04-21 12:59:47 +02:00
Alexey Milovidov
95e69b6f85
Do not allow incomplete changelog entries
2023-04-21 12:59:17 +02:00
Mikhail f. Shiryaev
c28e8438e3
Fail Fast tests on next run if previous running has failed
2023-04-20 14:51:53 +02:00
Dmitry Novik
b2ed99f6b3
Merge branch 'master' into analyzer-ci
2023-04-18 13:07:45 +02:00
