thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-27 10:02:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
137,581 Commits 9,196 Branches 1,782 Tags 2.1 GiB
02d5c4625f
Commit Graph

2359 Commits

Author SHA1 Message Date
Mikhail f. Shiryaev
b6a71ae6f4
Rewrite fast tests to reusable workflow 2023-11-13 12:49:33 +01:00
Mikhail f. Shiryaev
6f8baf3def
Rewrite style checks to reusable workflow 2023-11-13 12:49:32 +01:00
Mikhail f. Shiryaev
38b251946e
Add another check to CiConfig.validate, and test for it 2023-11-13 12:49:31 +01:00
Alexey Milovidov
9436209950 Fix error 2023-11-13 05:06:37 +01:00
Alexey Milovidov
7fc3cebd91 Fix error 2023-11-13 04:00:13 +01:00
Alexey Milovidov
c9f5ef0b1a Fix error 2023-11-13 03:14:29 +01:00
Alexey Milovidov
17669111fc Python 2023-11-12 08:07:14 +01:00
robot-clickhouse
c74aea08b2 Automatic style fix 2023-11-12 04:10:47 +00:00
Alexey Milovidov
fb8f9f5fed Fix error 2023-11-12 04:52:49 +01:00
Alexey Milovidov
6c30aa121c Collect information about binary sizes to the CI database 2023-11-12 04:01:59 +01:00
Alexey Milovidov
38ca18d8e7
Merge pull request #56617 from ClickHouse/publish-stripped-binary 
Publish stripped binary
 2023-11-11 22:18:26 +01:00
Alexey Milovidov
9824631044 Apply LowCardinality in more places 2023-11-11 07:46:35 +01:00
Alexey Milovidov
df24ef42b1 Publish stripped binary 2023-11-11 07:27:10 +01:00
Mikhail f. Shiryaev
a807a80d1e
Merge pull request #56385 from ClickHouse/modules-actions 
Rewrite jobs to use callable workflow
 2023-11-09 15:19:58 +01:00
Robert Schulze
949863872a
Merge pull request #56059 from rschu1ze/bump-grpc 
Bump gRPC to v1.47.5
 2023-11-09 11:35:38 +01:00
Robert Schulze
b9fafb5561
Try to fix sparse checkout 2023-11-08 17:18:05 +00:00
Mikhail f. Shiryaev
6dc0534143
Move sparse checkout logic to ci_config 2023-11-08 17:16:18 +01:00
Mikhail f. Shiryaev
af2795ad75
Work around issues with GH callable actions 2023-11-08 17:16:17 +01:00
Mikhail f. Shiryaev
1e981120c1
Merge pull request #56422 from ClickHouse/speed-up-autoscaling 
Make autoscaling more responsive
 2023-11-08 12:47:22 +01:00
Alexander Tokmakov
8fb594dd5e
Merge pull request #56388 from ClickHouse/tavplubix-patch-10 
Update stress.py
 2023-11-07 18:58:25 +01:00
Mikhail f. Shiryaev
4df3a7cc8b
Make autoscaling more responsive 2023-11-07 17:49:22 +01:00
Mikhail f. Shiryaev
b981a94bc7
Merge pull request #56305 from ClickHouse/digests 
Implement digest helpers for different objects
 2023-11-07 17:46:29 +01:00
Alexander Tokmakov
0fbb32c8ee Merge branch 'master' into tavplubix-patch-10 2023-11-06 20:59:16 +01:00
vdimir
cc25f66b03
Merge pull request #56243 from ClickHouse/vdimir/fix_check_url_in_commit_status 
Fix link to failed check report in status commit
 2023-11-06 20:27:18 +01:00
Alexander Tokmakov
101975705e
Update stress.py 2023-11-06 19:59:43 +01:00
robot-clickhouse
43f2b59625 Automatic style fix 2023-11-06 18:31:15 +00:00
Alexander Tokmakov
93cb51bad5
Update stress.py 2023-11-06 19:13:26 +01:00
Mikhail f. Shiryaev
53033d2347
Add a consistent digest and tests 2023-11-06 16:43:26 +01:00
Mikhail f. Shiryaev
4fe3d10604
Unify all workflows for python unit tests, follow naming best practices 2023-11-06 11:14:57 +01:00
Mikhail f. Shiryaev
e352e7bfba
Change digest API to update the single hash object 2023-11-03 17:42:09 +01:00
Mikhail f. Shiryaev
f7c5602da4
Add digest_paths 2023-11-03 17:42:09 +01:00
Mikhail f. Shiryaev
3e8ad14423
Implement digest helpers for different objects 2023-11-03 17:42:08 +01:00
Mikhail f. Shiryaev
77f4ec4422
Add evidence of failed integrations infrastructure 2023-11-02 11:36:18 +01:00
vdimir
9021667f82
Fix link to failed check report in status commit 2023-11-02 08:44:03 +00:00
Max K
a531ffc35d
Update fast_test_check.py 2023-10-31 12:47:21 +01:00
robot-clickhouse
a20f43c492 Automatic style fix 2023-10-31 11:43:32 +00:00
Max Kainov
9135d6c3eb set timeout via argparse 2023-10-31 11:32:08 +00:00
Max Kainov
9bb7de07e0 fasttest timeout set by env 2023-10-31 11:01:49 +00:00
Raúl Marín
71dfdf5bfe
Merge pull request #56009 from Algunenano/stress_cont 
Stress tests: Try to wait until server is responsive after gdb detach
 2023-10-26 11:37:49 +02:00
vdimir
12890eb70c
Merge pull request #55806 from canhld94/rocksdb_trivial_count 
Support trivial count for rocksdb and storage join
 2023-10-26 11:22:38 +02:00
Raúl Marín
ef2740052e Attempt to wait until server is responsive after gdb detach 2023-10-25 10:15:35 +00:00
vdimir
72f2288ee4
Add optimize_trivial_approximate_count_query to stress tests 2023-10-24 12:44:18 +02:00
Alexander Tokmakov
6167bf4fca
Update stress.py 2023-10-23 17:27:38 +02:00
robot-clickhouse
f377f4f594 Automatic style fix 2023-10-20 19:06:01 +00:00
Alexander Tokmakov
8a0eae21f5
Update stress.py 2023-10-20 20:45:16 +02:00
Mikhail f. Shiryaev
6a37546a6f
Merge pull request #55874 from ClickHouse/universal-diff-urls 
One final leftover in diff_urls of PRInfo
 2023-10-20 17:49:14 +02:00
Mikhail f. Shiryaev
849e44138a
One final leftover in diff_urls of PRInfo 2023-10-20 17:19:46 +02:00
Mikhail f. Shiryaev
fb5bc09535
Fix caching objects in pygithub, and changelogs 2023-10-19 19:45:16 +02:00
Mikhail f. Shiryaev
d8b899d22b
Use a proper tag from default.checks for enriched images 2023-10-19 11:35:35 +02:00
Mikhail f. Shiryaev
d957d60a52
Use publicly available play.clickhouse.com to search built images 2023-10-19 11:35:10 +02:00
Antonio Andelic
71adb434e3 Remove f-string 2023-10-18 09:19:09 +00:00
Antonio Andelic
be7be17352
add comment 2023-10-18 10:22:18 +02:00
Antonio Andelic
70d366a8eb Control feature flag randomization with env 2023-10-18 07:59:49 +00:00
Mikhail f. Shiryaev
b382705c2d
Use diff object again, since JSON API limits the files 2023-10-17 17:49:06 +02:00
Max Kainov
ad38c433a1 fix commit labels for diff 2023-10-17 08:48:25 +00:00
Max Kainov
fc9a5a725c Revert "Revert "Integration check script fix ups"" 
This reverts commit 67b9407530.
 2023-10-17 08:18:17 +00:00
alesapin
67b9407530
Revert "Integration check script fix ups" 2023-10-16 22:01:44 +02:00
Max Kainov
4d1edc2780 return back unidiff module 2023-10-16 15:00:13 +00:00
Max Kainov
683437c61c fix docs and script 2023-10-16 10:35:14 +00:00
Max Kainov
60ad1c79bd fix docs 2023-10-16 10:35:14 +00:00
robot-clickhouse
7c2fee3280 Automatic style fix 2023-10-16 10:35:14 +00:00
Max Kainov
3f3fcce7e5 gh api request func update 2023-10-16 10:35:14 +00:00
Mikhail f. Shiryaev
c5ebd6f072 Use requests.gte in get_gh_api 2023-10-16 10:35:14 +00:00
Mikhail f. Shiryaev
346e8a0162 Remove recursion in favor of reset retry loop 2023-10-16 10:35:14 +00:00
Max Kainov
f1c316b79b ci script to use git hub api urls, readme for test 2023-10-16 10:35:13 +00:00
Han Fei
0167b76e98 fix structure does not match logs again 2023-10-14 16:01:32 +02:00
Han Fei
e3ceca06e0 cast extra column expression pull_request_number to Int32 2023-10-13 14:52:25 +02:00
Mikhail f. Shiryaev
e60983f5ae
Do not fail if label-to-remove does not exists in PR 2023-10-13 13:32:56 +02:00
Alexey Milovidov
8f54123901
Update pr.py 2023-10-11 20:38:37 +03:00
Alexey Milovidov
f4ccf9f94f
Update pr.py 2023-10-11 20:38:19 +03:00
Alexey Milovidov
c04a33a70a
Update pr.py 2023-10-11 20:38:01 +03:00
Mike Kot
125250b4fd add k-morozov to trusted 2023-10-11 17:25:54 +00:00
Mikhail f. Shiryaev
59a1947653
Fix broken style check get_images 2023-10-04 14:29:01 +02:00
Mikhail f. Shiryaev
d94228b718
Fix style-check errors 2023-10-04 14:29:00 +02:00
Alexey Milovidov
be9a3cea42
Merge pull request #55122 from ClickHouse/vdimir/status_comment_link 
Add links to check reports in status comment
 2023-09-30 08:55:54 +03:00
Mikhail f. Shiryaev
fe155c61d4
Merge pull request #54532 from ClickHouse/Fix_ci_skip_build_and_skip_tests 
Fix CI skip build and skip tests checks
 2023-09-29 14:01:35 +02:00
vdimir
7c471be846
Fix link in table in status comment 2023-09-29 12:00:07 +02:00
vdimir
37bd5dd7be
Add links to check reports in status comment 2023-09-29 08:46:23 +00:00
vdimir
3a9abde35d
Merge pull request #54514 from ClickHouse/vdimir/allow_experimental_partial_result 
Add setting allow_experimental_partial_result
 2023-09-29 10:32:57 +02:00
vdimir
fff77876f9
Add partial_result_update_duration_ms to stress tests 2023-09-28 09:41:00 +00:00
Mikhail f. Shiryaev
183af376e1
Add a digest result in the end of the report 2023-09-28 11:22:38 +02:00
Mikhail f. Shiryaev
f19c172c5e
Move to parsing json reports of google test 2023-09-28 09:39:56 +02:00
Mikhail f. Shiryaev
1dddd8f08f
Fix the failing sqllogic jobs 2023-09-28 01:24:33 +02:00
Mikhail f. Shiryaev
eb00284896
Fix DownloadException 2023-09-28 01:24:32 +02:00
Mikhail f. Shiryaev
c5b1aa4aa5
Clean even more os.path 2023-09-28 01:24:31 +02:00
Mikhail f. Shiryaev
ff58e152d8
Remove os.path from docker related scripts 2023-09-28 01:20:36 +02:00
Mikhail f. Shiryaev
2d1dba372e
Get rid of the most of os.path stuff 2023-09-28 01:20:05 +02:00
Smita Kulkarni
c3f3824562 Merge branch 'master' into Fix_ci_skip_build_and_skip_tests 2023-09-24 13:31:24 +02:00
Smita Kulkarni
91149bc5a9 Fixed sha check 2023-09-24 13:30:38 +02:00
Robert Schulze
9a91f97ac4
Merge pull request #53831 from rschu1ze/clang-17 
Switch CI to Clang 17
 2023-09-22 12:28:35 +02:00
Robert Schulze
5209bd2d51
Merge remote-tracking branch 'rschu1ze/master' into clang-17 2023-09-21 14:45:55 +00:00
Mikhail f. Shiryaev
78b9d00966
Decrease timeout for fast tests with a commit 2023-09-21 16:25:17 +02:00
Mikhail f. Shiryaev
6acdd65c8e
Launch fast tests as the current user 2023-09-20 22:32:19 +02:00
Mikhail f. Shiryaev
dd7096bc59
Speed up fast tests a little bit 2023-09-20 19:09:06 +02:00
vdimir
65baf129bf
Do not set PR status label 2023-09-20 09:21:58 +00:00
Robert Schulze
cbcff6ef08
Merge remote-tracking branch 'rschu1ze/master' into clang-17 2023-09-20 09:15:58 +00:00
Mikhail f. Shiryaev
4882b99715
Merge pull request #54310 from ClickHouse/ci-libfuzzer-integration 
CI: libFuzzer integration
 2023-09-20 10:01:39 +02:00
Yakov Olkhovskiy
b1b49f430a review suggestions 2023-09-19 15:32:58 +00:00
Smita Kulkarni
132bcbe3a4 Merge branch 'master' into Fix_ci_skip_build_and_skip_tests 2023-09-19 16:16:17 +02:00
Smita Kulkarni
d07c2dc271 Added datatype and return type to function 2023-09-18 22:09:59 +02:00
Robert Schulze
3a3a00f95e
Bump minimal required compiler to Clang 16 2023-09-18 17:44:04 +00:00
robot-clickhouse
009d22b3d7 Automatic style fix 2023-09-18 12:21:11 +00:00
Smita Kulkarni
0c26f41ac9 Fixed style 2023-09-18 14:07:31 +02:00
robot-clickhouse
0a042fc3f0 Automatic style fix 2023-09-18 09:50:17 +00:00
Smita Kulkarni
a445335d91 Fixed style check 2023-09-18 11:23:28 +02:00
robot-clickhouse
b7e0b8ca77 Automatic style fix 2023-09-18 09:01:25 +00:00
Smita Kulkarni
0b172ed173 Updated version check in integration test & updated to check test_type in functional tests 2023-09-18 10:47:33 +02:00
Yakov Olkhovskiy
dd6f12dd94 review suggestions 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
3a14bde95a cleanup, fix tee to escape non-decodable symbols 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
cd0c775355 review suggestions 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
d80ae88060 run docker 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
1ad0a77c9f unzip corpora 2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
44546458f0 add infrastructure files to the download filter 2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
0847889db6 libFuzzer infrastructure 2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
b7a17bf8dd add libFuzzer tests, initial integration 2023-09-17 16:36:49 +00:00
Mikhail f. Shiryaev
4c9f8d150b
Merge pull request #54504 from ClickHouse/s3-artifacts 
S3 artifacts
 2023-09-15 18:21:57 +02:00
robot-ch-test-poll
3af3114478
Merge pull request #54668 from Avogar/better-ci-libs 
Move all `tests/ci/*.lib files` to `stateless-tests` image
 2023-09-15 17:40:01 +02:00
Igor Nikonov
eb6fceccbb
Merge pull request #54278 from ClickHouse/ci-check-process-timeout 
CI: a try to handle tests timeouts
 2023-09-15 17:13:16 +02:00
Mikhail f. Shiryaev
964b9ede2d
Improve index.html for the non-CI runnings 2023-09-15 15:00:35 +02:00
Mikhail f. Shiryaev
5200a8dadc
Create directory for archives if not exists 2023-09-15 15:00:32 +02:00
Mikhail f. Shiryaev
414594a472
Decouple ArtifactsHelper commit status 2023-09-15 14:54:48 +02:00
Mikhail f. Shiryaev
40e04fee6c
Report only changed images in commit status 2023-09-15 14:54:47 +02:00
Mikhail f. Shiryaev
5ead298d53
Improve S3Helper url handling, ArtifactsHelper local artifacts 2023-09-15 14:54:47 +02:00
Mikhail f. Shiryaev
51e79e1ddf
Create commit status for Artifacts 2023-09-15 14:54:46 +02:00
Mikhail f. Shiryaev
3f350eb148
Create artifact_helper for lightweight workflow artifacts 2023-09-15 14:54:45 +02:00
Mikhail f. Shiryaev
eef15ff67a
Insignificant improvements to git_helper and compress_files 2023-09-15 14:54:44 +02:00
Mikhail f. Shiryaev
2f8f16a864
Fix git_helper import issue with git_runner.run() 2023-09-15 14:54:44 +02:00
Mikhail f. Shiryaev
fde8817fb7
Fix PRInfo and docker_images_check typing 2023-09-15 14:54:42 +02:00
avogar
d5889c8cc8 Move all tests/ci/*.lib files to stateless-tests image 2023-09-15 11:27:09 +00:00
János Benjamin Antal
13868e4d1d Fix review comments 2023-09-14 14:45:23 +00:00
János Benjamin Antal
f7ceb76dcb Fix pylint and mypy issues 2023-09-14 13:41:34 +00:00
János Benjamin Antal
699bf031c9 Remove accidentally committed code 2023-09-14 12:07:15 +00:00
János Benjamin Antal
51781a6a86 Add workflow 2023-09-14 12:05:50 +00:00
János Benjamin Antal
078c16760f Add --remote-protocol arg 2023-09-14 12:05:49 +00:00
robot-clickhouse
0fda5e4bf2 Automatic style fix 2023-09-14 11:44:34 +00:00
János Benjamin Antal
da802b2688 Do the release 2023-09-14 11:28:35 +00:00
János Benjamin Antal
b13a07863d Add gh_cache to gitignore to pass dirty check 2023-09-14 11:17:20 +00:00
János Benjamin Antal
6df371754d Fix typos in release.py 2023-09-14 10:54:17 +00:00
János Benjamin Antal
33eeb0737f Fix style errors 2023-09-14 10:23:26 +00:00
János Benjamin Antal
462f4111de Turn PoC into real script without calling release.py 2023-09-13 23:33:04 +00:00
robot-clickhouse
94b6d9ed05 Automatic style fix 2023-09-13 17:16:17 +00:00
János Benjamin Antal
84e311321d Add basic logic to find releasable commits 2023-09-13 17:05:31 +00:00
robot-clickhouse
3ed7f47af9 Automatic style fix 2023-09-13 16:56:14 +00:00
Smita Kulkarni
1ec52de797 Addressed review comments 2023-09-13 18:37:03 +02:00
robot-clickhouse
fe2240afbf Automatic style fix 2023-09-13 08:23:14 +00:00
Smita Kulkarni
176bd0e509 Fixed function call and added check for FORCE_TESTS_LABEL 2023-09-13 09:58:57 +02:00
Mikhail f. Shiryaev
397a682d1c
Merge pull request #54441 from ClickHouse/vdimir/ci-commit-statis-update 
Update automated commit status comment
 2023-09-12 21:18:13 +02:00
Igor Nikonov
031da054f3 Return initial timeout 2023-09-12 19:06:39 +00:00
robot-clickhouse
63f71b719d Automatic style fix 2023-09-12 18:31:34 +00:00
Igor Nikonov
4671901313 Update stress_check.py 2023-09-12 18:17:55 +00:00
Igor Nikonov
8a4654c39e Address review comment 2023-09-12 18:06:00 +00:00
vdimir
acb559ce8b
Update tests/ci/commit_status_helper.py 
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
 2023-09-12 17:34:52 +02:00
Igor Nikonov
7f90b7983c Merge remote-tracking branch 'origin/master' into ci-check-process-timeout 2023-09-12 13:41:35 +00:00
Igor Nikonov
8db991faa0 Fix style 2023-09-12 13:41:31 +00:00
vdimir
72d5a5d094
fix report.py 2023-09-12 11:54:35 +00:00
robot-clickhouse
5a7ecbc23e Automatic style fix 2023-09-12 10:18:40 +00:00
Smita Kulkarni
135c447f07 Updated check to fix style 2023-09-12 12:01:27 +02:00
robot-clickhouse
3b4120ba55 Automatic style fix 2023-09-12 08:51:21 +00:00
Smita Kulkarni
9accebe73d Updated can_skip_builds_and_use_version_from_master, can_skip_integration_tests, can_skip_functional_tests checks in ci 2023-09-12 10:30:59 +02:00
vdimir
790d61971c
sucessfull items in report can be expandable 2023-09-11 17:06:16 +00:00
vdimir
8bb0fbfd2c
fix 2023-09-11 17:03:28 +00:00
vdimir
4a80a0f1c0
upd 2023-09-11 16:13:52 +00:00
vdimir
960ca5ebde
Show PR status in label 2023-09-11 16:13:33 +00:00
vdimir
a1ee226969
Update PR status icons 2023-09-11 16:13:11 +00:00
vdimir
61fdb63aad
fix 2023-09-11 13:53:20 +00:00
vdimir
297306b4b9
status emoji in the beginning of title 2023-09-11 13:36:02 +00:00
Alexey Milovidov
c4c41cad23 Merge branch 'ci-instance-type' of github.com:ClickHouse/ClickHouse into ci-instance-type 2023-09-09 05:52:04 +02:00
Alexey Milovidov
154ac14ef6 Fix error 2023-09-09 05:51:43 +02:00
robot-clickhouse
923d7a0bc3 Automatic style fix 2023-09-09 00:27:39 +00:00
Alexey Milovidov
0728df37e6 Add instance_type column to CI Logs and the checks table 2023-09-09 01:44:14 +02:00
vdimir
6a51d9fd7d
do not merge this commit 2023-09-08 17:04:44 +00:00
vdimir
a46d1974ac
fix 2023-09-08 15:49:13 +00:00
vdimir
465d84aba7
Set raw_logs in create_ci_report 2023-09-08 15:39:07 +00:00
vdimir
b0b8255c6f
Set PR status into title 2023-09-08 15:36:32 +00:00
vdimir
5e0caa669e
Move sucessull checks in commit status under a spoiler 2023-09-08 09:56:53 +00:00
János Benjamin Antal
5862c4ec93
Use not the absolute latest docker image tag (#54369) 
* Add params for select queries in clickhouse_helper.py

* Find the latest image tags from master

* Get full git history

* Do not checkout submodules

* Automatic style fix

* Fix style errors

* Make logging pretty

* Revert accidentally committed changes

* Eliminate pformat

* Update all workflows

* Remove flag with default value

* Improve exception handling

* Utilizing the loop condition in while loop

* Make the logic robust over temporary errors

* Prettify logs

* Automatic style fix

* Add accidentally removed line

* Revert "Make the logic robust over temporary errors"

This reverts commit 91e6b5d7ba.

* Do not fail in case the tag cannot be queried from ClickHouse

* Support partial finding of tags

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
 2023-09-08 08:42:56 +02:00
robot-clickhouse
c680c951d3 Automatic style fix 2023-09-07 13:12:53 +00:00
Igor Nikonov
27455a5882 Test timeout to fail 2023-09-07 12:57:35 +00:00
Igor Nikonov
c354fcaff7 Timeout report for stress_check 2023-09-07 12:56:22 +00:00
Igor Nikonov
a0317e461a Better description 2023-09-07 12:41:36 +00:00
Igor Nikonov
7ab56a13b8 Polishing 2023-09-06 22:49:28 +00:00
Igor Nikonov
babbecc646 Fix 2023-09-06 15:00:32 +00:00
Igor Nikonov
e858f0b880 Fix description length 2023-09-06 13:05:56 +00:00
Igor Nikonov
32048f2a8d Merge remote-tracking branch 'origin/master' into ci-check-process-timeout 2023-09-06 12:48:43 +00:00
Igor Nikonov
f6f2e731a7 Fix state 2023-09-06 12:44:39 +00:00
robot-clickhouse
f08d445a0f Automatic style fix 2023-09-06 11:59:51 +00:00
Igor Nikonov
a22e219be9 Fix 2023-09-06 11:51:43 +00:00
Igor Nikonov
3ef6d0da39 Set status and description 2023-09-06 11:02:17 +00:00
Mikhail f. Shiryaev
7f34c8e17d
Decouple env_helper.get_job_id_url 2023-09-06 12:43:29 +02:00
Mikhail f. Shiryaev
1afc5b7e05
Use suffix from git tags as version descriptions 2023-09-06 12:43:28 +02:00
Mikhail f. Shiryaev
6fc73e0e1f
Use a single BuildResult class across builds and report checks 2023-09-06 12:43:27 +02:00
Mikhail f. Shiryaev
88664bef3f
Create report status constants 2023-09-06 12:43:25 +02:00
Mikhail f. Shiryaev
428b72e767
Combine rows for build templates with lists 2023-09-06 12:43:23 +02:00
Mikhail f. Shiryaev
e0f6242af8
Use the same style for all reports 2023-09-06 12:43:21 +02:00
Mikhail f. Shiryaev
e18d9d39e8
Migrate S3Helper to pathlib.Path 2023-09-06 12:43:20 +02:00
Mikhail f. Shiryaev
7999598ad8
Rollback testing part from #42599 2023-09-05 12:59:31 +02:00
robot-clickhouse
0f5c49f6b5 Automatic style fix 2023-09-04 21:23:58 +00:00
Igor Nikonov
8aeccd078b Try to catch timeout 2023-09-04 21:16:25 +00:00
robot-clickhouse
926c5636dd
Merge pull request #42599 from ClickHouse/build-fuzzer-protocol 
libFuzzer: add CI fuzzers build, add tcp protocol fuzzer, fix other fuzzers.
 2023-09-04 22:41:54 +02:00
Mikhail f. Shiryaev
9851aebfa8
Add a note of where the lambda is deployed 2023-09-04 18:37:58 +02:00
Mikhail f. Shiryaev
4d0d161748
Use comment as a docstring 2023-09-04 17:06:52 +02:00
Mikhail f. Shiryaev
7351ac1d73
Deploy slack_bot_ci_lambda as other lambdas 2023-09-04 17:06:52 +02:00
Mikhail f. Shiryaev
5e27ca6e59
Use host network to avoid ipv6 problems 2023-09-04 17:06:51 +02:00
Mikhail f. Shiryaev
a082167d85
Move ci-slack-bot from utils to tests/ci 2023-09-04 17:06:51 +02:00
robot-clickhouse
f464effbea Automatic style fix 2023-09-03 22:15:53 +00:00
Yakov Olkhovskiy
11b7e1467f update build_check script 2023-09-03 21:51:12 +00:00
Yakov Olkhovskiy
02a729f9c5 fix 2023-09-03 18:05:54 +00:00
Yakov Olkhovskiy
ae6b5d46be fix 2023-09-03 17:38:36 +00:00
Yakov Olkhovskiy
97317a07f1 remove oss-fuzz build, add fuzzers build 2023-09-03 17:28:44 +00:00
Alexey Milovidov
e7f674165a
Merge pull request #54210 from ClickHouse/fix-timezones-ci-logs 
Fix timezones in the CI Logs database
 2023-09-03 04:58:43 +03:00
Alexey Milovidov
9763a4c2d4 Fix timezones in the CI Logs database 2023-09-02 17:49:51 +02:00
Alexander Tokmakov
d9438b176c save system tables from s3 in the report 2023-09-01 23:04:35 +02:00
Mikhail f. Shiryaev
6fb0257ee0
Use CiLogsCredentials in build_check 2023-08-30 22:06:30 +02:00
Mikhail f. Shiryaev
e113ba9024
Add vim filetype for *.lib files 2023-08-30 22:06:26 +02:00
Mikhail f. Shiryaev
f0c18d4bd7
Rework setup of CI logs export 2023-08-30 22:04:37 +02:00
Mikhail f. Shiryaev
c37c6c5220
Get rid of describe_parameters for the best robot token 2023-08-25 12:41:20 +02:00
Mikhail f. Shiryaev
0b9e7fa9c5
Reduce API calls to SSM client 2023-08-23 22:15:44 +02:00
Mikhail f. Shiryaev
eb9b452e86
Add default timeout value for ClickHouseHelper 2023-08-21 15:20:23 +02:00
Mikhail f. Shiryaev
b7866ce75f
Merge pull request #53493 from ClickHouse/update-style-checker 
Update style checker
 2023-08-17 12:56:20 +02:00
Mikhail f. Shiryaev
fd3e6c93ee
Produce standard report for cases when AST failed 2023-08-17 09:39:02 +02:00
Alexey Milovidov
857856b8b6 Leave only simplifications 2023-08-17 03:58:32 +02:00
Alexey Milovidov
64c829807c Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci-performance 2023-08-17 03:56:27 +02:00
Alexey Milovidov
428a05a560
Follow-up: Do not send logs to CI if the credentials are not set (#53456) 
* Follow-up

* Automatic style fix

* Update tests/ci/ast_fuzzer_check.py

* Update tests/ci/functional_test_check.py

* Update tests/ci/stress_check.py

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
 2023-08-16 14:04:14 +03:00
Mikhail f. Shiryaev
651a45b04d
Add tests for initd start 2023-08-16 01:03:29 +02:00
Mikhail f. Shiryaev
3cd9fa395d
Add test for systemd + /etc/default/clickhouse 2023-08-16 00:51:44 +02:00
Mikhail f. Shiryaev
790475385a
Improve downloading: skip dbg, do not pull images on --no-download 2023-08-16 00:47:39 +02:00
Mikhail f. Shiryaev
387ce81895
Clean all containers properly 2023-08-16 00:46:53 +02:00
Nikita Mikhaylov
12ebfc9a7e
Merge pull request #53441 from ClickHouse/graceful-degradation-sending-logs-to-ci 
Do not send logs to CI if the credentials are not set
 2023-08-15 18:24:14 +02:00
Mikhail f. Shiryaev
33948a150f
Restart killed PublishedReleaseCI workflows 2023-08-15 11:50:11 +02:00
robot-clickhouse
a92fe25ff9 Automatic style fix 2023-08-15 07:15:58 +00:00
Alexey Milovidov
df02512ebf Do not send logs to CI if the credentials are not set 2023-08-15 08:53:08 +02:00
Mikhail f. Shiryaev
56a8818cf2
Fix logic of Mergeable Check 2023-08-14 14:31:26 +02:00
Mikhail f. Shiryaev
900e38a676
Fail early on missed documentation for new features 2023-08-14 14:20:40 +02:00
Mikhail f. Shiryaev
310ac6feaf
Tune PRInfo.has_changes_in_documentation 2023-08-14 14:19:08 +02:00
Alexey Milovidov
748a65b2bb Fix error 2023-08-13 06:35:32 +02:00
Alexey Milovidov
25fefbe144 Fix error 2023-08-13 06:32:48 +02:00
Alexey Milovidov
3ca59e9b19 Fix a typo 2023-08-13 06:25:55 +02:00
Alexey Milovidov
df6fe897c6 Better logs in CI 2023-08-13 06:17:45 +02:00
Alexey Milovidov
645834ffb6 Fix errors 2023-08-13 04:54:20 +02:00
Alexey Milovidov
fd3d0f7fa4 Merge branch 'master' into export-logs-in-ci-performance 2023-08-13 02:43:37 +02:00
Alexey Milovidov
077cd535e2 Improvements 2023-08-13 02:38:48 +02:00
Alexey Milovidov
b84132f4cd Merge branch 'master' into export-logs-in-ci-fuzz 2023-08-13 02:17:30 +02:00
Alexey Milovidov
6fadb8e883
Merge pull request #53353 from ClickHouse/export-logs-in-ci-stress 
Export logs from CI in stress tests
 2023-08-13 03:07:46 +03:00
Alexey Milovidov
221dd53d37 Fixup 2023-08-13 00:36:50 +02:00
Alexey Milovidov
32778e0407 Export logs from CI in performance (part 3) 2023-08-13 00:34:01 +02:00
Alexey Milovidov
5df03dd12f Better 2023-08-13 00:19:58 +02:00
Alexey Milovidov
d059465389
Merge pull request #52293 from ClickHouse/sqltest 
Add SQLTest
 2023-08-13 00:35:46 +03:00
robot-clickhouse
7d7ed06010 Automatic style fix 2023-08-12 20:53:33 +00:00
robot-clickhouse
e6e5a3858d Automatic style fix 2023-08-12 20:43:29 +00:00
Alexey Milovidov
afbb91600e Export logs from CI in fuzzer 2023-08-12 22:41:56 +02:00
Alexey Milovidov
176c16fcc5 Export logs from CI in stress tests 2023-08-12 22:30:18 +02:00
Alexey Milovidov
fc6fc234b2
Merge pull request #53086 from ClickHouse/export-logs-in-ci 
Add a script to export logs in CI
 2023-08-12 17:35:36 +03:00
Yakov Olkhovskiy
fa7994de3b
Merge pull request #53181 from ClickHouse/ci-build-s390x 
Add Linux s390x build to CI
 2023-08-12 09:16:07 -04:00
Alexey Milovidov
01e9f32fdf Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci 2023-08-12 02:46:06 +02:00
Alexey Milovidov
3232993eeb
Merge pull request #53344 from ClickHouse/relax-mergeable-check 
Relax mergeable check
 2023-08-12 03:38:12 +03:00
Alexey Milovidov
1ae186b679 Merge branch 'export-logs-in-ci' of github.com:ClickHouse/ClickHouse into export-logs-in-ci 2023-08-12 02:11:48 +02:00
Alexey Milovidov
38c60430f4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci 2023-08-12 02:11:43 +02:00
Alexey Milovidov
62b3485cd8
Merge pull request #53283 from ClickHouse/fix-00906_low_cardinality_cache 
Inhibit randomization in `00906_low_cardinality_cache`
 2023-08-12 03:01:43 +03:00
Alexey Milovidov
aa815bfc74 Relax mergeable check 2023-08-12 01:54:11 +02:00
robot-clickhouse
2b852e55b6 Automatic style fix 2023-08-11 21:13:53 +00:00
Alexey Milovidov
af74bc9564 Merge branch 'export-logs-in-ci' of github.com:ClickHouse/ClickHouse into export-logs-in-ci 2023-08-11 22:57:23 +02:00
Alexey Milovidov
ddb7fb2ce9
Update tests/ci/functional_test_check.py 
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
 2023-08-11 23:56:23 +03:00
Alexey Milovidov
9b7fcf17bc Merge branch 'allow-creating-system-tables-at-startup' into export-logs-in-ci 2023-08-11 22:54:24 +02:00
Alexey Milovidov
b6c47ee157 Merge branch 'master' into export-logs-in-ci 2023-08-11 03:44:18 +02:00
Mikhail f. Shiryaev
dcb1d3ed00
Rewrite compress_file to pathlib.Path 2023-08-10 22:41:57 +02:00
Mikhail f. Shiryaev
c8d5deda83
Add typing to compress_files 2023-08-10 22:41:56 +02:00
Mikhail f. Shiryaev
18a291a4c7
Upload cargo cache for rust to S3 and reuse 2023-08-10 22:41:55 +02:00
Mikhail f. Shiryaev
dbd3fdd437
Clean ccache_utils a little bit 2023-08-10 22:09:20 +02:00
Mikhail f. Shiryaev
cbd81b3758
Partially revert changes from #52395 2023-08-10 22:09:19 +02:00
Alexey Milovidov
3acb10b8bc Inhibit randomization in 00906_low_cardinality_cache 2023-08-10 20:51:03 +02:00
Alexey Milovidov
561e043868
Merge branch 'master' into sqltest 2023-08-10 21:47:56 +03:00
Alexey Milovidov
269f54b49e
Merge branch 'master' into export-logs-in-ci 2023-08-10 16:56:14 +03:00
Alexey Milovidov
47b5d13367
Merge branch 'master' into fix-stress-test 2023-08-10 16:55:49 +03:00
Alexey Milovidov
e4fbca2e2e Apply review recommendations 2023-08-10 04:47:44 +02:00
Alexey Milovidov
cfdccb95d5 Merge branch 'master' into export-logs-in-ci 2023-08-10 04:30:23 +02:00
Alexey Milovidov
53151610a0
Merge branch 'master' into sqltest 2023-08-10 03:47:26 +03:00
Mikhail f. Shiryaev
ce30b93b34
Move repeated code for ClickHouseHelper to _insert_post 2023-08-09 23:46:45 +02:00
Mikhail f. Shiryaev
c7b045fdde
Process build profiles in the python script, not in docker 2023-08-09 21:48:05 +02:00
Mikhail f. Shiryaev
239d198cf2
Add insert_file to ClickHouseHelper, make insert_json_str public 2023-08-09 21:11:21 +02:00
Mikhail f. Shiryaev
1405346830
Rewrite build_check to use pathlib.Path 2023-08-09 18:56:19 +02:00
Mikhail f. Shiryaev
5341c5c8dd
Use CMAKE_FLAGS and args for cmake profiler 2023-08-09 18:26:25 +02:00
Alexey Milovidov
964c407d48
Revert "Revert "Upload build time-trace data to CI database"" 2023-08-09 16:11:17 +03:00
Alexander Gololobov
63183c56f1
Revert "Upload build time-trace data to CI database" 2023-08-09 13:58:05 +02:00
Alexey Milovidov
10bc51514b Merge branch 'allow-creating-system-tables-at-startup' into export-logs-in-ci 2023-08-09 04:28:50 +02:00
Alexey Milovidov
ede1b17c48
Merge branch 'master' into sqltest 2023-08-09 05:10:47 +03:00
Yakov Olkhovskiy
d8a231e0cb Add Linux s390x build to CI 2023-08-09 00:44:01 +00:00
Alexey Milovidov
acb43266ad
Merge branch 'master' into fix-stress-test 2023-08-08 23:41:59 +03:00
robot-clickhouse
b397d11c91 Automatic style fix 2023-08-08 19:26:19 +00:00
Alexey Milovidov
23eee8d10d Merge branch 'master' of github.com:ClickHouse/ClickHouse into upload-build-profile 2023-08-08 21:02:26 +02:00
Alexey Milovidov
2b59c1778c More info 2023-08-08 21:02:13 +02:00
Alexey Milovidov
ed34f3c46f Fix error 2023-08-08 21:00:30 +02:00
robot-clickhouse
2eff5928d9 Automatic style fix 2023-08-08 13:44:10 +00:00
Alexey Milovidov
7ce8266c8a Fix errors 2023-08-08 15:17:20 +02:00
János Benjamin Antal
67a87a4b95
Merge pull request #53051 from ClickHouse/only-debug-upgrade-check 
Require only ASAN based upgrade check to minimize false positives
 2023-08-08 11:44:11 +02:00
Alexey Milovidov
a91edb8b55 Fix mypy 2023-08-08 04:11:32 +02:00
Alexey Milovidov
161de7c12f Fix error 2023-08-08 03:34:44 +02:00
Alexey Milovidov
5644216429 Fix whitespace 2023-08-07 23:40:34 +02:00
Alexey Milovidov
27559b0349 Adjust a test 2023-08-07 23:09:34 +02:00
Alexey Milovidov
cafe4354c5 Merge branch 'master' into export-logs-in-ci 2023-08-07 23:08:26 +02:00
Alexey Milovidov
77e1693f3c Fix mypy 2023-08-07 21:18:56 +02:00
Alexey Milovidov
8ce4ff0f95 Merge branch 'master' of github.com:ClickHouse/ClickHouse into upload-build-profile 2023-08-07 21:18:30 +02:00
Alexey Milovidov
ab64845740 Fix mypy 2023-08-07 18:45:32 +02:00
Alexey Milovidov
5275062eaf Fix trailing whitespaces 2023-08-07 18:44:25 +02:00
Mikhail f. Shiryaev
2347f5886b
Update Mergeable Check at the finishing CI 2023-08-07 18:06:50 +02:00
Alexey Milovidov
9cb949b60b Fix style 2023-08-07 14:53:38 +02:00
János Benjamin Antal
55c3581242
Replace Upgrade check (debug) with a less flaky upgrade check 2023-08-07 10:27:10 +02:00
robot-clickhouse
19ad81dabd Automatic style fix 2023-08-07 01:50:29 +00:00
Alexey Milovidov
d977e221b4 Upload build time-trace data to CI database 2023-08-07 03:26:59 +02:00
robot-clickhouse
333ed6425c Automatic style fix 2023-08-06 11:30:50 +00:00
Alexey Milovidov
9428040d05 Fix hung check in stress test 2023-08-06 13:07:48 +02:00
Alexey Milovidov
fbb2be21cc Slightly better 2023-08-06 13:04:35 +02:00
robot-clickhouse
2edda961d2 Automatic style fix 2023-08-06 02:55:26 +00:00
Alexey Milovidov
f1eee292c9 Enable export (first try) 2023-08-06 04:38:04 +02:00
Alexey Milovidov
580f207b8d
Merge branch 'master' into sqltest 2023-08-04 22:16:56 +03:00
János Benjamin Antal
c874e5955b Remove upgrade checks with sanitizers 2023-08-04 12:33:11 +00:00
robot-ch-test-poll2
c556ad96f6
Merge pull request #52948 from ClickHouse/refactor-ci-config 
Refactor CI_CONFIG
 2023-08-04 11:10:12 +02:00
Alexey Milovidov
388feb953d Fix paths 2023-08-03 19:28:59 +02:00
Mikhail f. Shiryaev
ca67576720
Do not use inline cache in server images 2023-08-03 18:06:00 +02:00
Alexey Milovidov
65e8ee8fb7 Fix paths 2023-08-03 15:28:18 +02:00
Mikhail f. Shiryaev
8499956321
Refactor CI_CONFIG from dict to dataclasses 2023-08-03 14:37:19 +02:00
Alexey Milovidov
5ec6a4695f Fix log paths 2023-08-02 23:22:15 +02:00
Alexey Milovidov
a98e869912 Merge branch 'master' into sqltest 2023-08-02 20:08:39 +02:00
Mikhail f. Shiryaev
6dcdc4cd38
Remove mark_failed_report_pending, it's already in builds_report_config 2023-08-02 19:20:22 +02:00
Mikhail f. Shiryaev
40cdfa2384
Merge branch 'master' into fix-packager 2023-08-02 11:21:54 +02:00
Mikhail f. Shiryaev
3a07b80f34
Merge pull request #52277 from ClickHouse/kill-runner-with-subprocesses 
Kill the runner process with all subprocesses
 2023-08-02 11:18:56 +02:00
alesapin
0abd5a058b
Merge pull request #52871 from ClickHouse/cont-server-after-gdb-killed 
Try to continue clickhouse process in stress test after terminating gdb.
 2023-08-02 10:55:38 +02:00
Mikhail f. Shiryaev
8537b32de1
Merge branch 'master' into docker-improvements 2023-08-02 08:40:24 +02:00
Alexey Milovidov
3b6247e3f5 Merge branch 'sqltest' of github.com:ClickHouse/ClickHouse into sqltest 2023-08-01 22:33:19 +02:00
Alexey Milovidov
0641dfd7e6 Add missing modification 2023-08-01 22:33:04 +02:00
Alexey Milovidov
97bd68d5c7 Merge branch 'master' into sqltest 2023-08-01 22:31:18 +02:00
Mikhail f. Shiryaev
f87e53c042
Merge branch 'master' into sqltest 2023-08-01 17:42:58 +02:00
Mikhail f. Shiryaev
6b29cccf3e
Rename docker_images.json to docker_images_for_tests.json 2023-08-01 17:30:54 +02:00
Mikhail f. Shiryaev
79d49a006c
Fix the PR body check for Reverts #number 2023-08-01 17:06:23 +02:00
Nikolai Kochetov
09cb5cbe87 Try to continue clickhouse process in stress test after terminating gdb. 2023-08-01 14:30:41 +00:00
Mikhail f. Shiryaev
0931e87989
Merge branch 'master' into sqltest 2023-08-01 16:14:28 +02:00
Alexey Milovidov
8646eefc9c
Update docker_test.py 2023-08-01 17:05:24 +03:00
Mikhail f. Shiryaev
e5087d14ab
Merge branch 'master' into fix-packager 2023-08-01 12:04:06 +02:00
Kseniia Sumarokova
40ce9cf9ed
Merge pull request #51843 from ClickHouse/kssenii-nginx 
Replace kssenii/nginx-test by clickhouse/nginx-dav
 2023-08-01 11:36:20 +02:00
Alexey Milovidov
afb76101b7 Remove obsolete part of a check name 2023-07-31 05:23:28 +02:00
Alexey Milovidov
d243602e74
Merge pull request #52773 from ClickHouse/upload-build-check-statistics 
Upload build statistics to the CI database
 2023-07-31 06:18:41 +03:00
Alexey Milovidov
8155659f87
Merge pull request #52775 from ClickHouse/remove-coverity-2 
Remove Coverity (part 2)
 2023-07-30 12:49:04 +03:00
Alexey Milovidov
bc1f80dd82 Remove Coverity (part 2) 2023-07-30 10:25:44 +02:00
robot-clickhouse
358773c620 Automatic style fix 2023-07-30 07:45:27 +00:00
Alexey Milovidov
448756d148 Add machine_type information to the CI database 2023-07-30 09:31:21 +02:00
Alexey Milovidov
41ffc09771 Upload build statistics to the CI database 2023-07-30 09:18:06 +02:00
Kruglov Pavel
93e10077ba
Fix attaching gdb in stress tests (#51445) 
* Fix attaching gdb in stress tests

* Fix

* Update run.sh

* Try remove run_with_retry

* Return run_with_retry

* Don't set -e in run_with_retry if it was't set before

* Update tests/ci/utils.lib

* Fix bash

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
 2023-07-26 12:53:19 +03:00
Azat Khuzhin
0b258dda4e Reproducible builds for Rust 
From now on cargo will not download anything from the internet during
builds. This step had been moved for docker image builds (via cargo
vendor).

And now cargo inside docker.io/clickhouse/binary-builder will not use
any crates from the internet, so we don't need to add --offline for
cargo commands in cmake (corrosion_import_crate()).

Also the docker build command had been adjusted to allow following
symlinks inside build context, by using tar, this is required for Rust
packages.

Note, that to make proper Cargo.lock that could be vendored I did the
following:
- per-project locks had been removed (since there is no automatic way to
  sync the workspace Cargo.lock with per-project Cargo.lock, since cargo
  update/generate-lockfile will use only per-project Cargo.toml files
  apparently, -Z minimal-versions does not helps either)
- and to generate Cargo.lock with less changes I've pinned version in
  the Cargo.toml strictly, i.e. not 'foo = "0.1"' but 'foo = "=0.1"'
  then the Cargo.lock for workspace had been generated and afterwards
  I've reverted this part.

Plus I have to update the dependencies afterwards, since otherwise there
are conflicts with dependencies for std library. Non trivial.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-22 22:46:22 +02:00
Alexey Milovidov
c3c8ea9c27 Do something 2023-07-22 17:30:55 +02:00
Mikhail f. Shiryaev
c6e9f621f1 Replace kssenii/nginx-test:1.1 by clickhouse/nginx-dav 2023-07-22 15:45:47 +02:00
Alexey Milovidov
3398355e46 Add something with unclear purpose 2023-07-22 02:04:30 +02:00