Commit Graph

2046 Commits

Author SHA1 Message Date
Yakov Olkhovskiy
0847889db6 libFuzzer infrastructure 2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
b7a17bf8dd add libFuzzer tests, initial integration 2023-09-17 16:36:49 +00:00
Mikhail f. Shiryaev
4c9f8d150b
Merge pull request #54504 from ClickHouse/s3-artifacts
S3 artifacts
2023-09-15 18:21:57 +02:00
robot-ch-test-poll
3af3114478
Merge pull request #54668 from Avogar/better-ci-libs
Move all `tests/ci/*.lib files` to `stateless-tests` image
2023-09-15 17:40:01 +02:00
Igor Nikonov
eb6fceccbb
Merge pull request #54278 from ClickHouse/ci-check-process-timeout
CI: a try to handle tests timeouts
2023-09-15 17:13:16 +02:00
Mikhail f. Shiryaev
964b9ede2d
Improve index.html for the non-CI runnings 2023-09-15 15:00:35 +02:00
Mikhail f. Shiryaev
5200a8dadc
Create directory for archives if not exists 2023-09-15 15:00:32 +02:00
Mikhail f. Shiryaev
414594a472
Decouple ArtifactsHelper commit status 2023-09-15 14:54:48 +02:00
Mikhail f. Shiryaev
40e04fee6c
Report only changed images in commit status 2023-09-15 14:54:47 +02:00
Mikhail f. Shiryaev
5ead298d53
Improve S3Helper url handling, ArtifactsHelper local artifacts 2023-09-15 14:54:47 +02:00
Mikhail f. Shiryaev
51e79e1ddf
Create commit status for Artifacts 2023-09-15 14:54:46 +02:00
Mikhail f. Shiryaev
3f350eb148
Create artifact_helper for lightweight workflow artifacts 2023-09-15 14:54:45 +02:00
Mikhail f. Shiryaev
eef15ff67a
Insignificant improvements to git_helper and compress_files 2023-09-15 14:54:44 +02:00
Mikhail f. Shiryaev
2f8f16a864
Fix git_helper import issue with git_runner.run() 2023-09-15 14:54:44 +02:00
Mikhail f. Shiryaev
fde8817fb7
Fix PRInfo and docker_images_check typing 2023-09-15 14:54:42 +02:00
avogar
d5889c8cc8 Move all tests/ci/*.lib files to stateless-tests image 2023-09-15 11:27:09 +00:00
János Benjamin Antal
13868e4d1d Fix review comments 2023-09-14 14:45:23 +00:00
János Benjamin Antal
f7ceb76dcb Fix pylint and mypy issues 2023-09-14 13:41:34 +00:00
János Benjamin Antal
699bf031c9 Remove accidentally committed code 2023-09-14 12:07:15 +00:00
János Benjamin Antal
51781a6a86 Add workflow 2023-09-14 12:05:50 +00:00
János Benjamin Antal
078c16760f Add --remote-protocol arg 2023-09-14 12:05:49 +00:00
robot-clickhouse
0fda5e4bf2 Automatic style fix 2023-09-14 11:44:34 +00:00
János Benjamin Antal
da802b2688 Do the release 2023-09-14 11:28:35 +00:00
János Benjamin Antal
b13a07863d Add gh_cache to gitignore to pass dirty check 2023-09-14 11:17:20 +00:00
János Benjamin Antal
6df371754d Fix typos in release.py 2023-09-14 10:54:17 +00:00
János Benjamin Antal
33eeb0737f Fix style errors 2023-09-14 10:23:26 +00:00
János Benjamin Antal
462f4111de Turn PoC into real script without calling release.py 2023-09-13 23:33:04 +00:00
robot-clickhouse
94b6d9ed05 Automatic style fix 2023-09-13 17:16:17 +00:00
János Benjamin Antal
84e311321d Add basic logic to find releasable commits 2023-09-13 17:05:31 +00:00
robot-clickhouse
3ed7f47af9 Automatic style fix 2023-09-13 16:56:14 +00:00
Smita Kulkarni
1ec52de797 Addressed review comments 2023-09-13 18:37:03 +02:00
robot-clickhouse
fe2240afbf Automatic style fix 2023-09-13 08:23:14 +00:00
Smita Kulkarni
176bd0e509 Fixed function call and added check for FORCE_TESTS_LABEL 2023-09-13 09:58:57 +02:00
Mikhail f. Shiryaev
397a682d1c
Merge pull request #54441 from ClickHouse/vdimir/ci-commit-statis-update
Update automated commit status comment
2023-09-12 21:18:13 +02:00
Igor Nikonov
031da054f3 Return initial timeout 2023-09-12 19:06:39 +00:00
robot-clickhouse
63f71b719d Automatic style fix 2023-09-12 18:31:34 +00:00
Igor Nikonov
4671901313 Update stress_check.py 2023-09-12 18:17:55 +00:00
Igor Nikonov
8a4654c39e Address review comment 2023-09-12 18:06:00 +00:00
vdimir
acb559ce8b
Update tests/ci/commit_status_helper.py
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2023-09-12 17:34:52 +02:00
Igor Nikonov
7f90b7983c Merge remote-tracking branch 'origin/master' into ci-check-process-timeout 2023-09-12 13:41:35 +00:00
Igor Nikonov
8db991faa0 Fix style 2023-09-12 13:41:31 +00:00
vdimir
72d5a5d094
fix report.py 2023-09-12 11:54:35 +00:00
robot-clickhouse
5a7ecbc23e Automatic style fix 2023-09-12 10:18:40 +00:00
Smita Kulkarni
135c447f07 Updated check to fix style 2023-09-12 12:01:27 +02:00
robot-clickhouse
3b4120ba55 Automatic style fix 2023-09-12 08:51:21 +00:00
Smita Kulkarni
9accebe73d Updated can_skip_builds_and_use_version_from_master, can_skip_integration_tests, can_skip_functional_tests checks in ci 2023-09-12 10:30:59 +02:00
vdimir
790d61971c
sucessfull items in report can be expandable 2023-09-11 17:06:16 +00:00
vdimir
8bb0fbfd2c
fix 2023-09-11 17:03:28 +00:00
vdimir
4a80a0f1c0
upd 2023-09-11 16:13:52 +00:00
vdimir
960ca5ebde
Show PR status in label 2023-09-11 16:13:33 +00:00
vdimir
a1ee226969
Update PR status icons 2023-09-11 16:13:11 +00:00
vdimir
61fdb63aad
fix 2023-09-11 13:53:20 +00:00
vdimir
297306b4b9
status emoji in the beginning of title 2023-09-11 13:36:02 +00:00
Alexey Milovidov
c4c41cad23 Merge branch 'ci-instance-type' of github.com:ClickHouse/ClickHouse into ci-instance-type 2023-09-09 05:52:04 +02:00
Alexey Milovidov
154ac14ef6 Fix error 2023-09-09 05:51:43 +02:00
robot-clickhouse
923d7a0bc3 Automatic style fix 2023-09-09 00:27:39 +00:00
Alexey Milovidov
0728df37e6 Add instance_type column to CI Logs and the checks table 2023-09-09 01:44:14 +02:00
vdimir
6a51d9fd7d
do not merge this commit 2023-09-08 17:04:44 +00:00
vdimir
a46d1974ac
fix 2023-09-08 15:49:13 +00:00
vdimir
465d84aba7
Set raw_logs in create_ci_report 2023-09-08 15:39:07 +00:00
vdimir
b0b8255c6f
Set PR status into title 2023-09-08 15:36:32 +00:00
vdimir
5e0caa669e
Move sucessull checks in commit status under a spoiler 2023-09-08 09:56:53 +00:00
János Benjamin Antal
5862c4ec93
Use not the absolute latest docker image tag (#54369)
* Add params for select queries in clickhouse_helper.py

* Find the latest image tags from master

* Get full git history

* Do not checkout submodules

* Automatic style fix

* Fix style errors

* Make logging pretty

* Revert accidentally committed changes

* Eliminate pformat

* Update all workflows

* Remove flag with default value

* Improve exception handling

* Utilizing the loop condition in while loop

* Make the logic robust over temporary errors

* Prettify logs

* Automatic style fix

* Add accidentally removed line

* Revert "Make the logic robust over temporary errors"

This reverts commit 91e6b5d7ba.

* Do not fail in case the tag cannot be queried from ClickHouse

* Support partial finding of tags

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2023-09-08 08:42:56 +02:00
robot-clickhouse
c680c951d3 Automatic style fix 2023-09-07 13:12:53 +00:00
Igor Nikonov
27455a5882 Test timeout to fail 2023-09-07 12:57:35 +00:00
Igor Nikonov
c354fcaff7 Timeout report for stress_check 2023-09-07 12:56:22 +00:00
Igor Nikonov
a0317e461a Better description 2023-09-07 12:41:36 +00:00
Igor Nikonov
7ab56a13b8 Polishing 2023-09-06 22:49:28 +00:00
Igor Nikonov
babbecc646 Fix 2023-09-06 15:00:32 +00:00
Igor Nikonov
e858f0b880 Fix description length 2023-09-06 13:05:56 +00:00
Igor Nikonov
32048f2a8d Merge remote-tracking branch 'origin/master' into ci-check-process-timeout 2023-09-06 12:48:43 +00:00
Igor Nikonov
f6f2e731a7 Fix state 2023-09-06 12:44:39 +00:00
robot-clickhouse
f08d445a0f Automatic style fix 2023-09-06 11:59:51 +00:00
Igor Nikonov
a22e219be9 Fix 2023-09-06 11:51:43 +00:00
Igor Nikonov
3ef6d0da39 Set status and description 2023-09-06 11:02:17 +00:00
Mikhail f. Shiryaev
7f34c8e17d
Decouple env_helper.get_job_id_url 2023-09-06 12:43:29 +02:00
Mikhail f. Shiryaev
1afc5b7e05
Use suffix from git tags as version descriptions 2023-09-06 12:43:28 +02:00
Mikhail f. Shiryaev
6fc73e0e1f
Use a single BuildResult class across builds and report checks 2023-09-06 12:43:27 +02:00
Mikhail f. Shiryaev
88664bef3f
Create report status constants 2023-09-06 12:43:25 +02:00
Mikhail f. Shiryaev
428b72e767
Combine rows for build templates with lists 2023-09-06 12:43:23 +02:00
Mikhail f. Shiryaev
e0f6242af8
Use the same style for all reports 2023-09-06 12:43:21 +02:00
Mikhail f. Shiryaev
e18d9d39e8
Migrate S3Helper to pathlib.Path 2023-09-06 12:43:20 +02:00
Mikhail f. Shiryaev
7999598ad8
Rollback testing part from #42599 2023-09-05 12:59:31 +02:00
robot-clickhouse
0f5c49f6b5 Automatic style fix 2023-09-04 21:23:58 +00:00
Igor Nikonov
8aeccd078b Try to catch timeout 2023-09-04 21:16:25 +00:00
robot-clickhouse
926c5636dd
Merge pull request #42599 from ClickHouse/build-fuzzer-protocol
libFuzzer: add CI fuzzers build, add tcp protocol fuzzer, fix other fuzzers.
2023-09-04 22:41:54 +02:00
Mikhail f. Shiryaev
9851aebfa8
Add a note of where the lambda is deployed 2023-09-04 18:37:58 +02:00
Mikhail f. Shiryaev
4d0d161748
Use comment as a docstring 2023-09-04 17:06:52 +02:00
Mikhail f. Shiryaev
7351ac1d73
Deploy slack_bot_ci_lambda as other lambdas 2023-09-04 17:06:52 +02:00
Mikhail f. Shiryaev
5e27ca6e59
Use host network to avoid ipv6 problems 2023-09-04 17:06:51 +02:00
Mikhail f. Shiryaev
a082167d85
Move ci-slack-bot from utils to tests/ci 2023-09-04 17:06:51 +02:00
robot-clickhouse
f464effbea Automatic style fix 2023-09-03 22:15:53 +00:00
Yakov Olkhovskiy
11b7e1467f update build_check script 2023-09-03 21:51:12 +00:00
Yakov Olkhovskiy
02a729f9c5 fix 2023-09-03 18:05:54 +00:00
Yakov Olkhovskiy
ae6b5d46be fix 2023-09-03 17:38:36 +00:00
Yakov Olkhovskiy
97317a07f1 remove oss-fuzz build, add fuzzers build 2023-09-03 17:28:44 +00:00
Alexey Milovidov
e7f674165a
Merge pull request #54210 from ClickHouse/fix-timezones-ci-logs
Fix timezones in the CI Logs database
2023-09-03 04:58:43 +03:00
Alexey Milovidov
9763a4c2d4 Fix timezones in the CI Logs database 2023-09-02 17:49:51 +02:00
Alexander Tokmakov
d9438b176c save system tables from s3 in the report 2023-09-01 23:04:35 +02:00
Mikhail f. Shiryaev
6fb0257ee0
Use CiLogsCredentials in build_check 2023-08-30 22:06:30 +02:00
Mikhail f. Shiryaev
e113ba9024
Add vim filetype for *.lib files 2023-08-30 22:06:26 +02:00
Mikhail f. Shiryaev
f0c18d4bd7
Rework setup of CI logs export 2023-08-30 22:04:37 +02:00
Mikhail f. Shiryaev
c37c6c5220
Get rid of describe_parameters for the best robot token 2023-08-25 12:41:20 +02:00
Mikhail f. Shiryaev
0b9e7fa9c5
Reduce API calls to SSM client 2023-08-23 22:15:44 +02:00
Mikhail f. Shiryaev
eb9b452e86
Add default timeout value for ClickHouseHelper 2023-08-21 15:20:23 +02:00
Mikhail f. Shiryaev
b7866ce75f
Merge pull request #53493 from ClickHouse/update-style-checker
Update style checker
2023-08-17 12:56:20 +02:00
Mikhail f. Shiryaev
fd3e6c93ee
Produce standard report for cases when AST failed 2023-08-17 09:39:02 +02:00
Alexey Milovidov
857856b8b6 Leave only simplifications 2023-08-17 03:58:32 +02:00
Alexey Milovidov
64c829807c Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci-performance 2023-08-17 03:56:27 +02:00
Alexey Milovidov
428a05a560
Follow-up: Do not send logs to CI if the credentials are not set (#53456)
* Follow-up

* Automatic style fix

* Update tests/ci/ast_fuzzer_check.py

* Update tests/ci/functional_test_check.py

* Update tests/ci/stress_check.py

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-08-16 14:04:14 +03:00
Mikhail f. Shiryaev
651a45b04d
Add tests for initd start 2023-08-16 01:03:29 +02:00
Mikhail f. Shiryaev
3cd9fa395d
Add test for systemd + /etc/default/clickhouse 2023-08-16 00:51:44 +02:00
Mikhail f. Shiryaev
790475385a
Improve downloading: skip dbg, do not pull images on --no-download 2023-08-16 00:47:39 +02:00
Mikhail f. Shiryaev
387ce81895
Clean all containers properly 2023-08-16 00:46:53 +02:00
Nikita Mikhaylov
12ebfc9a7e
Merge pull request #53441 from ClickHouse/graceful-degradation-sending-logs-to-ci
Do not send logs to CI if the credentials are not set
2023-08-15 18:24:14 +02:00
Mikhail f. Shiryaev
33948a150f
Restart killed PublishedReleaseCI workflows 2023-08-15 11:50:11 +02:00
robot-clickhouse
a92fe25ff9 Automatic style fix 2023-08-15 07:15:58 +00:00
Alexey Milovidov
df02512ebf Do not send logs to CI if the credentials are not set 2023-08-15 08:53:08 +02:00
Mikhail f. Shiryaev
56a8818cf2
Fix logic of Mergeable Check 2023-08-14 14:31:26 +02:00
Mikhail f. Shiryaev
900e38a676
Fail early on missed documentation for new features 2023-08-14 14:20:40 +02:00
Mikhail f. Shiryaev
310ac6feaf
Tune PRInfo.has_changes_in_documentation 2023-08-14 14:19:08 +02:00
Alexey Milovidov
748a65b2bb Fix error 2023-08-13 06:35:32 +02:00
Alexey Milovidov
25fefbe144 Fix error 2023-08-13 06:32:48 +02:00
Alexey Milovidov
3ca59e9b19 Fix a typo 2023-08-13 06:25:55 +02:00
Alexey Milovidov
df6fe897c6 Better logs in CI 2023-08-13 06:17:45 +02:00
Alexey Milovidov
645834ffb6 Fix errors 2023-08-13 04:54:20 +02:00
Alexey Milovidov
fd3d0f7fa4 Merge branch 'master' into export-logs-in-ci-performance 2023-08-13 02:43:37 +02:00
Alexey Milovidov
077cd535e2 Improvements 2023-08-13 02:38:48 +02:00
Alexey Milovidov
b84132f4cd Merge branch 'master' into export-logs-in-ci-fuzz 2023-08-13 02:17:30 +02:00
Alexey Milovidov
6fadb8e883
Merge pull request #53353 from ClickHouse/export-logs-in-ci-stress
Export logs from CI in stress tests
2023-08-13 03:07:46 +03:00
Alexey Milovidov
221dd53d37 Fixup 2023-08-13 00:36:50 +02:00
Alexey Milovidov
32778e0407 Export logs from CI in performance (part 3) 2023-08-13 00:34:01 +02:00
Alexey Milovidov
5df03dd12f Better 2023-08-13 00:19:58 +02:00
Alexey Milovidov
d059465389
Merge pull request #52293 from ClickHouse/sqltest
Add SQLTest
2023-08-13 00:35:46 +03:00
robot-clickhouse
7d7ed06010 Automatic style fix 2023-08-12 20:53:33 +00:00
robot-clickhouse
e6e5a3858d Automatic style fix 2023-08-12 20:43:29 +00:00
Alexey Milovidov
afbb91600e Export logs from CI in fuzzer 2023-08-12 22:41:56 +02:00
Alexey Milovidov
176c16fcc5 Export logs from CI in stress tests 2023-08-12 22:30:18 +02:00
Alexey Milovidov
fc6fc234b2
Merge pull request #53086 from ClickHouse/export-logs-in-ci
Add a script to export logs in CI
2023-08-12 17:35:36 +03:00
Yakov Olkhovskiy
fa7994de3b
Merge pull request #53181 from ClickHouse/ci-build-s390x
Add Linux s390x build to CI
2023-08-12 09:16:07 -04:00
Alexey Milovidov
01e9f32fdf Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci 2023-08-12 02:46:06 +02:00
Alexey Milovidov
3232993eeb
Merge pull request #53344 from ClickHouse/relax-mergeable-check
Relax mergeable check
2023-08-12 03:38:12 +03:00
Alexey Milovidov
1ae186b679 Merge branch 'export-logs-in-ci' of github.com:ClickHouse/ClickHouse into export-logs-in-ci 2023-08-12 02:11:48 +02:00
Alexey Milovidov
38c60430f4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci 2023-08-12 02:11:43 +02:00
Alexey Milovidov
62b3485cd8
Merge pull request #53283 from ClickHouse/fix-00906_low_cardinality_cache
Inhibit randomization in `00906_low_cardinality_cache`
2023-08-12 03:01:43 +03:00
Alexey Milovidov
aa815bfc74 Relax mergeable check 2023-08-12 01:54:11 +02:00
robot-clickhouse
2b852e55b6 Automatic style fix 2023-08-11 21:13:53 +00:00
Alexey Milovidov
af74bc9564 Merge branch 'export-logs-in-ci' of github.com:ClickHouse/ClickHouse into export-logs-in-ci 2023-08-11 22:57:23 +02:00
Alexey Milovidov
ddb7fb2ce9
Update tests/ci/functional_test_check.py
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2023-08-11 23:56:23 +03:00
Alexey Milovidov
9b7fcf17bc Merge branch 'allow-creating-system-tables-at-startup' into export-logs-in-ci 2023-08-11 22:54:24 +02:00