Yakov Olkhovskiy
0847889db6
libFuzzer infrastructure
2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
b7a17bf8dd
add libFuzzer tests, initial integration
2023-09-17 16:36:49 +00:00
Mikhail f. Shiryaev
4c9f8d150b
Merge pull request #54504 from ClickHouse/s3-artifacts
...
S3 artifacts
2023-09-15 18:21:57 +02:00
robot-ch-test-poll
3af3114478
Merge pull request #54668 from Avogar/better-ci-libs
...
Move all `tests/ci/*.lib files` to `stateless-tests` image
2023-09-15 17:40:01 +02:00
Igor Nikonov
eb6fceccbb
Merge pull request #54278 from ClickHouse/ci-check-process-timeout
...
CI: a try to handle tests timeouts
2023-09-15 17:13:16 +02:00
Mikhail f. Shiryaev
964b9ede2d
Improve index.html for the non-CI runnings
2023-09-15 15:00:35 +02:00
Mikhail f. Shiryaev
5200a8dadc
Create directory for archives if not exists
2023-09-15 15:00:32 +02:00
Mikhail f. Shiryaev
414594a472
Decouple ArtifactsHelper commit status
2023-09-15 14:54:48 +02:00
Mikhail f. Shiryaev
40e04fee6c
Report only changed images in commit status
2023-09-15 14:54:47 +02:00
Mikhail f. Shiryaev
5ead298d53
Improve S3Helper url handling, ArtifactsHelper local artifacts
2023-09-15 14:54:47 +02:00
Mikhail f. Shiryaev
51e79e1ddf
Create commit status for Artifacts
2023-09-15 14:54:46 +02:00
Mikhail f. Shiryaev
3f350eb148
Create artifact_helper for lightweight workflow artifacts
2023-09-15 14:54:45 +02:00
Mikhail f. Shiryaev
eef15ff67a
Insignificant improvements to git_helper and compress_files
2023-09-15 14:54:44 +02:00
Mikhail f. Shiryaev
2f8f16a864
Fix git_helper import issue with git_runner.run()
2023-09-15 14:54:44 +02:00
Mikhail f. Shiryaev
fde8817fb7
Fix PRInfo and docker_images_check typing
2023-09-15 14:54:42 +02:00
avogar
d5889c8cc8
Move all tests/ci/*.lib files to stateless-tests image
2023-09-15 11:27:09 +00:00
János Benjamin Antal
13868e4d1d
Fix review comments
2023-09-14 14:45:23 +00:00
János Benjamin Antal
f7ceb76dcb
Fix pylint and mypy issues
2023-09-14 13:41:34 +00:00
János Benjamin Antal
699bf031c9
Remove accidentally committed code
2023-09-14 12:07:15 +00:00
János Benjamin Antal
51781a6a86
Add workflow
2023-09-14 12:05:50 +00:00
János Benjamin Antal
078c16760f
Add --remote-protocol
arg
2023-09-14 12:05:49 +00:00
robot-clickhouse
0fda5e4bf2
Automatic style fix
2023-09-14 11:44:34 +00:00
János Benjamin Antal
da802b2688
Do the release
2023-09-14 11:28:35 +00:00
János Benjamin Antal
b13a07863d
Add gh_cache
to gitignore to pass dirty check
2023-09-14 11:17:20 +00:00
János Benjamin Antal
6df371754d
Fix typos in release.py
2023-09-14 10:54:17 +00:00
János Benjamin Antal
33eeb0737f
Fix style errors
2023-09-14 10:23:26 +00:00
János Benjamin Antal
462f4111de
Turn PoC into real script without calling release.py
2023-09-13 23:33:04 +00:00
robot-clickhouse
94b6d9ed05
Automatic style fix
2023-09-13 17:16:17 +00:00
János Benjamin Antal
84e311321d
Add basic logic to find releasable commits
2023-09-13 17:05:31 +00:00
robot-clickhouse
3ed7f47af9
Automatic style fix
2023-09-13 16:56:14 +00:00
Smita Kulkarni
1ec52de797
Addressed review comments
2023-09-13 18:37:03 +02:00
robot-clickhouse
fe2240afbf
Automatic style fix
2023-09-13 08:23:14 +00:00
Smita Kulkarni
176bd0e509
Fixed function call and added check for FORCE_TESTS_LABEL
2023-09-13 09:58:57 +02:00
Mikhail f. Shiryaev
397a682d1c
Merge pull request #54441 from ClickHouse/vdimir/ci-commit-statis-update
...
Update automated commit status comment
2023-09-12 21:18:13 +02:00
Igor Nikonov
031da054f3
Return initial timeout
2023-09-12 19:06:39 +00:00
robot-clickhouse
63f71b719d
Automatic style fix
2023-09-12 18:31:34 +00:00
Igor Nikonov
4671901313
Update stress_check.py
2023-09-12 18:17:55 +00:00
Igor Nikonov
8a4654c39e
Address review comment
2023-09-12 18:06:00 +00:00
vdimir
acb559ce8b
Update tests/ci/commit_status_helper.py
...
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2023-09-12 17:34:52 +02:00
Igor Nikonov
7f90b7983c
Merge remote-tracking branch 'origin/master' into ci-check-process-timeout
2023-09-12 13:41:35 +00:00
Igor Nikonov
8db991faa0
Fix style
2023-09-12 13:41:31 +00:00
vdimir
72d5a5d094
fix report.py
2023-09-12 11:54:35 +00:00
robot-clickhouse
5a7ecbc23e
Automatic style fix
2023-09-12 10:18:40 +00:00
Smita Kulkarni
135c447f07
Updated check to fix style
2023-09-12 12:01:27 +02:00
robot-clickhouse
3b4120ba55
Automatic style fix
2023-09-12 08:51:21 +00:00
Smita Kulkarni
9accebe73d
Updated can_skip_builds_and_use_version_from_master, can_skip_integration_tests, can_skip_functional_tests checks in ci
2023-09-12 10:30:59 +02:00
vdimir
790d61971c
sucessfull items in report can be expandable
2023-09-11 17:06:16 +00:00
vdimir
8bb0fbfd2c
fix
2023-09-11 17:03:28 +00:00
vdimir
4a80a0f1c0
upd
2023-09-11 16:13:52 +00:00
vdimir
960ca5ebde
Show PR status in label
2023-09-11 16:13:33 +00:00
vdimir
a1ee226969
Update PR status icons
2023-09-11 16:13:11 +00:00
vdimir
61fdb63aad
fix
2023-09-11 13:53:20 +00:00
vdimir
297306b4b9
status emoji in the beginning of title
2023-09-11 13:36:02 +00:00
Alexey Milovidov
c4c41cad23
Merge branch 'ci-instance-type' of github.com:ClickHouse/ClickHouse into ci-instance-type
2023-09-09 05:52:04 +02:00
Alexey Milovidov
154ac14ef6
Fix error
2023-09-09 05:51:43 +02:00
robot-clickhouse
923d7a0bc3
Automatic style fix
2023-09-09 00:27:39 +00:00
Alexey Milovidov
0728df37e6
Add instance_type
column to CI Logs and the checks
table
2023-09-09 01:44:14 +02:00
vdimir
6a51d9fd7d
do not merge this commit
2023-09-08 17:04:44 +00:00
vdimir
a46d1974ac
fix
2023-09-08 15:49:13 +00:00
vdimir
465d84aba7
Set raw_logs in create_ci_report
2023-09-08 15:39:07 +00:00
vdimir
b0b8255c6f
Set PR status into title
2023-09-08 15:36:32 +00:00
vdimir
5e0caa669e
Move sucessull checks in commit status under a spoiler
2023-09-08 09:56:53 +00:00
János Benjamin Antal
5862c4ec93
Use not the absolute latest docker image tag ( #54369 )
...
* Add params for select queries in clickhouse_helper.py
* Find the latest image tags from master
* Get full git history
* Do not checkout submodules
* Automatic style fix
* Fix style errors
* Make logging pretty
* Revert accidentally committed changes
* Eliminate pformat
* Update all workflows
* Remove flag with default value
* Improve exception handling
* Utilizing the loop condition in while loop
* Make the logic robust over temporary errors
* Prettify logs
* Automatic style fix
* Add accidentally removed line
* Revert "Make the logic robust over temporary errors"
This reverts commit 91e6b5d7ba
.
* Do not fail in case the tag cannot be queried from ClickHouse
* Support partial finding of tags
---------
Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2023-09-08 08:42:56 +02:00
robot-clickhouse
c680c951d3
Automatic style fix
2023-09-07 13:12:53 +00:00
Igor Nikonov
27455a5882
Test timeout to fail
2023-09-07 12:57:35 +00:00
Igor Nikonov
c354fcaff7
Timeout report for stress_check
2023-09-07 12:56:22 +00:00
Igor Nikonov
a0317e461a
Better description
2023-09-07 12:41:36 +00:00
Igor Nikonov
7ab56a13b8
Polishing
2023-09-06 22:49:28 +00:00
Igor Nikonov
babbecc646
Fix
2023-09-06 15:00:32 +00:00
Igor Nikonov
e858f0b880
Fix description length
2023-09-06 13:05:56 +00:00
Igor Nikonov
32048f2a8d
Merge remote-tracking branch 'origin/master' into ci-check-process-timeout
2023-09-06 12:48:43 +00:00
Igor Nikonov
f6f2e731a7
Fix state
2023-09-06 12:44:39 +00:00
robot-clickhouse
f08d445a0f
Automatic style fix
2023-09-06 11:59:51 +00:00
Igor Nikonov
a22e219be9
Fix
2023-09-06 11:51:43 +00:00
Igor Nikonov
3ef6d0da39
Set status and description
2023-09-06 11:02:17 +00:00
Mikhail f. Shiryaev
7f34c8e17d
Decouple env_helper.get_job_id_url
2023-09-06 12:43:29 +02:00
Mikhail f. Shiryaev
1afc5b7e05
Use suffix from git tags as version descriptions
2023-09-06 12:43:28 +02:00
Mikhail f. Shiryaev
6fc73e0e1f
Use a single BuildResult class across builds and report checks
2023-09-06 12:43:27 +02:00
Mikhail f. Shiryaev
88664bef3f
Create report status constants
2023-09-06 12:43:25 +02:00
Mikhail f. Shiryaev
428b72e767
Combine rows for build templates with lists
2023-09-06 12:43:23 +02:00
Mikhail f. Shiryaev
e0f6242af8
Use the same style for all reports
2023-09-06 12:43:21 +02:00
Mikhail f. Shiryaev
e18d9d39e8
Migrate S3Helper to pathlib.Path
2023-09-06 12:43:20 +02:00
Mikhail f. Shiryaev
7999598ad8
Rollback testing part from #42599
2023-09-05 12:59:31 +02:00
robot-clickhouse
0f5c49f6b5
Automatic style fix
2023-09-04 21:23:58 +00:00
Igor Nikonov
8aeccd078b
Try to catch timeout
2023-09-04 21:16:25 +00:00
robot-clickhouse
926c5636dd
Merge pull request #42599 from ClickHouse/build-fuzzer-protocol
...
libFuzzer: add CI fuzzers build, add tcp protocol fuzzer, fix other fuzzers.
2023-09-04 22:41:54 +02:00
Mikhail f. Shiryaev
9851aebfa8
Add a note of where the lambda is deployed
2023-09-04 18:37:58 +02:00
Mikhail f. Shiryaev
4d0d161748
Use comment as a docstring
2023-09-04 17:06:52 +02:00
Mikhail f. Shiryaev
7351ac1d73
Deploy slack_bot_ci_lambda as other lambdas
2023-09-04 17:06:52 +02:00
Mikhail f. Shiryaev
5e27ca6e59
Use host network to avoid ipv6 problems
2023-09-04 17:06:51 +02:00
Mikhail f. Shiryaev
a082167d85
Move ci-slack-bot from utils to tests/ci
2023-09-04 17:06:51 +02:00
robot-clickhouse
f464effbea
Automatic style fix
2023-09-03 22:15:53 +00:00
Yakov Olkhovskiy
11b7e1467f
update build_check script
2023-09-03 21:51:12 +00:00
Yakov Olkhovskiy
02a729f9c5
fix
2023-09-03 18:05:54 +00:00
Yakov Olkhovskiy
ae6b5d46be
fix
2023-09-03 17:38:36 +00:00
Yakov Olkhovskiy
97317a07f1
remove oss-fuzz build, add fuzzers build
2023-09-03 17:28:44 +00:00
Alexey Milovidov
e7f674165a
Merge pull request #54210 from ClickHouse/fix-timezones-ci-logs
...
Fix timezones in the CI Logs database
2023-09-03 04:58:43 +03:00
Alexey Milovidov
9763a4c2d4
Fix timezones in the CI Logs database
2023-09-02 17:49:51 +02:00
Alexander Tokmakov
d9438b176c
save system tables from s3 in the report
2023-09-01 23:04:35 +02:00
Mikhail f. Shiryaev
6fb0257ee0
Use CiLogsCredentials in build_check
2023-08-30 22:06:30 +02:00
Mikhail f. Shiryaev
e113ba9024
Add vim filetype for *.lib files
2023-08-30 22:06:26 +02:00
Mikhail f. Shiryaev
f0c18d4bd7
Rework setup of CI logs export
2023-08-30 22:04:37 +02:00
Mikhail f. Shiryaev
c37c6c5220
Get rid of describe_parameters for the best robot token
2023-08-25 12:41:20 +02:00
Mikhail f. Shiryaev
0b9e7fa9c5
Reduce API calls to SSM client
2023-08-23 22:15:44 +02:00
Mikhail f. Shiryaev
eb9b452e86
Add default timeout value for ClickHouseHelper
2023-08-21 15:20:23 +02:00
Mikhail f. Shiryaev
b7866ce75f
Merge pull request #53493 from ClickHouse/update-style-checker
...
Update style checker
2023-08-17 12:56:20 +02:00
Mikhail f. Shiryaev
fd3e6c93ee
Produce standard report for cases when AST failed
2023-08-17 09:39:02 +02:00
Alexey Milovidov
857856b8b6
Leave only simplifications
2023-08-17 03:58:32 +02:00
Alexey Milovidov
64c829807c
Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci-performance
2023-08-17 03:56:27 +02:00
Alexey Milovidov
428a05a560
Follow-up: Do not send logs to CI if the credentials are not set ( #53456 )
...
* Follow-up
* Automatic style fix
* Update tests/ci/ast_fuzzer_check.py
* Update tests/ci/functional_test_check.py
* Update tests/ci/stress_check.py
* Automatic style fix
---------
Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-08-16 14:04:14 +03:00
Mikhail f. Shiryaev
651a45b04d
Add tests for initd start
2023-08-16 01:03:29 +02:00
Mikhail f. Shiryaev
3cd9fa395d
Add test for systemd + /etc/default/clickhouse
2023-08-16 00:51:44 +02:00
Mikhail f. Shiryaev
790475385a
Improve downloading: skip dbg, do not pull images on --no-download
2023-08-16 00:47:39 +02:00
Mikhail f. Shiryaev
387ce81895
Clean all containers properly
2023-08-16 00:46:53 +02:00
Nikita Mikhaylov
12ebfc9a7e
Merge pull request #53441 from ClickHouse/graceful-degradation-sending-logs-to-ci
...
Do not send logs to CI if the credentials are not set
2023-08-15 18:24:14 +02:00
Mikhail f. Shiryaev
33948a150f
Restart killed PublishedReleaseCI workflows
2023-08-15 11:50:11 +02:00
robot-clickhouse
a92fe25ff9
Automatic style fix
2023-08-15 07:15:58 +00:00
Alexey Milovidov
df02512ebf
Do not send logs to CI if the credentials are not set
2023-08-15 08:53:08 +02:00
Mikhail f. Shiryaev
56a8818cf2
Fix logic of Mergeable Check
2023-08-14 14:31:26 +02:00
Mikhail f. Shiryaev
900e38a676
Fail early on missed documentation for new features
2023-08-14 14:20:40 +02:00
Mikhail f. Shiryaev
310ac6feaf
Tune PRInfo.has_changes_in_documentation
2023-08-14 14:19:08 +02:00
Alexey Milovidov
748a65b2bb
Fix error
2023-08-13 06:35:32 +02:00
Alexey Milovidov
25fefbe144
Fix error
2023-08-13 06:32:48 +02:00
Alexey Milovidov
3ca59e9b19
Fix a typo
2023-08-13 06:25:55 +02:00
Alexey Milovidov
df6fe897c6
Better logs in CI
2023-08-13 06:17:45 +02:00
Alexey Milovidov
645834ffb6
Fix errors
2023-08-13 04:54:20 +02:00
Alexey Milovidov
fd3d0f7fa4
Merge branch 'master' into export-logs-in-ci-performance
2023-08-13 02:43:37 +02:00
Alexey Milovidov
077cd535e2
Improvements
2023-08-13 02:38:48 +02:00
Alexey Milovidov
b84132f4cd
Merge branch 'master' into export-logs-in-ci-fuzz
2023-08-13 02:17:30 +02:00
Alexey Milovidov
6fadb8e883
Merge pull request #53353 from ClickHouse/export-logs-in-ci-stress
...
Export logs from CI in stress tests
2023-08-13 03:07:46 +03:00
Alexey Milovidov
221dd53d37
Fixup
2023-08-13 00:36:50 +02:00
Alexey Milovidov
32778e0407
Export logs from CI in performance (part 3)
2023-08-13 00:34:01 +02:00
Alexey Milovidov
5df03dd12f
Better
2023-08-13 00:19:58 +02:00
Alexey Milovidov
d059465389
Merge pull request #52293 from ClickHouse/sqltest
...
Add SQLTest
2023-08-13 00:35:46 +03:00
robot-clickhouse
7d7ed06010
Automatic style fix
2023-08-12 20:53:33 +00:00
robot-clickhouse
e6e5a3858d
Automatic style fix
2023-08-12 20:43:29 +00:00
Alexey Milovidov
afbb91600e
Export logs from CI in fuzzer
2023-08-12 22:41:56 +02:00
Alexey Milovidov
176c16fcc5
Export logs from CI in stress tests
2023-08-12 22:30:18 +02:00
Alexey Milovidov
fc6fc234b2
Merge pull request #53086 from ClickHouse/export-logs-in-ci
...
Add a script to export logs in CI
2023-08-12 17:35:36 +03:00
Yakov Olkhovskiy
fa7994de3b
Merge pull request #53181 from ClickHouse/ci-build-s390x
...
Add Linux s390x build to CI
2023-08-12 09:16:07 -04:00
Alexey Milovidov
01e9f32fdf
Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci
2023-08-12 02:46:06 +02:00
Alexey Milovidov
3232993eeb
Merge pull request #53344 from ClickHouse/relax-mergeable-check
...
Relax mergeable check
2023-08-12 03:38:12 +03:00
Alexey Milovidov
1ae186b679
Merge branch 'export-logs-in-ci' of github.com:ClickHouse/ClickHouse into export-logs-in-ci
2023-08-12 02:11:48 +02:00
Alexey Milovidov
38c60430f4
Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci
2023-08-12 02:11:43 +02:00
Alexey Milovidov
62b3485cd8
Merge pull request #53283 from ClickHouse/fix-00906_low_cardinality_cache
...
Inhibit randomization in `00906_low_cardinality_cache`
2023-08-12 03:01:43 +03:00
Alexey Milovidov
aa815bfc74
Relax mergeable check
2023-08-12 01:54:11 +02:00
robot-clickhouse
2b852e55b6
Automatic style fix
2023-08-11 21:13:53 +00:00
Alexey Milovidov
af74bc9564
Merge branch 'export-logs-in-ci' of github.com:ClickHouse/ClickHouse into export-logs-in-ci
2023-08-11 22:57:23 +02:00
Alexey Milovidov
ddb7fb2ce9
Update tests/ci/functional_test_check.py
...
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2023-08-11 23:56:23 +03:00
Alexey Milovidov
9b7fcf17bc
Merge branch 'allow-creating-system-tables-at-startup' into export-logs-in-ci
2023-08-11 22:54:24 +02:00