Mikhail f. Shiryaev
cf8c904b61
Fix typing errors
2022-11-28 17:31:22 +01:00
Mikhail f. Shiryaev
7cddfbe9f9
Rename token lambda to reflect the meaning
2022-11-28 17:30:53 +01:00
Mikhail f. Shiryaev
fda2c4e78a
Merge pull request #43756 from ClickHouse/terminate-lost-runners
...
Terminate lost runners
2022-11-28 16:07:28 +01:00
Mikhail f. Shiryaev
272042108d
Terminate instances that lost connection to github
2022-11-28 16:05:55 +01:00
Alexander Tokmakov
a82fec83d8
Merge pull request #43623 from ClickHouse/move_perf_tests_aarch_to_master
...
Move perf tests for Aarch64 from PRs to master
2022-11-28 17:56:35 +03:00
Mikhail f. Shiryaev
28f9f588bc
A small improvement in naming and rounding pages number
2022-11-28 14:54:00 +01:00
Mikhail f. Shiryaev
88c338c090
Merge pull request #43579 from ClickHouse/universal-runners
...
Prepare CI for universal runners preallocated pool
2022-11-25 21:30:44 +01:00
Alexander Tokmakov
5bb0a7ac38
Update performance_comparison_check.py
2022-11-25 20:43:45 +03:00
Alexander Tokmakov
eec5449c1c
run perf tests on aarch64 for pr-performance
2022-11-25 17:55:10 +01:00
Mikhail f. Shiryaev
3ac0692a3d
Fix pagination issue in GITHUB_JOB_ID()
2022-11-25 17:28:13 +01:00
Mikhail f. Shiryaev
9584487a1e
Use docker images cache from merged PRs in master and release branches
2022-11-25 14:09:21 +01:00
Mikhail f. Shiryaev
1d9570a4cb
Display runner's labels on setup step
2022-11-24 16:05:16 +01:00
Mikhail f. Shiryaev
650a9dc2c2
Use zip file for ci-runners-metrics-lambda
2022-11-24 16:05:16 +01:00
Mikhail f. Shiryaev
ebe696af80
Handle universal runners in metrics lambda
2022-11-24 16:05:15 +01:00
Mikhail f. Shiryaev
ffd18d43a6
Use docker for lambda packages building
2022-11-24 16:05:15 +01:00
Mikhail f. Shiryaev
531811575e
Rename directory for zip deployment
2022-11-24 16:05:13 +01:00
Mikhail f. Shiryaev
7048f36fc7
Save unnecessary API requests
2022-11-22 13:37:08 +01:00
Mikhail f. Shiryaev
fb95ca43d8
Use all parameters with prefixes from ssm
2022-11-22 12:43:17 +01:00
alesapin
f4ef20b5e4
Merge pull request #43295 from ClickHouse/cancel-lambda-api-url
...
Cancel lambda api url
2022-11-21 12:03:37 +01:00
Mikhail f. Shiryaev
e9e355dd82
Process optionally base64-encoded bodies
2022-11-18 15:17:36 +01:00
Mikhail f. Shiryaev
b1fcdfcaad
Preserve the whole event for debugging
2022-11-18 14:26:19 +01:00
Mikhail f. Shiryaev
3727f21ac2
Merge pull request #43019 from ClickHouse/release-only-on-marked-commits
...
Allow release only from ready commits
2022-11-17 20:51:57 +01:00
Mikhail f. Shiryaev
6d532d310d
Migrate cancel-lambda to python package
2022-11-17 15:55:48 +01:00
Mikhail f. Shiryaev
1fe095ae90
Explicitly return OK for python lambdas
2022-11-17 15:55:25 +01:00
Mikhail f. Shiryaev
2e5e9a8729
Get rid of API_URL environment
2022-11-17 13:31:41 +01:00
Mikhail f. Shiryaev
cb069d8bfa
Use authorized requests for GET
2022-11-16 15:50:26 +01:00
Mikhail f. Shiryaev
589648c444
Event data for 'labeled' has an added label data
2022-11-16 15:47:32 +01:00
Mikhail f. Shiryaev
eea23df48a
Merge pull request #43121 from ClickHouse/commit-status-improvement
...
Improve commit_status_helper.py
2022-11-14 14:48:27 +01:00
Yatsishin Ilya
dee865ce78
Fix trailing \n from SQLancer status
2022-11-11 13:48:55 +01:00
Mikhail f. Shiryaev
eec74e46e4
Move get_commit_filtered_statuses to commit_status_helper
2022-11-10 13:12:22 +01:00
Mikhail f. Shiryaev
e2de809532
Add typing to commit_status_helper.py
2022-11-10 13:12:20 +01:00
Mikhail f. Shiryaev
c12c1cdf9b
Allow release only from ready commits
2022-11-10 12:42:33 +01:00
Antonio Andelic
e512d7f036
Merge pull request #42619 from ClickHouse/jepen-multiple-tests
...
Extend Jepsen tests with support for server
2022-11-10 09:01:40 +01:00
Alexander Tokmakov
af78f4b66a
Merge branch 'master' into tavplubix-patch-5
2022-11-09 16:20:24 +03:00
Alexander Tokmakov
9edb4d779b
fix
2022-11-09 12:18:29 +01:00
Mikhail f. Shiryaev
7549b22317
Add a script to mark commit as ready for release
2022-11-08 12:21:14 +01:00
Mikhail f. Shiryaev
ff083e1b55
Forbit launching release.py from branches but master
2022-11-08 12:21:12 +01:00
Antonio Andelic
900894e251
Fix style
2022-11-07 14:03:11 +00:00
robot-clickhouse
70ce952363
Automatic style fix
2022-11-07 13:49:21 +00:00
Antonio Andelic
af09ef5351
Enable release build
2022-11-07 11:48:48 +00:00
Antonio Andelic
8e1a4bcf9a
Update CI config
2022-11-07 09:42:00 +00:00
Antonio Andelic
e751557599
Merge branch 'master' into jepen-multiple-tests
2022-11-07 08:13:49 +00:00
Mikhail f. Shiryaev
1642b2f4bd
Fix old bug to remove refs/heads from default ref
2022-11-05 14:51:26 +01:00
Antonio Andelic
51ee6ec436
Use autoscaling for keeper
2022-11-04 14:12:30 +00:00
Antonio Andelic
fee53a415a
Reuse same PR
2022-11-04 13:49:12 +00:00
Antonio Andelic
98d3b4a835
Support Jepsen for server in CI
2022-11-04 13:40:13 +00:00
Ilya Yatsishin
2e7013f439
Merge pull request #42397 from qoega/revive-sqlancer
...
Revive SQLancer
2022-11-04 14:28:21 +01:00
Mikhail f. Shiryaev
0e27039ec4
Merge pull request #42934 from ClickHouse/lambdas-cryptography
...
Pin the cryptography version to not break lambdas
2022-11-04 10:09:43 +01:00
Mikhail f. Shiryaev
43dd55798d
Pin the cryptography version to not break lambdas
2022-11-03 16:37:58 +01:00
Vladimir C
acf9a62f2e
Merge pull request #42932 from ClickHouse/vdimir/pr-bufix-check
2022-11-03 14:17:58 +01:00
vdimir
5f184359a1
Do not show status for Bugfix validate check in non bugfix PRs
2022-11-03 12:44:07 +00:00
Mikhail f. Shiryaev
3f424de022
Adjust cancel and rerun workflow names to the actual
2022-11-01 14:26:06 +01:00
vdimir
2060c2d9ac
Fix style
2022-11-01 11:20:10 +01:00
vdimir
e83d61749a
update test bugfix report
2022-11-01 11:20:10 +01:00
vdimir
63b63da214
Update bugfix_validate_check.py
2022-11-01 11:20:10 +01:00
vdimir
1b32c7d212
Update bugfix_validate_check.py
2022-11-01 11:20:10 +01:00
vdimir
c18838715d
Post status for test bugfix check
2022-11-01 11:20:10 +01:00
vdimir
9f5dcd14af
Request labels from gh api for validate bugfix check
2022-11-01 11:20:10 +01:00
vdimir
e0735e1e67
Debug TestBugfixCheck
2022-11-01 11:20:10 +01:00
Ilya Yatsishin
7c345f6094
Merge branch 'master' into revive-sqlancer
2022-10-31 17:19:27 +01:00
Yatsishin Ilya
10873dfc9f
succeess
2022-10-28 11:28:20 +00:00
Yatsishin Ilya
aa75515219
fix
2022-10-28 09:47:16 +00:00
Ilya Yatsishin
cd2f9f6e3e
Merge pull request #42678 from qoega/fix-exception-handling-clickhouse-helper
...
Fix error handling in clickhouse_helper.py
2022-10-28 08:55:56 +02:00
Yatsishin Ilya
a4626c64af
fix
2022-10-27 17:56:08 +00:00
Yatsishin Ilya
d8e8dd006f
support server fail
2022-10-27 09:06:11 +00:00
Yatsishin Ilya
ccc515bebd
Merge remote-tracking branch 'origin/master' into revive-sqlancer
2022-10-27 07:13:28 +00:00
Yatsishin Ilya
9dee90cd42
fix path
2022-10-26 15:06:01 +00:00
Yatsishin Ilya
fa402d8967
fix
2022-10-26 12:01:12 +00:00
Yatsishin Ilya
acfea0e2df
style
2022-10-26 11:21:33 +00:00
Mikhail f. Shiryaev
a8f3b39dcc
Fix execution of version_helper.py to use git tweaks
2022-10-26 12:07:42 +02:00
Ilya Yatsishin
7973b4e5e5
Fix error handling
2022-10-26 11:09:01 +02:00
Yatsishin Ilya
b096edc995
do not upload files manually
2022-10-26 08:30:20 +00:00
Yatsishin Ilya
302df3af12
fix?
2022-10-25 16:34:12 +00:00
Yatsishin Ilya
c89c14a05d
add NoREC
2022-10-25 10:34:55 +00:00
Yatsishin Ilya
db2f3baf39
fix
2022-10-21 19:43:06 +00:00
Yatsishin Ilya
6f8f7150ff
style
2022-10-21 16:42:45 +00:00
Yatsishin Ilya
13f506f7b1
minor
2022-10-21 11:48:58 +00:00
Yatsishin Ilya
548ff1d2aa
fix
2022-10-20 12:33:56 +00:00
Yatsishin Ilya
105ca72955
fix
2022-10-20 10:51:47 +00:00
Ilya Yatsishin
b768925256
Update tests/ci/sqlancer_check.py
2022-10-20 00:09:09 +02:00
Ilya Yatsishin
8ef8def9ab
Update tests/ci/sqlancer_check.py
2022-10-19 21:00:05 +02:00
Yatsishin Ilya
7d90d54af8
better reporting
2022-10-19 17:02:49 +00:00
Yatsishin Ilya
757959d087
fix bug
2022-10-18 15:14:42 +00:00
Yatsishin Ilya
8b3dc2d551
typo
2022-10-18 07:52:11 +00:00
Yatsishin Ilya
aa432fe95a
staging
2022-10-17 15:20:20 +00:00
Yatsishin Ilya
6a82d54314
add CI files
2022-10-17 14:46:50 +00:00
Mikhail f. Shiryaev
54347c890f
Add at to runner AMI, bump gh runner version
2022-10-05 11:47:30 +02:00
Mikhail f. Shiryaev
45cde6545d
Add a warning message to release.py script, require release type
2022-09-30 16:22:25 +02:00
Robert Schulze
5dcdf60f68
Merge pull request #41762 from ClickHouse/bump-llvm-to-13
...
Bump LLVM from 12 to 13
2022-09-29 19:37:46 +02:00
Mikhail f. Shiryaev
10f3df340e
Use cgroups v1 on ubuntu workers
2022-09-28 14:24:45 +02:00
Robert Schulze
a300ea6024
Try to fix binary compatibility check + extend check to library-bridge
2022-09-28 09:56:58 +00:00
Robert Schulze
a18bdf0004
Merge pull request #41775 from ClickHouse/adjust-universalsh
...
Point automatic download script to to ARMv8.0 compat build
2022-09-27 09:01:25 +02:00
Alexey Milovidov
3f3f93ae13
Merge pull request #41556 from ClickHouse/gh-runners
...
Update runners to a recent version to install on 22.04
2022-09-27 01:00:53 +03:00
Mikhail f. Shiryaev
51c9f81dce
Fix tests for docker-ci
2022-09-26 13:58:38 +02:00
Robert Schulze
c5224cd007
Point automatic download script to to ARMv8.0 compat build
...
- follow-up to #41610
- universal.sh downloads a the correct ClickHouse binary for the current
platform
- For Linux/Aarch64, point to v8.0 compat build for maximum
compatibility. Also add property static_binary_name (ci_config.py) so
that the binary can be placed into the right location.
- Remove the unsupported combinations FreeBSD Aarch64 and PPC for which
we provide no binaries.
2022-09-26 11:40:09 +00:00
Alexey Milovidov
62ebf397d2
Merge pull request #41610 from ClickHouse/upgrade-arm-requirement
...
Bump minimum required ARM ISA to v8.2 and add v8.0 compat build
2022-09-26 14:08:48 +03:00
Mikhail f. Shiryaev
a760c71a0b
Fix the typo preventing building latest images
2022-09-26 12:52:12 +02:00
Robert Schulze
bcaa66c804
Add arm-v80compat builds
2022-09-21 13:09:24 +00:00
Mikhail f. Shiryaev
2dff307770
Build latest tags ONLY from master branch
2022-09-20 14:31:04 +02:00
Mikhail f. Shiryaev
a852644de2
Update runners to a recent version to install on 22.04
2022-09-20 11:33:06 +02:00
Alexey Milovidov
ecfd8cb5a6
Remove trash error message from integration tests
2022-09-17 20:24:56 +02:00
Mikhail f. Shiryaev
c9d1b1d519
Merge pull request #41401 from ClickHouse/backported-label
...
Rename pr-backported label to avoid confusion
2022-09-16 11:48:49 +02:00
Robert Schulze
13a2bbaf5e
Merge branch 'master' into enable_constant_column_search
2022-09-16 11:09:45 +02:00
Mikhail f. Shiryaev
6a17d4e705
Delete redundant LABEL_ prefix
2022-09-16 10:23:49 +02:00
Mikhail f. Shiryaev
ab7bd95d8b
Rename pr-backported label to avoid confusion
2022-09-16 10:04:49 +02:00
Alexey Milovidov
da01982652
Merge pull request #41046 from azat/build/llvm-15
...
Switch to llvm/clang 15
2022-09-16 07:31:06 +03:00
Robert Schulze
cce4ed5496
Un-exclude constant_column_search from ARM perf tests
...
constant_column_search was excluced when ARM perf tests were set up
PR 37497. Back then we haven't had PR 41033 and regexp eval on ARM was
slow. Let's check again.
2022-09-15 10:48:47 +00:00
Mikhail f. Shiryaev
c2b02c2ae9
Download ccache from release PRs for backports
2022-09-14 18:24:55 +02:00
Azat Khuzhin
ced30a2072
Switch to llvm/clang 15
...
It had been released few hours ago, and I want to check how clang-15
generates DWARF-5
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Alexander Tokmakov
e77b9e4d0c
Merge pull request #40775 from azat/ci/core-dumps-rework
...
Rework core collecting on CI (eliminate gcore usage)
2022-09-09 20:20:10 +03:00
Mikhail f. Shiryaev
b815fdbc8c
Merge pull request #41088 from ClickHouse/darwin-releases
...
Add macos binaries to release assets
2022-09-09 17:17:15 +02:00
Robert Schulze
9d4de0cbaa
Merge pull request #40999 from ClickHouse/sse2-special-build
...
Add special x86-SSE2-only build
2022-09-08 09:06:29 +02:00
Mikhail f. Shiryaev
c0ce4c2d6f
Add macos binaries to GH release assets
2022-09-07 19:23:44 +02:00
Mikhail f. Shiryaev
a067907fbe
Add typing and order import
2022-09-07 19:23:43 +02:00
Mikhail f. Shiryaev
bd83e905d3
Fix a typo in download_build_with_progress
2022-09-07 19:23:43 +02:00
Mikhail f. Shiryaev
7cdd8c3304
Move download template to env_helper
2022-09-07 19:23:42 +02:00
Mikhail f. Shiryaev
257c4328f7
Rename get_build_urls to read_build_urls
2022-09-07 19:23:41 +02:00
Mikhail f. Shiryaev
f3cf1069dc
Fix header for autogenerated version
2022-09-07 19:23:41 +02:00
robot-clickhouse
01139d9d28
Automatic style fix
2022-09-07 08:51:02 +00:00
Robert Schulze
497b65f41d
CheckLabels: Print message that 'can be tested' is missing
2022-09-07 08:42:53 +00:00
Kseniia Sumarokova
68e013e819
Update ci_config.py
2022-09-05 22:13:07 +02:00
Robert Schulze
401747eaa7
Merge branch 'master' into sse2-special-build
2022-09-05 16:17:20 +02:00
Kseniia Sumarokova
360bc93c87
Turn off always green mode
2022-09-05 16:16:49 +02:00
Robert Schulze
e1def723f8
Add special x86-SSE2-only build
2022-09-05 12:51:44 +00:00
Alexey Milovidov
a819f2c75b
Merge branch 'master' into add-more-s3-tests
2022-09-05 05:23:17 +03:00
Azat Khuzhin
25e3bebd9d
Rework core collecting on CI (eliminate gcore usage)
...
gcore is a gdb command, that internally uses gdb to dump the core.
However with proper configuration of limits (core_dump.size_limit) it
should not be required, althought some issues is possible:
- non standard kernel.core_pattern
- sanitizers
So yes, gcore is more "universal" (you don't need to configure any
`kernel_pattern`), but it is ad-hoc, and it has drawbacks -
**it does not work when gdb fails**. For example gdb may fail with
`Dwarf Error: DW_FORM_strx1 found in non-DWO CU` in case of DWARF-5 [1].
[1]: https://github.com/ClickHouse/ClickHouse/pull/40772#issuecomment-1236331323 .
Let's try to switch to more native way.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-04 22:07:16 +02:00
Alexey Milovidov
c4adc9ed8f
Remove trash
2022-09-04 04:28:08 +02:00
Mikhail f. Shiryaev
9e4f5d5006
Merge pull request #40845 from ClickHouse/cherry-pick-assignees
...
Assign new cherry-pick and backport PRs
2022-09-01 18:32:46 +02:00
Mikhail f. Shiryaev
ca837e6755
Add a doc-string for ReleaseBranch._assign_new_pr
2022-09-01 13:06:14 +02:00
Mikhail f. Shiryaev
1da02adc8d
Assign PRs to an original merged_by too
2022-09-01 12:38:30 +02:00
Robert Schulze
d311482391
More renamings for consistency
...
AST Fuzzer (ASan) --> AST Fuzzer (asan)
AST Fuzzer (TSan) --> AST Fuzzer (tsan)
AST Fuzzer (MSan) --> AST Fuzzer (msan)
AST Fuzzer (UBSan) --> AST Fuzzer (ubsan)
2022-09-01 07:59:01 +00:00
Robert Schulze
48164b039a
Consistent sanitizer naming in CI
...
Sanitizer build/test jobs were sometimes named with full form
('undefined') - which could be confusing - and sometimes named with
abbreviated form ('ubsan'). Now always using the short form.
2022-08-31 12:45:05 +00:00
Mikhail f. Shiryaev
187b10dec5
Assign to all at once, improve logging
2022-08-31 14:09:17 +02:00
Yakov Olkhovskiy
31a7ed09a1
disable default ENABLE_CLICKHOUSE_SELF_EXTRACTING and add to env
2022-08-27 21:08:01 +00:00
Alexey Milovidov
f86242c17e
Merge pull request #40699 from ClickHouse/remove-unbundled
...
Remove the remaining parts of "unbundled" build
2022-08-27 21:54:42 +03:00
Alexey Milovidov
91ed3ebe9a
Remove the remaining parts of "unbundled" build
2022-08-27 02:18:47 +02:00
Vladimir C
cc74e3dd19
Fix performance_comparison_check.py
2022-08-26 15:49:40 +02:00
Vladimir C
f76325c439
Fix style in performance_comparison_check.py
2022-08-26 12:45:40 +02:00
vdimir
d82cab7f65
Fix env variable forwaring in performance_comparison_check.py
2022-08-26 09:21:42 +00:00
Azat Khuzhin
4de309718b
tests/stress: use --privileged over --cap-add syslog to obtain dmesg
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-19 13:31:05 +02:00
Mikhail f. Shiryaev
e513ad6748
And the last tiny fix for assignees
2022-08-18 23:32:55 +02:00
Mikhail f. Shiryaev
b485afbe2c
Merge pull request #40367 from ClickHouse/cherry-pick-assignees
...
Fix wrong assignees argument passing
2022-08-18 23:28:31 +02:00
Mikhail f. Shiryaev
dce060bac4
Fix wrong assignees argument passing
2022-08-18 22:22:50 +02:00
Mikhail f. Shiryaev
13d95ebdef
Fix typo in the S3 download links for
2022-08-18 20:32:33 +02:00
robot-clickhouse
15bbb21a09
Automatic style fix
2022-08-16 13:10:28 +00:00
Yakov Olkhovskiy
dfbbc51045
add update_mergeable_check trigger
2022-08-16 09:02:03 -04:00
Yakov Olkhovskiy
b865787b3c
add Unit tests to Mergeable
2022-08-15 19:05:40 -04:00
Mikhail f. Shiryaev
9f3b2fafcc
Merge pull request #40177 from ClickHouse/cherry-pick-logging
...
Improve assignment and logging for cherry-pick and backport steps
2022-08-15 13:41:52 +02:00
Azat Khuzhin
923e2f22ef
tests/stress: fix dmesg reading
...
After #39939 there is still an error:
+ dmesg -T
dmesg: read kernel buffer failed: Operation not permitted
[1]: https://s3.amazonaws.com/clickhouse-test-reports/39939/a1981f21a153810f072af67bb6007dc1f4367c22/stress_test__debug_.html
Since it is not allowed to access dmesg by default,
one of the following is required:
- --cap-add syslog
- --cap-add cap_sys_admin
- --privileged
I decided to use as little capabilities as possible, even though it is
not that important on CI, but it is a rule of thumb.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-13 21:45:09 +02:00
Mikhail f. Shiryaev
22c53e7f7b
Merge pull request #40127 from ClickHouse/s3-helper
...
Rework S3Helper a little bit
2022-08-13 16:27:00 +02:00
