Commit Graph

1155 Commits

Author SHA1 Message Date
Robert Schulze
5dcdf60f68
Merge pull request #41762 from ClickHouse/bump-llvm-to-13
Bump LLVM from 12 to 13
2022-09-29 19:37:46 +02:00
Mikhail f. Shiryaev
10f3df340e
Use cgroups v1 on ubuntu workers 2022-09-28 14:24:45 +02:00
Robert Schulze
a300ea6024
Try to fix binary compatibility check + extend check to library-bridge 2022-09-28 09:56:58 +00:00
Robert Schulze
a18bdf0004
Merge pull request #41775 from ClickHouse/adjust-universalsh
Point automatic download script to to ARMv8.0 compat build
2022-09-27 09:01:25 +02:00
Alexey Milovidov
3f3f93ae13
Merge pull request #41556 from ClickHouse/gh-runners
Update runners to a recent version to install on 22.04
2022-09-27 01:00:53 +03:00
Mikhail f. Shiryaev
51c9f81dce
Fix tests for docker-ci 2022-09-26 13:58:38 +02:00
Robert Schulze
c5224cd007
Point automatic download script to to ARMv8.0 compat build
- follow-up to #41610

- universal.sh downloads a the correct ClickHouse binary for the current
  platform

- For Linux/Aarch64, point to v8.0 compat build for maximum
  compatibility. Also add property static_binary_name (ci_config.py) so
  that the binary can be placed into the right location.

- Remove the unsupported combinations FreeBSD Aarch64 and PPC for which
  we provide no binaries.
2022-09-26 11:40:09 +00:00
Alexey Milovidov
62ebf397d2
Merge pull request #41610 from ClickHouse/upgrade-arm-requirement
Bump minimum required ARM ISA to v8.2 and add v8.0 compat build
2022-09-26 14:08:48 +03:00
Mikhail f. Shiryaev
a760c71a0b
Fix the typo preventing building latest images 2022-09-26 12:52:12 +02:00
Robert Schulze
bcaa66c804
Add arm-v80compat builds 2022-09-21 13:09:24 +00:00
Mikhail f. Shiryaev
2dff307770
Build latest tags ONLY from master branch 2022-09-20 14:31:04 +02:00
Mikhail f. Shiryaev
a852644de2
Update runners to a recent version to install on 22.04 2022-09-20 11:33:06 +02:00
Alexey Milovidov
ecfd8cb5a6 Remove trash error message from integration tests 2022-09-17 20:24:56 +02:00
Mikhail f. Shiryaev
c9d1b1d519
Merge pull request #41401 from ClickHouse/backported-label
Rename pr-backported label to avoid confusion
2022-09-16 11:48:49 +02:00
Robert Schulze
13a2bbaf5e
Merge branch 'master' into enable_constant_column_search 2022-09-16 11:09:45 +02:00
Mikhail f. Shiryaev
6a17d4e705
Delete redundant LABEL_ prefix 2022-09-16 10:23:49 +02:00
Mikhail f. Shiryaev
ab7bd95d8b
Rename pr-backported label to avoid confusion 2022-09-16 10:04:49 +02:00
Alexey Milovidov
da01982652
Merge pull request #41046 from azat/build/llvm-15
Switch to llvm/clang 15
2022-09-16 07:31:06 +03:00
Robert Schulze
cce4ed5496
Un-exclude constant_column_search from ARM perf tests
constant_column_search was excluced when ARM perf tests were set up
PR 37497. Back then we haven't had PR 41033 and regexp eval on ARM was
slow. Let's check again.
2022-09-15 10:48:47 +00:00
Mikhail f. Shiryaev
c2b02c2ae9
Download ccache from release PRs for backports 2022-09-14 18:24:55 +02:00
Azat Khuzhin
ced30a2072 Switch to llvm/clang 15
It had been released few hours ago, and I want to check how clang-15
generates DWARF-5

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Alexander Tokmakov
e77b9e4d0c
Merge pull request #40775 from azat/ci/core-dumps-rework
Rework core collecting on CI (eliminate gcore usage)
2022-09-09 20:20:10 +03:00
Mikhail f. Shiryaev
b815fdbc8c
Merge pull request #41088 from ClickHouse/darwin-releases
Add macos binaries to release assets
2022-09-09 17:17:15 +02:00
Robert Schulze
9d4de0cbaa
Merge pull request #40999 from ClickHouse/sse2-special-build
Add special x86-SSE2-only build
2022-09-08 09:06:29 +02:00
Mikhail f. Shiryaev
c0ce4c2d6f
Add macos binaries to GH release assets 2022-09-07 19:23:44 +02:00
Mikhail f. Shiryaev
a067907fbe
Add typing and order import 2022-09-07 19:23:43 +02:00
Mikhail f. Shiryaev
bd83e905d3
Fix a typo in download_build_with_progress 2022-09-07 19:23:43 +02:00
Mikhail f. Shiryaev
7cdd8c3304
Move download template to env_helper 2022-09-07 19:23:42 +02:00
Mikhail f. Shiryaev
257c4328f7
Rename get_build_urls to read_build_urls 2022-09-07 19:23:41 +02:00
Mikhail f. Shiryaev
f3cf1069dc
Fix header for autogenerated version 2022-09-07 19:23:41 +02:00
robot-clickhouse
01139d9d28 Automatic style fix 2022-09-07 08:51:02 +00:00
Robert Schulze
497b65f41d
CheckLabels: Print message that 'can be tested' is missing 2022-09-07 08:42:53 +00:00
Kseniia Sumarokova
68e013e819
Update ci_config.py 2022-09-05 22:13:07 +02:00
Robert Schulze
401747eaa7
Merge branch 'master' into sse2-special-build 2022-09-05 16:17:20 +02:00
Kseniia Sumarokova
360bc93c87
Turn off always green mode 2022-09-05 16:16:49 +02:00
Robert Schulze
e1def723f8
Add special x86-SSE2-only build 2022-09-05 12:51:44 +00:00
Alexey Milovidov
a819f2c75b
Merge branch 'master' into add-more-s3-tests 2022-09-05 05:23:17 +03:00
Azat Khuzhin
25e3bebd9d Rework core collecting on CI (eliminate gcore usage)
gcore is a gdb command, that internally uses gdb to dump the core.

However with proper configuration of limits (core_dump.size_limit) it
should not be required, althought some issues is possible:
- non standard kernel.core_pattern
- sanitizers

So yes, gcore is more "universal" (you don't need to configure any
`kernel_pattern`), but it is ad-hoc, and it has drawbacks -
**it does not work when gdb fails**. For example gdb may fail with
`Dwarf Error: DW_FORM_strx1 found in non-DWO CU` in case of DWARF-5 [1].

  [1]: https://github.com/ClickHouse/ClickHouse/pull/40772#issuecomment-1236331323.

Let's try to switch to more native way.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-04 22:07:16 +02:00
Alexey Milovidov
c4adc9ed8f Remove trash 2022-09-04 04:28:08 +02:00
Mikhail f. Shiryaev
9e4f5d5006
Merge pull request #40845 from ClickHouse/cherry-pick-assignees
Assign new cherry-pick and backport PRs
2022-09-01 18:32:46 +02:00
Mikhail f. Shiryaev
ca837e6755
Add a doc-string for ReleaseBranch._assign_new_pr 2022-09-01 13:06:14 +02:00
Mikhail f. Shiryaev
1da02adc8d
Assign PRs to an original merged_by too 2022-09-01 12:38:30 +02:00
Robert Schulze
d311482391
More renamings for consistency
AST Fuzzer (ASan)  --> AST Fuzzer (asan)
AST Fuzzer (TSan)  --> AST Fuzzer (tsan)
AST Fuzzer (MSan)  --> AST Fuzzer (msan)
AST Fuzzer (UBSan) --> AST Fuzzer (ubsan)
2022-09-01 07:59:01 +00:00
Robert Schulze
48164b039a
Consistent sanitizer naming in CI
Sanitizer build/test jobs were sometimes named with full form
('undefined') - which could be confusing - and sometimes named with
abbreviated form ('ubsan'). Now always using the short form.
2022-08-31 12:45:05 +00:00
Mikhail f. Shiryaev
187b10dec5
Assign to all at once, improve logging 2022-08-31 14:09:17 +02:00
Yakov Olkhovskiy
31a7ed09a1 disable default ENABLE_CLICKHOUSE_SELF_EXTRACTING and add to env 2022-08-27 21:08:01 +00:00
Alexey Milovidov
f86242c17e
Merge pull request #40699 from ClickHouse/remove-unbundled
Remove the remaining parts of "unbundled" build
2022-08-27 21:54:42 +03:00
Alexey Milovidov
91ed3ebe9a Remove the remaining parts of "unbundled" build 2022-08-27 02:18:47 +02:00
Vladimir C
cc74e3dd19
Fix performance_comparison_check.py 2022-08-26 15:49:40 +02:00
Vladimir C
f76325c439
Fix style in performance_comparison_check.py 2022-08-26 12:45:40 +02:00
vdimir
d82cab7f65
Fix env variable forwaring in performance_comparison_check.py 2022-08-26 09:21:42 +00:00
Azat Khuzhin
4de309718b tests/stress: use --privileged over --cap-add syslog to obtain dmesg
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-19 13:31:05 +02:00
Mikhail f. Shiryaev
e513ad6748
And the last tiny fix for assignees 2022-08-18 23:32:55 +02:00
Mikhail f. Shiryaev
b485afbe2c
Merge pull request #40367 from ClickHouse/cherry-pick-assignees
Fix wrong assignees argument passing
2022-08-18 23:28:31 +02:00
Mikhail f. Shiryaev
dce060bac4
Fix wrong assignees argument passing 2022-08-18 22:22:50 +02:00
Mikhail f. Shiryaev
13d95ebdef
Fix typo in the S3 download links for 2022-08-18 20:32:33 +02:00
robot-clickhouse
15bbb21a09 Automatic style fix 2022-08-16 13:10:28 +00:00
Yakov Olkhovskiy
dfbbc51045
add update_mergeable_check trigger 2022-08-16 09:02:03 -04:00
Yakov Olkhovskiy
b865787b3c
add Unit tests to Mergeable 2022-08-15 19:05:40 -04:00
Mikhail f. Shiryaev
9f3b2fafcc
Merge pull request #40177 from ClickHouse/cherry-pick-logging
Improve assignment and logging for cherry-pick and backport steps
2022-08-15 13:41:52 +02:00
Azat Khuzhin
923e2f22ef tests/stress: fix dmesg reading
After #39939 there is still an error:

    + dmesg -T
    dmesg: read kernel buffer failed: Operation not permitted

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/39939/a1981f21a153810f072af67bb6007dc1f4367c22/stress_test__debug_.html

Since it is not allowed to access dmesg by default,
one of the following is required:

- --cap-add syslog
- --cap-add cap_sys_admin
- --privileged

I decided to use as little capabilities as possible, even though it is
not that important on CI, but it is a rule of thumb.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-13 21:45:09 +02:00
Mikhail f. Shiryaev
22c53e7f7b
Merge pull request #40127 from ClickHouse/s3-helper
Rework S3Helper a little bit
2022-08-13 16:27:00 +02:00
Mikhail f. Shiryaev
7f61f30f15
Improve assignment and logging for cherry-pick and backport steps 2022-08-12 23:30:32 +02:00
Alexey Milovidov
8c3d1f2b5b
Merge branch 'master' into server-side-time 2022-08-12 17:40:02 +03:00
Mikhail f. Shiryaev
b46622cf3c
Don't use envs for static links 2022-08-12 09:46:36 +02:00
Mikhail f. Shiryaev
372481e770
Rework S3Helper a little bit 2022-08-11 15:01:32 +02:00
Mikhail f. Shiryaev
9f45532999
Use a job ID as ref text 2022-08-11 12:05:16 +02:00
Mikhail f. Shiryaev
ac371818f7
Fix _csv.Error: field larger than field limit (131072) 2022-08-10 20:21:49 +02:00
Mikhail f. Shiryaev
2fb68078e8
Replace S3 URLs by parameter 2022-08-10 15:22:04 +02:00
Mikhail f. Shiryaev
4b2bba2ff1
Do not upload unnecessary lambda sources 2022-08-10 14:37:06 +02:00
Mikhail f. Shiryaev
5f3c7524bc
Merge pull request #40032 from ClickHouse/job-url
Job url
2022-08-10 09:58:30 +02:00
Alexey Milovidov
f7d995681b
Merge branch 'master' into replace-yandex-to-noto 2022-08-09 22:43:52 +03:00
Mikhail f. Shiryaev
bcf430b382
Add job url to test reports 2022-08-09 19:12:47 +02:00
Mikhail f. Shiryaev
32efae4f1b
Add JOB_ID and JOB_URL getters 2022-08-09 18:34:12 +02:00
Mikhail f. Shiryaev
a34a9b581c
Merge pull request #39871 from ClickHouse/universal-lambdas
Get api url from event, not from const/ENV
2022-08-08 23:34:04 +02:00
Alexey Milovidov
0349d9da96 Change font in CI reports just in case (might be worse) 2022-08-08 07:25:29 +02:00
Yakov Olkhovskiy
40463e9c47 add Stateful tests (release), Stateless tests (release) to Mergeable Check 2022-08-08 00:20:09 -04:00
Alexey Milovidov
f08952b74c
Merge pull request #39735 from ClickHouse/ci-simple-check-refactoring
CI: refactor Simple Check, use statuses to make it stateful
2022-08-06 02:04:36 +03:00
Yakov Olkhovskiy
1a52fa183d rename Simple Check to Mergeable Check, refactor processing 2022-08-05 10:39:58 -04:00
alesapin
48e55ff4c7
Merge pull request #39795 from ClickHouse/cloudflare-dns-fallback
Add cloudflare DNS as a fallback
2022-08-05 12:14:45 +02:00
Mikhail f. Shiryaev
0d1c31a869
Merge branch 'master' into release-tweak-generate 2022-08-04 21:33:54 +02:00
Alexey Milovidov
f474eb957d
Merge pull request #39758 from ClickHouse/tsan_clang_15
Try clang-15 for build with tsan
2022-08-04 01:56:52 +03:00
Mikhail f. Shiryaev
8919fd6e58
Add handful notes to a post-release logging 2022-08-04 00:40:32 +02:00
Mikhail f. Shiryaev
ff26492830
Prevent spoiling rollback_stack 2022-08-04 00:24:43 +02:00
Mikhail f. Shiryaev
c6948c3e82
Use token for all requests 2022-08-03 19:17:41 +02:00
Mikhail f. Shiryaev
61fd28e19f
Get api url from event, not from const/ENV 2022-08-03 19:17:41 +02:00
Mikhail f. Shiryaev
62a05dc10d
Add instructions for github-cli installation 2022-08-03 13:40:31 +02:00
Mikhail f. Shiryaev
2ca9df9b22
Merge pull request #39421 from ClickHouse/github-helper
GitHub helper
2022-08-03 12:04:03 +02:00
Mikhail f. Shiryaev
08474cf869
Update tweak on version part update 2022-08-03 11:43:47 +02:00
Mikhail f. Shiryaev
469b7e7668
Add notes about _is_cache_updated logic 2022-08-02 18:44:49 +02:00
Mikhail f. Shiryaev
70d97e9393
Merge pull request #39630 from ClickHouse/workflow-rerun-lambda
Attempt to fix wrong workflow_run data for rerun
2022-08-02 18:29:43 +02:00
Mikhail f. Shiryaev
f150966f10
Merge pull request #39723 from ClickHouse/cherry-pick-fix
Fix cherry-pick for cases, when assignee is not set for PR
2022-08-02 13:13:47 +02:00
Mikhail f. Shiryaev
26ef951fde
Add DNS trick to the dockerhub proxy too 2022-08-02 12:04:26 +02:00
Alexander Tokmakov
82b50e79cf
Merge branch 'master' into tsan_clang_15 2022-08-02 13:00:55 +03:00
Alexey Milovidov
b275aae95d
Update init_runner.sh 2022-08-02 03:23:53 +03:00
Alexey Milovidov
488ae32295
Update init_runner.sh 2022-08-02 03:23:05 +03:00
Robert Schulze
b33fe26d8c
Merge pull request #39759 from ClickHouse/splitted-to-shared-renaming
Rename "splitted build" to "shared libraries build" in CI tools
2022-08-01 22:39:57 +02:00
Mikhail f. Shiryaev
afcf76e899
Add cloudflare DNS as a fallback 2022-08-01 18:27:17 +02:00
robot-clickhouse
af2f1b4cc3 Automatic style fix 2022-08-01 13:22:53 +00:00
Mikhail f. Shiryaev
33b26dda05
Improve logging
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2022-08-01 15:15:48 +02:00