Mikhail f. Shiryaev
fcc14ae724
Enable s3 caching
2023-03-29 23:33:27 +02:00
Mikhail f. Shiryaev
6d8da8f88b
Add sccache and ctcache S3 parameters, don't use
2023-03-29 23:33:27 +02:00
Mikhail f. Shiryaev
df17a35410
Get rid of useless cache_maxsize parameter
2023-03-29 23:33:26 +02:00
Mikhail f. Shiryaev
2d872ff23b
Add a function to parse arguments
2023-03-29 23:33:26 +02:00
Mikhail f. Shiryaev
419f234294
Fix logic for --force-build-image
2023-03-29 23:33:25 +02:00
Mikhail f. Shiryaev
3b1291eb0e
Replace distcc with sccache in packager
2023-03-29 23:33:25 +02:00
Mikhail f. Shiryaev
612d1d8876
Install sccache in binary-builder and fasttests
2023-03-29 23:33:24 +02:00
Mikhail f. Shiryaev
c994c41e74
Fix logging formatting
2023-03-29 23:33:23 +02:00
Mikhail f. Shiryaev
648697f085
Add main function, use specific exception in packager
2023-03-29 23:33:23 +02:00
Mikhail f. Shiryaev
cd5852f11a
Add typing and rewrite packager to pathlib.Path
2023-03-29 23:33:21 +02:00
Alexey Milovidov
89a76c2d77
Use LLVM 16
2023-03-18 23:45:57 +01:00
Alexey Milovidov
d0d6306102
Fix coverity
2023-02-21 00:46:27 +01:00
Mikhail f. Shiryaev
08ffb8f93d
Install only "programs" directory during build
2023-02-15 11:49:19 +01:00
Mikhail f. Shiryaev
6a968bad8e
Reduce building and compiling deb packages with ninja *install
2023-02-14 14:57:00 +01:00
Mikhail f. Shiryaev
4d8ff0c0fb
Update the golang version to 1.19.5
2023-02-13 13:19:45 +01:00
Mikhail f. Shiryaev
ebb41504c0
Move copy to the end for parallel image building
2023-02-12 14:55:16 +01:00
Mikhail f. Shiryaev
376b5d178f
Experiment with multiple build stages
2023-02-09 19:13:44 +01:00
Mikhail f. Shiryaev
1ef1eefa26
Format the RUN, update clang-tidy-cache
2023-02-09 19:10:48 +01:00
Mikhail f. Shiryaev
5bc3e703ef
Move the heaviest operation to the top
2023-02-09 19:10:06 +01:00
MeenaRenganathan22
4a0202a074
Committing the docker with the changes to install the ysam
2023-01-24 20:41:43 -05:00
Alexey Milovidov
e9f11a3e61
Fix Docker
2023-01-08 22:45:30 +01:00
Alexey Milovidov
4694dad87c
Break CI
2023-01-08 07:59:31 +01:00
Robert Schulze
cfb6feffde
What happens if I remove these 139 lines of code?
2023-01-03 18:35:31 +00:00
Alexey Milovidov
d07f0c9e3f
Fix GitHub
2023-01-02 23:44:42 +01:00
Alexey Milovidov
ca117d5b94
Merge branch 'master' into remove-two-lines-of-code
2023-01-02 22:15:36 +03:00
Azat Khuzhin
d9fb47458f
Exclude cargo shared libraries from the artifacts
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-02 12:36:14 +01:00
Alexey Milovidov
47ae8c5c79
Remove more lines
2023-01-02 02:06:11 +01:00
Alexey Milovidov
f7f5aaf35d
What if I will remove two lines of code?
2023-01-02 01:20:34 +01:00
Robert Schulze
2b9a0824fe
Cosmetics: Rename "amd64-sse2" builds to "amd64-compat" builds
...
... a bit of consistency with "aarch64-v80compat"
2022-12-19 19:00:21 +00:00
Azat Khuzhin
28737a503c
Configure rustc compiler properly
...
Right now it works for host platforms because of gcc package, that
includes gcc-cross sysroot.
Use bundled sysroot from contrib instead.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-12-14 20:57:29 +01:00
Azat Khuzhin
67fa185611
Revert "Builtin skim"
2022-12-14 17:17:19 +03:00
Azat Khuzhin
8570f15688
Configure rustc compiler properly
...
Right now it works for host platforms because of gcc package, that
includes gcc-cross sysroot.
Use bundled sysroot from contrib instead.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-12-11 15:52:00 +01:00
Mikhail f. Shiryaev
a68dc6280d
Optimize binary-builder size
2022-11-25 12:17:51 +01:00
Mikhail f. Shiryaev
150ceb7d37
Use matus-chochlik/ctcache for clang-tidy
2022-11-03 11:53:11 +01:00
Azat Khuzhin
043c4163f4
Use nfpm packager for archlinux packages
...
Since nfpm v2.20.0 it can build packages for archlinux [1].
[1]: https://github.com/goreleaser/nfpm/pull/543
Something like this:
$ mkdir -p /src/packages/root
$ cmake -DCMAKE_INSTALL_PREFIX=/usr /src
$ DESTDIR=/src/packages/root ninja install
$ cd /src/packages
$ ./build --archlinux
$ root@s3:/src/packages# ./build --archlinux
Current version is 22.10.1.1
Building archlinux package for clickhouse-client.yaml
using archlinux packager...
created package: /src/clickhouse-client-22.10.1.1-1-x86_64.pkg.tar.zst
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-18 18:33:48 +03:00
Azat Khuzhin
fb6474c35b
Add a comment about MAKE_* env vars
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-18 18:33:48 +03:00
BoloniniD
3a3ca51980
Fixes after review
2022-10-02 20:52:05 +03:00
BoloniniD
55c79230b3
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-09-29 23:53:25 +03:00
Robert Schulze
bcaa66c804
Add arm-v80compat builds
2022-09-21 13:09:24 +00:00
BoloniniD
4f2915c8f7
Fix aarch64-darwin build
2022-09-19 21:52:57 +03:00
Mikhail f. Shiryaev
5d8b8a7db6
Add deb Source for packages
2022-09-19 20:42:02 +02:00
BoloniniD
2f771daa8c
Fix Rust installation for Corrosion
2022-09-18 15:22:16 +03:00
BoloniniD
627dea333e
Merge branch 'master' into BLAKE3
2022-09-17 22:14:30 +03:00
BoloniniD
452ef4435b
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-09-16 20:05:56 +03:00
BoloniniD
0df426d329
Corrosion fixes + review fixes
2022-09-16 00:05:21 +03:00
BoloniniD
fe239e7ee9
Fix style + free err_msg before throwing exception
2022-09-12 18:46:54 +03:00
Azat Khuzhin
ced30a2072
Switch to llvm/clang 15
...
It had been released few hours ago, and I want to check how clang-15
generates DWARF-5
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
BoloniniD
e8bcbcd016
Merge branch 'master' into BLAKE3
2022-09-09 11:48:31 +03:00
Robert Schulze
652f1bfd19
fix: pass -DNO_SSE3_OR_HIGHER=1 from packager
2022-09-06 12:18:11 +00:00
Robert Schulze
1ebcc3a14e
fix: endswidth --> endswith
2022-09-06 07:41:37 +00:00
Robert Schulze
438ed368a1
fix: correct compiler parsing
2022-09-05 17:49:40 +00:00
Robert Schulze
401747eaa7
Merge branch 'master' into sse2-special-build
2022-09-05 16:17:20 +02:00
Robert Schulze
e1def723f8
Add special x86-SSE2-only build
2022-09-05 12:51:44 +00:00
Azat Khuzhin
64f95710cd
ci: add symlink for llvm-symbolizer (to make symbolizer work)
...
Simply installing llvm-symbolizer-$VER is not enough, since it does not
contain proper symblink, while LLVM is looking only for
"llvm-symbolizer" (without version) - [1]:
[1]:
c444af1c20/compiler-rt/lib/sanitizer_common/sanitizer_symbolizer_posix_libcdep.cpp (L454)
Follow-up for: #40655
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-04 14:03:34 +02:00
Azat Khuzhin
ce88c7cb60
Add llvm-15 for llvm-symbolizer-15 for clang-15 (used for TSan)
...
Simply installing llvm-15 over TSAN_SYMBOLIZER_PATH had been prefered
(to keep everything in one place and as simple as possible), though
TSAN_SYMBOLIZER_PATH should also work.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-26 09:28:42 +02:00
Alexey Milovidov
cb2e5f316c
Revert "Maybe make it possible"
...
This reverts commit a517d9d65f
.
2022-08-21 20:52:04 +02:00
Alexey Milovidov
dd9085346a
Revert "Fix error"
...
This reverts commit e702adf0c9
.
2022-08-21 20:52:03 +02:00
Alexey Milovidov
c08766aa34
Revert "Do not put garbage in the Docker image"
...
This reverts commit 2b82916175
.
2022-08-21 20:51:59 +02:00
Alexey Milovidov
2b82916175
Do not put garbage in the Docker image
2022-08-17 09:13:04 +02:00
Alexey Milovidov
e702adf0c9
Fix error
2022-08-15 06:23:00 +02:00
Alexey Milovidov
a517d9d65f
Maybe make it possible
2022-08-15 04:23:56 +02:00
Alexey Milovidov
1021b756ac
Fix conflict
2022-08-14 06:12:38 +02:00
Alexey Milovidov
5ebba1af33
Merge branch 'riscv64-linker' into riscv-in-ci
2022-08-14 06:10:22 +02:00
Alexey Milovidov
2de309c34f
Add Linux RISC-V 64 build to CI
2022-08-14 06:07:31 +02:00
Alexey Milovidov
5ce6c07005
Set linker for RISC-V 64
2022-08-14 05:57:55 +02:00
Yakov Olkhovskiy
78cc2a970d
copy self-extracting to output
2022-08-09 02:40:17 -04:00
Alexander Tokmakov
3bc583c22b
Revert "copy self-extracting to output"
2022-08-08 20:13:40 +03:00
BoloniniD
24f3b00193
Merge branch 'master' into BLAKE3
2022-08-06 19:48:10 +03:00
Yakov Olkhovskiy
4c78f0fc7d
Merge branch 'master' into ci-self-extracting-s3-deployment
2022-08-05 08:14:48 -04:00
BoloniniD
48c91619b0
Merge branch 'master' into BLAKE3
2022-08-04 20:30:47 +03:00
Ilya Yatsishin
cecdc313d8
Merge branch 'master' into integration-tests-7
2022-08-04 11:37:16 +02:00
Alexey Milovidov
f474eb957d
Merge pull request #39758 from ClickHouse/tsan_clang_15
...
Try clang-15 for build with tsan
2022-08-04 01:56:52 +03:00
Mikhail f. Shiryaev
8533769132
Use compression and cleanup with the recent version ccache
2022-08-03 14:49:07 +02:00
Mikhail f. Shiryaev
eeaf08525f
Use test-util as source for base-test, fasttest and package builder
2022-08-03 14:49:06 +02:00
BoloniniD
b161773f71
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-08-02 20:25:25 +03:00
Alexander Tokmakov
e292d830f5
Update Dockerfile
2022-08-02 15:37:02 +03:00
Alexander Tokmakov
82b50e79cf
Merge branch 'master' into tsan_clang_15
2022-08-02 13:00:55 +03:00
Robert Schulze
e832153e93
Typos
2022-08-02 08:37:58 +00:00
Alexander Tokmakov
31550436e4
try clang-15 for build with tsan
2022-07-31 14:38:13 +02:00
Robert Schulze
729d19fa4f
Rename "splitted build" to "shared libraries build" in CI tools
...
- The old name made sense for (dev option) "-DUSE_STATIC_LIBRARIES=0
-DSPLIT_SHARED_LIBRARIES=1 -DSPLIT_BINARY=1" but that was removed with
#39520 .
- What still exists is "-DUSE_STATIC_LIBRARIES=0
-DSPLIT_SHARED_LIBRARIES=1" which does a shared library build
2022-07-31 12:26:51 +00:00
Robert Schulze
52d08d9db4
Merge pull request #39520 from ClickHouse/no-split-binary
...
Remove SPLIT_BINARY
2022-07-31 14:23:31 +02:00
Alexey Milovidov
36e6500e54
Merge branch 'master' into BLAKE3
2022-07-30 23:14:05 +03:00
Mikhail f. Shiryaev
e91fb2ee5c
Merge pull request #39652 from ClickHouse/clang-tidy-ccache
...
Increase ccache max size for clang tidy builds
2022-07-29 20:09:52 +02:00
Robert Schulze
3d1797f75f
Merge remote-tracking branch 'origin/master' into no-split-binary
2022-07-29 12:17:43 +00:00
Azat Khuzhin
4b0594633b
Build utils on CI when they was requested
...
clickhouse-bundle does not includes utils, and to avoid modifying each
utility it is better to build all, anyway this is not a common build.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-29 11:36:51 +03:00
Azat Khuzhin
2901ddc217
Remove --verbose=1 for cmake on configuration stage
...
--verbose is supported only for make/install, while 3.16 is OK (ubuntu
20.04), newer cmake (3.23) does not, and simply fails:
# cmake --debug-trycompile --verbose=1 /foo
debug trycompile on
CMake Error: Unknown argument --verbose=1
CMake Error: Run 'cmake --help' for all supported options.
And this is how it works with 3.16:
# cmake --debug-trycompile --verbose=1 /foo
debug trycompile on
CMake Error: The source directory "/foo" does not exist.
Specify --help for usage, or press the help button on the CMake GUI.
Anyway this script sets CMAKE_VERBOSE_MAKEFILE, and this is what
--verbose does.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-29 11:36:51 +03:00
Robert Schulze
199e254777
Merge remote-tracking branch 'origin/master' into no-split-binary
2022-07-28 15:54:22 +00:00
Mikhail f. Shiryaev
c6fd8364a4
Increase ccache max size for clang tidy builds
2022-07-28 15:11:45 +02:00
Yakov Olkhovskiy
ea17492f5f
Merge branch 'master' into ci-self-extracting-s3-deployment
2022-07-27 21:15:36 -04:00
Yakov Olkhovskiy
f91a0935cd
check existence of compressed clickhouse
2022-07-27 09:00:05 -04:00
Yakov Olkhovskiy
0720936c2d
rewrite original clickhouse with compressed one
2022-07-26 09:16:31 -04:00
Mikhail f. Shiryaev
061e61919a
Merge pull request #39450 from ClickHouse/tsal-clang-13
...
Build thread sanitizer binaries with clang-13
2022-07-26 15:13:17 +02:00
Yakov Olkhovskiy
c05c32e823
copy self-extracting to output
2022-07-26 08:41:36 -04:00
Yatsishin Ilya
25db71a8a3
Merge remote-tracking branch 'origin/master' into integration-tests-7
2022-07-25 09:17:55 +00:00
Alexey Milovidov
071374b152
Remove SPLIT_BINARY
2022-07-24 01:15:54 +02:00
Mikhail f. Shiryaev
17b504b0d4
Build thread sanitizer binaries with clang-13
2022-07-22 12:14:22 +02:00
jasperzhu
c044c67745
Merge branch 'master' into dev_intel_iaa_deflate
2022-07-19 15:32:57 +08:00
Yatsishin Ilya
eb2da901c7
Merge remote-tracking branch 'origin/master' into integration-tests-7
2022-07-18 09:29:35 +00:00
Azat Khuzhin
1ef9910453
Fix builder image for releases w/o diagnostics tool
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-16 12:07:58 +03:00
Yatsishin Ilya
d274b05fac
improvements
2022-07-07 20:21:10 +00:00
Mikhail f. Shiryaev
7a58a8c19b
Merge pull request #38647 from ClickHouse/clickhouse-diagnostics
...
Clickhouse diagnostics
2022-07-04 12:14:33 +02:00
Mikhail f. Shiryaev
7388b6fb55
Test and build clickhouse-diagnostics in release builds
2022-07-04 10:59:37 +02:00
Mikhail f. Shiryaev
0aae60f8f1
Update nfpm version
2022-07-01 11:43:13 +02:00
Robert Schulze
bb358617e1
Better naming for stuff related to splitted debug symbols
...
The previous name was slightly misleading, e.g. it is not about
"intalling stripped binaries" but about splitting debug symbols from the
binary.
2022-06-30 23:41:27 +02:00
jasperzhu
bca18b2caf
Merge branch 'master' into dev_intel_iaa_deflate
2022-06-16 08:56:27 +08:00
BoloniniD
6120495373
Fix Dockerfile
2022-06-10 10:31:25 +03:00
BoloniniD
14ddcee432
Trying another Rust target to fix compatibility test
2022-06-07 18:10:49 +03:00
BoloniniD
b05ee41d25
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-06-06 16:03:10 +03:00
jinjunzh
c7ca746994
fixed build issues in clickhouse-keeper
2022-06-05 14:46:28 -04:00
Nikita Taranov
e41b268cc1
Fix packager
2022-06-03 14:32:29 +02:00
BoloniniD
94c7833e25
Merge branch 'BLAKE3' of github.com:BoloniniD/ClickHouse into BLAKE3
2022-06-01 11:58:28 +03:00
BoloniniD
dd8aefdf1e
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-06-01 11:46:55 +03:00
jinjunzh
1d3ae2d88c
fixed unable to find library -ldl in docker build
2022-05-31 17:14:08 -04:00
jinjunzh
822cef10b3
add nasm into more docker configuration
2022-05-30 21:16:06 -04:00
Alexey Milovidov
dce7a86ca9
Merge branch 'master' into llvm-14
2022-05-22 22:38:07 +02:00
Mikhail f. Shiryaev
ec3246ea4f
Run binary-builder as a current user
2022-05-18 01:38:45 +02:00
Mikhail f. Shiryaev
48751f5a91
Checkout master:master for performance output in packager
2022-05-18 01:38:44 +02:00
Mikhail f. Shiryaev
1f67665c95
Build performance output in release builds
2022-05-18 01:38:44 +02:00
Mikhail f. Shiryaev
8507a4ddbf
Update nfpm version, prepare UID/GID workdir
2022-05-18 01:38:43 +02:00
Mikhail f. Shiryaev
96859ec678
Remove unused packager code for deb packages
2022-05-18 01:38:43 +02:00
Mikhail f. Shiryaev
d2e5ab0f6c
Improve packager script a little bit
2022-05-18 01:38:42 +02:00
Nikolai Kochetov
f1bc2bc615
Merge branch 'master' into llvm-14
2022-05-16 12:03:26 +02:00
BoloniniD
228a60ede2
Merge branch 'master' into BLAKE3
2022-04-23 10:08:26 +03:00
BoloniniD
a26acd3660
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-04-22 18:12:54 +03:00
Mikhail f. Shiryaev
bf41199cc3
Fix issue with broken git ownership
2022-04-22 14:56:34 +02:00
alesapin
c2a881decd
Update docker/packager/packager
...
Co-authored-by: Mikhail f. Shiryaev <felixoid@clickhouse.com>
2022-04-22 11:30:22 +02:00
Mikhail f. Shiryaev
fc83f5e96c
Get ccache status before build
2022-04-21 17:18:43 +02:00
Mikhail f. Shiryaev
7dd2fdb47c
Try to minimize linking for keeper
2022-04-21 16:11:43 +02:00
Mikhail f. Shiryaev
619d2703f0
Simplify build.sh for binary packager
2022-04-21 14:15:24 +02:00
Mikhail f. Shiryaev
49a572e00c
Build only clickhouse-keeper with musl
2022-04-21 13:43:24 +02:00
alesapin
48f1ce96e7
AA
2022-04-21 00:04:49 +02:00
alesapin
9815b4bea4
Followup
2022-04-20 22:42:26 +02:00
alesapin
b8021be891
Perfect cmake
2022-04-20 21:19:43 +02:00
alesapin
ba81816dc1
Better cmake
2022-04-20 12:11:55 +02:00
Alexey Milovidov
73b52859df
Merge branch 'master' into llvm-14
2022-04-16 00:46:58 +02:00
alesapin
be5b75b567
Reverse
2022-04-14 15:44:09 +02:00
alesapin
774e01bf13
Hacky hack
2022-04-14 15:43:36 +02:00
alesapin
b27070856e
Fix
2022-04-14 12:27:13 +02:00
alesapin
7521aecdf5
Debug why we have dynamic binary
2022-04-14 12:23:09 +02:00
alesapin
7c11abb995
Followup
2022-04-13 21:33:34 +02:00
alesapin
aba2b77972
Fix order
2022-04-13 17:45:34 +02:00
alesapin
1a88143468
Fix build
2022-04-13 11:49:56 +02:00
BoloniniD
30712ead45
Merge branch 'master' into BLAKE3
2022-04-13 00:45:44 +03:00
alesapin
b8389d48b4
Fix packager
2022-04-12 18:51:35 +02:00
alesapin
f011864386
Build clickhouse-keeper with musl
2022-04-12 18:48:16 +02:00
Mikhail f. Shiryaev
dd4bd4abba
Simplify and fix coverity
2022-04-07 18:35:58 +02:00
Boris Kuschel
2298b80ed8
Add coverity scan
...
Signed-off-by: Boris Kuschel <Boris.Kuschel@ibm.com>
2022-04-05 19:52:33 +02:00
BoloniniD
aec9af18e9
Test alt linker in blake3
2022-04-03 00:29:45 +03:00
BoloniniD
aca1f2d6c0
Revert previous change
2022-04-01 22:57:24 +03:00
BoloniniD
4a1262c8da
Revert previous change
2022-04-01 22:06:56 +03:00