Commit Graph

318 Commits

Author SHA1 Message Date
Yatsishin Ilya
2e7a4483f6 fixes after #13687 2020-08-27 20:35:51 +03:00
Yatsishin Ilya
3bf5dc578d fixes 2020-08-27 19:06:40 +03:00
Yatsishin Ilya
fa1875a313 Merge remote-tracking branch 'origin' into unbundled-packager 2020-08-27 13:00:56 +03:00
Konstantin Podshumok
cbdedc39f2
REVERSE ME: workaround for docker/packager/unbundled
Please, reverse this commit after docker/packager/deb image update

Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:34:36 +03:00
Konstantin Podshumok
f4383389d5
sync unbundled/build.sh with a0ae1b2b42
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:44 +03:00
Konstantin Podshumok
cda4472ebc
dockerfiles: verify 3rd party apt repos, disable LLVM in PVS check
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:44 +03:00
Konstantin Podshumok
68a921cdea
cmake: use bundled rdkafaka for in unbundled tests for now
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:43 +03:00
Konstantin Podshumok
45e089e0c3
re-enable replxx in packager for unbundled
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:42 +03:00
Konstantin Podshumok
b3180437da
test builds: docker/packager/packager: re-enable mysql
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:42 +03:00
Konstantin Podshumok
17c46faaa7
cmake: fix parquet/arrow variables
squashed:

- sync FindArrow.cmake and FindParquet.cmake with arrow repo
- unbundled: add arrow to dbms link libraries
- cmake: fix-up unbundled Arrow support

Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:41 +03:00
Konstantin Podshumok
4e9b5bd31b
docker/packager/deb: new dependencies for unbundled
Squashed:
- docker/packager/deb: add arrow repo
- docker/packager/deb: cleanup
- docker/packager/deb: Add thrift
- docker/packager/deb: add myariadbclient
- docker/packager/deb: remove poco-dev as we always use contrib/ version now
- docker/packager/deb: add libssl-dev (unbundled) and restructure
- docker/packager/deb: fix repo url
- docker/packager/deb: fix tzdata not updated in build.sh
- docker/packager/deb: add mysqlclient-dev

Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:40 +03:00
Yatsishin Ilya
b8002dc812 mErge remote-tracking branch 'origin' into unbundled-packager 2020-08-25 14:12:01 +03:00
alexey-milovidov
7ea5364299
Merge pull request #13648 from filimonov/tzdata_version2
tzdata improvements
2020-08-24 23:07:37 +03:00
Yatsishin Ilya
f2182db765 Separate stateless unbundled image 2020-08-24 13:05:56 +03:00
Yatsishin Ilya
ccbfd2e5df Update deb-builder ubuntu version. Add clang-11, gcc-10. Add unbundled docker. Add test-base image. 2020-08-18 17:16:40 +03:00
alexey-milovidov
3fac908dc7
Revert "Added separate docker image for unbundled build. Added clang-11, gcc-10 in packager image. Updated packager image to ubuntu 20.04" 2020-08-15 15:43:58 +03:00
alexey-milovidov
c241e42db0
Update Dockerfile 2020-08-15 11:05:38 +03:00
Ilya Yatsishin
b74ded3dc0
Update build.sh 2020-08-14 15:34:00 +03:00
Yatsishin Ilya
22938a7152 Add separate docker container for unbundled build 2020-08-14 15:22:47 +03:00
Mikhail Filimonov
a0ae1b2b42 tzdata improvements
Expose version of embedded tzdata via TZDATA_VERSION in system.build_options.
Autogenerate list of shipped timezones. Script to check tzdb updates.
2020-08-12 14:21:40 +02:00
Alexey Milovidov
33197fee5b Build ClickHouse with fresh tzdata 2020-08-11 22:03:04 +03:00
alesapin
48466c0960 New version of dpkg-deb 2020-08-07 19:07:52 +03:00
Alexander Kuzmenkov
8f5c4a25c9 More branches in perf test repo snapshot 2020-07-23 15:51:12 +03:00
Alexander Kuzmenkov
cdca798d2a
Update build.sh 2020-07-15 00:56:35 +03:00
Alexander Kuzmenkov
6498fe8123 Publish repo snapshot in perf test package 2020-07-14 18:12:53 +03:00
Alexander Kuzmenkov
76ef8feb04
Update packager 2020-07-08 12:52:03 +03:00
Alexander Kuzmenkov
08762dc825
Update build.sh 2020-07-08 12:46:44 +03:00
alesapin
7ce3464810 Remove -v from ninja 2020-07-06 18:13:08 +03:00
Azat Khuzhin
f91e34b2e8 Include libcurl4-openssl-dev into yandex/clickhouse-deb-builder 2020-07-05 00:56:48 +03:00
alesapin
f0b012c94b Remove garbage from images 2020-07-01 23:07:11 +03:00
alesapin
29178a1df4 Don't download image twice 2020-07-01 21:51:11 +03:00
alesapin
faaf3536ea Update deb image 2020-07-01 18:00:07 +03:00
alesapin
29c528235e Add ability to run any image version from packager and runner 2020-06-30 16:08:12 +03:00
alesapin
db79278981 Fake change in dockerfile 2020-06-29 16:13:20 +03:00
Alexander Kuzmenkov
01344d7b87 More verbose CMake in build docker 2020-06-25 22:16:48 +03:00
Alexander Kuzmenkov
4a8349cad9 Less layers in docker file 2020-06-25 09:26:10 +03:00
Alexander Kuzmenkov
63a8a8453a Less layers in docker file 2020-06-25 09:23:25 +03:00
Alexander Kuzmenkov
ce36da838c for the love of God just update this container already, i'm begging you 2020-06-24 19:12:05 +03:00
Alexander Kuzmenkov
751319d0ef show build commands 2020-06-24 16:16:54 +03:00
Azat Khuzhin
0731f2293d Add missing boost libraries into docker image 2020-06-11 11:47:30 +03:00
Azat Khuzhin
1f3c640da2 Use unbundled boost for unbundled builds 2020-06-10 20:56:47 +03:00
Ivan
47ad338cb2
Refactor CMake build files (#11390)
* Get rid of lib_name.cmake
* Refactor Boost and HyperScan libraries
* Refactor lz4
* Fix build with xxHash
2020-06-09 13:54:49 +03:00
Ivan
1e1b30dc05
Add libhyperscan-dev to deb Dockerfile 2020-06-07 10:19:56 +03:00
alesapin
d8de91ea4d Don't build redundant garbage in binary builds 2020-06-06 17:00:47 +03:00
alesapin
5038733abf
bump2 2020-06-05 14:20:54 +03:00
alesapin
3d48c10bc6
bump CI 2020-06-05 12:22:23 +03:00
alesapin
e964b6c93f Trying to increase ccache size 2020-06-04 22:48:48 +03:00
Denis Glazachev
808351048f Add libsasl2-dev and heimdal-multidev required by static system openldap libraries 2020-05-30 19:44:51 +04:00
Ilya Yatsishin
0f6410b56f
Merge pull request #11108 from ClickHouse/revert-11099-revert-10908-packager-add-bin
Revert "Revert "Allow to build binaries and tests from deb package build. ""
2020-05-21 19:59:52 +03:00
alesapin
20d41a3f98 Update dpkg-deb (https://github.com/ClickHouse-Extras/dpkg) for compatibility with ubuntu eoan packages format 2020-05-21 18:30:08 +03:00
Ilya Yatsishin
9dc493e063
Revert "Revert "Allow to build binaries and tests from deb package build. "" 2020-05-21 18:02:52 +03:00
Ilya Yatsishin
cce805c42c
Revert "Allow to build binaries and tests from deb package build. " 2020-05-21 14:50:12 +03:00
Yatsishin Ilya
e3c692bc48 fix issues 2020-05-19 10:54:08 +03:00
Yatsishin Ilya
9c551b8b4d set USE_GTEST for tests build 2020-05-19 10:54:08 +03:00
Yatsishin Ilya
8d190f316d wip 2020-05-19 10:54:08 +03:00
Yatsishin Ilya
b780adb241 wip 2020-05-19 10:54:08 +03:00
Yatsishin Ilya
60f9d2088d wip 2020-05-19 10:54:08 +03:00
Yatsishin Ilya
1086cf7691 wip 2020-05-19 10:54:08 +03:00
Artem Zuikov
0ba4c373a9 add OpenCL libraries for CI (part 2) 2020-05-14 12:45:22 +03:00
Artem Zuikov
9b029eb310
add OpenCL libraries for CI (#10898) 2020-05-14 12:36:17 +03:00
alesapin
a89653effe Add libldap2-dev to build image 2020-05-13 14:53:35 +03:00
Ivan
85d783c247
Poco contrib refactoring (#10396)
* Remove config_common.h
* Refactor libcpuid contrib
* Remove support for libcpuinfo
* Define USE_CPUID in Arcadia
* Refactor Poco libraries
2020-05-08 17:11:19 +03:00
Ivan
038e371570
Update cross-builds to use clang-10 compiler (#10724)
* Update FreeBSD toolchain
* Update cross-builds to use clang-10
2020-05-07 15:32:17 +03:00
Alexey Milovidov
cef28325ff Update to clang-10 2020-05-02 22:00:05 +03:00
Alexey Milovidov
ee81e5fef7 Add LLVM tools to Docker images 2020-04-30 15:10:32 +03:00
Ivan
91df18a906
Trigger new image build
to pull changes in freebsd toolchain
2020-04-28 17:06:52 +03:00
BohuTANG
71f9346db3 docker: fix one typo for clang-9 2020-04-27 17:33:54 +08:00
Alexey Milovidov
a0d56997de Fix error 2020-04-20 23:13:33 +03:00
Alexey Milovidov
31d2547363 clang-10 in CI 2020-04-20 23:04:35 +03:00
Azat Khuzhin
66d443df14 Add libmsgpack-dev into the image (for unbundled build) 2020-04-10 11:30:23 +03:00
Alexey Milovidov
b6f4287d2f Remove vagrant build 2020-04-08 23:42:12 +03:00
Ivan Lezhankin
1e3ec9113a Fix compiler possible values 2020-04-08 19:29:08 +03:00
Ivan
f6b31f344d
Add cross-compile build for FreeBSD (#9643)
* Add toolchain to Docker image
2020-04-07 11:33:49 +03:00
Ivan Lezhankin
06446b4f08 dbms/ → src/ 2020-04-03 18:14:31 +03:00
Ivan Lezhankin
159e72ea7c Trigger Docker image rebuild 2020-04-02 10:52:46 +03:00
Ivan
97f2a2213e
Move all folders inside /dbms one level up (#9974)
* Move some code outside dbms/src folder
* Fix paths
2020-04-02 02:51:21 +03:00
alesapin
5b8824c065 Add clang-8 to binary image 2020-03-23 21:23:32 +03:00
alesapin
72f3fbb630 Fix binary image 2020-03-23 19:08:13 +03:00
alesapin
ea061df5cd Add ability to build with clang-9 from packager script and remove outdated compilers 2020-03-23 17:49:52 +03:00
alexey-milovidov
92684b911d
Update Dockerfile 2020-03-23 14:02:39 +03:00
Alexey Milovidov
8df43f2f50 Update packager images 2020-03-23 00:10:14 +03:00
Alexey Milovidov
1bfe312834 Removed leftovers 2020-03-21 19:43:31 +03:00
Ivan
7aca050684
Add libcctz-dev package to Dockerfile 2020-03-17 16:18:36 +03:00
Alexey Milovidov
1c75827046 Packager script: add --clang-tidy option 2020-03-12 16:13:54 +03:00
Alexander Kuzmenkov
3be5fa1338 performance comparison 2020-03-11 17:29:34 +03:00
alesapin
3fbaa0a29f Add clang tidy to docker images 2020-03-10 12:07:43 +03:00
alesapin
49c0642c49 Build gcc with lld linker 2020-03-03 15:32:54 +03:00
Alexander Kuzmenkov
ebe70f5bcb performance comparison 2020-02-25 16:12:26 +03:00
alesapin
93fddc7b46 Remove symlink to lld from build images 2020-02-21 18:49:53 +03:00
alesapin
954ea60a6a Remove redundant compilers, linkers and libs 2020-02-10 12:05:14 +03:00
alesapin
bddbc956ec Add symlynks for lld, because gcc is not able to find it without 'ld.' prefix. 2020-02-07 23:59:51 +03:00
Ivan
b80e3dcd46
Refactoring of replxx (#8748) 2020-01-23 11:18:19 +03:00
Ivan Lezhankin
d90348eaa8 Disable unbundled with rdkafka
to fix it later
2020-01-13 14:28:30 +03:00
Ivan Lezhankin
fb677fd668 Disable replxx in unbundled build 2020-01-10 13:55:50 +03:00
Ivan Lezhankin
a33ade77fd Update packager for darwin 2020-01-01 22:27:48 +03:00
Alexander Kuzmenkov
17f1754695 Publish different files for perftest. 2019-12-25 19:09:37 +03:00
Alexander Kuzmenkov
be963a7a6f Add a build package type for performance tests. 2019-12-23 21:34:12 +03:00
Alexander Kuzmenkov
cb19696778 Dump cmake options in CI. 2019-12-18 18:40:42 +03:00
Ivan
453ff2c071
Refactor packager (#7539) 2019-10-30 17:36:27 +03:00
Ivan
4f2f5cca84
Add support for cross-compiling to the CPU architecture AARCH64 (#7370) 2019-10-30 10:01:53 +03:00
Ivan
4d27e8aa5b
Unpack toolchains into mounted volume (#7534) 2019-10-29 20:33:31 +03:00
Ivan
c250db4922
Update Docker Image for Binary Packager (#7474) 2019-10-24 15:56:30 +03:00
Ivan
32ca372b9d
Revert "Update Dockerfile for binary packager (#7456)" (#7458)
This reverts commit fa05a5860f.
2019-10-23 18:54:18 +03:00
Ivan
fa05a5860f
Update Dockerfile for binary packager (#7456) 2019-10-23 17:41:17 +03:00
Ivan
381947509a
Fix build for Darwin (#7149)
* Disable some contribs for cross-compilation
* Fix clang-8-darwin build
* Also fix docs
* Add diagnostics
* Check cross-compilation in each file individually.
* Disable warning for clang < 9
2019-10-02 17:35:07 +03:00
alesapin
dad401a047 Downgrade cmake version in packager image 2019-09-27 16:25:51 +03:00
Ivan Lezhankin
7285bad1e7 Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-24 17:52:50 +03:00
Ivan
e9e10670da
Update Docker image for CI packaging
Add support for cross-compilation to Darwin
2019-09-23 22:29:47 +03:00
Ivan Lezhankin
6cc2f8da97 Add 'clang-8-darwin' choise and update Docker build image. 2019-09-23 21:22:10 +03:00
alesapin
6b6714761b Also pack config into shared archive 2019-09-23 15:20:08 +03:00
alesapin
f2f9f585e4 Better check in shared binary build 2019-09-20 23:15:42 +03:00
alesapin
d0ef26e1b8 Better shared binary build 2019-09-20 22:57:09 +03:00
alesapin
8783798b99 Move so libraries to output directory in binary build image 2019-09-20 19:29:06 +03:00
alexey-milovidov
fe9e110a6a
Merge pull request #6965 from azat-archive/sparsehash-c11
Replace libsparsehash with sparsehash-c11
2019-09-18 12:46:13 +03:00
Azat Khuzhin
780341060f
Replace libsparsehash with sparsehash-c11
- use sparsehash-c11 over libsparsehash
- fix typos in find_sparsehash and users of the vars (s/SPARCE/SPARSE/)
- drop libsparsehash-dev from docker images (but keep for unbunlded build)
- use ::google over GOOGLE_NAMESPACE
2019-09-18 00:08:20 +03:00
alesapin
f682cbc31d Add time logging to build script 2019-09-17 22:26:24 +03:00
alesapin
fb1b809388 Original repo 2019-09-17 20:07:35 +03:00
alesapin
dccac1993f Add custom dpkg to deb build image 2019-09-17 19:42:18 +03:00
alesapin
e9b7bd7ed7 Add gdb to build images 2019-09-17 17:24:45 +03:00
alesapin
f1d86d55e8 Enable gdb-index for gold by default 2019-09-17 13:16:48 +03:00
alesapin
11b428033b Update cmake to 3.15 2019-09-06 22:19:41 +03:00
Ivan
cd5c0fc9ac
Fix build issues (#6744)
* libcxxabi uses exception handling library as public
* Don't set -stdlib for internal libc++ - it poisons the checks.
* Enable capnproto in unbundled build back
2019-08-30 20:40:27 +03:00
alesapin
6d6851e747 Add capnp-library do build image 2019-08-29 15:36:41 +03:00
Ivan
b4339f266d
Make a better build scheme (#6500)
* Fix shared build
* Major default libs refactor
* Fix build with gcc_eh
* Link all libraries as a big group.
* Use global interface library as a group
* Build capnproto using our cmake
* Use only internal libunwind
2019-08-28 23:49:37 +03:00
alesapin
fc0532a451 Add gcc-9 to build images 2019-07-29 14:04:25 +03:00
alesapin
82e2266d88
Merge pull request #5896 from yandex/add_coverage_image_for_ci
Add coverage image for CI
2019-07-09 12:27:51 +03:00
Ivan Lezhankin
23cc61821f Enable GLIBC_COMPATIBILITY for splitted build in CI 2019-07-05 18:50:56 +03:00
alesapin
b3ebb4d784 Add coverage images for CI 2019-07-05 18:12:18 +03:00
alexey-milovidov
4a2d3fe90a
Update Dockerfile 2019-06-30 23:47:12 +03:00
Alexey Milovidov
7181ecabb8 Removed wrong instruction from Dockerfile 2019-06-30 21:22:51 +03:00
alexey-milovidov
feafcb21bd
Merge branch 'master' into h3-integration 2019-06-30 16:19:11 +03:00
alesapin
1773d85bed Add ability to build rpm and tgz packages via packager 2019-06-27 14:16:56 +03:00
Ivan Remen
6bc851b74b Compile h3 in docker 2019-06-26 02:06:00 +03:00
alexey-milovidov
9bdbd84263
Merge pull request #5030 from PerformanceVision/top_level_domain
Changing how the function (cutTo)firstSignificantSubdomain detect the tld (proposal)
2019-06-19 02:08:43 +03:00
proller
64924f5ef3 Docker: add comments with current tags 2019-06-04 16:01:16 +03:00
alesapin
5c5c23c4c9 Remove gcc-9 from images 2019-05-20 22:24:55 +03:00
alesapin
ec22af6da0 Add gcc-9 to build images 2019-05-20 12:51:52 +03:00
alesapin
ee84b8f8bb Add gcc-9 choice for packager 2019-05-20 12:08:19 +03:00
proller
51ca4cbaa4
Build fixes (#5278) 2019-05-15 20:19:39 +03:00
Guillaume Tassery
7c4541b127
Merge branch 'master' into top_level_domain 2019-04-26 12:30:23 +07:00
proller
97c532c0f0
Build fixes (#5114)
Need to push builder docker image
2019-04-26 02:21:59 +03:00
proller
fd63093032 Add gperf to build requirements (for upcoming pull request #5030 ) 2019-04-25 17:31:08 +03:00
proller
33922685d5
Packager: fixes (#5103) 2019-04-25 15:29:28 +03:00
Guillaume Tassery
0d931918ce Add gperf dependency for binary packager dockerfile 2019-04-19 11:07:15 +07:00
Guillaume Tassery
90f5cc569d Add gperf dependency for packager dockerfile 2019-04-19 10:02:13 +07:00
alesapin
958b71c37f Add official flag 2019-04-10 13:55:47 +03:00
alesapin
80cc4dc88c Save unit tests binary after binary build 2019-03-28 13:34:05 +03:00
alesapin
face35521a Add clang-8 build 2019-03-21 11:02:45 +03:00
alesapin
0b17e6c85a Add freebsd build to packager and vagrant file 2019-03-16 14:02:34 +03:00
alesapin
cc848c0c83 Add version argument to packager 2019-03-04 12:33:37 +03:00
alesapin
3105d83861 Also save .changes and .buildinfo files 2019-02-26 15:04:55 +03:00
alesapin
a4eca201b4 Add tzdata to build images 2019-02-21 20:14:29 +03:00
alesapin
3b09a816b3 Add options forwarding for binary builder docker image 2019-02-13 15:05:34 +03:00
alesapin
7ec47da203 Add split-binary mode to packager 2019-02-06 19:23:19 +03:00
alesapin
59f4f7f140 Remove llvm-7 from building images 2019-01-10 23:20:16 +03:00
alesapin
1eb0750cfa Get clang-7 from clang repo and rollback to ubuntu 18.04 2019-01-10 13:35:17 +03:00
alesapin
34e4f8e0c1 Move docker images to 18.10 and add compatibility file for glibc >= 2.28 2018-12-29 13:10:35 +03:00
alesapin
b604761a94 CLICKHOUSE-4128: Add unbundled option to packager 2018-11-22 15:14:55 +03:00
alesapin
43b099f20b Revert to ubuntu 18.04 2018-11-21 15:05:31 +03:00
alesapin
6ce13a08ef Move build and test images to 18.10, add libraries for unbundled build in debian image 2018-11-21 13:09:16 +03:00
alesapin
b65250e672 Better default value in packager script 2018-11-14 11:05:34 +03:00
alesapin
935efe81b7 CLICKHOUSE-4056: Fix build params 2018-10-18 19:49:00 +03:00
alesapin
1d7ef9133e CLICKHOUSE-4056: Add ability to run build with ccache or distcc 2018-10-18 15:56:48 +03:00
alesapin
cdb0b5d598 Add tty detection 2018-10-05 13:40:58 +03:00
alesapin
972d1663bb Remove exception handling 2018-10-05 13:26:54 +03:00
alesapin
ed585157ff
Delete packager.py 2018-10-04 22:52:02 +03:00
alesapin
1b5c4f501b
Update README.md 2018-10-04 20:09:19 +03:00
alesapin
1ee6984d46 CLICKHOUSE-3968: Add script for package creation in docker 2018-10-04 20:07:00 +03:00