Commit Graph

385 Commits

Author SHA1 Message Date
Nikita Mikhaylov
1c956481a1 Updated deb/build.sh and fixed shellcheck 2021-08-23 13:21:39 +00:00
mergify[bot]
95e9d517ff
Merge branch 'master' into fix-clang-tidy 2021-08-23 10:54:36 +00:00
Yatsishin Ilya
91289983c6 Use ru.archive.ubuntu.com as default one is not responding from CI 2021-08-23 11:22:39 +03:00
Nikita Mikhaylov
80ebc6ccea Done 2021-08-22 15:09:49 +00:00
Nikita Mikhaylov
e9979312dd Fixed 2021-08-22 10:38:36 +00:00
Nikita Mikhaylov
cfa571cac4
Merge pull request #27895 from nikitamikhaylov/temporary_remove_yaml_fuzzer
Build fuzzers with clang-tidy
2021-08-21 16:51:31 +03:00
Nikita Mikhaylov
c5779eb604 Fix build 2021-08-20 13:27:44 +00:00
Nikita Mikhaylov
c6f94e5016 better 2021-08-20 11:57:15 +00:00
Nikita Mikhaylov
0da15b9ece Fix build 2021-08-20 10:23:50 +00:00
Nikita Mikhaylov
d575f06dff better 2021-08-19 23:04:55 +00:00
Nikita Mikhaylov
06a0580db1 done 2021-08-19 23:02:01 +00:00
mergify[bot]
bde834a8c0
Merge branch 'master' into try-llvm-12 2021-08-19 18:21:29 +00:00
alexey-milovidov
c06f212bb5
Update packager 2021-08-15 09:55:54 +03:00
Alexey Milovidov
6ff43a614c Use only SSE2 in "unbundled" build 2021-08-15 09:52:55 +03:00
Yatsishin Ilya
9145dd3fd0 Merge branch 'master' into try-llvm-12 2021-08-06 19:14:01 +03:00
alesapin
6d28892fbd Followup fix 2021-07-30 16:50:26 +03:00
alesapin
acc4e9e79d Merge remote-tracking branch 'evillique/nlp' into evillique-nlp 2021-07-30 16:46:58 +03:00
alesapin
916594fe23 Merge branch 'master' into evillique-nlp 2021-07-30 13:03:10 +03:00
vdimir
23423524c5
Update path to apache-arrow deb package in unbundled/Dockerfile
See 'Linux packages notes' https://arrow.apache.org/blog/2021/05/03/4.0.0-release/
2021-07-19 16:04:42 +03:00
vdimir
22d545133a
Update link to dpkg-deb in dockerfiles 2021-07-19 12:49:19 +03:00
alesapin
870f7eb716
Update Dockerfile 2021-07-08 15:33:12 +03:00
Nikolay Degterinsky
87eb76d51e Fix unbundled build 2021-07-08 12:16:53 +00:00
alesapin
aa86fac4e7 Fix unbundled build 2021-07-07 14:07:20 +03:00
Ivan
14e43cfafa
Add CI check for darwin-aarch64 (#25560)
* Add support for darwin-aarch64

* Fix PVS warnings

* Add build configuration

* Fix packager args
2021-06-25 18:21:56 +03:00
Yatsishin Ilya
46023c4b99 merge remote-tracking branch 'origin' into try-llvm-12 2021-06-03 15:32:22 +03:00
Nikita Mikhaylov
c127c433c2 better 2021-05-27 23:43:00 +03:00
Yatsishin Ilya
366a7fe45b linker path required to be specific one 2021-05-12 18:24:27 +03:00
Maksim Kita
bc6de947fb gcc-10 installation no-install-reccomends option fix 2021-05-01 16:17:42 +03:00
alexey-milovidov
f360e7c808
Merge pull request #23766 from kitaisreal/remove-unused-compilers
Remove unused compilers (fixed for the troublesome "unbundled" build)
2021-05-01 16:15:38 +03:00
Maksim Kita
939b940c29
Update Dockerfile 2021-05-01 00:47:34 +03:00
Maksim Kita
ecb05a5f40
Update Dockerfile 2021-04-30 17:36:05 +03:00
Yatsishin Ilya
e523162eda Merge remote-tracking branch 'origin' into try-llvm-12 2021-04-30 13:11:18 +03:00
alexey-milovidov
fab763f8fa
Revert "Fix CI build for gcc-10" 2021-04-29 20:43:08 +03:00
Maksim Kita
26068a4d28 Updated llvm.cmake 2021-04-29 20:10:01 +03:00
Maksim Kita
140a289f8e Remove unused compilers 2021-04-29 17:00:38 +03:00
Maksim Kita
5b4d2006aa Fix CI build for gcc-10 2021-04-29 14:29:55 +03:00
Alexey Milovidov
eda56e52d8 Remove obsolete compilers 2021-04-28 07:16:48 +03:00
mergify[bot]
68ee3ff70e
Merge branch 'master' into limit-gcc 2021-04-25 05:01:45 +00:00
Alexey Milovidov
1c2d16f608 Fix build 2021-04-25 06:11:54 +03:00
Alexey Milovidov
fe76b2242a Remove rotten parts of release script 2021-04-25 02:11:31 +03:00
Alexey Milovidov
8cb0e5579a Remove gcc from docs 2021-04-22 04:20:03 +03:00
Alexander Kuzmenkov
6acc92ffd9 remove debug 2021-04-07 23:38:48 +03:00
Alexander Kuzmenkov
29cf5bd712 Merge remote-tracking branch 'origin/master' into HEAD 2021-04-06 14:31:19 +03:00
Alexey Milovidov
0501c025db Remove OpenCL 2021-04-05 18:09:14 +03:00
Alexander Kuzmenkov
d5a7809873 add pixz 2021-04-02 16:37:44 +03:00
Alexander Kuzmenkov
e456e40232 show ccache config 2021-04-02 16:37:43 +03:00
Alexander Kuzmenkov
9ec0a9dd4c more debug 2021-04-02 14:06:36 +03:00
Alexander Kuzmenkov
13f3efcc88 typo 2021-04-01 21:02:35 +03:00
Alexander Kuzmenkov
28dd226004 remove extra option 2021-04-01 20:00:08 +03:00
Alexander Kuzmenkov
a255ab179f typo 2021-04-01 17:29:51 +03:00
Alexander Kuzmenkov
5f45199082 typo 2021-04-01 15:46:55 +03:00
Alexander Kuzmenkov
40dac7b678 more debug 2021-04-01 15:12:30 +03:00
Alexander Kuzmenkov
2b97587055 debug again 2021-04-01 02:53:22 +03:00
Alexander Kuzmenkov
026dab2b81 typo 2021-04-01 02:51:47 +03:00
Alexander Kuzmenkov
a91f505899 remove debug 2021-04-01 00:59:31 +03:00
Alexander Kuzmenkov
8bd19ccad2
Update packager 2021-03-31 23:23:08 +03:00
Alexander Kuzmenkov
a55d03cb62 try to avoid conflict with prlimit 2021-03-31 22:41:53 +03:00
Alexander Kuzmenkov
c187dca12c Merge remote-tracking branch 'origin/master' into HEAD 2021-03-31 20:18:08 +03:00
Alexander Kuzmenkov
d0db789196
Update build.sh 2021-03-31 18:43:31 +03:00
Alexander Kuzmenkov
1683c3a10d more debug 2021-03-31 18:38:36 +03:00
Alexander Kuzmenkov
1ccc162c86 stats 2021-03-31 15:59:45 +03:00
alesapin
7f0df7d451
Update Dockerfile 2021-03-30 19:18:20 +03:00
alesapin
c7d733040c
Update Dockerfile 2021-03-30 19:17:35 +03:00
alesapin
82389ca03b
Update Dockerfile 2021-03-30 19:15:49 +03:00
alesapin
45c1ba8c69
Revert "quick fix for broken resolution of apt.llvm.org on Yandex infra" 2021-03-30 19:03:55 +03:00
Alexander Kuzmenkov
8d52292eb1 fix 2021-03-30 18:57:22 +03:00
Alexander Kuzmenkov
350546356a debug dns in docker build 2021-03-30 18:09:58 +03:00
Alexander Kuzmenkov
5f8e88aca0
boop 2021-03-30 16:39:49 +03:00
Alexander Kuzmenkov
e5953f249d
Update build.sh 2021-03-30 15:34:24 +03:00
Alexander Kuzmenkov
b01897ebd7 check how ccache is used for contribs 2021-03-30 14:31:39 +03:00
Yatsishin Ilya
7e6cd00cee Try to switch to llvm-12/clang-12 2021-03-24 17:17:59 +03:00
Alexander Kuzmenkov
4c2278c215 Merge pull request #22047 from ClickHouse/aku/llvm-cloudflare-21.3
21.3: quick fix for broken resolution of apt.llvm.org on Yandex infra

(cherry picked from commit 12f5753e5f)
2021-03-23 19:41:09 +03:00
Danila Kutenin
e5ec4e21b6 Fix Darwin build 2021-01-11 09:04:34 +00:00
Azat Khuzhin
469b631ca6 Fix performance comparison
In #18113 the top_level_domains list copying was moved into
docker/packager/binary/build.sh, this was done to avoid symlinks (since
Dockerfile cannot dereference them).

But the patch was wrong, since it copied into the root (/), which is not
included into performance.tgz and also compare.sh was not modified.

This wasn't showed up with CI checks since the docker image wasn't
updated and it still included that top_level_domains, once it was
modified the image was updated and it became broken.

Cc: @akuzm
2021-01-02 17:09:20 +03:00
alesapin
b4cac6a8a4 Fix unbundled, splitted and disable freebsd build 2020-12-25 15:36:49 +03:00
Nikolai Kochetov
af7f5c9518
Merge pull request #17868 from ClickHouse/async-read-from-socket
Async read from socket
2020-12-23 12:20:42 +03:00
Azat Khuzhin
95c35b318e Avoid using symlinks for top_level_domains
Move the main copy into the tests/config and ship it to the perf tests
via the perf package.
2020-12-15 21:58:46 +03:00
Nikolai Kochetov
4905201985 Merge branch 'master' into async-read-from-socket 2020-12-15 21:04:47 +03:00
Alexander Kuzmenkov
fe6f477881 Build utils in CI, at least in split build
Currently we don't build them at all, so they were broken by https://github.com/ClickHouse/ClickHouse/pull/17988
2020-12-14 20:39:52 +03:00
Nikolai Kochetov
75ac87c241 Fixing build. 2020-12-14 17:42:12 +03:00
Vitaly Baranov
8e6c68f4f7 Fix unbundled build. 2020-11-24 17:53:34 +03:00
sundy-li
46c01eb7a2 improve unbundle build 2020-11-11 09:08:53 +08:00
sundy-li
c7617173c4 add sync_file_range for glibc-compatibility 2020-11-11 09:08:52 +08:00
alexey-milovidov
fa929b0312
Replace duplicate development config files with symlinks. (#16486)
* Fix test "max_memory_usage_for_user"

* Update test

* Update annoying boilerplate

* Support symlinks in tarballs

* Fix Fuzzer

* Remove "secondary" user

* Remove "secondary" user
2020-11-04 23:45:06 +03:00
Alexey Milovidov
d412e0ca2c Move trash to "Unbundled" Dockerfile 2020-10-26 19:41:38 +03:00
alesapin
848de47a2c Remove checksum check from arrow package 2020-10-21 17:49:37 +03:00
alesapin
9caf46c273
Update build.sh 2020-10-05 10:06:38 +03:00
alesapin
b3fa86191e Fix binary build 2020-10-04 13:23:25 +03:00
Azat Khuzhin
9cb3c743bd
Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
Vitaly Baranov
dd634aa731
Merge pull request #15491 from vitlibar/update-grpc
Update gRPC to the latest version
2020-10-02 15:54:35 +03:00
alesapin
c5df9433f0
Merge pull request #15239 from ClickHouse/100_percent_lld_11_for_clang_11
Build ClickHouse for release with clang-11
2020-10-02 14:59:29 +03:00
alesapin
bde65557f1 Fix bash 2020-10-02 12:40:50 +03:00
Vitaly Baranov
65a1684ed7 Fix gRPC build scripts. 2020-10-02 01:45:01 +03:00
Alexander Kuzmenkov
d0dff5b738 fixes 2020-10-01 12:27:05 +03:00
Alexander Kuzmenkov
499e0766e5 Check docker scripts with shellcheck 2020-09-30 20:06:46 +03:00
alesapin
9f89fe095a Missed changes 2020-09-29 10:17:02 +03:00
alesapin
eafcec7ebf Move release build to clang-11 2020-09-29 10:15:05 +03:00
alesapin
646e843105 100% lld-11 for clang-11 builds 2020-09-24 19:26:04 +03:00
Alexey Milovidov
035d7cb47f Enable control for heavy translation units 2020-09-20 23:46:32 +03:00
alesapin
368ddada33 Fix binary build 2020-09-18 22:01:59 +03:00
alesapin
1f429b3d52 Set enable tests to zero for performance build 2020-09-18 22:01:59 +03:00
Nikolai Kochetov
000cd42d5e
Merge pull request #14917 from ClickHouse/revert-14607-lower-number-of-threads-in-binary-build
Revert "Lower number of threads in binary build"
2020-09-17 15:45:02 +03:00
Nikolai Kochetov
d23244b3a5
Revert "Lower number of threads in binary build" 2020-09-17 12:45:06 +03:00
alesapin
7fc09b930e Clang 11 in binary build 2020-09-15 15:16:23 +03:00
alesapin
393c213866 Revert changes 2020-09-14 15:25:00 +03:00
alesapin
558164bf24 Add retries 2020-09-14 11:17:59 +03:00
alesapin
e519e2b87a Use patched dpkg on build stage 2020-09-14 11:16:00 +03:00
alesapin
b0e6df1532 Trying to fix build 2020-09-14 10:21:03 +03:00
alesapin
c202ce8e63 Merge branch 'master' into update_to_gcc_10 2020-09-11 12:50:10 +03:00
alesapin
956138635d Fix compiler name 2020-09-09 15:59:26 +03:00
alesapin
c535d75243 Add update 2020-09-09 14:47:34 +03:00
alesapin
ca6b634eb0 Install gcc-10 from proposed repo 2020-09-09 13:51:01 +03:00
alesapin
f528cd9f97 Forward compiler version to unbundled build 2020-09-09 13:01:12 +03:00
Alexey Milovidov
cc2b4014ff Lower number of threads in binary build 2020-09-09 09:32:09 +03:00
alesapin
54cdb2472c Bump binary image version 2020-09-07 18:40:21 +03:00
Azat Khuzhin
2d7cb03120 Suppress superfluous wget (-nv) output
Since for dowloading some of files wget logging may take 50% of overall
log [1].

  [1]: https://clickhouse-builds.s3.yandex.net/14315/c32ff4c98cb3b83a12f945eadd180415b7a3b269/clickhouse_build_check/build_log_761119955_1598923036.txt
2020-09-01 10:25:13 +03:00
Alexey Milovidov
0aec4c99d0 Cut off broken parts of "unbundled" build 2020-08-29 18:42:04 +03:00
Yatsishin Ilya
2e7a4483f6 fixes after #13687 2020-08-27 20:35:51 +03:00
Yatsishin Ilya
3bf5dc578d fixes 2020-08-27 19:06:40 +03:00
Yatsishin Ilya
fa1875a313 Merge remote-tracking branch 'origin' into unbundled-packager 2020-08-27 13:00:56 +03:00
Konstantin Podshumok
cbdedc39f2
REVERSE ME: workaround for docker/packager/unbundled
Please, reverse this commit after docker/packager/deb image update

Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:34:36 +03:00
Konstantin Podshumok
f4383389d5
sync unbundled/build.sh with a0ae1b2b42
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:44 +03:00
Konstantin Podshumok
cda4472ebc
dockerfiles: verify 3rd party apt repos, disable LLVM in PVS check
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:44 +03:00
Konstantin Podshumok
68a921cdea
cmake: use bundled rdkafaka for in unbundled tests for now
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:43 +03:00
Konstantin Podshumok
45e089e0c3
re-enable replxx in packager for unbundled
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:42 +03:00
Konstantin Podshumok
b3180437da
test builds: docker/packager/packager: re-enable mysql
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:42 +03:00
Konstantin Podshumok
17c46faaa7
cmake: fix parquet/arrow variables
squashed:

- sync FindArrow.cmake and FindParquet.cmake with arrow repo
- unbundled: add arrow to dbms link libraries
- cmake: fix-up unbundled Arrow support

Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:41 +03:00
Konstantin Podshumok
4e9b5bd31b
docker/packager/deb: new dependencies for unbundled
Squashed:
- docker/packager/deb: add arrow repo
- docker/packager/deb: cleanup
- docker/packager/deb: Add thrift
- docker/packager/deb: add myariadbclient
- docker/packager/deb: remove poco-dev as we always use contrib/ version now
- docker/packager/deb: add libssl-dev (unbundled) and restructure
- docker/packager/deb: fix repo url
- docker/packager/deb: fix tzdata not updated in build.sh
- docker/packager/deb: add mysqlclient-dev

Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:40 +03:00
Yatsishin Ilya
b8002dc812 mErge remote-tracking branch 'origin' into unbundled-packager 2020-08-25 14:12:01 +03:00
alexey-milovidov
7ea5364299
Merge pull request #13648 from filimonov/tzdata_version2
tzdata improvements
2020-08-24 23:07:37 +03:00
Yatsishin Ilya
f2182db765 Separate stateless unbundled image 2020-08-24 13:05:56 +03:00
Yatsishin Ilya
ccbfd2e5df Update deb-builder ubuntu version. Add clang-11, gcc-10. Add unbundled docker. Add test-base image. 2020-08-18 17:16:40 +03:00
alexey-milovidov
3fac908dc7
Revert "Added separate docker image for unbundled build. Added clang-11, gcc-10 in packager image. Updated packager image to ubuntu 20.04" 2020-08-15 15:43:58 +03:00
alexey-milovidov
c241e42db0
Update Dockerfile 2020-08-15 11:05:38 +03:00
Ilya Yatsishin
b74ded3dc0
Update build.sh 2020-08-14 15:34:00 +03:00
Yatsishin Ilya
22938a7152 Add separate docker container for unbundled build 2020-08-14 15:22:47 +03:00
Mikhail Filimonov
a0ae1b2b42 tzdata improvements
Expose version of embedded tzdata via TZDATA_VERSION in system.build_options.
Autogenerate list of shipped timezones. Script to check tzdb updates.
2020-08-12 14:21:40 +02:00
Alexey Milovidov
33197fee5b Build ClickHouse with fresh tzdata 2020-08-11 22:03:04 +03:00
alesapin
48466c0960 New version of dpkg-deb 2020-08-07 19:07:52 +03:00
Alexander Kuzmenkov
8f5c4a25c9 More branches in perf test repo snapshot 2020-07-23 15:51:12 +03:00
Alexander Kuzmenkov
cdca798d2a
Update build.sh 2020-07-15 00:56:35 +03:00
Alexander Kuzmenkov
6498fe8123 Publish repo snapshot in perf test package 2020-07-14 18:12:53 +03:00
Alexander Kuzmenkov
76ef8feb04
Update packager 2020-07-08 12:52:03 +03:00
Alexander Kuzmenkov
08762dc825
Update build.sh 2020-07-08 12:46:44 +03:00
alesapin
7ce3464810 Remove -v from ninja 2020-07-06 18:13:08 +03:00
Azat Khuzhin
f91e34b2e8 Include libcurl4-openssl-dev into yandex/clickhouse-deb-builder 2020-07-05 00:56:48 +03:00
alesapin
f0b012c94b Remove garbage from images 2020-07-01 23:07:11 +03:00
alesapin
29178a1df4 Don't download image twice 2020-07-01 21:51:11 +03:00
alesapin
faaf3536ea Update deb image 2020-07-01 18:00:07 +03:00
alesapin
29c528235e Add ability to run any image version from packager and runner 2020-06-30 16:08:12 +03:00