Commit Graph

610 Commits

Author SHA1 Message Date
Andrew Onyshchuk
d15ff3e8d5 Parquet improvements
- Read only required columns
- Avoid reading the entire file to RAM when possible
- Allow using internal parquet on darwin
2020-02-23 00:04:58 -06:00
Ivan Lezhankin
102dad0ca0 Merge branch 'master' into arcadia 2020-02-17 17:37:10 +03:00
Ivan Lezhankin
39ea079034 More clean-up 2020-02-17 17:27:09 +03:00
alexey-milovidov
355ff00c2e
Revert "Build fixes" 2020-02-16 11:48:01 +03:00
Ivan Lezhankin
4cedd4619d Code clean-up 2020-02-16 11:04:03 +03:00
alexey-milovidov
ace75296df
Merge pull request #8435 from levysh/add-grpc-contrib
Add grpc contrib
2020-02-16 09:27:34 +03:00
Ivan Lezhankin
2d44fa59b5 libs/ → base/ 2020-02-14 17:48:30 +03:00
proller
4c3b8649e3 Merge remote-tracking branch 'upstream/master' into fix27 2020-02-12 13:59:14 +03:00
Andrew Onyshchuk
e6a536618e Allow bundled libgsasl on Mac 2020-02-04 19:38:00 -06:00
Andrew Onyshchuk
9de5dffb5c Upgrade librdkafka to v1.3.0
Allow bundled librdkafka on Mac
2020-02-04 16:12:24 -06:00
proller
bce3ec2a29 Revert "Revert "Build fixes""
This reverts commit 9e0b40bf09.
2020-02-03 19:46:17 +03:00
alexey-milovidov
9e0b40bf09
Revert "Build fixes" 2020-02-02 23:21:49 +03:00
levysh
9928b0bbb2
Merge branch 'master' into add-grpc-contrib 2020-02-02 14:47:16 +03:00
proller
a705c2ff3a Fix zlibstatic problem 2020-01-30 18:10:01 +03:00
proller
936c357e05 Merge remote-tracking branch 'upstream/master' into fix27 2020-01-27 17:54:43 +03:00
proller
58412e6aeb Dont change linker on freebsd 2020-01-24 02:04:22 +03:00
Alexey Milovidov
680da3d7ed Merge remote-tracking branch 'origin/master' into oandrew-avro 2020-01-23 22:08:08 +03:00
Alexey Milovidov
59d9bfa71e Enable Avro with Memory Sanitizer 2020-01-23 21:47:17 +03:00
Ivan
b80e3dcd46
Refactoring of replxx (#8748) 2020-01-23 11:18:19 +03:00
proller
394714bca9 Fix H3_INCLUDE_DIR find 2020-01-20 19:59:28 +03:00
Alexey Milovidov
51d0d7691c Fixed "unbundled" build 2020-01-19 20:08:37 +03:00
Alexey Milovidov
05048bf0c1 Fixed "unbundled" build 2020-01-19 20:08:15 +03:00
alexey-milovidov
901009d9b0
Merge branch 'master' into oandrew-avro 2020-01-19 03:37:29 +03:00
Alexey Milovidov
4dd7bb7c50 Fixed configuration of replxx 2020-01-19 03:18:25 +03:00
Alexey Milovidov
76e04b9843 Merge branch 'avro' of https://github.com/oandrew/ClickHouse into oandrew-avro 2020-01-18 21:23:55 +03:00
alexey-milovidov
2ba89d169e
Merge branch 'master' into readline-to-replxx-docs-and-corrections 2020-01-18 20:58:24 +03:00
alexey-milovidov
86a062110d
Merge pull request #8704 from kreuzerkrieg/MoreGCCWarnings
Enable -Wmissing-include-dirs for GCC
2020-01-18 20:12:56 +03:00
Alexey Milovidov
c0a5c664a9 Replace readline to replxx: docs and corrections 2020-01-18 18:44:08 +03:00
Alexey Milovidov
f7efa5e2c7 Merge branch 'replxx' of https://github.com/abyss7/ClickHouse into abyss7-replxx 2020-01-18 17:00:59 +03:00
kreuzerkrieg
0bf3ea4247 Enable -Wmissing-include-dirs for GCC 2020-01-18 10:46:27 +02:00
proller
3e817e5daa fix 2020-01-13 13:24:35 +03:00
proller
21ae7efa17 try fix 2020-01-13 12:55:57 +03:00
alexey-milovidov
f051844eb7
Merge branch 'master' into replxx 2020-01-11 19:59:33 +03:00
Alexey Milovidov
83869b78ca Merge branch 'master' into base64-update 2020-01-11 14:03:18 +03:00
Andrew Onyshchuk
4c13317fba refactor avro cmake 2020-01-10 16:47:41 -06:00
Alexey Milovidov
6dd0a19879 Fixed error #8604 2020-01-10 19:36:36 +03:00
alexey-milovidov
0a3a9a61e4
Merge pull request #8604 from abyss7/add-warning-macro
Add CMake macro add_warning to check if compiler supports warning
2020-01-10 19:22:25 +03:00
Ivan Lezhankin
8eb0cd82fe Add CMake macro add_warning to check if compiler supports warning 2020-01-10 13:25:14 +03:00
Andrew Onyshchuk
e96b3059c0 Refactor Avro CMake 2020-01-10 00:03:32 -06:00
meo
1de3261ec4
Catalina support
<filesystem> support was only introduced in Mac OS 10.15: minimum version must be raised to compile on Catalina
2020-01-10 00:53:07 +01:00
levysh
0b0fff8dc4
Merge branch 'master' into add-grpc-contrib 2020-01-09 20:11:23 +03:00
Ivan Lezhankin
5950f6c081 Merge remote-tracking branch 'upstream/master' into replxx 2020-01-09 19:21:04 +03:00
Andrew Onyshchuk
7320447f92 Add Avro formats
Add Avro file input/output formats
Add AvroConfluent input format (for Kafka)
2020-01-08 03:18:00 -06:00
Alexey Milovidov
31e4dc0e08 Disable ICU on non-Linux systems #8530 2020-01-05 23:43:14 +03:00
Ivan
835be7d47c
Proper ASM files generation for darwin (#8297) 2020-01-02 03:28:40 +03:00
Aleksei Levushkin
13643d825b added PROTOBUF_GENERATE_GRPC_CPP for generating grpc proto 2019-12-29 14:40:55 +03:00
Alexey Milovidov
c92e7e742c Fixed error 2019-12-28 06:07:02 +03:00
Ivan Lezhankin
cb6fcee307 Remove local fixes 2019-12-27 16:17:36 +03:00
Ivan Lezhankin
bf22e12e4e Initial replacement readline → replxx 2019-12-27 16:17:36 +03:00
Ivan Lezhankin
1268cddc61 Temporary build fix 2019-12-27 16:17:36 +03:00
Ivan Lezhankin
61c73d04f0 Improve CMakeLists.txt 2019-12-27 16:17:36 +03:00
Ivan Lezhankin
66517796ee Import replxx into contrib 2019-12-27 16:17:36 +03:00
maxulan
031dbe465d
Merge branch 'master' into parquet_list_reading_fix 2019-12-23 10:01:41 +03:00
Maxim Ulanovskiy
e9021f6377 flatbuffers lib downloading replaced with contrib/flatbuffers 2019-12-23 09:51:35 +03:00
Alexey Milovidov
4f7f5ecad6 Fixed "unbundled" build 2019-12-22 12:31:29 +03:00
Alexey Milovidov
5443d4a998 Merge branch 'master' into gcc-libcxx 2019-12-20 21:30:30 +03:00
alexey-milovidov
c2bde1f4eb
Merge pull request #8321 from ClickHouse/libc-headers
Using libc-headers for cxx targets
2019-12-20 20:59:23 +03:00
Alexey Milovidov
8f5e41ddfc Using libc-headers for cxx targets 2019-12-20 18:48:01 +03:00
alexey-milovidov
1b528ab2f1
Merge pull request #5773 from ClickHouse/libc-headers
Imported libc headers to contrib.
2019-12-20 18:14:19 +03:00
proller
521e2e709e Build fixes. Arm, minimal build 2019-12-20 17:46:00 +03:00
Alexey Milovidov
1444b18e1c Fixed AArch64 build 2019-12-20 15:35:41 +03:00
alexey-milovidov
b864bc49b9
Merge pull request #8310 from ClickHouse/remove-tcmalloc
Remove support for tcmalloc
2019-12-20 05:04:19 +03:00
Alexey Milovidov
687a8bf43b Using libc includes from custom directory 2019-12-20 04:24:25 +03:00
Alexey Milovidov
272b7b4471 Using libc++ even with gcc 2019-12-20 03:06:12 +03:00
Alexey Milovidov
6061e04b75 Fixed comment 2019-12-20 03:01:51 +03:00
Alexey Milovidov
0d089700fa Remove support for tcmalloc 2019-12-20 02:56:40 +03:00
Alexey Milovidov
814690e26f Fixed selection of targets 2019-12-19 19:49:32 +03:00
Alexey Milovidov
70a365f2d3 Added missing library 2019-12-19 03:23:16 +03:00
Alexey Milovidov
db853247ed Disabled LLVM under UBSan (it should be already disabled from sanitize.cmake but does not work) 2019-12-19 00:37:17 +03:00
Alexey Milovidov
701a9a8143 Fixed "unbundled" build 2019-12-18 22:50:12 +03:00
Alexey Milovidov
3a02b1093e Fixed error 2019-12-18 19:15:03 +03:00
Alexey Milovidov
1d0854c7af Using less number of LLVM libraries 2019-12-18 19:08:11 +03:00
Alexey Milovidov
2f17bf2833 Fixed aarch64 build in CI 2019-12-18 18:36:44 +03:00
Alexey Milovidov
823c120776 Fixed "splitted" build in CI 2019-12-18 18:34:02 +03:00
Alexey Milovidov
a7ef9e911a Fixed UBSan check in CI 2019-12-18 18:30:23 +03:00
Alexey Milovidov
cdc3a78e2f Fixed PVS Studio CI check 2019-12-18 18:26:27 +03:00
Alexey Milovidov
0896450230 Updated LLVM search script 2019-12-18 03:13:45 +03:00
Alexey Milovidov
c8e19f8bc8 Enable ICU for build with Memory Sanitizer 2019-12-15 20:53:16 +03:00
Alexey Milovidov
f97a542132 Fixed bug in README files for cross build 2019-12-15 09:36:43 +03:00
Alexey Milovidov
47d9209ebb Merge branch 'master' into libressl-to-openssl 2019-12-15 08:19:56 +03:00
Alexey Milovidov
7bba07d5f4 Added AARCH64 build for OpenSSL 2019-12-15 08:14:50 +03:00
Alexey Milovidov
09a0223f81 Preparation to build ICU from sources 2019-12-15 06:00:53 +03:00
Alexey Milovidov
c7cd1e8c20 Fixed CMakeLists 2019-12-15 01:43:08 +03:00
Alexey Milovidov
974d6f3bb0 Replaced libressl with openssl 2019-12-14 05:28:12 +03:00
alexey-milovidov
575208c6e2
Merge pull request #8182 from ClickHouse/aku/msan-exception
Suppress an msan false positive in exception handling.
2019-12-13 02:41:28 +03:00
Alexander Kuzmenkov
f0ed2bd233 Suppress an msan false positive in exception handling.
See https://github.com/google/sanitizers/issues/1155
2019-12-12 21:28:58 +03:00
alexey-milovidov
51ed10ed78
Merge pull request #8011 from Jokser/aws-s3-sdk-integration
AWS SDK S3 integration
2019-12-12 20:43:16 +03:00
Vladimir Chebotarev
a3fd3bfd15 Fixed linker searching logic. 2019-12-11 13:20:45 +03:00
Vladimir Chebotarev
3c053ec36a
Fixed a typo 2019-12-11 07:56:33 +03:00
alexey-milovidov
bbce99dd4c
Merge pull request #8115 from excitoon-favorites/enable_ld
Better linking
2019-12-10 23:15:20 +03:00
alexey-milovidov
c181fdc6a9
Update tools.cmake 2019-12-10 23:14:57 +03:00
alexey-milovidov
319428ca68
Merge pull request #7737 from amosbird/modernclient
Favor tinfo or bundled ncurses
2019-12-10 22:29:50 +03:00
Vladimir Chebotarev
d7b276551c Better linking in both GCC and Clang. 2019-12-10 17:05:48 +03:00
Vladimir Chebotarev
f9fbf70c69 Enabled ld for GCC. 2019-12-10 11:37:06 +03:00
alesapin
eb676b3c5d Fix search for lld 2019-12-09 12:29:59 +03:00
Pavel Kovalenko
a9dfefd37f AWS SDK integration rework. 2019-12-06 17:37:21 +03:00
Pavel Kovalenko
a9e2327ec0 AWS S3 SDK integration. 2019-12-03 19:23:24 +03:00
Amos Bird
dc390be385
Favor tinfo or bundled ncurses 2019-11-12 22:37:33 +08:00
alexey-milovidov
15c4a19bb1
Merge pull request #7585 from ernestp/macos_catalina_2019_11_01
Fixed compile errors on macOS Catalina
2019-11-02 15:46:17 +03:00
proller
6a573b4092 Allow to use mysql format without ssl - try2 with mysql interface split (#7524)
* Allow use mysql format without ssl

* fix

* fix

*  fix

* Also disable poco's optional libraries

* clean

* fix

* fix

* Requested changes

* clean

* Requested fixes

* Update MySQLHandler.cpp
2019-11-02 13:20:46 +03:00
alexey-milovidov
fd104a1f9a
Merge pull request #7570 from ClickHouse/fix-cross-arm
Fix cross-arm build
2019-11-02 00:55:19 +03:00
Ernest Poletaev
de1e5d0e53 Fixed compile errors on macOS Catalina 2019-11-01 23:33:43 +07:00
Ivan Lezhankin
ad76cd74e6 Cache AR and RANLIB paths 2019-11-01 18:18:57 +03:00
Ivan
be75b8d16e
Update toolchain for ASM language 2019-11-01 16:14:15 +03:00
Ivan Lezhankin
473a60f741 Fix toolchain file 2019-11-01 14:28:39 +03:00
proller
0006f2a370 Fix build without submodules (#7295)
* Build fixes

*            fix

* Fix

* fix

* Fix install(export..

* Freebsd fixes

* Freebsd fixes

* Fix warning

* fix

* More PRIVATE linking

* Fix review

* Timmy

* Timmy

* fix

* Try fix jemalloc link

* style
2019-10-30 23:34:06 +03:00
Ivan
4f2f5cca84
Add support for cross-compiling to the CPU architecture AARCH64 (#7370) 2019-10-30 10:01:53 +03:00
Amos Bird
82d0dfa629
Better add_globs 2019-10-22 15:09:49 +08:00
Amos Bird
b0d4baccc8 Enable musl and jemalloc for arm.
Can generate better arm packages.
2019-10-14 00:06:54 +08:00
proller
594c535bd4 Build fixes (#7063)
* Build fixes

*            fix

* Fix

* fix

* Fix install(export..

* Freebsd fixes

* Freebsd fixes

* Fix warning

* fix

* More PRIVATE linking

* Fix review

* Timmy

* fix

* fix
2019-10-05 22:25:31 +03:00
Ivan
381947509a
Fix build for Darwin (#7149)
* Disable some contribs for cross-compilation
* Fix clang-8-darwin build
* Also fix docs
* Add diagnostics
* Check cross-compilation in each file individually.
* Disable warning for clang < 9
2019-10-02 17:35:07 +03:00
Amos Bird
dbc352fdf9 glibc 2.29 compatibility 2019-09-30 12:28:50 +08:00
Ivan
8bce0fa9cb
Disable some contribs for cross-compilation (#7101) 2019-09-25 21:51:09 +03:00
Alexey Milovidov
ff07ffbbae Merge branch 'merging_redis' of https://github.com/CurtizJ/ClickHouse into CurtizJ-merging_redis 2019-09-25 02:27:05 +03:00
Alexander Kuzmenkov
6e32553e01 Add a comment about MemorySanitizer options. 2019-09-24 22:00:47 +03:00
Alexey Milovidov
981e3e6ef7 Fixed build with CMake 3.10. 2019-09-24 03:22:05 +03:00
alexey-milovidov
2f195ddb03
Merge pull request #7028 from abyss7/issue-6459
Implement cross-compilation support Linux → Darwin
2019-09-24 02:20:17 +03:00
Alexander Kuzmenkov
8ca6d6ed5d Prepare for MemorySanitizer build in CI.
This is a preparatory commit just to get the msan build running in some
shape. It disables many external libraries that are not yet tested.
2019-09-23 21:11:28 +03:00
Ivan Lezhankin
ce2fb6d3d1 Fix build 2019-09-23 17:46:01 +03:00
Ivan Lezhankin
4b143c3e0f Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-23 16:07:19 +03:00
alexey-milovidov
b0dd36db7c
Update sanitize.cmake 2019-09-23 00:22:22 +03:00
alexey-milovidov
c5f9b4ad0a
Update sanitize.cmake 2019-09-23 00:21:41 +03:00
Eldar Zaitov
b174833bdf Initial fuzzing support with libfuzzer 2019-09-22 13:34:09 +03:00
Ivan Lezhankin
9e46118edd Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-20 21:25:55 +03:00
CurtizJ
79a08ef8ea Merge remote-tracking branch 'upstream/master' into merging_redis 2019-09-18 12:58:22 +03:00
Azat Khuzhin
780341060f
Replace libsparsehash with sparsehash-c11
- use sparsehash-c11 over libsparsehash
- fix typos in find_sparsehash and users of the vars (s/SPARCE/SPARSE/)
- drop libsparsehash-dev from docker images (but keep for unbunlded build)
- use ::google over GOOGLE_NAMESPACE
2019-09-18 00:08:20 +03:00
Ivan Lezhankin
8c356a3830 WIP 2019-09-15 18:20:31 +03:00
Ivan Lezhankin
01fdb802d4 Useful changes 2019-09-15 13:35:12 +03:00
Ivan Lezhankin
5b60053ef7 [WIP] 2019-09-13 17:56:27 +03:00
Ivan Lezhankin
e692a88196 CMake now works
Example: -DCMAKE_SYSTEM_NAME=Darwin -DSDK_PATH=${HOME}/stuff/MacOSX10.12.sdk -DLINKER_NAME=${HOME}/.local/bin/ld64
2019-09-13 17:56:27 +03:00
Ivan Lezhankin
f01706ad11 Refactor some cmake files 2019-09-13 17:56:26 +03:00
Ivan Lezhankin
ac47427b76 cmake/test_cpu → cmake/cpu_features 2019-09-13 17:54:22 +03:00
Ivan Lezhankin
393bf8a804 cmake/find_* → cmake/find/* 2019-09-13 17:54:22 +03:00
Amos Bird
bf799fef92 Build fix 2019-09-11 10:53:56 +08:00
proller
54a5b801b7 Build fixes (Orc, ...) (#6835)
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)

* wip

* Fix build (orc, ...)

* Missing files

* Try fix

* fix hdfs

* Fix llvm 7.1 find
2019-09-10 00:40:40 +03:00
CurtizJ
3b3657ff1e Merge branch 'add-ext-dict-redis' of https://github.com/comunodi/ClickHouse into merging_redis 2019-09-09 13:51:50 +03:00
Ivan
cd5c0fc9ac
Fix build issues (#6744)
* libcxxabi uses exception handling library as public
* Don't set -stdlib for internal libc++ - it poisons the checks.
* Enable capnproto in unbundled build back
2019-08-30 20:40:27 +03:00
alexey-milovidov
358ad13930
Merge pull request #6715 from yandex/remove-mimalloc
Remove mimalloc
2019-08-30 00:41:33 +03:00
Ivan Lezhankin
85afd61c01 Fix build with internal libcxx 2019-08-29 13:44:22 +03:00
Ivan
b4339f266d
Make a better build scheme (#6500)
* Fix shared build
* Major default libs refactor
* Fix build with gcc_eh
* Link all libraries as a big group.
* Use global interface library as a group
* Build capnproto using our cmake
* Use only internal libunwind
2019-08-28 23:49:37 +03:00
Alexey Milovidov
39d50b5144 Remove mimalloc 2019-08-28 22:01:52 +03:00
akonyaev
caf0d30a5f ADQM-34 add orc input format 2019-08-21 17:19:47 +03:00
alex-zaitsev
1e6437e4ee WIP: Fix MacOS build (#6429)
* Fix broken MacOS build

* Fix MacOS build

* Update ReadBufferFromFile.cpp

* Update WriteBufferFromFile.cpp

* Update Elf.h

* Update Elf.h
2019-08-21 03:35:41 +03:00
proller
d09c5c871b Build fixes (#6491)
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)
2019-08-18 01:53:46 +03:00
Vitaly Baranov
75aa1d7858
Merge pull request #6320 from yandex/simdjson-sse42
Enabled SIMDJSON for SSE 4.2 with PCLMUL instruction set
2019-08-13 23:12:40 +03:00
alexey-milovidov
c8a810ef58
Merge branch 'master' into fix25 2019-08-10 01:21:54 +03:00
Alexey Milovidov
7e6b1333a1 Renamed Yandex CTO just in case 2019-08-10 00:58:17 +03:00
Vitaly Baranov
0154cdf13b Remove checks for AVX2 from cmake lists which are no longer needed. 2019-08-07 17:08:15 +03:00
proller
274eb83602 fix 2019-08-05 10:52:41 +00:00
proller
4f9d870fca Fix arm and freebsd build 2019-08-04 12:37:59 +00:00