Commit Graph

830 Commits

Author SHA1 Message Date
Alexander Kuzmenkov
51c1a120b8 Update lz4 to see if it fixes an msan failure.
The failure goes like this:

https://clickhouse-test-reports.s3.yandex.net/7946/1f69a7a015468099b7395ce3b96fb638b9830e0b/functional_stateless_tests_(memory)/stderr.log

```
==199==WARNING: MemorySanitizer: use-of-uninitialized-value
    #0 0x2009fc34 in LZ4_count /build/obj-x86_64-linux-gnu/../contrib/lz4/lib/lz4.c:541:13
    #1 0x2009fc34 in LZ4_compress_generic /build/obj-x86_64-linux-gnu/../contrib/lz4/lib/lz4.c:999
    #2 0x2009fc34 in LZ4_compress_fast_extState /build/obj-x86_64-linux-gnu/../contrib/lz4/lib/lz4.c:1140
    #3 0x200ac663 in LZ4_compress_fast /build/obj-x86_64-linux-gnu/../contrib/lz4/lib/lz4.c:1211:14
    #4 0x200ac663 in LZ4_compress_default /build/obj-x86_64-linux-gnu/../contrib/lz4/lib/lz4.c:1222
    #5 0x1b76d2e8 in DB::CompressionCodecLZ4::doCompressData(char const*, unsigned int, char*) const /build/obj-x86_64-linux-gnu/../dbms/src/Compression/CompressionCodecLZ4.cpp:45:12
```
2019-12-12 20:55:27 +03:00
alexey-milovidov
51ed10ed78
Merge pull request #8011 from Jokser/aws-s3-sdk-integration
AWS SDK S3 integration
2019-12-12 20:43:16 +03:00
Pavel Kovalenko
988e4e4390 AWS SDK integration - add patch file for original curl CMakeLists.txt 2019-12-12 20:08:51 +03:00
Pavel Kovalenko
98c5ab5094 AWS SDK integration - set default ca_bundle and ca_path for curl build. 2019-12-12 19:57:37 +03:00
Pavel Kovalenko
980c82a2b5 AWS SDK integration - add curl license and references to original curl CMake files. 2019-12-11 17:31:48 +03:00
alexey-milovidov
309653f60d
Merge pull request #7182 from ClickHouse/aku/zlib-msan
Update zlib-ng to fix MemorySanitizer problems.
2019-12-11 02:15:16 +03:00
Alexey Milovidov
da4631fe31 Updated Poco submodule for #8126 2019-12-10 22:55:14 +03:00
Alexander Kuzmenkov
9e09c419db fixup: update zlib 2019-12-10 19:36:28 +03:00
Pavel Kovalenko
563ef63354 AWS SDK integration - optional openssl for aws_s3. 2019-12-10 18:35:21 +03:00
Pavel Kovalenko
50173584c1 AWS SDK integration - don't use CA in curl build if openssl is disabled. 2019-12-10 17:33:07 +03:00
Pavel Kovalenko
509068c513 AWS SDK integration - curl makefile cleanup. 2019-12-10 16:23:49 +03:00
Pavel Kovalenko
28d4e7db65 AWS SDK integration - build curl manually. 2019-12-10 15:30:39 +03:00
Alexander Kuzmenkov
fc70b03891 Build zlib-ng static lib 2019-12-10 13:15:18 +03:00
Alexander Kuzmenkov
2dafdb9c5e Update zlib-ng to fix MemorySanitizer problems.
See 78406af8241471e7ff5e1ce9eb4d94cea596e863.
2019-12-10 13:15:18 +03:00
Pavel Kovalenko
7142919e8f AWS SDK integration - build curl external project before libcurl library. 2019-12-09 15:51:37 +03:00
Pavel Kovalenko
8e2136dbf5 AWS SDK integration - fixed build for aws-c-common lib. 2019-12-09 14:22:57 +03:00
Pavel Kovalenko
1289966a70 Update submodule heads. 2019-12-09 13:31:59 +03:00
Pavel Kovalenko
a9dfefd37f AWS SDK integration rework. 2019-12-06 17:37:21 +03:00
Nikolai Kochetov
f0dd0de9ec Revert submodule change. 2019-12-06 12:13:36 +03:00
Sergei Shtykov
459bfc314b Merge branch 'master' of github.com:ClickHouse/ClickHouse into en-docs/CLICKHOUSEDOCS-466-query-profiler-settings 2019-12-05 19:54:00 +03:00
Pavel Kovalenko
a9e2327ec0 AWS S3 SDK integration. 2019-12-03 19:23:24 +03:00
alexey-milovidov
febb7f6aca
Merge pull request #7956 from amosbird/hdfsabi
utilize libunwind to achieve better abi-compat
2019-12-02 12:57:55 +03:00
Amos Bird
e12e1ecd13
utilize libunwind to achieve better abi-compat 2019-11-28 18:59:21 +08:00
Amos Bird
2f6643b03c
old kernel hdfs support 2019-11-27 15:14:23 +08:00
alexey-milovidov
9b25e476d7
Merge pull request #7838 from filimonov/issue7383_update_libunwind
Disable DwarfFDECache in libunwind
2019-11-21 00:27:14 +03:00
Mikhail Filimonov
c8def1b29e Updated libunwind and protobuf to fix gcc-9 build and #7114 2019-11-20 17:38:42 +01:00
BayoNet
194c25a2a7 CLICKHOUSEDOCS-466: EN docs for query_profiler* settings. 2019-11-20 12:15:52 +03:00
Vitaly Baranov
db9de2fa0d Update Poco to a new version. 2019-11-19 19:26:41 +03:00
Mikhail Filimonov
5504e3d768 Disable DwarfFDECache in libunwind 2019-11-19 13:04:42 +01:00
alexey-milovidov
5e46576d20
Update CMakeLists.txt 2019-11-02 11:46:35 +03:00
alexey-milovidov
fa3a2bb533
Update CMakeLists.txt 2019-11-01 22:16:03 +03:00
Ernest Poletaev
de1e5d0e53 Fixed compile errors on macOS Catalina 2019-11-01 23:33:43 +07:00
Azat Khuzhin
fe98e90d0d Avoid conflicts of static zlib and mariadb-connector-c zlib
After crc32() had been replaced with crc32_z() the following error will
happen with two different zlib:
  2019-10-25 09:48:42 /usr/bin/ld.gold: error: contrib/zlib-ng/libz.a(crc32.c.o): multiple definition of 'get_crc_table'
  2019-10-25 09:48:42 /usr/bin/ld.gold: contrib/mariadb-connector-c/libmariadb/libmariadbclient.a(crc32.c.o): previous definition here

Fix this by using zlibstatic compiled for and by CH in
mariadb-connector-c, and wrap into function reduce variable scopes.
2019-10-25 23:32:33 +03:00
alesapin
7e5b05bbe8
Revert "Remove hardcoded paths in unwind target" 2019-10-24 23:55:41 +03:00
Konstantin Podshumok
d1a19d26e8
Remove hardcoded paths in unwind target
In most cases they match defaults now, but it is too hard to override when one needs to (alternative builds)
2019-10-23 20:33:40 +03:00
alexey-milovidov
2a9e2ab45c
Merge pull request #7388 from amosbird/ubunaligned
murmurhash32 ubsan fix.
2019-10-19 06:21:20 +03:00
Amos Bird
ecebbbf5a6
murmurhash32 ubsan fix. 2019-10-19 03:25:20 +08:00
Ivan
e595df05d9
Fix CREATE TABLE AS from table with virtual columns (#7183)
* Disable undefined instrumentation for rdkafka
2019-10-17 14:12:35 +03:00
Amos Bird
b0d4baccc8 Enable musl and jemalloc for arm.
Can generate better arm packages.
2019-10-14 00:06:54 +08:00
proller
594c535bd4 Build fixes (#7063)
* Build fixes

*            fix

* Fix

* fix

* Fix install(export..

* Freebsd fixes

* Freebsd fixes

* Fix warning

* fix

* More PRIVATE linking

* Fix review

* Timmy

* fix

* fix
2019-10-05 22:25:31 +03:00
Ivan
381947509a
Fix build for Darwin (#7149)
* Disable some contribs for cross-compilation
* Fix clang-8-darwin build
* Also fix docs
* Add diagnostics
* Check cross-compilation in each file individually.
* Disable warning for clang < 9
2019-10-02 17:35:07 +03:00
Yuriy
c6b18c9fe8 disabled auth_gssapi_client plugin 2019-09-28 03:27:53 +03:00
Yuriy
403b156114 fixed build without glibc-compatibility 2019-09-25 01:30:26 +03:00
Yuriy
dfb762d93c Revert "Revert "Updated MariaDB""
This reverts commit f8b7cc8693.
2019-09-25 01:28:59 +03:00
Yuriy Baranov
f8b7cc8693
Revert "Updated MariaDB" 2019-09-24 05:11:52 +03:00
alexey-milovidov
2f195ddb03
Merge pull request #7028 from abyss7/issue-6459
Implement cross-compilation support Linux → Darwin
2019-09-24 02:20:17 +03:00
alexey-milovidov
4602de0e2c
Merge pull request #6945 from yurriy/mysql
Updated MariaDB
2019-09-24 02:16:12 +03:00
Yuriy
eb0d7073df Merge branch 'mysql' of https://github.com/yurriy/ClickHouse into mysql 2019-09-23 21:03:28 +03:00
Yuriy
2b5d8d53d9 updated mariadb-connector-c 2019-09-23 21:02:57 +03:00
Ivan Lezhankin
ce2fb6d3d1 Fix build 2019-09-23 17:46:01 +03:00
alexey-milovidov
f3ba89ccef
Empty commit to trigger CI 2019-09-23 01:48:21 +03:00
Yuriy
e42e26a453 updated contrib/mariadb-connector-c 2019-09-22 04:57:58 +03:00
Ivan Lezhankin
9e46118edd Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-20 21:25:55 +03:00
Ivan Lezhankin
967e00a8da It works!
if compiled with:

CC=clang CXX=clang++ cmake -Wno-dev . -Bbuild -GNinja -DCMAKE_AR:FILEPATH=x86_64-apple-darwin-ar -DCMAKE_RANLIB:FILEPATH=x86_64-apple-darwin-ranlib -DCMAKE_SYSTEM_NAME=Darwin -DSDK_PATH=MacOSX10.14.sdk -DLINKER_NAME=x86_64-apple-darwin-ld -DUSE_SNAPPY=OFF -DENABLE_SSL=OFF -DENABLE_PROTOBUF=OFF -DENABLE_PARQUET=OFF -DENABLE_READLINE=OFF -DENABLE_ICU=OFF -DENABLE_FASTOPS=OFF
2019-09-20 20:09:22 +03:00
Azat Khuzhin
780341060f
Replace libsparsehash with sparsehash-c11
- use sparsehash-c11 over libsparsehash
- fix typos in find_sparsehash and users of the vars (s/SPARCE/SPARSE/)
- drop libsparsehash-dev from docker images (but keep for unbunlded build)
- use ::google over GOOGLE_NAMESPACE
2019-09-18 00:08:20 +03:00
Yuriy
89524cff46 link with glibc-compatibility before libm 2019-09-16 05:32:38 +03:00
Yuriy Baranov
2d53ab3f18 Merge remote-tracking branch 'origin/master' into mysql 2019-09-16 01:29:09 +00:00
Yuriy
040e63eba4 disabled tests of mariadb-connector-c 2019-09-16 01:30:55 +03:00
Yuriy
fd0c76131f removed contrib/mariadb-connector-c-cmake 2019-09-15 23:44:34 +03:00
Yuriy
84cfbb8e69 simplified mariadb-connector-c compilation and fixed caching_sha2_password plugin 2019-09-15 23:09:09 +03:00
Ivan Lezhankin
8c356a3830 WIP 2019-09-15 18:20:31 +03:00
Amos Bird
7b30835b13 Fix build error when cmake_minimum_required(3.12) 2019-09-10 20:46:39 +08:00
proller
54a5b801b7 Build fixes (Orc, ...) (#6835)
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)

* wip

* Fix build (orc, ...)

* Missing files

* Try fix

* fix hdfs

* Fix llvm 7.1 find
2019-09-10 00:40:40 +03:00
Ivan
cd5c0fc9ac
Fix build issues (#6744)
* libcxxabi uses exception handling library as public
* Don't set -stdlib for internal libc++ - it poisons the checks.
* Enable capnproto in unbundled build back
2019-08-30 20:40:27 +03:00
alexey-milovidov
358ad13930
Merge pull request #6715 from yandex/remove-mimalloc
Remove mimalloc
2019-08-30 00:41:33 +03:00
Alexey Milovidov
260b8c7fa7 Removed obsolete directory 2019-08-29 18:32:25 +03:00
Ivan Lezhankin
0e606c790e Fix install of libcxx and libcxxabi 2019-08-29 16:38:18 +03:00
Ivan Lezhankin
36abd1e6fc Fix build 2019-08-29 14:09:01 +03:00
Ivan Lezhankin
85afd61c01 Fix build with internal libcxx 2019-08-29 13:44:22 +03:00
Ivan
b4339f266d
Make a better build scheme (#6500)
* Fix shared build
* Major default libs refactor
* Fix build with gcc_eh
* Link all libraries as a big group.
* Use global interface library as a group
* Build capnproto using our cmake
* Use only internal libunwind
2019-08-28 23:49:37 +03:00
Alexey Milovidov
abdd70fcc4 Fixed "splitted" build 2019-08-23 18:01:36 +03:00
Alexey Milovidov
dce9753215 Fix splitted build. 2019-08-23 00:44:40 +03:00
akonyaev
caf0d30a5f ADQM-34 add orc input format 2019-08-21 17:19:47 +03:00
alexey-milovidov
c0514ddd9b
Merge pull request #6512 from yurriy/sha256-in-mariadb-connector-c
Enabled sha256_password plugin in MariaDB Connector/C
2019-08-18 01:47:37 +03:00
Vitaly Baranov
e7a2565290
Merge pull request #6479 from vitlibar/no-allocation-in-simdjson-iterator
Get rid of dynamic allocation in ParsedJson::Iterator.
2019-08-16 20:58:16 +03:00
Yuriy
d78c4ec7b9 dependencies of caching_sha2_pw.c 2019-08-16 19:27:49 +03:00
Vitaly Baranov
69ed5279b5 Get rid of dynamic allocation in ParsedJson::Iterator. 2019-08-16 15:48:48 +03:00
Yuriy
d8efa5a842 added missing caching_sha2_pw.c 2019-08-16 03:59:59 +03:00
Yuriy
c08d01cfb4 linking caching_sha2_password plugin statically 2019-08-16 02:03:58 +03:00
Yuriy
b288611472 static linking of sha256_password in mariadb-connector-c 2019-08-16 01:03:30 +03:00
alesapin
cdc6d6c1ba
Merge pull request #6466 from yandex/poco-check-bad-uri
Check bad URIs in Poco library
2019-08-14 14:43:50 +03:00
Vitaly Baranov
75aa1d7858
Merge pull request #6320 from yandex/simdjson-sse42
Enabled SIMDJSON for SSE 4.2 with PCLMUL instruction set
2019-08-13 23:12:40 +03:00
Alexey Milovidov
4b9ae60bd1 Check bad URIs in Poco library 2019-08-13 14:25:37 +03:00
Vitaly Baranov
d8684bef28 Unfork simdjson (they accepted our changes). 2019-08-09 21:43:19 +03:00
alesapin
ca51d3f1d1 Update poco again 2019-08-08 18:05:47 +03:00
alesapin
9086dba26e Comments in code 2019-08-07 22:11:14 +03:00
alesapin
48b48844a4 Update poco submodule for broken timeouts 2019-08-07 20:40:57 +03:00
Vitaly Baranov
0154cdf13b Remove checks for AVX2 from cmake lists which are no longer needed. 2019-08-07 17:08:15 +03:00
alexey-milovidov
f3dfd1c410
Merge pull request #6317 from yandex/fastops
Using Danila Kutenin variant to make fastops working
2019-08-06 17:45:35 +03:00
Alexey Milovidov
98e6dbdd87 Fixed CMake 2019-08-04 13:58:43 +03:00
Alexey Milovidov
64c42930e6 Using Danila Kutenin variant to make fastops working 2019-08-04 06:36:57 +03:00
alexey-milovidov
7388454eb2
Merge pull request #6306 from yandex/simdjson-update
Updated SIMDJSON
2019-08-04 06:29:28 +03:00
alexey-milovidov
14671d6df8
Merge pull request #6254 from yandex/fastops
Integration with "FastOps" library. Added functions sigmoid and tanh.
2019-08-04 06:28:34 +03:00
proller
77bd2624ea Build fixes (#6016)
* Fix building without submodules

* Fix more gcc9 warnings

* was wrong!
../dbms/src/IO/WriteBufferAIO.cpp:277:54: error: result of comparison 'ssize_t' (aka 'long') > 9223372036854775807 is always false [-Werror,-Wtautological-type-limit-compare]
    if ((static_cast<ssize_t>(flush_buffer.offset()) > std::numeric_limits<off_t>::max()) ||
         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

* mimalloc off MI_OVERRIDE

* Fix freebsd build

* Fix shared build

* Fix build in gcc9

* Fix split build

* fix

* fix

* fix

* fix

* clean

* zstd

* Update CMakeLists.txt

* Update Defines.h

* Try fix -Wsign-compare

* Freebsd fix

* Add missing libs

* Fix double-conversion include for copy-headers

* Fix zlib link

* Fix includes for arcadia

* Fix includes for arcadia

* Fix includes for arcadia

* Freebsd fix

* Arcadia fixes

* Update QueryProfiler.cpp

* Freebsd fix

* clean

* 19.11: Fixes for arcadia porting (#6223)

* fix glibc-compatibility

* M_LIBRARY fix

* wip

* Fix

* Fix arm build

* unwind fix

* Update CMakeLists.txt
2019-08-04 03:19:03 +03:00
Alexey Milovidov
ee19bca191 Make dynamic dispatching to really work 2019-08-04 02:47:32 +03:00
Alexey Milovidov
47a47e49c4 Make dynamic dispatch free of TSan warnings 2019-08-04 01:57:14 +03:00
Alexey Milovidov
63f508ae04 Merge branch 'master' into simdjson-update 2019-08-03 23:12:24 +03:00
Alexey Milovidov
aa1569ffba Merge branch 'fastops' of github.com:yandex/ClickHouse into fastops 2019-08-03 06:25:07 +03:00
Alexey Milovidov
b9d39f4882 Merge branch 'master' into fastops 2019-08-03 06:24:33 +03:00
Alexey Milovidov
61541a76e6 Update hyperscan; avoid hyperscan rebuilds 2019-08-03 03:15:17 +03:00