Commit Graph

509 Commits

Author SHA1 Message Date
alesapin
3e068b81de Add loading of external dictionaries 2019-10-15 17:09:57 +03:00
Vitaly Baranov
12d1d87d64 Move authentication code to a separate class. 2019-10-11 00:18:52 +03:00
proller
594c535bd4 Build fixes (#7063)
* Build fixes

*            fix

* Fix

* fix

* Fix install(export..

* Freebsd fixes

* Freebsd fixes

* Fix warning

* fix

* More PRIVATE linking

* Fix review

* Timmy

* fix

* fix
2019-10-05 22:25:31 +03:00
Azat Khuzhin
4b9d711f07 Add missing linking with PocoXML for clickhouse_common_io
Otherwise unbundled build fail with:
  FAILED: dbms/libclickhouse_common_iod.so
  ...
  ../dbms/src/IO/WriteBufferFromS3.cpp:143: error: undefined reference to 'Poco::XML::InputSource::InputSource(std::istream&)'
  ../dbms/src/IO/WriteBufferFromS3.cpp:144: error: undefined reference to 'Poco::XML::DOMParser::DOMParser(Poco::XML::NamePool*)'
  ../dbms/src/IO/WriteBufferFromS3.cpp:145: error: undefined reference to 'Poco::XML::DOMParser::parse(Poco::XML::InputSource*)'
  ../dbms/src/IO/WriteBufferFromS3.cpp:146: error: undefined reference to 'Poco::XML::Document::getElementsByTagName(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) const'
  ../dbms/src/IO/WriteBufferFromS3.cpp:144: error: undefined reference to 'Poco::XML::DOMParser::~DOMParser()'
  ../dbms/src/IO/WriteBufferFromS3.cpp:143: error: undefined reference to 'Poco::XML::InputSource::~InputSource()'
  ../dbms/src/IO/WriteBufferFromS3.cpp:144: error: undefined reference to 'Poco::XML::DOMParser::~DOMParser()'
  ../dbms/src/IO/WriteBufferFromS3.cpp:143: error: undefined reference to 'Poco::XML::InputSource::~InputSource()'
  collect2: error: ld returned 1 exit status
2019-10-04 19:48:10 +03:00
Amos Bird
dadc613072 Get rid of malloc symbols in libcommon (#7134) 2019-09-30 14:58:32 +03:00
Ivan
e5a5091556
Revert "Get rid of malloc symbols in libcommon (#7065)" (#7131)
This reverts commit 4cb53093a0.
2019-09-27 16:16:53 +03:00
Amos Bird
4cb53093a0 Get rid of malloc symbols in libcommon (#7065) 2019-09-27 15:19:26 +03:00
Ivan Lezhankin
9e46118edd Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-20 21:25:55 +03:00
alexey-milovidov
0bdb48ed65
Merge pull request #6966 from azat-archive/build--fixes
Add missing linking with jemalloc
2019-09-19 01:52:22 +03:00
Azat Khuzhin
6cb5d0046b
Add missing linking with jemalloc for clickhouse_common_io
clickhouse_common_io incudes new_delete.cpp, that uses memory.h, which
uses sdallocx (jemalloc).

And since there is -Wl,--no-undefined every undefined symbols are not
allowed, hence clickhouse_common_io must know about sdallocx symbol.

For the default build (-DUNBUNDLED=OFF) everything is good, because
jemalloc is static, and clickhouse_common_io linked with libcommon
(which is linked with jemalloc)

But if jemalloc will be shared, and clickhouse_common_io and libcommon
is different shared libraries then clickhouse_common_io should be linked
with jemalloc, otherwise you will undefined reference to sdallocx error.

This can be reproduced using the following build configuration:
   -DUSE_STATIC_LIBRARIES=OFF -DCLICKHOUSE_SPLIT_BINARY=ON -DSPLIT_SHARED_LIBRARIES=ON -DUNBUNDLED=ON
Provided that you have systemd-wide jemalloc>=4 (see memory.h).

Refs: https://github.com/yandex/ClickHouse/pull/6878#discussion_r324902295
v2: do not link jemalloc if it is static
2019-09-18 21:26:23 +03:00
Azat Khuzhin
780341060f
Replace libsparsehash with sparsehash-c11
- use sparsehash-c11 over libsparsehash
- fix typos in find_sparsehash and users of the vars (s/SPARCE/SPARSE/)
- drop libsparsehash-dev from docker images (but keep for unbunlded build)
- use ::google over GOOGLE_NAMESPACE
2019-09-18 00:08:20 +03:00
Ivan Lezhankin
8c356a3830 WIP 2019-09-15 18:20:31 +03:00
Ivan Lezhankin
787c2b8d83 WIP 2019-09-15 13:35:19 +03:00
Ivan Lezhankin
01fdb802d4 Useful changes 2019-09-15 13:35:12 +03:00
Amos Bird
9152a832c4 Robust shared build 2019-09-12 04:01:46 +08:00
Amos Bird
bf799fef92 Build fix 2019-09-11 10:53:56 +08:00
Amos Bird
a1310ffbe6 Split libdbms.so using object library
Now the linking time of incremental builds are around 1-2 seconds
2019-09-11 01:56:01 +08:00
Olga Khvostikova
4129d8cf60
Merge pull request #6092 from yandex/globs-in-file-one-more-attempt
Globs in storage file and HDFS
2019-09-05 23:05:37 +03:00
alexey-milovidov
b2e80b0cd9
Merge branch 'master' into query_masking 2019-09-03 22:58:15 +03:00
alexey-milovidov
358ad13930
Merge pull request #6715 from yandex/remove-mimalloc
Remove mimalloc
2019-08-30 00:41:33 +03:00
Ivan
b4339f266d
Make a better build scheme (#6500)
* Fix shared build
* Major default libs refactor
* Fix build with gcc_eh
* Link all libraries as a big group.
* Use global interface library as a group
* Build capnproto using our cmake
* Use only internal libunwind
2019-08-28 23:49:37 +03:00
Alexey Milovidov
39d50b5144 Remove mimalloc 2019-08-28 22:01:52 +03:00
dimarub2000
6fe40a0d90
Merge branch 'master' into perfomance_test_help_size 2019-08-28 16:38:54 +03:00
Dmitry Rubashkin
5989b19684 Final 2019-08-26 22:16:28 +03:00
Alexey Milovidov
c4712f1e6e Make the code less bad 2019-08-23 02:22:57 +03:00
stavrolia
6055c61e7f wip hdfs 2019-08-19 21:12:50 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
proller
77bd2624ea Build fixes (#6016)
* Fix building without submodules

* Fix more gcc9 warnings

* was wrong!
../dbms/src/IO/WriteBufferAIO.cpp:277:54: error: result of comparison 'ssize_t' (aka 'long') > 9223372036854775807 is always false [-Werror,-Wtautological-type-limit-compare]
    if ((static_cast<ssize_t>(flush_buffer.offset()) > std::numeric_limits<off_t>::max()) ||
         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

* mimalloc off MI_OVERRIDE

* Fix freebsd build

* Fix shared build

* Fix build in gcc9

* Fix split build

* fix

* fix

* fix

* fix

* clean

* zstd

* Update CMakeLists.txt

* Update Defines.h

* Try fix -Wsign-compare

* Freebsd fix

* Add missing libs

* Fix double-conversion include for copy-headers

* Fix zlib link

* Fix includes for arcadia

* Fix includes for arcadia

* Fix includes for arcadia

* Freebsd fix

* Arcadia fixes

* Update QueryProfiler.cpp

* Freebsd fix

* clean

* 19.11: Fixes for arcadia porting (#6223)

* fix glibc-compatibility

* M_LIBRARY fix

* wip

* Fix

* Fix arm build

* unwind fix

* Update CMakeLists.txt
2019-08-04 03:19:03 +03:00
Alexey Milovidov
0d55faf2dd Speed up stack traces for debug build 2019-08-03 23:47:57 +03:00
Alexey Milovidov
d95e0e66c6 Fixed "splitted" build 2019-07-30 21:03:12 +03:00
Alexey Milovidov
1d289b5b49 Fixed "splitted" build 2019-07-30 18:22:41 +03:00
Alexey Milovidov
372c4d89b2 Enabled line numbers in stack traces 2019-07-30 01:26:44 +03:00
alexey-milovidov
e4ad0da6e3
Merge pull request #4247 from laplab/query-poor-mans-profiler
Poor man's profiler on query level [Work in progress]
2019-07-23 03:02:58 +03:00
Mikhail Filimonov
9c2ae4513d SensitiveDataMasker 2019-07-19 10:22:42 +02:00
alexey-milovidov
6706af64d7
Merge pull request #5981 from 4ertus2/some
Count new/delete memory in MemoryTracker
2019-07-18 23:07:00 +03:00
Amos Bird
a3312106af Misc build fix 2019-07-17 02:27:11 +08:00
chertus
8c715d9b91 minor fix in cmake-files 2019-07-12 20:22:20 +03:00
chertus
37bee1104d Merge branch 'master' into some 2019-07-12 18:16:03 +03:00
chertus
9bd42366f0 build fixes 2019-07-12 17:41:59 +03:00
Nikolai Kochetov
e9f3d4d6b8
Merge pull request #4914 from yandex/processors
Processors
2019-07-11 19:22:02 +03:00
chertus
9739ac13e4 move new/delete overloads to dbms/src/Common 2019-07-11 18:40:55 +03:00
Alexey Milovidov
499d798b34 Remove "clickhouse_compression" library because it is not a library (cyclic dependency via IDataType) 2019-07-10 00:37:43 +03:00
Alexey Milovidov
e07235e294 Addition to prev. revision 2019-07-08 21:55:06 +03:00
Nikolai Kochetov
209793c981 Merged with master. 2019-07-08 16:00:54 +03:00
Alexey Milovidov
ac20c515ab Better code in unit tests 2019-07-08 04:58:31 +03:00
Alexey Milovidov
03712aabec Add two more warnings from -Weverything 2019-07-08 03:16:39 +03:00
Nikita Lapkov
e935cb08a8 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-07 01:06:10 +00:00
Nikita Lapkov
0f579860f7 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-04 22:13:51 +00:00
Ivan Lezhankin
3b995bdb02 Add missing dependecies on sight to enable --no-undefined option 2019-07-04 17:05:55 +03:00
Alexey Milovidov
7ca7d6c774 Initial support for clang-tidy (not yet useful) 2019-06-30 21:56:53 +03:00
Danila Kutenin
e67431e455 Use mimalloc instead of lfallocator 2019-06-27 18:13:19 +03:00
Nikita Lapkov
7cff36fbfc Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-06-26 11:46:04 +00:00
Nikolai Kochetov
f9b29bfdd2 Merged with master. 2019-06-25 20:00:54 +03:00
proller
1ac09fa721
Split Common/config.h by libs (dbms) (#5715) 2019-06-24 14:17:15 +03:00
proller
3d8c8ee83c
Build fixes. Split config.h (#5686) 2019-06-20 12:12:49 +03:00
proller
a813a001e2
Allow to use internal compiler with system includes (fix compile for freebsd) (#5447)
* Allow to use internal compiler with system includes (fix compile for freebsd)
* Fix macos build
2019-05-30 15:58:15 +03:00
Nikita Lapkov
382beefdb8 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-21 22:52:57 +00:00
Alexey Milovidov
48f921120c Fixed linking in "splitted" mode 2019-05-17 01:58:29 +03:00
Alexey Milovidov
dd9e993a87 Fixed issue #3540 (in progress) 2019-05-17 00:09:06 +03:00
proller
51ca4cbaa4
Build fixes (#5278) 2019-05-15 20:19:39 +03:00
Nikolai Kochetov
808d0f3b08 Merged with master. 2019-05-14 13:31:19 +03:00
Nikita Lapkov
6dbe205b55 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-12 16:16:30 +00:00
proller
c6d0e095e0
Prepare cmake for new contrib/poco (#5062) 2019-04-25 00:33:04 +03:00
proller
ba4687e110
Cmake: dont use LINK_MODE (but use BUILD_SHARED_LIBS) (#5091) 2019-04-24 12:06:28 +03:00
proller
29c3433322
Freebsd build fixes (#5083) 2019-04-23 15:51:27 +03:00
proller
525726a5e2
Remove pocoext (#5036) 2019-04-17 20:36:58 +03:00
alesapin
faeb95cfd7
Merge branch 'master' into adaptive_index_granularity 2019-04-15 19:36:36 +03:00
Danila Kutenin
622b2c8472 Enable LFAlloc for MarkCache and UncompressedCache 2019-04-13 15:07:43 +03:00
alesapin
a53b002973 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-04-08 14:29:33 +03:00
Nikita Lapkov
fbdf2c3525 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-04-06 06:58:40 +00:00
proller
5b1bde2e80 CLICKHOUSE-4387 Add (official build) to version of yandex builds 2019-04-03 17:06:59 +03:00
Nikolai Kochetov
5e39ec610c Merged with master 2019-04-03 14:21:38 +03:00
Nikolai Kochetov
94ff7f694a QueryPipeline [in progress]. 2019-04-03 13:14:36 +03:00
proller
67903eeadf Fix tests link 2019-03-28 14:06:28 +03:00
alesapin
1b8392a3d0 Style fixed 2019-03-28 12:02:56 +03:00
Alexey Milovidov
5bd3246e8d Miscellaneous 2019-03-24 02:31:29 +03:00
Nikita Lapkov
4a4ff8d5bf Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-03-23 18:45:22 +00:00
proller
d6d83d4a5c
Allow build without ssl (#4525) (#4750) 2019-03-22 14:18:24 +03:00
proller
8c70de3bc7
Build fixes (freebsd) (#4696) 2019-03-14 23:52:10 +03:00
Nikita Lapkov
12fe175385 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-03-06 10:30:47 +00:00
Nikita Lapkov
fe2adb261a move rt from dbms to clickhouse_common_io 2019-03-06 10:23:03 +00:00
alexey-milovidov
98fe1a6e8b
Update CMakeLists.txt 2019-03-06 04:01:53 +03:00
Alexey Milovidov
01f7efe615 Added support for clang-9 2019-03-06 03:44:25 +03:00
Nikita Lapkov
14e3639caf add rt library for timer_{create,settime,delete} 2019-03-05 23:39:49 +00:00
proller
0afb7dfc7f Fix include 2019-03-05 14:14:24 +03:00
Vitaly Baranov
61e21d50e1
Merge pull request #4207 from andyyzh/bitmap_feature
Added bitmap function feature with roaring bitmap
2019-03-04 22:42:47 +03:00
proller
d2e18d47fb
Fix link in split mode (#4574) 2019-03-04 20:47:31 +03:00
Nikolai Kochetov
c8c2e1fd82 Added NullSource, ExpressionTransform, FilterTransform, LimitByTransform processors. 2019-02-22 20:45:56 +03:00
Nikolai Kochetov
e91a0a31b7 Merge branch 'master' into processors 2019-02-21 19:19:35 +03:00
Nikolai Kochetov
aba56e171c Formats processorss. 2019-02-21 19:05:47 +03:00
proller
e20c77e4c6 Add parquet support. Fixes, tests, ... 2019-02-19 23:51:44 +03:00
proller
88076bb8c9 Merge commit 'bf09c2047a47b74f089d701b9b1e4fcbe8955a7f' into fix23 2019-02-19 23:46:37 +03:00
Alex Zatelepin
cadc023af8
Update CMakeLists.txt
remove redundant statement
2019-02-18 18:24:20 +03:00
Nikolai Kochetov
b6fd31865e Merged with master. 2019-02-15 19:22:29 +03:00
proller
263e69e861
Build fixes (FreeBSD port) (#4397) 2019-02-15 14:46:07 +03:00
Andy Yang
7978b508b4 check 00281_compile_sizeof_packed test case error 2019-02-15 15:02:08 +08:00
Andy Yang
41f474ef64 Merge branch 'bitmap_feature' of https://github.com/andyyzh/ClickHouse into bitmap_feature
merge remote branch
2019-02-14 15:42:43 +08:00
Andy Yang
4a4dbcd2c1 Merge remote-tracking branch 'origin' into bitmap_feature 2019-02-14 15:14:18 +08:00
Mikhail
4fd289c1f4
Merge branch 'master' into brotli 2019-02-12 22:52:23 +03:00
proller
558ebbcc31 New library clickhouse_storage_kafka 2019-02-12 14:17:46 +03:00