Commit Graph

259 Commits

Author SHA1 Message Date
proller
fa2484ea90 Make gperftools (libtcmalloc) as submodule and update. (#1381)
* Update tcmalloc and make submodule

* wip

* wip

* wip

* wip

* clean

* fix

* fix

* fix

* Fix tests
2017-10-24 22:11:42 +03:00
proller
2d2a4afa3f Fix stripping debug info from huge .o (-g0) 2017-10-24 16:30:44 +03:00
Marek Vavruša
a494491f47 contrib: updated librdkafka to v0.11.1@3401fa1
This is the last version with CMake fixes from @proller
2017-10-23 20:47:33 +03:00
proller
ddb0dcd2fd Increase default maximum size of brtie dictionary to 128m ips (#1364)
* Increase default maximum size of brtie dictionary to 128m ips
pbuilder: use newer cmake on ubuntu trusty

* no cmake
2017-10-23 20:19:15 +03:00
Alexey Milovidov
d77686685a Using PODArray instead of std::vector in ZooKeeper library [#CLICKHOUSE-2]. 2017-10-23 18:08:31 +03:00
proller
0eb833c433 Fix tcmalloc compile with old clang 2017-10-18 15:24:56 +03:00
proller
4c7850fdc2 Optional kafka (#1355)
* Zookeeper include fix

* Update submodule contrib/poco

* Fix zookeeper submodule ho-to-make doc

* Update zookeeper submodule

* Update submodule zookeeper

* Fix compile with external zookeeper

* Optional kafka

* fix

* Fix

* fix
2017-10-14 03:53:01 +03:00
proller
142da9550e Fix zookeeper submodule and how-to-make doc (#1354)
* Zookeeper include fix

* Update submodule contrib/poco

* Fix zookeeper submodule ho-to-make doc

* Update zookeeper submodule

* Update submodule zookeeper
2017-10-14 01:53:57 +03:00
alexey-milovidov
9ccdb5420b Merge branch 'master' into upstream-add-kafka 2017-10-13 23:52:42 +03:00
proller
5af5c8d1a7 Update submodule contrib/poco 2017-10-13 23:37:41 +03:00
Alexey Milovidov
b586e2771e Removed old files after creating a submodules [#CLICKHOUSE-2]. 2017-10-13 23:03:44 +03:00
proller
14d9a91b6e Update submodule contrib/poco (warning fixes) 2017-10-13 22:54:22 +03:00
alexey-milovidov
e1e65d7298 Update CMakeLists.txt 2017-10-13 22:24:37 +03:00
proller
4844c99d9d zookeeper 3.4.10 as submodule (#1304)
* zookeeper 3.4.10 as submodule

* fix

* Apply patch
2017-10-13 22:02:41 +03:00
proller
64194c9b03 Updating poco and making submodule (#1263)
* Updating poco part 1: use submodule

* switch to tmp submodule

* update submodule

* wip

* wip

* wip

* wip

* wip

* fix

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* test

* wip

* wip

* wip

* wip

* wip

* wip

* Remove werror

* wip

* wip

* wip

* wip

* wip

* Block pipe signal

* Update poco

* Update and fix poco

* Better sigpipe handler

* Better block sigpipe

* Update BaseDaemon.cpp
2017-10-13 21:58:19 +03:00
proller
fd072b58bb zstd, lz4 as submodule (#1214)
* Contrib: use zstd, lz4 as submodule

* fix shared build

* re-test me.

* wip

* Update CHANGELOG_RU.md

* Update CHANGELOG.md

* Update CHANGELOG_RU.md

* Whitespaces [#CLICKHOUSE-2].

* Implemented TODO [#CLICKHOUSE-2].

* Whitespaces [#CLICKHOUSE-2].

* Remove wrong test

* Implemented TODO [#CLICKHOUSE-2].

* Moved chown to correct place [#CLICKHOUSE-2].

* Resolves #1273. Exception safe users update. [#CLICKHOUSE-3]

* Less noisy logging. [#CLICKHOSUE-2]

* Add metrics for RWLockFIFO. [#CLICKHOUSE-3246]

* Executable dictionaries: fail if program returns non zero exit code (#CLICKHOUSE-3171)

* Add better logging if OPTIMIZE cannot be executed. [#CLICKHOUSE-2]

* test me

* Fixing documentation fragment about "default" user. It is not mandatory anymore.

* append yurial/clickhouse-client to docs/interfaces

* Fixed FREEZE PARTITION: using only active data parts; acquire snapshot of parts [#CLICKHOUSE-3369].

* Removed tcp_ssl_port by default [#CLICKHOUSE-2].

* Update MergeTreeDataMerger.cpp

* Update ShellCommand.cpp

* Disable part sendings and fetches before ALTER. [#CLICKHOUSE-3343]

* Update ExecutableDictionarySource.cpp

* Update ExecutableDictionarySource.cpp

* Miscellaneous changes after merge [#CLICKHOUSE-2].

* Improve tests: allow redefine some values (clickhouse path, ports, ...)

* Received signal Segmentation fault (#1300) (#1302)

* Received signal Segmentation fault (#1300)

* Add test

* Tests: Use new possibly redefined values from env (in 2 tests)

* Proper fix for the issue: better exception message [#CLICKHOUSE-2].

* Split GatherUtils.cpp for faster compile (#1312)

* Split GatherUtils.cpp for faster compile

* remove GatherUtils.cpp

* Fix array writing (#1314)

* changed MergedBlockOutputStream [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* disabled checkNoMultidimensionalArrays [#CLICKHOUSE-3341]

* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]

* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]

* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]

* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]

* added test [#CLICKHOUSE-3341]

* fixed test [#CLICKHOUSE-3341]

* refactoring and comments [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* Update ColumnArray.h

* Update ActionBlocker.h

* Fix section tabulation

* Fixed infinite recursion in expression analyzer. [#CLICKHOUSE-3125]

* Update ActionBlocker.h

* Improvement [#CLICKHOUSE-2].

* Try fix strange terminate (#1329)

* Tests: External: rename --use_http  => --no_http and fix

* Try fix strange terminate

* Misc [#CLICKHOUSE-2].

*  Fix compile CallPointInPolygon on clang4 (Thanks to @vavrusa) (#1333)

* Fix compile with boost 1.65.1+ and clang 3.8 ( https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=222439 )

* Fix compile CallPointInPolygon on clang4 (Thanks to @vavrusa)

* Fix complex queries with GLOBAL IN and UNION ALL  (#CLICKHOUSE-3356) (#1339)

* TEST only: why initQueryAnalyzer ?

* Better tests

* missing file

* Missing file

* Add test

* Test fixes

* Fixed FREEZE PARTITION: using only active data parts; acquire snapshot of parts [#CLICKHOUSE-3369].

* Removed tcp_ssl_port by default [#CLICKHOUSE-2].

* Better tests

* comment

* clean

* REmove wrong code

* clean

* dbms: Added compression level for ZSTD. [#METR-26742]

* dbms: CompressionSettingsSelector. [#METR-21516]

* dbms: Minor fix. [#METR-21516]

* Fix SummingMergeTree argument checking logic.

This patch fixes the Nested Column Name checking logic, which allows nested
columns be explicitly specified in SummingMergeTree engine.
2017-10-13 21:52:23 +03:00
Marek Vavruša
011658bb02 contrib: include librdkafka as submodule 2017-10-10 08:33:00 -07:00
Vladimir Chebotarev
07c964ef3b contrib: Fixed unwind build under GCC 7. [#METR-21516]
See https://gcc.gnu.org/bugzilla/show_bug.cgi?id=81712 .
2017-09-28 23:28:37 +03:00
proller
7d0e5e786e Compile fixes 2017-09-24 15:41:29 +03:00
proller
a355256dd6 Revert "Removed build of shared library and test executables for libzlib-ng [#CLICKHOUSE-2]."
This reverts commit c208220566.
2017-09-18 15:44:54 +03:00
Alexey Milovidov
094c18bb46 Fixed error in boost::filesystem: NULL pointer dereference (reproduced with increased inline-depth in clang) [#CLICKHOUSE-2]. 2017-09-15 16:26:50 +03:00
Alexey Milovidov
c208220566 Removed build of shared library and test executables for libzlib-ng [#CLICKHOUSE-2]. 2017-09-15 12:51:56 +03:00
Alexey Milovidov
104c6d9ddf Fixed warning in Poco [#CLICKHOUSE-2]. 2017-09-11 08:33:36 +03:00
Alexey Milovidov
93f1e274fb Removed unused code from pcg-random, that generates compiler warning by default [#CLICKHOUSE-2]. 2017-09-10 01:43:11 +03:00
Alexey Milovidov
0c41b87647 Fixed insignificant error in Poco, shown by TSan [#CLICKHOUSE-2]. 2017-09-10 01:26:01 +03:00
Alexey Milovidov
2e74123075 Fixed insignificant error in Poco, shown by TSan [#CLICKHOUSE-2]. 2017-09-09 07:08:04 +03:00
Alexey Milovidov
b5c6bb6416 Removed boost::random library [#CLICKHOUSE-3174]. 2017-09-09 03:01:29 +03:00
Alexey Milovidov
f9679a40b1 Added README describing source of imported pcg-random library [#CLICKHOUSE-3174]. 2017-09-09 02:57:52 +03:00
Alexey Milovidov
7896e9d65f Imported pcg-random library (Reason: rng with small size of state, fast initialization, good performance and quality, with interface compatible with C++ standard library. Cause: boost::random::taus88 in latest Boost 1.65 is incompatible with C++17 standard) [#CLICKHOUSE-3174]. 2017-09-09 02:43:28 +03:00
Alexey Milovidov
57d244d739 Removed usage of deprecated C++ feature [#CLICKHOUSE-3174]. 2017-09-08 23:24:11 +03:00
Alexey Milovidov
88e2dd9d74 Added missing file [#CLICKHOUSE-3282]. 2017-09-07 06:47:18 +03:00
Alexey Milovidov
17edcdec96 Updated zstd to version 1.3.1, properly [#CLICKHOUSE-3277]. 2017-09-07 06:33:53 +03:00
Alexey Milovidov
14d5149293 Added missing files [#CLICKHOUSE-3276]. 2017-09-04 22:33:17 +03:00
Alexey Milovidov
8971967651 Added missing files [#CLICKHOUSE-3276]. 2017-09-04 22:31:23 +03:00
Alexey Milovidov
b4d7d8f1de Added missing files [#CLICKHOUSE-3276]. 2017-09-04 22:30:52 +03:00
Alexey Milovidov
6901e80c4c Updated boost; added boost geometry [#CLICKHOUSE-3276]. 2017-09-04 21:56:02 +03:00
proller
f68a0ea63b Fix mysql includes and remove libmariadb submodule (#1185)
* Use bundled libmariadbclient (CLICKHOUSE-3261)

* wip

* wip

* wip

* Update docs about git clone. move docs/en/development/build_*.sh -> utils/build/build_debian.sh

* Fix mysql includes

* Cmake: don't install mariadb targets

* Fix generated includes

* Disable mysql tests

* cmake: mariadb fixes

* Fix

* Update find_mysqlclient.cmake

* Fix zlib

* Remove bundled contrib/mariadb-connector-c

* fix

* Fix build

* Fix includes
2017-09-04 20:04:33 +03:00
proller
1a8e22c37f Allow compile on 32bit systems (#1175)
* Trying compile under 32bit..

* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file

* clnag-format of Split ComplexKeyCacheDictionary

* wip

* Requested changes

* wip

* wip

* Fix boost 1.64 and gcc7+ compile errors

* More fixes

* wip

* Fix arm build

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* fix

* wip

* wip

* clean

* clean

* wip

* wip

* Update MergeTreeSettings.h

* Requested changes

* Requested changes

* Requested changes

* Requested changes
2017-09-01 20:21:03 +03:00
proller
3269b1da57 libmariadb as submodule (CLICKHOUSE-3261) (#1181)
* Use bundled libmariadbclient (CLICKHOUSE-3261)

* wip

* wip

* wip

* Update docs about git clone. move docs/en/development/build_*.sh -> utils/build/build_debian.sh
2017-08-31 20:11:30 +03:00
Hiroaki Nakamura
2d12fea90f Update zstd to 1.3.1 2017-08-24 16:24:33 +03:00
proller
c351b367fb Fix sparcehash include (#1084)
* Fix sparcehash include

* Fix re2_st include
2017-08-10 02:11:28 +03:00
proller
ac178bde1f Cmake: link ltdl with pocoodbc static only. rename ARM -> ARCH_ARM (#1083)
* Cmake: link ltdl with pocoodbc static only. rename ARM -> ARCH_ARM

* Fix lib find order

* Allow define non-contrib cityhash farmhash metrohash

* Fix message

* Cmake: fixes

* clean

* Update CMakeLists.txt
2017-08-09 23:52:55 +03:00
proller
d6833a0d55 Cmake: remove global include_directories (#1055)
* Fix .h compile

* Cmake: remove global include_directories

* boost include hide

* fix cctz

* add \n
2017-08-03 15:44:39 +03:00
proller
465d305479 gcc7 and arm fixes (#1041)
* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file

* gcc7 fixes

* clnag-format of Split ComplexKeyCacheDictionary

* Requested changes

* Fix boost 1.64 and gcc7+ compile errors

* More fixes

* Fix arm build

* Fix nothrow

* Better arm detection
2017-07-29 22:58:10 +03:00
Alexey Zatelepin
8763567e9a fix metrohash build when sse4.2 is disabled 2017-07-24 15:50:02 +03:00
proller
b172f7a0f1 Cmake: clear test variables with CMakePushCheckState (it will fix macos build issue) (#992) 2017-07-17 17:21:43 +03:00
Alexey Milovidov
632d9188cf Applied a patch from Jeff Frasca about file permissions [#CLICKHOUSE-3]. 2017-07-11 04:24:07 +03:00
Георгий Кондратьев
bf3736c55e Fix libunwind config
`#ifdef HAVE_LZMA` check in `contrib/libunwind/src/elfxx.c` expects `HAVE_LZMA`
to be undefined.
2017-06-27 11:53:56 +03:00
proller
2d359fee54 Make libunwind optional. Allow use custom libcctz (#920)
* Make libunwind optional. Allow use custom libcctz

* fix

* Fix

* fix

* Update BaseDaemon.cpp

* Update CMakeLists.txt
2017-06-23 17:41:07 +03:00
Alexey Milovidov
8ef94aa82d Fix for Mac OS [#CLICKHOUSE-3094]. 2017-06-23 08:46:04 +03:00
Alexey Milovidov
aac1a18811 Added CMakeLists for libunwind [#CLICKHOUSE-3094]. 2017-06-23 08:30:50 +03:00
Alexey Milovidov
65753deb7e Using libunwind for stack trace from signal handler [#CLICKHOUSE-3094]. 2017-06-23 08:16:34 +03:00
Alexey Milovidov
a86f72189a Added README for libunwind [#CLICKHOUSE-3094]. 2017-06-23 08:13:39 +03:00
Alexey Milovidov
2aec6efddc Imported unwind library from https://github.com/libunwind/libunwind, rev. 2934cf40529e0261801a4142fabae449a65effd0 [#CLICKHOUSE-3094]. 2017-06-23 08:12:40 +03:00
Alexey Milovidov
6df5d556e5 Changed namespace [#DEVTOOLS-3381]. 2017-06-21 11:35:38 +03:00
Alexey Milovidov
604de2bfeb Better [#DEVTOOLS-3381]. 2017-06-21 04:24:05 +03:00
Георгий Кондратьев
a736ef618a Put ClickHouse variant of CityHash into DB namespace [#DEVTOOLS-3381]
This avoids symbol conflict when linking external applications that use another
variant of CityHash in the global namespace with ClickHouse libraries.
2017-06-20 12:25:16 +03:00
Alexey Milovidov
2af2ddfcb2 Added missing file [#CLICKHOUSE-31]. 2017-06-13 07:14:22 +03:00
proller
1338b03438 Fix freebsd and macos build (contrib/libbtrie) (#806)
* Try fix freebsd 11-STABLE OCbuild

* Fix freebsd and macos build (contrib/libbtrie)
2017-05-17 21:45:44 +04:00
Marek Vavruša
9520234365 Dictionaries/TrieDictionary: IP prefix dictionary
This commit implements a basic IP prefix dictionary
that allows storing IPv4/IPv6 prefixes and
matching them against a single IP address on query
time. This allows for doing IP -> ASN matching and
other similar things on query time.

The implementation is basic for start, using a
simple bitwise trie and reusing interface for
complex key dictionaries (so using tuple instead
of UInt32/FixedString(16) as the key). A faster
bitwise trie implementation (like poptrie) is
desired to improve lookup performance and
memory consumption with large prefix tables.
2017-05-15 10:51:03 +04:00
ivanzhukov
f33494ffe2 Add missing liblz4 header file 2017-05-07 00:10:25 +03:00
kmeaw
6b9fbd2095 Update lz4 library to the latest stable version (1.7.5, 2016-11-28) 2017-05-06 10:48:30 -04:00
Marek Vavruša
d2d7aaac69 contrib/libpoco: update Crypto to last stable
the last stable version 1.7.8 fixes build with
newer OpenSSL that’s in most of the distribution
2017-05-03 23:09:52 -07:00
Alexey Milovidov
5e969e70bc Removed useless code from re2 library build [#CLICKHOUSE-2]. 2017-04-18 00:11:12 +03:00
proller
5996800a73 Fix compiler option -Wno-dynamic-exception-spec 2017-04-17 18:57:50 +03:00
proller
d2b070bb40 Remove compiler option -Wno-dynamic-exception-spec [#CLICKHOUSE-2951] 2017-04-17 17:52:43 +03:00
proller
e3f0ff3c70 tcmalloc: add -Wno-dynamic-exception-spec 2017-04-11 16:30:49 +03:00
proller
29d4471b9d Fix build in gcc7 (#641)
* Fix build in gcc7

* try reduce warn area

* better fix
2017-03-31 08:09:11 +03:00
Vitaliy Lyudvichenko
2ab25099cd Move boost::tests to Google Tests. [#CLICKHOUSE-2] 2017-03-28 20:46:16 +03:00
Vitaliy Lyudvichenko
15254f91d2 Improve CMakeLists.txt for tests. [#CLICKHOUSE-2] 2017-03-28 20:46:16 +03:00
Vitaliy Lyudvichenko
253a0a55fe Add GoogleTest 1.7 framework for unit tests. [#CLICKHOUSE-2] 2017-03-28 20:46:16 +03:00
Vitaliy Lyudvichenko
19a2195710 Implemented re-readable buffers, add unit tests. [#CLICKHOUSE-2070] 2017-03-28 20:46:16 +03:00
proller
0b5731bc59 Try fix "Conditional jump or move depends on uninitialised value(s)" in cctz 2017-03-17 21:38:11 +04:00
Alexey Zatelepin
98a866ee5b split a single large SET_WATCHES message into multiple smaller ones [#CLICKHOUSE-2101]
See https://issues.apache.org/jira/browse/ZOOKEEPER-706 for details.
2017-03-15 23:44:24 +04:00
proller
e96092c66c Freebsd fixes (#555)
* freebsd fixes

* Update SocketImpl.cpp
2017-03-04 05:58:45 +04:00
proller
0e91c47066 Allow build with external double-conversion lz4 zstd re2 zookeeper (#531)
* Allow build with external double-conversion lz4 zstd re2 zookeeper

* fix

* fix

* freebsd fixes

* spaces

* fix

* fix

* fix

* wip

* move

* fix
2017-03-01 03:49:04 +04:00
proller
9bbe8fe5c4 Dynamic library mode (#471)
* Cmake: UNBUNDLED option

* Dynamic library mode
2017-02-08 22:53:00 +04:00
proller
045fd6f55d fix build without readline 2017-02-08 01:40:08 +03:00
proller
f87ae6808f cmake: USE_INTERNAL_ZLIB_LIBRARY (#463)
* Correct fix of building with external poco with disabled sending progress

    Revert "Removed wrong code [#CLICKHOUSE-2]."

    This reverts commit 33f9917f53.

* fix

* fix

* cmake: USE_INTERNAL_ZLIB_LIBRARY
2017-02-08 01:28:13 +04:00
proller
5a9c317b65 Freebsd: libcctz build fix 2017-02-02 19:16:38 +03:00
Alexey Milovidov
c903a23864 Sending progress in HTTP headers (continued) [#CLICKHOUSE-32]. 2017-01-22 19:12:30 +03:00
Alexey Milovidov
93bbaf0e70 Sending progress in HTTP headers (continued) [#CLICKHOUSE-32]. 2017-01-22 18:49:26 +03:00
Alexey Milovidov
3476e4d4c4 Sending progress in HTTP headers (continued) [#CLICKHOUSE-32]. 2017-01-22 18:48:53 +03:00
Alexey Milovidov
b2457e076a Sending progress in HTTP headers (continued) [#CLICKHOUSE-32]. 2017-01-22 18:42:42 +03:00
Alexey Milovidov
a2380fc86b Poco: allow sending and flushing individual HTTP headers [#CLICKHOUSE-32]. 2017-01-22 18:02:24 +03:00
Alexey Milovidov
eec6c54ce1 cctz: removed useless file from build [#CLICKHOUSE-2]. 2017-01-21 07:36:34 +03:00
Alexey Milovidov
ed60f63e26 Added CCTZ to build [#CLICKHOUSE-2]. 2017-01-21 04:24:35 +03:00
Alexey Milovidov
2b311d49e9 Imported CCTZ library from 90ef68be6d [#CLICKHOUSE-2]. 2017-01-21 04:13:22 +03:00
proller
2688f4563f cmake: remove add_definitions(-DNO_TCMALLOC), instead use ENABLE_LIBTCMALLOC from config (#375)
* Manual version update to [54135]

* Temporary release script fix [#METRIQA-732]

* cmake: remove add_definitions(-DNO_TCMALLOC), instead use ENABLE_LIBTCMALLOC from config
2017-01-20 21:58:07 +04:00
proller
f63a3ab167 Fix some errors in apple build (#362)
Fix some errors in apple build
2017-01-18 20:16:35 +03:00
proller
f7c0998599 fix clang build (#353)
* Freebsd clang3.8 compile fixes

* clean

* fix

* fix clang build
2017-01-18 02:48:01 +04:00
proller
29475c94c0 Reorganize includes, less depends in .h files 2017-01-16 22:47:11 +03:00
proller
718b765742 Fix no-pie with clang 2017-01-16 19:29:11 +03:00
Alexey Milovidov
a3d59db251 Fixed error on clang [#CLICKHOUSE-2]. 2017-01-14 12:12:16 +03:00
Alexey Milovidov
e8d7641316 Fixed warning on clang [#CLICKHOUSE-2]. 2017-01-14 12:05:56 +03:00
proller
e2bc0c7471 Add -no-pie flag to linker in static mode 2017-01-13 23:11:21 +03:00
proller
c601dacf31 arm64 compile fix 2017-01-13 22:01:45 +03:00
alexey-milovidov
56743008dd Merge pull request #317 from proller/libs
Allow link with external libs: poco, tcmalloc
2017-01-13 21:39:23 +04:00
proller
2a6a4657be Fix compiling zlib-ng on arm64 (#331)
Fix compiling zlib-ng on arm64
2017-01-13 15:41:25 +03:00
proller
ee3882f251 Allow link with external libs: poco, tcmalloc 2017-01-13 14:25:44 +03:00