Commit Graph

94 Commits

Author SHA1 Message Date
Alexey Milovidov
1d0854c7af Using less number of LLVM libraries 2019-12-18 19:08:11 +03:00
kreuzerkrieg
9612bb0e79 More GCC warnings 2019-12-16 23:19:50 +02:00
Nikolai Kochetov
18bfa684a2 Rename IFunction.h to IFunctionImpl.h in functions implementations. 2019-12-09 16:12:54 +03:00
Azat Khuzhin
420089c301
Add new dictionary layout (sparse_hashed) that is more memory efficient
With this new layout, sparsehash will be used over default HashMap,
sparsehash is more memory efficient but it is also slower.

So in a nutshell:
- HashMap uses ~2x more memory then sparse_hash_map
- HashMap ~2-2.5x faster then sparse_hash_map
(tested on lots of input, and the most close to production was
dictionary with 600KK hashes and UInt16 as value)

TODO:
- fix allocated memory calculation
- getBufferSizeInBytes/getBufferSizeInCells interface
- benchmarks

v0: replace HashMap with google::sparse_hash_map
v2: use google::sparse_hash_map only when <sparse> isset to true
v3: replace attributes with different layout
v4: use ch hash over std::hash
2019-09-21 02:22:40 +03:00
proller
d09c5c871b Build fixes (#6491)
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)
2019-08-18 01:53:46 +03:00
alexey-milovidov
14671d6df8
Merge pull request #6254 from yandex/fastops
Integration with "FastOps" library. Added functions sigmoid and tanh.
2019-08-04 06:28:34 +03:00
proller
77bd2624ea Build fixes (#6016)
* Fix building without submodules

* Fix more gcc9 warnings

* was wrong!
../dbms/src/IO/WriteBufferAIO.cpp:277:54: error: result of comparison 'ssize_t' (aka 'long') > 9223372036854775807 is always false [-Werror,-Wtautological-type-limit-compare]
    if ((static_cast<ssize_t>(flush_buffer.offset()) > std::numeric_limits<off_t>::max()) ||
         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

* mimalloc off MI_OVERRIDE

* Fix freebsd build

* Fix shared build

* Fix build in gcc9

* Fix split build

* fix

* fix

* fix

* fix

* clean

* zstd

* Update CMakeLists.txt

* Update Defines.h

* Try fix -Wsign-compare

* Freebsd fix

* Add missing libs

* Fix double-conversion include for copy-headers

* Fix zlib link

* Fix includes for arcadia

* Fix includes for arcadia

* Fix includes for arcadia

* Freebsd fix

* Arcadia fixes

* Update QueryProfiler.cpp

* Freebsd fix

* clean

* 19.11: Fixes for arcadia porting (#6223)

* fix glibc-compatibility

* M_LIBRARY fix

* wip

* Fix

* Fix arm build

* unwind fix

* Update CMakeLists.txt
2019-08-04 03:19:03 +03:00
Alexey Milovidov
b1c9fc0233 Using FastOps library 2019-08-01 03:29:32 +03:00
Ivan Lezhankin
3b995bdb02 Add missing dependecies on sight to enable --no-undefined option 2019-07-04 17:05:55 +03:00
Alexey Milovidov
008f3a247e Merging H3 integration 2019-06-30 21:20:32 +03:00
Ivan Remen
f3c8ac2d3b Merge remote-tracking branch 'main/master' into h3-integration 2019-06-25 11:23:53 +03:00
proller
badb6ab831
Functions: make array and gatherutils libs (#5712) 2019-06-21 18:31:37 +03:00
proller
fa809de91f
Move all url functions to clickhouse_functions_url lib (#5696) 2019-06-20 18:49:54 +03:00
Ivan Remen
b439769aa7 Merge remote-tracking branch 'main/master' into h3-integration-fix 2019-06-20 13:53:17 +03:00
proller
3d8c8ee83c
Build fixes. Split config.h (#5686) 2019-06-20 12:12:49 +03:00
alexey-milovidov
9bdbd84263
Merge pull request #5030 from PerformanceVision/top_level_domain
Changing how the function (cutTo)firstSignificantSubdomain detect the tld (proposal)
2019-06-19 02:08:43 +03:00
Vitaly Baranov
8ab4e4dcfe Use rapidjson when AVX2 instructions are not available. 2019-05-16 20:40:24 +03:00
proller
51ca4cbaa4
Build fixes (#5278) 2019-05-15 20:19:39 +03:00
Vitaly Baranov
7ace113ac0 Use custom cmake file for simdjson and fix build 2019-05-08 16:20:25 +03:00
hcz
789b484108 Fix cmakelists 2019-05-08 16:20:25 +03:00
Guillaume Tassery
7c4541b127
Merge branch 'master' into top_level_domain 2019-04-26 12:30:23 +07:00
Guillaume Tassery
40db4551f2 Add USE_GPERF on configuration file 2019-04-26 12:01:02 +07:00
proller
ba4687e110
Cmake: dont use LINK_MODE (but use BUILD_SHARED_LIBS) (#5091) 2019-04-24 12:06:28 +03:00
Guillaume Tassery
4cc0ee677a Use gperf perfect hash for checking with a better accurency the tld for firstSignificantSubdomain and cutToFirstSignificantSubdomain 2019-04-17 13:21:26 +07:00
Ivan Remen
2fb5addc40 H3 library integration 2019-03-26 11:59:48 +03:00
Danila Kutenin
f8001b41ba Hyperscan multi regular expressions search 2019-03-23 22:40:16 +03:00
proller
d6d83d4a5c
Allow build without ssl (#4525) (#4750) 2019-03-22 14:18:24 +03:00
proller
89014b5480
Build fixes (#4591) 2019-03-05 13:15:47 +03:00
Георгий Кондратьев
b94de32423 Support xxHash with external lz4
xxhash.h does not exist in external lz4 because it is an implementation detail
and its symbols are namespaced with XXH_NAMESPACE macro.  When lz4 is external,
xxHash has to be external too, and the dependents have to link to it.

This find_xxhash.cmake is based on find_lz4.cmake.
2019-02-25 07:14:37 +00:00
proller
c7cb8d2db5 Freebsd fixes (#4225)
* CLICKHOUSE-4109 mlock clickhouse

* wip

* Fix

* wip

* fix

* fix

* better place

* wip

* clean

* tidy

* fix

* Freebsd fix

* Fix compile on ARM

* Freebsd fixes

* Simpler test

* Fuzzy test: dont skip already fixed functions
2019-02-02 14:09:22 +03:00
proller
2eee2d97df Update contrib/libmetrohash 2019-01-28 17:00:50 +03:00
proller
7cefef6983
Fix linking in all modes (unbundled, split, ...) (#4037) 2019-01-11 19:52:46 +03:00
proller
bebaf9d861 Fix includes, Faster compile (#3898)
* Fix includes

* Faster compile

* WTFix

* Limit compile and linking jobs according to available memory

* Add comment

* fix

* Remove ALL from copy-headers target

* Freebsd fix

* Better

* cmake: split use libcxx
2018-12-23 17:19:11 +03:00
mf5137
3757007118 Adding xxHash64 and xxHash32 functions 2018-12-21 18:53:16 +01:00
proller
dd2371e071 CLICKHOUSE-4137 DictionaryFactory, DictionarySourceFactory (#3653)
* Split ComplexKeyCacheDictionary to faster compile (part2)

* Dictionaries as lib WIP

* wip

* clean

* Fix build with old capnp

* fix

* wip

* fixes

* fix

* clean

* clean

* clean

* wip

* wip

* wip

* flat

* wip

* cache

* clean

* wip

* faster

* fix style

* fixes

* clean

* clean

* Split CacheDictionary.cpp for faster compile

* fix

* fix

* Less memory usage while compiling

* missing file

* format

* Update registerDictionaries.h

* clean
2018-11-28 14:37:12 +03:00
proller
1ea31e0491
Fix icu link #3631 (#3671) 2018-11-27 18:34:21 +03:00
alexey-milovidov
e00ce0bb57
Every function in its own file, part 7 (#3666)
* Every function in its own file, part 7 [#CLICKHOUSE-2]

* Every function in its own file, part 7 [#CLICKHOUSE-2]

* Every function in its own file, part 7 [#CLICKHOUSE-2]

* Every function in its own file, part 7 [#CLICKHOUSE-2]

* Every function in its own file, part 7 [#CLICKHOUSE-2]

* Fixed build #3666
2018-11-26 19:20:40 +03:00
Alexey Milovidov
5a0feee45e Removed "conditional computations" feature, because it is not ready #2272 2018-11-26 04:39:04 +03:00
proller
ad6ae4fdbe Fix build on mac (caused by #3631) (#3654)
* Fix build on mac (caused by #3631)

* fix
2018-11-24 04:15:00 +03:00
Alexey Milovidov
dbbacf4f87 Added more style checks [#CLICKHOUSE-3] 2018-11-23 21:52:00 +03:00
Alexandr Krasheninnikov
177a00f09a Merge https://github.com/yandex/ClickHouse into base64_functions 2018-11-14 12:32:42 +03:00
proller
abfe675097
Build fixes (#3419) 2018-10-18 22:28:05 +03:00
Alexandr Krasheninnikov
41281ad397 Make compilation on-demand 2018-10-11 19:25:17 +03:00
Alexander Krasheninnikov
5ff30ebb3d Initial implementation 2018-10-10 04:04:07 +03:00
Alexey Milovidov
2126170d97 Every function in its own file, part 3 2018-09-09 23:57:54 +03:00
alexey-milovidov
46a38b72b9
Merge pull request #2975 from amosbird/dense
Extending arrayEnumerateUniq.
2018-08-30 23:26:31 +03:00
proller
de2b740db7 USE_INTERNAL_CONSISTENT_HASHING_LIBRARY 2018-08-30 22:07:24 +03:00
proller
48766c1c2d split libconsistent-hashing 2018-08-30 21:44:46 +03:00
Amos Bird
a4dfe0ae38 Extending arrayEnumerateUniq.
https://github.com/yandex/ClickHouse/issues/2934
2018-08-28 15:31:25 +08:00
Alexey Milovidov
0c233d668f Removed useless file; preparations #2791 2018-08-03 21:47:44 +03:00