Commit Graph

1538 Commits

Author SHA1 Message Date
alexey-milovidov
bffe514efa
Merge pull request #4466 from danlark1/master
Function trigramDistance() added for string similarity search
2019-02-25 21:20:29 +03:00
Георгий Кондратьев
b94de32423 Support xxHash with external lz4
xxhash.h does not exist in external lz4 because it is an implementation detail
and its symbols are namespaced with XXH_NAMESPACE macro.  When lz4 is external,
xxHash has to be external too, and the dependents have to link to it.

This find_xxhash.cmake is based on find_lz4.cmake.
2019-02-25 07:14:37 +00:00
Danila Kutenin
6c50a55777 Faster hash function and one comment removed 2019-02-23 21:26:09 +03:00
Danila Kutenin
6736dcc96b A bit better performance, return old name to function 2019-02-22 22:43:47 +03:00
Danila Kutenin
9ea1e948b3 better style in distance() 2019-02-22 06:50:06 +03:00
Danila Kutenin
3149eac681 some style 2019-02-22 06:07:35 +03:00
Danila Kutenin
ada849263b Optimize distance function, some allocation, hashmap tricks 2019-02-22 06:02:10 +03:00
Danila Kutenin
3f636b3c34 Remove redundant include 2019-02-21 08:16:55 +03:00
Danila Kutenin
953d8c29a5 Remove redundant comment 2019-02-21 08:14:26 +03:00
Danila Kutenin
16b2e45586 Function trigramDistance added for string similarity search 2019-02-21 08:08:37 +03:00
Anton Kobzev
58b94db3fd
Merge branch 'master' into array-flatten-function 2019-02-15 12:08:24 +03:00
anton
2868bbcb21 Basic implementation 2019-02-15 10:00:50 +03:00
anton
5cb04155d7 Basic implementation 2019-02-15 08:47:49 +03:00
anton
350975cb25 Basic implementation 2019-02-14 17:56:11 +03:00
Andy Yang
4a4dbcd2c1 Merge remote-tracking branch 'origin' into bitmap_feature 2019-02-14 15:14:18 +08:00
alexey-milovidov
2493b63bf2
Merge pull request #4365 from vitlibar/function-to-start-of-day-now-can-receive-date
Function toStartOfDay() now can receive a date.
2019-02-12 21:33:12 +03:00
Nikolai Kochetov
31397f7156 Fix column size for const LowCardinality arguments. 2019-02-12 19:04:05 +03:00
Nikolai Kochetov
bb686b3154 Fix type for constant LowCardinality arguments. 2019-02-12 18:43:58 +03:00
Nikolai Kochetov
1af4d9b89c Fix type for constant LowCardinality arguments. 2019-02-12 18:42:33 +03:00
Vitaly Baranov
83d461975e Function toStartOfDay() now can receive a date. 2019-02-12 17:21:37 +03:00
Alexey Milovidov
2aafcb8401 Fixed ubsan build #4322 2019-02-12 16:51:34 +03:00
Alexey Milovidov
8f1910729a Fixed ubsan build #4322 2019-02-12 15:33:24 +03:00
Alexey Milovidov
2294575693 Fixed fuzz test #4322 2019-02-11 20:26:35 +03:00
alexey-milovidov
4e12697e1c
Merge pull request #4304 from vitlibar/add-function-to-start-of-interval
Add time function toStartOfInterval().
2019-02-11 17:21:48 +03:00
Vitaly Baranov
0dd1dc242a Add time function toStartOfInterval(). 2019-02-11 14:59:17 +03:00
Alexey Milovidov
e150e62040 Grouped includes (40 of 182) 2019-02-10 20:40:52 +03:00
Alexey Milovidov
ba3cb83a84 Removed duplicate includes 2019-02-10 20:12:22 +03:00
alexey-milovidov
77ce3dab0f
Merge pull request #4320 from yandex/bitmask-ubsan
Fixed error found by UBSan; added a test for bitmask functions for negative input
2019-02-10 01:27:04 +03:00
Alexey Milovidov
f794ebbec4 Fixed implementation of "arrayWithConstant" #4309 2019-02-10 00:13:58 +03:00
Alexey Milovidov
a01427db27 Merge branch 'master' of https://github.com/Stupnikov/ClickHouse into Stupnikov-master 2019-02-10 00:04:17 +03:00
Alexey Milovidov
871670d4fb Fixed test 2019-02-10 00:03:42 +03:00
Alexey Milovidov
d705c4fc9c Fixed error found by UBSan; added a test for bitmask functions for negative input 2019-02-09 22:44:27 +03:00
Andy Yang
1a28ba01c1 Added bitmap function feature, fixed test errors and code styles 2019-02-09 14:33:09 +08:00
proller
a95d2d153d Build ARM fix (#4306)
* Build ARM fix

* Fix warning: declaration shadows a local variable

* Add info about SPLIT_SHARED_LIBRARIES

* Fix cpuid on ARM

* release: better pbuilder autoinstall
2019-02-09 01:09:32 +03:00
Stupnikov Andrey
dbc9376a0f arrayWithConstant function implementation; 2019-02-08 02:24:07 +03:00
Vitaly Baranov
7ff5439971
Merge pull request #4298 from vitlibar/add-function-to-start-of-ten-minutes
Add function toStartOfTenMinutes().
2019-02-07 11:46:13 +03:00
Vitaly Baranov
7cbdb17f5b Add function toStartOfTenMinutes(). 2019-02-07 01:50:04 +03:00
alexey-milovidov
2686f64233
Merge pull request #4128 from yandex/unified-sets
Unified sets
2019-02-06 20:40:11 +03:00
alexey-milovidov
f234d7b55e
Merge pull request #4291 from proller/fix15
Build ARM fixes
2019-02-06 18:41:24 +03:00
KochetovNicolai
9f971c276f
Merge pull request #3669 from Enmk/ipv4_and_ipv6_domains
Ipv4 and ipv6 domains
2019-02-06 18:16:58 +03:00
proller
8a714ed2f0 Build ARM fixes 2019-02-06 14:37:30 +00:00
Nikita Vasilev
a1b0dede07 Data Skipping Indices (#4143)
* made index parser

* added index parsing

* some fixes

* added index interface and factory

* fixed compilation

* ptrs

* added indexParts

* indextypes

* index condition

* IndexCondition

* added indexes in selectexecutor

* fix

* changed comment

* fix

* added granularity

* comments

* fix

* fix

* added writing indexes

* removed indexpart class

* fix

* added setSkipIndexes

* add rw for MergeTreeIndexes

* fixes

* upd error

* fix

* fix

* reading

* test index

* fixed nullptr error

* fixed

* fix

* unique names

* asts -> exprlist

* minmax index

* fix

* fixed select

* fixed merging

* fixed mutation

* working minmax

* removed test index

* fixed style

* added indexes to checkDataPart

* added tests for minmax index

* fixed constructor

* fix style

* fixed includes

* fixed setSkipIndexes

* added indexes meta to zookeeper

* added parsing

* removed throw

* alter cmds parse

* fix

* added alter

* fix

* alters fix

* fix alters

* fix "after"

* fixed alter

* alter fix + test

* fixes

* upd setSkipIndexes

* fixed alter bug with drop all indices

* fix metadata editing

* new test and repl fix

* rm test files

* fixed repl alter

* fix

* fix

* indices

* MTReadStream

* upd test for bug

* fix

* added useful parsers and ast classes

* fix

* fix comments

* replaced columns

* fix

* fixed parsing

* fixed printing

* fix err

* basic IndicesDescription

* go to IndicesDescr

* moved indices

* go to indicesDescr

* fix test minmax_index*

* fixed MT alter

* fixed bug with replMT indices storing in zk

* rename

* refactoring

* docs ru

* docs ru

* docs en

* refactor

* rename tests

* fix docs

* refactoring

* fix

* fix

* fix

* fixed style

* unique idx

* unique

* fix

* better minmax calculation

* upd

* added getBlock

* unique_condition

* added termForAST

* unique

* fixed not

* uniqueCondition::mayBeTrueOnGranule

* fix

* fixed bug with double column

* is always true

* fix

* key set

* spaces

* test

* tests

* fix

* unique

* fix

* fix

* fixed bug with duplicate column

* removed unused data

* fix

* fixes

* __bitSwapLastTwo

* fix
2019-02-05 17:50:25 +03:00
Nikolai Kochetov
a249fc7788 Do nut use Arena in ColumnsHashing for string in functions arrayUniq and arrayEnumerate. 2019-02-05 14:14:09 +03:00
Nikolai Kochetov
daa051b1f8 Fix tests. 2019-02-05 13:55:34 +03:00
Nikolai Kochetov
1644349342 Refactor arrayEnumerateUniq using ColumnsHashing. 2019-02-05 13:55:25 +03:00
Alexey Milovidov
b186861ef7 Fixed error message 2019-02-04 22:50:21 +03:00
Vasily Nemkov
2716df8ab2 IPv4 and IPv6 Domain implementation.
Added:
 * IDataTypeDomain interface;
 * method DataTypeFactory::registerDataTypeDomain for registering domains;
 * DataTypeDomainWithSimpleSerialization domain base class with simple serialization/deserialization;
 * Concrete IPv4 and IPv6 domain implementations: DataTypeDomanIPv6 and DataTypeDomanIPv4;

Updated:
 * IDataType text serialization/deserialization methods;
 * IDataType implementation to use domain for text serialization/deserialization;
 * Refactored implementation of the IPv4/IPv6 functions to use formatIPv4/v6 and parseIPv4/v6 from Common/formatIPv6.h;

Tests:
 * Added test cases for IPv4 and IPv6 domains.
 * Updated IPv4/v6 functions tests to validate more cases;
 * Added performance tests for IPv4 and IPv6 related functions;
2019-02-04 12:37:46 +03:00
Alexey Milovidov
1f72b0fb16 Disable JIT compilation for comparison of Date and DateTime and conditional operator 2019-02-04 01:11:28 +03:00
Alexey Milovidov
59318c2ad9 Disable JIT compilation for comparison of Date and DateTime and conditional operator 2019-02-04 01:08:17 +03:00
Alexey Milovidov
2129094ba3 Merge branch 'master' into generic-case-for-function-if 2019-02-03 16:01:56 +03:00
alexey-milovidov
91d0d403a2
Merge pull request #3890 from zhang2014/fix/ISSUES-3885
ISSUES-3885 temporarily disable predicate optimization for order by
2019-02-03 12:10:20 +03:00
Alexey Milovidov
bf19e73386 Added generic case for function "if" 2019-02-03 11:41:25 +03:00
alexey-milovidov
ad2f6b4db3
Merge pull request #4237 from valexey/date_and_datetime_comparison
correct Date and DateTime comparison
2019-02-02 20:58:07 +03:00
alexey-milovidov
592d56ac69
Update FunctionsComparison.h 2019-02-02 20:57:36 +03:00
alexey-milovidov
14f208b9a3
Merge pull request #4239 from danlark1/master
produce hints for typo functions and types
2019-02-02 20:42:35 +03:00
Alexey
fc417a4e62 code cleanup 2019-02-02 07:02:57 -08:00
Danila Kutenin
5e62a0825a produce hints for typo functions and types 2019-02-02 17:54:50 +03:00
Alexey
84bbc83192 use common time for Date and DateTime comparisons 2019-02-02 06:23:44 -08:00
proller
c7cb8d2db5 Freebsd fixes (#4225)
* CLICKHOUSE-4109 mlock clickhouse

* wip

* Fix

* wip

* fix

* fix

* better place

* wip

* clean

* tidy

* fix

* Freebsd fix

* Fix compile on ARM

* Freebsd fixes

* Simpler test

* Fuzzy test: dont skip already fixed functions
2019-02-02 14:09:22 +03:00
Andy Yang
7e7a864fd4 Added bitmap function feature with roaring bitmap 2019-01-31 21:26:11 +08:00
zhang2014
3af26ca070 ISSUES-3885 better test & fix isStateful bug 2019-01-30 12:49:00 +08:00
zhang2014
ddbd384f32 ISSUES-3885 mark stateful function & do not optimize their predicate 2019-01-30 12:04:28 +08:00
alexey-milovidov
aa06005a32
Merge pull request #4179 from yandex/avoid-overflow-in-function-sleep
Fixed possible overflow in function "sleep" (found by fuzz test with UBSan)
2019-01-29 13:44:39 +03:00
Alexey Milovidov
c792191831 Fixed possible overflow in function "sleep" (found by fuzz test with UBSan) #4166 2019-01-29 13:42:45 +03:00
proller
2eee2d97df Update contrib/libmetrohash 2019-01-28 17:00:50 +03:00
Amos Bird
d8eba7e71b Better joinGet. 2019-01-25 23:38:13 +08:00
maiha
6c83beafdd dbms: Fixed misspells in comments 2019-01-23 04:56:53 +09:00
Alexey Milovidov
c7b95b5175 Miscellaneous changes for PVS-Studio 2019-01-20 02:27:52 +03:00
Boris Granveaud
f1a7f60165 new functions filesystemAvailable, filesystemFree and filesystemCapacity 2019-01-18 16:44:53 +01:00
Danila Kutenin
12bcff48ee Miscellaneous and some optimizations 2019-01-16 20:41:08 +03:00
Alexey Milovidov
7d03804d06 Miscellaneous #4053 2019-01-16 16:57:11 +03:00
Danila Kutenin
a5669b6b7a MultiVolnitsky added with tests and some benchmark, many multiFunctions are added to support multistring search 2019-01-14 18:54:47 +03:00
proller
7cefef6983
Fix linking in all modes (unbundled, split, ...) (#4037) 2019-01-11 19:52:46 +03:00
alesapin
8ae59da557 Fix name hiding 2019-01-10 14:46:20 +03:00
Alexey Milovidov
19f4652959 Fixed bugs found by PVS-Studio 2019-01-09 18:44:20 +03:00
alexey-milovidov
0648088ff0
Merge pull request #4000 from housepower/feature/gccHash
Add gccHash function
2019-01-09 10:29:37 +03:00
sundy-li
31a516300a rename to gccMurmurHash 2019-01-09 10:03:50 +08:00
Alexey Milovidov
ed07c1a1d2 Added "reserve" for "arrayFirst" #3920 2019-01-08 18:30:04 +03:00
sundy-li
e6c02a2356 Add gccHash function 2019-01-08 13:12:52 +08:00
Alexey Milovidov
d4f5310358 Miscellaneous [#CLICKHOUSE-2] 2019-01-07 22:57:32 +03:00
Alexey Milovidov
1c7ccbf108 Miscellaneous [#CLICKHOUSE-2] 2019-01-07 22:56:53 +03:00
Alexey Milovidov
0dfa553fca Added more warnings from clang's -Weverything, that are available in clang 8 2019-01-07 13:40:58 +03:00
Alexey Milovidov
06a8c3f02d Added some warnings from clang's -Weverything 2019-01-05 06:33:22 +03:00
Alexey Milovidov
afda68d25c Added some warnings from clang's -Weverything 2019-01-04 17:18:49 +03:00
Alexey Milovidov
4622f5dc7c Added some warnings from clang's -Weverything 2019-01-04 16:32:08 +03:00
Alexey Milovidov
1d4701b0bc Added some warnings from clang's -Weverything 2019-01-04 15:10:00 +03:00
Alexey Milovidov
e33e5150b7 Miscellaneous [#CLICKHOUSE-2] 2019-01-02 09:44:36 +03:00
Alexey Milovidov
cd6a1c9bc9 Fixed uninitialized memory in "runningDifference" function [#CLICKHOUSE-2] 2018-12-29 03:53:11 +03:00
alexey-milovidov
4ac9f7a204
Merge pull request #3959 from yandex/catboost-multiclass-models
Catboost multiclass models
2018-12-29 01:22:14 +03:00
Nikolai Kochetov
bdaf1ac109 Support multiclass models for CatBoost. 2018-12-28 21:08:32 +03:00
Alexey Milovidov
88bdbc4dc7 Some additions to Amos Bird's optimization #3920 2018-12-27 22:58:30 +03:00
Alexey Milovidov
160ffe8c7f Fixed UB #3926 2018-12-27 05:00:31 +03:00
Alexey Milovidov
76dafd4d95 Fixed UB #3926 2018-12-27 04:51:22 +03:00
Alexey Milovidov
673fa80a9c Allowed some UB #3926 2018-12-27 03:40:10 +03:00
Alexey Milovidov
39492139f0 Allowed some UB #3926 2018-12-27 03:25:47 +03:00
Alexey Milovidov
d6c7825328 Addition to prev. revision #3926 2018-12-27 03:11:42 +03:00
Alexey Milovidov
e308d2e069 Addition to prev. revision #3926 2018-12-27 03:10:38 +03:00
Alexey Milovidov
2e20bd4b4a Addition to prev. revision #3926 2018-12-27 03:09:39 +03:00
Alexey Milovidov
2e323192a2 Addition to prev. revision #3926 2018-12-27 03:02:11 +03:00
Alexey Milovidov
732f60c8be Allowed some UB under UBSan #3926 2018-12-27 02:55:09 +03:00