thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-19 04:42:37 +00:00
Code Issues Packages Projects Releases Wiki Activity
24,091 Commits 9,326 Branches 1,783 Tags 2.2 GiB
65fc607c18
Commit Graph

1578 Commits

Author SHA1 Message Date
Danila Kutenin
f8001b41ba Hyperscan multi regular expressions search 2019-03-23 22:40:16 +03:00
Alexey Milovidov
847abfdbb1 Fixed bad code with arithmetic ops on aggregate function states 2019-03-23 05:35:50 +03:00
Alexey Milovidov
5a7237cc13 Miscellaneous 2019-03-23 04:27:08 +03:00
proller
d6d83d4a5c
Allow build without ssl (#4525) (#4750) 2019-03-22 14:18:24 +03:00
alexey-milovidov
f7bdc657d3
Update hasAllAny.h 2019-03-15 02:12:30 +03:00
Alexey Milovidov
a459b2c298 Fixed insufficient type checking in hasAll, hasAny functions 2019-03-15 02:10:51 +03:00
proller
cf8001b6a9
Fix includes (#4673) 2019-03-13 16:58:04 +03:00
alexey-milovidov
617a0a8938
Merge pull request #4592 from yandex/fix-concurrent-alters2 
Fix a race condition during concurrent ALTER COLUMN queries
 2019-03-10 19:11:49 +03:00
alexey-milovidov
357e17959e
Merge pull request #4602 from danlark1/master 
Rename trigramDistance to ngramDistance, add more functions with CaseInsensitive and UTF, update docs, more job done in perf, added some perf tests for string search that I would like to see
 2019-03-09 21:19:59 +03:00
Alexey Zatelepin
3344955154 separate Read and Write lock holders, better method names 2019-03-07 21:10:21 +03:00
Alexey Zatelepin
ab025805a3 alter intention lock 2019-03-07 20:21:18 +03:00
Alexey Milovidov
3389cd1735 Merge branch 'master' into fix-function-replicate 2019-03-07 14:56:43 +03:00
proller
86d9876221 Merge remote-tracking branch 'upstream/master' into fix23 2019-03-06 22:58:47 +03:00
proller
ee15cb237c Better fix 2019-03-06 22:19:21 +03:00
proller
9159d602f5 Fix bug in arrayEnumerateRanked 2019-03-06 20:19:26 +03:00
Alexey Milovidov
fb8e37f60f Fix segfault in function "replicate" 2019-03-06 02:37:41 +03:00
Danila Kutenin
dcfd3fe37f Comment in FunctionsStringSimilarity 2019-03-06 02:08:08 +03:00
Alexey Milovidov
5a644f0052 Miscellaneous 2019-03-06 02:05:47 +03:00
Alexey Milovidov
b5b3f52f0f Added documentation 2019-03-06 01:43:18 +03:00
Danila Kutenin
952b5ea24a Rename trigramDistance to ngramDistance, add more functions with CaseInsensitive and UTF, update docs, more job done in perf, added some perf tests for string search that I would like to see 2019-03-06 01:42:28 +03:00
Alexey Milovidov
224839a58a Attempt to read the code #4475 2019-03-06 00:53:16 +03:00
proller
89014b5480
Build fixes (#4591) 2019-03-05 13:15:47 +03:00
Vitaly Baranov
61e21d50e1
Merge pull request #4207 from andyyzh/bitmap_feature 
Added bitmap function feature with roaring bitmap
 2019-03-04 22:42:47 +03:00
Alexey Milovidov
3033d329eb Fixed error #4564 2019-03-04 18:50:23 +03:00
Alexey Milovidov
b29c24d3d9 Fixed error #4564 2019-03-04 18:13:33 +03:00
Alexey Milovidov
315b6f3878 Better string comparison (development) 2019-03-03 23:08:39 +03:00
Alexey Milovidov
865d54d9e3 Addition to prev. revision 2019-03-03 16:53:06 +03:00
Alexey Milovidov
d120fc788b NaN comparisons are implementation specific - remove them from tests 2019-03-03 04:18:35 +03:00
Alexey Milovidov
bcf8cd6297 NaN comparisons are implementation specific - remove them from tests 2019-03-03 04:17:33 +03:00
Alexey Milovidov
0dc576e44f Avoid performance degradation in few degenerate cases: added fast path for tautological compares #4405 2019-03-03 02:51:48 +03:00
Alexey Milovidov
8df4b8e270 Added comment #4409 2019-03-01 23:17:30 +03:00
Alexey Milovidov
3c2dd5257b Fixed typo #4409 2019-03-01 23:16:56 +03:00
Alexey Milovidov
bc25bedbd4 Implemented function "flatten" #4409 2019-03-01 23:07:58 +03:00
Alexey Milovidov
9d0adf40d2 Merge branch 'array-flatten-function' of https://github.com/kzon/ClickHouse into kzon-array-flatten-function 2019-03-01 19:42:06 +03:00
alexey-milovidov
97cea95f74
Merge pull request #4536 from amosbird/fixedhashtable 
A Proper lookup table that uses HashTable's API
 2019-03-01 17:47:33 +03:00
Amos Bird
26ab5dd7a7 A Proper lookup table that uses HashTable's API 
This is the first step of allowing heterogeneous cells in hash tables.

performance test results are

```

1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>

ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124

ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998

ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130

ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191

ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279

ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441

ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564

ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378

ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157

ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041

```
 2019-03-01 16:47:13 +08:00
Alexey Zatelepin
eee73dac42 Merge branch 'master' into fix-concurrent-alters 2019-02-28 19:19:21 +03:00
proller
aad2856eba CLICKHOUSE-4179 : arrayEnumerateDenseRanked arrayEnumerateUniqRanked (#4475) 
* Build fixes (clang 7.0.0+)

* better

* wip

* wip

* fix

* fix

* wip

* fix

* clean

* clean

* CLICKHOUSE-4179 WIP

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

*    wip

* wip

* wip

* wip

* wip

* cf

*    wip

* wip

* wip

* wip

* cf

* wip

* wip# Please enter the commit message for your changes. Lines starting

* wip# Please enter the commit message for your changes. Lines starting

* cf

* wip# Please enter the commit message for your changes. Lines starting

* wip

* cf

* wip

* wip

* clean

* clean

* clean

* clean

* wip

* wip

* wip

* cf

* wip

* wip

* wip

* cf

* clean

* wip

* clean

* cf

* clean

* clean

* test

* clean

* wip

* cf

* wip

* clean

* clean

* wip

* wip

* clean

* cf

* clean

* Requested changes

* cf

* no convertToFullColumnIfConst

* clean

* clean

* clean

* fix

* Remove comment
 2019-02-28 01:18:58 +03:00
Alexey Zatelepin
0d7ab9e3ea allow acquiring read lock to a table out of order if it was already locked by the same query [#CLICKHOUSE-3789] 
this is important in preventing ALTER deadlocks
 2019-02-27 21:34:38 +03:00
proller
23d70b2e04
Add Y_IGNORE (#4521) 2019-02-27 19:52:08 +03:00
alexey-milovidov
bffe514efa
Merge pull request #4466 from danlark1/master 
Function trigramDistance() added for string similarity search
 2019-02-25 21:20:29 +03:00
Георгий Кондратьев
b94de32423 Support xxHash with external lz4 
xxhash.h does not exist in external lz4 because it is an implementation detail
and its symbols are namespaced with XXH_NAMESPACE macro.  When lz4 is external,
xxHash has to be external too, and the dependents have to link to it.

This find_xxhash.cmake is based on find_lz4.cmake.
 2019-02-25 07:14:37 +00:00
Danila Kutenin
6c50a55777 Faster hash function and one comment removed 2019-02-23 21:26:09 +03:00
Danila Kutenin
6736dcc96b A bit better performance, return old name to function 2019-02-22 22:43:47 +03:00
Danila Kutenin
9ea1e948b3 better style in distance() 2019-02-22 06:50:06 +03:00
Danila Kutenin
3149eac681 some style 2019-02-22 06:07:35 +03:00
Danila Kutenin
ada849263b Optimize distance function, some allocation, hashmap tricks 2019-02-22 06:02:10 +03:00
Danila Kutenin
3f636b3c34 Remove redundant include 2019-02-21 08:16:55 +03:00
Danila Kutenin
953d8c29a5 Remove redundant comment 2019-02-21 08:14:26 +03:00
Danila Kutenin
16b2e45586 Function trigramDistance added for string similarity search 2019-02-21 08:08:37 +03:00
Anton Kobzev
58b94db3fd
Merge branch 'master' into array-flatten-function 2019-02-15 12:08:24 +03:00
anton
2868bbcb21 Basic implementation 2019-02-15 10:00:50 +03:00
anton
5cb04155d7 Basic implementation 2019-02-15 08:47:49 +03:00
anton
350975cb25 Basic implementation 2019-02-14 17:56:11 +03:00
Andy Yang
4a4dbcd2c1 Merge remote-tracking branch 'origin' into bitmap_feature 2019-02-14 15:14:18 +08:00
alexey-milovidov
2493b63bf2
Merge pull request #4365 from vitlibar/function-to-start-of-day-now-can-receive-date 
Function toStartOfDay() now can receive a date.
 2019-02-12 21:33:12 +03:00
Nikolai Kochetov
31397f7156 Fix column size for const LowCardinality arguments. 2019-02-12 19:04:05 +03:00
Nikolai Kochetov
bb686b3154 Fix type for constant LowCardinality arguments. 2019-02-12 18:43:58 +03:00
Nikolai Kochetov
1af4d9b89c Fix type for constant LowCardinality arguments. 2019-02-12 18:42:33 +03:00
Vitaly Baranov
83d461975e Function toStartOfDay() now can receive a date. 2019-02-12 17:21:37 +03:00
Alexey Milovidov
2aafcb8401 Fixed ubsan build #4322 2019-02-12 16:51:34 +03:00
Alexey Milovidov
8f1910729a Fixed ubsan build #4322 2019-02-12 15:33:24 +03:00
Alexey Milovidov
2294575693 Fixed fuzz test #4322 2019-02-11 20:26:35 +03:00
alexey-milovidov
4e12697e1c
Merge pull request #4304 from vitlibar/add-function-to-start-of-interval 
Add time function toStartOfInterval().
 2019-02-11 17:21:48 +03:00
Vitaly Baranov
0dd1dc242a Add time function toStartOfInterval(). 2019-02-11 14:59:17 +03:00
Alexey Milovidov
e150e62040 Grouped includes (40 of 182) 2019-02-10 20:40:52 +03:00
Alexey Milovidov
ba3cb83a84 Removed duplicate includes 2019-02-10 20:12:22 +03:00
alexey-milovidov
77ce3dab0f
Merge pull request #4320 from yandex/bitmask-ubsan 
Fixed error found by UBSan; added a test for bitmask functions for negative input
 2019-02-10 01:27:04 +03:00
Alexey Milovidov
f794ebbec4 Fixed implementation of "arrayWithConstant" #4309 2019-02-10 00:13:58 +03:00
Alexey Milovidov
a01427db27 Merge branch 'master' of https://github.com/Stupnikov/ClickHouse into Stupnikov-master 2019-02-10 00:04:17 +03:00
Alexey Milovidov
871670d4fb Fixed test 2019-02-10 00:03:42 +03:00
Alexey Milovidov
d705c4fc9c Fixed error found by UBSan; added a test for bitmask functions for negative input 2019-02-09 22:44:27 +03:00
Andy Yang
1a28ba01c1 Added bitmap function feature, fixed test errors and code styles 2019-02-09 14:33:09 +08:00
proller
a95d2d153d Build ARM fix (#4306) 
* Build ARM fix

* Fix warning: declaration shadows a local variable

* Add info about SPLIT_SHARED_LIBRARIES

* Fix cpuid on ARM

* release: better pbuilder autoinstall
 2019-02-09 01:09:32 +03:00
Stupnikov Andrey
dbc9376a0f arrayWithConstant function implementation; 2019-02-08 02:24:07 +03:00
Vitaly Baranov
7ff5439971
Merge pull request #4298 from vitlibar/add-function-to-start-of-ten-minutes 
Add function toStartOfTenMinutes().
 2019-02-07 11:46:13 +03:00
Vitaly Baranov
7cbdb17f5b Add function toStartOfTenMinutes(). 2019-02-07 01:50:04 +03:00
alexey-milovidov
2686f64233
Merge pull request #4128 from yandex/unified-sets 
Unified sets
 2019-02-06 20:40:11 +03:00
alexey-milovidov
f234d7b55e
Merge pull request #4291 from proller/fix15 
Build ARM fixes
 2019-02-06 18:41:24 +03:00
KochetovNicolai
9f971c276f
Merge pull request #3669 from Enmk/ipv4_and_ipv6_domains 
Ipv4 and ipv6 domains
 2019-02-06 18:16:58 +03:00
proller
8a714ed2f0 Build ARM fixes 2019-02-06 14:37:30 +00:00
Nikita Vasilev
a1b0dede07 Data Skipping Indices (#4143) 
* made index parser

* added index parsing

* some fixes

* added index interface and factory

* fixed compilation

* ptrs

* added indexParts

* indextypes

* index condition

* IndexCondition

* added indexes in selectexecutor

* fix

* changed comment

* fix

* added granularity

* comments

* fix

* fix

* added writing indexes

* removed indexpart class

* fix

* added setSkipIndexes

* add rw for MergeTreeIndexes

* fixes

* upd error

* fix

* fix

* reading

* test index

* fixed nullptr error

* fixed

* fix

* unique names

* asts -> exprlist

* minmax index

* fix

* fixed select

* fixed merging

* fixed mutation

* working minmax

* removed test index

* fixed style

* added indexes to checkDataPart

* added tests for minmax index

* fixed constructor

* fix style

* fixed includes

* fixed setSkipIndexes

* added indexes meta to zookeeper

* added parsing

* removed throw

* alter cmds parse

* fix

* added alter

* fix

* alters fix

* fix alters

* fix "after"

* fixed alter

* alter fix + test

* fixes

* upd setSkipIndexes

* fixed alter bug with drop all indices

* fix metadata editing

* new test and repl fix

* rm test files

* fixed repl alter

* fix

* fix

* indices

* MTReadStream

* upd test for bug

* fix

* added useful parsers and ast classes

* fix

* fix comments

* replaced columns

* fix

* fixed parsing

* fixed printing

* fix err

* basic IndicesDescription

* go to IndicesDescr

* moved indices

* go to indicesDescr

* fix test minmax_index*

* fixed MT alter

* fixed bug with replMT indices storing in zk

* rename

* refactoring

* docs ru

* docs ru

* docs en

* refactor

* rename tests

* fix docs

* refactoring

* fix

* fix

* fix

* fixed style

* unique idx

* unique

* fix

* better minmax calculation

* upd

* added getBlock

* unique_condition

* added termForAST

* unique

* fixed not

* uniqueCondition::mayBeTrueOnGranule

* fix

* fixed bug with double column

* is always true

* fix

* key set

* spaces

* test

* tests

* fix

* unique

* fix

* fix

* fixed bug with duplicate column

* removed unused data

* fix

* fixes

* __bitSwapLastTwo

* fix
 2019-02-05 17:50:25 +03:00
Nikolai Kochetov
a249fc7788 Do nut use Arena in ColumnsHashing for string in functions arrayUniq and arrayEnumerate. 2019-02-05 14:14:09 +03:00
Nikolai Kochetov
daa051b1f8 Fix tests. 2019-02-05 13:55:34 +03:00
Nikolai Kochetov
1644349342 Refactor arrayEnumerateUniq using ColumnsHashing. 2019-02-05 13:55:25 +03:00
Alexey Milovidov
b186861ef7 Fixed error message 2019-02-04 22:50:21 +03:00
Vasily Nemkov
2716df8ab2 IPv4 and IPv6 Domain implementation. 
Added:
 * IDataTypeDomain interface;
 * method DataTypeFactory::registerDataTypeDomain for registering domains;
 * DataTypeDomainWithSimpleSerialization domain base class with simple serialization/deserialization;
 * Concrete IPv4 and IPv6 domain implementations: DataTypeDomanIPv6 and DataTypeDomanIPv4;

Updated:
 * IDataType text serialization/deserialization methods;
 * IDataType implementation to use domain for text serialization/deserialization;
 * Refactored implementation of the IPv4/IPv6 functions to use formatIPv4/v6 and parseIPv4/v6 from Common/formatIPv6.h;

Tests:
 * Added test cases for IPv4 and IPv6 domains.
 * Updated IPv4/v6 functions tests to validate more cases;
 * Added performance tests for IPv4 and IPv6 related functions;
 2019-02-04 12:37:46 +03:00
Alexey Milovidov
1f72b0fb16 Disable JIT compilation for comparison of Date and DateTime and conditional operator 2019-02-04 01:11:28 +03:00
Alexey Milovidov
59318c2ad9 Disable JIT compilation for comparison of Date and DateTime and conditional operator 2019-02-04 01:08:17 +03:00
Alexey Milovidov
2129094ba3 Merge branch 'master' into generic-case-for-function-if 2019-02-03 16:01:56 +03:00
alexey-milovidov
91d0d403a2
Merge pull request #3890 from zhang2014/fix/ISSUES-3885 
ISSUES-3885 temporarily disable predicate optimization for order by
 2019-02-03 12:10:20 +03:00
Alexey Milovidov
bf19e73386 Added generic case for function "if" 2019-02-03 11:41:25 +03:00
alexey-milovidov
ad2f6b4db3
Merge pull request #4237 from valexey/date_and_datetime_comparison 
correct Date and DateTime comparison
 2019-02-02 20:58:07 +03:00
alexey-milovidov
592d56ac69
Update FunctionsComparison.h 2019-02-02 20:57:36 +03:00
alexey-milovidov
14f208b9a3
Merge pull request #4239 from danlark1/master 
produce hints for typo functions and types
 2019-02-02 20:42:35 +03:00
Alexey
fc417a4e62 code cleanup 2019-02-02 07:02:57 -08:00
Danila Kutenin
5e62a0825a produce hints for typo functions and types 2019-02-02 17:54:50 +03:00
Alexey
84bbc83192 use common time for Date and DateTime comparisons 2019-02-02 06:23:44 -08:00
proller
c7cb8d2db5 Freebsd fixes (#4225) 
* CLICKHOUSE-4109 mlock clickhouse

* wip

* Fix

* wip

* fix

* fix

* better place

* wip

* clean

* tidy

* fix

* Freebsd fix

* Fix compile on ARM

* Freebsd fixes

* Simpler test

* Fuzzy test: dont skip already fixed functions
 2019-02-02 14:09:22 +03:00
Andy Yang
7e7a864fd4 Added bitmap function feature with roaring bitmap 2019-01-31 21:26:11 +08:00