Danila Kutenin
0abde66822
isValidUTF8 movemask is a bad choice, let's use testz
2019-04-16 15:49:22 +03:00
Alexey Milovidov
0db5ec9227
More tests
2019-04-12 03:52:24 +03:00
Alexey Milovidov
ceef92fa9e
Fixed inconsistent whitespaces
2019-04-12 03:37:07 +03:00
Alexey Milovidov
b4878dbffa
Added support for non-constant and negative size and length arguments for function substringUTF8
2019-04-12 03:34:11 +03:00
Alexey Milovidov
36d016d331
Added [[noreturn]] attributes for functions that throw unconditionally
2019-04-10 23:27:14 +03:00
Alexey Milovidov
5be06d8556
Simplified expression (suggested by PVS-Studio)
2019-04-10 23:05:25 +03:00
Alexey Milovidov
37e086f3bf
Merge branch 'master' of github.com:yandex/ClickHouse
2019-04-10 22:57:42 +03:00
Alexey Milovidov
b4efebc6ac
Fixed error found by PVS-Studio
2019-04-10 22:57:30 +03:00
Danila Kutenin
e9bef32618
License to valid utf8 function
2019-04-10 22:09:27 +03:00
Danila Kutenin
9dc6d8f0f5
Style
2019-04-08 00:23:15 +03:00
Danila Kutenin
3519598ae9
Accurate tail handling
2019-04-07 23:24:08 +03:00
Danila Kutenin
b603e51c6e
isValidUTF8 function added
2019-04-07 21:58:13 +03:00
Nikita Lapkov
fbdf2c3525
Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler
2019-04-06 06:58:40 +00:00
Vitaly Baranov
842ce6cff8
Fix function cutQueryStringAndFragment().
2019-04-03 15:58:38 +03:00
Nikolai Kochetov
30d3496c36
Merge pull request #4871 from yandex/fix-array-intersect-impl
...
Fix array intersect
2019-04-02 17:05:01 +03:00
proller
45591c9d83
Build and test fixes ( #4873 )
2019-04-02 12:43:53 +03:00
Nikolai Kochetov
e8a8da1a4f
Fix array intersect.
2019-04-01 16:27:07 +03:00
Nikolai Kochetov
736e3c0f46
Merge pull request #4847 from fancyqlx/master
...
Fixed segment fault of arrayIntersect
2019-04-01 16:06:56 +03:00
Danila Kutenin
fca67c8820
Fix clang build
2019-04-01 08:05:52 +03:00
Danila Kutenin
3ce9686bc4
Some cosmetics
2019-04-01 00:04:45 +03:00
Danila Kutenin
8edb5c5b2d
Some cosmetics
2019-03-31 23:59:18 +03:00
Danila Kutenin
d509c226ab
Pool was not doing what I expected, great improvement of compilation
2019-03-31 23:55:36 +03:00
Danila Kutenin
f80fb09b81
Hyperscan better usage of scratch space and error handling
2019-03-31 23:19:22 +03:00
qianlixiang
bd6bc86ceb
Fixed style check errors
2019-03-31 13:03:08 +08:00
qianlixiang
32692fb0dd
Fixed style check errors
2019-03-31 12:52:24 +08:00
qianlixiang
dad023ea48
Fixed style check errors
2019-03-31 12:00:11 +08:00
qianlixiang
a1d2732d4c
Fixed segment fault of arrayIntersect and add a test
2019-03-31 11:44:05 +08:00
alexey-milovidov
cf492a4401
Merge pull request #4862 from danlark1/master
...
Optimize Volnitsky by inlining compare function
2019-03-31 02:24:33 +03:00
alexey-milovidov
254369324b
Miscellanous changes in ColumnArray ( #4857 )
...
* Miscellanous
* Miscellanous
* Miscellanous
2019-03-30 13:46:17 +03:00
Danila Kutenin
18d3813ff9
Optimize Volnitsky by inlining compare function
2019-03-30 12:39:45 +03:00
qianlixiang
bdb420cdfd
Fixed segment fault of arrayIntersect
2019-03-29 18:53:50 +08:00
alexey-milovidov
7aefd6663f
Merge pull request #4841 from danlark1/master
...
Added hyperscan fuzzy search
2019-03-29 12:39:25 +03:00
Danila Kutenin
cd850f6f98
Fix clang build
2019-03-29 10:04:44 +03:00
Danila Kutenin
b822923f5a
Better renamings of fuzzy string search
2019-03-29 04:27:17 +03:00
Danila Kutenin
ef0d622a5f
Added hyperscan fuzzy search
2019-03-29 04:02:05 +03:00
alexey-milovidov
e3c5da0a69
Merge pull request #4783 from yandex/cow-ptr-compositions
...
WIP. Attempt to make compositions with COWPtr more convenient
2019-03-29 02:09:39 +03:00
Danila Kutenin
d22d66a552
Fix exception message
2019-03-28 20:06:04 +03:00
Danila Kutenin
d4e67fa64c
Another bug fixed to the comparison
2019-03-28 19:58:16 +03:00
Danila Kutenin
70a7f4805d
Test to the restriction added, fix bug
2019-03-28 19:41:11 +03:00
Danila Kutenin
cae4a426c5
Hyperscan restriction
2019-03-28 17:59:25 +03:00
Alexey Milovidov
4417705f32
Merge branch 'master' into cow-ptr-compositions
2019-03-28 17:47:59 +03:00
Alexey Milovidov
faf9462c37
Added support for constant-constant case in multi-search functions
2019-03-27 22:25:58 +03:00
Alexey Milovidov
42dd521e45
Added a setting to disallow Hyperscan
2019-03-27 00:56:46 +03:00
proller
1584fd4367
Fix hyperscan library find and use ( #4798 )
2019-03-26 00:31:00 +03:00
Alexey Milovidov
fb19cf1eec
Attempt to make compositions with COWPtr more convenient
2019-03-25 04:43:54 +03:00
alexey-milovidov
06e79a7643
Merge pull request #4780 from danlark1/master
...
Hyperscan string search regular expression matching was added
2019-03-25 04:26:18 +03:00
Danila Kutenin
4b7824095e
Possible fixes to docker containers
2019-03-24 21:24:56 +03:00
Danila Kutenin
1c90d98d16
Clang fix
2019-03-24 02:56:52 +03:00
Danila Kutenin
725139f0f5
Renamings, fixes to search algorithms, more tests
2019-03-24 01:49:38 +03:00
Danila Kutenin
f8001b41ba
Hyperscan multi regular expressions search
2019-03-23 22:40:16 +03:00
Nikita Lapkov
4a4ff8d5bf
Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler
2019-03-23 18:45:22 +00:00
Alexey Milovidov
847abfdbb1
Fixed bad code with arithmetic ops on aggregate function states
2019-03-23 05:35:50 +03:00
Alexey Milovidov
5a7237cc13
Miscellaneous
2019-03-23 04:27:08 +03:00
proller
d6d83d4a5c
Allow build without ssl ( #4525 ) ( #4750 )
2019-03-22 14:18:24 +03:00
alexey-milovidov
f7bdc657d3
Update hasAllAny.h
2019-03-15 02:12:30 +03:00
Alexey Milovidov
a459b2c298
Fixed insufficient type checking in hasAll, hasAny functions
2019-03-15 02:10:51 +03:00
proller
cf8001b6a9
Fix includes ( #4673 )
2019-03-13 16:58:04 +03:00
alexey-milovidov
617a0a8938
Merge pull request #4592 from yandex/fix-concurrent-alters2
...
Fix a race condition during concurrent ALTER COLUMN queries
2019-03-10 19:11:49 +03:00
Nikita Lapkov
1ea971ddd2
Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler
2019-03-10 01:56:41 +00:00
alexey-milovidov
357e17959e
Merge pull request #4602 from danlark1/master
...
Rename trigramDistance to ngramDistance, add more functions with CaseInsensitive and UTF, update docs, more job done in perf, added some perf tests for string search that I would like to see
2019-03-09 21:19:59 +03:00
Alexey Zatelepin
3344955154
separate Read and Write lock holders, better method names
2019-03-07 21:10:21 +03:00
Alexey Zatelepin
ab025805a3
alter intention lock
2019-03-07 20:21:18 +03:00
Alexey Milovidov
3389cd1735
Merge branch 'master' into fix-function-replicate
2019-03-07 14:56:43 +03:00
proller
86d9876221
Merge remote-tracking branch 'upstream/master' into fix23
2019-03-06 22:58:47 +03:00
proller
ee15cb237c
Better fix
2019-03-06 22:19:21 +03:00
proller
9159d602f5
Fix bug in arrayEnumerateRanked
2019-03-06 20:19:26 +03:00
Nikita Lapkov
12fe175385
Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler
2019-03-06 10:30:47 +00:00
Alexey Milovidov
fb8e37f60f
Fix segfault in function "replicate"
2019-03-06 02:37:41 +03:00
Danila Kutenin
dcfd3fe37f
Comment in FunctionsStringSimilarity
2019-03-06 02:08:08 +03:00
Alexey Milovidov
5a644f0052
Miscellaneous
2019-03-06 02:05:47 +03:00
Alexey Milovidov
b5b3f52f0f
Added documentation
2019-03-06 01:43:18 +03:00
Danila Kutenin
952b5ea24a
Rename trigramDistance to ngramDistance, add more functions with CaseInsensitive and UTF, update docs, more job done in perf, added some perf tests for string search that I would like to see
2019-03-06 01:42:28 +03:00
Alexey Milovidov
224839a58a
Attempt to read the code #4475
2019-03-06 00:53:16 +03:00
proller
89014b5480
Build fixes ( #4591 )
2019-03-05 13:15:47 +03:00
Vitaly Baranov
61e21d50e1
Merge pull request #4207 from andyyzh/bitmap_feature
...
Added bitmap function feature with roaring bitmap
2019-03-04 22:42:47 +03:00
Alexey Milovidov
3033d329eb
Fixed error #4564
2019-03-04 18:50:23 +03:00
Alexey Milovidov
b29c24d3d9
Fixed error #4564
2019-03-04 18:13:33 +03:00
Alexey Milovidov
315b6f3878
Better string comparison (development)
2019-03-03 23:08:39 +03:00
Alexey Milovidov
865d54d9e3
Addition to prev. revision
2019-03-03 16:53:06 +03:00
Alexey Milovidov
d120fc788b
NaN comparisons are implementation specific - remove them from tests
2019-03-03 04:18:35 +03:00
Alexey Milovidov
bcf8cd6297
NaN comparisons are implementation specific - remove them from tests
2019-03-03 04:17:33 +03:00
Alexey Milovidov
0dc576e44f
Avoid performance degradation in few degenerate cases: added fast path for tautological compares #4405
2019-03-03 02:51:48 +03:00
Alexey Milovidov
8df4b8e270
Added comment #4409
2019-03-01 23:17:30 +03:00
Alexey Milovidov
3c2dd5257b
Fixed typo #4409
2019-03-01 23:16:56 +03:00
Alexey Milovidov
bc25bedbd4
Implemented function "flatten" #4409
2019-03-01 23:07:58 +03:00
Alexey Milovidov
9d0adf40d2
Merge branch 'array-flatten-function' of https://github.com/kzon/ClickHouse into kzon-array-flatten-function
2019-03-01 19:42:06 +03:00
alexey-milovidov
97cea95f74
Merge pull request #4536 from amosbird/fixedhashtable
...
A Proper lookup table that uses HashTable's API
2019-03-01 17:47:33 +03:00
Nikita Lapkov
ce4e48d6f4
Merge branch 'master' into query-poor-mans-profiler
2019-03-01 14:22:38 +00:00
Amos Bird
26ab5dd7a7
A Proper lookup table that uses HashTable's API
...
This is the first step of allowing heterogeneous cells in hash tables.
performance test results are
```
1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>
ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124
ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998
ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130
ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191
ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279
ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441
ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564
ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378
ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157
ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041
```
2019-03-01 16:47:13 +08:00
Alexey Zatelepin
eee73dac42
Merge branch 'master' into fix-concurrent-alters
2019-02-28 19:19:21 +03:00
proller
aad2856eba
CLICKHOUSE-4179 : arrayEnumerateDenseRanked arrayEnumerateUniqRanked ( #4475 )
...
* Build fixes (clang 7.0.0+)
* better
* wip
* wip
* fix
* fix
* wip
* fix
* clean
* clean
* CLICKHOUSE-4179 WIP
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* cf
* wip
* wip
* wip
* wip
* cf
* wip
* wip# Please enter the commit message for your changes. Lines starting
* wip# Please enter the commit message for your changes. Lines starting
* cf
* wip# Please enter the commit message for your changes. Lines starting
* wip
* cf
* wip
* wip
* clean
* clean
* clean
* clean
* wip
* wip
* wip
* cf
* wip
* wip
* wip
* cf
* clean
* wip
* clean
* cf
* clean
* clean
* test
* clean
* wip
* cf
* wip
* clean
* clean
* wip
* wip
* clean
* cf
* clean
* Requested changes
* cf
* no convertToFullColumnIfConst
* clean
* clean
* clean
* fix
* Remove comment
2019-02-28 01:18:58 +03:00
Alexey Zatelepin
0d7ab9e3ea
allow acquiring read lock to a table out of order if it was already locked by the same query [#CLICKHOUSE-3789]
...
this is important in preventing ALTER deadlocks
2019-02-27 21:34:38 +03:00
proller
23d70b2e04
Add Y_IGNORE ( #4521 )
2019-02-27 19:52:08 +03:00
alexey-milovidov
bffe514efa
Merge pull request #4466 from danlark1/master
...
Function trigramDistance() added for string similarity search
2019-02-25 21:20:29 +03:00
Георгий Кондратьев
b94de32423
Support xxHash with external lz4
...
xxhash.h does not exist in external lz4 because it is an implementation detail
and its symbols are namespaced with XXH_NAMESPACE macro. When lz4 is external,
xxHash has to be external too, and the dependents have to link to it.
This find_xxhash.cmake is based on find_lz4.cmake.
2019-02-25 07:14:37 +00:00
Danila Kutenin
6c50a55777
Faster hash function and one comment removed
2019-02-23 21:26:09 +03:00
Danila Kutenin
6736dcc96b
A bit better performance, return old name to function
2019-02-22 22:43:47 +03:00
Danila Kutenin
9ea1e948b3
better style in distance()
2019-02-22 06:50:06 +03:00
Danila Kutenin
3149eac681
some style
2019-02-22 06:07:35 +03:00
Danila Kutenin
ada849263b
Optimize distance function, some allocation, hashmap tricks
2019-02-22 06:02:10 +03:00