Commit Graph

1790 Commits

Author SHA1 Message Date
Danila Kutenin
1c6707526a style 2019-05-18 16:21:48 +03:00
Danila Kutenin
59f26b7569 some optimizations 2019-05-18 15:56:26 +03:00
Danila Kutenin
a49ee5efd6 some optimizations 2019-05-18 15:52:33 +03:00
Danila Kutenin
84b04dc8ea format function added 2019-05-18 15:29:10 +03:00
Danila Kutenin
4e3a607267 format function added 2019-05-18 14:30:36 +03:00
alexey-milovidov
24b16da9fd
Merge pull request #5235 from vitlibar/improve-new-json-functions
Improve new json functions
2019-05-18 12:51:41 +03:00
alexey-milovidov
fa4a7eb3d1
Merge branch 'master' into merge-itable-istorage 2019-05-18 00:37:12 +03:00
alexey-milovidov
34f36e2891
Merge pull request #5304 from 4ertus2/funcs
Support quantile(s) and median for Decimal
2019-05-17 23:03:27 +03:00
Ivan Lezhankin
0821d62516 Merge ITableDeclaration into IStorage.
Also a couple of massive include-refactorings with better forwarding
2019-05-17 17:34:25 +03:00
Vitaly Baranov
095fc7b454 Optimization by using implementation-specific JSONParser::sizeOfArray(), JSONParser::sizeOfObject(). 2019-05-17 17:24:13 +03:00
Danila Kutenin
64913c4778 better names 2019-05-17 16:00:29 +03:00
Danila Kutenin
0d3422fa8a toValidUTF8 function added 2019-05-17 15:55:21 +03:00
Vitaly Baranov
823d862ceb Add a setting to disable simdjson. 2019-05-16 22:39:49 +03:00
Vitaly Baranov
b90a3a4222 Add UInt64 support to JSON functions. 2019-05-16 21:22:59 +03:00
Vitaly Baranov
8ab4e4dcfe Use rapidjson when AVX2 instructions are not available. 2019-05-16 20:40:24 +03:00
chertus
fdcbf509bb support quantile(s)ExactWeighted for Decimal 2019-05-16 17:33:13 +03:00
Vitaly Baranov
263fc16bd5 Fix handling wrong JSONs. 2019-05-16 15:16:21 +03:00
Vitaly Baranov
f4942007e1 Add function JSONExtractKeysAndValues(). 2019-05-16 14:09:22 +03:00
Vitaly Baranov
99ab74acc6 Use CpuFlagsCache instead of __builtin_cpu_supports. 2019-05-16 14:09:22 +03:00
Vitaly Baranov
edf1c42c7b Add comments to the class template FunctionJSON. 2019-05-16 14:09:22 +03:00
Vitaly Baranov
c93bd31695 Simplify template implementation. 2019-05-16 14:09:22 +03:00
Vitaly Baranov
76bda0342b Move ExtraArg to the end of arguments of JSONExtract(). 2019-05-16 14:09:22 +03:00
Vitaly Baranov
d003682626 Implement function JSONExtractRaw(). 2019-05-16 14:09:22 +03:00
Vitaly Baranov
900f5cac81 Return Enum8 instead of string from JSONType(). 2019-05-16 14:09:22 +03:00
Vitaly Baranov
8be2e728c0 Use capital letters in the names of json functions: jsonHas => JSONHas 2019-05-16 14:09:22 +03:00
Vitaly Baranov
0d26ac8583 Reimplement indices in objects in more straightforward way 2019-05-16 14:09:22 +03:00
chertus
2739a3f6d0 Merge branch 'master' into nulls 2019-05-16 14:02:12 +03:00
chertus
5f19c0981d add toDecimalOrZero and toDecimalOrNull fuctions 2019-05-15 21:50:35 +03:00
proller
51ca4cbaa4
Build fixes (#5278) 2019-05-15 20:19:39 +03:00
Vitaly Baranov
9620e2e223
Merge pull request #5003 from Enmk/geohash_support
Implementation of geohashEncode and geohashDecode functions;
2019-05-14 20:01:22 +03:00
proller
cc3de4115f
Build fixes (#5261) 2019-05-14 12:58:33 +03:00
Alexander Kozhikhov
003a0fbadf conflict fix 2019-05-13 17:43:47 +03:00
Alexander Kozhikhov
9b4f322fd8 Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-05-13 16:50:56 +03:00
svladykin
22389d4eca Support for bitmapHasAny and bitmapHasAll functions. 2019-05-12 17:47:31 +03:00
Vasily Nemkov
e4988110ec Implementation of geohashEncode and geohashDecode functions;
Function signatures:
 * geohashEncode(float lon, float lat, int precision) => string

 * geohashDecode(string encoded) => (float llon, float lat)

With test cases and documentation;
2019-05-10 14:59:24 +03:00
吴健
bd43e8bada Fix if, multiIf's nullable bug. 2019-05-10 18:42:44 +08:00
alexey-milovidov
9f5e1a5b80
Merge pull request #5228 from andyyzh/fix_bitmap_issue_5220
Fix bitmap functions crash the server bug segfault
2019-05-09 23:06:57 +03:00
alexey-milovidov
a1cb9a2d67
Merge pull request #5152 from janplus/bug-null-in
Fix null problem in FunctionIn
2019-05-09 19:22:41 +03:00
Andy Yang
4b66622601 Fix bitmap functions crash the server bug segfault 2019-05-09 17:24:36 +08:00
Vitaly Baranov
7ace113ac0 Use custom cmake file for simdjson and fix build 2019-05-08 16:20:25 +03:00
Vitaly Baranov
14d58737dd Fix error: use of old-style cast 2019-05-08 16:20:25 +03:00
hcz
682ce99133 Return strings in jsonType 2019-05-08 16:20:25 +03:00
hcz
706f335042 Format code and update tests 2019-05-08 16:20:25 +03:00
hcz
8cae381428 Performance improvement 2019-05-08 16:20:25 +03:00
hcz
b721ae11f5 Fix const column detection 2019-05-08 16:20:25 +03:00
hcz
e1a236f55c Update API 2019-05-08 16:20:25 +03:00
hcz
789b484108 Fix cmakelists 2019-05-08 16:20:25 +03:00
hcz
560246c0c3 Add Simdjson API 2019-05-08 16:20:25 +03:00
吴健
c687a85304 Merge branch 'bug-null-in' of github.com:janplus/ClickHouse into bug-null-in 2019-05-07 13:59:46 +08:00
吴健
84ee8cec93 Add function ignoreExceptNull to meet nullable functionIn's requirement for optimization of analyse. 2019-05-07 13:20:23 +08:00
Guillaume Tassery
3f8121d34f format code style 2019-05-06 17:23:06 +07:00
Guillaume Tassery
24dce70207 Merge branch 'master' of github.com:PerformanceVision/ClickHouse into ignore_scheme 2019-05-06 17:20:25 +07:00
Danila Kutenin
c280907f09 Zero initialization instead of memset 2019-05-06 11:34:28 +03:00
Danila Kutenin
512c7fa3a4 Comments 2019-05-06 00:40:37 +03:00
Danila Kutenin
8b235f7a4a Comments 2019-05-06 00:37:58 +03:00
Danila Kutenin
6a6b30a56f Less code with unique ptrs and some docs added 2019-05-06 00:35:08 +03:00
Danila Kutenin
f613c06c47 ngram vector_vector distance added 2019-05-05 23:48:46 +03:00
Danila Kutenin
ca4f098362 fix hyperscan to treat regular expressions as utf-8 expressions 2019-05-05 09:51:59 +03:00
Alexey Milovidov
c462b0fabb Miscellaneous 2019-05-05 02:12:55 +03:00
alexey-milovidov
9e3c80d2ed
Merge pull request #5170 from yandex/cidr-to-range-better-code
Cidr to range better code
2019-05-02 19:29:36 +03:00
Alexey Milovidov
4dc0170d2c CIDR functions: better code #5095 2019-05-02 16:04:24 +03:00
alexey-milovidov
478b721b36
Merge pull request #5167 from yandex/remove-useless-code-in-columns-description
Removed bad and useless code in ColumnsDescription
2019-05-02 02:16:36 +03:00
Alexey Milovidov
0381a6a1ec Better code for CIDR to range functions #5095 2019-05-02 01:09:24 +03:00
Alexey Milovidov
3fa2784e7c Removed unneeded file #5095 2019-05-02 01:00:56 +03:00
alexey-milovidov
2dccdb18eb
Merge pull request #5095 from PerformanceVision/CIDR_MASK
Functions for calculate lower and high range of an IP address using a CIDR mask
2019-05-02 01:00:29 +03:00
Alexey Milovidov
1be21e3cb6 Removed bad and useless code in ColumnsDescription 2019-05-02 00:43:05 +03:00
alexey-milovidov
35471f4234
Update in.cpp 2019-04-30 20:26:56 +03:00
alexey-milovidov
b88c981902
Update basename.cpp 2019-04-30 19:15:08 +03:00
alexey-milovidov
39b696f9df
Update basename.cpp 2019-04-30 19:14:53 +03:00
Guillaume Tassery
ee742f38d9 Formatting 2019-04-30 13:53:09 +07:00
Guillaume Tassery
9a5a0b2776 Formatting 2019-04-30 13:50:38 +07:00
吴健
acbeedad38 Fix null problem in FunctionIn 2019-04-30 11:50:30 +08:00
alexey-milovidov
109726d533
Update basename.cpp 2019-04-30 00:40:54 +03:00
Guillaume Tassery
95141804fb Add a basename function 2019-04-29 16:40:44 +07:00
Guillaume Tassery
f21004ed7e IPv4CIDRtoIPv4Range and IPv6CIDRtoIPv6Range return now an IP 2019-04-26 13:30:07 +07:00
Guillaume Tassery
7c4541b127
Merge branch 'master' into top_level_domain 2019-04-26 12:30:23 +07:00
Guillaume Tassery
40db4551f2 Add USE_GPERF on configuration file 2019-04-26 12:01:02 +07:00
Guillaume Tassery
d1bca5b6a4 Remove test file 2019-04-26 10:59:20 +07:00
Guillaume Tassery
2640a0716c Add some pragma for ignoring some compilation flags for file generated by gperf 2019-04-24 17:09:46 +07:00
proller
ba4687e110
Cmake: dont use LINK_MODE (but use BUILD_SHARED_LIBS) (#5091) 2019-04-24 12:06:28 +03:00
Guillaume Tassery
68b0144178 Remove unused header and some typo in comment for IPv6 range function 2019-04-24 13:26:28 +07:00
Guillaume Tassery
efd780f20d Apply fix for IPv6 range function when we use a column with more than one element 2019-04-24 12:19:36 +07:00
Guillaume Tassery
0e67d424da Code reformating for ip range function 2019-04-24 11:18:17 +07:00
Guillaume Tassery
56393de68e Handle UB case for CIDR IP range function and add documentation 2019-04-23 19:28:25 +07:00
Guillaume Tassery
8dee4fe5d1 Add function for get an ipv4 range using an ipv4 and a cidr mask 2019-04-23 14:02:23 +07:00
Guillaume Tassery
8b0dda39e4 Handle more test and update tests 2019-04-23 13:08:09 +07:00
Guillaume Tassery
3639f03bc6 Check if we got a reserved char on url for domain and top level domain 2019-04-23 12:56:24 +07:00
Guillaume Tassery
b567127f49 Doing more URL check on domain and topLevelDomain function 2019-04-23 12:23:59 +07:00
Guillaume Tassery
153c9d6455 Add function for get an IP range from a CIDR 2019-04-22 18:21:59 +07:00
Alexander Kozhikhov
fd07c97097 Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-04-21 18:43:29 +03:00
Alexander Kozhikhov
daf4690d37 review fixes 2019-04-21 17:32:42 +03:00
Guillaume Tassery
5964646971 Remove template for getURLHost function for skip scheme 2019-04-19 11:02:25 +07:00
Guillaume Tassery
bd9a583869 Adapt coding style top level domain lookup 2019-04-18 10:51:02 +07:00
Guillaume Tassery
593dcbb33f Handle URL without www and scheme for domain and topleveldomain function 2019-04-18 10:36:10 +07:00
Vitaly Baranov
7ef7a2d767 Disable ubsan error "outside the range of representable values" in bitSwapLastTwo.cpp 2019-04-17 19:14:31 +03:00
Guillaume Tassery
a904a4af7a Remove useless file 2019-04-17 19:45:25 +07:00
Guillaume Tassery
65fc607c18 Modify tldlookup.gperf file for include only second level domain 2019-04-17 19:40:11 +07:00
Guillaume Tassery
1eccfacca5 Take into account when we have content after the dns on (cutTo)firstSignificantSubdomain function 2019-04-17 19:27:15 +07:00
Guillaume Tassery
4cc0ee677a Use gperf perfect hash for checking with a better accurency the tld for firstSignificantSubdomain and cutToFirstSignificantSubdomain 2019-04-17 13:21:26 +07:00
Danila Kutenin
0abde66822 isValidUTF8 movemask is a bad choice, let's use testz 2019-04-16 15:49:22 +03:00
Guillaume Tassery
6df315a985 Add a way to accept URL without scheme for domain and topLevelDomain 2019-04-16 12:17:56 +07:00
Alexander Kozhikhov
19021e76bb style 2019-04-15 03:16:13 +03:00
Alexander Kozhikhov
12132b8fdf fix in evalMLMethod 2019-04-15 02:57:14 +03:00
Alexey Milovidov
0db5ec9227 More tests 2019-04-12 03:52:24 +03:00
Alexey Milovidov
ceef92fa9e Fixed inconsistent whitespaces 2019-04-12 03:37:07 +03:00
Alexey Milovidov
b4878dbffa Added support for non-constant and negative size and length arguments for function substringUTF8 2019-04-12 03:34:11 +03:00
Alexey Milovidov
36d016d331 Added [[noreturn]] attributes for functions that throw unconditionally 2019-04-10 23:27:14 +03:00
Alexey Milovidov
5be06d8556 Simplified expression (suggested by PVS-Studio) 2019-04-10 23:05:25 +03:00
Alexey Milovidov
37e086f3bf Merge branch 'master' of github.com:yandex/ClickHouse 2019-04-10 22:57:42 +03:00
Alexey Milovidov
b4efebc6ac Fixed error found by PVS-Studio 2019-04-10 22:57:30 +03:00
Danila Kutenin
e9bef32618 License to valid utf8 function 2019-04-10 22:09:27 +03:00
Alexander Kozhikhov
c93aae6741 linear regression 2019-04-09 01:40:37 +03:00
Alexander Kozhikhov
a9ae6d0681 Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-04-09 00:01:28 +03:00
Danila Kutenin
9dc6d8f0f5 Style 2019-04-08 00:23:15 +03:00
Danila Kutenin
3519598ae9 Accurate tail handling 2019-04-07 23:24:08 +03:00
Danila Kutenin
b603e51c6e isValidUTF8 function added 2019-04-07 21:58:13 +03:00
Alexander Kozhikhov
f550304fa4 Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-04-04 03:17:37 +03:00
Vitaly Baranov
842ce6cff8 Fix function cutQueryStringAndFragment(). 2019-04-03 15:58:38 +03:00
Nikolai Kochetov
30d3496c36
Merge pull request #4871 from yandex/fix-array-intersect-impl
Fix array intersect
2019-04-02 17:05:01 +03:00
proller
45591c9d83
Build and test fixes (#4873) 2019-04-02 12:43:53 +03:00
Nikolai Kochetov
e8a8da1a4f Fix array intersect. 2019-04-01 16:27:07 +03:00
Nikolai Kochetov
736e3c0f46
Merge pull request #4847 from fancyqlx/master
Fixed segment fault of arrayIntersect
2019-04-01 16:06:56 +03:00
Danila Kutenin
fca67c8820 Fix clang build 2019-04-01 08:05:52 +03:00
Danila Kutenin
3ce9686bc4 Some cosmetics 2019-04-01 00:04:45 +03:00
Danila Kutenin
8edb5c5b2d Some cosmetics 2019-03-31 23:59:18 +03:00
Danila Kutenin
d509c226ab Pool was not doing what I expected, great improvement of compilation 2019-03-31 23:55:36 +03:00
Danila Kutenin
f80fb09b81 Hyperscan better usage of scratch space and error handling 2019-03-31 23:19:22 +03:00
qianlixiang
bd6bc86ceb Fixed style check errors 2019-03-31 13:03:08 +08:00
qianlixiang
32692fb0dd Fixed style check errors 2019-03-31 12:52:24 +08:00
qianlixiang
dad023ea48 Fixed style check errors 2019-03-31 12:00:11 +08:00
qianlixiang
a1d2732d4c Fixed segment fault of arrayIntersect and add a test 2019-03-31 11:44:05 +08:00
alexey-milovidov
cf492a4401
Merge pull request #4862 from danlark1/master
Optimize Volnitsky by inlining compare function
2019-03-31 02:24:33 +03:00
alexey-milovidov
254369324b
Miscellanous changes in ColumnArray (#4857)
* Miscellanous

* Miscellanous

* Miscellanous
2019-03-30 13:46:17 +03:00
Danila Kutenin
18d3813ff9 Optimize Volnitsky by inlining compare function 2019-03-30 12:39:45 +03:00
qianlixiang
bdb420cdfd Fixed segment fault of arrayIntersect 2019-03-29 18:53:50 +08:00
alexey-milovidov
7aefd6663f
Merge pull request #4841 from danlark1/master
Added hyperscan fuzzy search
2019-03-29 12:39:25 +03:00
Danila Kutenin
cd850f6f98 Fix clang build 2019-03-29 10:04:44 +03:00
Danila Kutenin
b822923f5a Better renamings of fuzzy string search 2019-03-29 04:27:17 +03:00
Danila Kutenin
ef0d622a5f Added hyperscan fuzzy search 2019-03-29 04:02:05 +03:00
alexey-milovidov
e3c5da0a69
Merge pull request #4783 from yandex/cow-ptr-compositions
WIP. Attempt to make compositions with COWPtr more convenient
2019-03-29 02:09:39 +03:00
Danila Kutenin
d22d66a552 Fix exception message 2019-03-28 20:06:04 +03:00
Danila Kutenin
d4e67fa64c Another bug fixed to the comparison 2019-03-28 19:58:16 +03:00
Danila Kutenin
70a7f4805d Test to the restriction added, fix bug 2019-03-28 19:41:11 +03:00
Danila Kutenin
cae4a426c5 Hyperscan restriction 2019-03-28 17:59:25 +03:00
Alexey Milovidov
4417705f32 Merge branch 'master' into cow-ptr-compositions 2019-03-28 17:47:59 +03:00
Alexey Milovidov
faf9462c37 Added support for constant-constant case in multi-search functions 2019-03-27 22:25:58 +03:00
Alexey Milovidov
42dd521e45 Added a setting to disallow Hyperscan 2019-03-27 00:56:46 +03:00
Ivan Remen
2fb5addc40 H3 library integration 2019-03-26 11:59:48 +03:00
proller
1584fd4367
Fix hyperscan library find and use (#4798) 2019-03-26 00:31:00 +03:00
Alexey Milovidov
fb19cf1eec Attempt to make compositions with COWPtr more convenient 2019-03-25 04:43:54 +03:00