Commit Graph

2510 Commits

Author SHA1 Message Date
millb
d617c443b0 working project 2019-11-12 16:50:31 +03:00
millb
fcbd37c662 Working commit 2019-11-12 14:56:22 +03:00
chertus
92fda25029 fix UB (attempt 2) 2019-11-12 03:18:13 +03:00
chertus
4411edeadd fix UB 2019-11-12 01:47:52 +03:00
chertus
a8a283ffdc add missing array functions for Decimals 2019-11-11 23:46:36 +03:00
chertus
b2ae509030 fix gcc9 build 2019-11-11 21:02:44 +03:00
alexey-milovidov
44cf1483c8
Merge pull request #7710 from amosbird/batchreduce2
Better addBatchArray aggregator
2019-11-11 20:36:34 +03:00
chertus
03933a1039 gather utils for Decimals (no scale checks) 2019-11-11 19:18:37 +03:00
millb
0ee1b46d40 Working test 2019-11-11 12:00:31 +03:00
Amos Bird
3707da4fbf
Better addBatchArray aggregator 2019-11-11 16:56:11 +08:00
millb
368bb5f217 Working project 2019-11-11 11:47:20 +03:00
millb
e15c636021 Working commit 2019-11-11 11:36:02 +03:00
Vasily Nemkov
07041d45c9 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-11-11 09:19:13 +03:00
Vasily Nemkov
d227712f84 Fixed build errors for GCC-9 and Apple Clang. 2019-11-11 09:07:26 +03:00
Vasily Nemkov
5c125dff90 Fixed PVS error on sprintf and structure. 2019-11-11 08:34:39 +03:00
Alexey Milovidov
f47415b7fa Allowed non-constant negative "size" argument for function "substring" 2019-11-11 04:45:03 +03:00
alexey-milovidov
1d910c5071
Merge pull request #7608 from amosbird/batchreduce
Optimize arrayReduce, -Array and -State combinators
2019-11-10 22:10:03 +03:00
Vasily Nemkov
9ff70ff484 Fixed GCC-9 error of not returning a value from non-void function. 2019-11-10 16:13:26 +03:00
Vasily Nemkov
512932c0d2 Fixed regression: unable to determine timezone for certain cases. 2019-11-10 16:12:59 +03:00
millb
15932052c5 Working commit 2019-11-08 20:46:12 +03:00
Vasily Nemkov
b93e6b8db8 Fixed GCC9 build error 2019-11-08 14:52:01 +03:00
alexey-milovidov
0fefebae1b
Merge pull request #7518 from sundy-li/improve_range
Improve range
2019-11-08 00:59:05 +03:00
alexey-milovidov
98eca0faef
Merge pull request #7652 from ClickHouse/trap-context-dangling-reference
Added another mode for function "trap"
2019-11-08 00:57:26 +03:00
alexey-milovidov
034d6ce729
Merge pull request #7355 from millb/decimal_hex_function
Decimal hex function
2019-11-08 00:56:59 +03:00
Vasily Nemkov
3ea467d34a Minor fixes: headers, comments and [[maybe_unused]] for some variables. 2019-11-07 13:56:13 +03:00
alesapin
4f6fa013e5 Merge branch 'master' into fix_scope_of_interpreter_select_query_in_mutations 2019-11-07 11:18:35 +03:00
Amos Bird
544af39d23
Vectorize arrayReduce and -Array combinator
Also devirtualize -State combinator.
2019-11-07 11:53:47 +08:00
alexey-milovidov
31aff291e6
Merge pull request #7651 from achimbab/javaHashUTF16LE
Implemented javaHashUTF16LE()
2019-11-06 22:58:48 +03:00
alesapin
8c7deaa70d More safier, but still ugly mutations interpreter 2019-11-06 20:28:03 +03:00
Mikhail Korotov
317af908fd Merge branch 'master' into decimal_hex_function 2019-11-06 18:20:05 +03:00
Mikhail Korotov
ed7971ea25 Fixed small bug 2019-11-06 18:15:24 +03:00
millb
254c94ebfa Fixed bugs 2019-11-06 18:06:15 +03:00
philip.han
16ea323fff Removed undefined behavior of signed integer overflow. 2019-11-07 00:00:59 +09:00
millb
7d46d359ea Working commit 2019-11-06 17:48:23 +03:00
philip.han
300062e91a Fixed type conversions in javaHashUTF16LE 2019-11-06 23:17:38 +09:00
millb
7863b7f3c9 Working commit 2019-11-06 16:08:02 +03:00
Alexey Milovidov
3f0476b522 Disabled "trap" function back 2019-11-06 15:36:56 +03:00
Vasily Nemkov
9c62209978 Added missing support of formatDateTime() for DateTime64 2019-11-06 15:01:39 +03:00
millb
4f6197c370 Working commit 2019-11-06 14:48:17 +03:00
alexey-milovidov
a120fba929
Update FunctionsHashing.h 2019-11-06 14:20:31 +03:00
Alexey Milovidov
83c63171ad Added another mode for function "trap" #7601 2019-11-06 14:17:12 +03:00
Alexander Kuzmenkov
233212ac68
Merge pull request #7531 from amosbird/getkeymapped
Unify hash tables interface (separated for review)
2019-11-06 13:49:39 +03:00
philip.han
68a82f78b4 Implemented javaHashUTF16LE() 2019-11-06 19:46:37 +09:00
sundy-li
76b75dc0e8 args to supertype 2019-11-06 18:19:08 +08:00
Mikhail Korotov
281b0062bc
Working commit 2019-11-06 11:48:51 +03:00
Mikhail Korotov
556f6fbdc5
Working commit 2019-11-06 11:47:25 +03:00
millb
043ca0d470 Working commit 2019-11-06 11:42:34 +03:00
millb
9308ea5d33 Merge branch 'decimal_hex_function' of github.com:millb/ClickHouse into decimal_hex_function 2019-11-06 11:29:43 +03:00
millb
695f3c58cc Working Commmit 2019-11-06 11:29:18 +03:00
Mikhail Korotov
0168620fad
Fixed style commit 2019-11-06 11:17:31 +03:00
millb
0226ba406c Functions tryExecuteFloat and tryExecuteDecimal are combined 2019-11-06 10:42:10 +03:00
millb
5c478dfe02 Merge branch 'master' into decimal_hex_function 2019-11-06 09:43:30 +03:00
alexey-milovidov
8fc84e93ff
Merge pull request #7635 from ClickHouse/fix_concat_return_data_type
Now concat always return string column
2019-11-05 21:39:48 +03:00
alexey-milovidov
40a8216294
Merge pull request #7625 from ClickHouse/array-compact-improve
Improvement of arrayCompact function.
2019-11-05 21:39:06 +03:00
Amos Bird
fbfbe161ec
Unify hash tables interface. 2019-11-06 00:08:04 +08:00
alesapin
2d7ae27232 Now concat always return string column 2019-11-05 16:23:09 +03:00
Vasily Nemkov
61ad74bc58 Fixed parsing DateTime and/or DateTime64 with parseXXXOrNull 2019-11-05 14:59:46 +03:00
sundy-li
71ec49cc2f add range performance tests 2019-11-05 15:07:25 +08:00
alexey-milovidov
6a871f579f
Merge pull request #7598 from infinivision/bitmap_replace
added bitmapTransform
2019-11-05 02:23:50 +03:00
alexey-milovidov
2fe5f23025
Update FunctionsBitmap.h 2019-11-05 02:21:22 +03:00
alexey-milovidov
0c1510d3e3
Update FunctionsBitmap.h 2019-11-05 02:20:16 +03:00
alexey-milovidov
f9d14f78c0
Update FunctionsBitmap.h 2019-11-05 02:09:28 +03:00
alexey-milovidov
7d2a16ee39
Merge pull request #7486 from sundy-li/char_function
functions: add char function
2019-11-05 01:40:18 +03:00
Alexey Milovidov
979db8c965 Improve "arrayCompact" function 2019-11-05 01:13:10 +03:00
Vasily Nemkov
c6eb0fcff7 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-11-04 17:06:22 +03:00
Vasily Nemkov
1237976021 Minor: style fix and removed debug output. 2019-11-04 14:54:17 +03:00
Zhichang Yu
da2d05802c added bitmapTransform 2019-11-04 14:55:31 +08:00
alexey-milovidov
a8d6843723
Merge pull request #7599 from azat/__getScalar-fix
Check column for __getScalar() (avoids assertion)
2019-11-04 02:28:42 +03:00
Azat Khuzhin
842f4e2ca0 Check column for __getScalar() (avoids assertion)
Can be triggered using the following query:
  CREATE TABLE foo (key String, macro String MATERIALIZED __getScalar(key)) Engine=Null();

Trace:
    3. 0x00007ffff6d5d526 __assert_fail (libc.so.6)
    4. 0x00007ffff41fd931 boost::intrusive_ptr<DB::IColumn const>::operator*() const (libclickhouse_functionsd.so)
    5. 0x00007ffff41fcd64 COW<DB::IColumn>::IntrusivePtr<DB::IColumn const>::operator*() const & (libclickhouse_functionsd.so)
    6. 0x00007ffff4dc5944 DB::FunctionGetScalar::getReturnTypeImpl() const (libclickhouse_functionsd.so)

(Even though it is internal I guess it is better to fix it)

Refs: #7392
Cc: @amosbird
2019-11-03 21:44:56 +03:00
Vasily Nemkov
98235e9202 Fixed now64 2019-11-03 08:42:48 +03:00
Vasily Nemkov
f437ae4822 Fixed zero-subsecond part 2019-11-03 08:38:45 +03:00
Vasily Nemkov
1fc28c08e6 Fixed toDateTime64 bug
Of unable to deduce timezone in function execution phase.
2019-11-03 08:10:11 +03:00
alexey-milovidov
d08bfbd3e1
Merge pull request #7328 from Joeywzr/arrayCompact
implement arrayCompact
2019-11-03 01:07:19 +03:00
alexey-milovidov
fa0274e223
Merge pull request #7380 from hczhcz/patch-1018
Add function arrayFill and arrayReverseFill
2019-11-03 01:06:41 +03:00
alexey-milovidov
15c4a19bb1
Merge pull request #7585 from ernestp/macos_catalina_2019_11_01
Fixed compile errors on macOS Catalina
2019-11-02 15:46:17 +03:00
alexey-milovidov
f5531fb436
Merge pull request #7590 from amosbird/typetrait
ubsan fix
2019-11-02 13:22:39 +03:00
Amos Bird
ad12099642
ubsan fix 2019-11-02 17:00:03 +08:00
alexey-milovidov
dda93e2275
Merge pull request #7561 from ClickHouse/achimbab-master
Merge for #7363
2019-11-02 00:57:13 +03:00
Ernest Poletaev
de1e5d0e53 Fixed compile errors on macOS Catalina 2019-11-01 23:33:43 +07:00
alexey-milovidov
4081b0be90
Merge pull request #7497 from amosbird/countopt
Early constant folding.
2019-11-01 16:54:02 +03:00
Nikolai Kochetov
9a5a0a2a3b Fix types for set elements. 2019-10-31 19:14:06 +03:00
Amos Bird
e04cdd4ebb
Early constant folding. 2019-10-31 23:54:32 +08:00
Vasily Nemkov
a6ba05e5d9 Fixed converting DateTime64 to DateTime and Date. 2019-10-31 11:27:15 +03:00
sundy-li
17212afabb fix virtual call 2019-10-31 13:19:28 +08:00
sundy-li
d2a785f759 fix style 2019-10-31 12:59:50 +08:00
alexey-milovidov
194fd85f5c
Update arrayCompact.cpp 2019-10-31 00:29:15 +03:00
alexey-milovidov
1ec7cb3546
Update range.cpp 2019-10-30 23:39:29 +03:00
Vasily Nemkov
be683588a5 Fixed CASTing Date and DateTime to DateTime64 2019-10-30 16:59:38 +03:00
Vasily Nemkov
bb04fd8e54 Type-support fixes 2019-10-30 13:10:51 +03:00
sundy-li
7292748012 fix docs 2019-10-30 10:06:30 +08:00
sundy-li
be9da37720 fix zero divide 2019-10-30 09:36:50 +08:00
Alexander Kuzmenkov
55ec00977b
Update dbms/src/Functions/greatCircleDistance.cpp 2019-10-29 16:31:53 +03:00
sundy-li
6f2cce37d7 fix move 2019-10-29 19:22:00 +08:00
sundy-li
718fb99939 fix move 2019-10-29 19:20:35 +08:00
sundy-li
66ffec32f7 improve range to support start,step args 2019-10-29 14:33:03 +08:00
sundy-li
9eb77a59e3 fix index 2019-10-29 13:20:18 +08:00
sundy-li
a653f50432 remove logs 2019-10-29 13:01:45 +08:00
sundy-li
dbd3227e5a fixup partial const column 2019-10-29 11:51:27 +08:00
sundy-li
3f1651fa29 improve range 2019-10-29 11:03:47 +08:00
memo
3449e8d107 fix 2019-10-29 10:27:54 +08:00
memo
3064e716db add line 2019-10-28 14:48:25 +08:00
memo
0f572e5d7d add line 2019-10-28 12:51:59 +08:00
memo
90333ac9aa modified getReturnType 2019-10-28 11:15:52 +08:00
sundy-li
538b77c123 functions: add char function as mysql behavior 2019-10-28 10:44:56 +08:00
Vasily Nemkov
38e2897b49 Casting DateTime64 to DateTime64 of different scale or to/from Date/DateTime 2019-10-26 09:22:55 +03:00
Azat Khuzhin
04f1e6b2cc Use crc32_z() over crc32(), since it size_t for length 2019-10-25 23:32:29 +03:00
Azat Khuzhin
2d2e738085 Add CRC32IEEE()/CRC64() support
zlib's implementation uses CRC-32-IEEE 802.3 polynomial (0xedb88320) but
with starting value 0xffffffff, so introduce another crc32
implementation - CRC32IEEE that has starting value - 0

Also add CRC64 with ECMA polynomial.

v2: s/crc*_data./crc*_data./ to avoid conflicts with other crc32.h in contrib
v3: join with existing CRC32()
2019-10-25 15:52:41 +03:00
hcz
3767cb76de Improve style 2019-10-25 11:25:02 +08:00
Vasily Nemkov
17263bc7b1 Better reporting of unmatching function argument types. 2019-10-24 13:49:00 +03:00
Vasily Nemkov
d6ff36c760 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-10-24 07:52:50 +03:00
Amos Bird
295864e6e0
better scalar query 2019-10-23 21:37:54 +08:00
Vasily Nemkov
1a0011853e Fixed toWeek, toYearWeek, toStartOfWeek with DateTime64 2019-10-23 15:27:36 +03:00
stavrolia
22e960dbff Move initialisation of constants 2019-10-23 13:55:44 +03:00
Vasily Nemkov
f8170e8973 Reverted modifications of now.cpp 2019-10-22 18:37:43 +03:00
Vasily Nemkov
06255a9b9f DateTime64 toStartOfInterval fix 2019-10-22 10:43:14 +03:00
hcz
d877ef6098 Merge remote-tracking branch 'hcz/patch-1018' into patch-1018 2019-10-22 11:31:23 +08:00
memo
645bcdacae add docs and simplify the code 2019-10-22 10:23:07 +08:00
Vitaly Baranov
a0ca932035
Fix build and add comments. 2019-10-21 16:39:55 +03:00
millb
2a183c3d07 Merge branch 'master' into decimal_hex_function 2019-10-21 11:13:51 +03:00
hcz
79a27ece1a Flip the condition column in arrayFill 2019-10-21 11:19:11 +08:00
stavrolia
40688294b0 another attempt to fix clang warning 2019-10-21 01:56:22 +03:00
philip.han
5e32bf1ae7 Removed unchecked type-casting 2019-10-19 21:42:08 +09:00
VDimir
797f76a187 Separate class for IsValidJSONImpl 2019-10-19 07:26:19 +00:00
VDimir
f1630b4e2e Merge branch 'master' into feature/isvalidjson-5910 2019-10-19 06:21:21 +00:00
stavrolia
1397a90324 Fix test and clang warning 2019-10-18 18:03:15 +03:00
hcz
2be06255b1
Update arrayFill.cpp 2019-10-18 21:31:18 +08:00
hcz
124ea9699a Add arrayFill 2019-10-18 16:45:39 +08:00
hcz
decd555317 Cleanup, keep function names consistent 2019-10-18 15:30:41 +08:00
philip.han
8aac4d04de Fixed weird type-casting for IN-operator in bloom_filter 2019-10-17 19:53:41 +09:00
stavrolia
688ec20de1 Fix style from clang warnings 2019-10-17 09:28:26 +03:00
Amos Bird
89247deb64 Constness-aware JoinGet. 2019-10-17 08:52:28 +08:00
stavrolia
65efaf7ac7 Delete macros 2019-10-16 22:52:35 +03:00
stavrolia
fdad33fcd0 Fix style 2019-10-16 20:43:44 +03:00
stavrolia
ae2f5ad7d2 Speedup 2019-10-16 20:25:46 +03:00
millb
19a54a59bb Created: function hex for Decimal32, Decimal64, Decimal128 2019-10-16 18:28:10 +03:00
Vasily Nemkov
6280ea086f Enabled toDateTime64 2019-10-16 10:26:28 +03:00
memo
947c345eda style: Normalize the format 2019-10-16 14:05:43 +08:00
memo
d1fb238820 implement arrayCompact 2019-10-15 15:50:10 +08:00
Vasily Nemkov
9f9fcb1add Simplified argument type validation for conversion functions. 2019-10-14 16:28:52 +03:00
alexey-milovidov
f0409348a1
Merge pull request #7294 from hczhcz/patch-1013
Add arraySplit
2019-10-14 12:32:09 +03:00
Danila Kutenin
60d273a65d Get better message for non hyperscan supported platforms 2019-10-14 10:58:05 +02:00
Vasily Nemkov
db166af95a Moved DataTypeDateTime64 and now64() to separate source files. 2019-10-14 11:38:03 +03:00
Danila Kutenin
7527896f1a Unused variables 2019-10-13 21:40:07 +02:00
Danila Kutenin
57f20ba17e All multi{Fuzzy}MatchAllIndices functions 2019-10-13 15:22:09 +02:00
hcz
c8c40e159d Add arraySplit 2019-10-13 16:06:57 +08:00
alexey-milovidov
4dffc67434
Merge pull request #7291 from sundy-li/FQDN
Function FQDN, fullHostName
2019-10-12 20:02:22 +03:00
alexey-milovidov
62c7c50aba
Update FunctionsJSON.h 2019-10-12 20:00:32 +03:00
VDimir
1174fc346b Add isValidJSON function 2019-10-12 11:42:43 +00:00
sundy-li
4e48992397 fullHostName by function getFQDNOrHostName 2019-10-12 17:21:30 +08:00
sundy-li
59d2989826 Function FQDN,fullHostName 2019-10-12 15:17:30 +08:00
Vasily Nemkov
8648ebf75c Initial implementation of DateTime64 parsing functions; 2019-10-12 10:03:38 +03:00
Alexander Kuzmenkov
57b5592236 Work around garbage in roaring.h to fix Mac OS build. 2019-10-11 14:28:16 +03:00
Alexander Kuzmenkov
8a1d57bddb Include PODArray.h into fewer files. 2019-10-11 14:28:16 +03:00
Vasily Nemkov
a6b20e8ca3 Minor simplification on FunctionDateOrDateTimeAddInterval::TransformResultDataType and FunctionDateOrDateTimeAddInterval::resolveReturnType 2019-10-10 20:05:29 +03:00
Alexander Kazakov
03c7b7ff8d
Prevent from using non-deterministic functions in mutations of replicated tables (#7247)
* Added isDeterministic() to IFunctionBuilder i-face
* A test for non-deterministic mutations
* In MutationsInterpreter::validate() ensure deterministic functions
* Adjusted nondeterministic mutation tests
* Moved around some code in MutationsInterpreter::validate()
* Dropped unnecessary check in findFirstNonDeterministicFuncName()
* Corrections to IFunction{Base,Builder} interface
2019-10-10 17:38:08 +03:00
Vasily Nemkov
fb4dbf94e9 Simplified customizing add/substract-Interval functions for DateTime64 2019-10-10 16:49:40 +03:00
Vasily Nemkov
7afff3d661 Style fixes 2019-10-09 23:02:50 +03:00
Vasily Nemkov
c1f9fcc3d5 Fixed getting function default timezone value from DateTime64-argument 2019-10-09 22:53:57 +03:00
Vasily Nemkov
3e3de2adf8 add/substract-XXX family of functions now can take DateTime64 as argument 2019-10-09 22:52:59 +03:00
Alexey Milovidov
9f8d562543 Add function "getMacro" #7239 2019-10-09 04:14:57 +03:00
Alexander Kuzmenkov
2b30f2696c Include Field.h in less files. 2019-10-08 16:23:24 +03:00
Vasily Nemkov
1a84580005 Scaffold for toDateTime64(scale, [timezone]) 2019-10-08 07:59:38 +03:00
Vasily Nemkov
77ac67eba8 Fixed toTimeZone implementation 2019-10-08 07:50:13 +03:00
Vasily Nemkov
46e5171952 Fixed comparing values of DateTime64 to DateTime and Int/UInt 2019-10-07 18:19:18 +03:00
Vasily Nemkov
46174e92b3 attempt to fix toTimeZone. 2019-10-07 10:45:59 +03:00
alexey-milovidov
d096119529
Merge pull request #7156 from ClickHouse/fix-header-for-now
Fix header for function 'now'
2019-10-05 22:35:23 +03:00
proller
594c535bd4 Build fixes (#7063)
* Build fixes

*            fix

* Fix

* fix

* Fix install(export..

* Freebsd fixes

* Freebsd fixes

* Fix warning

* fix

* More PRIVATE linking

* Fix review

* Timmy

* fix

* fix
2019-10-05 22:25:31 +03:00
Vasily Nemkov
f6a997d1e1 Minor: using UInt32 DateTime64-related scale instead of UInt64. 2019-10-04 17:05:39 +03:00
tavplubix
d73db7f779
Merge pull request #6781 from ClickHouse/merging_values_with_expressions
Merging Values with expressions
2019-10-04 12:51:22 +03:00
Vasily Nemkov
bda2179dc3 Fixed now64() to be variadic 2019-10-03 11:10:52 +03:00
Alexander Kuzmenkov
8e245d4e8c
Merge pull request #7135 from ClickHouse/aku/msan-field
Fix some MemorySanitizer warnings for Fields.
2019-10-03 10:33:44 +03:00
Vasily Nemkov
180b986972 Extern templates + minor simplifications 2019-10-03 10:27:28 +03:00
Vasily Nemkov
655ec351ba Fixed DateTime64 creation, and optional scale parameter for now64()
Added more tests for casting and inserting values.
2019-10-03 05:07:36 +03:00
Alexander Tokmakov
80e5976d10 fixes after review 2019-10-02 20:51:00 +03:00
Vasily Nemkov
31d5730513 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-10-02 13:54:59 +03:00
Vasily Nemkov
6e813002d5 Proper serialization of DateTime64 also updated functions support. 2019-10-02 08:53:38 +03:00
Nikolai Kochetov
58a432be62 Updated functions today, yestarday, randConstant. 2019-10-01 13:15:20 +03:00
Nikolai Kochetov
b9b2ca342d Updated functions today, yestarday, randConstant. 2019-10-01 13:11:16 +03:00
Nikolai Kochetov
92ba6081a4 Updated functions today, yestarday, randConstant. 2019-10-01 13:10:07 +03:00
Nikolai Kochetov
0d94bdb6a1 Updated functions today, yestarday, randConstant. 2019-10-01 13:03:55 +03:00
Nikolai Kochetov
486deee1f1 Use new iface for now function. Use current time value from function builder. 2019-09-30 20:36:03 +03:00
Nikolai Kochetov
393bfdcd9f Use new iface for now function. Use current time value from function builder. 2019-09-30 20:31:36 +03:00
Alexander Tokmakov
979f235e38 Merge branch 'master' into merging_values_with_expressions 2019-09-30 18:06:58 +03:00
Nikolai Kochetov
963acff1d2 Use new iface for now function. Use current time value from function builder. 2019-09-30 17:59:04 +03:00
Alexander Kuzmenkov
ec2d9a083c Remove excessive includes. 2019-09-30 15:31:14 +03:00
Vasily Nemkov
9cc2baf05c DataType64 as decimal
compiles
2019-09-26 18:12:40 +03:00
alesapin
4fdb5a61e5 Rename ExternalDictionaries to ExternalDictionariesLoader 2019-09-26 13:41:33 +03:00
alesapin
5668f55ab7 Rename ExternalModels to ExternalModelsLoader 2019-09-26 13:23:14 +03:00
Alexander Kuzmenkov
f3bde19b74 Do not use iterators in find() and emplace() methods of hash tables.
Instead, these methods return a pointer to the required data as they are
stored inside the hash table. The caller uses overloaded functions to
get the key and "mapped" values from this pointer. Such an interface
avoids the need for constructing iterator-like wrapper objects, which is
especially important for compound hash tables such as the future
StringHashMap.
2019-09-24 17:44:35 +03:00
alexey-milovidov
2f195ddb03
Merge pull request #7028 from abyss7/issue-6459
Implement cross-compilation support Linux → Darwin
2019-09-24 02:20:17 +03:00
alexey-milovidov
a314a36feb
Merge pull request #7062 from ClickHouse/fix-msan-for-low-cardinality
Fix msan for LowCardinality
2019-09-24 02:11:15 +03:00
alexey-milovidov
c4c936c685
Merge pull request #7049 from ClickHouse/ucasFL-master
Merging function "repeat"
2019-09-23 22:52:38 +03:00
alexey-milovidov
e24d882326
Merge pull request #7024 from millb/master
Fixed Function Hex for Float32 and Float64
2019-09-23 22:52:19 +03:00
Nikolai Kochetov
630872837e Skip null columns while checknig num rows. 2019-09-23 22:26:04 +03:00
millb
bd29efdbbe New hex function release
Bugs and tests fixed
2019-09-23 18:47:34 +03:00
Ivan Lezhankin
ce2fb6d3d1 Fix build 2019-09-23 17:46:01 +03:00
Nikolai Kochetov
61b583ccb9 Fix size of constant columns in case of execution function over LowCardinality without allowed defaults. 2019-09-23 17:19:02 +03:00
Nikolai Kochetov
f15bc77778 Fix size of constant columns in case of execution function over LowCardinality without allowed defaults. 2019-09-23 16:36:20 +03:00
Ivan Lezhankin
4b143c3e0f Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-23 16:07:19 +03:00
Alexey Milovidov
2585cde3d0 Added safety threshold 2019-09-23 02:49:15 +03:00
Alexey Milovidov
454b83fcd3 Merging function 'repeat' 2019-09-23 02:30:13 +03:00
Alexey Milovidov
52272eeea9 Merge branch 'master' of https://github.com/ucasFL/ClickHouse into ucasFL-master 2019-09-23 02:04:18 +03:00
alexey-milovidov
61b02598d7
Update repeat.cpp 2019-09-23 02:02:03 +03:00
alexey-milovidov
0dc4b1793d
Merge pull request #7036 from infinivision/fix_bitmapMax_doc
fix bitmapMin and bitmapMax doc
2019-09-23 01:49:04 +03:00
alexey-milovidov
6fa234cea4
Merge pull request #6894 from azat-archive/hashed-dict-memory-usage-v2
[RFC] Add sparsehash support for hashed dictionary (to reduce memory usage)
2019-09-22 15:55:36 +03:00
fenglv
4465fdb8bf Add test
fix

fix

fix
2019-09-22 14:25:43 +08:00
alexey-milovidov
67e02b4ea0
Merge pull request #6957 from infinivision/add_bitmapSubsetLimit
added bitmapSubsetLimit
2019-09-22 04:58:44 +03:00
Silviu Caragea
5a14d97587 Fix linking when __ELF__ is not defined 2019-09-22 01:04:17 +03:00
Zhichang Yu
ab7ecd84a1 fix bitmapMin and bitmapMax doc 2019-09-21 23:34:44 +08:00
Azat Khuzhin
420089c301
Add new dictionary layout (sparse_hashed) that is more memory efficient
With this new layout, sparsehash will be used over default HashMap,
sparsehash is more memory efficient but it is also slower.

So in a nutshell:
- HashMap uses ~2x more memory then sparse_hash_map
- HashMap ~2-2.5x faster then sparse_hash_map
(tested on lots of input, and the most close to production was
dictionary with 600KK hashes and UInt16 as value)

TODO:
- fix allocated memory calculation
- getBufferSizeInBytes/getBufferSizeInCells interface
- benchmarks

v0: replace HashMap with google::sparse_hash_map
v2: use google::sparse_hash_map only when <sparse> isset to true
v3: replace attributes with different layout
v4: use ch hash over std::hash
2019-09-21 02:22:40 +03:00
Alexander Tokmakov
0080639f79 Merge branch 'master' into merging_values_with_expressions 2019-09-20 23:26:01 +03:00
Ivan Lezhankin
9e46118edd Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-20 21:25:55 +03:00
Ivan Lezhankin
967e00a8da It works!
if compiled with:

CC=clang CXX=clang++ cmake -Wno-dev . -Bbuild -GNinja -DCMAKE_AR:FILEPATH=x86_64-apple-darwin-ar -DCMAKE_RANLIB:FILEPATH=x86_64-apple-darwin-ranlib -DCMAKE_SYSTEM_NAME=Darwin -DSDK_PATH=MacOSX10.14.sdk -DLINKER_NAME=x86_64-apple-darwin-ld -DUSE_SNAPPY=OFF -DENABLE_SSL=OFF -DENABLE_PROTOBUF=OFF -DENABLE_PARQUET=OFF -DENABLE_READLINE=OFF -DENABLE_ICU=OFF -DENABLE_FASTOPS=OFF
2019-09-20 20:09:22 +03:00
millb
88adbb72d9 Fixed Function Hex for Float32 and Float64 2019-09-20 19:21:05 +03:00
fenglv
2062bedaf0 Add repeat function 2019-09-20 00:46:41 +08:00
Zhichang Yu
0dc3866c36 added bitmapSubsetLimit 2019-09-19 10:15:36 +08:00
alexey-milovidov
01a1920e9b
Merge pull request #6970 from infinivision/add_bitmapMin_bitmapMax
added bitmapMin and bitmapMax
2019-09-19 02:01:16 +03:00
Artem Zuikov
aae82eed5a
Merge pull request #6940 from 4ertus2/mjoin
PartialMergeJoin
2019-09-18 16:16:10 +03:00
Zhichang Yu
460ccb04a2 added bitmapMin and bitmapMax 2019-09-18 16:56:12 +08:00
Vitaly Baranov
0fb234c63e
Merge branch 'master' into dict_allow_databases 2019-09-15 01:51:44 +03:00
Alexander Kuzmenkov
f4da0399c0 Some MemorySanitizer fixes. 2019-09-13 14:49:29 +03:00
Guillaume Tassery
bb088fbf65 Write dictionary permission on user instead of dictionary configuration 2019-09-13 10:22:34 +02:00
proller
0d6612d424 CLICKHOUSE-4652 Simpler 2019-09-12 22:52:24 +03:00
proller
8ce32897fa CLICKHOUSE-4652 Another fix for АrrayEnumerateUniqRanked with empty arrays 2019-09-12 22:38:34 +03:00
Alexander Tokmakov
f323476111 Merge branch 'master' into merging_values_with_expressions 2019-09-11 23:31:37 +03:00
Guillaume Tassery
5f1621faa2 Add database right for dictionaries 2019-09-11 13:14:55 +02:00
Amos Bird
bf799fef92 Build fix 2019-09-11 10:53:56 +08:00
Amos Bird
a1310ffbe6 Split libdbms.so using object library
Now the linking time of incremental builds are around 1-2 seconds
2019-09-11 01:56:01 +08:00
chertus
1b313eedfa MergeJoin in progress 2019-09-09 22:43:37 +03:00
Vasily Nemkov
1b0410cee7 Merge commit '50928323ebabe0663e26601c3929ee94b9a5127d' into DateTime64 2019-09-09 16:18:22 +03:00
Denis Zhuravlev
50c32490be
Update arrayElement.cpp
Typo in error message ( is -> are )
2019-09-05 19:41:27 -03:00
Alexander Tokmakov
8936f854be better checking of types of literals 2019-09-04 19:54:20 +03:00
Zhichang Yu
cfac445144 fix bitmapSubsetInRange memory leak 2019-09-04 22:05:32 +08:00
alexey-milovidov
4f7d472cb7
Merge pull request #6048 from Akazz/ternary-logic-light
Correct implementation of ternary logic for AND/OR
2019-09-03 22:09:56 +03:00
alexey-milovidov
845a612b95
Merge pull request #6773 from infinivision/fix_issue_6575
fix DataTypeAggregateFunction deserialization
2019-09-03 21:19:41 +03:00
Zhichang Yu
fd0947899d fix 00980_shard_aggregation_state_deserialization.sql 2019-09-03 23:47:09 +08:00
Alexander Tokmakov
b9eb992320 Merge branch 'master' into merging_values_with_expressions 2019-09-02 19:54:56 +03:00
proller
184e2ef9ab CLICKHOUSE-4644 arrayEnumerateUniqRanked: fix for empty arrays 2019-09-02 18:49:25 +03:00
Alexander Tokmakov
46effbd7f6 Template for functions with constant arguments 2019-09-02 17:33:10 +03:00
Alexander Kuzmenkov
ab2bd54022 Remove a redundant condition (found by PVS-Studio). 2019-09-02 16:17:14 +03:00
Zhichang Yu
9e587fb139 fix DataTypeAggregateFunction deserialization 2019-09-02 20:09:40 +08:00
Alexey Milovidov
dcc6163d32 Added function "trap" 2019-09-01 00:39:17 +03:00
Alexey Milovidov
aac0b27daa Fixed possible deadlock in distributed queries 2019-08-31 15:18:14 +03:00
alexey-milovidov
2b124c5af8
Merge pull request #6718 from vitlibar/fix-extract-tuple-from-json
Fix extracting a Tuple from JSON
2019-08-29 17:40:26 +03:00
Vitaly Baranov
6cbb52128b Fix extracting tuple from JSON. 2019-08-29 01:55:35 +03:00
alexey-milovidov
16ba2fa85a
Merge pull request #6662 from Enmk/hasTokenCaseInsensitive
Implemented hasTokenCaseInsensitive function
2019-08-27 00:39:04 +03:00
Vasily Nemkov
d0d63d769e Implemented hasTokenCaseInsensitive function
And tests;
2019-08-26 11:00:48 +03:00
alexey-milovidov
03deb642d5
Merge pull request #6647 from yandex/fix-trim
Fixed "trim" functions
2019-08-24 17:36:38 +03:00
Alexey Milovidov
cc0157b293 Added a test 2019-08-24 02:07:05 +03:00
Alexey Milovidov
d38e9ee229 Fixed "trim" functions (in progress) 2019-08-23 23:32:31 +03:00
alexey-milovidov
eeeaf8fbee
Merge pull request #6643 from yandex/double-whitespaces
Added a check for double whitespaces
2019-08-23 23:10:12 +03:00
alexey-milovidov
012a5f8911
Merge pull request #6596 from Enmk/hasToken
hasToken function implementation
2019-08-23 21:41:33 +03:00
Alexey Milovidov
b42f85e16b Added a check for double whitespaces 2019-08-23 21:30:04 +03:00
Alexey Milovidov
20b9af29f5 More tests 2019-08-23 07:34:59 +03:00
Alexey Milovidov
6685365ab8 Added optimized case 2019-08-23 07:25:32 +03:00
Alexey Milovidov
341e2e4587 Step 1: make it correct. 2019-08-23 06:00:06 +03:00
Alexey Milovidov
1222973cb3 Function "neighbor": merging #5925 2019-08-23 05:02:14 +03:00
Alexey Milovidov
cff8ec43f9 Rename neighbour -> neighbor 2019-08-23 04:31:04 +03:00
alexey-milovidov
49aa9384af
Merge pull request #5925 from alex-krash/function_next_prev_in_block
Implement neighbour() function
2019-08-23 04:28:36 +03:00
Vasily Nemkov
6d78e3be94 hasToken function implementation
* Function to check if given token is present in a string;
* Special case for hasToken to 'tokenbf_v1' index;
* Test cases for hasToken()
* Test case for hasToken() + 'tokenbf_v1' integration
2019-08-22 18:00:35 +03:00
alexey-milovidov
f0e0793cdd
Merge pull request #6581 from yandex/assert_cast
Added checks to static_cast of columns.
2019-08-22 05:09:34 +03:00
Alexey Milovidov
e573b06373 Updated comment 2019-08-21 23:33:38 +03:00
Alexey Milovidov
93d380ddaa Fixed test 2019-08-21 23:32:58 +03:00
alexey-milovidov
e6fd885c68
Merge pull request #6580 from yandex/fix-nullif
Fix nullIf function.
2019-08-21 06:36:47 +03:00
alexey-milovidov
0e896fb341
Merge pull request #6578 from yandex/disable-elf-on-macos
Disable ELF on Mac OS
2019-08-21 06:01:49 +03:00
Alexey Milovidov
8966520801 Added "assert_cast" function as a replacement for static_cast for columns 2019-08-21 05:28:04 +03:00
Alexey Milovidov
b768bef4e3 Fixed nullIf function 2019-08-21 04:43:19 +03:00
Alexey Milovidov
69be2c4658 Fixed nullIf function 2019-08-21 04:28:55 +03:00
Alexey Milovidov
449dc4757a Fixed nullIf function 2019-08-21 04:20:06 +03:00
Alexey Milovidov
562bffb337 Fixed nullIf function 2019-08-21 04:14:25 +03:00
Alexey Milovidov
17e93b8f2d Disable ELF on Mac OS #6429 2019-08-21 03:48:34 +03:00
Nikolai Kochetov
0ab886ce9d Materialize constant in arrayWithConstant function. 2019-08-20 15:28:36 +03:00
Nikolai Kochetov
bfd0505d99 Fix tests. 2019-08-20 11:36:10 +03:00
Nikolai Kochetov
d359ff3d4a Fix build. 2019-08-19 21:34:12 +03:00
Nikolai Kochetov
56a9c3920f Fix build. 2019-08-19 21:28:48 +03:00
Nikolai Kochetov
d4363768e6 Added IFunctonBase::getResultIfAlwaysReturnsConstantAndHasArguments 2019-08-19 20:48:19 +03:00
Nikolai Kochetov
cb848159e1 Merged with master. 2019-08-18 14:52:49 +03:00
proller
d09c5c871b Build fixes (#6491)
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)
2019-08-18 01:53:46 +03:00
Nikolai Kochetov
86bba711c4 Merge branch 'master' into try-to-remove-dry-run 2019-08-17 13:43:14 +03:00
Nikolai Kochetov
7da72261a2 Merge branch 'master' into try-to-remove-dry-run 2019-08-16 15:50:48 +03:00
Nikolai Kochetov
2ef878d7ce Add alwaysReturnsConstant for IFunctionBase. Set alwaysReturnsConstant=true for ignore. 2019-08-15 22:31:43 +03:00
Nikita Vasilev
a051009d28 add it's a bug mes 2019-08-15 21:48:48 +03:00
Nikita Vasilev
f59fa67050 added type checks for set index functions 2019-08-15 21:46:16 +03:00
Alexandr Krasheninnikov
27b079bd6a Tests added, fix wrong behaviour 2019-08-15 11:59:20 +03:00
Nikolai Kochetov
867a7461dc Make randConstant const again. 2019-08-15 10:32:06 +03:00
alexey-milovidov
7a439e269f
Merge pull request #6470 from alex-krash/function_user
Function currentUser()
2019-08-14 20:09:54 +03:00
Nikolai Kochetov
287eb633b8 Merged with master 2019-08-14 18:16:52 +03:00
Nikolai Kochetov
5131b6af4b Fix header for joins. Make function randConstant not constant. 2019-08-14 18:14:32 +03:00
Nikolai Kochetov
16918c7dba Added more comments. 2019-08-14 18:14:32 +03:00
Nikolai Kochetov
de93b759c9 Return non-const column in ignoreExceptNull. 2019-08-14 18:14:32 +03:00
Alexandr Krasheninnikov
d9234a64c4 Make function return initial user 2019-08-14 15:18:11 +03:00
Alexandr Krasheninnikov
2126196c89 Nullable correct handling 2019-08-14 15:09:51 +03:00
Alexandr Krasheninnikov
986d56ba0c Fix casting style, work with Nullable 2019-08-14 14:32:03 +03:00
Alexandr Krasheninnikov
bc4177f64c Make alias case-insenstitive 2019-08-14 13:20:15 +03:00
Vitaly Baranov
75aa1d7858
Merge pull request #6320 from yandex/simdjson-sse42
Enabled SIMDJSON for SSE 4.2 with PCLMUL instruction set
2019-08-13 23:12:40 +03:00
Alexandr Krasheninnikov
e227611f01 New function currentUser() implemented 2019-08-13 19:05:13 +03:00
Vitaly Baranov
9632c4102a Change test to pass the exceeding of memory limit in ParsedJson::Iterator::Iterator when UBSan is used. 2019-08-13 18:26:31 +03:00
Alexandr Krasheninnikov
6bf3902ce5 Format file 2019-08-13 16:20:32 +03:00
Alexandr Krasheninnikov
ea9cf3a62f Done 2019-08-13 16:11:24 +03:00
Alexandr Krasheninnikov
9fa0b867f1 Merge branch 'master' of https://github.com/yandex/ClickHouse into function_next_prev_in_block 2019-08-13 11:45:00 +03:00