thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-17 03:42:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
106,486 Commits 9,315 Branches 1,783 Tags 2.1 GiB
4cf11d9a84
Commit Graph

4550 Commits

Author SHA1 Message Date
Nikolay Degterinsky
c344e2de84 Fix style 2022-07-13 11:41:08 +00:00
Robert Schulze
04c1cb207b
Use fmt-based exceptions in FunctionsMultiStringPosition 
(for consistency with Functions/FunctionsMultiStringSearch.h)
 2022-07-13 09:46:40 +00:00
Robert Schulze
59a64ac902
Rename some variables 
(for consistency with Functions/FunctionsMultiStringSearch.h)
 2022-07-13 09:46:39 +00:00
Robert Schulze
f8c38b0d3a
Remove obsolete doxygen 
(the removed functions are implemented elsewhere)
 2022-07-13 09:46:38 +00:00
Nikolay Degterinsky
daae55b4ac Better 2022-07-13 01:41:27 +00:00
Anton Popov
81da0bb9f5 keep LowCardinality type in array() and map() functions 2022-07-12 13:31:00 +00:00
Andrey Zvonov
7bfe155f09
Merge branch 'master' into dt64_timeslots 2022-07-12 10:26:38 +03:00
Anton Popov
72fe4ce680 fix function toColumnTypeName with LowCardinality 2022-07-12 03:12:42 +00:00
Anton Popov
b67405915e keep LowCardinality type in tuple() function 2022-07-12 02:01:41 +00:00
Kruglov Pavel
57a719bafd
Merge pull request #39037 from amosbird/index-fix-1-again 
Fix toHour() monotonicity which can lead to incorrect query result (incorrect index analysis) (second try)
 2022-07-11 13:36:01 +02:00
Robert Schulze
5b8e448c7e
Merge pull request #39012 from ClickHouse/fix-crashing-stringsearch-with-empty-needle 
Don't throw Logical error in functions multiMatch[Fuzzy](AllIndices/Any/AnyIndex)() with empty needle
 2022-07-11 08:13:52 +02:00
Amos Bird
28aefc33a0
Revert "Merge pull request #39001 from ClickHouse/revert-38675-index-fix-1" 
This reverts commit 1cf01bb959, reversing
changes made to af1136c990.
 2022-07-08 23:22:10 +08:00
Robert Schulze
8e1a3cd194
Don't crash in functions multiMatch[Fuzzy](AllIndices/Any/AnyIndex)() with empty needle 
Queries like
  "select multiMatchAnyIndex('abc', []::Array(String))"
were not properly handled and crashed.
 2022-07-08 11:18:53 +00:00
Alexander Tokmakov
d4784203b7
Revert "Fix toHour() monotonicity which can lead to incorrect query result (incorrect index analysis)" 2022-07-08 12:51:30 +03:00
Robert Schulze
524f39551c
Merge pull request #38485 from ClickHouse/multi-match-with-non_const-patterns 
Multi match with non const patterns
 2022-07-08 09:29:10 +02:00
Roman Vasin
12f4a48957 Extend LUT range to 1900..2300 2022-07-08 06:48:05 +00:00
Alexey Milovidov
89fdcbf08c
Merge pull request #38675 from amosbird/index-fix-1 
Fix toHour() monotonicity which can lead to incorrect query result (incorrect index analysis)
 2022-07-08 00:32:27 +03:00
Robert Schulze
49348b833a
Simplify 2022-07-07 20:25:26 +00:00
Robert Schulze
1de5e9a7da
Avoid copy-ing array elements 2022-07-07 12:33:34 +00:00
Nikolay Degterinsky
1869b7f408 Add functions translate & translateUTF8 2022-07-07 08:25:00 +00:00
Robert Schulze
dec184f61d
Add comment about const needle + const haystack 2022-07-06 17:41:15 +00:00
Robert Schulze
8a18705729
More variable renamings for more uniformity 2022-07-06 14:55:02 +00:00
Robert Schulze
0b0d64c5ca
Don't resize output vector in each loop iteration 2022-07-06 14:45:22 +00:00
Robert Schulze
144c1edb03
Inherit default implementation of getArgumentsThatAreAlwaysConstant() 2022-07-06 14:42:19 +00:00
mergify[bot]
8cc2c3914b
Merge branch 'master' into isnullable 2022-07-06 14:40:01 +00:00
Robert Schulze
6a907b23fb
Replace typeid_cast() with checkAndGetColumnConst() 
... syntactic sugar
 2022-07-06 14:38:28 +00:00
Robert Schulze
0c4da85e75
More uniform naming 2022-07-06 14:29:42 +00:00
mergify[bot]
e5535f5ab4
Merge branch 'master' into mapupdate_dev 2022-07-06 13:54:36 +00:00
Nikolai Kochetov
020c99a269
Merge pull request #38617 from azat/contrib-debug-symbols 
Add separate option to omit symbols from heavy contrib
 2022-07-06 14:40:24 +02:00
Robert Schulze
d0b2f13f9d
Fix style check 2022-07-05 13:41:52 +02:00
lokax
e6bd0105b1 feat(Function): isNullable 
Signed-off-by: lokax <m632656684@gmail.com>
 2022-07-05 15:51:53 +08:00
lokax
849c46e6fa feat(Function): isNullable 2022-07-05 15:23:07 +08:00
mergify[bot]
f14b62b2d6
Merge branch 'master' into index-fix-1 2022-07-04 22:50:36 +00:00
Robert Schulze
1eed72b525
Make more multi-search methods work with non-const needles 
After making function multi[Fuzzy]Match(Any|AnyIndex|AllIndices)() work
with non-const needles, 12 more functions started to fail in test
"00233_position_function_family":

multiSearchAny()
multiSearchAnyCaseInsensitive()
multiSearchAnyUTF8
multiSearchAnyCaseInsensitiveUTF8()

multiSearchFirstPosition()
multiSearchFirstPositionCaseInsensitive()
multiSearchFirstPositionUTF8()
multiSearchFirstPositionCaseInsensitiveUTF8()

multiSearchFirstIndex()
multiSearchFirstIndexCaseInsensitive()
multiSearchFirstIndexUTF8()
multiSearchFirstIndexCaseInsensitiveUTF8()

Failing queries take the form
  select 0 = multiSearchAny('\0', CAST([], 'Array(String)'));
 2022-07-04 14:00:21 +00:00
Robert Schulze
ece61f6da3
Fix davenger's review comments 
https://github.com/ClickHouse/ClickHouse/pull/38434#discussion_r907397214
https://github.com/ClickHouse/ClickHouse/pull/38434#discussion_r907385290
https://github.com/ClickHouse/ClickHouse/pull/38434#discussion_r907406097

(the latter is no longer relevant as the affected places were removed in
the meantime)
 2022-07-04 10:43:21 +00:00
Robert Schulze
d547aa7849
Allow non-const pattern array argument in multi[Fuzzy]Match*() 
Resolves #38046
 2022-07-04 10:43:16 +00:00
Alexander Gololobov
8ce8158f7f Do computations in Float32 (not Float64) for arrays of Float32 2022-07-03 10:33:11 +02:00
Alexander Gololobov
c6691cc5f2 Improved vectorized execution of main loop for array norm/distance 2022-07-02 22:45:22 +02:00
mergify[bot]
b016be264c
Merge branch 'master' into squared_l2 2022-07-02 09:17:28 +00:00
Azat Khuzhin
e8f5cd3c68 Add separate option to omit symbols from heavy contrib 
Sometimes it is useful to build contrib with debug symbols for further
debugging.

With everything turned ON (i.e. debug build) I got 3.3GB vs 3.0GB w/o
this patch, 9% bloat, thoughts about this is this OK or not for you, if
not STRIP_DEBUG_SYMBOLS_HEAVY_CONTRIB can be OFF by default (regardless
of build type).

P.S. aws debug symbols adds just 1.7%.
v2: rename STRIP_HEAVY_DEBUG_SYMBOLS
v3: OMIT_HEAVY_DEBUG_SYMBOLS
v4: documentation had been removed
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-07-02 06:32:03 +03:00
Robert Schulze
2a1ede0f5a
Merge pull request #38589 from ClickHouse/fix-zero-bytes-in-haystack 
Fix countSubstrings() & position() on patterns with 0-bytes
 2022-07-01 16:15:43 +02:00
Amos Bird
84a407f381
Fix toHour monotonicity 2022-07-01 18:24:24 +08:00
Alexander Gololobov
b2b31103c5 Reuse common code for L2Squared and L2 2022-06-30 14:12:25 +02:00
Azat Khuzhin
a47355877e
Add revision() function (#38555) 
It can be useful to match versions, since in some tables
(system.trace_log) there is only revision column.

P.S. came to this when was digging into stress reports from CI.
P.P.S. case insensitive by analogy with version().

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-06-30 12:58:26 +02:00
Robert Schulze
81bb2242fd
Fix countSubstrings() & position() on patterns with 0-bytes 
SQL functions countSubstrings(), countSubstringsCaseInsensitive(),
countSubstringsUTF8(), position(), positionCaseInsensitive(),
positionUTF8() with non-const pattern argument use fallback sorters
LibCASCIICaseSensitiveStringSearcher and LibCASCIICaseInsensitiveStringSearcher
which call ::strstr(), resp. ::strcasestr(). These functions assume that
the haystack is 0-terminated and they even document that. However, the
callers did not check if the haystack contains 0-byte (perhaps because
its sort of expensive). As a consequence, if the haystack contained a
zero byte in it's payload, matches behind this zero byte were ignored.

    create table t (id UInt32, pattern String) engine = MergeTree() order by id;
    insert into t values (1, 'x');
    select countSubstrings('aaaxxxaa\0xxx', pattern) from t;

We returned 3 before this commit, now we return 6
 2022-06-29 21:41:18 +00:00
hexiaoting
e32a0838d1 fix bug for mapUpdate 2022-06-29 15:52:08 +08:00
Julian Gilyadov
d0d72e0b5e
Implement L2Squared Distance and Norm 2022-06-28 15:28:58 -04:00
BoloniniD
6ddcec0906
Merge branch 'master' into BLAKE3 2022-06-28 16:53:06 +03:00
Miel Donkers
4e9f396a48
Small improvement of the error message to hint at possible issue (#38458) 2022-06-28 13:36:30 +02:00
Robert Schulze
959cbaab02
Move loop over patterns into implementations 
- This is preparation for non-const regexp arguments, where this loop
  will run for each row.
 2022-06-26 16:26:13 +00:00
Robert Schulze
cb5d1a4a85
Fix style check 2022-06-26 16:25:49 +00:00
Robert Schulze
b8f67185bf
Cosmetics: Whitespaces 2022-06-26 16:25:49 +00:00
Robert Schulze
e2b11899a1
Move check if cfg allows hyperscan into implementations 
- This is not needed for non-const regexp array arguments but cleans up
  the code and runs the check only in functions which actually use
  hyperscan.
 2022-06-26 16:25:49 +00:00
Robert Schulze
c2cea38b97
Move local variable into if statement 2022-06-26 16:25:49 +00:00
Robert Schulze
c9ce0efa66
Instantiate MultiMatchAnyImpl template using enums 
- With this, invalid combinations of the FindAny/FindAnyIndex bools are
  no longer possible and we can remove the corresponding check

- Also makes the instantiations more readable.
 2022-06-26 16:25:49 +00:00
Robert Schulze
2f15d45f27
Move check for regexp array size into implementations 
- This is not needed for non-const regexp array arguments (the
  cardinality of arrays is fixed per column) but it cleans up the code
  and runs the check only in functions which have restrictions on the
  number of patterns.

- For functions using hyperscans, it was checked that the number of
  regexes is < 2^32. Removed the check because I don't think anyone will
  every specify 4 billion patterns.
 2022-06-26 16:25:43 +00:00
Robert Schulze
3478db9fb6
Move check for regexp array size into implementations 
- This is not needed for non-const regexp array arguments (the
  cardinality of arrays is fixed per column) but it cleans up the code
  and runs the check only in functions which have restrictions on the
  number of patterns.

- For functions using hyperscans, it was checked that the number of
  regexes is < 2^32. Removed the check because I don't think anyone will
  every specify 4 billion patterns.
 2022-06-26 15:38:12 +00:00
Robert Schulze
7913edc172
Move check for hyperscan regexp constraints into implementations 
- This is preparation for non-const regexp arguments, where this check
  will run for each row.
 2022-06-26 15:38:05 +00:00
Robert Schulze
89bfdd50bf
Remove unnecessary check 
- getReturnTypeImpl() ensures that the haystack column has type "String"
  and we can simply assert that.
 2022-06-26 15:34:24 +00:00
Robert Schulze
580d89477f
Minimally faster performance 2022-06-26 15:34:22 +00:00
Robert Schulze
4bc59c18e3
Cosmetics: Move some code around + docs + whitespaces + minor stuff 2022-06-26 15:34:15 +00:00
Robert Schulze
1273756911
Cosmetics: fmt-based exceptions 2022-06-26 15:33:18 +00:00
Robert Schulze
e5c74a14f7
Cosmetics: More consistent naming 
- rename utility function and file to "checkHyperscanRegexp"
 2022-06-26 15:33:18 +00:00
Robert Schulze
072e0855a8
Cosmetics: Make member variables const 2022-06-26 15:32:26 +00:00
Robert Schulze
2ebfd01c2e
Cosmetics: Pull out settings variable 2022-06-26 15:32:23 +00:00
Robert Schulze
bb7c627964
Cosmetics: Pass patterns around as std::string_view instead of StringRef 
- The patterns are not used in hashing, there should not be a performance
  impact when we use stuff from the standard library instead.

- added forgotten .reserve() in FunctionsMultiStringPosition.h
 2022-06-26 15:32:19 +00:00
Alexey Milovidov
b3098822e0
Merge pull request #38171 from ClickHouse/hyper-to-vectorscan 
Replace hyperscan by vectorscan
 2022-06-26 10:01:45 +03:00
Alexey Milovidov
0654684bd4 Fix wrong implementation of filesystem* functions 2022-06-25 06:10:50 +02:00
Andrey Zvonov
ea73d9c492
Merge branch 'master' into zvonand-base58 2022-06-24 21:37:20 +03:00
Kruglov Pavel
0201d62090
Merge pull request #38173 from Avogar/fix-short-circuit 
Fix bug with nested short-circuit functions
 2022-06-24 16:04:17 +02:00
Robert Schulze
2c828338f4
Replace hyperscan by vectorscan 
This commit migrates ClickHouse to Vectorscan. The first 10 min of
[0] explain the reasons for it.

(*) Addresses (but does not resolve) #38046

(*) Config parameter names (e.g. "max_hyperscan_regexp_length") are
    preserved for compatibility. Likewise, error codes (e.g.
    "ErrorCodes::HYPERSCAN_CANNOT_SCAN_TEXT") and function/class names (e.g.
    "HyperscanDeleter") are preserved as vectorscan aims to be a drop-in
    replacement.

[0] https://www.youtube.com/watch?v=KlZWmmflW6M
 2022-06-24 10:47:52 +02:00
Andrey Zvonov
c18d09a617
Merge branch 'master' into zvonand-base58 2022-06-24 07:05:49 +03:00
zvonand
dd8203038f updated exception handling 2022-06-24 00:36:57 +05:00
zvonand
a94c40e33a Merge branch 'master' of github.com:ClickHouse/ClickHouse into dt64_timeslots 2022-06-23 17:08:28 +05:00
mergify[bot]
234f0c6399
Merge branch 'master' into revert-35914-FIPS_compliance 2022-06-23 12:06:17 +00:00
zvonand
946117ec89 Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-base58 2022-06-23 17:04:40 +05:00
Alexey Milovidov
5855668514 Remove trash 2022-06-22 06:23:35 +02:00
mergify[bot]
bb79eb73e6
Merge branch 'master' into fix-short-circuit 2022-06-21 10:40:07 +00:00
Kruglov Pavel
b9b58b4305
Merge pull request #37759 from Avogar/fix-nothing-error 
Fix possible logical error with type Nothing in some functions
 2022-06-21 12:35:05 +02:00
Larry Luo
bbd73ba727 use utility methods to access x509 struct fields. 2022-06-20 21:27:33 -04:00
zvonand
22af00b757 rename variable + fix handling of ENABLE_LIBRARIES 2022-06-20 23:53:47 +05:00
mergify[bot]
b440ee84ae
Merge branch 'master' into fix-short-circuit 2022-06-20 15:14:19 +00:00
zvonand
d4e5686b99 minor: fix message for base64 2022-06-20 20:13:09 +05:00
zvonand
78d55d6f46 small fixes 2022-06-20 19:30:54 +05:00
zvonand
832fd6e0a9 Added tests + minor updates 2022-06-19 23:10:28 +05:00
Alexey Milovidov
0cf88e0950
Revert "ClickHouse's boringssl module updated to the official version of the FIPS compliant." 2022-06-18 23:16:18 +03:00
zvonand
f4b3af091d fix zero byte 2022-06-17 23:48:14 +05:00
avogar
23f48a9fb9 Fix bug with nested short-circuit functions 2022-06-17 11:44:49 +00:00
Andrey Zvonov
f987f461e5 fix style -- rm unused ErrorCode 2022-06-17 15:00:32 +05:00
Igor Nikonov
baebbc084f
Merge pull request #38027 from ClickHouse/decimal_rounding_fix 
Fix: rounding for Decimal128/Decimal256 with more than 19-digits long scale
 2022-06-17 09:48:18 +02:00
zvonand
c1b2b669ab remove wrong code 2022-06-17 01:52:45 +05:00
mergify[bot]
f46f7257dd
Merge branch 'master' into fix-nothing-error 2022-06-16 10:58:03 +00:00
mergify[bot]
2557e8ad51
Merge branch 'master' into decimal_rounding_fix 2022-06-16 10:53:49 +00:00
avogar
a3a7cc7a5d Fix logical error in array mapped functions with const nullable column 2022-06-16 10:41:53 +00:00
zvonand
a800158438 wip upload 2022-06-16 15:11:41 +05:00
Danila Kutenin
048f56bf4d Fix some tests and comments 2022-06-15 14:40:21 +00:00
Danila Kutenin
08e3f77a9c Optimize most important parts with NEON SIMD 
First part, updated most UTF8, hashing, memory and codecs. Except
utf8lower and upper, maybe a little later.

That includes huge amount of research with movemask dealing. Exact
details and blog post TBD.
 2022-06-15 13:19:29 +00:00
mergify[bot]
d704264fae
Merge branch 'master' into decimal_rounding_fix 2022-06-15 10:47:09 +00:00
zvonand
c149c916ec initial setup 2022-06-15 11:49:55 +05:00
Igor Nikonov
bf7dd39282 Fix: decimal rounding 
Fixes #37531
 2022-06-14 18:03:05 +00:00
Maksim Kita
dc2e117cce UnaryLogicalFunctions improve performance using dynamic dispatch 2022-06-14 17:30:11 +02:00
zvonand
a5a980b69d Added no_sanitize 2022-06-13 19:45:54 +05:00
zvonand
54b8709cb1 minor fix 2022-06-13 19:21:07 +05:00
BoloniniD
617ef0809f Minor fixes 2022-06-12 01:22:33 +03:00
Robert Schulze
5f5732a2c4
Merge pull request #37969 from ClickHouse/consistent-macro-usage 
More consistent use of platform macros
 2022-06-10 14:10:01 +02:00
zvonand
fb67b080b9 added docs 2022-06-10 14:30:17 +03:00
zvonand
551d1ea875 fix wrong interval 2022-06-10 13:21:31 +03:00
Robert Schulze
1a0b5f33b3
More consistent use of platform macros 
cmake/target.cmake defines macros for the supported platforms, this
commit changes predefined system macros to our own macros.

__linux__ --> OS_LINUX
__APPLE__ --> OS_DARWIN
__FreeBSD__ --> OS_FREEBSD
 2022-06-10 10:22:31 +02:00
zvonand
e19653618c fix wrongfully added submodule 2022-06-10 11:19:38 +03:00
zvonand
16087ea400 enable dt64 for timeslots 2022-06-09 15:28:18 +03:00
Maksim Kita
0c1211eb61
Merge pull request #37930 from kitaisreal/function-dict-get-check-arguments-size 
Function dictGet check arguments size
 2022-06-08 23:25:14 +02:00
Maksim Kita
b7152fa2bf Function dictGet check arguments size 2022-06-08 17:19:30 +02:00
Maksim Kita
7d1a43cfeb Fix setting cast_ipv4_ipv6_default_on_conversion_error for internal cast 2022-06-08 12:43:39 +02:00
Maksim Kita
4e160105b9
Merge pull request #37805 from kitaisreal/dictionaries-hierarchy-nullable-key-support 
Hierarchical dictinaries support nullable parent key
 2022-06-08 12:36:09 +02:00
Anton Popov
df6882d2b9
Revert "Fix errors of CheckTriviallyCopyableMove type" 2022-06-07 13:53:10 +02:00
mergify[bot]
014d9e2144
Merge branch 'master' into fix-nothing-error 2022-06-07 11:24:28 +00:00
avogar
cbd50aecd4 Fix 2022-06-07 11:23:59 +00:00
Vitaly Baranov
d199478169
Merge pull request #37303 from ClickHouse/fix_trash 
Try to fix some trash
 2022-06-07 10:17:39 +02:00
BoloniniD
b05ee41d25 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-06-06 16:03:10 +03:00
Robert Schulze
2d87af2a15
Merge pull request #37647 from DevTeamBK/Fix-all-CheckTriviallyCopyableMove-Errors 
Fix errors of CheckTriviallyCopyableMove type
 2022-06-05 19:58:47 +02:00
zvonand
5475f62363 32 to 64 2022-06-05 13:06:48 +03:00
Maksim Kita
6db5c08fde Functions dictGetChildren, dictGetDescendants added support for nullable parent key 2022-06-03 17:36:16 +02:00
Maksim Kita
a0cbbd9edc Hierarchical Cache, Direct dictionaries added support for nullable parent key 2022-06-03 17:21:55 +02:00
Anton Popov
f592a802a1
Merge pull request #37482 from CurtizJ/json-new-serialization 
Better binary serialization of `ColumnObject`
 2022-06-03 13:29:19 +02:00
Robert Schulze
05f08357a9
Merge pull request #37764 from ClickHouse/like_with_trailing_backslash 
Disallow LIKE patterns with trailing escape
 2022-06-03 13:19:51 +02:00
Alexey Milovidov
1529d47207
Merge pull request #34754 from ClickHouse/llvm-14 
Switch to clang/llvm 14
 2022-06-03 14:07:34 +03:00
Alexey Milovidov
de16784832
Merge pull request #37633 from ClickHouse/dump-column-structure-more-precise 
More precise result of the `dumpColumnStructure` and `byteSize` miscellaneous functions
 2022-06-03 14:05:20 +03:00
Alexey Milovidov
ea89f81a78 Merge branch 'master' of github.com:ClickHouse/ClickHouse into llvm-14 2022-06-03 03:07:14 +02:00
Robert Schulze
657662d89f
Minor follow-up to cache table: std::{vector-->array} 2022-06-02 20:18:10 +02:00
Maksim Kita
20b55a45b2 Hierarchical dictionaries support nullable parent key 2022-06-02 19:24:23 +02:00
HeenaBansal2009
e3080f2a97 Merge remote-tracking branch 'origin' into Fix-all-CheckTriviallyCopyableMove-Errors 2022-06-02 07:30:08 -07:00
Alexander Gololobov
b34782dc6a
Merge pull request #37775 from liuneng1994/fix_date32_to_string 
fix toString error on DatatypeDate32
 2022-06-02 16:40:47 +03:00
Vladimir C
670c721ded
Merge pull request #37742 from ucasfl/hashid 2022-06-02 12:47:11 +02:00
Robert Schulze
4e18659bfd
Fix tests + more precise exception msg 2022-06-02 11:11:56 +02:00
liuneng1994
7b15055e72 fix toString error on DatatypeDate32 
Signed-off-by: liuneng1994 <1398775315@qq.com>
 2022-06-02 16:56:43 +08:00
Alexey Milovidov
b5f48a7d3f Merge branch 'master' of github.com:ClickHouse/ClickHouse into llvm-14 2022-06-01 22:09:58 +02:00
Robert Schulze
366f368d06
Disallow LIKE patterns with trailing escape 
Trailing escape ('ab\') is disallowed in SQL, in standardese:

  "If an escape character is specified, then [...] If there is not a
  partitioning of the string PVC into substrings such that each substring
  has length 1 (one) or 2, no substring of length 1 (one) is the escape
  character ECV, and each substring of length 2 is the escape character
  ECV followed by either the escape character ECV, an <underscore>
  character, or the <percent> character, then an exception condition is
  raised: data exception - invalid escape sequence."

I first thought this is checked already higher up in the stack, at least
for const needles, as single trailing backslashes ('ab\') are rejected,
but then I realized that ClickHouse quotes by default. I.e., double
trailing backslashes ('ab\\') are not rejected but when interpreted as
LIKE needle ('ab\') they should.
 2022-06-01 21:38:46 +02:00
Robert Schulze
b3b0716b32
Merge pull request #37544 from ClickHouse/cached_patterns 
Cache compiled regexps when evaluating non-const needles
 2022-06-01 19:55:25 +02:00
avogar
966b864986 Fix possible logical error with type Nothing and JSON functions 2022-06-01 16:34:31 +00:00
flynn
b62e4cec65 Fix crash of FunctionHashID 2022-06-01 12:39:16 +00:00
BoloniniD
44ce53f4b3 Fix new line 2022-06-01 15:22:22 +03:00
Alexander Tokmakov
75f49a48e1 Merge branch 'master' into fix_trash 2022-06-01 14:20:46 +02:00
Robert Schulze
600512cc08
Replace exceptions thrown for programming errors by asserts 2022-06-01 11:53:37 +02:00
BoloniniD
dd8aefdf1e Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-06-01 11:46:55 +03:00
Anton Popov
20e319d67a
Merge pull request #37666 from CurtizJ/optimize-coalesce 
Optimize function `COALESCE` with two arguments
 2022-05-31 23:48:13 +02:00
Yakov Olkhovskiy
873ac9f8ff
Merge pull request #37540 from ClickHouse/feature-server-certificate 
showCertificate function implementation
 2022-05-31 02:50:03 -04:00
Anton Popov
30f8eb800a optimize function coalesce with two arguments 2022-05-30 22:29:35 +00:00
Nikolai Kochetov
77b07dd0a8
Merge pull request #37163 from ClickHouse/grouping-function 
Add GROUPING function
 2022-05-30 20:45:04 +02:00
HeenaBansal2009
b7eb6bbd38 Fixed clang-tidy-CheckTriviallyCopyableMove-errors 2022-05-30 11:09:03 -07:00
Robert Schulze
ad12adc31c
Measure and rework internal re2 caching 
This commit is based on local benchmarks of ClickHouse's re2 caching.

Question 1: -----------------------------------------------------------
Is pattern caching useful for queries with const LIKE/REGEX
patterns? E.g. SELECT LIKE(col_haystack, '%HelloWorld') FROM T;

The short answer is: no. Runtime is (unsurprisingly) dominated by
pattern evaluation + other stuff going on in queries, but definitely not
pattern compilation. For space reasons, I omit details of the local
experiments.

(Side note: the current caching scheme is unbounded in size which poses
a DoS risk (think of multi-tenancy). This risk is more pronounced when
unbounded caching is used with non-const patterns ..., see next
question)

Question 2: -----------------------------------------------------------
Is pattern caching useful for queries with non-const LIKE/REGEX
patterns? E.g. SELECT LIKE(col_haystack, col_needle) FROM T;

I benchmarked five caching strategies:
1. no caching as a baseline (= recompile for each row)
2. unbounded cache (= threadsafe global hash-map)
3. LRU cache (= threadsafe global hash-map + LRU queue)
4. lightweight local cache 1 (= not threadsafe local hashmap with
   collision list which grows to a certain size (here: 10 elements) and
   afterwards never changes)
5. lightweight local cache 2 (not threadsafe local hashmap without
   collision list in which a collision replaces the stored element, idea
   by Alexey)

... using a haystack of 2 mio strings and
A). 2 mio distinct simple patterns
B). 10 simple patterns
C)  2 mio distinct complex patterns
D)  10 complex patterns

Fo A) and C), caching does not help but these queries still allow to
judge the static overhead of caching on query runtimes.

B) and D) are extreme but common cases in practice. They include
queries like "SELECT ... WHERE LIKE (col_haystack, flag ? '%pattern1%' :
'%pattern2%'). Caching should help significantly.

Because LIKE patterns are internally translated to re2 expressions, I
show only measurements for MATCH queries.

Results in sec, averaged over on multiple measurements;

1.A): 2.12
  B): 1.68
  C): 9.75
  D): 9.45

2.A): 2.17
  B): 1.73
  C): 9.78
  D): 9.47

3.A): 9.8
  B): 0.63
  C): 31.8
  D): 0.98

4.A): 2.14
  B): 0.29
  C): 9.82
  D): 0.41

5.A) 2.12 / 2.15 / 2.26
  B) 1.51 / 0.43 / 0.30
  C) 9.97 / 9.88 / 10.13
  D) 5.70 / 0.42 / 0.43
(10/100/1000 buckets, resp. 10/1/0.1% collision rate)

Evaluation:

1. This is the baseline. It was surprised that complex patterns (C, D)
   slow down the queries so badly compared to simple patterns (A, B).
   The runtime includes evaluation costs, but as caching only helps with
   compilation, and looking at 4.D and 5.D, compilation makes up over 90%
   of the runtime!

2. No speedup compared to 1, probably due to locking overhead. The cache
   is unbounded, and in experiments with data sets > 2 mio rows, 2. is
   the only scheme to throw OOM exceptions which is not acceptable.

3. Unique patterns (A and C) lead to thrashing of the LRU cache and very
   bad runtimes due to LRU queue maintenance and locking. Works pretty
   well however with few distinct patterns (B and D).

4. This scheme is tailored to queries B and D where it performs pretty
   good. More importantly, the caching is lightweight enough to not
   deteriorate performance on datasets A and C.

5. After some tuning of the hash map size, 100 buckets seem optimal to
   be in the same ballpark with 10 distinct patterns as 4. Performance
   also does not deteriorate on A and C compared to the baseline.
   Unlike 4., this scheme behaves LRU-like and can adjust to changing
   pattern distributions.

As a conclusion, this commit implementes two things:

1. Based on Q1, pattern search with const needle no longer uses
   caching. This applies to LIKE and MATCH + a few (exotic) other SQL
   functions. The code for the unbounded caching was removed.

2. Based on Q2, pattern search with non-const needles now use method 5.
 2022-05-30 20:00:35 +02:00
Alexey Milovidov
f1fb57c6ce Fix clang-tidy-14 2022-05-30 05:36:26 +02:00
Alexey Milovidov
c0e6ff4216 More precise result of "dumpColumnStructure" and "byteSize" miscellaneous functions 2022-05-30 04:56:54 +02:00
Alexey Milovidov
c1169019d2 Merge branch 'master' into llvm-14 2022-05-29 02:29:02 +02:00
Alexey Milovidov
73e2e63414
Merge pull request #37612 from ClickHouse/clang-tidy-14 
Fix clang-tidy-14, part 1
 2022-05-29 03:16:32 +03:00
Alexander Tokmakov
4e52f45695 Merge branch 'master' into fix_trash 2022-05-28 19:43:19 +02:00
Alexey Milovidov
c50791dd3b Fix clang-tidy-14, part 1 2022-05-27 22:52:14 +02:00
Alexey Milovidov
d2c6fd90cb Fix clang-tidy-14, part 1 2022-05-27 22:51:37 +02:00
Alexander Gololobov
9b1b30855c Fixed check for HUGE_VAL 2022-05-27 18:25:11 +02:00
Alexander Gololobov
6361c5f38c Fix for failed style check 2022-05-27 18:22:16 +02:00
Alexander Gololobov
540353566c Added LpNorm and LpDistance functions for arrays 2022-05-27 17:17:08 +02:00
Robert Schulze
80061aa3e2
Merge remote-tracking branch 'origin/master' into cached_patterns 2022-05-27 09:21:01 +02:00
Alexey Milovidov
86afa3a245
Merge pull request #37502 from ClickHouse/array_norm_dist_fixes 
Renamed arrayXXNorm/arrayXXDistance functions to XXNorm/XXDistance and fixed some overflow cases
 2022-05-27 00:56:29 +03:00
mergify[bot]
a7629f900f
Merge branch 'master' into normalize-utf8-performance-tests-fix 2022-05-26 10:29:55 +00:00
Maksim Kita
3a92e61827
Merge pull request #37148 from kitaisreal/dictionary-get-descendants-performance-improvement 
Dictionary getDescendants performance improvement
 2022-05-26 12:29:17 +02:00
Yakov Olkhovskiy
2dc160a4c3 style fix 2022-05-25 20:56:36 -04:00
Dmitry Novik
7cd7782e4f Process columns more efficiently in GROUPING() 2022-05-25 21:55:41 +00:00
Dmitry Novik
3c1b6609ae Add comments and make tests more verbose 2022-05-25 21:23:35 +00:00
Maksim Kita
58cd1bd3ec
Merge pull request #36843 from bharatnc/ncb/h3-unidirectionaledges-funcs 
add h3 unidirectional edge functions
 2022-05-25 22:46:40 +02:00
Maksim Kita
bee3c30f66
Merge pull request #37524 from kitaisreal/geo-distance-functions-improve-performance 
Geo distance functions improve performance
 2022-05-25 22:40:40 +02:00
Alexander Gololobov
168b47d0ad Use same norm and distance function names for tuples and arrays 2022-05-25 22:39:59 +02:00
Alexander Gololobov
b065839f44 always return Float64 2022-05-25 22:27:00 +02:00
Alexander Gololobov
5df14cd956 Cast arguments to result type to avoid int overflow 2022-05-25 22:27:00 +02:00
Robert Schulze
49934a3dc8
Cache compiled regexps when evaluating non-const needles 
Needles in a (non-const) needle column may repeat and this commit allows
to skip compilation for known needles. Out of the different design
alternatives (see below, if someone is interested), we now maintain
- one global pattern cache,
- with a fixed size of 42k elements currently,
- and use LRU as eviction strategy.

------------------------------------------------------------------------

(sorry for the wall of text, dumping it here not for reading but just
for reference)

Write-up about considered design alternatives:

1. Keep the current global cache of const needles. For non-const
   needles, probe the cache but don't store values in it.
   Pros: need to maintain just a single cache, no problem with cache
         pollution assuming there are few distinct constant needles
   Cons: only useful if a non-const needle occurred as already as a
         const needle
   --> overall too simplistic

2. Keep the current global cache for const needles. For non-const
   needles, create a local (e.g. per-query) cache
   Pros: unlike (1.), non-const needles can be skipped even if they
         did not occur yet, no pollution of the const pattern cache when
         there are very many non-const needles (e.g. large / highly
         distinct needle columns).
   Cons: caches may explode "horizontally", i.e. we'll end up with the
         const cache + caches for Q1, Q2, ... QN, this makes it harder
         to control the overall space consumption, also patterns
         residing in different caches cannot be reused between queries,
         another difficulty is that the concept of "query" does not
         really exist at matching level - there are only column chunks
         and we'd potentially end up with 1 cache / chunk

3. Queries with const and non-const needles insert into the same global
   cache.
   Pros: the advantages of (2.) + allows to reuse compiled patterns
         accross parallel queries
   Cons: needs an eviction strategy to control cache size and pollution
         (and btw. (2.) also needs eviction strategies for the
         individual caches)

4. Queries with const needle use global cache, queries with non-const
   needle use a different global cache
   --> Overall similar to (3) but ignores the (likely) edge case that
       const and non-const needles overlap.

In sum, (3.) seems the simplest and most beneficial approach.

Eviction strategies:

0. Don't ever evict --> cache may grow infinitely and eventually make
   the system unusable (may even pose a DoS risk)

1. Flush the cache after a certain threshold is exceeded --> very
   simple but may lead to peridic performance drops

2. Use LRU --> more graceful performance degradation at threshold but
   comes with a (constant) performance overhead to maintain the LRU
   queue

In sum, given that the pattern compilation in RE2 should be quite costly
(pattern-to-DFA/NFA), LRU may be acceptable.
 2022-05-25 22:04:06 +02:00
Robert Schulze
ea60a614d2
Decrease namespace indent 2022-05-25 21:56:35 +02:00
Alexey Milovidov
abf2558fba
Merge pull request #37491 from ClickHouse/match_refactoring 
Refactorings of LIKE/MATCH code
 2022-05-25 22:05:38 +03:00
Alexey Milovidov
4482da9eb6
Update greatCircleDistance.cpp 2022-05-25 21:59:31 +03:00
Alexander Tokmakov
779e6ea0b9 make it better, fix on cluster queries 2022-05-25 20:17:49 +02:00
Nikolai Kochetov
ff98c24d44
Merge pull request #37048 from Avogar/fix-array-map-nothing 
Add default implementation for Nothing in functions
 2022-05-25 19:10:40 +02:00
Yakov Olkhovskiy
6692b9c2ed showCertificate function implementation 2022-05-25 12:11:44 -04:00
Alexey Milovidov
cb92482ca5
Merge pull request #37484 from kitaisreal/function-has-all-avx2-dynamic-dispatch 
Function hasAll added dynamic dispatch
 2022-05-25 19:05:32 +03:00
Maksim Kita
28355114c0 Fixed tests 2022-05-25 16:19:29 +02:00
Maksim Kita
e67b3537f7 Functions normalizeUTF8 unstable performance tests fix 2022-05-25 15:54:52 +02:00
Maksim Kita
45da28ecae Improve performance of geo distance functions 2022-05-25 14:22:22 +02:00
Maksim Kita
c372c3d6aa Fix performance tests 2022-05-25 11:49:59 +02:00
Kseniia Sumarokova
b50d4549c9
Merge pull request #37356 from amosbird/partition-prune-for-s3 
"Partition pruning" for s3
 2022-05-25 11:03:07 +02:00
Robert Schulze
05e4fa7df1
Fix special case of trivial regexp 
Previously, we would alsays set 1 in case of a trivial regex (which is
correct). If someone in future builds a negated operator, then this
will produce wrong results. Right now, negation of regexp (SQL: NOT
MATCH) is implemented at a higher level, so we are safe and this is more
a preventive fix.
 2022-05-25 10:05:55 +02:00
Robert Schulze
01ab7b9bad
Pass strings in some places as string_view 
The original goal was to get change

  const auto & needle = String(
        reinterpret_cast<const char *>(cur_needle_data),
        cur_needle_length);

in Functions/MatchImpl.h into a std::string_view to save an allocation +
copy. The needle is eventually passed as search pattern into the re2
library. Re2 has an alternative constructor taking a const char * i.e. a
NULL-terminated string. Here, the needle is NULL-terminated but
1. this is only because it is passed inside a ColumnString yet this is
   not always the case (e.g. fixed string columns has a dense layout w/o
   NULL terminator).
2. assuming NULL termination for users != MatchImpl of the regex code is
   too dangerous.

So, for now we'll stay with copying to be on the safe side. One fine day
when re2 has a ptr/size ctor, we can use std::string_view.

Just changing a few other places from std::string to std::string_view
but this will not help with performance.
 2022-05-25 10:05:51 +02:00
Robert Schulze
040fbf3686
Tighter sanity checks in matching code 2022-05-25 10:05:06 +02:00
Robert Schulze
35bef17302
Introduce variables to hold the match result 
--> nicer when debugging
 2022-05-25 10:04:47 +02:00
Robert Schulze
b044d44fef
Refactoring: Make template instantiation easier to read 
- introduced class MatchTraits with enums that replace bool template
  parameters

- (minor: made negation the last template parameters because negation
  executes last during evaluation)
 2022-05-25 10:03:58 +02:00
Bharat Nallan Chakravarthy
57cfc0bd04 check for validity of h3 index 2022-05-25 06:17:15 +05:30
Alexander Gololobov
2ff747785e
Merge pull request #37394 from ClickHouse/array_norm_dist_fixes 
Do computations on the raw input data without copying to Eigen::Matrix
 2022-05-24 20:59:04 +02:00
Robert Schulze
7348a0eb28
Merge pull request #37251 from ClickHouse/non_const_like 
Support non-constant SQL functions (NOT) (I)LIKE and MATCH
 2022-05-24 20:28:31 +02:00
Robert Schulze
028f15c4fa
Review comment: Throw LOGICAL_ERROR for different sizes of haystack / needles 2022-05-24 20:19:13 +02:00
Maksim Kita
3c0c322d7c
Merge pull request #37480 from kitaisreal/dynamic-dispatch-infrastructure-improvements 
Dynamic dispatch infrastructure style fixes
 2022-05-24 18:13:53 +02:00
Maksim Kita
6fb51e8bd3 Function hasAll added dynamic dispatch 2022-05-24 17:06:06 +02:00
Maksim Kita
86180614e7 Fixed tests 2022-05-24 15:33:03 +02:00
Anton Popov
e96af9fd75 better binary serialization of ColumnObject 2022-05-24 13:16:11 +00:00
Maksim Kita
e6e4b2826d Dynamic dispatch infrastructure style fixes 2022-05-24 14:25:29 +02:00
Amos Bird
c25ef92139
Fix tests 2022-05-24 18:57:55 +08:00
Amos Bird
093d315756
partition pruning for s3 2022-05-24 18:57:55 +08:00
Maksim Kita
712b000f2a
Merge pull request #37443 from kitaisreal/functions-normalize-utf8-fix 
Functions normalize utf8 fix
 2022-05-24 11:11:15 +02:00
Alexander Gololobov
7d0ed7e51a Remove eigen library 2022-05-24 10:24:50 +02:00
Alexander Gololobov
caad1435d5 Optimized the case when one the argumnets is Const 2022-05-24 10:24:50 +02:00
Alexander Gololobov
65fbda436a Do computations on the raw input data without copying to Eigen::Matrix 2022-05-24 10:24:50 +02:00
Bharat Nallan Chakravarthy
6e49b76cfd try suppress h3 asan errors 2022-05-24 10:22:46 +05:30
Maksim Kita
996241493f
Merge pull request #37447 from kitaisreal/binary-function-vectorized-remove-macro 
BinaryFunctionVectorized remove macro
 2022-05-23 16:50:12 +02:00
Maksim Kita
fe21b4ca9e Fixed style check 2022-05-23 14:41:07 +02:00
Maksim Kita
008de5c779
Merge pull request #37438 from kitaisreal/function-binary-representation-style-fixes 
FunctionBinaryRepresentation style fixes
 2022-05-23 13:54:15 +02:00
Maksim Kita
e550843d56 BinaryFunctionVectorized remove macro 2022-05-23 12:45:16 +02:00
Maksim Kita
585b86446e Added hierarchical_index_bytes_allocated column in system.dictionaries 2022-05-23 12:42:00 +02:00
Maksim Kita
be9c3d9bd4 Fixed build 2022-05-23 12:42:00 +02:00
Maksim Kita
100afa8bcf Dictionary getDescendants performance improvement 2022-05-23 12:42:00 +02:00
Maksim Kita
78782de887 Functions normalizeUTF8 logical error fix 2022-05-23 12:19:14 +02:00
Maksim Kita
98bb34f2f2 FunctionBinaryRepresentation style fixes 2022-05-23 10:59:33 +02:00
Robert Schulze
e25ca139cd
Implement SQL functions (NOT) (I)LIKE() + MATCH() with non-const needles 
With this commit, SQL functions LIKE and MATCH and their variants can
work with non-const needle arguments. E.g.

  create table tab
    (id UInt32, haystack String, needle String)
    engine = MergeTree()
    order by id;

  insert into tab values
  (1, 'Hello', '%ell%')
  (2, 'World', '%orl%')

  select id, haystack, needle, like(haystack, needle)
  from tab;

For that, methods vectorVector() and vectorFixedVector() were added to
MatchImpl. The existing code for const needles has an optimization where
the compiled regexp is cached. The new code expects a different needle
per row and consequently does not cache the regexp.
 2022-05-23 09:41:28 +02:00
Alexey Milovidov
698e5e5352
Merge pull request #37415 from Joeywzr/gen_uuid 
Generate multiple columns with UUID
 2022-05-23 00:29:42 +03:00
Robert Schulze
4829ae8380
Replace overly clever const argument logic by something simpler 
The previous logic was smart but too inflexible to support the next
commits. Replace by a simple pushdown logic where string search
implementations return their const arguments instead of having the
common class figure these out based on properties/traits.
 2022-05-22 17:50:38 +02:00
Robert Schulze
0299cc87e4
Improve naming consistency of string search code 
Just renamings, nothing major ...
 2022-05-22 17:50:38 +02:00
Robert Schulze
19d53c14fa
Merge pull request #37382 from ClickHouse/wc++98-compat-extra-semi 
Enable -Wc++98-compat-extra-semi
 2022-05-22 09:40:45 +02:00
Memo
15a76d012f add NUMBER_OF_ARGUMENTS_DOESNT_MATCH defination 2022-05-22 13:38:47 +08:00
Yakov Olkhovskiy
d878f193d8
Merge pull request #37013 from mnutt/hashid 
Add hashid support
 2022-05-21 17:14:54 -04:00
Memo
942af133e5 init 2022-05-21 23:54:12 +08:00
Maksim Kita
0d69f35b6a Fixed style check 2022-05-21 14:54:45 +02:00
Maksim Kita
42439aeb3c Improve performance of number comparison functions 2022-05-20 22:42:48 +02:00
Robert Schulze
0f6715bd91
Follow-up to PR #37300: semicolon warnings 
In PR #37300, Alexej asked why we the compiler does not warn about
unnecessary semicolons, e.g.

  f()
  {
  }; // <-- here

The answer is surprising: In C++98, above syntax was disallowed but by
most compilers accepted it regardless. C++>11 introduced "empty
declarations" which made the syntax legal.

The previous behavior can be restored using flag
-Wc++98-compat-extra-semi. This finds many useless semicolons which were
removed in this change. Unfortunately, there are also false positives
which would require #pragma-s and HAS_* logic (--> check_flags.cmake) to
suppress. In the end, -Wc++98-compat-extra-semi comes with extra effort
for little benefit. Therefore, this change only fixes some semicolons
but does not enable the flag.
 2022-05-20 15:06:34 +02:00
Michael Nutt
23dbf1b257 Merge branch 'master' into hashid 2022-05-20 08:42:01 -04:00
Robert Schulze
b475fbc9a7
Merge pull request #37300 from ClickHouse/cmake-cleanup-pt3 
Various cmake cleanups
 2022-05-20 10:02:36 +02:00
Dmitry Novik
b3ccf96c81 Merge remote-tracking branch 'origin/master' into grouping-function 2022-05-19 17:58:33 +00:00
Dmitry Novik
d4c66f4a48 Code cleanup & fix GROUPING() with TOTALS 2022-05-19 16:36:51 +00:00
avogar
f69c3175af Fix comments 2022-05-19 10:13:44 +00:00
avogar
cb8646fbb4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-array-map-nothing 2022-05-19 07:18:48 +00:00
Michael Nutt
e0c14dfc01 fix includes 2022-05-18 20:16:43 -04:00
Bharat Nallan Chakravarthy
00d3bbc2e0 review fixes 2022-05-18 17:04:15 -07:00
Michael Nutt
c87638d2ba put hashid behind allow_experimental_hash_functions setting 2022-05-18 19:06:33 -04:00
Michael Nutt
11a17997b3 better const column checking 2022-05-18 18:09:45 -04:00
Michael Nutt
da99b1b250 simplify hashing 2022-05-18 16:57:30 -04:00
Michael Nutt
d6d1c22008 better argument type checking 2022-05-18 16:57:21 -04:00
Michael Nutt
e453132db8 remove hashid define guard 2022-05-18 15:26:54 -04:00
Maksim Kita
df0cb06209
Merge pull request #37289 from kitaisreal/unary-arithmetic-functions-improve-performance-dynamic-dispatch 
Improve performance of unary arithmetic functions
 2022-05-18 19:16:30 +02:00
Dmitry Novik
6356112a76 Refactor GROUPING function 2022-05-18 15:23:31 +00:00
Anton Popov
715d5b0173
Merge pull request #37270 from Avogar/fix-bool-eof 
Fix Nullable(String) to Nullable(Bool/IPv4/IPv6) conversion
 2022-05-18 14:08:52 +02:00
Nikolai Kochetov
64ecb3941c
Merge pull request #37259 from ClickHouse/clangtidies2 
Activate more clangtidies
 2022-05-18 13:01:40 +02:00
Bharat Nallan Chakravarthy
c476b8dd92 Merge remote-tracking branch 'upstream/master' into ncb/h3-unidirectionaledges-funcs 2022-05-17 20:10:03 -07:00
mergify[bot]
05305811f8
Merge branch 'master' into fix-bool-eof 2022-05-17 19:28:11 +00:00
Robert Schulze
0c55ac76d2
A few clangtidy updates 
Enable:

- bugprone-lambda-function-name: "Checks for attempts to get the name of
  a function from within a lambda expression. The name of a lambda is
  always something like operator(), which is almost never what was
  intended."

- bugprone-unhandled-self-assignment: "Finds user-defined copy
  assignment operators which do not protect the code against
  self-assignment either by checking self-assignment explicitly or using
  the copy-and-swap or the copy-and-move method.""

- hicpp-invalid-access-moved: "Warns if an object is used after it has
  been moved."

- hicpp-use-noexcept: "This check replaces deprecated dynamic exception
  specifications with the appropriate noexcept specification (introduced
  in C++11)"

- hicpp-use-override: "Adds override (introduced in C++11) to overridden
  virtual functions and removes virtual from those functions as it is
  not required."

- performance-type-promotion-in-math-fn: "Finds calls to C math library
  functions (from math.h or, in C++, cmath) with implicit float to
  double promotions."

Split up:

- cppcoreguidelines-*. Some of them may be useful (haven't checked in
  detail), therefore allow to toggle them individually.

Disable:

- linuxkernel-*. Obvious.
 2022-05-17 20:56:57 +02:00
mergify[bot]
36b4ed19c5
Merge branch 'master' into unary-arithmetic-functions-improve-performance-dynamic-dispatch 2022-05-17 18:08:24 +00:00
Alexander Gololobov
38f291c70d
Merge pull request #37030 from bharatnc/ncb/h3-missing-traversal-funcs 
add remaining h3 traversal funcs
 2022-05-17 18:19:56 +02:00
avogar
46f4f8a457 Fix use of unitialized memory 2022-05-17 12:59:46 +00:00
Maksim Kita
beb34e7062 Improve performance of unary arithmetic functions 2022-05-17 13:53:20 +02:00
Alexander Gololobov
670a8bac29 Fixed required array size calculation and reduced number of reallocations 2022-05-17 09:45:49 +02:00
Kseniia Sumarokova
94683786dc
Merge branch 'master' into MeiliSearch 2022-05-16 22:42:09 +02:00
Alexander Gololobov
e2e3536a80 Fixed handling of gridPathCellsSize() errors 2022-05-16 21:23:45 +02:00
avogar
415aabd4d0 Fix Nullable(String) to Nullable(Bool/IPv4/IPv6) conversion 2022-05-16 19:15:18 +00:00
Robert Schulze
43945cea1b
Fixing some warnings 2022-05-16 20:59:27 +02:00
Dmitry Novik
e5b395e054 Support ROLLUP and CUBE in GROUPING function 2022-05-16 17:33:38 +00:00
Robert Schulze
e3cfec5b09
Merge remote-tracking branch 'origin/master' into clangtidies 2022-05-16 10:12:50 +02:00
Michael Nutt
8bff9b8ce9
Merge branch 'master' into hashid 2022-05-14 09:52:05 +09:00
Dmitry Novik
6fc7dfea80 Support ordinary GROUP BY 2022-05-13 23:04:12 +00:00
Maksim Kita
3f18d7da33
Merge pull request #37189 from kitaisreal/function-h3-k-ring-add-cast 
Function h3kRing added cast
 2022-05-13 22:53:20 +02:00
Dmitry Novik
efb30bdf64 Correctly use __grouping_set_map column 2022-05-13 18:20:12 +00:00
Dmitry Novik
ae81268d4d Try to compute helper column lazy 2022-05-13 14:55:50 +00:00
Maksim Kita
ef7e21ea46 Function h3kRing added cast 2022-05-13 15:20:04 +02:00
Michael Nutt
9599c1f05c use single-character find for bad alphabet 2022-05-13 19:01:20 +09:00
qieqieplus
8b3fb22c6d check array sizes for short cut 2022-05-13 17:05:18 +08:00
mergify[bot]
2fdd305ef1
Merge branch 'master' into array-distance-functions 2022-05-13 07:56:57 +00:00
Michael Nutt
62a1e1c0cd use existing error code 2022-05-13 09:58:14 +09:00
Michael Nutt
03a7f7c4bd disallow null characters in custom alphabet 2022-05-13 08:43:42 +09:00
Dmitry Novik
92575fc3e5 Add missing file 2022-05-12 16:54:02 +00:00
Dmitry Novik
c5b40a9c91 WIP on GROUPING function 2022-05-12 16:40:26 +00:00
avogar
4c945d7fe5 Fix 2022-05-12 16:07:58 +00:00
avogar
0311dbb422 Add default implementation for Nothing, support arrays of nullable for arrayFilter and similar functions 2022-05-12 15:15:31 +00:00
Alexander Gololobov
548625a003 Reserve result vectors 2022-05-12 14:33:20 +02:00
Alexander Gololobov
7c226f6067 Fixed special case condition 2022-05-12 14:32:47 +02:00
Alexander Gololobov
355c5443a0 Trying to fix sanitizer failure 2022-05-12 13:50:53 +02:00
Robert Schulze
f8c24c5fe8
Merge pull request #37117 from ClickHouse/bug-37114 
Fix Bug 37114 - ilike on FixedString(N)s produces wrong results
 2022-05-12 09:39:36 +02:00
Mikhail Artemenko
031aca593d fix after merge 2022-05-12 01:42:34 +03:00
Alexander Gololobov
096b4626d6 Print more info in mismatching array sizes error message 2022-05-11 21:20:33 +02:00
Michael Nutt
2ff13c4e5d
Merge branch 'master' into hashid 2022-05-12 03:12:10 +09:00
Alexander Gololobov
b34a55c9e9
Merge branch 'master' into array-distance-functions 2022-05-11 16:55:02 +02:00
Yakov Olkhovskiy
6d3a54a044
Merge pull request #36467 from olevino/wyhash 
Wyhash
 2022-05-11 09:57:09 -04:00
Alexander Gololobov
3533cd770d Reserve result arrays 2022-05-11 14:46:06 +02:00
Robert Schulze
7232f47c68
Fix Bug 37114 - ilike on FixedString(N) columns produces wrong results 
The main fix is in MatchImpl.h where the "case_insensitive" parameter is
added to Regexps::get().

Also made "case_insensitive" a non-default template parameter to reduce
the risk of future bugs.

The remainder of this commit are minor random code improvements.

resoves #37114
 2022-05-11 14:30:21 +02:00
avogar
246aafa58a Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-array-map-nothing 2022-05-11 10:51:14 +00:00
mergify[bot]
0e2a86dcee
Merge branch 'master' into MeiliSearch 2022-05-11 08:49:19 +00:00
qieqieplus
5f9eee976f fix & format 2022-05-11 16:14:43 +08:00
Michael Nutt
b3340caea4 fixing hashid function registration when hashid is disabled 2022-05-10 20:26:42 +09:00
Sergei Trifonov
376e556474
Merge pull request #36861 from Vxider/fix-fire-hop-window 
Fix fire in window view with hop window
 2022-05-10 09:25:24 +02:00
bharatnc
592de6895c Merge remote-tracking branch 'upstream/master' into ncb/h3-missing-traversal-funcs 2022-05-09 22:41:03 -07:00
avogar
cbada6fe03 Fix Illegal column Nothing while using arrayMap 2022-05-09 15:51:31 +00:00
Yakov Olkhovskiy
24d1176bf3
Update CMakeLists.txt 2022-05-09 09:37:03 -04:00
Yakov Olkhovskiy
a0e67be32f
Update CMakeLists.txt 2022-05-09 08:54:00 -04:00
qieqieplus
b00a17ca38 Merge branch 'master' into array-distance-functions 2022-05-09 15:15:07 +08:00
qieqieplus
307511aab4 impl norm functions for array 2022-05-09 14:42:09 +08:00
qieqieplus
a17da05bda use return type as matrix value type 2022-05-09 14:42:02 +08:00
Robert Schulze
1b81bb49b4
Enable clang-tidy modernize-deprecated-headers & hicpp-deprecated-headers 
Official docs:

  Some headers from C library were deprecated in C++ and are no longer
  welcome in C++ codebases. Some have no effect in C++. For more details
  refer to the C++ 14 Standard [depr.c.headers] section. This check
  replaces C standard library headers with their C++ alternatives and
  removes redundant ones.
 2022-05-09 08:23:33 +02:00
Yakov Olkhovskiy
a2b1f7fe08
Update CMakeLists.txt 2022-05-09 01:15:50 -04:00
bharatnc
d49491a945 add h3HexRing func 2022-05-08 22:05:44 -07:00
bharatnc
ef623a39a0 minor fix to func return type 2022-05-08 22:05:44 -07:00
bharatnc
2145aa3e3a add h3Distance func 2022-05-08 22:05:44 -07:00
Yakov Olkhovskiy
c53ce4269f
Update CMakeLists.txt 
define language for header only library
 2022-05-09 00:51:03 -04:00
Michael Nutt
e87309ae8d clang-format FunctionHashID 2022-05-09 09:33:47 +09:00
Michael Nutt
e9f8114738 clean up std::string usage 2022-05-09 09:00:10 +09:00
Michael Nutt
477d9b1793 guard against hashid support being disabled 2022-05-09 07:52:35 +09:00
Robert Schulze
61cbcbf073
Enable clang-tidy readability-misleading-indentation 
Official docs:

  Correct indentation helps to understand code. Mismatch of the
  syntactical structure and the indentation of the code may hide serious
  problems.
 2022-05-08 19:12:01 +02:00
Michael Nutt
c16ce7657e add hashid support 2022-05-08 06:42:51 +09:00
mergify[bot]
2d1057bc87
Merge branch 'master' into fix-substring-negative-offset-length 2022-05-07 10:30:39 +00:00
bharatnc
be3f497b30 add h3Line func 2022-05-06 09:17:07 -07:00
Anton Popov
515f68eead Merge remote-tracking branch 'upstream/master' into dynamic-columns-14 2022-05-06 16:10:51 +00:00
Anton Popov
566c08086a support Object type inside other types 2022-05-06 14:44:00 +00:00
Anton Popov
0caf91602f
Merge pull request #36812 from CurtizJ/hash-array-of-tuples 
Allow to execute hash functions with arguments of type `Array(Tuple(..))`
 2022-05-06 14:15:38 +02:00
mergify[bot]
eba26ec956
Merge branch 'master' into fix-fire-hop-window 2022-05-05 13:11:34 +00:00
bharatnc
01ea1beee5 Merge remote-tracking branch 'upstream/master' into ncb/h3-unidirectionaledges-funcs 2022-05-04 15:55:56 -07:00
Yakov Olkhovskiy
9c1a06703a
Merge pull request #36564 from awakeljw/fork_chmaster2 
Fix CAST Object to Object with Nullable subcolumns
 2022-05-04 14:40:43 -04:00
Vxider
407c14251a simplify code 2022-05-04 20:56:09 +08:00
mergify[bot]
17aecac7ff
Merge branch 'master' into new-clangtidies 2022-05-03 19:44:01 +00:00
Robert Schulze
0a4eccb73e
Activated a bunch of LLVM 12/13/14 clang-tidy warnings 
Omitted new checks which produce too many matches or which are
controversial (e.g. readability-identifier-length).

New checks:

- misc-misleading-bidirectional + misc-misleading-identifier

  Detects potential attack as described in the Trojan Source attack

- modernize-macro-to-enum

  Replaces groups of adjacent macros with an unscoped anonymous enum

- modernize-shrink-to-fit

  Replace copy and swap tricks on shrinkable containers with the
  shrink_to_fit() method call

- modernize-use-transparent-functors

  Prefer transparent functors to non-transparent ones

- modernize-use-uncaught-exceptions

  This check will warn on calls to std::uncaught_exception and replace
  them with calls to std::uncaught_exceptions (uncaught_exception was
  deprecated with C++17)

- performance-no-int-to-ptr

  Diagnoses every integer to pointer cast

- readability-duplicate-include

  Looks for duplicate includes and removes them

- readability-redundant-preprocessor

  Finds potentially redundant preprocessor directives

- bugprone-lambda-function-name

  Checks for attempts to get the name of a function from within a lambda
  expression

- bugprone-redundant-branch-condition

  Finds condition variables in nested if statements that were also
  checked in the outer if statement and were not changed

- bugprone-shared-ptr-array-mismatch

  Finds initializations of C++ shared pointers to non-array type that
  are initialized with an array

- bugprone-stringview-nullptr

  Checks for various ways that the const CharT* constructor of
  std::basic_string_view can be passed a null argument and replaces them
  with the default constructor in most cases

- bugprone-suspicious-memory-comparison

  Finds potentially incorrect calls to memcmp() based on properties of
  the arguments
 2022-05-03 09:22:11 +02:00
bharatnc
e56f7a1451 fix style check 2022-05-02 22:20:27 -07:00
bharatnc
a0da885c3c add h3GetUnidirectionalEdgeBoundary func 2022-05-02 21:38:54 -07:00
Dmitry Novik
9be17ef50c
Merge pull request #35111 from azat/optimize_aggregation_in_order-prefix 
Implement partial GROUP BY key for optimize_aggregation_in_order
 2022-05-02 17:49:48 +02:00
Vladimir C
7293a69e5e
Merge pull request #36656 from amosbird/timefunctionunderflow 
Saturate date/datetime to zero (part 2)
 2022-05-02 17:10:48 +02:00
bharatnc
745a44a7b0 add h3GetUnidirectionalEdgesFromHexagon func 2022-05-01 22:25:58 -07:00
bharatnc
30d14c1217 add h3GetIndexesFromUnidirectionalEdge func 2022-05-01 21:26:44 -07:00
awakeljw
0a32fe4da3 Fix CAST Object to Object with Nullable subcolumns 2022-05-02 11:31:13 +08:00
bharatnc
77b5f6fee0 add h3GetDestinationIndexFromUnidirectionalEdge func 2022-05-01 14:06:45 -07:00
bharatnc
7e871adf91 add h3GetOriginIndexFromUnidirectionalEdge func 2022-05-01 13:47:43 -07:00
bharatnc
0e4a833717 add h3UnidirectionalEdgeIsValid func 2022-05-01 13:21:18 -07:00
bharatnc
6ce66e6d13 add func h3GetUnidirectionalEdge 2022-05-01 11:12:05 -07:00
Mikhail Artemenko
41f657d8ed
Merge branch 'master' into MeiliSearch 2022-05-01 10:01:56 +03:00
Alexey Milovidov
1ddb04b992
Merge pull request #36715 from amosbird/refactorbase 
Reorganize source files so that base won't depend on Common
 2022-04-30 09:40:58 +03:00
Anton Popov
9878cae3e8 allow to execute hash function with arguments of type Array(Tuple(..)) 2022-04-29 18:50:42 +00:00
Azat Khuzhin
767acd53fb Add ability to pass range of rows to Aggregator 
v2: fix compiled aggregate functions (seek result to row_start)
v3: fix compiled aggregate functions (seek args to row_start)
v4: change signatures for JIT
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-29 06:57:55 +03:00
Amos Bird
4a5e4274f0
base should not depend on Common 2022-04-29 10:26:35 +08:00
Amos Bird
e81929a8b5
Saturate date/datetime to zero (part 2) 
For partial hours/minutes timezones.
 2022-04-29 10:24:18 +08:00
Meena Renganathan
bdaf5391cf Merge branch 'master' of https://github.com/DevTeamBK/ClickHouse into FIPS_compliance 2022-04-28 06:15:46 -07:00
Nikita Mikhaylov
7d95051d32
Fixed integer overflow in toStartOfInterval (#36546) 2022-04-26 11:44:57 +02:00
Meena Renganathan
ab329721d7 Merge branch 'master' of https://github.com/DevTeamBK/ClickHouse into FIPS_compliance 2022-04-25 06:21:44 -07:00
Memo
856412ea6e fix wrong alias 2022-04-22 11:27:24 +08:00
Memo
25f4d76da3 change name 2022-04-22 11:24:44 +08:00
Memo
956d525840 fix conflict 2022-04-22 11:22:50 +08:00
Memo
32721b001f add alias 2022-04-22 11:18:07 +08:00
Memo
39aadf0975 replaced toStartOfFiveMinute to toStartOfFiveMinutes 2022-04-22 10:49:59 +08:00
olevino999
6594ae8e44 Merge branch 'master' of github.com:ClickHouse/ClickHouse into wyhash 2022-04-21 19:36:25 +03:00
BoloniniD
a353210e94 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-04-21 18:44:42 +03:00
Maksim Kita
57444fc7d3
Merge pull request #36444 from rschu1ze/clang-tidy-fixes 
Clang tidy fixes
 2022-04-21 16:11:27 +02:00
olevino999
465191b562 wyhash 2022-04-21 02:31:31 +03:00
olevino999
64989afa52 wyhash 2022-04-21 02:26:37 +03:00
Yakov Olkhovskiy
95fc6243b1
Merge pull request #36386 from Joeywzr/hex_support_uint128 
hex support Int128/Int256/UInt128/UInt256
 2022-04-20 11:11:51 -04:00
Robert Schulze
b24ca8de52
Fix various clang-tidy warnings 
When I tried to add cool new clang-tidy 14 warnings, I noticed that the
current clang-tidy settings already produce a ton of warnings. This
commit addresses many of these. Almost all of them were non-critical,
i.e. C vs. C++ style casts.
 2022-04-20 10:29:05 +02:00
qieqieplus
2865c8141d Merge branch 'master' into array-distance-functions 2022-04-19 14:46:39 +08:00
qieqieplus
c4b5c45740 refactor & add tests 2022-04-19 14:39:40 +08:00
Memo
8d4e433c7d add int8 int16 int32 int64 and tests 2022-04-19 14:38:16 +08:00
Robert Schulze
118e94523c
Activate clang-tidy warning "readability-container-contains" 
This check suggests replacing <Container>.count() by
<Container>.contains() which is more speaking and in case of
multimaps/multisets also faster.
 2022-04-18 23:53:11 +02:00
Memo
335be4c807 hex support Int128/Int256/UInt128/UInt256 2022-04-18 20:13:43 +08:00
Alexey Milovidov
f6ab2bd523
Merge pull request #36312 from ClickHouse/remove-arcadia 
Remove remaining parts of Arcadia
 2022-04-18 07:02:54 +03:00
Alexey Milovidov
294efeccfe Fix clang-tidy-14 (part 1) 2022-04-16 04:54:04 +02:00
Alexey Milovidov
cbeeb7ec4f Remove Arcadia 2022-04-16 00:20:47 +02:00
Mikhail Artemenko
2fd86cc564
Merge branch 'master' into MeiliSearch 2022-04-13 12:05:46 +03:00
BoloniniD
30712ead45
Merge branch 'master' into BLAKE3 2022-04-13 00:45:44 +03:00
bharatnc
e5494de63c h3Res0Indexes - remove unused array 2022-04-11 22:18:55 -07:00
Anton Popov
471e945efe
Merge pull request #35934 from ClickHouse/make_date 
Implementation of makeDateTime() and makeDateTime64() #30895
 2022-04-11 16:38:23 +02:00
Alexander Tokmakov
6a46da93ae Merge branch 'master' into mvcc_prototype 2022-04-07 23:22:19 +02:00
Kruglov Pavel
73adbb4c15
Merge pull request #35986 from amosbird/better-scalar1 
Fix performance regression of scalar query
 2022-04-07 14:07:59 +02:00
Alexander Tokmakov
8290ffa88d Merge branch 'master' into mvcc_prototype 2022-04-07 13:50:42 +02:00
Alexander Gololobov
42d4a84a6f More tests for corner cases 2022-04-07 12:34:26 +02:00
Alexander Gololobov
81d150ed43 Implementation of makeDateTime() and makeDateTime64() 2022-04-07 00:30:18 +02:00
Meena Renganathan
645e156af6 Updated the boringssl-cmake to match the latest broingssl module update 2022-04-06 14:52:33 -07:00
Mikhail Artemenko
151eeb1a27
Merge branch 'master' into MeiliSearch 2022-04-06 17:07:55 +03:00
Amos Bird
df06f9f974
Fix performance regression of scalar query 2022-04-06 17:50:22 +08:00
Vladimir C
2ebae2d722
Merge pull request #35682 from CurtizJ/dynamic-columns-6 2022-04-06 11:48:07 +02:00
Alexander Tokmakov
1fe50ad201 Merge branch 'master' into mvcc_prototype 2022-04-05 14:38:02 +02:00
Maksim Kita
b160ffd726
Merge pull request #35723 from ClickHouse/array-has-all-sse-avx2-optimizations 
Merging #27653
 2022-04-05 11:09:14 +02:00
Alexander Gololobov
f0de8eb625 Extracted argument handling into a separate class to reuse it for makeDateTime() and makeDateTime64() 2022-04-04 19:57:04 +02:00
Alexander Tokmakov
a2167f12b8 Merge branch 'master' into mvcc_prototype 2022-04-04 14:24:23 +02:00
Maksim Kita
47528de78b Fix build 2022-04-04 14:07:05 +02:00
Maksim Kita
af405d3ba6 Fixed style check 2022-04-04 13:34:27 +02:00
Nikolai Kochetov
19819c72f8
Merge pull request #35290 from bigo-sg/function_enumerate_streams 
Add function getTypeSerializationStreams
 2022-04-04 12:09:53 +02:00
Alexey Milovidov
d9e5ca2119
Merge pull request #34394 from holadepo/last_day 
Add toLastDayOfMonth function
 2022-04-04 07:02:08 +03:00
Alexander Tokmakov
5a50ad9de3 Merge branch 'master' into mvcc_prototype 2022-03-31 11:35:04 +02:00
taiyang-li
a5765dccb1 Merge branch 'master' into function_enumerate_streams 2022-03-31 12:21:00 +08:00
Kruglov Pavel
4ec3c35e14
Merge pull request #35755 from Avogar/fix-custom-to-string 
Fix bug in conversion from custom types to string
 2022-03-31 00:06:48 +02:00
Maksim Kita
e43fdcd7eb Function hasAll added dynamic dispatch for SSE4.2, AVX2 2022-03-30 18:41:34 +02:00
Maksim Kita
8d0a9689e4 Update gatherutils CMakeLists to use X86_INTRINSICS_FLAGS from cpu_features 2022-03-30 18:40:18 +02:00
Maksim Kita
91eec8962f Rename test 2022-03-30 18:39:28 +02:00
avogar
af4bfec051 Fix bug in conversion from custom types to string 2022-03-30 11:19:03 +00:00
Vladimir C
31c367d3cd
Merge pull request #35651 from amosbird/columntransformerrename 2022-03-30 12:37:30 +02:00
Antonio Andelic
d85ed8f2a9
Merge pull request #35655 from ClickHouse/exception-compile-time-message-check 
Use compile-time check for `Exception` messages
 2022-03-30 08:11:32 +02:00
taiyang-li
47f3e9330e merge master and fix conflict 2022-03-30 11:06:51 +08:00
Anton Popov
a842a81aba
Merge pull request #35690 from CurtizJ/flatten-tuple 
Add function `flattenTuple`
 2022-03-30 00:24:36 +02:00
Maksim Kita
2742b88e6c
Merge pull request #27653 from ContentSquare/hasAllAny_SIMD 
Implement HasAll specialization for SSE and AVX2
 2022-03-29 16:35:59 +02:00
Alexander Tokmakov
287d858fda Merge branch 'master' into mvcc_prototype 2022-03-29 16:24:12 +02:00
Antonio Andelic
9990abb76a Use compile-time check for Exception messages, fix wrong messages 2022-03-29 13:16:11 +00:00
Anton Popov
9610139477
Merge pull request #35629 from CurtizJ/dynamic-columns-5 
Support schema inference for type `Object` in format `JSONEachRow`
 2022-03-29 14:17:09 +02:00
Alexander Gololobov
bf376ee2f5
Merge pull request #35628 from ClickHouse/make_date 
Implementation of makeDate and makeDate32
 2022-03-29 13:35:26 +02:00
BoloniniD
2d2420c8a9 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-03-29 11:00:50 +03:00
taiyang-li
db436ad621 Merge branch 'master' into function_enumerate_streams 2022-03-29 11:35:21 +08:00
Alexander Gololobov
b49993f993 Fixes according to the code review 2022-03-28 22:47:39 +02:00
Anton Popov
24c0cf86d4 add function 'flattenTuple' 2022-03-28 19:32:12 +00:00
Anton Popov
6cbdc6af00 remove obsolete parameter 2022-03-28 18:44:53 +00:00
Alexander Tokmakov
208b242188 Merge branch 'master' into mvcc_prototype 2022-03-28 19:58:06 +02:00
Alexander Gololobov
93021e387e Implementation of makeDate and makeDate32 2022-03-28 18:57:24 +02:00
Amos Bird
6003a49a87
Fix style 2022-03-28 17:48:47 +08:00
Amos Bird
58a78fba12
formatString bug fix and refactoring 2022-03-28 15:47:48 +08:00
Anton Popov
67195bfdd5 support schema inference for type Object in format JSONEachRow 2022-03-25 21:51:53 +00:00
taiyang-li
7889059f7d fix building 2022-03-25 22:39:57 +08:00
taiyang-li
4788006030 Merge branch 'master' into function_enumerate_streams 2022-03-25 22:31:10 +08:00
Antonio Andelic
e76074ef7f Merge branch 'master' into fix-casewithexpression-type-deduction 2022-03-25 11:12:38 +00:00
taiyang-li
dd0873189d rename all files 2022-03-25 14:54:01 +08:00
taiyang-li
c9acc55008 rename function name 2022-03-25 14:51:59 +08:00
Antonio Andelic
fbba450cff Take ELSE branch into account for result type deduction 2022-03-24 11:23:18 +00:00
Alexey Milovidov
31eeeeb428 Add compatibility alias 2022-03-24 02:21:57 +01:00
Alexey Milovidov
d54138425f Rename yandexConsistentHash to kostikConsistentHash 2022-03-24 02:18:25 +01:00
Maksim Kita
4b88c6f934
Merge pull request #35534 from kitaisreal/set-in-ipv4-ipv6-address-cast-fix 
Fix cast into IPv4, IPv6 address in IN section
 2022-03-24 01:26:25 +01:00
Maksim Kita
31b3d2e840 Fixed tests 2022-03-23 19:59:26 +01:00
Yakov Olkhovskiy
1631656803
Merge pull request #34353 from zvonand/issue_33147 
Extended usage of Milliseconds, Microseconds, Nanoseconds
 2022-03-23 13:33:07 -04:00
Maksim Kita
ff2d5dae83 Fix cast into IPv4, IPv6 address in IN section 2022-03-23 15:22:08 +01:00
Alexander Tokmakov
bcec53aadc Merge branch 'master' into mvcc_prototype 2022-03-23 11:28:43 +01:00
alesapin
0ab9a9c0f6
Merge pull request #33664 from ClickHouse/release-steps 
Refactor releasing process
 2022-03-22 14:43:18 +01:00
Maksim Kita
0576c1b0f3
Merge pull request #35500 from kitaisreal/throw-if-constant-argument-crash-fix 
Fix crash for function throwIf with constant arguments
 2022-03-22 13:44:37 +01:00
Maksim Kita
22112feef3 Fix crash for function throwIf with constant arguments 2022-03-22 12:30:25 +01:00
qieqieplus
91bc253f86 impl distance functions for array 2022-03-22 18:19:12 +08:00
alesapin
bad78f0daa
Don't unwind inlines if we unable to do it 2022-03-22 11:11:36 +01:00
Alexander Tokmakov
3c762f566d Merge branch 'master' into mvcc_prototype 2022-03-21 20:16:29 +01:00
avogar
0f69baa231 Fix bug in function if that led to logical error 2022-03-21 14:27:25 +00:00
mergify[bot]
e11ef05c2b
Merge branch 'master' into issue_33147 2022-03-21 13:40:17 +00:00
Maksim Kita
695b1300f9
Merge pull request #35383 from rschu1ze/enable-if-to-concepts-pt2 
Replace more uses of std::enable_if for SFINAE by concepts
 2022-03-21 10:47:28 +01:00
taiyang-li
b52a066903 fix style 2022-03-21 14:19:54 +08:00
taiyang-li
8e856a00fd enable column as argument 2022-03-21 12:49:05 +08:00
Alexander Tokmakov
9e05b12d2c Merge branch 'master' into mvcc_prototype 2022-03-20 22:42:26 +01:00
Maksim Kita
ab2496ca4e Fix style check 2022-03-18 21:39:30 +01:00
Maksim Kita
b7b69156e3 Added functions arrayFirstOrNull, arrayLastOrNull 2022-03-18 19:52:02 +01:00
Maksim Kita
2e22164cd7
Merge pull request #35360 from ClickHouse/merging-min-sample-size 
Merging #34354
 2022-03-18 02:28:39 +03:00
BoloniniD
0f8bfbb25b Add Rust aarch64 toolchain to Docker container 2022-03-18 00:34:44 +03:00
Robert Schulze
df73c75456
Replace more uses of std::enable_if for SFINAE by concepts 
- enable_if is usually regarded as fragile and unreadable
- C++20 concepts are much easier to read and produce more expressive error messages

- this is follow-up to PR #35347 but this time most of the remaining and
  more complex usages of enable_if in the codebase were replaced.
 2022-03-17 20:44:55 +01:00
Maksim Kita
8f01a6bbde Function proportionsZTest fix style check 2022-03-17 18:17:30 +00:00
Maksim Kita
7efb9d38e1 Function proporationsZTest formatting fix 2022-03-17 15:32:15 +00:00
Maksim Kita
cca121f0da Fixed minSampleSize functions 2022-03-17 15:30:59 +00:00
Alexander Tokmakov
d04dc03fa4 Merge branch 'master' into mvcc_prototype 2022-03-17 15:24:32 +01:00
Maksim Kita
3f45755822
Merge pull request #34354 from achimbab/minSampleSize 
Implement functions for minimum-sample-size-calculators
 2022-03-17 12:47:53 +01:00
Maksim Kita
1bf3ff67b2 Function h3GetRes0Indexes crash fix 2022-03-17 11:45:25 +00:00
Maksim Kita
9e88f3b4b9
Merge pull request #34568 from bharatnc/ncb/h3-misc-funcs-3 
add remaining h3 miscellaneous functions
 2022-03-17 11:55:58 +01:00
alesapin
457fa0d1ba
Merge pull request #23932 from CurtizJ/dynamic-columns 
Support of dynamic subcolumns (JSON data type)
 2022-03-17 10:45:46 +01:00
Maksim Kita
4d8c2b2009
Merge pull request #35347 from rschu1ze/enable-if-to-concepts 
Replace a few uses of enable_if for SFINAE by concepts
 2022-03-17 10:34:08 +01:00
taiyang-li
d9391f2f7b fix conflict 2022-03-17 17:31:37 +08:00
Maksim Kita
f837f609f3
Merge pull request #35240 from kitaisreal/cast-to-ip-address-refactoring 
Standardize behaviour of CAST into IPv4, IPv6, toIPv4, toIPv6 functions
 2022-03-17 10:26:32 +01:00
taiyang-li
c04ba090bf add missing sourcefile and fix code style 2022-03-17 15:35:35 +08:00
taiyang-li
0867a0ce17 fix code style 2022-03-17 10:59:13 +08:00
Alexander Tokmakov
4b3e13a4fe Merge branch 'master' into mvcc_prototype 2022-03-16 21:06:19 +01:00
Maksim Kita
346c6b9d79 Fixed tests 2022-03-16 19:59:31 +00:00
Robert Schulze
b56c28d841
Replace a few uses of enable_if for SFINAE by concepts 
- enable_if is usually regarded as fragile and unreadable

- C++20 concepts are much easier to read and produce more expressive
  error messages
 2022-03-16 19:51:38 +01:00
Maksim Kita
9ba53ae037
Merge pull request #34888 from kitaisreal/performance-tests-fix 
Performance tests fix
 2022-03-16 17:19:16 +01:00
Anton Popov
0ba78c3c3a Merge remote-tracking branch 'upstream/master' into HEAD 2022-03-16 15:28:09 +00:00
Nikita Mikhaylov
96c6325fc3
Merging #33398 (proportionsZTest) (#35157) 2022-03-16 13:17:07 +01:00
Maksim Kita
8bdb906acb Fixed tests 2022-03-15 15:43:39 +00:00
Maksim Kita
08bb39d869 Fixed performance tests 2022-03-15 15:43:39 +00:00
Maksim Kita
fa4508bcb9 Fixed tests 2022-03-15 15:35:25 +00:00
taiyang-li
93550d547e add doc and tests 2022-03-15 18:25:36 +08:00
taiyang-li
c08e3c0dd2 return const for function getMacro if not distributed query 2022-03-15 17:06:16 +08:00
Alexander Tokmakov
9702b5177d Merge branch 'master' into mvcc_prototype 2022-03-14 21:45:38 +01:00
Maksim Kita
538f8cbaad Fix clang-tidy warnings in Disks, Formats, Functions folders 2022-03-14 18:17:35 +00:00
Anton Popov
36ec379aeb Merge remote-tracking branch 'upstream/master' into HEAD 2022-03-14 16:28:35 +00:00
Maksim Kita
36dc7f03a4 Fixed tests 2022-03-14 09:14:41 +00:00
BoloniniD
253afd032f Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-03-13 21:18:46 +03:00
Alexey Milovidov
978877a9c0
Merge pull request #35212 from rschu1ze/cpp14-trait-aliases 
Use C++14 aliases for some type traits
 2022-03-12 22:20:14 +03:00
Alexey Milovidov
3385275003
Merge pull request #35226 from ClickHouse/timezone-in-config 
Change timezone example in server config
 2022-03-12 21:58:29 +03:00
Maksim Kita
3a2b3ce503 Standardize behaviour of CAST into IPv4, IPv6, toIPv4, toIPv6 functions 2022-03-12 17:12:05 +00:00
Alexey Milovidov
df906dfbd4 Change comments 2022-03-11 23:46:02 +01:00
Alexey Milovidov
e4e058d667
Update ReplaceRegexpImpl.h 2022-03-12 01:35:37 +03:00
Robert Schulze
85ce4a9bea
Use C++14 aliases for some type traits 2022-03-11 15:54:29 +01:00
vdimir
c66fb7cf6e
Attempt to fix replaceRegexpAll 2022-03-10 19:57:13 +00:00
alexey-milovidov
008760b436
Update toLastDayOfMonth.cpp 2022-03-10 22:30:46 +03:00
Alexander Tokmakov
061fa6a6f2 Merge branch 'master' into mvcc_prototype 2022-03-10 13:13:04 +01:00
Amos Bird
a19224bc9b
Fix partition pruner: non-monotonic function IN 2022-03-09 15:48:42 +08:00
Alexander Tokmakov
8acfb8d27f Merge branch 'master' into mvcc_prototype 2022-03-07 17:40:15 +01:00
Anton Popov
0bc57da238 Merge remote-tracking branch 'upstream/master' into HEAD 2022-03-07 14:46:08 +00:00
Vladimir C
79b21c80b1
Merge pull request #33698 from hexiaoting/dev-map-funciton 2022-03-04 11:51:17 +01:00
vdimir
e9dee63fe2
style fix 2022-03-04 10:49:43 +00:00
Maksim Kita
6722227407
Merge pull request #35027 from kitaisreal/functions-hierarchical-dictionaries-const-arguments-fix 
Dictionary hierarchy functions implicit key cast and support for constant arguments
 2022-03-04 10:45:37 +01:00
Anton Popov
df3b07fe7c Merge remote-tracking branch 'upstream/master' into HEAD 2022-03-03 22:25:28 +00:00
Anton Popov
7d01516202
Merge pull request #34795 from snar/array-compact-higher-order 
make arrayCompact behave as other higher-order functions
 2022-03-03 21:25:43 +03:00
vdimir
2aa6685baf
Add cases to 02169_map_functions, update error messages in FunctionArrayMapped 2022-03-03 18:04:17 +00:00
Maksim Kita
18fabccff2 Functions dictGetHierarchy, dictIsIn, dictGetChildren, dictGetDescendants support implicit key cast and constant arguments 2022-03-03 16:13:05 +00:00
hexiaoting
95530d0d70
fix style error 2022-03-03 13:22:48 +00:00
vdimir
f7f002139a
Upd FunctionArrayMapped 2022-03-03 13:22:48 +00:00
vdimir
939a15d29a
Upd FunctionArrayMapped for Map 2022-03-03 13:22:48 +00:00
vdimir
82a76d47ff
Use FunctionArrayMapped for Map 2022-03-03 13:22:47 +00:00
hexiaoting
aeec4a62e7
fix bug 2022-03-03 13:22:47 +00:00
hexiaoting
71aa411746
Fix bug 2022-03-03 13:22:46 +00:00
hexiaoting
a435c3a1e8
Fix mapFilter bug 2022-03-03 13:22:46 +00:00
hexiaoting
582e6fa1c5
Fix build error 2022-03-03 13:22:46 +00:00
hexiaoting
36939f1d5c
Update src/Functions/FunctionMapMapped.h 
Co-authored-by: Vladimir C <vdimir@yandex-team.ru>
 2022-03-03 13:22:45 +00:00
hexiaoting
ed39edda67
Update src/Functions/mapFilter.cpp 
Co-authored-by: Vladimir C <vdimir@yandex-team.ru>
 2022-03-03 13:22:45 +00:00
hexiaoting
e953e482ec
Implement more functions for Map data type 2022-03-03 13:22:44 +00:00
Maksim Kita
b1a956c5f1 clang-tidy check performance-move-const-arg fix 2022-03-02 18:15:27 +00:00
Maksim Kita
1f5837359e clang-tidy check performance-noexcept-move-constructor fix 2022-03-02 18:15:27 +00:00
BoloniniD
8474babe88 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-03-02 18:27:53 +03:00
HaiBo Li
2ea18b3085
Fix the bug that the toDatetime function overflows (#32898) 
* Fixed overflow bug of the function toDatetime/toDate/toDate32/parseDateTimeBestEffort
 2022-03-02 10:06:38 +03:00
Anton Popov
c1fdcf7a64 Merge remote-tracking branch 'upstream/master' into HEAD 2022-03-01 20:21:39 +03:00
Anton Popov
2758db5341 add more comments 2022-03-01 19:32:55 +03:00
mergify[bot]
b4574a777f
Merge branch 'master' into mvcc_prototype 2022-02-28 11:24:39 +00:00
bharatnc
fb2a9a26df Merge remote-tracking branch 'upstream/master' into ncb/h3-misc-funcs-3 2022-02-25 20:36:31 -08:00
Anton Popov
fcdebea925 Merge remote-tracking branch 'upstream/master' into HEAD 2022-02-25 13:41:30 +03:00
Vladimir C
9ba0cb547a
Merge pull request #34836 from vdimir/issue-34810 2022-02-25 09:58:28 +01:00
Alexander Tokmakov
aa6b9a2abc Merge branch 'master' into mvcc_prototype 2022-02-23 23:22:03 +03:00
vdimir
b5ab8f97c6
Fix untuple condition in IN function 2022-02-23 14:31:53 +00:00
bharatnc
9b770a92ba improve h3GetRes0Indexes implementation 2022-02-23 01:25:13 -08:00
Alexandre Snarskii
2148b0f803 optimize specialization to use arrays 2022-02-22 18:38:45 +03:00
bharatnc
cf3d9f893c fix style 2022-02-21 21:37:10 -08:00
bharatnc
57e17c607a fix - convert const cols to full cols 2022-02-21 12:15:14 -08:00
bharatnc
8e19415992 generalize implementation for h3PointDist{M,Km,Rads} 2022-02-21 11:41:21 -08:00
Alexandre Snarskii
7d87a446d1 make arrayCompact behave as other higher-order functions 2022-02-21 15:40:03 +03:00
Maksim Kita
a3e6552fa5
Merge pull request #34753 from ClickHouse/check-submodules 
Submodules are mandatory
 2022-02-21 13:16:35 +01:00
Maksim Kita
57ef720f2a
Merge pull request #34743 from bharatnc/ncb/fixes-to-h3-funcs 
fix h3 failing queries having const columns
 2022-02-21 11:54:16 +01:00
achimbab
7b9c6e6cba Merge branch 'minSampleSize' of https://github.com/achimbab/ClickHouse into minSampleSize 2022-02-20 16:43:34 +09:00
achimbab
4794ea236c Some fixes for minSampleSize functions. 
- use getData
- add fomulas
- move distribution constructor out of the hot loop
- fix test cases
- use fixed const values for function arguments
 2022-02-20 16:40:23 +09:00
BoloniniD
3f149e88be Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-02-19 20:23:19 +03:00
Alexey Milovidov
e1a2e376a3 Submodules are mandatory 2022-02-19 17:44:24 +01:00
bharatnc
a4cf3303f9 fix fuzzer segfault 2022-02-19 08:41:21 -08:00
bharatnc
b7678c1bc1 fix s2 functions having const columns 2022-02-18 22:42:27 -08:00
bharatnc
7c9a581af6 convert const cols to full cols 2022-02-18 16:34:50 -08:00
Maksim Kita
3dd6b91cbe
Merge pull request #34731 from kitaisreal/performance-tests-fix-h3 
Performance tests fix H3
 2022-02-18 19:21:38 +01:00
Vladimir C
9b7d011ee7
Merge pull request #34529 from vdimir/join-nullable-on-pipeline 
Apply join_use_nulls on types before join
 2022-02-18 18:34:44 +01:00
Maksim Kita
80b0efb367 Performance tests fix H3 2022-02-18 15:57:54 +00:00
zvonand
9367a8df68 no_sanitize_undefined 2022-02-18 14:53:22 +03:00
zvonand
8d34797212 AST fix try 123 2022-02-18 13:45:47 +03:00
zvonand
6d47a715dc fix decimal overflow 2022-02-18 10:18:07 +03:00
Nikolay Degterinsky
c09275f0da
Merge pull request #34368 from usurai/sw 
Add startsWith & endsWith function for arrays
 2022-02-18 08:34:48 +03:00
zvonand
71b7b6605e fixed maths 2 2022-02-18 00:17:29 +03:00
zvonand
1f24f3a5e2 fixed overflow 2022-02-17 23:17:06 +03:00
Maksim Kita
5c92ad0d57 Function encodeURLComponent minor fixes 2022-02-17 18:34:23 +00:00
Maksim Kita
562f1ec01a
Merge pull request #34607 from zzsmdfj/issue/#31092_add_encodeURLComponent_function 
add encode url component function
 2022-02-17 17:57:23 +01:00
zvonand
90c857c5e3 merge 2022-02-17 18:23:37 +03:00
Kruglov Pavel
07098fc597
Merge pull request #34619 from vdimir/fix_aarch64/01662_date_ubsan 
Check overflow in addSeconds/Minues/etc functions
 2022-02-17 15:55:55 +03:00
zvonand
1afe815bda fix maths 2022-02-17 15:33:26 +03:00
Alexander Tokmakov
dae044f86b Merge branch 'master' into mvcc_prototype 2022-02-17 13:49:37 +03:00
zvonand
d37003e4b6 mustfix fuzzer 2022-02-17 10:28:09 +03:00
zzsmdfj
1c068f1295 to issue/#31092_add_encodeURLComponent_function 2022-02-17 11:55:06 +08:00
zzsmdfj
6b78da6f02 to issue/#31092_add_encodeURLComponent_function 2022-02-17 11:32:47 +08:00
zvonand
a5a742e22b updated negative fracs 2022-02-17 01:39:46 +03:00
zvonand
fca314aa11 fixed clang-tidy 2022-02-16 19:23:10 +03:00
vdimir
65452ac089
Fix checkOverflow in FunctionDateOrDateTimeAddInterval 2022-02-16 14:30:37 +00:00
usurai
9fe920500d
Apply suggestions from code review 
Co-authored-by: Nikolay Degterinsky <43110995+evillique@users.noreply.github.com>
 2022-02-16 20:58:43 +08:00
zvonand
cf244689a2 fixed filling transform 2022-02-16 15:14:25 +03:00
zzsmdfj
4dcb411f4f to #31092_add_encodeURLComponent_function 2022-02-16 10:19:20 +08:00
zvonand
f60a944483 fixed toStartOfInterval 2022-02-16 02:43:08 +03:00
vdimir
a5c34fafd4
Check overflow in addSeconds/Minues/etc functions 2022-02-15 19:04:59 +00:00
Maksim Kita
37f7e6a216
Merge pull request #34562 from bigo-sg/fix_round 
Fix round bug
 2022-02-15 13:01:57 +01:00
Alexander Tokmakov
1e4e569151 Merge branch 'master' into mvcc_prototype 2022-02-15 02:26:47 +03:00
vdimir
99ca89c0ca
Fix StorageJoin and Asof or join_use_nulls in pipeline 2022-02-14 14:14:27 +00:00
achimbab
054d691685
Merge branch 'ClickHouse:master' into minSampleSize 2022-02-14 09:32:15 +09:00
zvonand
888542e29b add[interval] no longer oses decimal components 
Not only support for better subsecond logic, but also fewer conversions
-> faster operation
 2022-02-14 02:52:56 +03:00
zvonand
2454f1dd13 Decimal components attempt 2022-02-14 00:04:09 +03:00
bharatnc
c29e16fb74 add tests for h3GetPentagonIndexes 2022-02-13 12:56:43 -08:00
bharatnc
8654691b96 add h3GetPentagonIndexes func 2022-02-13 12:56:43 -08:00
bharatnc
88b6fc6432 add h3GetRes0Indexes func 2022-02-13 12:56:43 -08:00
bharatnc
9646bb0c91 add func h3PointDistRads 2022-02-13 12:56:43 -08:00
bharatnc
982e6aae42 add h3PointDistKm func 2022-02-13 12:56:42 -08:00
bharatnc
d5f2312c2f add func h3PointDistM 2022-02-13 12:56:42 -08:00
zvonand
196ffb4827 toStartOf[...]second works 2022-02-13 18:41:45 +03:00
zvonand
dcc0f53f8e updated Interval definitions 2022-02-13 17:54:03 +03:00
achimbab
c5c2e83435 Remove some codes 2022-02-13 23:27:06 +09:00
taiyang-li
e759af2dd4 fix round bug 2022-02-13 18:52:25 +08:00
BoloniniD
a4cdbbc159 Fix MSan false positive 2022-02-13 13:15:02 +03:00
zvonand
48c1b8b62b Updated IntervalParser 2022-02-13 13:01:48 +03:00
BoloniniD
c8bb6fb38a Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-02-13 12:47:18 +03:00
BoloniniD
677b5ea6aa Add MSan support for BLAKE3 lib 2022-02-13 12:46:20 +03:00
bharatnc
4dadc7e15b fix style check 2022-02-12 23:36:40 -08:00
bharatnc
b50005e702 add check for max h3 resolution 2022-02-12 22:05:28 -08:00
achimbab
674032afb9 An integer type can be used for the baseline and sigma. 2022-02-13 14:43:12 +09:00
bharatnc
e02bd7d785 check and get columns in geoToH3 func 2022-02-12 19:08:40 -08:00
zvonand
0c5e8a0beb upload 2022-02-12 19:37:06 +03:00
Alexander Tokmakov
07e66e690d Merge branch 'master' into mvcc_prototype 2022-02-11 15:53:32 +03:00
zvonand
da1ba60202 upload 2022-02-11 13:35:50 +03:00
RogerYK
45296fd039 Merge remote-tracking branch 'upstream/master' into fix-substring-negative-offset-length 2022-02-10 15:58:33 +08:00
Anton Popov
18940b8637 Merge remote-tracking branch 'upstream/master' into HEAD 2022-02-09 23:38:38 +03:00
zvonand
0fe1fdb6ca add[...]Seconds basically work 2022-02-09 20:19:01 +03:00
zvonand
d8b40e7deb basic add[...]seconds added 
TODO: fix DT64 scale resolution when input and func's scale are not the
same
 2022-02-09 10:28:15 +03:00
Habibullah Oladepo
57ff05b6e6 Add new function toLastDayOfMonth 2022-02-08 23:48:44 +01:00
zvonand
0633174b10 Merge branch 'master' of github.com:ClickHouse/ClickHouse into issue_33147 2022-02-08 11:42:31 +03:00
cmsxbc
a33bd4c623
Merge branch 'master' into addressToLineWithInlines 2022-02-08 08:54:15 +08:00
zvonand
9456d89fad Move current work from old laptop 
skip-checks: true
 2022-02-07 21:44:14 +03:00
achimbab
28e6cfb753 Modify the sample_size type from UInt64 to Float64 2022-02-07 22:25:00 +09:00
Kruglov Pavel
b35f479dea
Delete empty file DateOrDateTimeFunctionsConvertion.cpp 2022-02-07 12:26:50 +03:00
usurai
8076e1ef30 Remove whitespace 2022-02-07 17:23:43 +08:00
usurai
e242192ab8 Declare error code 2022-02-07 16:36:49 +08:00
usurai
550d80201e Fix endsWith, add test for endsWith 2022-02-07 16:36:49 +08:00
usurai
e6f5c74c17 Remove redundent header 2022-02-07 16:36:49 +08:00
usurai
6dd482136f Add startsWith & endsWith for array 2022-02-07 16:36:49 +08:00
alexey-milovidov
fb9ed9acad
Merge pull request #34175 from kitaisreal/bitset-sort-performance-check 
bitsetsort peformance check
 2022-02-07 05:34:57 +03:00
achimbab
938aa88e40 Validate arguments and unwrap arguments and the result to each columns. 2022-02-07 01:28:27 +09:00
Maksim Kita
60cc5fff56
Merge pull request #34344 from bharatnc/ncb/s2-fixes 
explicitly check and get columns for s2 funcs
 2022-02-06 17:24:52 +01:00
achimbab
ce40acefa9 Implement functions for minimum-sample-size-calculators 2022-02-06 22:12:22 +09:00
Maksim Kita
5f43fdbfd2
Merge pull request #34140 from bigo-sg/max_splits 
Maxsplit argument for splitByChar.
 2022-02-06 13:38:14 +01:00
Maksim Kita
7492280ada
Merge pull request #34334 from bigo-sg/alias_function 
REGEXP_MATCHES and REGEXP_REPLACE function aliases for compatibility with PostgreSQL.
 2022-02-06 13:37:56 +01:00
bharatnc
d666b2250c fix failing tests 2022-02-05 19:15:20 -08:00
bharatnc
008af0e0c2 update src/Functions/geoToS2.cpp 2022-02-05 19:07:25 -08:00
taiyang-li
5fc2e46dd0 make aliases case insensitive 2022-02-06 09:38:05 +08:00
bharatnc
3df4929b63 minor fixes 2022-02-05 16:45:12 -08:00
bharatnc
557cf6ecc1 check and get column remaining s2 funcs 2022-02-05 16:32:15 -08:00
bharatnc
8ba93354b0 check and get column for s2 funcs 2022-02-05 16:29:02 -08:00
taiyang-li
829a9a4d83 as alias functions 2022-02-05 19:44:21 +08:00
taiyang-li
b9c42effb4 change as requested 2022-02-05 19:30:40 +08:00
Maksim Kita
4646cac075 Fixed tests 2022-02-04 21:49:39 +00:00
Maksim Kita
b81d9d20b7 Fixed tests 2022-02-04 21:25:06 +00:00
Maksim Kita
1202fec927 Fixed tests 2022-02-04 20:25:30 +00:00
Maksim Kita
4c9ba1dfd7 Fixed tests 2022-02-04 19:52:18 +00:00
Maksim Kita
a5306396dd Function mapPopulateSeries refactoring 2022-02-04 14:53:22 +00:00
cmsxbc
9f9fce07e2 Merge branch 'master' into addressToLineWithInlines 2022-02-04 20:43:00 +08:00
Alexander Tokmakov
6a646b413e fix 2022-02-04 00:40:17 +03:00
Alexander Tokmakov
ca5f951558 Merge branch 'master' into mvcc_prototype 2022-02-03 18:56:44 +03:00
BoloniniD
9b2292ec6c Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-02-02 12:09:01 +03:00
Anton Popov
836a348a9c Merge remote-tracking branch 'upstream/master' into HEAD 2022-02-01 15:23:07 +03:00
cmsxbc
8b916a67e5 Merge branch 'master' into addressToLineWithInlines 2022-02-01 19:37:18 +08:00
Azat Khuzhin
bedf208cbd Use fmt::runtime() for LOG_* for non constexpr 
Here is oneliner:

    $ gg 'LOG_\(DEBUG\|TRACE\|INFO\|TEST\|WARNING\|ERROR\|FATAL\)([^,]*, [a-zA-Z]' -- :*.cpp :*.h | cut -d: -f1 | sort -u | xargs -r sed -E -i 's#(LOG_[A-Z]*)\(([^,]*), ([A-Za-z][^,)]*)#\1(\2, fmt::runtime(\3)#'

Note, that I tried to do this with coccinelle (tool for semantic
patchin), but it cannot parse C++:

    $ cat fmt.cocci
    @@
    expression log;
    expression var;
    @@

    -LOG_DEBUG(log, var)
    +LOG_DEBUG(log, fmt::runtime(var))

I've also tried to use some macros/templates magic to do this implicitly
in logger_useful.h, but I failed to do so, and apparently it is not
possible for now.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

v2: manual fixes
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-01 14:30:03 +03:00
Anton Popov
aab6ef60b2 better performance of parsing json data 2022-02-01 14:17:29 +03:00
Alexander Tokmakov
2e4ae37d98 Merge branch 'master' into mvcc_prototype 2022-02-01 13:20:03 +03:00
youenn lebras
9ec7e61f5f
Add Unsigned version for Int8, Int16, Int32, Int64 for SS4.2 and AVX2 (aka AVX256) 2022-01-31 12:15:20 +01:00
youenn lebras
c0864e6cd9
Update branch - Merge master 2022-01-31 10:22:25 +01:00
BoloniniD
b04ed43ebd Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-01-30 22:58:04 +03:00
Maksim Kita
5ef83deaa6 Update sort to pdqsort 2022-01-30 19:49:48 +00:00
taiyang-li
e9c435a23f fix style 2022-01-30 13:23:11 +08:00
taiyang-li
c9d5251e12 finish dev 2022-01-30 09:10:27 +08:00
Anton Popov
78b9f15abb Merge remote-tracking branch 'upstream/master' into HEAD 2022-01-30 03:24:37 +03:00
taiyang-li
5228a3e421 commit again 2022-01-29 23:42:04 +08:00
Alexander Tokmakov
fb9b2d5326 Merge branch 'master' into mvcc_prototype 2022-01-28 21:18:36 +03:00
mergify[bot]
81c841a89c
Merge branch 'master' into addressToLineWithInlines 2022-01-28 08:20:48 +00:00
mergify[bot]
ebbfc0fd2f
Merge branch 'master' into remove-decimal-padded-pod-array 2022-01-27 20:12:41 +00:00
alexey-milovidov
5a4ad04ae6
Merge pull request #33505 from zvonand/issue_14648 
Fix fromUnixTimestamp64 functions
 2022-01-27 22:54:53 +03:00
BoloniniD
5c4ac80181 Style check fix 2022-01-27 19:51:11 +03:00
BoloniniD
44591b79ff Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-01-27 19:49:58 +03:00
Maksim Kita
24267c8cfb Fixed tests 2022-01-27 16:02:31 +00:00
Nikolay Degterinsky
c5ca5b608e
Merge pull request #33314 from evillique/classification 
Merge functions for text classification
 2022-01-27 17:15:08 +03:00
mergify[bot]
61ac72ca32
Merge branch 'master' into addressToLineWithInlines 2022-01-27 12:02:56 +00:00
Maksim Kita
af5ad2f370 Remove DecimalPaddedPODArray 2022-01-27 10:07:53 +00:00
Anton Popov
90b74c2aeb better unflattenTuple 2022-01-27 03:24:34 +03:00
zvonand
1384f9e89d moved common code out of template 2022-01-26 20:15:34 +03:00
BoloniniD
6f078c164d Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-01-26 20:11:27 +03:00
RogerYK
6fab7ec882 Merge remote-tracking branch 'upstream/master' into fix-substring-negative-offset-length 2022-01-26 19:42:08 +08:00
zvonand
3879137994 Merge branch 'master' of github.com:ClickHouse/ClickHouse into issue_14648 2022-01-26 12:33:21 +03:00
cmsxbc
c3e541376d
fix style: add pragma once 2022-01-26 00:47:43 +08:00
cmsxbc
4c34d8f563
fix function names 2022-01-26 00:30:27 +08:00
cmsxbc
4d7073ceed
1. generic addressToLine and addressToLineWithInlines, 2. improve addressToLineWithInlines document 2022-01-26 00:20:19 +08:00
cmsxbc
58dd1a2d5c
add function addressToLineWithInlines 2022-01-25 19:13:47 +08:00
Nikolay Degterinsky
5edbae6734 Merge branch 'master' into classification 2022-01-25 10:22:47 +00:00
Kruglov Pavel
ed43abbaeb
Update FunctionsConversion.h 2022-01-25 12:32:21 +03:00
avogar
ad01d68f36 Fix parsing IPv6 from query parameter and fix IPv6 to string conversion 2022-01-25 10:09:17 +03:00
zvonand
3594cdbeeb updated dt64 value return 2022-01-23 23:06:32 +03:00
zvonand
86cc9419ba Merge branch 'master' of github.com:ClickHouse/ClickHouse into issue_14648 2022-01-23 22:30:31 +03:00
Maksim Kita
818966c1a2
Merge pull request #33921 from bharatnc/ncb/h3-improve 
explicitly checkAndGetColumn for remaining H3 funcs
 2022-01-23 18:08:30 +01:00
bharatnc
6faad9366b fix tests 2022-01-23 06:29:57 -08:00
Maksim Kita
711451f497
Merge pull request #33916 from kitaisreal/function-math-unary-remove-macro 
FunctionMathUnary remove macro usage
 2022-01-23 13:34:09 +01:00
bharatnc
d91caa0d3f better arg check for h3kRing func 2022-01-23 00:45:40 -08:00
bharatnc
12d135346c fix build 2022-01-22 23:48:53 -08:00
bharatnc
59ecdeb3ef fixes to exception message 2022-01-22 23:05:06 -08:00
bharatnc
7d62593bb1 h3 remaining funcs checkAndGetColumn 2022-01-22 23:02:14 -08:00
bharatnc
d2bc0712f7 h3 explicitly checkAndGetColumn 2022-01-22 23:02:14 -08:00
Maksim Kita
333bd24aca Fixed tests 2022-01-23 00:09:29 +00:00
Maksim Kita
4be393fba5 Support cast from Map to Array of Tuple 2022-01-22 20:40:18 +00:00
Maksim Kita
ee146b555f FunctionMathUnary remove macro usage 2022-01-22 18:44:36 +00:00
Maksim Kita
4100512818
Merge pull request #33621 from bharatnc/ncb/h3-misc-funcs 
add h3 misc functions - part 2
 2022-01-22 12:20:06 +01:00
alexey-milovidov
8cabd373e1
Merge pull request #32170 from FrankChen021/hex 
Allows hex() to work on type of UUID
 2022-01-22 13:03:22 +03:00
alexey-milovidov
eb6849f7c7
Merge pull request #33842 from azat/cmake-contrib-fixes 
More cmake external modules cleanups
 2022-01-22 10:34:54 +03:00
bharatnc
9f17706f62 better fix for build failure 2022-01-21 12:36:12 -08:00
bharatnc
526f350ce2 fix build failure 2022-01-21 11:29:16 -08:00
Anton Popov
e8ce091e68 Merge remote-tracking branch 'upstream/master' into HEAD 2022-01-21 20:11:18 +03:00
bharatnc
6f9b82dd2c update src/Functions/h3HexAreaM2.cpp 2022-01-21 08:47:22 -08:00
bharatnc
6de6c1c5bf use UInt8 for resolution 2022-01-21 08:30:48 -08:00
bharatnc
e418bf9f65 update src/Functions/h3EdgeLengthM.cpp 2022-01-21 08:28:31 -08:00
Alexander Tokmakov
e3b1397001 Merge branch 'master' into mvcc_prototype 2022-01-21 18:59:01 +03:00
Kruglov Pavel
daba57a933
Merge pull request #33737 from Avogar/bool-type 
Some improvements and fixes for Bool data type
 2022-01-21 15:24:58 +03:00
Maksim Kita
a7f666c07b FunctionBase64Conversion warning fix 2022-01-21 11:26:39 +00:00
Maksim Kita
ace483fb5b
Merge pull request #33769 from bharatnc/ncb/degrees-radians-funcs 
add DEGREES and RADIANS funcs
 2022-01-21 11:50:11 +01:00
Maksim Kita
1fd79e732b
Merge pull request #33852 from bharatnc/ncb/updates 
updates to min2 and max2 funcs
 2022-01-21 11:37:13 +01:00
RogerYK
93c58c25e0 Fix substring negative offset length 2022-01-21 18:04:59 +08:00
Azat Khuzhin
e81586cd8d contrib/murmurhash: add ALIAS library 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-01-21 10:11:23 +03:00
Azat Khuzhin
dc7affd813 contrib/libmetrohash: add ALIAS library 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-01-21 10:11:23 +03:00
Azat Khuzhin
03fc3895bd contrib/libdivide: add ALIAS library 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-01-21 10:11:23 +03:00
Azat Khuzhin
81880ac20c contrib/consistent-hashing: add ALIAS library 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-01-21 10:11:22 +03:00
Vladimir C
cd75d221cd
Merge pull request #33779 from vdimir/base64enc-arm64 2022-01-21 08:42:50 +03:00
bharatnc
3342c64110 Merge remote-tracking branch 'upstream/master' into ncb/h3-misc-funcs 2022-01-20 20:21:56 -08:00
bharatnc
2bbf8dc9bc updates to min2 and max2 funcs 2022-01-20 15:39:05 -08:00
mergify[bot]
8e7b26bae0
Merge branch 'master' into ncb/degrees-radians-funcs 2022-01-20 22:30:27 +00:00
mergify[bot]
b32e2a8624
Merge branch 'master' into functions-conversion-fix-typo 2022-01-20 17:56:46 +00:00
Maksim Kita
9acba98b77 FunctionsConversion fix typo 2022-01-20 16:21:34 +00:00
Bharat Nallan
adbdc3153a
improvements to tests for h3kRing and h3ToChildren funcs (#33311) 2022-01-20 17:08:13 +03:00
Alexander Tokmakov
0ea0a8ccc7 Merge branch 'master' into mvcc_prototype 2022-01-20 17:05:55 +03:00
Vladimir C
7156e64ee2
Merge pull request #33360 from RogerYK/feat/bitSlice 2022-01-20 16:20:27 +03:00
avogar
2d975057d0 Make result Bool only if arguments contain Bool 2022-01-20 14:16:11 +03:00
avogar
ba54a5ff80 Some improvements and fixes for Bool data type 2022-01-20 14:16:11 +03:00
Azat Khuzhin
b23053d1f6 Remove USE_XXHASH (reduntant) 2022-01-20 10:02:02 +03:00
Azat Khuzhin
66a210410f Fix build w/o hyperscan 2022-01-20 10:02:02 +03:00
Azat Khuzhin
6dcb09f9e1 Cleanup llvm 2022-01-20 10:02:01 +03:00
Azat Khuzhin
3889f79a3d Remove unbundled h3 support 2022-01-20 10:01:59 +03:00
Azat Khuzhin
8cca397fcb Fix config header for functions 2022-01-20 10:01:59 +03:00
Azat Khuzhin
cbf8867f50 Remove unbundled fastops support 2022-01-20 10:01:59 +03:00
Azat Khuzhin
126aa4b65c Remove unbundled base64 support 2022-01-20 10:01:58 +03:00
Azat Khuzhin
133e00a43d Remove unbundled rapidjson support 2022-01-20 10:01:12 +03:00
Azat Khuzhin
db468b6fae Remove unbundled simdjson support 2022-01-20 10:01:12 +03:00
Azat Khuzhin
4524a19391 Remove unbundled ICU support 2022-01-20 10:01:12 +03:00
Azat Khuzhin
48b5c098dd Remove unbundled farmhash support 2022-01-20 10:01:12 +03:00
Azat Khuzhin
f1cc63d900 Remove unbundled cityhash support 2022-01-20 10:01:12 +03:00
Azat Khuzhin
8ede97925e Remove unbundled sparsehash support 2022-01-20 10:01:11 +03:00
Azat Khuzhin
789dfd9f3b Remove unbundled re2 support 
v2: preserve re2_st name to make PVS check pass (since docker image
update fails)
 2022-01-20 10:00:49 +03:00
bharatnc
6e8439e764 review fixes 2022-01-19 22:35:21 -08:00
bharatnc
9c79ba3151 minor fix 2022-01-19 22:18:45 -08:00
bharatnc
cd4d12c443 add degrees and radians funcs 2022-01-19 22:18:44 -08:00
Azat Khuzhin
94ba901fbd Remove unbundled s2geometry support 2022-01-20 08:47:16 +03:00
Azat Khuzhin
cf30669cc9 Remove unbundled openssl/boringssl (crypo/ssl) support 2022-01-20 08:47:16 +03:00
Azat Khuzhin
8485abd52b Remove unbundled lz4 support 2022-01-20 08:47:16 +03:00
Azat Khuzhin
ca8525a733 Remove unbundled zlib support 2022-01-20 08:47:16 +03:00
Alexander Tokmakov
e9a5a64a71 Merge branch 'master' into mvcc_prototype 2022-01-19 21:41:23 +03:00
Maksim Kita
6de52464e5
Merge pull request #33772 from ucasfl/bit-hamming 
rewrite bitHammingDistance with FunctionBinaryArithmetic
 2022-01-19 15:18:05 +01:00
Bharat Nallan
4dd8b65a1c
add h3ToCenterChild function (#33313) 2022-01-19 16:04:23 +03:00
vdimir
34765765ad Use tb64senc for base64Decode on aarch64 2022-01-19 12:00:24 +00:00
Nikolay Degterinsky
8c1c3f0ce8 Small fix 2022-01-19 10:31:04 +00:00
feng lv
53fde56cb7 rewrite bitHammingDistance with FunctionBinaryArithmetic 
fix

fix typo
 2022-01-19 09:07:05 +00:00
bharatnc
a2a5beaedc fix style check 2022-01-18 22:52:13 -08:00
bharatnc
28a7366130 fix spacing 2022-01-18 22:52:13 -08:00
bharatnc
5e58767de8 add check for h3 empty column arguments 2022-01-18 22:52:13 -08:00
Frank Chen
94a2490664
Fix style checking 2022-01-19 10:13:12 +08:00
Nikolay Degterinsky
9d45025c7d Merge branch 'master' into classification 2022-01-18 21:41:03 +00:00
Nikolay Degterinsky
3a414eb1da Fix detectLanguage 2022-01-18 21:32:32 +00:00
Dmitry Novik
43838c1b4c
Merge pull request #33355 from ucasfl/decimal-binary-op 
Enable binary arithmetic between Decimal and Float
 2022-01-18 14:04:26 +03:00
frank chen
3391f3f06e Change the order 
Signed-off-by: frank chen <frank.chen021@outlook.com>
 2022-01-18 14:27:08 +08:00
alexey-milovidov
19fadd8d41
Merge pull request #33707 from kitaisreal/h3-remove-functions-rads-to-degs 
H3 remove functions degsToRads, radsToDegs
 2022-01-18 03:32:38 +03:00
Maksim Kita
110b39add4 H3 remove functions degsToRads, radsToDegs 2022-01-17 14:42:50 +00:00
Nikolay Degterinsky
6424311773 Fix 2022-01-17 10:01:06 +00:00
zvonand
32dc865203 Merge branch 'master' of github.com:ClickHouse/ClickHouse into issue_14648 2022-01-17 11:42:06 +03:00
Maksim Kita
ff15e5af1d Fixed tests 2022-01-16 11:45:36 +00:00
BoloniniD
c14245675c Replace shim methods with one apply_shim 2022-01-16 13:28:07 +03:00
Maksim Kita
0df98140af Functions dictGet, dictHas implicit key cast 2022-01-15 23:25:05 +00:00
bharatnc
3660438325 Merge remote-tracking branch 'upstream/master' into ncb/h3-misc-funcs 2022-01-14 16:46:17 -08:00
Mikhail Artemenko
698364f7b0 add tests 2022-01-14 20:58:56 +03:00
Alexander Tokmakov
4dd216ce8f Merge branch 'master' into mvcc_prototype 2022-01-14 17:11:32 +03:00
bharatnc
8b10bd9221 fix style check 2022-01-14 00:52:02 -08:00
bharatnc
9f35c0affc fix res type in various funcs 2022-01-14 00:44:18 -08:00
bharatnc
f303e0b23b fix return type 2022-01-14 00:20:34 -08:00
bharatnc
f0bffbfee5 check max H3 resolution 2022-01-14 00:11:52 -08:00
bharatnc
a680604335 add h3NumHexagons func 2022-01-14 00:02:41 -08:00
bharatnc
c9aca0d7c6 add h3ExactEdgeLengthRads func 2022-01-13 23:42:56 -08:00
bharatnc
905d4abdd6 add h3ExactEdgeLengthKm func 2022-01-13 23:40:07 -08:00
bharatnc
e4d8b60745 add column check for h3EdgeLengthKm 2022-01-13 22:25:17 -08:00
bharatnc
2d6801aa95 add h3ExactEdgeLengthM func 2022-01-13 21:05:54 -08:00
bharatnc
a037d286fb add func h3EdgeLengthKm 2022-01-13 19:19:23 -08:00
BoloniniD
bd0e2e3c80 Remove memcpy by using OutputReader.fill() 2022-01-13 19:17:23 +03:00
mergify[bot]
48f8706869
Merge branch 'master' into comp-decimal-float 2022-01-13 04:33:28 +00:00
feng lv
abea81789e fix and add more tests 2022-01-13 03:25:01 +00:00
Nikolay Degterinsky
1c24667f20 Refactor 2022-01-12 16:49:21 +00:00
BoloniniD
b486f9462b Fix the memory leak 2022-01-12 18:28:30 +03:00
RogerYK
1dd903f28d fix undefined behavior 2022-01-12 19:13:08 +08:00
RogerYK
b6e40427a0 fix style 2022-01-11 23:35:34 +08:00
RogerYK
8707e3bea1 make implementation clear and add more test 2022-01-11 23:22:16 +08:00
feng lv
bf0a6570c0 Merge branch 'decimal-binary-op' of https://github.com/ucasfl/ClickHouse into decimal-binary-op 2022-01-11 12:28:25 +00:00
feng lv
655cf6c315 fix 2022-01-11 12:27:21 +00:00
Maksim Kita
a9f389d546
Merge pull request #33512 from kitaisreal/h3-funcs-bad-arguments-possible-crash-fix 
H3 functions bad arguments possible crash fix
 2022-01-11 12:31:57 +03:00
Kruglov Pavel
eb65175b6b
Merge pull request #33504 from ClickHouse/fix_nested_lc_default 
Fix insert into defalut nested LowCardinality column.
 2022-01-11 12:15:27 +03:00
Maksim Kita
ca5e08cef6 H3 functions bad arguments possible crash fix 2022-01-11 11:21:56 +03:00
bharatnc
01f9370d6e fix variable name in h3 misc funcs 2022-01-10 22:41:41 -08:00
Nikolay Degterinsky
85b8985df2 Better 2022-01-10 20:30:26 +00:00
BoloniniD
82027176f1 Move BLAKE3 tests away from fasttest + add USE_BLAKE3 key to CMakeLists 2022-01-10 23:12:33 +03:00
BoloniniD
ab20d8b45f Change test reference to uppercase 2022-01-10 23:12:33 +03:00
BoloniniD
bd1c9fd3c7 Fix FunctionsHashing.h 2022-01-10 23:12:33 +03:00
BoloniniD
a50530f061 Add cargo to fasttest + fixes 2022-01-10 23:12:32 +03:00
BoloniniD
921f456251 Add tests for BLAKE3 - WIP 2022-01-10 23:12:32 +03:00
zvonand
3c0acbfbbf Fix fromUnixTimestamp64...() functions 2022-01-10 22:41:05 +03:00
Nikolai Kochetov
776bb0b02c Fix insert into defalut nested LowCardinality column. 2022-01-10 21:30:28 +03:00
Alexander Tokmakov
bf2b6c2c37 Merge branch 'master' into mvcc_prototype 2022-01-10 19:53:50 +03:00
zvonand
ed0f7adb1e Modified type check for fromUnixTimestamp64 2022-01-10 13:15:26 +03:00
mergify[bot]
664eb7d456
Merge branch 'master' into decimal-binary-op 2022-01-10 07:14:56 +00:00
feng lv
8346057be6 fix 2022-01-10 03:05:45 +00:00
bharatnc
fe0e2af033 remove some extra vertical spaces 2022-01-09 09:12:30 -08:00
bharatnc
ab518b282c use checkAndGetColumn to get columns explicitly 2022-01-09 09:08:52 -08:00
feng lv
b06211fb03 fix 
fix
 2022-01-09 16:32:31 +00:00
bharatnc
1a98c34c98 fix formatting 2022-01-08 15:38:52 -08:00
bharatnc
cced75732a add h3CellAreaRads2 func 2022-01-08 15:23:46 -08:00
bharatnc
deb2ed649a add h3CellAreaM2 func 2022-01-08 15:23:46 -08:00
bharatnc
fb3ad4e0fc add h3HexAreaToKm2 func 2022-01-08 15:23:46 -08:00
bharatnc
3e84a4ee81 add func h3RadsToDegs 2022-01-08 15:23:45 -08:00
bharatnc
70288074e8 change input arg to Float64 2022-01-08 15:23:45 -08:00
bharatnc
c0fa31f28e fix return stmt 2022-01-08 15:23:45 -08:00
bharatnc
d0fd19f28c add h3DegsToRads func 2022-01-08 15:23:45 -08:00
Maksim Kita
ff645a062a
Merge pull request #33465 from kitaisreal/function-array-last-index 
Added function arrayLastIndex
 2022-01-08 23:08:04 +03:00
feng lv
442a183ec2 fix 
fix
 2022-01-08 14:17:53 +00:00
Maksim Kita
d6df9d6621 Added function arrayLastIndex 2022-01-08 11:37:31 +03:00
Maksim Kita
4141246c13 Function monthName small fix 2022-01-08 11:04:22 +03:00
alexey-milovidov
df2fede98b
Update decodeURLComponent.cpp 2022-01-08 07:21:12 +03:00
mergify[bot]
905d5be288
Merge branch 'master' into add-decodeURLFormComponent 2022-01-08 01:22:40 +00:00
alexey-milovidov
140d64f785
Merge pull request #33415 from kitaisreal/function-array-last 
Added function arrayLast
 2022-01-07 20:37:06 +03:00
usurai
d4116d8de2 Fix case style 2022-01-07 23:47:21 +08:00
Maksim Kita
6b9703446d Added function arrayLast 2022-01-07 16:37:21 +03:00
cmsxbc
37349a9d0f
add function decodeURLFormComponent 2022-01-07 20:51:30 +08:00
usurai
9fd8b99b7c Remove maybe_unused 2022-01-07 13:23:22 +08:00
usurai
76848e7a2a Use FunctionFactory to invoke dateName 2022-01-07 13:06:47 +08:00
usurai
aaa45beba1 Revert "Move dataName.cpp to dateName.h" 
This reverts commit f919bb8664.
 2022-01-07 09:45:34 +08:00
usurai
e849ea4294 Revert "Add monthName" 
This reverts commit c0892f6e6c.
 2022-01-07 09:45:27 +08:00
usurai
c0892f6e6c Add monthName 2022-01-07 00:32:38 +08:00
usurai
f919bb8664 Move dataName.cpp to dateName.h 2022-01-07 00:11:54 +08:00
Alexey Milovidov
6157f73fb5 Fix UBSan 2022-01-05 22:15:22 +03:00
Alexey Milovidov
eb80dfebf2 Fix style 2022-01-05 07:12:20 +03:00
Alexey Milovidov
c4713ee34b Normalize left, right, leftUTF8, rightUTF8 functions 2022-01-05 06:46:31 +03:00
Alexey Milovidov
bf59114cee Make "left" and "right" real functions 2022-01-05 05:32:40 +03:00
RogerYK
86db17e70f Add comment and docs 2022-01-03 16:31:11 +08:00
Alexey Milovidov
cab5f4fe1e Merge with master 2022-01-03 02:07:08 +03:00
Amos Bird
0b7a94c2be Saturate date/datetime to zero 2022-01-03 02:07:08 +03:00
RogerYK
f2e5399c61 Add function bitSlice for String and FixedString 2022-01-02 18:49:09 +08:00
feng lv
48c0b41ad5 Enable binary arithmetic between Decimal and Float 
fix
 2022-01-01 09:11:21 +00:00
Alexander Tokmakov
0d91887cdc save versions of parts 2021-12-30 16:15:28 +03:00
Nikolay Degterinsky
fce10091a9 Merge branch 'master' into classification 2021-12-30 10:34:06 +00:00
Nikolay Degterinsky
3dfba6f223 Fix style 2021-12-30 03:46:57 +00:00
Nikolay Degterinsky
b9a75bc39c Fix build 2021-12-30 03:15:21 +00:00
Nikolay Degterinsky
2bdee0b0b8 Merge branch 'master' into classification 2021-12-30 02:17:47 +00:00
Nikolay Degterinsky
ba0083736e Change DetectLanguageMixed output type 2021-12-30 02:14:57 +00:00
vdimir
154e7b03c0
Disable FunctionConvertFromString::canBeExecutedOnDefaultArguments 2021-12-29 13:34:54 +03:00
Alexander Tokmakov
8aec3ae94f Merge branch 'master' into mvcc_prototype 2021-12-28 14:24:36 +03:00
Mikhail Artemenko
58dd32b07b add meiliMatch function 2021-12-28 12:23:39 +03:00
feng lv
5e23126f28 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into decimal-binary-op 2021-12-26 09:24:18 +00:00
feng lv
a32513fd46 fix 2021-12-26 09:23:42 +00:00
feng lv
6734b592bb decimal plus float 2021-12-26 09:04:12 +00:00
mergify[bot]
f5a7e58cb0
Merge branch 'master' into comp-decimal-float 2021-12-26 07:13:00 +00:00
alexey-milovidov
4d99f1016d
Merge pull request #33146 from CurtizJ/fix-column-sparse 
Fix functions with sparse arguments in case when result type doesn't support sparse serialization
 2021-12-25 06:28:19 +03:00
alexey-milovidov
26a735c52f
Merge pull request #32984 from Avogar/bool-type 
Improve Bool data type
 2021-12-25 06:22:54 +03:00
Anton Popov
c37f1c40be fix functions with sparse arguments 2021-12-24 19:39:50 +03:00
Alexey Milovidov
29d28c531f Move code around to avoid dlsym on Musl 2021-12-24 12:25:27 +03:00
feng lv
148fbb82ad fix 
fix comment
 2021-12-24 05:25:23 +00:00
feng lv
80c5bfcbcb fix 
fix
 2021-12-24 05:13:12 +00:00
avogar
85d214d560 Fix build 2021-12-23 20:14:54 +03:00
avogar
2e02a6bcca Try to fix build 2021-12-23 19:47:29 +03:00
avogar
ce68c54b03 Fix comments, reduce extra copying 2021-12-23 19:47:29 +03:00
avogar
5e5d6609ed Proper cast to bool 2021-12-23 19:47:29 +03:00
avogar
19faf46b68 Improve Bool data type 2021-12-23 19:47:29 +03:00
Nikolay Degterinsky
52b18b0c56 Refactor 2021-12-23 14:10:12 +00:00
mergify[bot]
caf19e66e3
Merge branch 'master' into hex 2021-12-23 09:00:29 +00:00
feng lv
dc6f7858f8 refactor 2021-12-23 03:55:40 +00:00
Alexander Tokmakov
b7184732d5 Merge branch 'master' into mvcc_prototype 2021-12-22 19:46:09 +03:00
tavplubix
c297c2c4c3
Revert "Dictionaries added Date32 type support" 2021-12-22 19:41:52 +03:00
Maksim Kita
97b0a343f8
Merge pull request #32971 from kitaisreal/dictionaries-added-date32-type-support 
Dictionaries added Date32 type support
 2021-12-22 19:22:01 +03:00
mergify[bot]
7da6d8b310
Merge branch 'master' into fix_IP_conversion 2021-12-21 12:16:05 +00:00
Alexander Tokmakov
9cd49bc0ec Merge branch 'master' into mvcc_prototype 2021-12-20 22:06:22 +03:00
Maksim Kita
dd0d3de050
Merge pull request #32970 from kitaisreal/loops-remove-postfix-increment 
Loops remove postfix increment
 2021-12-20 19:51:07 +03:00
Maksim Kita
02b6ad52ef FunctionThrowIf fixed exception 2021-12-20 16:55:15 +03:00
Maksim Kita
60d4295d8a FunctionThrowIf added comment 2021-12-20 16:00:43 +03:00
Maksim Kita
51477adf1b Updated additional cases 2021-12-20 15:55:07 +03:00
Maksim Kita
20e4ce3314 Short circuit evaluation function throwIf support 2021-12-20 14:49:05 +03:00
Maksim Kita
51826c14a0 Dictionaries added Date32 type support 2021-12-20 13:39:07 +03:00
Maksim Kita
7785eac384 Loops remove postfix increment 2021-12-20 13:32:13 +03:00
Maksim Kita
2eb9b3118e
Merge pull request #32805 from kitaisreal/cache-dictionary-dictionary-source-access-race-fix 
CacheDictionary dictionary source access race fix
 2021-12-20 12:50:16 +03:00
bharatnc
b9787f730e use prefix increment for rows 2021-12-19 20:32:52 -08:00
bharatnc
15c555c161 simplify looping in S2 functions 
Previously replaced range based for loops in H3 functions with simple
for loops based on review. Similarly doing the same for the S2 functions
also.
 2021-12-19 20:00:28 -08:00
alexey-milovidov
13d1377ad7
Update src/Functions/ReplaceRegexpImpl.h 
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
 2021-12-19 12:59:28 +03:00
Alexey Milovidov
0d6e8e90eb Proper fix for #30245 2021-12-19 12:44:42 +03:00
alexey-milovidov
cee850b3be
Revert "fix replaceRegexpAll bug" 2021-12-19 11:32:34 +03:00
Anton Popov
99ebabd822 Merge remote-tracking branch 'upstream/master' into HEAD 2021-12-17 19:02:29 +03:00
alesapin
6bd7e425c6
Merge pull request #22535 from CurtizJ/sparse-serialization 
Sparse serialization and ColumnSparse
 2021-12-17 15:26:17 +03:00
Alexander Tokmakov
32e62ed5c2 Merge branch 'master' into mvcc_prototype 2021-12-17 10:43:46 +03:00
Anton Popov
079b08a28a support nested in json type (wip) 2021-12-16 14:42:12 +03:00
alexey-milovidov
5293555d4d
Merge pull request #31797 from aiven/kmichel-fix-base64encode-too-fast 
Fix base64Encode adding trailing bytes on small strings
 2021-12-16 01:35:22 +03:00
mergify[bot]
41ae7c8eb1
Merge branch 'master' into fix_IP_conversion 2021-12-15 19:19:47 +00:00
Dmitry Novik
64b0365848 Fix build 2021-12-15 20:40:36 +03:00
Maksim Kita
ac3cb8c12b CacheDictionary dictionary source access race fix 2021-12-15 15:55:28 +03:00
mergify[bot]
4300f77532
Merge branch 'master' into fix_IP_conversion 2021-12-14 20:12:34 +00:00
Alexander Tokmakov
d7ad72838c Merge branch 'master' into mvcc_prototype 2021-12-14 23:07:52 +03:00
Anton Popov
16312e7e4a Merge remote-tracking branch 'upstream/master' into HEAD 2021-12-14 18:58:17 +03:00
cmsxbc
0b4a9ebce0
fix fuzzbits with multiply same fixedstring 2021-12-14 23:26:18 +08:00
youenn lebras
c2b761acf2
Add cmake option to enable or not AVX2 instructions 
This reverts commit bca8eca44fe382b6efe80a381d42e6ede8a91fa3.
 2021-12-14 09:45:03 +01:00
youenn lebras
72fb56904d
Add cmake option to enable or not AVX2 instructions 2021-12-13 17:57:32 +01:00
Youenn Lebras
2a2eb3a27b
re-enable full AVX2 
- change lddqu to loadu
 - Update CmakeList.txt
 2021-12-13 17:57:32 +01:00
Youenn Lebras
a810ce5dcb
Remove AVX2 to figure out where is the illegal intruction 
Enable AVX2 - int32
 2021-12-13 17:57:31 +01:00
Youenn Lebras
62487fe2fc
Pass SSE version to 4.2 and exploiting it's specific loadu 2021-12-13 17:57:31 +01:00
Youenn Lebras
13878d2618
Modify include files according to the processors capabilities 2021-12-13 17:57:29 +01:00
Jakub Kuklis
a3c08acac3
Moving sliceHasImplAnyAll and sliceEqualElements to separate header files to avoid SIMD instructions bloat in Algorithms.h 2021-12-13 17:57:28 +01:00
Jakub Kuklis
169c49c583
Correcting style and resolving warnings 2021-12-13 17:57:28 +01:00
Jakub Kuklis
7dbb217a9a
Correcting { placement 2021-12-13 17:57:27 +01:00
Jakub Kuklis
763bd006a7
Correcting new hasAll implementation for the case with null elements present in 'second' and absent in 'first', refactoring the outer loop remainder into a separate function, improving null checking in the default implementation 2021-12-13 17:57:27 +01:00
Jakub Kuklis
439082aa98
Adding a null map negative test, the new hasAll implementation needs correction for that case 2021-12-13 17:57:26 +01:00
Jakub Kuklis
92ec28a87b
Refactoring the new SIMD hasAll implementation to comply with current hasAll implementation (swapping 'first' and 'second' arguments meaning) and with ClickHouse C++ guidelines 2021-12-13 17:57:26 +01:00
Jakub Kuklis
abecb8114f
Refactoring the hasAll gtest so that it works with the original hasAll 2021-12-13 17:57:25 +01:00
Youenn Lebras
3548e974e1
Implement HasAll specialization for SSE and AVX2 2021-12-13 17:57:21 +01:00
Frank Chen
7cb8171d37
Merge branch 'ClickHouse:master' into hex 2021-12-13 13:24:22 +08:00
Alexey Milovidov
71926a3a97 Fix surprisingly bad code in function "file" 2021-12-13 07:57:54 +03:00
alexey-milovidov
6779196c6b
Merge pull request #32587 from ClickHouse/reinterpret-perf 
Slight performance improvement of "reinterpret" function
 2021-12-12 12:14:43 +03:00
alexey-milovidov
26d606c158
Merge pull request #32456 from ClickHouse/fix-29890 
Fix arraySlice with null args.
 2021-12-12 06:38:17 +03:00
Alexey Milovidov
3b0f026827 Slight performance improvement of "reinterpret" function 2021-12-12 03:29:26 +03:00
vxider
d021e13b8c rename window function name 2021-12-10 09:59:50 +00:00
vxider
52fa82b4d4 rename window-view function to time window function 2021-12-10 09:43:44 +00:00
Nikolai Kochetov
b3bd9e6a37 Fix arraySlice with null args. 2021-12-09 16:31:13 +03:00
Nikolay Degterinsky
2b2ffcc8ea Merge branch 'master' into classification 2021-12-09 11:22:01 +00:00
Anton Popov
d8367334a3 Merge remote-tracking branch 'upstream/master' into HEAD 2021-12-08 18:26:19 +03:00
feng lv
c3c69c5f79 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into comp-decimal-float 2021-12-08 13:15:51 +00:00
mergify[bot]
ed0c36bf32
Merge branch 'master' into rename-window-functions 2021-12-07 21:04:53 +00:00
feng lv
8ab2777dd5 fix 2021-12-07 15:51:47 +00:00
Alexander Tokmakov
7fcb79ae72 Merge branch 'master' into mvcc_prototype 2021-12-07 14:39:29 +03:00
Nikita Mikhaylov
7e036d31e9 One more style related commit 2021-12-07 11:29:46 +00:00
Nikita Mikhaylov
d3d4524390 Merge branch 'master' of github.com:ClickHouse/ClickHouse into get_fuzz_data 2021-12-07 10:32:03 +00:00
vxider
c4c517bb8a rename window functions 2021-12-07 08:14:00 +00:00
Nikita Mikhaylov
fb24e7181f Better 2021-12-06 18:27:06 +00:00
Nikita Mikhaylov
fa22fdc097 Merge branch 'master' of github.com:ClickHouse/ClickHouse into get_fuzz_data 2021-12-06 14:30:49 +00:00
vxider
2f4f2d9d5e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse 2021-12-06 14:06:00 +00:00
frank chen
0b6949172c keep leading zeros for UUID 
Signed-off-by: frank chen <frank.chen021@outlook.com>
 2021-12-06 17:13:32 +08:00
vxider
c522c06755 fix windowview parser 2021-12-04 12:30:04 +00:00
Maksim Kita
2d3f773147 Function accurateCastOrDefault remove separate branch 2021-12-03 13:25:55 +03:00