flynn
9f8dcfca34
Merge branch 'master' into filesystem-function
2022-11-16 23:28:10 +08:00
Duc Canh Le
84aea78d0f
fix array first / last or null with nullable column
2022-11-16 13:11:05 +08:00
李扬
6393d11dab
fix doc
2022-11-16 09:34:45 +08:00
Suzy Wang
97d76771a4
update format
2022-11-15 08:53:39 -08:00
freedomDR
5753be7b99
remove useless head file
2022-11-15 12:33:14 +08:00
freedomDR
7fdb2f400e
unhex support FixedString
2022-11-15 12:33:14 +08:00
taiyang-li
7178d80c51
Merge branch 'function_factorial' of https://github.com/bigo-sg/ClickHouse into function_factorial
2022-11-15 09:46:44 +08:00
taiyang-li
5eba20e119
modify return type from Int64 to UInt64
2022-11-15 09:46:24 +08:00
李扬
10449247fd
Merge branch 'master' into function_factorial
2022-11-15 09:34:43 +08:00
李扬
1de5bb2392
Add function canonicalRand ( #43124 )
...
* add function canonicalRand
* add perf test
* revert rand.xml
2022-11-15 00:27:19 +01:00
李扬
ef45889ecb
Add function pmod which return non-negative result based on modulo ( #42755 )
...
* add function positive_modulo
* add ducument
* fix type deduction of positive_modulo
* add function positive_modulo
* add ducument
* fix type deduction of positive_modulo
* add notice
* fix typo
* fix typo
* fix bug
* fix ub error
* fix ub error
2022-11-15 00:15:58 +01:00
HarryLeeIBM
0133444433
Fix byte order issue of wide integer for s390x
2022-11-14 10:47:32 -08:00
zvonand
0b780346cd
fix typos
2022-11-14 19:26:15 +03:00
zvonand
0a7e4ff3bf
fix asan
2022-11-14 17:52:17 +03:00
AlfVII
3768641bf7
Merge branch 'master' into fix-slow-json-extract-with-low-cardinality
2022-11-14 15:10:03 +01:00
Kruglov Pavel
48e6d39055
Merge pull request #43178 from Avogar/fix-if
...
Fix function if in case of NULL and const Nullable arguments
2022-11-14 14:52:30 +01:00
Alfonso Martinez
769cef9458
Replaced str with chars directly
2022-11-14 11:51:50 +01:00
Roman Vasin
ee0baa679b
Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-623
2022-11-14 09:45:32 +00:00
zvonand
4392d04837
fix zero result
2022-11-14 12:27:31 +03:00
李扬
bf88816da4
Merge branch 'master' into function_factorial
2022-11-14 10:30:41 +08:00
zvonand
2390d59a2b
fix memory access(2)
2022-11-14 03:07:21 +03:00
zvonand
e83deedb25
fix nullptr
2022-11-13 23:07:52 +03:00
zvonand
03bdb93dd9
fix fuzzer(3)
2022-11-13 13:34:33 +03:00
Alexander Gololobov
661c5cd0ae
fixed type
2022-11-12 23:58:09 +01:00
zvonand
1ed5a6c78d
fix fuzzer(2)
2022-11-13 00:27:14 +03:00
Joanna Hulboj
42de468665
Fixed unexpected behaviour of Interval types with subquery and casting
2022-11-12 19:47:06 +00:00
zvonand
fce1573320
ast fix
2022-11-12 02:07:25 +03:00
zvonand
007e883c2b
one more fix
2022-11-12 01:52:36 +03:00
zvonand
faf5185b22
one more fix
2022-11-11 23:59:03 +03:00
Nikolai Kochetov
505af344c4
Merge pull request #42612 from FArthur-cmd/UTC_timestamp
...
Add functions for PowerBI connect
2022-11-11 17:27:29 +01:00
zvonand
142c3d438c
fix
2022-11-11 18:36:11 +03:00
zvonand
8f5e0a7e7a
small datatype update
2022-11-11 17:54:41 +03:00
avogar
5ec748c664
Fix function if in case of NULL and const Nullable arguments
2022-11-11 14:49:49 +00:00
Alfonso Martinez
f24991fa56
Remove pushing a last 0 in FixedStrings
2022-11-11 13:02:30 +01:00
Alfonso Martinez
5d53ec9da8
Cleaned and replace some Strings by using chars directly
2022-11-11 11:07:05 +01:00
Roman Vasin
1f2f457e56
Fix style in function doc
2022-11-11 09:41:55 +00:00
Roman Vasin
67e66e40c3
Fix DateTime64 scale problem in age()
2022-11-11 09:25:08 +00:00
Roman Vasin
35a1c406ad
Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-623
2022-11-11 07:35:44 +00:00
Roman Vasin
61b0c9d77c
Add documentation of age() into code
2022-11-11 07:34:53 +00:00
avogar
9e89af28c6
Refactor BSONEachRow format, fix bugs, support more data types, support parallel parsing and schema inference
2022-11-10 20:15:14 +00:00
Alfonso Martinez
92028756f7
Merge remote-tracking branch 'upstream/master' into fix-slow-json-extract-with-low-cardinality
2022-11-10 17:22:58 +01:00
taiyang-li
f58e960a7d
update as request
2022-11-10 21:07:44 +08:00
Roman Vasin
4962df7efb
Fix quarter
2022-11-10 11:37:57 +00:00
Roman Vasin
8f3a7b5024
Change algorithm into more accurate
2022-11-10 10:27:18 +00:00
Alfonso Martinez
a1fd275209
Fixed duplicated includes
2022-11-10 09:13:52 +01:00
taiyang-li
d76c271242
add missed file
2022-11-10 16:08:22 +08:00
taiyang-li
628019d9d9
Merge branch 'enable_max_splits' of https://github.com/bigo-sg/ClickHouse into enable_max_splits
2022-11-10 10:47:10 +08:00
taiyang-li
c6449a1b23
fix bug
2022-11-10 10:46:51 +08:00
Suzy Wang
6ae4843b6d
Update fixes as suggested
2022-11-09 13:54:32 -08:00
zvonand
90e3aed957
Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-decdiv
2022-11-09 15:05:31 +03:00
李扬
9b2dd49b4a
Merge branch 'master' into enable_max_splits
2022-11-09 15:31:06 +08:00
Suzy Wang
90250ea6ec
s390x ip coding functions fixes
2022-11-08 21:12:47 -08:00
Roman Vasin
44e033680e
Refactor age() function
2022-11-08 16:39:40 +00:00
Nikolay Degterinsky
09aca50c3b
Merge pull request #42195 from evillique/tuple-of-intervals
...
Better INTERVAL parsing and execution
2022-11-08 16:21:39 +01:00
Robert Schulze
2c568df714
Merge pull request #42968 from ClickHouse/bitcast
...
Less use of CH-specific bit_cast()
2022-11-08 10:54:10 +01:00
Vladimir C
c4eb83408f
Merge pull request #37681 from xlwh/display_name
...
closes undefined
2022-11-08 10:53:58 +01:00
李扬
1728f1e436
Merge branch 'master' into enable_max_splits
2022-11-08 10:15:42 +08:00
Nikolay Degterinsky
2b286222f7
Merge branch 'master' into tuple-of-intervals
2022-11-08 00:15:35 +01:00
Roman Vasin
1d8e7728e1
Add age() function
2022-11-07 16:42:46 +00:00
Robert Schulze
58a12300ef
Update src/Functions/FunctionsStringSearch.h
...
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
2022-11-07 16:05:48 +00:00
Robert Schulze
a8098db25d
Minor cleanups
...
Semantics are unchanged.
Some special case handling was changed to early-out, because of that the
indentation changed but the logic is the same as before.
2022-11-07 14:03:46 +00:00
Vladimir C
0481999e35
Fix displayName test, add doc
2022-11-07 14:34:47 +01:00
xlwh
500609ccd3
Add miscellaneous function displayName()
2022-11-07 14:34:47 +01:00
Robert Schulze
cdaf0becfe
Merge branch 'master' into bitcast
2022-11-07 09:24:52 +01:00
李扬
70fd664dd1
Merge branch 'master' into ascii_function
2022-11-07 10:30:10 +08:00
Nikolay Degterinsky
fbf891d375
Merge pull request #42774 from alexon1234/add_format_redable_decimal_size
...
Published formatReadableDecimalSize so it can be used as function
2022-11-05 12:34:20 +03:00
Nikolay Degterinsky
3bcf151a9a
Merge remote-tracking branch 'upstream/master' into tuple-of-intervals
2022-11-04 23:09:43 +00:00
Robert Schulze
9c066e964d
Less use of CH-specific bit_cast()
...
Converted usage of CH-custom bit_cast to std::bit_cast if possible, i.e.
when
sizeof(From) == sizeof(To).
(The CH-custom bit_cast is able to deal with sizeof(From) != sizeof(To).)
Motivation for this came from #42847 where it is not clear how the
internal bit_cast should behave on big endian systems, so we better
avoid that situation as much as possible.
2022-11-04 15:52:48 +00:00
Vitaly Baranov
52b1f4aed9
Merge pull request #42484 from vitlibar/mask-sensitive-info-in-logs
...
Mask some information in logs
2022-11-04 14:09:38 +01:00
Nikolay Degterinsky
16fc05b734
Merge branch 'master' into add_format_redable_decimal_size
2022-11-04 15:02:01 +03:00
Robert Schulze
6df8f7ef25
Merge pull request #42907 from ClickHouse/cleanup-regexpreplace
...
Cleanup implementation of regexpReplace(All|One)
2022-11-04 12:49:44 +01:00
Filatenkov Artur
7afc714b06
Merge branch 'master' into UTC_timestamp
2022-11-04 14:32:44 +03:00
Kruglov Pavel
e9a01a1946
Merge branch 'master' into fix-slow-json-extract-with-low-cardinality
2022-11-04 11:13:46 +01:00
李扬
fccf6c037f
Merge branch 'master' into ascii_function
2022-11-03 22:48:55 -05:00
李扬
e65b0f1c2e
Merge branch 'master' into enable_max_splits
2022-11-03 22:47:15 -05:00
zvonand
a7ab336af2
fixed types
2022-11-03 16:55:14 +03:00
taiyang-li
f39cb41d3e
change as requested
2022-11-03 16:44:57 +08:00
taiyang-li
0df7e95845
improve doc and uts
2022-11-03 16:12:19 +08:00
Alejandro
a1e158993d
Added docs in the function
2022-11-03 09:04:22 +01:00
Alejandro
16bf5458f5
Published formatReadableDecimalSize
2022-11-03 09:04:22 +01:00
taiyang-li
a51a1b4394
rename alphaTokens to SplitByAlphaImpl
2022-11-03 15:06:58 +08:00
taiyang-li
5fa0968bd5
reset to original solution
2022-11-03 15:05:23 +08:00
taiyang-li
e78861ad1c
Merge branch 'master' into enable_max_splits
2022-11-03 14:41:52 +08:00
taiyang-li
6770723027
modify as requested
2022-11-03 12:02:31 +08:00
taiyang-li
aeea21e4d7
Merge branch 'master' into ascii_function
2022-11-03 11:13:20 +08:00
Robert Schulze
494d6ca3df
Cleanup implementation of regexpReplace(All|One)
...
This is a pure refactoring, there are no semantic changes.
Cherry-picked from #42682 .
2022-11-02 15:49:53 +00:00
Vitaly Baranov
e0133688bc
Merge branch 'master' into mask-sensitive-info-in-logs
2022-11-02 16:26:13 +01:00
ltrk2
14141c9071
Add support for FixedString input to base64 functions
2022-11-02 08:14:28 -04:00
FArthur-cmd
84c88ddc91
fix typos
2022-11-01 17:29:15 +00:00
FArthur-cmd
34a33d1821
add documentation for functions
2022-11-01 15:09:05 +00:00
Anton Popov
876dca48da
Merge pull request #36969 from CurtizJ/dynamic-columns-14
...
Support `Object` type inside other types
2022-11-01 15:20:02 +01:00
Kruglov Pavel
c3a7211c1c
Merge pull request #41502 from marcioapm/coercing-json-extract
...
Add coercing in JSONExtract
2022-11-01 14:52:41 +01:00
Alexander Gololobov
f67f0183f6
Merge pull request #42812 from azat/utf8-fix-followup
...
Fix lowerUTF8()/upperUTF8() in case of symbol was in between 16-byte boundary
2022-11-01 12:01:00 +01:00
zvonand
2f1e4bbad7
added documentation
2022-11-01 13:21:17 +03:00
zvonand
83fb05e5ca
Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-decdiv
2022-11-01 09:03:29 +03:00
Zhiguo Zhou
d18d08bcc7
Remove short-circuit evaluation in AssociativeApplierImpl::apply ( #42214 )
...
The short-circuit evaluation was implemented when applying the
saturable operators (and, or) on a vector of ColumnUInt8. However,
its control flow would be compiled as a series of conditional
branch instructions which are hard to predict by the hardware and
at the same time hinder the vectorization optimization by the
compiler. This commit removes the short-circuit and evaluates the
whole expression.
2022-10-31 21:36:15 +01:00
zvonand
46f1847dd9
fix segfaults invalid mem access, add tests
2022-10-31 23:18:08 +03:00
Anton Popov
2ae3cfa9e0
Merge branch 'master' into dynamic-columns-14
2022-10-31 16:15:19 +01:00
Márcio Martins
399d024c2c
Fix array index argument type check for JSONExtract* functions
2022-10-31 15:08:34 +01:00
Márcio Martins
c33bd7794f
Merge branch 'master' into coercing-json-extract
2022-10-31 15:04:48 +01:00
FArthur-cmd
81c1576e61
add tests
2022-10-31 13:03:13 +00:00
Vitaly Baranov
a30bfada63
Wipe passwords from backup logs too.
2022-10-31 10:50:33 +01:00
Alfonso Martinez
9e33b13737
Merge remote-tracking branch 'upstream/master' into fix-slow-json-extract-with-low-cardinality
2022-10-31 08:46:55 +01:00
Azat Khuzhin
5fe44f2736
Fix lowerUTF8()/upperUTF8() in case of symbol was in between 16-byte boundary
...
In lowerUTF8()/upperUTF8() there is an SSE optimization that handles
16 byte at a time, but only for ASCII, for UTF8 symbols converion will
be done by symbol.
Consider the following example:
КВ АМ И СЖ
^ - offset is 15, length of sequence is 2
so first byte of a symbol is in first 16 bytes
second byte of a symbol is not ther
And in this case it will be handled incorrectly because it will try to
process oly these 16 bytes w/o looking forward.
This had been broken by #41286 , before this patch it does not looks at
the row boundaries but only at the string end and so this sutation
wasn't possible.
Fixes : #42756
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-31 08:17:38 +01:00
Azat Khuzhin
32febf5155
Remove dead code in LowerUpperUTF8Impl::array()
...
AFAICS it was there before since it was possible to overrun the
expected_end, since utf8.convert() was called with "src_end - src" not
"expected_end - src".
Refs: 5a21f3908b054a0efc90c65a12fbe151c74d90dc:dbms/include/DB/Functions/FunctionsString.h
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-31 08:00:29 +01:00
Roman Vasin
24a4f4afe7
Merge branch 'master' into ADQM-605
2022-10-30 18:03:07 +03:00
FArthur-cmd
f5417da46b
merge
2022-10-29 08:33:05 +00:00
FArthur-cmd
6cbf50a829
extract common part
2022-10-28 21:06:32 +00:00
Roman Vasin
5755728b33
Add Date32 and DateTime64 into exception messages
2022-10-28 13:11:09 +00:00
Roman Vasin
15f3f56812
Change 1 argument of function to first argument of function etc
2022-10-28 12:44:47 +00:00
zvonand
9e9222862d
fixed division
2022-10-28 15:31:03 +03:00
Alfonso Martinez
c37b154254
Added reverted files and fixes for failing fuzzer tests
2022-10-28 12:37:59 +02:00
Vladimir C
31e8f92cd9
Merge pull request #42664 from ClickHouse/vdimir/followup-42274
2022-10-27 12:20:46 +02:00
Márcio Martins
1ca230ff6d
Allow coercing in JSONExtract* functions
2022-10-27 10:26:55 +02:00
Roman Vasin
09fe9c3ed1
Use {} in exceptions
2022-10-26 16:07:56 +00:00
李扬
04f8f38580
Merge branch 'master' into ascii_function
2022-10-26 07:29:49 -05:00
Nikolai Kochetov
db422fa903
Merge pull request #42410 from ClickHouse/fix-multi-arg-monotonicity
...
Fix possible LOGICAL_ERROR in binary ariphmetics monotonicity.
2022-10-26 14:11:23 +02:00
vdimir
14d0f6457b
Add tests and doc for some url-related functions
2022-10-26 10:52:57 +00:00
李扬
c7e5eb756b
Update src/Functions/ascii.cpp
...
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
2022-10-26 18:18:15 +08:00
李扬
48c37c52e6
Update src/Functions/ascii.cpp
...
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
2022-10-26 18:18:04 +08:00
Alfonso Martinez
348e153455
Merge branch 'fix-corner-case-low-cardinality-string-from-json' into fix-slow-json-extract-with-low-cardinality
2022-10-26 11:53:12 +02:00
Alfonso Martinez
241049763b
Fixed failing tests
2022-10-26 11:50:45 +02:00
taiyang-li
05b77b3e34
fix comment
2022-10-26 16:25:25 +08:00
taiyang-li
fcbc217a7d
enable limits for functions using FunctionTokens
2022-10-26 16:18:32 +08:00
taiyang-li
add5360a1b
implement function ascii
2022-10-26 03:02:00 -05:00
Roman Vasin
3eca9ada3b
Add Date32 to formatDateTIme
2022-10-26 08:00:12 +00:00
Alexey Milovidov
2b4be633ff
Merge branch 'master' into revert-41726-fix-slow-json-extract-with-low-cardinality
2022-10-25 22:57:12 +02:00
ltrk2
2c902bbc65
Implement support for different UUID binary formats ( #42108 )
...
* Implement support for different UUID binary formats
* Declare error codes that the implementation uses
* Make single-argument constructor explicit
* Modernize parts of the solution
* Make improvements based on review comments
* Declare an error code being used
2022-10-25 21:57:50 +02:00
Alfonso Martinez
8ef07bac89
Failing case corrected and test added
2022-10-25 17:40:54 +02:00
Anton Popov
e2ff7aa261
Merge pull request #42623 from CurtizJ/fix-bad-cast
...
Fix bad cast in `arrayElement` with `Map` with `Nullable` values and `Nullable` index
2022-10-25 14:59:52 +02:00
Vladimir C
8fabe1515c
Merge pull request #42274 from dentiscalprum/fix_domain
2022-10-25 13:56:58 +02:00
Nikita Taranov
49f6692a2e
Adapt internal data structures to 512-bit era ( #42564 )
...
* impl
* update tests
* fix tests
2022-10-25 13:56:28 +02:00
Maksim Kita
06fe6f3c8b
Merge pull request #31796 from kitaisreal/identifier-resolver
...
Added Analyzer
2022-10-25 12:36:08 +03:00
Alexey Milovidov
90c62fe46e
Merge branch 'master' into revert-41726-fix-slow-json-extract-with-low-cardinality
2022-10-25 09:31:46 +02:00
Robert Schulze
efd47c9eff
Merge pull request #42476 from ClickHouse/add-datetime-typedefs
...
Add convenience typedefs for Date/Date32/DateTime/DateTime64 columns
2022-10-25 08:45:57 +02:00
Alexey Milovidov
c48127534b
Merge pull request #41753 from pkit/morton_coding
...
add Morton Coding (ZCurve)
2022-10-25 06:10:37 +02:00
Anton Popov
eed21ad4ca
Revert "Low cardinality cases moved to the function for its corresponding type"
2022-10-25 01:30:32 +02:00
Anton Popov
b58ca49f05
fix bad cast in arrayElement with Map and Nullable index
2022-10-24 17:34:46 +00:00
Robert Schulze
655233e1c5
Add convenience typedefs for Date/Date32/DateTime/DateTime64 columns
2022-10-24 16:55:41 +00:00
Sergei Trifonov
bef3c71453
Merge pull request #41726 from AlfVII/fix-slow-json-extract-with-low-cardinality
...
Low cardinality cases moved to the function for its corresponding type
2022-10-24 18:18:40 +02:00
Nikolai Kochetov
14e3bb6354
Another case.
2022-10-24 13:58:26 +00:00
FArthur-cmd
e0c87b2ae2
small fix
2022-10-24 12:53:10 +00:00
FArthur-cmd
93d48a2403
add functions for powerBI connection
2022-10-24 11:04:45 +00:00
Maksim Kita
fe84e871f8
Fixed build
2022-10-24 10:22:20 +02:00
Maksim Kita
504cb2b38f
Added GROUPING function support
2022-10-24 10:22:20 +02:00
Maksim Kita
75885ce2e1
Added Analyzer
2022-10-24 10:22:18 +02:00
Nikolay Degterinsky
6242e93c81
Fixes & better tests
2022-10-24 02:11:08 +00:00
Azat Khuzhin
bcc8d9f9d9
Merge remote-tracking branch 'upstream/master' into build/shorten-64-to-32
...
* upstream/master:
Fix strange code in date monotonicity
Add a test
Fix error
Add tests
Remove trash
2022-10-23 07:45:10 +02:00
Quanfa Fu
b07f65343d
Add functions: domainRFC, topLevelDomainRFC, domainWithoutWWWRFC...
2022-10-23 12:01:26 +08:00
Alexey Milovidov
ebf330ca1a
Merge pull request #42573 from ClickHouse/remove-trash-6
...
Remove trash
2022-10-23 01:31:10 +02:00