Commit Graph

2866 Commits

Author SHA1 Message Date
Alexey Milovidov
29d28c531f Move code around to avoid dlsym on Musl 2021-12-24 12:25:27 +03:00
feng lv
148fbb82ad fix
fix comment
2021-12-24 05:25:23 +00:00
feng lv
80c5bfcbcb fix
fix
2021-12-24 05:13:12 +00:00
avogar
85d214d560 Fix build 2021-12-23 20:14:54 +03:00
avogar
2e02a6bcca Try to fix build 2021-12-23 19:47:29 +03:00
avogar
ce68c54b03 Fix comments, reduce extra copying 2021-12-23 19:47:29 +03:00
avogar
5e5d6609ed Proper cast to bool 2021-12-23 19:47:29 +03:00
avogar
19faf46b68 Improve Bool data type 2021-12-23 19:47:29 +03:00
feng lv
dc6f7858f8 refactor 2021-12-23 03:55:40 +00:00
tavplubix
c297c2c4c3
Revert "Dictionaries added Date32 type support" 2021-12-22 19:41:52 +03:00
Maksim Kita
97b0a343f8
Merge pull request #32971 from kitaisreal/dictionaries-added-date32-type-support
Dictionaries added Date32 type support
2021-12-22 19:22:01 +03:00
mergify[bot]
7da6d8b310
Merge branch 'master' into fix_IP_conversion 2021-12-21 12:16:05 +00:00
Maksim Kita
dd0d3de050
Merge pull request #32970 from kitaisreal/loops-remove-postfix-increment
Loops remove postfix increment
2021-12-20 19:51:07 +03:00
Maksim Kita
02b6ad52ef FunctionThrowIf fixed exception 2021-12-20 16:55:15 +03:00
Maksim Kita
60d4295d8a FunctionThrowIf added comment 2021-12-20 16:00:43 +03:00
Maksim Kita
51477adf1b Updated additional cases 2021-12-20 15:55:07 +03:00
Maksim Kita
20e4ce3314 Short circuit evaluation function throwIf support 2021-12-20 14:49:05 +03:00
Maksim Kita
51826c14a0 Dictionaries added Date32 type support 2021-12-20 13:39:07 +03:00
Maksim Kita
7785eac384 Loops remove postfix increment 2021-12-20 13:32:13 +03:00
Maksim Kita
2eb9b3118e
Merge pull request #32805 from kitaisreal/cache-dictionary-dictionary-source-access-race-fix
CacheDictionary dictionary source access race fix
2021-12-20 12:50:16 +03:00
bharatnc
b9787f730e use prefix increment for rows 2021-12-19 20:32:52 -08:00
bharatnc
15c555c161 simplify looping in S2 functions
Previously replaced range based for loops in H3 functions with simple
for loops based on review. Similarly doing the same for the S2 functions
also.
2021-12-19 20:00:28 -08:00
alexey-milovidov
13d1377ad7
Update src/Functions/ReplaceRegexpImpl.h
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
2021-12-19 12:59:28 +03:00
Alexey Milovidov
0d6e8e90eb Proper fix for #30245 2021-12-19 12:44:42 +03:00
alexey-milovidov
cee850b3be
Revert "fix replaceRegexpAll bug" 2021-12-19 11:32:34 +03:00
alesapin
6bd7e425c6
Merge pull request #22535 from CurtizJ/sparse-serialization
Sparse serialization and ColumnSparse
2021-12-17 15:26:17 +03:00
alexey-milovidov
5293555d4d
Merge pull request #31797 from aiven/kmichel-fix-base64encode-too-fast
Fix base64Encode adding trailing bytes on small strings
2021-12-16 01:35:22 +03:00
mergify[bot]
41ae7c8eb1
Merge branch 'master' into fix_IP_conversion 2021-12-15 19:19:47 +00:00
Dmitry Novik
64b0365848 Fix build 2021-12-15 20:40:36 +03:00
Maksim Kita
ac3cb8c12b CacheDictionary dictionary source access race fix 2021-12-15 15:55:28 +03:00
mergify[bot]
4300f77532
Merge branch 'master' into fix_IP_conversion 2021-12-14 20:12:34 +00:00
Anton Popov
16312e7e4a Merge remote-tracking branch 'upstream/master' into HEAD 2021-12-14 18:58:17 +03:00
cmsxbc
0b4a9ebce0
fix fuzzbits with multiply same fixedstring 2021-12-14 23:26:18 +08:00
Alexey Milovidov
71926a3a97 Fix surprisingly bad code in function "file" 2021-12-13 07:57:54 +03:00
alexey-milovidov
6779196c6b
Merge pull request #32587 from ClickHouse/reinterpret-perf
Slight performance improvement of "reinterpret" function
2021-12-12 12:14:43 +03:00
alexey-milovidov
26d606c158
Merge pull request #32456 from ClickHouse/fix-29890
Fix arraySlice with null args.
2021-12-12 06:38:17 +03:00
Alexey Milovidov
3b0f026827 Slight performance improvement of "reinterpret" function 2021-12-12 03:29:26 +03:00
vxider
d021e13b8c rename window function name 2021-12-10 09:59:50 +00:00
vxider
52fa82b4d4 rename window-view function to time window function 2021-12-10 09:43:44 +00:00
Nikolai Kochetov
b3bd9e6a37 Fix arraySlice with null args. 2021-12-09 16:31:13 +03:00
Anton Popov
d8367334a3 Merge remote-tracking branch 'upstream/master' into HEAD 2021-12-08 18:26:19 +03:00
feng lv
c3c69c5f79 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into comp-decimal-float 2021-12-08 13:15:51 +00:00
mergify[bot]
ed0c36bf32
Merge branch 'master' into rename-window-functions 2021-12-07 21:04:53 +00:00
feng lv
8ab2777dd5 fix 2021-12-07 15:51:47 +00:00
Nikita Mikhaylov
7e036d31e9 One more style related commit 2021-12-07 11:29:46 +00:00
Nikita Mikhaylov
d3d4524390 Merge branch 'master' of github.com:ClickHouse/ClickHouse into get_fuzz_data 2021-12-07 10:32:03 +00:00
vxider
c4c517bb8a rename window functions 2021-12-07 08:14:00 +00:00
Nikita Mikhaylov
fb24e7181f Better 2021-12-06 18:27:06 +00:00
Nikita Mikhaylov
fa22fdc097 Merge branch 'master' of github.com:ClickHouse/ClickHouse into get_fuzz_data 2021-12-06 14:30:49 +00:00
vxider
2f4f2d9d5e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse 2021-12-06 14:06:00 +00:00
vxider
c522c06755 fix windowview parser 2021-12-04 12:30:04 +00:00
Maksim Kita
2d3f773147 Function accurateCastOrDefault remove separate branch 2021-12-03 13:25:55 +03:00
Azat Khuzhin
344298f403 Fix CAST from Nullable with cast_keep_nullable
UBsan report [1]:

    SELECT toUInt32OrDefault(toNullable(0)) SETTINGS cast_keep_nullable = 1

    ../src/Common/assert_cast.h:50:12: runtime error: downcast of address 0x000029461170 which does not point to an object of type 'const DB::ColumnNullable'
    0x000029461170: note: object is of type 'DB::ColumnVector<unsigned int>'
     00 00 00 00  a0 51 3d 09 00 00 00 00  01 00 00 00 00 00 00 00  a0 3f 4e 29 00 00 00 00  a4 3f 4e 29
                  ^~~~~~~~~~~~~~~~~~~~~~~
                  vptr for 'DB::ColumnVector<unsigned int>'
        0 0x1e3e279d in DB::ColumnNullable const& assert_cast<DB::ColumnNullable const&, DB::IColumn const&>(DB::IColumn const&) obj-x86_64-linux-gnu/../src/Common/assert_cast.h:50:12
        1 0x1e3e279d in DB::ColumnNullable::insertRangeFrom(DB::IColumn const&, unsigned long, unsigned long) obj-x86_64-linux-gnu/../src/Columns/ColumnNullable.cpp:167:43
        2 0x12db4507 in DB::FunctionCastOrDefault::executeImpl() const (/src/ch/tmp/32019/clickhouse-ubsan+0x12db4507)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/32019/9e1222a50b1805f696f4205e451365f8acdbc8a5/fuzzer_astfuzzerubsan,actions//report.html

And w/o -fsanitize=undefined:

    SELECT toUInt32OrDefault(toNullable(1), toNullable(toUInt32(1))) SETTINGS cast_keep_nullable = 1

    Received exception:
    Code: 12. DB::Exception: Parameters start = 0, length = 1 are out of bound in ColumnVector<T>::insertRangeFrom method (data.size() = 0).: While processing toUInt32OrDefault(toNullable(1), toNullable(toUInt32(1))). (PARAMETER_OUT_OF_BOUND)
2021-12-03 02:02:42 +03:00
Maksim Kita
2d359a5e79
Merge pull request #32110 from bharatnc/ncb/h3-func-looping
make looping in H3 funcs uniform
2021-12-02 13:15:36 +03:00
Maksim Kita
a426ed0a5a
Merge pull request #31800 from kitaisreal/dict-get-with-type-nullable-fix
Function dictGet with type Nullable fix
2021-12-02 12:27:47 +03:00
bharatnc
5614be28ef make looping in H3 funcs uniform
Some of the H3 funcs use `collections::range(0, input_rows_count)`
and some just use simple for loop for iterating over the rows.

In my recent PR reviews, I've been requested to use for loop in favor of
collections in the H3 functions and have been wanting to make the switch
for other functions too to make them uniform

This PR replaces `collections::range` with a simple for loop for this
kind of iteration in the remaining H3 funcs.
2021-12-01 18:14:08 -08:00
Anton Popov
54f51444c0 Merge remote-tracking branch 'upstream/master' into HEAD 2021-12-01 15:49:02 +03:00
Kruglov Pavel
cbfd77a394
Merge pull request #31839 from loneylee/master
Fix a bug about function transform with decimal args
2021-12-01 12:56:41 +03:00
Kseniia Sumarokova
3c348a2998
Merge pull request #8331 from Vxider/window-view
Support for Stream Processing
2021-11-30 18:20:12 +03:00
feng lv
f27699ccda Enable comparison betwwen Decimal and Float
add tests

update test
2021-11-30 03:29:49 +00:00
loneylee
496c3acd1c
Merge branch 'ClickHouse:master' into master 2021-11-29 15:15:23 +08:00
loneylee
fb159c0227 fix pr's bug @31839 2021-11-29 15:14:27 +08:00
Alexey Milovidov
0e07fe1002 Fix error 2021-11-28 07:18:00 +03:00
Alexey Milovidov
e865b49293 Merge branch 'master' into fix-decrypt-nullable 2021-11-28 06:12:06 +03:00
vxider
98740eec2e fix AST Fuzzer 2021-11-27 17:53:43 +00:00
vxider
d3a68c1498 update code style 2021-11-27 14:46:43 +00:00
vxider
f9a0b1aa13 fix AST Fuzzer 2021-11-27 08:38:53 +00:00
alexey-milovidov
d9292395e8
Merge pull request #31832 from ClickHouse/strange-code-typelist
Fix the issue that LowCardinality of Int256 cannot be created.
2021-11-27 00:36:56 +03:00
alexey-milovidov
75ac0f72bc
Merge pull request #31883 from CurtizJ/fix-empty-uuid
Fix function `empty` with `UUID` type
2021-11-27 00:23:47 +03:00
vxider
d95d181cbe fix code style 2021-11-26 18:30:22 +00:00
Vxider
71d9d80275 timezone support for Tumble/Hop Start/End 2021-11-26 18:03:41 +00:00
Raúl Marín
051dddd8df Reduce dependencies on ASTIdentifier.h
Goes from rebuilding 483 objects to 165 when it's modified
2021-11-26 16:49:40 +01:00
Anton Popov
7237343fd6 fix function 'empty' with uuid type 2021-11-26 17:39:29 +03:00
loneylee
56307bb2fa issue #29730 2021-11-26 10:05:31 +08:00
kssenii
223048d395 Merge branch 'master' of github.com:ClickHouse/ClickHouse into vxider-window-view 2021-11-26 01:06:06 +03:00
Alexey Milovidov
85cec911be Fix strange code in TypeList 2021-11-25 23:55:02 +03:00
Maksim Kita
1fa57c96b2 FunctionsExternalDictionaries removed areTypesEqual 2021-11-25 19:06:37 +03:00
Kevin Michel
8356d44c70
Fix base64Encode returning corrupted data
The "fast" mode of turbo base64 seem to go too fast on small strings,
disabling the AVX2 optimisation for small string fixes the problem.

See the test named 02113_base64encode_trailing_bytes.sql for an example
of a failing case (only applies when running on a CPU with the AVX2
instruction set).

Ref. 15e044269d/turbob64.h (L106-L111)
2021-11-25 15:24:11 +01:00
Maksim Kita
a480eb89ef Function dictGet with type Nullable fix 2021-11-25 17:06:35 +03:00
Alexey Milovidov
a4e57228cf Add a test from #31662 2021-11-24 23:09:50 +03:00
Alexey Milovidov
bd1964a2eb Fix exception on some of the applications of "decrypt" function on Nullable columns 2021-11-24 16:46:20 +03:00
yandd
7b43608e1f
Fixed function ngrams 2021-11-24 21:18:38 +08:00
Kruglov Pavel
b63b47f0f0
Merge pull request #31265 from Avogar/fix-write-buffers
Fix and refactor WriteBiffer-s a little
2021-11-23 16:46:09 +03:00
Alexey Milovidov
c5fcef03c3 Remove trash 2021-11-21 18:12:05 +03:00
Kruglov Pavel
d9c1a0c8ec
Merge branch 'master' into fix-write-buffers 2021-11-20 17:48:24 +03:00
kssenii
29978f9707 Merge branch 'master' of github.com:ClickHouse/ClickHouse into vxider-window-view 2021-11-20 12:13:39 +03:00
kssenii
9bdad8ab64 Rewrite from DataStreams to Processors 2021-11-19 16:09:12 +03:00
kssenii
6a39d871b2 Merge branch 'master' of github.com:ClickHouse/ClickHouse into vxider-window-view 2021-11-18 17:29:11 +03:00
kssenii
11ab1f1ae5 Fix 2021-11-18 08:46:31 +00:00
kssenii
4016530b99 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into sql-json-fix-2 2021-11-18 08:33:50 +00:00
Kruglov Pavel
f27fcf8372
Merge pull request #31004 from Avogar/output-formats
Small refactoring in formats
2021-11-17 20:44:46 +03:00
avogar
c521a9131a Small refactoring of WriteBiffer-s 2021-11-11 02:11:18 +03:00
mergify[bot]
4f6fd49266
Merge branch 'master' into fix_IP_conversion 2021-11-09 12:11:54 +00:00
Dmitry Novik
406bb4d997
Merge pull request #28965 from nicelulu/issues_28774
128bit hash-functions accepting arbitrary list of arguments
2021-11-09 14:40:25 +03:00
Anton Popov
66973a2a28 Merge remote-tracking branch 'upstream/master' into HEAD 2021-11-08 21:27:45 +03:00
kssenii
ab44123f49 Fix 2021-11-08 13:00:42 +03:00
kssenii
9cfa2c4578 Merge branch 'master' of github.com:ClickHouse/ClickHouse into sql-json-fix-2 2021-11-04 13:04:00 +03:00
avogar
2dd4393ca1 Small refactoring in formats 2021-11-03 20:07:05 +03:00
kssenii
ae8a451cef Merge branch 'master' of github.com:ClickHouse/ClickHouse into sql-json-fix-2 2021-11-03 14:37:50 +03:00
Vitaly Baranov
1f217aeb5a
Merge pull request #30998 from vitlibar/rename-access-control-manager
Rename AccessControlManager
2021-11-03 12:20:17 +03:00
Anton Popov
2a617e6a5a
Merge pull request #31003 from kssenii/sql-json-fix
Allow spaces in JSONPath.
2021-11-03 00:59:54 +03:00
kssenii
79bb4fdba4 Fix 2021-11-02 21:57:36 +03:00
kssenii
01684ad05a Fix 2021-11-02 16:53:47 +03:00
avogar
62c5951dd7 Fix segfault in formatRow function 2021-11-02 16:26:14 +03:00
Vitaly Baranov
afe2c9c040 Rename AccessControlManager -> AccessControl. 2021-11-02 14:06:20 +03:00
Vitaly Baranov
3ed7f8f0b3 Move access-rights' source files needed for parser to a separate target. 2021-11-01 19:13:49 +03:00
Anton Popov
d50137013c Merge remote-tracking branch 'upstream/master' into HEAD 2021-11-01 16:55:53 +03:00
Vladimir C
9d967e9883
Merge pull request #30840 from nickitat/nickitat_any_type_4_arrayStringConcat 2021-11-01 11:48:45 +03:00
alexey-milovidov
b18e5fcfe4
Merge branch 'master' into issues_28774 2021-10-31 15:07:26 +03:00
Kseniia Sumarokova
2050d0a33d
Merge pull request #30793 from lingtaolf/feature/function_mapExtractKeyLike
Add  new function mapExtractKeyLike
2021-10-29 21:54:39 +03:00
凌涛
921bdbdd7d
Update src/Functions/map.cpp
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
2021-10-29 14:51:34 +08:00
Nickita Taranov
734bb5b026 support any serializable column 2021-10-28 23:17:45 +03:00
alexey-milovidov
69bc2a8d2a
Merge pull request #30780 from ClickHouse/remove-cruft
Remove cruft
2021-10-28 17:42:18 +03:00
凌涛
39322cdbe2 add a new function mapExtractKeyLike 2021-10-28 17:15:32 +08:00
Kseniia Sumarokova
fba0e11cff
Merge pull request #29471 from lingtaolf/feature/fucntion-mapContainsKeyLike
New function `mapContainsKeyLike`
2021-10-28 09:21:51 +03:00
Alexey Milovidov
8b4a6a2416 Remove cruft 2021-10-28 02:10:39 +03:00
凌涛
996706101d optimized code 2021-10-27 19:53:53 +08:00
凌涛
d4d97d7b9a add new function mapContainsKeyLike
fixed error because of inconsistent offsets
2021-10-27 00:06:01 +08:00
Nikolai Kochetov
36c3b1d5b1
Merge pull request #30639 from ClickHouse/fix-30545
Fix argument types for now and now64
2021-10-26 16:29:18 +03:00
Kseniia Sumarokova
377b937aa5
Merge pull request #30244 from evillique/fix_like_function
Fix `LIKE` function
2021-10-25 16:35:37 +03:00
Anton Popov
b87c819c10
Merge pull request #30566 from nickitat/nickitat_nullable_4_arrayStringConcat
Support Nullable(String) type in arrayStringConcat
2021-10-25 16:04:20 +03:00
Nikolai Kochetov
a0a5c1a21d Fix argument types for now and now64 2021-10-25 12:06:53 +03:00
Nickita Taranov
877e8b579b fix style 2021-10-24 14:45:12 +03:00
Nickita Taranov
2d23e3b17d support for ColumnString 2021-10-22 18:53:02 +03:00
Nickita Taranov
a211c9ecbc support nullable for ColumnConst 2021-10-22 18:52:59 +03:00
mergify[bot]
86e1bb6b55
Merge branch 'master' into fix_like_function 2021-10-21 12:24:28 +00:00
Kruglov Pavel
27e8a83269
Merge pull request #30426 from amosbird/jsonextractstring3
JSONExtractString raw string support.
2021-10-21 12:29:11 +03:00
Kseniia Sumarokova
feeb572219
Merge pull request #30474 from kssenii/sql-json-fix
sql json change order of arguments
2021-10-21 09:47:12 +03:00
Kseniia Sumarokova
5544e866f8
Merge pull request #30219 from lhuang09287750/master
make date32 type comparable with date/datetime/string
2021-10-21 09:38:55 +03:00
kssenii
c96b884951 Fix 2021-10-20 20:47:34 +00:00
Anton Popov
78c925ddef
Merge pull request #30177 from CurtizJ/initializeAggregation-nullable
Support nullable arguments in function `initializeAggregation`
2021-10-20 15:39:07 +03:00
Amos Bird
ddcf12c83b
JSONExtractString raw string support. 2021-10-20 17:57:14 +08:00
lhuang0928
008a13df8b fix date32 comparison with datetime/datetime64 2021-10-20 03:36:07 +00:00
Nikita Mikhaylov
1114d06bc0 Done 2021-10-19 12:11:18 +00:00
Vladimir C
49685f0b9a
Merge pull request #30292 from Joeywzr/trim_dev 2021-10-19 14:49:43 +03:00
Nikolay Degterinsky
f861da2dd1 Fix [I]LIKE function 2021-10-18 17:19:02 +03:00
Anton Popov
d71ffc355a Merge remote-tracking branch 'upstream/master' into HEAD 2021-10-18 15:18:22 +03:00
lhuang0928
109e664188 fix date32 comparison with datetime/datetime64 2021-10-18 08:53:25 +00:00
Nikolai Kochetov
bfcbf5abe0 Merge branch 'master' into removing-data-streams-folder 2021-10-17 10:42:37 +03:00
WangZengrui
131aa77017 fix style 2021-10-17 11:21:58 +08:00
alexey-milovidov
3e9cf0b5ba
Merge pull request #30243 from Algunenano/multiIf_shortcircuit_fix
Fix crash with shortcircuit and LowCardinality in multiIf
2021-10-17 06:16:09 +03:00
WangZengrui
bd2c016cf3 fix bug 2021-10-17 00:33:57 +08:00
WangZengrui
1541593b2f add notes 2021-10-16 23:28:29 +08:00
WangZengrui
6752be4c4e fix bug and add test 2021-10-16 23:11:45 +08:00
WangZengrui
8a94e26bec init 2021-10-16 18:51:42 +08:00
Nikolai Kochetov
067eaadadd Merge branch 'master' into removing-data-streams-folder 2021-10-16 09:46:05 +03:00
Maksim Kita
a35d7096d8 Added concept HasIndexOperator 2021-10-15 23:26:09 +03:00
Nikolai Kochetov
fd14faeae2 Remove DataStreams folder. 2021-10-15 23:18:20 +03:00
Raúl Marín
01fbd52758 Fix crash with shortcircuit and locardinality in multiIf 2021-10-15 18:52:23 +02:00
Maksim Kita
a744097fb6 Fixed build 2021-10-15 15:34:13 +03:00