thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-15 10:52:30 +00:00
Code Issues Packages Projects Releases Wiki Activity
120,234 Commits 9,328 Branches 1,783 Tags 2.1 GiB
890a3754a6
Commit Graph

5578 Commits

Author SHA1 Message Date
Yakov Olkhovskiy
09806bc363
Merge branch 'master' into cast-ipv6-to-ipv4 2023-06-23 10:53:46 -04:00
Dmitry Kardymon
2d11ce43f1 Build fix 2023-06-23 05:17:01 +00:00
Dmitry Kardymon
d2635bff64 Merge remote-tracking branch 'origin/master' into ADQM-868 2023-06-22 19:56:15 +00:00
Dmitry Kardymon
65e5d40cae Fix formatDateTime() with fractional negative datetime64 2023-06-22 19:38:41 +00:00
Andrey Zvonov
d4316c7189
Merge branch 'master' into zvonand-implicit-tz 2023-06-22 17:23:20 +02:00
Nikolai Kochetov
22e49748b5 Cleanup. 2023-06-22 14:23:04 +00:00
Nikolai Kochetov
a940031878 Merge branch 'master' into refactor-subqueries-for-in 2023-06-22 12:18:48 +02:00
Sema Checherinda
01de36f1fa
Merge pull request #50395 from CheSema/better-log 
require `finalize()` call before d-tor for all writes buffers
 2023-06-21 21:12:02 +02:00
Alexey Milovidov
f0d93d5b60
Merge pull request #51199 from ClickHouse/empty_array_get_name 
Avoid initializing DateLUT from emptyArray function registration
 2023-06-21 20:29:28 +03:00
Alexander Gololobov
a708adecee Pass element type as param to ctor 2023-06-21 14:04:45 +02:00
Andrey Zvonov
b4f2e4020d
Merge branch 'master' into zvonand-implicit-tz 2023-06-21 13:41:35 +02:00
Dmitry Kardymon
d58152cb82 Add constants / fix tests 2023-06-21 08:04:40 +00:00
Sema Checherinda
9b0c3359cf
Merge branch 'master' into better-log 2023-06-20 20:37:36 +02:00
Dmitry Kardymon
cda37f4d73 Fix negative support for date_diff/age(), fix whole int TransformDateTime64 2023-06-20 18:31:04 +00:00
Alexey Milovidov
ced1ae7287
Update emptyArray.cpp 2023-06-20 21:20:25 +03:00
Alexander Gololobov
29f6ce871d Avoid initializing DateLUT from emptyArray function registration 2023-06-20 19:00:41 +02:00
Dmitry Kardymon
d1cb371d8d Style fix (whitespaces) 2023-06-20 08:53:25 +00:00
Maksim Kita
7e5017dd31 Fixed tests 2023-06-20 11:42:22 +03:00
Maksim Kita
aa28a1f259 Fixed tests 2023-06-20 11:42:22 +03:00
Maksim Kita
6e26fde707 Updated tests 2023-06-20 11:42:22 +03:00
Maksim Kita
129b97c727 JIT infrastructure refactoring 2023-06-20 11:42:22 +03:00
Dmitry Kardymon
792cdb6da5 Add millisecond support to age() / add tests 2023-06-20 08:26:59 +00:00
Andrey Zvonov
07191ce10d
Merge branch 'master' into zvonand-implicit-tz 2023-06-20 00:24:53 +02:00
Sergei Trifonov
5867f39fc7
Merge pull request #50675 from ClickHouse/unify-priorities-pools 
Unify priorities for connection pools
 2023-06-19 17:16:15 +02:00
Nikolai Kochetov
8e7d06e0a4 Remove isReady from FutureSet iface. 2023-06-19 12:56:24 +00:00
Sema Checherinda
cf31fdb4d5 no finalize at d-tor in compression 2023-06-16 16:38:18 +02:00
Sema Checherinda
1cb02e2710 do call finalize for all buffers 2023-06-16 16:38:18 +02:00
Dmitry Kardymon
02b5b50e41 Add milli/micro seconds support for date_diff 2023-06-16 12:39:46 +00:00
zvonand
4155d13d69 merge master and resolve conflict 2023-06-16 02:20:32 +02:00
zvonand
e60506f41b changes requested in review 2023-06-16 02:16:04 +02:00
Zhiguo Zhou
d780d0bab1 fix style 
Move error throws in Transform to FunctionDateOrDateTimeToSomething.
 2023-06-15 21:48:02 +08:00
Han Fei
9e81b2fd5d fix style 2023-06-15 21:48:02 +08:00
Zhiguo Zhou
d14299eb09 The general optimization of predicates with date/datetime converters 
As is suggested in issue #15257, the function preimage is a general
solution to the optimization problem with predicates containing the
date and datetime converters. This commit implements the idea by
adding the new methods, hasInformationAboutPreimage and getPreimage,
to IFunction/IFunctionBase, and having the specific convert functions
define their own preimage. Moreover, we added a new pass in the
TreeOptimizer and a new AST visitor for in-place rewriting the AST
with the converters' preimage.

Specifically, the optimization is applied to toYear and toYYYYMM.
 2023-06-15 21:48:02 +08:00
Kseniia Sumarokova
31e08635bf
Merge branch 'master' into unify-priorities-pools 2023-06-15 12:51:45 +02:00
Robert Schulze
edd29492c3
Merge pull request #50893 from rschu1ze/snowflake-crash 
Fix LOGICAL_ERROR in snowflakeToDateTime*()
 2023-06-14 09:42:21 +02:00
Robert Schulze
76f69f2b44
Revert overengineering 2023-06-13 15:52:06 +00:00
Robert Schulze
3e3b8ff5f6
More robustness 2023-06-13 12:24:31 +00:00
FFFFFFFHHHHHHH
80a897639e Merge remote-tracking branch 'origin/master' into jaccard_similarity 2023-06-13 19:31:04 +08:00
Kseniia Sumarokova
0ab3dc9261
A bit safer UserDefinedSQLFunctionVisitor (#50913) 
* Update UserDefinedSQLFunctionVisitor.cpp

* Update UserDefinedSQLFunctionVisitor.cpp

---------

Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2023-06-13 11:25:13 +02:00
Robert Schulze
79bc884733
Stabilize tests 2023-06-13 08:56:22 +00:00
ltrk2
edb4a644b1 Update FunctionsCodingIP.cpp 2023-06-12 14:23:22 -04:00
ltrk2
a4285d56b2 Fix compilation error on big-endian platforms 2023-06-12 14:23:22 -04:00
Robert Schulze
65d83e45cb
Fix crash in snowflakeToDateTime(), follow-up to #50834 2023-06-12 16:21:49 +00:00
Robert Schulze
128e8c20d5
Merge pull request #50709 from arenadata/ADQM-867 
Added numeric arguments support to some Date/DateTime conversion functions
 2023-06-12 17:08:14 +02:00
Dmitry Kardymon
9fd3f197c6
Merge branch 'master' into ADQM-867 2023-06-11 22:06:37 +03:00
Robert Schulze
2146c35608
Fix style 2023-06-11 07:40:39 +00:00
Robert Schulze
72b9d75a84
Add compat setting for non-const timezones 
SQL function toTimezone() converts a Date or DateTime into another
timezone. The problem is that the timezone is part of the Date /
DateTime type but not part of the internal representation (value). This
led to the fact that toTimeZone() wqith non-const timezones produced
wrong and misleading results until #48471 (shipped with v23.4) enforced
a const timezone.

Unfortunately, this PR also broke existing table definitions with
non-const timezones, e.g. in ALIAS expressions. So while #48471
addressed the issue appropriately, it is really backwards-incompatible.

This PR adds a setting to toggle the behavior and makes it also part of
the compatibility profile.
 2023-06-10 16:56:42 +00:00
Nikolai Kochetov
6ce8329bda Merge branch 'master' into refactor-subqueries-for-in 2023-06-09 20:04:27 +02:00
Dmitry Kardymon
d0c2c1dbad Add test and reorder if's 2023-06-09 12:06:43 +00:00
Dmitry Kardymon
7a02a70ad4 Add value to exceptions text 2023-06-09 11:11:49 +00:00
Dmitry Kardymon
de70e322cf Fix by pull request comments 2023-06-09 10:29:44 +00:00
Andrey Zvonov
d95be4162f
Merge branch 'master' into zvonand-implicit-tz 2023-06-08 18:34:45 +03:00
Dmitry Kardymon
7263769d20 Add constexpr / fix date check 2023-06-08 06:12:54 +00:00
Nikita Mikhaylov
c0f2141bd0
Revert "date_trunc function to always return DateTime type" (#50670) 2023-06-07 19:51:41 +02:00
serxa
2df0e0c669 Unify priorities for connections 2023-06-07 16:25:52 +00:00
Dmitry Kardymon
cf886d8ced Remove IsConvertible() 2023-06-06 11:08:21 +00:00
robot-ch-test-poll
e1889ffb3a
Merge pull request #50529 from kitaisreal/function-if-constant-folding 
Function if constant folding
 2023-06-05 17:29:29 +02:00
Maksim Kita
c860db0fb7 Fixed tests 2023-06-05 10:32:46 +03:00
johanngan
8d4206df66 Review comments: Use constexpr-if in more places 
Also add a comment about the apparent lack of type checking on the limit
column.
 2023-06-04 23:46:04 -05:00
johanngan
c0f162c5b6 Add dictGetAll function for RegExpTreeDictionary 
This function outputs an array of attribute values from all regexp nodes
that matched in a regexp tree dictionary. An optional final argument can
be passed to limit the array size.
 2023-06-04 23:46:04 -05:00
Azat Khuzhin
bf127f4e1e MSan support for Rust 
Previously you have to unpoison memory from the Rust, however Rust does
supports MSan, so let's simply use it.

But for this we need nightly Rust and recompile standard library.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-06-04 23:04:55 +02:00
Dmitry Kardymon
c032dee3b4 Merge remote-tracking branch 'origin/master' into ADQM-867 2023-06-04 18:45:47 +00:00
Maksim Kita
46cbdeeb7e Fixed tests 2023-06-04 15:02:46 +03:00
Maksim Kita
7a7e03a2ff Function if constant folding 2023-06-03 14:16:59 +03:00
Alexey Milovidov
054b908b9c
Merge pull request #50416 from ClickHouse/revert-49656-rs/entropy-learned-hashing 
Revert "Add SQL functions for Entropy Learned Hashing"
 2023-06-03 06:50:48 +03:00
Kruglov Pavel
f87f98fb80
Merge pull request #47409 from Avogar/random-structure 
Add new function generateRandomStructure
 2023-06-02 18:50:35 +02:00
Robert Schulze
12993890a8
Merge branch 'master' into revert-49656-rs/entropy-learned-hashing 2023-06-02 15:32:33 +02:00
Dmitry Kardymon
fa5f890a7a Added ru function descriptions (docs) 2023-06-02 12:03:50 +00:00
Robert Schulze
7070eac9db
Merge branch 'ClickHouse:master' into fix-const-int-hashing 2023-06-02 10:57:18 +02:00
Dmitry Kardymon
c7088a8180 Trying to fix build 2023-06-02 07:26:55 +00:00
Dmitry Kardymon
8a10baec7f Add dateTime range check 2023-06-02 06:25:00 +00:00
Andrey Zvonov
2e427ee028
Merge branch 'master' into zvonand-implicit-tz 2023-06-02 01:15:56 +03:00
Nikolai Kochetov
92859ebb3b Fixing more tests. 2023-06-01 21:15:15 +00:00
Dmitry Kardymon
a22e80eed5 Remove whitespaces 2023-06-01 19:52:48 +00:00
Dmitry Kardymon
38abcd1c44 Add nullable support to DateTimeTransformImpl 2023-06-01 19:25:53 +00:00
Dmitry Kardymon
54d526c75c Add cast type supprt to DateTimeTransformImpl 2023-06-01 14:22:57 +00:00
Robert Schulze
45b1fcdeda
Merge pull request #50315 from arenadata/ADQM-810 
Add new function toLastDayOfWeek()
 2023-06-01 16:19:14 +02:00
Robert Schulze
03628bde42
Fix hashing of const integer values 2023-06-01 12:54:34 +00:00
Robert Schulze
93ba75b370
Remove parentheses from single-line if/for 2023-06-01 12:51:38 +00:00
Robert Schulze
56fa98cb77
Rename variables for better readability 2023-06-01 12:51:30 +00:00
Alexander Tokmakov
9a2b3afb7e
Revert "Fix msan issue in keyed siphash" 2023-06-01 15:02:32 +03:00
Kruglov Pavel
7485962443
Merge pull request #50343 from Avogar/fix-bit-shift-func 
Fix bitShift* functions with both constant arguments
 2023-06-01 13:53:36 +02:00
Robert Schulze
08d98329b0
Revert "Add SQL functions for Entropy Learned Hashing" 2023-06-01 10:12:09 +02:00
Yakov Olkhovskiy
3af7e0a6fa
better exception message 2023-05-31 11:26:58 -04:00
Yakov Olkhovskiy
0d4ed32bac
better exception message 2023-05-31 11:25:33 -04:00
Robert Schulze
c5343679df
Merge branch 'master' into msan-siphash-keyed 2023-05-31 09:05:24 +02:00
Robert Schulze
fc157b3dad
Merge branch 'master' into msan-siphash-keyed 2023-05-30 21:30:33 +02:00
Nikolai Kochetov
8cec00dd6e Merge branch 'master' into refactor-subqueries-for-in 2023-05-30 18:08:37 +02:00
Dmitry Kardymon
a48c4fd370 Merge remote-tracking branch 'origin/master' into ADQM-884 2023-05-30 14:56:37 +00:00
avogar
c87e8c1f23 Fix bitShift* functions with both constant arguments 2023-05-30 12:12:54 +00:00
Dmitry Kardymon
c25980bcf4 Trying to fix toDateOrDefault() 2023-05-30 12:02:44 +00:00
Robert Schulze
1cbce21968
Better, pt. II 2023-05-30 11:46:23 +00:00
Andrey Zvonov
87fc780c14
Merge branch 'master' into zvonand-implicit-tz 2023-05-30 13:13:46 +03:00
Robert Schulze
2d06947522
Better 2023-05-30 09:06:45 +00:00
Robert Schulze
fb6c4f2802
Fix msan issue, pt. II 2023-05-30 08:51:44 +00:00
Victor Krasnov
6c94632d47 Deprive toStartOfWeek and toLastDayOfWeek functions of in-source documentation 2023-05-29 22:10:34 +00:00
Robert Schulze
516fa1c375
Merge branch 'master' into rs/entropy-learned-hashing 2023-05-29 17:40:14 +02:00
Victor Krasnov
0ad5b9f598 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-810-dev 2023-05-29 08:26:26 +00:00
Robert Schulze
41d60f0be3
Fix style 2023-05-29 08:08:47 +00:00
Maksim Kita
7ef20bbdcd Function equals NaN fix 2023-05-28 17:02:46 +03:00
FFFFFFFHHHHHHH
fe7f247be6
Merge branch 'master' into jaccard_similarity 2023-05-27 13:34:49 +08:00
Robert Schulze
f49160ef4e
Build partial key positions from entire training data 2023-05-26 15:27:56 +00:00
Robert Schulze
2298eeb2b2
Merge branch 'master' into rs/entropy-learned-hashing 2023-05-26 12:04:49 +02:00
Nikolai Kochetov
b5b261b22c Merge branch 'master' into refactor-subqueries-for-in 2023-05-25 21:22:06 +02:00
Robert Schulze
ad4a21034f
Fix msan issue in keyed siphash 
Issue:
https://s3.amazonaws.com/clickhouse-test-reports/0/ffdd91669471f4934704f98f0191524496b4e85b/fuzzer_astfuzzermsan/report.html

Repro:
SELECT hex(sipHash128ReferenceKeyed((toUInt64(2), toUInt64(-9223372036854775807)))) GROUP BY (toUInt64(506097522914230528), toUInt64(now64(2, NULL + NULL), 1084818905618843912)), toUInt64(2), NULL + NULL, char(-2147483649, 1)

Minimal repro:
SELECT sipHash64Keyed((2::UInt64, toUInt64(2)), 4) GROUP BY toUInt64(2)
 2023-05-25 17:52:03 +00:00
Robert Schulze
eca08438f4
Fix macos build 2023-05-25 17:05:18 +00:00
Nikolai Kochetov
30ff5113d9 Fixing more tests. 2023-05-25 13:33:52 +00:00
Robert Schulze
8804dfd4b0
Fix resizing 2023-05-25 11:57:09 +00:00
Victor Krasnov
03ca3f96d2 Add built-in documentation to toStartOfWeek and toLastDayOfWeek functions 2023-05-24 17:40:21 +00:00
taiyang-li
87907dafa7 fix code style 2023-05-24 14:27:37 +08:00
Robert Schulze
889489b02e
Merge branch 'master' into space 2023-05-23 23:18:19 +02:00
Robert Schulze
285e8f4ae1
Protect against DOS 2023-05-23 12:16:49 +00:00
Robert Schulze
f4c73e94d2
Merge pull request #49989 from arenadata/ADQM-811 
Add support of Date|Date32 arguments to the toUnixTimestamp() function
 2023-05-23 08:55:56 +02:00
Robert Schulze
d9a7227cf4
Fix style check 2023-05-23 06:49:19 +00:00
avogar
646eeb63a4 Fix build 2023-05-22 19:46:05 +00:00
avogar
4f85d6a1bb Merge branch 'master' of github.com:ClickHouse/ClickHouse into random-structure 2023-05-22 19:43:24 +00:00
Robert Schulze
d76498dca0
reserve() --> resize() 2023-05-22 19:19:08 +00:00
Robert Schulze
d5cfcdfae1
String terminator: \n --> \0 2023-05-22 19:10:03 +00:00
Robert Schulze
df436b2cd4
Spark compatibility: Add new function space() 2023-05-22 14:52:51 +00:00
FFFFFFFHHHHHHH
656d6abb2e fix style 2023-05-22 22:49:02 +08:00
Nikolai Kochetov
ff6400f91a Merge branch 'master' into refactor-subqueries-for-in 2023-05-22 13:07:51 +02:00
Maksim Kita
804e5e12ba JIT compilation not equals NaN fix 2023-05-22 13:14:27 +03:00
FFFFFFFHHHHHHH
c7aff9164a
Merge branch 'master' into jaccard_similarity 2023-05-22 17:34:33 +08:00
FFFFFFFHHHHHHH
ceecb1488a add function arrayJaccardIndex 2023-05-22 17:29:52 +08:00
Victor Krasnov
98aace14ae Add DATE_SECONDS_PER_DAY macro definition to replace the numeric literal 86400 2023-05-22 09:23:23 +00:00
taiyang-li
056e5824b5 remove useless code 2023-05-22 16:02:42 +08:00
taiyang-li
1f91a75b54 fix bugs of geoHashEncode 2023-05-22 15:52:58 +08:00
taiyang-li
e1bf96a786 finish dev 2023-05-22 14:29:15 +08:00
zvonand
8c816a5c4a update 2023-05-22 01:00:40 +02:00
zvonand
af5793b26e fix incode docs 2023-05-20 16:38:45 +02:00
vdimir
8b77e2096c
Merge pull request #49760 from arthurpassos/extract_kv_ignore_kv_delimiter_when_reading_value 2023-05-20 13:27:59 +02:00
zvonand
7dccb51bc0 fix conflict and update 2023-05-19 23:40:51 +02:00
Victor Krasnov
3a3e413552 Implement toLastDayWeek function 2023-05-18 21:47:52 +00:00
Yakov Olkhovskiy
9443457ea0
Merge branch 'master' into cast-ipv6-to-ipv4 2023-05-18 14:25:18 -04:00
Victor Krasnov
83d066e5cf Re-enable Date and Date32 as parameters of toUnixTimestamp function 2023-05-18 09:07:27 +00:00
FFFFFFFHHHHHHH
fd1e6557e1
Merge branch 'master' into dot_product 2023-05-17 14:40:06 +08:00
fhbai
c104354894 fix 2023-05-17 14:39:30 +08:00
Kruglov Pavel
d50e6fe868
Fix build after bad conflicts resolution 2023-05-16 15:35:16 +02:00
Kruglov Pavel
b6d2a84e83
Try to fix build 2023-05-16 12:01:55 +02:00
Kruglov Pavel
362fa4849f
Try to fix build 2023-05-15 17:56:53 +02:00
vdimir
07de815d96
Merge pull request #49836 from arthurpassos/add_extract_kv_max_number_of_pairs_safeguard 2023-05-15 16:31:01 +02:00
Arthur Passos
e8f971aa2b use LIMIT_EXCEEDED instead of TOO_LARGE_MAP_SIZE 2023-05-15 09:25:10 -03:00
Arthur Passos
b06e34a77f Accept key value delimiter as part of value 2023-05-15 13:52:47 +02:00
Kruglov Pavel
c901d2a7be
Fix style 2023-05-15 13:46:18 +02:00
avogar
aa7ab1f23b Fix comments 2023-05-15 11:20:03 +00:00
Kruglov Pavel
558eda4146
Merge pull request #49412 from azat/block-use-dense-hash-map 
Switch Block::NameMap to google::dense_hash_map over HashMap
 2023-05-15 12:22:55 +02:00
Alexey Milovidov
1db35384d9 Support bitCount for big integers 2023-05-15 03:30:03 +02:00
robot-clickhouse
33ca77b4ca
Merge pull request #49843 from azat/joinGet-non-deterministic 
[RFC] Mark joinGet() as non deterministic (so as dictGet)
 2023-05-14 11:12:12 +02:00
Alexey Milovidov
4f7bcf01f6
Merge pull request #49858 from ucasfl/bit-hamming 
bitHammingDistance support String and FixedString data type
 2023-05-14 08:28:01 +03:00
Robert Schulze
c4f7c3daa1
Merge branch 'master' into rs/entropy-learned-hashing 2023-05-13 17:33:12 +02:00
flynn
2f88605c3d remove space 
format
 2023-05-13 14:03:21 +00:00
flynn
2ffd00df8a bitHammingDistance support String and FixedString data type 2023-05-13 13:56:36 +00:00
Azat Khuzhin
a96067987e Mark joinGet() as non deterministic (so as dictGet) 
joinGet() should not be considered as deterministic function, since
shards could have different data in tables.

Also since now there is allow_nondeterministic_mutations, it could be
used as a workaround for this backward incompatible change.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-05-13 08:12:53 +02:00
Alexey Milovidov
5a44dc26e7 Fixes for clang-17 2023-05-13 02:57:31 +02:00
avogar
602b9a740e Make better, allow generateRandom without structure argument 2023-05-12 19:39:33 +00:00
Yakov Olkhovskiy
24067ea977 allow conversion for toIPv4OrDefault 2023-05-12 15:54:50 +00:00
Arthur Passos
b1549a19a5 Use 0 as unlimited 2023-05-12 11:19:35 -03:00
Arthur Passos
1e3b7af97a Add setting to limit the max number of pairs produced by extractKeyValuePairs 2023-05-12 10:26:05 -03:00
Robert Schulze
b9c185af44
Merge pull request #49678 from azat/build/llvm-16 
Switch to LLVM/clang 16 (16.0.3)
 2023-05-12 13:47:36 +02:00
Anton Popov
3351ef7398
Merge pull request #49789 from CurtizJ/fix-array-map-tuple 
Fix `arrayMap` with array of tuples with single argument
 2023-05-12 13:27:40 +02:00
Robert Schulze
922420420c
Merge pull request #49300 from ClickHouse/rs/functdocs 
Introduce more fields for in-source function documentation
 2023-05-12 11:36:04 +02:00
Robert Schulze
d15f19912f
Merge pull request #49198 from ClibMouse/s390x_reinterpretas_fix 
Fix reinterpretAs*() on big endian machines
 2023-05-12 10:33:50 +02:00
Azat Khuzhin
2c40dd6a4c Switch Block::NameMap to google::dense_hash_map over HashMap 
Since HashMap creates 2^8 elements by default, while dense_hash_map
should be good here.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-05-12 05:52:57 +02:00
Alexey Milovidov
76f7f5750d
Merge pull request #49799 from rschu1ze/demange 
Typo: demange.cpp --> demangle.cpp
 2023-05-12 02:01:49 +03:00
Robert Schulze
8ca804d40e
Typo: demange.cpp --> demangle.cpp 2023-05-11 21:32:12 +00:00
Robert Schulze
bbfb74ab70
Update comment 2023-05-11 19:06:04 +00:00
Robert Schulze
4a168444fa
Store keys as std::string_view 2023-05-11 19:03:17 +00:00
Robert Schulze
37c1b1aa58
Some fixups 2023-05-11 18:49:05 +00:00
Suzy Wang
70db49cdeb
Merge branch 'master' into s390x_reinterpretas_fix 2023-05-11 14:41:57 -04:00
Yakov Olkhovskiy
108e256578 allow to cast IPv4 to IPv6 2023-05-11 16:17:52 +00:00
Anton Popov
84aa97b738 fix arrayMap with array of tuples with single argument 2023-05-11 14:52:01 +00:00
Azat Khuzhin
00fdfa115f Suppress MSan warning in NgramDistanceImpl::unrollLowering() 
NgramDistanceImpl::unrollLowering() relies on the fact that PODArray has
padding and it is OK to access more items.

Here is an MSan report:

    ==656==WARNING: MemorySanitizer: use-of-uninitialized-value
        0 0x557fd825485f in DB::NgramDistanceImpl<4ul, char8_t, false, true, false>::vectorConstant(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, DB::PODArray<float, 4096ul, Allocator<false, false>, 63ul, 64ul>&) (/usr/bin/clickhouse+0x124d885f) (BuildId: 76773125d8739591c75d4f4d263a2ffe7ca96855)
        1 0x557fd824eb83 in DB::FunctionsStringSimilarity<DB::NgramDistanceImpl<4ul, char8_t, false, true, false>, DB::NameNgramSearchCaseInsensitive>::executeImpl(std::__1::vector<DB::ColumnWithTypeAndName, std::__1::allocator<DB::ColumnWithTypeAndName>> const&, std::__1::shared_ptr<DB::IDataType const> const&, unsigned long) const (/usr/bin/clickhouse+0x124d2b83) (BuildId: 76773125d8739591c75d4f4d263a2ffe7ca96855)
        2 0x557fd50023b7 in DB::FunctionToExecutableFunctionAdaptor::executeImpl() const (/usr/bin/clickhouse+0xf2863b7) (BuildId: 76773125d8739591c75d4f4d263a2ffe7ca96855)

      Uninitialized value was stored to memory at
        0 0x557fd4f8da5a in __msan_memcpy (/usr/bin/clickhouse+0xf211a5a) (BuildId: 76773125d8739591c75d4f4d263a2ffe7ca96855)
        1 0x557fd8253803 in DB::NgramDistanceImpl<4ul, char8_t, false, true, false>::vectorConstant(DB::PODArray<char8_t, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, DB::PODArray<float, 4096ul, Allocator<false, false>, 63ul, 64ul>&) (/usr/bin/clickhouse+0x124d7803) (BuildId: 76773125d8739591c75d4f4d263a2ffe7ca96855)
        2 0x557fd824eb83 in DB::FunctionsStringSimilarity<DB::NgramDistanceImpl<4ul, char8_t, false, true, false>, DB::NameNgramSearchCaseInsensitive>::executeImpl(std::__1::vector<DB::ColumnWithTypeAndName, std::__1::allocator<DB::ColumnWithTypeAndName>> const&, std::__1::shared_ptr<DB::IDataType const> const&, unsigned long) const (/usr/bin/clickhouse+0x124d2b83) (BuildId: 76773125d8739591c75d4f4d263a2ffe7ca96855)
        3 0x557fd50023b7 in DB::FunctionToExecutableFunctionAdaptor::executeImpl() const (/usr/bin/clickhouse+0xf2863b7) (BuildId: 76773125d8739591c75d4f4d263a2ffe7ca96855)

      Uninitialized value was stored to memory at
        0 0x557fd4f8da5a in __msan_memcpy (/usr/bin/clickhouse+0xf211a5a) (BuildId: 76773125d8739591c75d4f4d263a2ffe7ca96855)
        1 0x5580061699f5 in detail::memcpySmallAllowReadWriteOverflow15Impl(char*, char const*, long) build_docker/./src/Common/memcpySmall.h:42:13
        2 0x5580061699f5 in memcpySmallAllowReadWriteOverflow15(void*, void const*, unsigned long) build_docker/./src/Common/memcpySmall.h:57:5
        3 0x5580061699f5 in DB::ColumnString::replicate(DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 63ul, 64ul> const&) const build_docker/./src/Columns/ColumnString.cpp:462:13
        4 0x558005d3fae4 in DB::ColumnConst::convertToFullColumn() const build_docker/./src/Columns/ColumnConst.cpp:48:18

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-05-11 16:30:17 +02:00
avogar
5ed1b12e19 Fix build 2023-05-11 12:12:43 +00:00
avogar
604bd24995 Refactor, remove no more needed arguments 2023-05-11 11:58:08 +00:00
Robert Schulze
c2a4d89b6f
Fix style 2023-05-11 09:29:05 +00:00
Yakov Olkhovskiy
58bdcc2931 allow to cast IPv6 to IPv4 for address in proper mapping block 2023-05-10 23:55:13 +00:00
Suzy Wang
d267c914c3
Merge branch 'master' into s390x_reinterpretas_fix 2023-05-10 16:08:50 -04:00
Suzy Wang
24b6ff47ac fix format and some more fix for fixedstring 2023-05-10 13:06:30 -07:00
avogar
9096f62efc Merge branch 'master' of github.com:ClickHouse/ClickHouse into random-structure 2023-05-10 18:46:19 +00:00
Robert Schulze
9795d5403f
Merge branch 'master' into rs/msan-randomStringUTF8 2023-05-10 20:16:49 +02:00
Robert Schulze
374dbd9c39
Fix msan issue in randomStringUTF8(<uneven number>) 2023-05-10 17:49:23 +00:00
Andrey Zvonov
9237b904be
Merge branch 'master' into zvonand-implicit-tz 2023-05-10 01:25:33 +02:00
zvonand
8d0644e793 cleanup 2023-05-09 23:02:03 +02:00
Suzy Wang
1b21f13605 ip encoding fix 2023-05-09 13:57:22 -07:00
zvonand
297188ce58 fix Date32 2023-05-09 22:37:25 +02:00
Suzy Wang
ce471a2e8b Updated code as suggested 2023-05-09 13:31:54 -07:00
zvonand
1751ccc7ac fix stateless 2023-05-09 14:18:04 +02:00
FFFFFFFHHHHHHH
4a10f4b3d0
Merge branch 'master' into dot_product 2023-05-09 12:06:28 +08:00
FFFFFFFHHHHHHH
79398f612f fix style 2023-05-09 11:50:38 +08:00
fhbai
a7e04b7576 fix return type 2023-05-09 11:36:15 +08:00
zvonand
3fedd683ef speedup vol. II 2023-05-08 22:28:31 +02:00
Robert Schulze
e9d9eda3a2
More typedef usage 2023-05-08 12:46:14 +00:00
Robert Schulze
6a454ed6c3
Add Entropies typedef 2023-05-08 12:41:30 +00:00
Robert Schulze
d2dc5e9fc8
Improve naming 2023-05-08 12:36:28 +00:00
Robert Schulze
8b77b706c4
Optimize allocations 2023-05-08 12:31:25 +00:00
Robert Schulze
d2216a4339
Remove leftover 2023-05-08 12:20:40 +00:00
Robert Schulze
1b7c207d7a
Replace ACM link by DOI link 2023-05-08 12:16:12 +00:00
Robert Schulze
fdabce9a68
Move chooseBytes() up 2023-05-08 12:15:19 +00:00
Robert Schulze
03e9522de4
Less namespace clutter 2023-05-08 12:13:52 +00:00
Robert Schulze
267e0c4ef5
More typedef usage 2023-05-08 12:12:24 +00:00