Commit Graph

137 Commits

Author SHA1 Message Date
ltrk2
f2fd1da891 Fix a build error 2023-07-31 19:13:27 +00:00
ltrk2
5bd670d8c6 Improve endianness-independent support for hash functions 2023-07-27 15:58:46 -07:00
Alexey Milovidov
d7782f6518 Merge branch 'fix_keyed_hash' of github.com:nickitat/ClickHouse into many-fixes-3 2023-07-06 02:47:51 +02:00
Nikita Taranov
da105d4916 impl 2023-07-04 23:01:06 +02:00
Alexey Milovidov
3ed86867f8 Remove sipHash128ReferenceKeyed 2023-06-24 23:06:13 +02:00
Azat Khuzhin
bf127f4e1e MSan support for Rust
Previously you have to unpoison memory from the Rust, however Rust does
supports MSan, so let's simply use it.

But for this we need nightly Rust and recompile standard library.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-06-04 23:04:55 +02:00
Robert Schulze
03628bde42
Fix hashing of const integer values 2023-06-01 12:54:34 +00:00
Robert Schulze
93ba75b370
Remove parentheses from single-line if/for 2023-06-01 12:51:38 +00:00
Robert Schulze
56fa98cb77
Rename variables for better readability 2023-06-01 12:51:30 +00:00
Alexander Tokmakov
9a2b3afb7e
Revert "Fix msan issue in keyed siphash" 2023-06-01 15:02:32 +03:00
Robert Schulze
1cbce21968
Better, pt. II 2023-05-30 11:46:23 +00:00
Robert Schulze
2d06947522
Better 2023-05-30 09:06:45 +00:00
Robert Schulze
fb6c4f2802
Fix msan issue, pt. II 2023-05-30 08:51:44 +00:00
Robert Schulze
ad4a21034f
Fix msan issue in keyed siphash
Issue:
https://s3.amazonaws.com/clickhouse-test-reports/0/ffdd91669471f4934704f98f0191524496b4e85b/fuzzer_astfuzzermsan/report.html

Repro:
SELECT hex(sipHash128ReferenceKeyed((toUInt64(2), toUInt64(-9223372036854775807)))) GROUP BY (toUInt64(506097522914230528), toUInt64(now64(2, NULL + NULL), 1084818905618843912)), toUInt64(2), NULL + NULL, char(-2147483649, 1)

Minimal repro:
SELECT sipHash64Keyed((2::UInt64, toUInt64(2)), 4) GROUP BY toUInt64(2)
2023-05-25 17:52:03 +00:00
Robert Schulze
e275da1d31
Remove deprecated logic for ccache 2023-05-07 15:41:56 +00:00
Nikolay Degterinsky
a48655af39
Merge branch 'master' into add-kafka-murmur-hash-function 2023-04-07 12:21:16 +02:00
Nikolay Degterinsky
47ea27fd92 Fix 2023-03-31 02:57:55 +00:00
Nikolay Degterinsky
4f360e76e9 Add kafkaMurmurHash function 2023-03-29 18:09:15 +00:00
Yakov Olkhovskiy
9201e7d393
Merge pull request #47371 from HarryLeeIBM/hlee-s390x-hash-tuples
Fix hashing tuples for s390x
2023-03-28 15:19:37 -04:00
Alexey Milovidov
aea421cc9b Add a style check for unsafe code 2023-03-18 03:29:14 +01:00
HarryLeeIBM
1ba75c6408 Refactored by using std::byteswap 2023-03-16 10:03:43 -07:00
HarryLeeIBM
808f2c0cb4 Fix hashing tuples for s390x 2023-03-16 08:44:28 -04:00
HarryLeeIBM
b84e9fdaac Fix halfMD5 and cityhash for s390x 2023-03-01 13:36:35 -08:00
Alexander Gololobov
7606d2406b Check that argument sizes and result size match 2023-02-25 14:47:45 +01:00
Alexey Milovidov
c659d84b47 Fix MSan report in Map data type 2023-02-25 08:46:21 +01:00
Robert Schulze
9914d4c591
Cosmetics 2023-02-23 14:35:45 +00:00
HarryLeeIBM
776d4d9bb4 More refactoring 2023-02-22 15:19:25 -08:00
HarryLeeIBM
e979a86604 Minor change for adding constexpr 2023-02-22 12:50:46 -08:00
HarryLeeIBM
18b93fc212 More refactoring for better style 2023-02-22 12:41:00 -08:00
HarryLeeIBM
ef33d11e3f Refactor code according to code review 2023-02-21 18:40:11 -08:00
HarryLeeIBM
3a635e428a Fix xxhash endian issue for s390x 2023-02-16 11:03:41 -08:00
Salvatore Mesoraca
476342602b
Functions: Hashing: add sipHash128Reference{,Keyed} 2023-02-07 11:19:04 +01:00
Salvatore Mesoraca
59c17a7719
functions: hashing: add sipHash{64,128}Keyed 2023-01-27 13:00:54 +01:00
Salvatore Mesoraca
31e4d042f8
function: hashing: add generic support for keyed algos 2023-01-27 13:00:53 +01:00
Alexander Tokmakov
70d1adfe4b
Better formatting for exception messages (#45449)
* save format string for NetException

* format exceptions

* format exceptions 2

* format exceptions 3

* format exceptions 4

* format exceptions 5

* format exceptions 6

* fix

* format exceptions 7

* format exceptions 8

* Update MergeTreeIndexGin.cpp

* Update AggregateFunctionMap.cpp

* Update AggregateFunctionMap.cpp

* fix
2023-01-24 00:13:58 +03:00
Yakov Olkhovskiy
2559c49810 make only IPv4 as numeric, fix hash functions for IPv6, add more hash functions to test 2023-01-10 02:03:06 +00:00
Yakov Olkhovskiy
6ec1592a9f fix hash functions for IPv4 2023-01-08 20:58:09 +00:00
Yakov Olkhovskiy
d77178194f fix cutIPv6 function and IPv4 hashing 2023-01-07 21:48:02 +00:00
Yakov Olkhovskiy
a8cb29da4b
Merge branch 'master' into refactoring-ip-types 2022-12-21 23:56:24 -05:00
Joanna Hulboj
d32452d90c Fixed use-after-free of BLAKE3 error message
As std::string is not POD there sadly was no warning from the compiler.
2022-12-14 19:57:41 +00:00
Yakov Olkhovskiy
770b520ded
Merge branch 'master' into refactoring-ip-types 2022-11-28 08:50:19 -05:00
Nikita Taranov
d1c258cf20
Add xxh3 hash function (#43411)
* impl

* try fix

* add docs

* add test

* rm unused file

* excellent
2022-11-26 00:14:08 +01:00
Yakov Olkhovskiy
4d144be39c replace domain IP types (IPv4, IPv6) with native 2022-11-14 14:17:17 +00:00
Azat Khuzhin
3ccd5e8a18 Fix -Wshorten-64-to-32 with USE_BLAKE3
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-21 13:25:42 +02:00
Vitaly Baranov
26b2db2c94
Merge pull request #42073 from BoloniniD/BLAKE3_fixes
Minor fixes for BLAKE3
2022-10-07 15:00:13 +02:00
BoloniniD
d188601881 Fix style 2022-10-06 21:41:26 +03:00
Robert Schulze
da5a2e2db0
Merge remote-tracking branch 'origin/master' into generated-file-cleanup
Physical merge conflicts:
- src/Common/ZooKeeper/ZooKeeperImpl.cpp
- src/Core/config_core.h.in
- src/Functions/FunctionsAES.h
- src/Functions/config_functions.h.in
- src/configure_config.cmake

Logical merge conflicts:
- Functions/tryDecrypt.cpp
2022-10-06 08:43:25 +00:00
BoloniniD
87f06bbe0b Fix [[noreturn]] function variant 2022-10-05 23:38:44 +03:00
BoloniniD
9dd15998c7 Print nicer exception if BLAKE3 is unavailable 2022-10-05 00:11:41 +03:00
Vitaly Baranov
65c61877c7
Merge pull request #33435 from BoloniniD/BLAKE3
Integrating Rust code into ClickHouse
2022-10-03 15:25:06 +02:00