Commit Graph

3965 Commits

Author SHA1 Message Date
kssenii
07eedc8ef1 Fix 2023-05-24 15:03:11 +02:00
Azat Khuzhin
885dea3658 Switch to upstream repository of vectorscan
Everything that is requried already merged:
- https://github.com/VectorCamp/vectorscan/pull/144
- https://github.com/VectorCamp/vectorscan/pull/149
- https://github.com/VectorCamp/vectorscan/pull/148

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-23 22:13:35 +02:00
Alexey Milovidov
70c83f5133
Merge pull request #49991 from amosbird/clickhouse_as_library
Use PROJECT_*_DIR instead of CMAKE_*_DIR.
2023-05-19 12:37:18 +03:00
Amos Bird
6b4dcbd3ed
Use PROJECT_*_DIR instead of CMAKE_*_DIR. 2023-05-18 23:23:39 +08:00
Kruglov Pavel
b414760d43
Merge pull request #49673 from Avogar/fiber-local-var
Fix assert in SpanHolder::finish() with fibers
2023-05-16 11:59:33 +02:00
Sema Checherinda
03c51208d1
Merge pull request #44869 from CheSema/multi_part_upload
rework WriteBufferFromS3, add tests, add abortion
2023-05-16 10:52:01 +02:00
avogar
b23afdc533 Fix build for aarch64-darwin 2023-05-15 15:48:00 +00:00
Alexey Milovidov
6df457dcaf
Merge pull request #49811 from jinjunzh/iaadeflate_swpath_compat
qpl_deflate codec lower the minimum SIMD version to SSE 4.2
2023-05-13 04:21:54 +03:00
Robert Schulze
13494ffe9b
Include msan fixes in vectorscan 2023-05-12 17:58:54 +00:00
Robert Schulze
a6d4c17afb
Add vectorscan submodule 2023-05-12 17:52:45 +00:00
Robert Schulze
e468b92b9c
Remove vectorscan 2023-05-12 17:47:46 +00:00
avogar
37e4c531ba Don't update contrib 2023-05-12 15:02:56 +00:00
Robert Schulze
9d34233e65
Merge branch 'master' into iaadeflate_swpath_compat 2023-05-12 16:39:17 +02:00
jinjunzh
e72a6fe973 qpl-deflate codec lower the minimum SIMD version to SSE 4.2 2023-05-12 09:56:01 -04:00
Kruglov Pavel
084a696b54
Merge branch 'master' into fiber-local-var 2023-05-11 17:55:25 +02:00
Sema Checherinda
9ef14d5ed4
Merge branch 'master' into multi_part_upload 2023-05-11 08:21:02 +02:00
Alexey Milovidov
f82dc03b14 Fix build of libfiu on clang-16 2023-05-11 04:43:00 +02:00
Sema Checherinda
7fbf87be17 rework WriteBufferFromS3, squashed 2023-05-10 18:31:47 +00:00
Azat Khuzhin
dde535797e Update libfiu to fix the build
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-10 19:35:45 +02:00
Kruglov Pavel
289af626ad
Merge branch 'master' into fiber-local-var 2023-05-10 18:21:46 +02:00
Azat Khuzhin
a0cc5b7e47 Merge remote-tracking branch 'u/master' into build/llvm-16 2023-05-10 16:28:36 +02:00
Azat Khuzhin
88b07d121c Update vectorscan library with fixes for MSan
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-10 16:01:29 +02:00
Han Fei
d17aa828b3
Merge pull request #49361 from hanfei1991/hanfei/fiu
support named fault injection and add a simple test
2023-05-10 15:51:51 +02:00
avogar
0cf6b9f145 Inherit context from parent fiber 2023-05-10 12:27:13 +00:00
Han Fei
505d9be7b2 address comments 2023-05-10 13:56:17 +02:00
avogar
66971662de Update cmake 2023-05-09 18:56:59 +00:00
Azat Khuzhin
6ae41be0cc Add riscv64 support for boringssl
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-09 10:33:37 +02:00
Han Fei
64b67b9a37 Merge branch 'master' into hanfei/fiu 2023-05-09 01:14:30 +02:00
avogar
c961e3706e Clean up 2023-05-08 16:52:57 +00:00
avogar
5527d43a5d Use only needed src files 2023-05-08 16:51:17 +00:00
avogar
b320527158 Fix assert in SpanHolder::finish() with fibers 2023-05-08 16:33:39 +00:00
jasperzhu
d92ff92966
Merge branch 'master' into iaadeflate_idxd_config_amend 2023-05-08 16:36:23 +08:00
jinjunzh
d2d291fe89 resolved conflict with master 2023-05-08 16:46:27 -04:00
jinjunzh
17cb445c1b refine content of cmake for qpl 2023-05-08 16:43:37 -04:00
jinjunzh
9fad9f234f add missing idxd-config module for qpl-deflate codec 2023-05-08 15:20:55 -04:00
Robert Schulze
156cd1de6f
Revert "Remove trash" 2023-05-07 22:03:37 +02:00
Alexey Milovidov
bcafd7002a
Merge pull request #49597 from ClickHouse/remove-locales
Remove "locale"
2023-05-07 07:26:02 +03:00
Alexey Milovidov
49766769df
Merge pull request #49584 from jinjunzh/iaadeflate_isal_issuefix
fixed symbol conflict between contrib/isa-l and isa-l in qpl
2023-05-07 04:52:08 +03:00
Alexey Milovidov
13ed528e0b Remove "locale" 2023-05-06 18:45:14 +02:00
jasperzhu
6b9df33ca1
Merge branch 'master' into iaadeflate_isal_issuefix 2023-05-06 10:32:58 +08:00
jinjunzh
576fbb9c25 fixed symbol conflict between contrib/isal and isal in qpl 2023-05-06 10:38:11 -04:00
ltrk2
20cd799e51 Add CMake option for BOOST_USE_UCONTEXT 2023-05-05 16:29:21 +00:00
Alexey Milovidov
3a33f0eefb
Merge pull request #49531 from ClickHouse/remove-garbage-hdfs
Remove garbage from HDFS
2023-05-05 17:47:23 +03:00
Nikolay Degterinsky
7a727bbbe3
Merge pull request #49520 from IvanTakarlikov-st/it-grammar-fixes
Fix some grammar mistakes in documentation, code and tests
2023-05-05 15:45:58 +02:00
Alexey Milovidov
34798f5358 Remove garbage from HDFS 2023-05-05 03:27:03 +02:00
Alexey Milovidov
bbd6be85bf
Merge pull request #49457 from ClibMouse/fix_json_float_s390x
Fix the code to use the RapidJSONParser in case of big-endian system
2023-05-05 00:21:30 +03:00
MeenaRenganathan22
9b75f08794 Modified the code to disable the build of SimdJSONParser library in case of S390X and use the RapidJSONParser library instead. 2023-05-04 19:48:46 +00:00
Ivan Takarlikov
8873856ce5 Fix some grammar mistakes in documentation, code and tests 2023-05-04 13:35:18 -03:00
Alexey Milovidov
c799bcf6bf
Merge pull request #49437 from azat/build/disable-libraries-fixes
Build fixes for ENABLE_LIBRARIES=OFF
2023-05-03 23:55:50 +03:00
Nikolay Degterinsky
048b4ec738
Merge branch 'master' into bcrypt 2023-05-03 16:14:57 +02:00
alesapin
129d123956
Merge pull request #49423 from ClickHouse/remove-trash-7
Remove trash
2023-05-03 14:19:08 +02:00
Azat Khuzhin
2045cf1550 Respect ENABLE_LIBRARIES for ISA-L library
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-03 09:50:42 +02:00
Alexey Milovidov
7075c16b3e Remove trash 2023-05-02 19:25:40 +02:00
Han Fei
5a31d2129e fix build in fast test 2023-05-02 14:54:10 +02:00
Han Fei
d608ba41e7 try to fix 2023-05-02 00:05:36 +02:00
Robert Schulze
550e430c28
A better way of excluding ISA-L on non-x86
Follow-up to #49256. More 'modern', i.e. uses a CMake TARGET exists
check instead of an internal variable.
2023-05-01 20:42:57 +00:00
Han Fei
4d18a4f8d3
Merge branch 'master' into hanfei/fiu 2023-05-01 17:51:41 +02:00
Han Fei
b701293d46 support named fault injection and add a simple test 2023-05-01 17:44:37 +02:00
Nikolay Degterinsky
f64ef88197 Merge remote-tracking branch 'upstream/master' into bcrypt 2023-04-30 21:39:16 +00:00
Boris Kuschel
e640d79765
Update Curl to latest 2023-04-28 04:59:06 -07:00
Boris Kuschel
dcfee036a8
One more file 2023-04-28 04:59:05 -07:00
Boris Kuschel
449f63a2ef
Add missing files 2023-04-28 04:59:04 -07:00
Boris Kuschel
2246306370
remove commented lines 2023-04-28 04:59:03 -07:00
Boris Kuschel
7f91105e7d
Update curl to 8.0.1 2023-04-28 04:59:02 -07:00
Robert Schulze
744acc943c
Update CMakeLists.txt 2023-04-27 19:43:51 +02:00
Robert Schulze
742a93f168
Check NASM exists 2023-04-27 17:42:09 +00:00
Nikolay Degterinsky
df1e56b985 Merge remote-tracking branch 'upstream/master' into bcrypt 2023-04-27 17:01:58 +00:00
Jordi
be702ee584 Disable ISA-L on aarch64 architectures 2023-04-27 12:15:37 +02:00
Alexey Milovidov
ce00aa74a0
Merge pull request #48833 from M1eyu2018/update-hdfs
Update HDFS: Support for erasure codes
2023-04-27 01:36:05 +03:00
Alexey Milovidov
0c3dfe9d86
Merge branch 'master' into iaadeflate_upgrade_qpl_v1.1.0 2023-04-26 13:57:16 +03:00
Alexey Milovidov
038402c9d2
Merge branch 'master' into update-hdfs 2023-04-26 13:52:59 +03:00
jinjunzh
260eb5450b Upgrade IAA-Deflate codec library:qpl from v1.0.0 to v1.1.0 2023-04-25 14:52:28 -04:00
alesapin
2495e30b7d Bump sysroot 2023-04-25 18:15:07 +02:00
M1eyu2018
dff3c0c867 Update HDFS: Support for erasure codes
Signed-off-by: M1eyu2018 <857037797@qq.com>
2023-04-24 09:59:16 +08:00
Azat Khuzhin
fff6062c7b Update llvm to fix std::stringstream for payload > INT_MAX
Refs: https://reviews.llvm.org/D146294
Refs: https://github.com/ClickHouse/llvm-project/pull/9
Refs: https://github.com/ClickHouse/llvm-project/pull/16
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-04-17 10:49:55 +02:00
Robert Schulze
5553a521ba
Bump ZSTD to 1.5.5-pre 2023-04-13 12:11:43 +00:00
Robert Schulze
3f7ce60e03
Merge branch 'master' into rs/gcc-removal 2023-04-12 22:17:04 +02:00
Alexey Milovidov
83ca36d621
Merge pull request #48614 from ClickHouse/update-hdfs
Update HDFS
2023-04-12 22:10:11 +03:00
Robert Schulze
1477887259
Initial removal of logic under COMPILER_GCC 2023-04-11 16:27:32 +00:00
Alexander Tokmakov
327bfbc6c4
Merge pull request #48183 from ClickHouse/contrib_sparse_checkout
Add scripts for sparse checkout of some contribs
2023-04-11 16:18:27 +03:00
Alexey Milovidov
9f420ecad0 Update HDFS 2023-04-10 22:00:03 +02:00
Alexey Milovidov
438cd4af09
Merge pull request #48579 from ClickHouse/kerberos-fix-tsan
Fix TSan report in Kerberos
2023-04-10 20:58:50 +03:00
Alexey Milovidov
6738ab6660 Fix TSan report in Kerberos 2023-04-10 04:22:17 +02:00
Alexey Milovidov
98cabda66d Update CCTZ 2023-04-10 00:15:15 +02:00
Alexander Tokmakov
3c509214e4 Merge branch 'master' into contrib_sparse_checkout 2023-04-07 23:44:38 +02:00
Yakov Olkhovskiy
5841c415a7
Merge pull request #48407 from ClibMouse/krb5_openssl
Fix issue with krb5 and building w/ OpenSSL
2023-04-06 14:15:02 -04:00
Boris Kuschel
76738017a8
Fix krb5 with openssl 2023-04-04 15:28:40 -07:00
Alexander Tokmakov
686b284e6c fix 2023-04-01 02:00:45 +02:00
Alexander Tokmakov
8169f01a24 exclude more subdirs 2023-03-31 20:58:57 +02:00
avogar
c23eec876c Try to update arrow library with 11.0.0 release 2023-03-31 14:38:16 +00:00
Alexander Tokmakov
2ab198f19d Merge branch 'master' into contrib_sparse_checkout 2023-03-31 16:10:15 +02:00
Robert Schulze
e464ef1f7a
Remove support for std::unary/binary_function (removed in C++17) 2023-03-30 09:44:23 +00:00
Alexander Tokmakov
905975f6e6 update docs 2023-03-29 18:47:38 +02:00
Alexander Tokmakov
499b58dcf6 add scripts for sparse checkout of some contribs 2023-03-29 17:03:57 +02:00
robot-ch-test-poll2
9bea890906
Merge pull request #48101 from evillique/update-sqlite
Update SQLite to 3.41.2
2023-03-29 07:15:34 +02:00
Nikolay Degterinsky
a2df2b73fa Update SQLite to 3.41.2 2023-03-28 10:51:27 +00:00
Robert Schulze
6b3d0c1a34
Bump vectorscan to 5.4.9
As a consequence, this enables to remove a temporary workaround from ClickHouse's llvm-fork
2023-03-23 20:07:13 +00:00
Yakov Olkhovskiy
e04ba4ae30
Merge pull request #47036 from HarryLeeIBM/hlee-s390x-murmurhash
Fix murmurhash for s390x
2023-03-22 08:19:05 -04:00
Robert Schulze
382aa60056
Merge pull request #47745 from jinjunzh/iaadeflate_doc_update
Create doc and scripts for qpl_deflate benchmark
2023-03-22 10:15:26 +01:00
jinjunzh
038b56ad6a reformat doc 2023-03-21 16:31:47 -04:00
jinjunzh
a721c3e392 remove unused space 2023-03-21 16:02:03 -04:00
jinjunzh
bdb59db8ed fixed spelling issues 2023-03-21 15:36:38 -04:00
Yakov Olkhovskiy
3d47b051a7
Merge branch 'master' into hlee-s390x-murmurhash 2023-03-21 14:55:11 -04:00
jinjunzh
d65d23bf0e remove blank spaces 2023-03-21 12:06:29 -04:00
jinjunzh
ffc8d831c5 improve doc path and structure 2023-03-21 12:00:57 -04:00
jinjunzh
18c59fb5d3 Create doc and scripts for qpl_deflate benchmark 2023-03-20 17:19:34 -04:00
Alexey Milovidov
ddf29b69f9
Merge branch 'master' into fuzzer-of-data-formats 2023-03-20 03:26:51 +03:00
Robert Schulze
de760578d8
Fixup git reference to LLVM
(motivated by [0])

PRs [0]/[1] switched the git reference in ClickHouse's main repo to a
feature branch derived from the correct branch
(ClickHouse/releases/15.x). As per this PR, this is now fixed. The
actual code state of llvm-project doesn't change.

[0] https://github.com/ClickHouse/llvm-project/pull/10
[1] https://github.com/ClickHouse/llvm-project/pull/8
[2] https://github.com/ClickHouse/ClickHouse/pull/46600
2023-03-19 14:34:25 +00:00
Alexey Milovidov
a270f985a7 Update roaring bitmaps, because the previous version had a bug 2023-03-19 04:35:20 +01:00
Robert Schulze
145eed9455
Merge pull request #46485 from ClibMouse/KRB_CVE_Fix
Update krb5 to 1.20.1-final to mitigate CVE-2022-42898
2023-03-15 11:00:06 +01:00
MeenaRenganathan22
91625184a3 Updated the krb5 submodule reference 2023-03-14 06:23:22 -07:00
Robert Schulze
348a40aa5d
Compile with C++23 2023-03-10 19:11:58 +00:00
MeenaRenganathan22
f4f7336fd0 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into KRB_CVE_Fix 2023-03-10 09:08:02 -08:00
MeenaRenganathan22
65890de50c Updating the submodule to the new PR#9 2023-03-10 09:05:25 -08:00
Kruglov Pavel
71b6d6c6ae
Merge pull request #47114 from Avogar/parquet-compression
Improve working with compression methods in Parquet/ORC/Arrow formats
2023-03-09 13:02:18 +01:00
MeenaRenganathan22
30fd798a2c Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into KRB_CVE_Fix 2023-03-08 06:08:59 -08:00
HarryLeeIBM
bbbe529e24 Fix farmhash for s390x 2023-03-03 09:29:35 -08:00
Kruglov Pavel
3b034e7c35
Merge branch 'master' into parquet-compression 2023-03-02 15:55:48 +01:00
avogar
5ab5902f38 Allow control compression in Parquet/ORC/Arrow output formats, support more compression for input formats 2023-03-01 21:27:46 +00:00
Amos Bird
8162446496
The three-way comparison operator
Please refer to
https://www.open-std.org/jtc1/sc22/wg21/docs/papers/2022/p2468r2.html
for more information on why it is necessary to modify the code in this
way.
2023-03-01 11:06:34 +08:00
HarryLeeIBM
5f649542a3 Fix murmurhash for s390x 2023-02-28 10:08:57 -08:00
Amos Bird
620f3297fa
Simplify the LLVM build process 2023-02-28 22:41:52 +08:00
MeenaRenganathan22
6b1bb3f7ad Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into KRB_CVE_Fix 2023-02-27 05:52:25 -08:00
MeenaRenganathan22
a17edd224a Updated the krb5 submodule reference 2023-02-27 05:49:28 -08:00
Alexey Milovidov
1afbf49a63
Merge pull request #46832 from HarryLeeIBM/hlee-s390x-xz
Fix http xz compression issue for s390x
2023-02-26 22:31:57 +03:00
Alexey Milovidov
52beeadac7
Merge pull request #46755 from HarryLeeIBM/hlee-s390x-new-libunwind
Use latest libunwind for s390x
2023-02-25 00:40:06 +03:00
MeenaRenganathan22
2d967a1b45 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into KRB_CVE_Fix 2023-02-24 13:34:12 -08:00
MeenaRenganathan22
ebcd00e1c5 Changes to reflect the latest submodule and corresponding CMakeLists.txt 2023-02-24 13:31:40 -08:00
HarryLeeIBM
e8458048a9 Fix http xz compression issue for s390x 2023-02-24 07:33:57 -08:00
Robert Schulze
d26a12b6b2
Remove ZSTD version from CMake output
- produced wrong output:

  > ZSTD VERSION 1.5.0

  (see any recent local or CI build log), whereas the current version is 1.5.4

- that could be fixed, on the other hand other contrib's also don't
  print their version (it is given implicitly by ClickHouse's source
  Git hash), the parsing regex is fragile and it hasn't changed since
  2016 so it was probably broken for a long time already

- therefore remove it
2023-02-23 20:27:30 +00:00
HarryLeeIBM
6fa908ff10 Use latest libunwind for s390x 2023-02-22 17:24:15 -08:00
Han Fei
4715e2c172 update llvm-project to fix gwp-asan 2023-02-20 15:36:45 +01:00
MeenaRenganathan22
09323457b9 :wMerge branch 'master' of https://github.com/ClickHouse/ClickHouse into KRB_CVE_Fix 2023-02-17 07:48:05 -08:00
MeenaRenganathan22
fdde8de47c Updated the krb5 submodule reference to branch CVE_Fix in ClibMouse/krb5 2023-02-17 07:45:13 -08:00
MeenaRenganathan22
537c9914ce Updating the CMakeLists.txt to include the latest changes in the KRB5 submodule 2023-02-16 06:21:09 -08:00
Nikolay Degterinsky
e61947bf47
Merge pull request #44662 from evillique/ulid
Add generateULID function
2023-02-16 11:21:23 +01:00
Antonio Andelic
17494d79c2
Merge pull request #46070 from ClickHouse/s3-client-polish
Polish S3 client
2023-02-15 21:22:47 +01:00
Nikolay Degterinsky
494fd472f0
Merge branch 'master' into ulid 2023-02-15 07:24:32 +01:00
Mallik Hassan
7f0ad0e6ba
Merge branch 'master' into unixodbc_update_v_2_3_11 2023-02-14 19:22:48 -04:00
Nikolay Degterinsky
94d52d2b28 Fix include 2023-02-14 16:45:46 +00:00
Nikolay Degterinsky
09da5575e3 Merge remote-tracking branch 'upstream/master' into ulid 2023-02-14 13:41:17 +00:00
SadiHassan
5bb2144e12 updated files 2023-02-14 05:25:50 -08:00
Antonio Andelic
1826c29c82 Merge branch 'master' into s3-client-polish 2023-02-14 13:08:27 +00:00
SadiHassan
df68017fff update unixodbc to v2.3.11 to mitigate CVE-2011-1145 2023-02-13 08:43:46 -08:00
Suzy Wang
e140bed3ea
Merge branch 'master' into z-build-0120 2023-02-13 09:06:48 -05:00
Robert Schulze
9f47378421
Merge pull request #46328 from ClickHouse/rs/better-yasm-error
Slightly improve error message for required Yasm assembler
2023-02-13 11:09:39 +01:00
Robert Schulze
8b8ca25b18
Slightly improve error message for required Yasm assembler 2023-02-13 09:17:48 +00:00
Robert Schulze
da9119547e
What happens if MySQL is enabled for macOS? 2023-02-12 23:08:14 +01:00
Nikolay Degterinsky
a7603aad69
Merge pull request #46096 from HarryLeeIBM/hlee-s390x-checksum
Fix endian issue in CityHash for s390x
2023-02-12 21:46:30 +01:00
Nikolay Degterinsky
01d904daf7
Merge pull request #46280 from Algunenano/zstd_154
Update zstd to 1.5.4
2023-02-11 17:19:04 +01:00
Raúl Marín
88e03016a8 Update zstd to 1.5.4 2023-02-10 16:41:02 +01:00
Alexey Milovidov
92ca58fbb2
Merge branch 'master' into curl_update 2023-02-10 07:28:56 +03:00
Larry Luo
59d380c4a2 Avoid CVE-2022-40303 CVE-2022-40304 2023-02-09 12:29:42 -08:00
Suzy Wang
64313d7020
Merge branch 'master' into z-build-0120 2023-02-09 14:49:22 -05:00
bkuschel
0d61ab29f7
Update Curl to 7.87.0 2023-02-09 12:55:05 -05:00
Alexey Milovidov
d9fbf643bc
Merge pull request #45226 from hanfei1991/hanfei/gwp-asan
Introduce llvm/gwp-asan
2023-02-09 09:24:52 +03:00
Kruglov Pavel
979ccda629
Merge pull request #46139 from ClibMouse/capnproto_update_2065
update CapnProto to v0.10.3 to avoid CVE-2022-46149
2023-02-08 22:43:24 +01:00
Robert Schulze
f97880840a
Complain about missing Yasm at configure time at of build time 2023-02-08 13:17:42 +00:00
Kseniia Sumarokova
6160db6569
Merge pull request #44949 from ClibMouse/HDFS_PowerPC
Changes to support the HDFS in Power PC.
2023-02-08 12:17:15 +01:00
Robert Schulze
b79ead9c84
Move poco to base/poco/ (#46075)
* Replicate poco into base/poco/

* De-register poco submodule

* Build poco from ClickHouse

* Exclude poco from stylecheck

* Exclude poco from whitespace check

* Exclude poco from typo check

* Remove x bit from sources/headers (the style check complained)

* Exclude poco from duplicate include check

* Fix fasttest

* Remove contrib/poco-cmake/*

* Simplify poco build descriptions

* Remove poco stuff not used by ClickHouse

* Glob poco sources

* Exclude poco from clang-tidy
2023-02-08 12:04:11 +01:00
Antonio Andelic
3418a8e955 use master for aws 2023-02-08 10:07:30 +00:00
SadiHassan
b3d8dd766f update CapnProto to v0.10.3 to avoid CVE-2022-46149 2023-02-07 14:47:28 -08:00
Nikolay Degterinsky
e5b5fce970
Update liburing CmakeLists.txt 2023-02-07 18:11:43 +01:00
MeenaRenganathan22
2445a391fb Updating the libhdfs3 to reflect the revert of PR#21 2023-02-07 09:05:12 -05:00
Han Fei
0f7defb87f
Merge branch 'master' into hanfei/gwp-asan 2023-02-07 14:55:55 +01:00
HarryLeeIBM
3f78c86b31 Fix endian issue in CityHash for s390x 2023-02-06 15:51:08 -08:00
MeenaRenganathan22
e8f45ddf59 Updating the submodule to reflect the latest changes i.e revert of PR#24 2023-02-06 10:22:29 -05:00
Anton Popov
3850a1969d
Merge branch 'master' into fix-memory-leak-azure 2023-02-06 16:21:56 +01:00
MeenaRenganathan22
722e389847 Updating the submodule to the local branch HDFS_PowerPC 2023-02-03 17:45:48 -08:00
Anton Popov
e9f80c650a fix memory leak at creation of curl connection in azure sdk 2023-02-03 20:10:39 +00:00
Antonio Andelic
d5117f2aa6
Define S3 client with bucket and endpoint resolution (#45783)
* Update aws

* Define S3 client with bucket and endpoint resolution

* Add defines for ErrorCodes

* Use S3Client everywhere

* Remove unused errorcode

* Add DROP S3 CLIENT CACHE query

* Add a comment

* Fix style

* Update aws

* Update reference files

* Add missing include

* Fix unit test

* Remove unneeded declarations

* Correctly use RetryStrategy

* Rename S3Client to Client

* Fix retry count

* fix clang-tidy warnings
2023-02-03 14:30:52 +01:00
Anton Popov
cdbe145bc1
Merge pull request #45796 from CurtizJ/fix-leak-in-azure-sdk
Fix test `test_azure_blob_storage_zero_copy_replication ` (memory leak in azure sdk)
2023-02-03 14:16:19 +01:00
MeenaRenganathan22
7435ba1e3d Updating the submodule and CMakeLists.txt 2023-02-02 17:36:03 -08:00
jasperzhu
38a73c9bfe
Merge branch 'master' into iaadeflate_upgrade_qpl_v1.0.0 2023-02-02 10:20:49 +08:00
jinjunzh
d60fe99c4e Merge branch 'iaadeflate_upgrade_qpl_v1.0.0' of https://github.com/jinjunzh/ClickHouse into iaadeflate_upgrade_qpl_v1.0.0 2023-02-02 09:28:33 -05:00
jinjunzh
4089c34337 move the content of idxd-config-cmake into QPL-cmake 2023-02-02 09:26:27 -05:00
jinjunzh
40e9834313 Merge branch 'iaadeflate_upgrade_qpl_v1.0.0' of https://github.com/jinjunzh/ClickHouse into iaadeflate_upgrade_qpl_v1.0.0 2023-02-01 09:49:46 -05:00
jinjunzh
2a42c1314b Improved code detals according to suggestions 2023-02-01 09:45:06 -05:00
Robert Schulze
a92595890c
Merge pull request #45670 from HarryLeeIBM/hlee-s390x-snappy-endian
Fix endian issue in snappy lib for s390x
2023-02-01 11:55:07 +01:00
Antonio Andelic
a3e3b65b32
Merge branch 'master' into keeper-use-fallocate 2023-02-01 09:05:49 +01:00
Alexey Milovidov
bf9f62dcbd
Merge pull request #38456 from sauliusvl/iouring
Re-introduce io_uring read method
2023-02-01 06:41:32 +03:00
jasperzhu
7ee8af9123
Merge branch 'master' into iaadeflate_upgrade_qpl_v1.0.0 2023-02-01 10:42:19 +08:00
jinjunzh
3bc0c13ea0 Update QPL version from v0.3.0 to v1.0.0 2023-01-31 09:31:26 -05:00
jinjunzh
d1d5f06260 add libaccel-config as submodule and static link to QPL 2023-01-31 09:24:43 -05:00
Han Fei
716518f143
Merge branch 'master' into hanfei/gwp-asan 2023-01-31 15:01:25 +01:00
Antonio Andelic
1786237be6 Merge branch 'master' into keeper-use-fallocate 2023-01-31 13:53:47 +00:00
Robert Schulze
ffa00fc134
Merge pull request #45632 from ClibMouse/icudata_s390x_support
support icudata on s390x platform
2023-01-31 12:27:09 +01:00
jasperzhu
53ed394447
Merge branch 'master' into iaadeflate_upgrade_qpl_v1.0.0 2023-01-31 11:12:31 +08:00
Alexey Milovidov
7aa10a430a
Merge branch 'master' into hanfei/gwp-asan 2023-01-31 04:13:59 +03:00
Anton Popov
839cd614fb fix memory leak in azure sdk 2023-01-31 01:01:10 +00:00
Robert Schulze
19b3c1cc3f
Merge pull request #45519 from ClibMouse/fix_krb5_openssl
Fix krb5 for OpenSSL
2023-01-30 11:48:32 +01:00
Robert Schulze
49b7c45686
Add note about OpenSSL 2023-01-29 20:03:50 +00:00
Saulius Valatka
a7d1e62054 bump liburing 2023-01-28 21:54:44 +02:00
Saulius Valatka
fb45ed038f add liburing to build 2023-01-28 21:54:44 +02:00
MeenaRenganathan22
9f43446959 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into HDFS_PowerPC 2023-01-27 10:08:26 -05:00
Robert Schulze
dae708c588
Merge pull request #45593 from genzgd/update_poco_http
Update poco version
2023-01-27 00:08:24 +01:00
HarryLeeIBM
27857901eb Fix endian issue in snappy lib for s390x 2023-01-26 07:20:08 -08:00
Antonio Andelic
80e7dca288 Update NuRaft 2023-01-26 10:08:24 +00:00
Antonio Andelic
f02a763830
Merge pull request #45511 from ClickHouse/keeper-fix-race-asio-listener
Fix race in NuRaft's asio listener
2023-01-26 09:21:03 +01:00
bkuschel
5aa3c10c3f
Fix Cmake 2 2023-01-25 17:58:09 -05:00
SuzyWangIBMer
e3c286de29 support icudata on s390x platform 2023-01-25 22:53:03 +00:00
bkuschel
748c3ad015
Fix build error 2023-01-25 13:35:31 -05:00
bkuschel
d6d2414ef8 Remove aes.c and use the one krb5 2023-01-25 13:29:54 -05:00
bkuschel
ec1e0bde6b Update krb5 2023-01-25 13:29:54 -05:00
Antonio Andelic
e7a86998ef Fix race more 2023-01-25 11:46:59 +00:00
Antonio Andelic
7421d8f872 Merge branch 'master' into keeper-use-fallocate 2023-01-25 11:36:47 +00:00
MeenaRenganathan22
6f76ecfdb5 Committing the libhdfs3-cmake/CMakeLists.txt to include the IntelAsmCrc32c.cpp and perf_checksum.cpp 2023-01-24 20:33:25 -05:00
MeenaRenganathan22
359775a1cf Updated yhe libhdfs3 submoule 2023-01-24 20:31:33 -05:00
Geoff Genz
909cb9b6b1 Update poco version 2023-01-24 16:40:01 -07:00
MeenaRenganathan22
78a4c8a270 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into HDFS_PowerPC 2023-01-24 11:30:52 -05:00
Kruglov Pavel
689fbea759
Merge pull request #45478 from Avogar/fix-arrow-abort
Fix possible aborts in arrow lib
2023-01-24 16:37:44 +01:00
Antonio Andelic
71f754b6f6 Fix race in NuRaft 2023-01-24 11:16:55 +00:00
Suzy Wang
1176260b3c
Merge branch 'master' into z-build-0120 2023-01-24 01:14:42 -05:00
Suzy Wang
b7ba24945f fix build 2023-01-23 22:09:08 -08:00
Suzy Wang
fb46b5ed4d s390x support 2023-01-23 14:20:49 +00:00
Suzy Wang
19d26828a0 s390x build support 2023-01-20 21:16:55 +00:00
avogar
4432ee9927 Fix aborts in arrow lib 2023-01-20 16:40:33 +00:00
Han Fei
8b29f8406b
Merge branch 'master' into hanfei/gwp-asan 2023-01-20 11:03:12 +01:00
MeenaRenganathan22
f66dbf6372 Committing the CMakeLists.txt with IntelAsmCrc32c.cpp and perf_checksum.cpp 2023-01-18 13:47:16 -05:00
MeenaRenganathan22
c6c4246314 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into HDFS_PowerPC 2023-01-18 10:09:07 -05:00
Han Fei
29b20775f7 not compile gwp in non-linux environment 2023-01-17 23:06:44 +01:00
Alexander Tokmakov
e7899825e6 save format strings for DB::Exceptions 2023-01-16 23:20:33 +01:00
Nikolay Degterinsky
d414d4aa7a Merge remote-tracking branch 'upstream/master' into bcrypt 2023-01-16 22:14:03 +00:00
MeenaRenganathan22
9f571d3e93 Updating the submodules libhdfs3 and libgsasl 2023-01-16 08:28:03 -05:00
Alexander Tokmakov
2d7773fccc Merge branch 'master' into text_log_add_pattern 2023-01-13 20:33:46 +01:00
Han Fei
7feb9b7f6f Merge branch 'master' into hanfei/gwp-asan 2023-01-13 20:26:34 +01:00
MeenaRenganathan22
245bcaa75a Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into HDFS_PowerPC 2023-01-13 12:49:41 -05:00
Han Fei
214830c569 enable gwp_asan by option 2023-01-13 15:22:14 +01:00
Robert Schulze
9779d034eb
Merge pull request #45144 from ClibMouse/crc-power-fix
Changes to support the CRC32 in PowerPC.
2023-01-13 11:24:18 +01:00
Han Fei
f5e736e240 introduce llvm/gwp-asan 2023-01-12 15:00:26 +01:00
Antonio Andelic
6a0e481ed7 Merge branch 'master' into keeper-use-fallocate 2023-01-12 13:57:05 +00:00
alesapin
3245e822ef Update merge 2023-01-12 12:55:50 +01:00
MeenaRenganathan22
28d5c3cf7f Addressed the review comments 2023-01-11 17:00:10 -08:00
alesapin
e581a56ed0 Better 2023-01-11 15:30:48 +01:00
alesapin
fe8f373aa6 Less stupid tests 2023-01-11 15:20:18 +01:00
MeenaRenganathan22
25c94dfa83 Changes to support the CRC32 in PowerPC to address the WeakHash collision issue. Update the reference to support the hash values based on the specific platform 2023-01-10 21:20:13 -08:00
Meena Renganathan
ba5111905e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into HDFS_PowerPC 2023-01-10 19:13:13 -05:00
alesapin
9b16b3f48f Fix potential memory leak 2023-01-11 01:03:01 +01:00
Alexey Milovidov
4995ce945e Fix TSan report in SQLite (false positive) 2023-01-08 05:40:48 +01:00
Alexey Milovidov
77708b4a03 Update SQLite 2023-01-08 05:22:56 +01:00
Ilya Yatsishin
2703b47d31
Merge pull request #44942 from vitlibar/fix-memory-leak-in-aws-init
Fix memory leak in Aws::InitAPI
2023-01-06 12:12:46 +01:00
Vitaly Baranov
239734ceb6 Fix memory leak in Aws::InitAPI. 2023-01-06 00:40:18 +01:00
Meena Renganathan
06e44827a3 Added the file DataReader.cpp in source list when the HDFS submodule has been updated to the latest commit 2023-01-05 15:21:31 -05:00
Meena Renganathan
ba0edb310f Changes to support the HDFS in PowerPC 2023-01-05 15:21:14 -05:00
Yakov Olkhovskiy
1be48f706b
Merge pull request #43706 from ClibMouse/s390x_crc32
s390x weakhash32 support
2023-01-05 14:45:20 -05:00
Robert Schulze
a4322b3057
Merge pull request #44894 from ClickHouse/upgrade-googletest
Upgrade googletest to latest HEAD
2023-01-04 21:49:56 +01:00
Nikolay Degterinsky
aa52956412 Add bcrypt authentification type 2023-01-04 15:33:16 +00:00
alesapin
92255e5d4b
Merge pull request #43020 from vitlibar/update-aws-c-submodules
Update aws-c* submodules
2023-01-04 16:25:22 +01:00
Robert Schulze
23196ceffd
Upgrade googletest to their lastest main state 2023-01-04 10:44:39 +00:00
Nikolay Degterinsky
57b3fbf206 Fix build 2023-01-04 02:24:14 +00:00
Nikolay Degterinsky
c6daf0a6eb Merge remote-tracking branch 'upstream/master' into ulid 2023-01-03 19:58:50 +00:00
Robert Schulze
27f5aad49e
What happens if I remove 156 lines of code? 2023-01-03 18:51:16 +00:00
Robert Schulze
cfb6feffde
What happens if I remove these 139 lines of code? 2023-01-03 18:35:31 +00:00
Antonio Andelic
14355d8009 Merge branch 'master' into keeper-use-fallocate 2023-01-02 08:22:27 +00:00
Vitaly Baranov
9014be8968 Fix disable loading EC2 metadata by aws-sdk-core. 2022-12-29 12:26:43 +01:00
Nikolay Degterinsky
7bb8db4bb3 Add generateULID function 2022-12-28 00:54:50 +00:00
avogar
5c42b78766 Forbid paths in timezones in cctz lib 2022-12-27 17:52:38 +00:00
Alexey Milovidov
3342b84321
Merge pull request #44569 from ClickHouse/stack-traces-debug-build
Fix extremely slow stack traces in debug build
2022-12-27 14:31:35 +03:00
Vitaly Baranov
c7e1aa2ea0 Fix finding pthread_atfork() while linking ppc64le build. 2022-12-25 18:24:35 +01:00
Vitaly Baranov
dffeb2a54a Disable memory sanitizer for events from epoll 2022-12-25 18:24:35 +01:00
Vitaly Baranov
fea3a6280c Fix race condition in cJSON_Parse.* calls. 2022-12-25 18:24:35 +01:00
Vitaly Baranov
e23c42d042 Fix checking for embedded error in PocoHTTPClient. 2022-12-25 18:24:35 +01:00
Vitaly Baranov
1eb0d5db16 Disable loading EC2-metadata. 2022-12-25 18:24:35 +01:00
Vitaly Baranov
f8f598e298 Correctly handle that dlopen(NULL) returns NULL in ClickHouse. 2022-12-25 18:24:35 +01:00
Vitaly Baranov
8efb1ae7bb Fix support for boringssl. 2022-12-25 18:24:35 +01:00
Vitaly Baranov
665813e127 Remove subsubmodules contrib/aws/crt and contrib/aws-crt-cpp/crt
because they were moved to the contrib folder.
2022-12-25 18:24:35 +01:00
Vitaly Baranov
8e53b54082 Update AWS SDK to version 1.10.36 2022-12-25 18:24:35 +01:00
Vitaly Baranov
fa722c6cd8 Switch "contrib/sysroot" back to master. 2022-12-25 10:50:45 +01:00
Alexey Milovidov
4651a538a8 Fix extremely slow stack traces in debug build 2022-12-24 20:31:04 +01:00
Alexander Tokmakov
93509395fb add a column with a message pattern to text_log 2022-12-23 15:06:30 +01:00
Antonio Andelic
fcb78cd1d7 Update NuRaft 2022-12-19 12:05:15 +00:00
Alexey Milovidov
a3dc5e8b0a
Merge pull request #44132 from azat/bump-libdivide
Bump libdivide (to gain some new optimizations)
2022-12-17 04:07:08 +03:00
Azat Khuzhin
92d70c66e8 corrosion: export path to FindRust.cmake in CMAKE_MODULE_PATH
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-12-14 20:58:09 +01:00
Azat Khuzhin
440aa50588 corrosion: clean rules (remove useless message)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-12-14 20:57:01 +01:00
Azat Khuzhin
67fa185611
Revert "Builtin skim" 2022-12-14 17:17:19 +03:00
Azat Khuzhin
cdfe62f303 Update libdivide
This will includes at least [1].

  [1]: https://github.com/ridiculousfish/libdivide/pull/94

v2: Define LIBDIVIDE_* macros mutually exclusive
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-12-13 10:45:01 +01:00
Suzy Wang
093dc95d0f
Merge branch 'master' into s390x_crc32 2022-12-12 09:39:29 -05:00
Azat Khuzhin
67eab36086 corrosion-cmake: clean rules
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-12-11 15:51:37 +01:00
Alexey Milovidov
9a48cf0da8
Merge pull request #40422 from pkubaj/patch-1
Add FreeBSD/powerpc64le support
2022-12-11 09:38:04 +03:00
Alexey Milovidov
03648ab5a9
Merge pull request #43991 from ClibMouse/openssl_support
Add OpenSSL option to Clickhouse
2022-12-11 07:59:23 +03:00
Suzy Wang
1903a1b645
Merge branch 'master' into s390x_enable_base64 2022-12-09 16:15:39 -05:00
Suzy Wang
802f633f39
Merge branch 'master' into s390x_crc32 2022-12-09 15:00:46 -05:00
Boris Kuschel
cc3314acbe
Merge branch 'master' into openssl_support 2022-12-08 07:40:43 -05:00
Nikita Taranov
b81ad6aaf7
Add google benchmark to contrib (#43779)
* add google benchmark to contrib

* rework integer_hash_tables_and_hashes

* update readme

* keep benchmarks near the benchmarked code

* fix fasttests build

* rm old target

* fix
2022-12-08 13:38:08 +01:00
jinjunzh
47c3508337 fixed build issues for QPL 0.3.0 2022-12-07 16:41:12 -05:00
Boris Kuschel
f03f95044e OpenSSL code changes 2022-12-07 13:22:46 -05:00
Boris Kuschel
623f23f55d OpenSSL cmake changes 2022-12-07 13:22:46 -05:00
Boris Kuschel
6591e804c5 Add cmake support for openssl 2022-12-07 13:22:46 -05:00
Boris Kuschel
daab1fde8f Add OpenSSL submodule 2022-12-07 13:22:46 -05:00
Suzy Wang
75a298a275 fix cmake 2022-12-06 14:02:22 -08:00
jinjunzh
5206816b6c Update contrib/qpl to latest v0.3.0 2022-12-06 16:10:13 -05:00
Antonio Andelic
2623804dc5 Update NuRaft 2022-12-02 08:17:48 +00:00
Suzy Wang
e34af8602c
Merge branch 'master' into s390x_crc32 2022-12-01 11:02:43 -05:00
Suzy Wang
be16e0bce7 Include crc32_s390x as a submodule library 2022-12-01 07:43:32 -08:00
Antonio Andelic
c12c0cc8af Merge branch 'master' into parallel-log-appending 2022-12-01 08:53:52 +00:00
Antonio Andelic
0921356e91
Merge branch 'master' into parallel-log-appending 2022-11-30 09:42:38 +01:00
Alexey Milovidov
54e27d4230
Merge branch 'master' into build-libcxx-and-libcxxabi-from-llvm-project 2022-11-30 00:25:25 +01:00
Alexander Gololobov
e94ac23a4e Update Poco 2022-11-29 15:03:52 +01:00
Robert Schulze
829958e13a
Merge branch 'master' into build-libcxx-and-libcxxabi-from-llvm-project 2022-11-28 16:09:14 +01:00
Antonio Andelic
599f381217
Merge branch 'master' into parallel-log-appending 2022-11-26 09:04:27 +01:00
Nikita Taranov
d1c258cf20
Add xxh3 hash function (#43411)
* impl

* try fix

* add docs

* add test

* rm unused file

* excellent
2022-11-26 00:14:08 +01:00
Antonio Andelic
f79af2aea7 Merge branch 'master' into parallel-log-appending 2022-11-24 11:13:04 +00:00
Antonio Andelic
2d2c6eee30 Update NuRaft 2022-11-21 15:06:33 +00:00
Suzy Wang
d1a2af8670 Enable base64 on s390x platform 2022-11-16 13:01:10 -08:00
Azat Khuzhin
ddfea23804 Do not include libcxx library for C
If you will have the same header in both libraries you may have some
tricky failures.

And there is at least one header that exists in both: stdatomic.h

Right now there is a workaround for this header, that allows to use C++
version of this header for C - the workaround is called "set
_LIBCPP_COMPILER_CLANG_BASED not only for CXX" [1] and use include_next
[2].

  [1]: 9a457ab3c6/include/__config (L39)
  [2]: 9a457ab3c6/include/stdatomic.h (L223-L231)

However #42730 changes this, and now it fails to compile because of this.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-11 14:43:14 +01:00
Antonio Andelic
25b19e6ba0
Merge branch 'master' into manual_snapshot_for_keeper 2022-11-03 08:55:01 +01:00
Robert Schulze
c8068bdfa2
Merge pull request #42816 from azat/build/llvm-fix
Fix compilation of LLVM with cmake cache
2022-11-01 08:22:06 +01:00
Azat Khuzhin
b62170426a Fix compilation of LLVM with cmake cache
Simple reproducer:

    $ cmake
    $ ninja contrib/llvm-project/llvm/lib/MC/MCParser/CMakeFiles/LLVMMCParser.dir/MasmParser.cpp.o # will have -std=c++14
    $ touch CMakeLists.txt
    $ cmake
    $ ninja contrib/llvm-project/llvm/lib/MC/MCParser/CMakeFiles/LLVMMCParser.dir/MasmParser.cpp.o # will have -std=c++20 and fail
    (fails because std::vector cannot work with opaque types anymore)

Fixes: #42249 (cc @rschu1ze)
2022-10-31 10:56:05 +01:00
Alexey Milovidov
25d35a97f9 Update CCTZ to 2022f 2022-10-29 18:10:33 +02:00
Sema Checherinda
df3e4d26ad
Merge pull request #42463 from ClibMouse/update_zlib
Update zlib-ng to latest commit
2022-10-27 12:45:23 +02:00
Robert Schulze
a9427888be
Build libcxx and libcxxabi from llvm-project
Resolves #42245
2022-10-27 09:55:27 +00:00
Robert Schulze
31ef6c66cb
Merge pull request #42513 from ClickHouse/update-libcxx-to-15
Build with libcxx(abi) 15
2022-10-27 10:30:36 +02:00
Alexey Milovidov
8a56beb74a
Merge branch 'master' into update_zlib 2022-10-25 08:55:44 +02:00
Alexey Milovidov
c48127534b
Merge pull request #41753 from pkit/morton_coding
add Morton Coding (ZCurve)
2022-10-25 06:10:37 +02:00
Alexey Milovidov
dcf45e83a9
Merge branch 'master' into update_zlib 2022-10-25 05:08:09 +02:00
Robert Schulze
240637f8f1
Merge branch 'master' into update-libcxx-to-15 2022-10-24 11:11:01 +02:00
Robert Schulze
7243e12ef8
Fix build 2022-10-24 07:42:20 +00:00
Alexey Milovidov
729692f862
Merge pull request #42462 from ClibMouse/power_build_fix
Fix power8+ support add power9+ support
2022-10-24 09:30:38 +02:00
Robert Schulze
c119cd2f00
Merge branch 'master' into update-libcxx-to-15 2022-10-24 08:29:37 +02:00
JackyWoo
39c88c74e8 check whether last manually created snapshot is done 2022-10-22 22:31:17 +08:00
Yakov Olkhovskiy
d285c9e7ff move libfuzzer to dedicated contrib/libfuzzer-cmake 2022-10-21 14:04:01 +00:00
Yakov Olkhovskiy
bd33c4f180 add lib_fuzzer and lib_fuzzer_no_main to llvm-project build 2022-10-21 01:25:51 +00:00
Robert Schulze
eda3955f01
Update libcxx submodule 2022-10-20 14:50:51 +00:00
Robert Schulze
820e6b4276
Build with libcxx(abi) 15 2022-10-20 10:52:43 +00:00
Constantine Peresypkin
5b3b11b517 add Morton Coding (ZCurve) 2022-10-19 15:59:25 +02:00
Boris Kuschel
4645d465b1
update zlib-ng to latest 2022-10-18 17:38:06 -05:00
Boris Kuschel
e45c800cdf Fix power8+ support add power9+ support 2022-10-18 17:14:43 -05:00
Alexey Milovidov
87296eb90b Update CCTZ to 2022e. 2022-10-14 22:01:26 +02:00
Dom Del Nano
6bbbbda868 Update cctz to pull in upstream 2022e changes 2022-10-12 21:46:51 -07:00
Robert Schulze
50ae7d8484
Merge branch 'master' into cleanup-llvm 2022-10-12 10:02:55 +02:00
Robert Schulze
c08387eb0d
Minor cleanups of LLVM integration 2022-10-11 14:18:52 +00:00
Raúl Marín
dbed82e74c Fix LLVM build 2022-10-10 12:18:05 +02:00
Maksim Kita
4eb29f7428 Updated submodule 2022-10-07 10:55:08 +02:00
Alexey Milovidov
25d13b89e9
Merge pull request #41142 from MeenaRenganathan22/OpenSSL_InHouse
Changes to support the OpenSSL In-house build.
2022-10-05 23:02:04 +03:00
Kseniia Sumarokova
46c20a7197
Merge pull request #42031 from kssenii/update-amqp
Update amqp-cpp
2022-10-05 12:06:58 +02:00
Kseniia Sumarokova
7935337513
Update CMakeLists.txt 2022-10-04 19:59:08 +02:00
Robert Schulze
af8d32bb1f
Merge pull request #42023 from ClickHouse/llvm-without-clothes
Build against an LLVM version which has clang[-extra-tools], lldb and lld removed
2022-10-04 17:13:50 +02:00
Kseniia Sumarokova
aacb314a41
Update cmake 2022-10-04 16:15:33 +02:00
kssenii
620b0673d0 Update AMQP 2022-10-03 17:24:57 +02:00
Vitaly Baranov
65c61877c7
Merge pull request #33435 from BoloniniD/BLAKE3
Integrating Rust code into ClickHouse
2022-10-03 15:25:06 +02:00
Robert Schulze
aadb999913
Build against an LLVM version which has clang[-extra-tools], lldb and lld removed
Saves ca. 600 MB of disk space
2022-10-03 12:44:11 +00:00
Robert Schulze
aa9373c9c2
Merge pull request #41951 from ClickHouse/llvm-14
Bump LLVM from 13 to 14
2022-10-03 12:34:31 +02:00
BoloniniD
92e6bf57dc Remove old if-statement in corrosion-cmake 2022-10-02 22:29:47 +03:00
BoloniniD
a3c0b8e815
Fix CMake style in corrosion-cmake
Co-authored-by: Vitaly Baranov <vitlibar@yandex.ru>
2022-10-02 21:25:10 +03:00
Alexey Milovidov
2194c549ba
Merge pull request #41974 from ClibMouse/enable_base64_ppc64le
Enable lib base64 for powerpc platform
2022-10-01 18:10:08 +03:00
root
7e4edfeb5a Merge branch 'master' of https://github.com/MeenaRenganathan22/ClickHouse into OpenSSL_InHouse 2022-09-30 15:50:46 -07:00
root
4318ec125e Merge branch 'master' of https://github.com/MeenaRenganathan22/ClickHouse into OpenSSL_InHouse 2022-09-30 15:50:22 -07:00
root
bb1771e159 Update the macro ENABLE_CH_BUNDLE_BORINGSSLL to ENABLE_EXTERNAL_OPENSSL 2022-09-30 10:35:49 -07:00
BoloniniD
758d4b79fb Fix submodules 2022-09-30 20:31:01 +03:00
Suzy Wang
29c8023b7f Enable lib base64 for powerpc platform 2022-09-30 07:04:47 -07:00
Robert Schulze
4ac308a7a6
Update submodule + fix compile error 2022-09-30 09:23:41 +00:00
BoloniniD
55c79230b3 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-09-29 23:53:25 +03:00
Robert Schulze
32f0aa75e6
Bump to LLVM 14 2022-09-29 19:16:11 +00:00
Robert Schulze
a300ea6024
Try to fix binary compatibility check + extend check to library-bridge 2022-09-28 09:56:58 +00:00
Robert Schulze
9c62797d28
Bump LLVM from 12 to 13 2022-09-26 07:13:46 +00:00
Nikolay Degterinsky
6edf8ec3f2 Better S3 logs 2022-09-22 22:34:13 +00:00
BoloniniD
7642212ff8 Fix find_package(Rust) for corrosion-cmake 2022-09-22 21:53:55 +03:00
Alexey Milovidov
33c751a561
Merge pull request #41603 from ClickHouse/cut-openldap
Update OpenLDAP library
2022-09-22 07:26:01 +03:00
Alexey Milovidov
2d6350b114 Update OpenLDAP library 2022-09-21 06:27:10 +02:00
Filatenkov Artur
2139d5be17
Merge branch 'master' into annoy 2022-09-20 15:28:08 +03:00
FArthur-cmd
14c963e4ee update submodule 2022-09-20 11:29:13 +03:00
BoloniniD
55fcb98f29 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-09-19 21:53:14 +03:00
BoloniniD
4f2915c8f7 Fix aarch64-darwin build 2022-09-19 21:52:57 +03:00
BoloniniD
5b4fb4bf66
Merge branch 'master' into BLAKE3 2022-09-18 23:14:37 +03:00
BoloniniD
7b5d3e3d82 Fix Rust installation for Corrosion 2022-09-18 23:14:16 +03:00
Alexey Milovidov
3eb7ee8308 Remove noise from build process 2022-09-18 10:35:25 +02:00
Alexey Milovidov
7e93dbfcd6
Merge pull request #41094 from HarryLeeIBM/hlee-s390x-zlib-ng
Fix zlib-ng build issue for s390x
2022-09-18 07:55:20 +03:00
Alexey Milovidov
59d05b949b
Merge branch 'master' into bump-replxx 2022-09-17 22:49:34 +03:00
BoloniniD
627dea333e Merge branch 'master' into BLAKE3 2022-09-17 22:14:30 +03:00
Alexander Tokmakov
42dab6dc02 Revert "Merge pull request #38200 from ClickHouse/keeper-linearizable-reads"
This reverts commit 222b964070, reversing
changes made to da01982652.
2022-09-17 19:22:58 +02:00
BoloniniD
1c0047dbff Review fixes 2022-09-17 16:34:19 +03:00
Alexey Milovidov
cb45f51e51
Merge branch 'master' into bump-replxx 2022-09-17 03:22:10 +03:00
BoloniniD
452ef4435b Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-09-16 20:05:56 +03:00
Robert Schulze
545893f56a
Merge pull request #41239 from ClickHouse/bundled-c-ares
Bundle c-ares 3rd-party library
2022-09-16 12:06:54 +02:00
Antonio Andelic
222b964070
Merge pull request #38200 from ClickHouse/keeper-linearizable-reads
Keeper faster linearizable reads
2022-09-16 07:58:52 +02:00
Alexey Milovidov
da01982652
Merge pull request #41046 from azat/build/llvm-15
Switch to llvm/clang 15
2022-09-16 07:31:06 +03:00
Robert Schulze
2b9938fb3a
Merge branch 'master' into bundled-c-ares 2022-09-16 02:15:19 +02:00
BoloniniD
0df426d329 Corrosion fixes + review fixes 2022-09-16 00:05:21 +03:00
Antonio Andelic
761d53b438 Use merged NuRaft 2022-09-15 16:14:45 +00:00
Antonio Andelic
0dbd0c1f72 Merge branch 'master' into keeper-linearizable-reads 2022-09-15 16:03:18 +00:00
Robert Schulze
065e668182
Merge branch 'master' into bundled-c-ares 2022-09-14 09:31:06 +02:00
Robert Schulze
5aedf60689
fix: repair aarch64 build 2022-09-13 20:51:51 +00:00
Robert Schulze
fb5812f554
Bump vectorscan to 5.4.8
Brings good stuff like
- https://github.com/VectorCamp/vectorscan/pull/119
- https://github.com/VectorCamp/vectorscan/pull/118
2022-09-13 17:06:09 +00:00
Robert Schulze
d2d6e6787b
style: remove obsolete comments 2022-09-13 17:42:57 +02:00
Robert Schulze
5fcad783d2
fix: make musl build work 2022-09-13 07:21:27 +00:00
Robert Schulze
134def1cff
build: bundle c-ares 2022-09-12 20:36:35 +00:00
BoloniniD
147dfac11e Try using Corrosion 2022-09-12 23:05:41 +03:00
Meena Renganathan
51d6611b96 Committing the ClickHouse core changes and other libraries to support OpenSSL. BoringSSL is still set as default 2022-09-12 09:05:38 -07:00
Alexey Milovidov
485262991e
Merge pull request #41033 from ClickHouse/regen-vectorscan-assets
Regenerate vectorscan assets with latest and greatest ragel/colm
2022-09-11 22:57:39 +03:00
Azat Khuzhin
3c47d5bbff Add a workaround for strerror_r() libpq for FreeBSD (for clang-15)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:35 +02:00
Azat Khuzhin
38c0b0ee50 Add a workaround for krb5 and musl for strerror_r()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:35 +02:00
Azat Khuzhin
0bb835c66e Add a workaround for clang-15 in libpq for strerror_r()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:35 +02:00
Azat Khuzhin
95b3a02779 Fix strerror_r() configuration for jemalloc with musl under clang-15
Build error [1]:

    Sep 06 18:40:53 FAILED: contrib/jemalloc-cmake/CMakeFiles/_jemalloc.dir/__/jemalloc/src/malloc_io.c.o
    Sep 06 18:40:53 /usr/bin/ccache /usr/bin/clang-15 --target=x86_64-linux-musl --sysroot=/build/cmake/linux/../../contrib/sysroot/linux-x86_64-musl -DHAS_RESERVED_IDENTIFIER -DJEMALLOC_NO_PRIVATE_NAMESPACE -DJEMALLOC_PROF=1 -DJEMALLOC_PROF_LIBGCC=1 -DSTD_EXCEPTION_HAS_STACK_TRACE=1 -DUSE_MUSL=1 -D_LIBCPP_ENABLE_THREAD_SAFETY_ANNOTATIONS -D_LIBCPP_HAS_MUSL_LIBC=1 -I../contrib/jemalloc/include -isystem ../contrib/jemalloc-cmake/include -isystem contrib/jemalloc-cmake/include_linux_x86_64_musl/jemalloc/internal -isystem ../contrib/libcxx/include -isystem ../contrib/libcxxabi/include -isystem ../contrib/libunwind/include --gcc-toolchain=/build/cmake/linux/../../contrib/sysroot/linux-x86_64-musl --gcc-toolchain=/build/cmake/linux/../../contrib/sysroot/linux-x86_64-musl -fdiagnostics-color=always -Xclang -fuse-ctor-homing  -gdwarf-aranges -pipe -mssse3 -msse4.1 -msse4.2 -mpclmul -mpopcnt -fasynchronous-unwind-tables -ffile-prefix-map=/build=. -falign-functions=32 -mbranches-within-32B-boundaries  -fdiagnostics-absolute-paths -fexperimental-new-pass-manager -w -O2 -g -DNDEBUG -O3 -g -gdwarf-4  -flto=thin -fwhole-program-vtables -fno-pie   -D OS_LINUX -D_GNU_SOURCE -Werror -std=gnu11 -MD -MT contrib/jemalloc-cmake/CMakeFiles/_jemalloc.dir/__/jemalloc/src/malloc_io.c.o -MF contrib/jemalloc-cmake/CMakeFiles/_jemalloc.dir/__/jemalloc/src/malloc_io.c.o.d -o contrib/jemalloc-cmake/CMakeFiles/_jemalloc.dir/__/jemalloc/src/malloc_io.c.o   -c ../contrib/jemalloc/src/malloc_io.c
    Sep 06 18:40:53 /build/contrib/jemalloc/src/malloc_io.c💯8: error: incompatible integer to pointer conversion initializing 'char *' with an expression of type 'int' [-Wint-conversion]
    Sep 06 18:40:53         char *b = strerror_r(err, buf, buflen);
    Sep 06 18:40:53               ^   ~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    Sep 06 18:40:53 1 error generated.

  [1]: https://s3.amazonaws.com/clickhouse-builds/41046/0e9265ad951d40cdce3716fb8a679360b2e0c156/package_release/build_log.log

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:35 +02:00
Azat Khuzhin
32d9bb5a7e Update sentry for clang-15 (to fix __msan_unpoison())
CI: https://s3.amazonaws.com/clickhouse-builds/41046/0e9265ad951d40cdce3716fb8a679360b2e0c156/package_msan/build_log.log
Refs: https://github.com/ClickHouse/sentry-native/pull/5
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Azat Khuzhin
aed0897e77 Update libcpuid for clang-15 (for snprintf())
CI: https://s3.amazonaws.com/clickhouse-builds/41046/0e9265ad951d40cdce3716fb8a679360b2e0c156/binary_freebsd/build_log.log
Refs: https://github.com/ClickHouse/libcpuid/pull/2
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Azat Khuzhin
e1cfde8a86 Update librdkafka for clang-15 (do not set _POSIX_C_SOURCE on FreeBSD)
Refs: https://github.com/ClickHouse/librdkafka/pull/7
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Azat Khuzhin
50cc4a6a1f Update llvm to add ability to preserve debug symbols
There are some issues with JIT, you will find details in a patch that
disables one function for it, and it will be great to have an ability to
get full backtrace for this problem during investigations.

Refs: https://github.com/ClickHouse/llvm/pull/9
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Azat Khuzhin
c214875a36 Bump replxx to fix possible uncaught exception
Refs: https://github.com/ClickHouse/replxx/pull/24
2022-09-09 22:02:45 +02:00
Azat Khuzhin
62a105f216 Update capnproto to v0.10.2 (to address issue with ASan in clang-15)
This should address issue with ASan:

- CI report - https://s3.amazonaws.com/clickhouse-test-reports/41046/490a2c75610c4bc3191d55226f8454b3c3d3919a/stateless_tests__asan__[1/2].html

    2022-09-08 19:39:40 kj/exception.c++:977: failed: expected offset < 65536 && offset > -65536; ExceptionCallback must be allocated on the stack.

- Discussion in ML - https://www.mail-archive.com/capnproto@googlegroups.com/msg01451.html

- Fix capnproto/capnproto@c4eef80a13

    "Fix ASAN problems under Clang 15.

    It appears ASAN now by default tries to detect stack-use-after-return. This breaks our assumptions in requireOnStack() and totally breaks fibers.

    For requireOnStack() we can just skip the check in this case.

    For fibers, we need to implement the ASAN hints to tell it when we're switching fibers."

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-09 19:56:25 +02:00
BoloniniD
e8bcbcd016
Merge branch 'master' into BLAKE3 2022-09-09 11:48:31 +03:00
BoloniniD
ff82784b91 Fix MSAN test 2022-09-08 23:41:18 +03:00
Robert Schulze
0df6173e4a
Merge remote-tracking branch 'origin/master' into regen-vectorscan-assets 2022-09-08 08:37:30 +00:00
BoloniniD
c08b41b611 Clean files and compatibility code 2022-09-08 09:34:59 +03:00
Robert Schulze
9b868f8b7d
doc: add note about upstream colm/ragel 2022-09-07 20:10:17 +00:00
Robert Schulze
151bf1e074
fix: suppress warnings for ARM ragel assets 2022-09-07 20:08:31 +00:00
HarryLeeIBM
af603f9ac6 Fix zlib-ng build for s390x 2022-09-07 12:20:39 -07:00
Robert Schulze
d1d6e5cb23
fix: build ragel assets for amd64 and aarch64 separately 2022-09-07 11:56:09 +00:00
Antonio Andelic
61398cee80 Merge branch 'master' into keeper-linearizable-reads 2022-09-07 10:25:35 +00:00
Robert Schulze
c4297c6c99
fix: disable narrowing warnings 2022-09-06 22:02:02 +00:00
Robert Schulze
0e363ca6e3
chore: regenerate vectorscan assets with ragel/colm head 2022-09-06 21:15:30 +00:00
BoloniniD
d635c3f9be Disable BLAKE3 for aarch64-darwin 2022-09-06 21:22:40 +03:00
Robert Schulze
cc1bd3ac36
fix: disable vectorscan when building w/o SSE >=3 2022-09-06 16:15:50 +00:00
Filatenkov Artur
7949b3fb74
Merge branch 'master' into annoy 2022-09-06 11:23:15 +03:00
FArthur-cmd
7f311ad03c add words about setting to docs 2022-09-05 13:20:49 +00:00
FArthur-cmd
9096b73084 add setting 2022-09-05 12:41:46 +00:00
Kruglov Pavel
582216a3ca
Merge pull request #39919 from pzhdfy/UniqSketch
UniqThetaSketch support set operation such as union/intersect/not
2022-09-05 13:42:14 +02:00
Antonio Andelic
110ad53300 Merge branch 'master' into keeper-linearizable-reads 2022-09-05 07:12:45 +00:00
alesapin
3da9e8646d
Merge pull request #40941 from ClickHouse/keeper-fix-shutdown-increase-request-size
Fix in Keeper shutdown during long commit and increase allowed request size
2022-09-04 13:39:33 +02:00
Antonio Andelic
396500aaa7 Update NuRaft 2022-09-02 13:14:33 +00:00
Azat Khuzhin
dd8478422a Fix usage of generator expressions for libcxx cmake
Before, if you store clickhouse sources in /src, there was a typo and it
produce the following error:

    CMake Error in contrib/libcxx-cmake/CMakeLists.txt:
      Target "cxx" INTERFACE_INCLUDE_DIRECTORIES property contains path:

        "/src"

      which is prefixed in the source directory.

Also move "src" into PRIVATE, since it is required only for libcxx
itself.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-02 14:21:43 +02:00
Fangyuan Deng
bc7d661668
Merge branch 'master' into UniqSketch 2022-09-01 19:31:53 +08:00
Antonio Andelic
9acb253334 Update NuRaft 2022-09-01 08:44:20 +00:00
Antonio Andelic
91aff95298 Merge branch 'master' into keeper-linearizable-reads 2022-09-01 08:43:50 +00:00
Filatenkov Artur
899a2e29df
Enable UBsan 2022-08-31 16:44:52 +03:00
Antonio Andelic
97fd3d9123
Merge branch 'master' into fix-install-snapshot 2022-08-31 08:42:00 +02:00
Fangyuan Deng
5c2f35c302
Merge branch 'master' into UniqSketch 2022-08-31 10:23:46 +08:00
FArthur-cmd
941cceda7f fix build 2022-08-30 23:09:22 +00:00
FArthur-cmd
c7d31c3a90 fix indexes for ColumnArray 2022-08-30 15:32:05 +00:00
FArthur-cmd
e7abc06c89 Revert "Revert "Add Annoy index""
This reverts commit 6fdfb964d0.
2022-08-30 15:26:56 +00:00
Alexander Tokmakov
6fdfb964d0
Revert "Add Annoy index" 2022-08-30 15:10:10 +03:00
pzhdfy
92f88c1429 update datasketches-cpp 2022-08-30 20:02:47 +08:00
Alexander Tokmakov
44c6c85f75
Merge pull request #40756 from ClickHouse/libuv_update
Merging #39398
2022-08-30 14:38:50 +03:00
Alexander Tokmakov
ff2db8e2a7 update submodule 2022-08-29 16:46:21 +02:00
FArthur-cmd
c6e45fe690 remove build with UBSan 2022-08-29 09:18:15 +00:00
Antonio Andelic
b4af21b6fb Small fixes 2022-08-29 07:06:51 +00:00
FArthur-cmd
f3d0083e57 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into annoy-2 2022-08-26 13:53:53 +00:00
Antonio Andelic
dae65178b7 Improve preprocessing performance 2022-08-26 10:46:14 +00:00
Antonio Andelic
4bbcbda7cc NuRaft fix for install snapshot 2022-08-25 14:12:17 +00:00
BoloniniD
78d00c3371 Add glibc symbols to glibc_compatibility 2022-08-24 21:30:48 +03:00
Antonio Andelic
073b168b31 add msg type string for leader status 2022-08-24 07:50:08 +00:00
Antonio Andelic
99d23cb67e Merge branch 'master' into keeper-linearizable-reads 2022-08-23 07:03:20 +00:00
BoloniniD
c7a6c4d56f Test with Ubuntu 14.04 static libs 2022-08-22 20:09:37 +03:00
Antonio Andelic
af02c76a3c
Merge branch 'master' into keeper-listen-host 2022-08-21 18:43:55 +02:00
FArthur-cmd
1e8910f048 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into annoy-2 2022-08-21 08:45:03 +00:00
pkubaj
17f757a94c Add FreeBSD/powerpc64le support 2022-08-19 21:41:03 +02:00
BoloniniD
a30d43ba19 Add RUSTFLAGS to link crates to glibc 2022-08-19 21:45:19 +03:00
Suzy Wang
c273ef125d
Merge branch 'master' into libuv_update 2022-08-18 16:30:52 -04:00
BoloniniD
256d4a5e61 Move -l rustc flag out of target part 2022-08-18 23:26:44 +03:00
Alexey Milovidov
aaf6a3c862
Merge pull request #40184 from ClickHouse/update-cctz
Update cctz
2022-08-18 10:13:04 +03:00
Antonio Andelic
26b7117b6c Merge branch 'master' into keeper-listen-host 2022-08-18 07:05:20 +00:00
BoloniniD
eba479101a Fix glibc compat 2022-08-17 21:03:35 +03:00
Suzy Wang
9d14397a2a rm duplicated declaration 2022-08-17 08:15:08 -07:00
Antonio Andelic
833c4bc5f6 Update commit for NuRaft 2022-08-17 09:28:57 +00:00
Robert Schulze
2110d4334b
Merge pull request #40272 from ClibMouse/librdkafka_update
(negligible) rdkafka library: update lz4.c from upstream, cve fixes
2022-08-17 10:32:33 +02:00
Antonio Andelic
b5358ba8de Merge branch 'master' into keeper-listen-host 2022-08-17 08:31:43 +00:00
Suzy Wang
6539273c86 update lz4.c from upstream, cve fixes 2022-08-16 06:50:37 -07:00
Suzy Wang
ec7f89f287 Update libuv commits, pull changes from upstream 2022-08-15 12:47:23 -07:00
Suzy Wang
cceab1cd3e Merge remote-tracking branch 'upstream/master' into libuv_update 2022-08-15 12:27:29 -07:00
BoloniniD
1691a8b3f5 Merge branch 'BLAKE3' of github.com:BoloniniD/ClickHouse into BLAKE3 2022-08-15 20:44:49 +03:00
BoloniniD
00b57b8af8 Fix compatibility with glibc 2022-08-15 20:44:31 +03:00
FArthur-cmd
1d048432a1 update contrib and update cmake 2022-08-15 14:35:51 +00:00
Alexey Milovidov
970d482469 Merge branch 'master' into update-cctz 2022-08-14 04:49:29 +02:00
Alexey Milovidov
055c80d80c Update cctz 2022-08-13 07:48:11 +02:00
Alexey Milovidov
a6a51f4fb8 Minor build changes 2022-08-13 06:39:20 +02:00
avogar
347ffbf178 Fix special build 2022-08-10 14:19:27 +00:00
avogar
4c102adaf3 Fix deadlock with msan 2022-08-09 11:39:40 +00:00
Kruglov Pavel
704bdd08ec
Merge branch 'master' into revert-39804-revert-39510-update-arrow 2022-08-08 15:51:29 +02:00
Antonio Andelic
3b1117dafd use correct NuRaft commit 2022-08-08 11:12:12 +00:00
Antonio Andelic
6b935a252f Support multiple listen hosts 2022-08-08 09:08:19 +00:00
BoloniniD
244c37cbbf Fix submodules 2022-08-07 16:03:44 +03:00
BoloniniD
c1f09655cf Fix include directory for BLAKE3 2022-08-07 11:38:23 +03:00
BoloniniD
24f3b00193
Merge branch 'master' into BLAKE3 2022-08-06 19:48:10 +03:00
BoloniniD
ef4ca4279a Fix build cfg for BLAKE3 2022-08-06 18:24:25 +03:00
BoloniniD
d2e554e4f6 Fix build cfg for BLAKE3 2022-08-06 11:11:45 +03:00
Alexey Milovidov
adc880f362
Merge pull request #39867 from ClickHouse/keeper-block-memory-tracker-commit
Block memory tracker in Keeper during commit
2022-08-06 02:02:29 +03:00
Kseniia Sumarokova
ba53ed274b
Merge pull request #39327 from kssenii/update-azure-lib
Update azure library (removed "harmful" function)
2022-08-05 00:20:43 +02:00
BoloniniD
48c91619b0
Merge branch 'master' into BLAKE3 2022-08-04 20:30:47 +03:00
Antonio Andelic
f63e4ba261 Update NuRaft 2022-08-04 13:14:57 +00:00
Antonio Andelic
c99c5a0dd1 Merge branch 'master' into keeper-block-memory-tracker-commit 2022-08-04 13:04:11 +00:00
Kseniia Sumarokova
92882fe337
Update CMakeLists.txt 2022-08-04 11:08:59 +02:00
BoloniniD
f09c8c8a50
Enable aarch64-darwin build 2022-08-04 09:02:46 +03:00
Alexey Milovidov
f474eb957d
Merge pull request #39758 from ClickHouse/tsan_clang_15
Try clang-15 for build with tsan
2022-08-04 01:56:52 +03:00
Kseniia Sumarokova
bd5610b732
Merge branch 'master' into update-azure-lib 2022-08-03 23:00:57 +02:00
Antonio Andelic
56ca93ca3f Block memory tracker in Keeper during commit 2022-08-03 14:14:57 +00:00
kssenii
da49a0cc02 Fix build 2022-08-03 12:32:55 +02:00
BoloniniD
be8eefa3cd
Fix BLAKE3 crate name 2022-08-03 11:18:35 +03:00
BoloniniD
29084d92d8 Fix CMake for ENABLE_RUST 2022-08-02 20:44:12 +03:00
Alexander Tokmakov
82b50e79cf
Merge branch 'master' into tsan_clang_15 2022-08-02 13:00:55 +03:00
avogar
3be13e4f92 Try fix build under ppc64 2022-08-02 08:25:46 +00:00
Kruglov Pavel
6976c690bd
Revert "Revert "Update arrow to fix possible data race"" 2022-08-02 10:09:18 +02:00
Alexander Tokmakov
55af8878a5
Revert "Update arrow to fix possible data race" 2022-08-01 22:18:34 +03:00
BoloniniD
aee6a72049 Add BLAKE3 as shims only with blake3 as Rust crate 2022-08-01 21:31:38 +03:00
BoloniniD
15773e5b01 Remove BLAKE3 as submodule 2022-08-01 21:30:15 +03:00
BoloniniD
720cc6335b Merge branch 'BLAKE3' of github.com:BoloniniD/ClickHouse into BLAKE3 2022-08-01 20:44:50 +03:00
Alexander Tokmakov
0d68b1c67f fix build with clang-15 2022-08-01 18:00:54 +02:00
kssenii
96f476d078 Merge remote-tracking branch 'upstream/master' into update-azure-lib 2022-07-31 20:17:10 +03:00
Alexey Milovidov
075ff5005e
Merge branch 'master' into update-arrow 2022-07-31 03:05:53 +03:00
Alexey Milovidov
36e6500e54
Merge branch 'master' into BLAKE3 2022-07-30 23:14:05 +03:00
kssenii
f5f6c74648 One more update 2022-07-29 22:00:21 +03:00
Antonio Andelic
3b96ff0fe4 Merge branch 'master' into fix-rollback-inconsistency-keeper 2022-07-29 07:53:00 +00:00
Yakov Olkhovskiy
7c48886d23
Merge pull request #39411 from michael1589/for-update-libgsasl
compile secure rpc need the latest libgsasl
2022-07-28 16:07:53 -04:00
Antonio Andelic
c0a5d45258 Rollback on failed PreAppend 2022-07-28 14:06:45 +00:00
Antonio Andelic
1090d6bca7 Rollback request if storing log fails 2022-07-28 12:55:29 +00:00
Antonio Andelic
0ff9fc2eb9 Use commit with init 2022-07-28 07:11:03 +00:00
Yakov Olkhovskiy
c865c85b61
Merge branch 'master' into for-update-libgsasl 2022-07-27 19:01:29 -04:00
Filatenkov Artur
a218597546
Merge branch 'master' into annoy-2 2022-07-27 15:37:58 +03:00
avogar
c9ad914164 Update arrow to fix special build 2022-07-27 09:32:54 +00:00
Kruglov Pavel
79c455fadd
Merge branch 'master' into update-arrow 2022-07-27 11:25:58 +02:00
Antonio Andelic
c5bbf44492 Update NuRaft 2022-07-26 10:58:10 +00:00
avogar
9302d67fc9 Fix special build 2022-07-26 10:30:12 +00:00
Alexey Milovidov
c78fe0fc10
Merge pull request #39498 from Avogar/fix-avro
Fix data race and possible heap-buffer-overflow in Avro format
2022-07-26 03:20:01 +03:00
Alexander Tokmakov
917fbb9b07 remove c-ares from grpc 2022-07-25 15:49:03 +02:00
Kruglov Pavel
0655ff3265
Merge branch 'master' into fix-avro 2022-07-25 13:41:21 +02:00
avogar
5503d92d97 Fix submodules 2022-07-25 11:30:23 +00:00
Robert Schulze
c788e05c77
Merge pull request #39292 from zvonand/zvonand-b58-datatype
Simplify Base58 encoding/decoding
2022-07-24 18:09:40 +02:00
avogar
d41292bf42 Update arrow to fix possible data race 2022-07-22 18:51:26 +00:00
avogar
8283cc9e2c Fix possible heap-buffer-overflow in Avro 2022-07-22 17:59:43 +00:00
avogar
c6d0ca2940 Fix data race in Avro format 2022-07-22 14:23:05 +00:00
jinjunzh
8fb0d63010 Merge branch 'dev_intel_iaa_deflate' of https://github.com/jinjunzh/ClickHouse into dev_intel_iaa_deflate 2022-07-22 12:02:32 -04:00
jinjunzh
e7562f85fe Update sysroot aligned with master for missing files 2022-07-22 12:00:53 -04:00
jinjunzh
aab7ce1aa8 Revert "restore aarch64 files due to a oversight"
This reverts commit 151a98b18e.
2022-07-22 10:25:14 -04:00
jinjunzh
151a98b18e restore aarch64 files due to a oversight 2022-07-22 10:08:46 -04:00
jasperzhu
614f3b14a2
Merge branch 'master' into dev_intel_iaa_deflate 2022-07-22 11:05:44 +08:00
Andrey Zvonov
e473606cd1
Merge branch 'master' into zvonand-b58-datatype 2022-07-21 15:55:05 +02:00
Alexander Tokmakov
9e9969cea7
Merge pull request #37827 from arthurpassos/host_regexp_multiple_domains
Test host_regexp against all PTR records instead of only one
2022-07-21 16:43:05 +03:00
Azat Khuzhin
0e95dba3ef Fix make clean (due to crosscompile of llvm)
Without ADDITIONAL_CLEAN_FILES it reports an error:

    Cleaning... ninja: error: remove(contrib/llvm/llvm/NATIVE): Directory not empty
    ninja: error: remove(/bld/contrib/llvm/llvm/NATIVE): Directory not empty
    0 files.

Note, that ADDITIONAL_CLEAN_FILES had been added since cmake 3.15.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-20 17:34:10 +03:00
zvonand
562148e0e2 remove basex 2022-07-20 15:04:15 +02:00
zvonand
260d4e5455 fix remaining basex files 2022-07-20 15:02:30 +02:00
FArthur-cmd
4b71760f7d fix build 2022-07-20 15:32:41 +03:00
Peng Liu
af50b04cd0
Merge branch 'master' into for-update-libgsasl 2022-07-20 17:47:24 +08:00
FArthur-cmd
f290f7692f annoy interface 2022-07-20 12:38:56 +03:00
Peng Liu
128e3ec97f compile secure rpc need the latest libgsasl 2022-07-20 17:33:55 +08:00
Suzy Wang
0c9d7f7060 Update libuv to 1.44.1 2022-07-19 12:42:50 -07:00
jasperzhu
c044c67745
Merge branch 'master' into dev_intel_iaa_deflate 2022-07-19 15:32:57 +08:00
FArthur-cmd
25dc3e26aa change submodule path 2022-07-19 01:00:50 +03:00
FArthur-cmd
3b30cd9259 improvements 2022-07-19 00:59:07 +03:00
kssenii
8eb628f7fa Update azure 2022-07-18 17:23:50 +02:00
Azat Khuzhin
d99851bcbe Fix googletest contrib compilation (due to GTEST_HAS_POSIX_RE=0)
By some reason cmake rules for googletest sets GTEST_HAS_POSIX_RE=0
(Compatibilty? But which platform that does support ClickHouse does not
have it?)

But everything will be okay, if these macros was set PUBLIC (i.e. for
compiling googletest library itself and it's users), however it was
added as INTERFACE only (so library itself does not know about
GTEST_HAS_POSIX_RE=0), and this leads to UB, here ASan report (while I
was trying to use ASSERT_EXIT()).

<details>

<summary>ASan report</summary>

    [ RUN      ] Common.LSan
    =================================================================
    ==7566==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x6030005b2388 at pc 0x00000d00924c bp 0x7ffcd3b7cfb0 sp 0x7ffcd3b7c770
    WRITE of size 64 at 0x6030005b2388 thread T0
        0 0xd00924b in regcomp (/bld/src/unit_tests_dbms+0xd00924b) (BuildId: 40d3fa83125f9047)
        1 0x29ca243b in testing::internal::RE::Init(char const*) /bld/./contrib/googletest/googletest/src/gtest-port.cc:750:15
        2 0xd4d92b3 in testing::internal::RE::RE(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) /bld/./contrib/googletest/googletest/include/gtest/internal/gtest-port.h:896:36
        3 0xd4d92b3 in testing::PolymorphicMatcher<testing::internal::MatchesRegexMatcher> testing::ContainsRegex<char const*>(char const* const&) /bld/./contrib/googletest/googletest/include/gtest/gtest-matchers.h:868:28
        4 0xd4d813a in testing::internal::MakeDeathTestMatcher(char const*) /bld/./contrib/googletest/googletest/include/gtest/internal/gtest-death-test-internal.h:173:10
        5 0xd4d813a in Common_LSan_Test::TestBody() /bld/./src/Common/tests/gtest_lsan.cpp:11:5

    0x6030005b2388 is located 0 bytes to the right of 24-byte region [0x6030005b2370,0x6030005b2388)
    allocated by thread T0 here:
        0 0xd066fbd in operator new(unsigned long) (/bld/src/unit_tests_dbms+0xd066fbd) (BuildId: 40d3fa83125f9047)
        1 0xd4d913d in testing::PolymorphicMatcher<testing::internal::MatchesRegexMatcher> testing::ContainsRegex<char const*>(char const* const&) /bld/./contrib/googletest/googletest/include/gtest/gtest-matchers.h:868:24
        2 0xd4d813a in testing::internal::MakeDeathTestMatcher(char const*) /bld/./contrib/googletest/googletest/include/gtest/internal/gtest-death-test-internal.h:173:10
        3 0xd4d813a in Common_LSan_Test::TestBody() /bld/./src/Common/tests/gtest_lsan.cpp:11:5

</details>
2022-07-17 17:24:02 +03:00
zvonand
91be72dbb4 updated 2022-07-17 12:17:16 +02:00
zvonand
d07a652883 merge 2022-07-16 19:05:07 +02:00
zvonand
4ab52b6873 added new DataType + fixes 2022-07-16 18:58:47 +02:00
Robert Schulze
1d61ff1474
Merge pull request #38280 from ClibMouse/thrift_update
Update thrift to 0.16.0
2022-07-15 09:19:22 +02:00
Suzy Wang
f3650d8769 Add back accidentally removed line 2022-07-14 18:42:41 -07:00
Suzy Wang
0804ff9284 Update as suggested 2022-07-14 07:12:59 -07:00
FArthur-cmd
ad459bc6e4 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into annoy-2 2022-07-14 14:10:44 +03:00
Arthur Passos
a0055fc47a Add force cache to gRPC_CARES_PROVIDER set 2022-07-13 15:49:22 -03:00
Arthur Passos
7f4043a3ed Force use of c-ares inet_net_pton and style adjustments 2022-07-13 11:51:43 -03:00
Antonio Andelic
b49ac48bfd Merge branch 'master' into keeper-linearizable-reads 2022-07-13 09:30:21 +00:00
Suzy Wang
0dde11d5dd Merge remote-tracking branch 'upstream/master' into thrift_update 2022-07-12 08:02:59 -07:00
Antonio Andelic
5f661e3e2b Merge branch 'master' into keeper-linearizable-reads 2022-07-12 07:33:34 +00:00
Azat Khuzhin
1f049e8bac Bump jemalloc to fix possible assertion
This patch also updates the jemalloc version.

Note, that I've enabled page_id for jemalloc
PR_SET_VMA/PR_SET_VMA_ANON_NAME, that requires linux 5.17+ (but ignores
EINVAL anyway).

v2: add -isystem to fix reserved name for JEMALLOC_OVERRIDE___LIBC_PVALLOC
Refs: https://github.com/jemalloc/jemalloc/pull/2304
Refs: https://github.com/ClickHouse/ClickHouse/issues/31531
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-12 07:57:27 +03:00
FArthur-cmd
0fa354a77a remove hyperscan 2022-07-11 23:07:06 +03:00
FArthur-cmd
783e6e398c merge with other working branch 2022-07-11 23:02:58 +03:00
Arthur Passos
f176024eb3 prevent grpc from building c-ares 2022-07-11 12:29:38 -03:00
Arthur Passos
624ae4d8e9 link grpc against project-wide c-ares 2022-07-11 12:15:53 -03:00
FArthur-cmd
868628d3fd make stable prototype with arrays support 2022-07-11 18:02:50 +03:00
FArthur-cmd
7b7a9521c7 change submodule path 2022-07-10 18:10:47 +03:00
FArthur-cmd
2f9f5f172a Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into annoy_3 2022-07-10 17:25:21 +03:00
jinjunzh
825b7511e4 improve cosmetics 2022-07-09 14:13:12 -04:00
Arthur Passos
4f4acfabe5 c-ares draft wrapper and draft build rules 2022-07-08 17:52:14 -03:00
Suzy Wang
5f7002eafc Include boringssl header files 2022-07-07 09:08:46 -07:00
jinjunzh
65a91864b3 revise comments 2022-07-06 13:26:07 -04:00
FArthur-cmd
a3407ba6db Merge branch 'master' of github.com:FArthur-cmd/ClickHouse into annoy-2 2022-07-06 19:42:55 +03:00
jinjunzh
f91d73fa37 adjust AS_FEATURE_LEVEL 2022-07-06 12:19:37 -04:00
jinjunzh
b13b1cf226 add some comments in CMakeLists.txt 2022-07-06 10:34:22 -04:00
Nikolai Kochetov
020c99a269
Merge pull request #38617 from azat/contrib-debug-symbols
Add separate option to omit symbols from heavy contrib
2022-07-06 14:40:24 +02:00
FArthur-cmd
c94d6a57ec add arrays 2022-07-06 14:39:49 +03:00
jinjunzh
720c179963 remove redundant flags 2022-07-05 17:40:54 -04:00
jinjunzh
08907f8220 change HAVE_AVX512 in qpl cmake to ENABLE_AVX512 2022-07-05 16:54:17 -04:00
jinjunzh
ba38969e9c enable qpl for clickhouse-keeper build 2022-07-05 15:28:41 -04:00
jinjunzh
463c03b84e improve qpl section in CMakefile:remove windows build flag, modify qpl build option dependency on avx2/avx512 2022-07-05 14:08:44 -04:00
Kseniia Sumarokova
3e803006a2
Merge pull request #37171 from tchepavel/nats-integration
Nats Integration
2022-07-05 17:47:02 +02:00
Suzy Wang
93e2921edb Merge remote-tracking branch 'upstream/master' into thrift_update 2022-07-05 07:18:13 -07:00
jinjunzh
8b008fb726 remove nasm as a submodule 2022-07-05 09:42:44 -04:00
Nikita Mikhaylov
736fa4bb72
Update libprotobuf-mutator + fix build (#38834) 2022-07-05 12:31:50 +02:00
kssenii
7a4be3b748 Fix build, disable for freebsd 2022-07-05 12:10:49 +02:00
Alexey Milovidov
0def9a89f7 Update simdjson 2022-07-05 06:08:44 +02:00
Kseniia Sumarokova
6c3d648f49
Merge branch 'master' into nats-integration 2022-07-04 21:06:07 +02:00
FArthur-cmd
deb14fbaf2 update annoy 2022-07-04 19:34:41 +03:00
FArthur-cmd
21df8ed12f refactoring 2022-07-04 17:21:50 +03:00
Arthur Passos
6c987fb28e Minor adjustments 2022-07-04 10:13:50 -03:00
Arthur Passos
5c00dcd884 Link cpp-dns/udns unconditionally and update submodules to clickhouse fork 2022-07-04 10:07:03 -03:00
Arthur Passos
78519847a6 Fix wrong udns submodule 2022-07-04 10:05:56 -03:00
Arthur Passos
e030d49d97 Remove unnecessary CMake comments 2022-07-04 10:05:30 -03:00
Arthur Passos
d66154e697 Test host_regexp against all PTR records instead of only one 2022-07-04 10:05:28 -03:00
FArthur-cmd
21b99e7304 Merge branch 'master' of https://github.com/Vector-Similarity-Search-for-ClickHouse/ClickHouse into annoy-2 2022-07-04 14:54:21 +03:00
Azat Khuzhin
cd2d053ce5 Update poco to fix GCS via proxy tunnel usage
GCS server does not handle requests with port, and simply report an
error:

```xml
    <?xml version="1.0"?>
    <?xml version='1.0' encoding='UTF-8'?>
    <Error>
        <Code>InvalidURI</Code>
        <Message>Couldn't parse the specified URI.</Message>
        <Details>Invalid URL: storage.googleapis.com:443/...</Details>
    </Error>
```

Removing the port fixes the issue. Note that there is port in the Host
header anyway.

Note, this is a problem only for proxy in a tunnel mode, since only it
sends such requests, other sends requests directly via HTTP methods.

Refs: https://github.com/ClickHouse/poco/pull/22#22 (cc @Jokser)
Refs: https://github.com/ClickHouse/poco/pull/63
Refs: #38069 (cc @CurtizJ)
Cc: @alesapin @kssenii

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-04 08:46:10 +03:00
Azat Khuzhin
e8f5cd3c68 Add separate option to omit symbols from heavy contrib
Sometimes it is useful to build contrib with debug symbols for further
debugging.

With everything turned ON (i.e. debug build) I got 3.3GB vs 3.0GB w/o
this patch, 9% bloat, thoughts about this is this OK or not for you, if
not STRIP_DEBUG_SYMBOLS_HEAVY_CONTRIB can be OFF by default (regardless
of build type).

P.S. aws debug symbols adds just 1.7%.
v2: rename STRIP_HEAVY_DEBUG_SYMBOLS
v3: OMIT_HEAVY_DEBUG_SYMBOLS
v4: documentation had been removed
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-02 06:32:03 +03:00
Yakov Olkhovskiy
ab7bdd856f
Merge pull request #38599 from ClibMouse/mcc_zlib_removal
Remove zlib in mariadb-connector-c
2022-06-29 20:27:37 -04:00
Suzy Wang
eb3f49426c Remove zlib in mariadb-connector-c 2022-06-29 10:03:55 -07:00
Antonio Andelic
7333e36639 Merge branch 'master' into keeper-linearizable-reads 2022-06-29 13:59:31 +00:00
Maksim Kita
24e8ba5f9a
Merge pull request #38540 from ClickHouse/update-poco
Update poco
2022-06-29 11:02:43 +02:00
jinjunzh
fe451a4317 remove compress sync interface 2022-06-28 22:52:11 -04:00
Yakov Olkhovskiy
e78db73078 update poco 2022-06-28 12:56:43 -04:00
Yakov Olkhovskiy
52d6b45a09 update poco 2022-06-28 12:37:07 -04:00
BoloniniD
6ddcec0906
Merge branch 'master' into BLAKE3 2022-06-28 16:53:06 +03:00
Suzy Wang
b014df386e Merge remote-tracking branch 'upstream/master' into thrift_update 2022-06-27 12:14:14 -07:00
Antonio Andelic
b8c26e3ad0 Merge branch 'master' into keeper-linearizable-reads 2022-06-27 06:59:23 +00:00
jasperzhu
b2f98fa73b
Merge branch 'master' into dev_intel_iaa_deflate 2022-06-27 10:21:21 +08:00
Peng Liu
03b846e112
Merge branch 'ClickHouse:master' into master 2022-06-27 09:38:48 +08:00
Alexey Milovidov
b3098822e0
Merge pull request #38171 from ClickHouse/hyper-to-vectorscan
Replace hyperscan by vectorscan
2022-06-26 10:01:45 +03:00
Robert Schulze
07f14c9bb2
Disable vectorscan-on-ARM for now 2022-06-26 00:03:01 +02:00
Alexey Milovidov
13a6254e1e Correct submodule 2022-06-25 01:45:38 +02:00
Andrey Zvonov
ea73d9c492
Merge branch 'master' into zvonand-base58 2022-06-24 21:37:20 +03:00
Alexander Tokmakov
cfe0e434e5
Revert "Add support for io_uring read method" 2022-06-24 12:19:41 +03:00
Robert Schulze
2c828338f4
Replace hyperscan by vectorscan
This commit migrates ClickHouse to Vectorscan. The first 10 min of
[0] explain the reasons for it.

(*) Addresses (but does not resolve) #38046

(*) Config parameter names (e.g. "max_hyperscan_regexp_length") are
    preserved for compatibility. Likewise, error codes (e.g.
    "ErrorCodes::HYPERSCAN_CANNOT_SCAN_TEXT") and function/class names (e.g.
    "HyperscanDeleter") are preserved as vectorscan aims to be a drop-in
    replacement.

[0] https://www.youtube.com/watch?v=KlZWmmflW6M
2022-06-24 10:47:52 +02:00
Andrey Zvonov
c18d09a617
Merge branch 'master' into zvonand-base58 2022-06-24 07:05:49 +03:00
Alexey Milovidov
812ab9bd6b
Merge pull request #36103 from sauliusvl/uring
Add support for io_uring read method
2022-06-24 00:34:29 +03:00
Suzy Wang
45f94c3d23 Add new files to makefile for thrift 0.16.0 2022-06-23 14:01:45 -07:00
Alexey Milovidov
e7c8023ef5
Merge pull request #38201 from ClickHouse/revert-35914-FIPS_compliance
Revert "ClickHouse's boringssl module updated to the official version of the FIPS compliant."
2022-06-23 20:22:03 +03:00
Antonio Andelic
91637bf79a Merge branch 'master' into keeper-linearizable-reads 2022-06-23 14:07:00 +00:00
mergify[bot]
234f0c6399
Merge branch 'master' into revert-35914-FIPS_compliance 2022-06-23 12:06:17 +00:00
zvonand
946117ec89 Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-base58 2022-06-23 17:04:40 +05:00
zvonand
267025c35b update base-x cmakelists 2022-06-23 16:51:15 +05:00
Robert Schulze
42e70b7cd3
Document why the submodule check does not halt the configuration 2022-06-23 13:41:05 +02:00
Suzy Wang
4deddbf900 Update thrift to 0.16.0(latest) 2022-06-21 12:28:40 -07:00
Robert Schulze
0d80874d40
Merge pull request #38068 from ClickHouse/clang-tsa
Support for Clang Thread Safety Analysis (TSA)
2022-06-21 20:19:33 +02:00
Suzy Wang
1a23dfa827 Update thrift to 0.13.0 2022-06-21 06:54:54 -07:00
Saulius Valatka
a7152fe5ec bump liburing 2022-06-21 13:20:46 +03:00
Saulius Valatka
7b5e13a9eb implement pending request queue to prevent CQ overflows, more error checking, reduce size of io_uring 2022-06-21 13:17:56 +03:00
Saulius Valatka
6bbabf59d9 simplify build, add read method randomized tests, fix typos 2022-06-21 09:59:46 +03:00
Saulius Valatka
3f755a2505 add liburing to build 2022-06-21 09:59:46 +03:00
zvonand
22af00b757 rename variable + fix handling of ENABLE_LIBRARIES 2022-06-20 23:53:47 +05:00
Robert Schulze
55b39e709d
Merge remote-tracking branch 'origin/master' into clang-tsa 2022-06-20 16:39:32 +02:00
Robert Schulze
5a4f21c50f
Support for Clang Thread Safety Analysis (TSA)
- TSA is a static analyzer build by Google which finds race conditions
  and deadlocks at compile time.

- It works by associating a shared member variable with a
  synchronization primitive that protects it. The compiler can then
  check at each access if proper locking happened before. A good
  introduction are [0] and [1].

- TSA requires some help by the programmer via annotations. Luckily,
  LLVM's libcxx already has annotations for std::mutex, std::lock_guard,
  std::shared_mutex and std::scoped_lock. This commit enables them
  (--> contrib/libcxx-cmake/CMakeLists.txt).

- Further, this commit adds convenience macros for the low-level
  annotations for use in ClickHouse (--> base/defines.h). For
  demonstration, they are leveraged in a few places.

- As we compile with "-Wall -Wextra -Weverything", the required compiler
  flag "-Wthread-safety-analysis" was already enabled. Negative checks
  are an experimental feature of TSA and disabled
  (--> cmake/warnings.cmake). Compile times did not increase noticeably.

- TSA is used in a few places with simple locking. I tried TSA also
  where locking is more complex. The problem was usually that it is
  unclear which data is protected by which lock :-(. But there was
  definitely some weird code where locking looked broken. So there is
  some potential to find bugs.

*** Limitations of TSA besides the ones listed in [1]:

- The programmer needs to know which lock protects which piece of shared
  data. This is not always easy for large classes.

- Two synchronization primitives used in ClickHouse are not annotated in
  libcxx:
  (1) std::unique_lock: A releaseable lock handle often together with
      std::condition_variable, e.g. in solve producer-consumer problems.
  (2) std::recursive_mutex: A re-entrant mutex variant. Its usage can be
      considered a design flaw + typically it is slower than a standard
      mutex. In this commit, one std::recursive_mutex was converted to
      std::mutex and annotated with TSA.

- For free-standing functions (e.g. helper functions) which are passed
  shared data members, it can be tricky to specify the associated lock.
  This is because the annotations use the normal C++ rules for symbol
  resolution.

[0] https://clang.llvm.org/docs/ThreadSafetyAnalysis.html
[1] https://static.googleusercontent.com/media/research.google.com/en//pubs/archive/42958.pdf
2022-06-20 16:13:25 +02:00
Rafael Acevedo
51035ee300
Update librdkafka
Update to get fixes from https://github.com/ClickHouse/librdkafka/pull/5

Refs https://github.com/ClickHouse/ClickHouse/issues/38151
2022-06-20 07:19:58 -03:00
zvonand
832fd6e0a9 Added tests + minor updates 2022-06-19 23:10:28 +05:00
Alexey Milovidov
0cf88e0950
Revert "ClickHouse's boringssl module updated to the official version of the FIPS compliant." 2022-06-18 23:16:18 +03:00
Antonio Andelic
fdef4cc44d Update NuRaft 2022-06-18 19:25:43 +00:00
alesapin
0ae0cc54aa
Merge pull request #38106 from ClickHouse/tsan_less_flaky_tests
Some fixes for tests with tsan
2022-06-18 14:22:43 +02:00
Alexey Milovidov
d43492a512
Merge pull request #37795 from DevTeamBK/curl_upgrade
Upgrade curl to 7.83.1
2022-06-18 04:14:09 +03:00
Antonio Andelic
fa8bfced1a Update NuRaft 2022-06-17 18:19:09 +00:00
alesapin
ca33ff93cb
Merge pull request #37555 from ClickHouse/revert-37534-revert-37036-keeper-preprocess-operations
Add support for preprocessing ZooKeeper operations and real-time digest in `clickhouse-keeper`
2022-06-16 17:29:00 +02:00
Suzy Wang
b80b9ec8b9 Merge branch 'master' into curl_upgrade 2022-06-16 08:09:15 -07:00
jasperzhu
bca18b2caf
Merge branch 'master' into dev_intel_iaa_deflate 2022-06-16 08:56:27 +08:00
Daniel Kutenin
a769dea8ef
Merge branch 'ClickHouse:master' into master 2022-06-15 19:12:10 +01:00
Alexander Tokmakov
9cac78b498 make tests with tsan less flaky 2022-06-15 19:54:46 +02:00
Maksim Kita
5729210f22
Merge pull request #37797 from kitaisreal/libunwind-update-version
libunwind update version
2022-06-15 19:32:42 +02:00
Danila Kutenin
08e3f77a9c Optimize most important parts with NEON SIMD
First part, updated most UTF8, hashing, memory and codecs. Except
utf8lower and upper, maybe a little later.

That includes huge amount of research with movemask dealing. Exact
details and blog post TBD.
2022-06-15 13:19:29 +00:00
mergify[bot]
68d043869c
Merge branch 'master' into libunwind-update-version 2022-06-15 11:43:01 +00:00
Maksim Kita
1c841fadcd Updated libunwind 2022-06-15 10:59:23 +02:00
zvonand
c149c916ec initial setup 2022-06-15 11:49:55 +05:00
mergify[bot]
17cc36e0e2
Merge branch 'master' into grpc_update_to_PR9 2022-06-15 02:10:38 +00:00
Antonio Andelic
b7bd5a8eb1 Merge branch 'master' into revert-37534-revert-37036-keeper-preprocess-operations 2022-06-14 12:51:35 +00:00
Maksim Kita
4a37e36d78 Updated libunwind 2022-06-14 12:52:52 +02:00
Antonio Andelic
e5504f1b33 Merge branch 'master' into revert-37534-revert-37036-keeper-preprocess-operations 2022-06-13 15:43:10 +00:00
Robert Schulze
027fe1db9d
Merge pull request #37970 from ClickHouse/color_diagnostics
Always disable --color-diagnostics for LLVM
2022-06-13 13:32:19 +02:00
Maksim Kita
fb54a1cb6a Updated libunwind 2022-06-13 11:44:45 +02:00
Maksim Kita
8907c4b5b0 Updated libunwind 2022-06-13 11:44:45 +02:00
Maksim Kita
25a886a78c libunwind update version fix sanitizers 2022-06-13 11:44:45 +02:00
Maksim Kita
d8c4af725a libunwind update version 2022-06-13 11:44:45 +02:00
BoloniniD
617ef0809f Minor fixes 2022-06-12 01:22:33 +03:00
BoloniniD
43cafcc4dc Fix submodules 2022-06-10 22:33:45 +03:00
Robert Schulze
0696ee3758
Always disable --color-diagnostics for LLVM
The flag is not only not recognized on MacOS, it is not recognized by
the gold linker in general.
2022-06-10 10:39:38 +02:00
BoloniniD
14ddcee432 Trying another Rust target to fix compatibility test 2022-06-07 18:10:49 +03:00
BoloniniD
4dd7638cca Trying another Rust target to fix compatibility test 2022-06-06 18:03:41 +03:00
BoloniniD
b05ee41d25 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-06-06 16:03:10 +03:00
Antonio Andelic
2c37fe3d7b Merge branch 'master' into revert-37534-revert-37036-keeper-preprocess-operations 2022-06-06 12:39:55 +00:00
jinjunzh
c7ca746994 fixed build issues in clickhouse-keeper 2022-06-05 14:46:28 -04:00
Peng Liu
6de7590af4 compile the new libgsasl with supportting three modes(privacy/integrity/authentication) 2022-06-04 23:30:38 +08:00
Bharat Nallan Chakravarthy
5fb9336159 add ssl version to build options 2022-06-04 15:31:08 +05:30
jinjunzh
2170a99484 revise ENABLE_QPL_COMPRESSION build option 2022-06-03 21:06:55 -04:00
Alexey Milovidov
4387379090
Merge pull request #37745 from DevTeamBK/libxml2_upgrade
Upgrade libxml2 to 2.9.14
2022-06-02 18:39:09 +03:00
jinjunzh
041a8e42ca revise code style 2022-06-02 10:34:11 -04:00
Antonio Andelic
7ee47fc5bb Merge branch 'master' into revert-37534-revert-37036-keeper-preprocess-operations 2022-06-02 13:38:52 +00:00
Alexey Milovidov
eef6a5ec96
Revert "Remove resursive submodules" 2022-06-02 09:41:12 +03:00
Suzy Wang
17fb5d8068 upgrade curl to 7.83.1 2022-06-01 21:30:02 -07:00
jinjunzh
e1426c7e9d add build option for iaa compression 2022-06-01 11:47:43 -04:00
Robert Schulze
7813cf5a8b
Merge pull request #37719 from ClickHouse/lib-dependency-mgmt
Fix build with -DENABLE_LIBRARIES=0
2022-06-01 16:53:49 +02:00
Suzy Wang
9bef38effb Upgrade libxml2 to 2.9.14 2022-06-01 06:10:05 -07:00
mergify[bot]
4aefcf29e3
Merge branch 'revert-37534-revert-37036-keeper-preprocess-operations' into keeper-real-time-digest 2022-06-01 10:17:49 +00:00
Robert Schulze
393b97763a
Make SSL a mandatory dependency for now
- SSL is a dependency of too many libs + unit tests (via poco crypto
  which requires SSL)

- optional SSL is desirable but right now, turning off SSL (via
  -DENABLE_LIBRARIES=0 or =DENABLE_SSL=0) breaks the build

- therefore make SSL mandatory for now + add a TODO comment
2022-06-01 11:26:24 +02:00
Robert Schulze
933f98a900
Removed warning flags in contribs
warnings are disabled for all contribs in contrib/CMakeLists.txt already
2022-06-01 11:02:39 +02:00
Robert Schulze
a4e037c728
Remove unused M_LIBRARY link 2022-06-01 11:02:39 +02:00
Robert Schulze
12871a43e1
Cosmetics 2022-06-01 11:02:39 +02:00
BoloniniD
dd8aefdf1e Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-06-01 11:46:55 +03:00
Robert Schulze
249fe561f4
Fix build with -DENABLE_LIBRARIES=0 / -DENABLE_REPLXX=0
Replxx: When disabled via -DENABLE_LIBRARIES=0 or -DENABLE_REPLXX (the
latter was undocumented) the build broke because replxx symbols were
used since [0] in header LineReader.h. This header should in theory
stay clean of replxx but doesn't for efficiency reasons.

This change makes compilation of replxx mandatory. As replxx is quite
small, I guess this is okay. (The alternative is to litter the code
with ifdefs for non-replxx and a replxx paths.)

[0] https://github.com/ClickHouse/ClickHouse/pull/33201
2022-06-01 10:02:28 +02:00
HarryLeeIBM
93be56a151 Update grpc submodule to PR 9 2022-05-31 14:12:44 -07:00
jinjunzh
330a46c418 Remove eigen library according to master commit: 7d0ed7e51a 2022-05-31 09:55:06 -04:00
alesapin
65057bf8c4
Merge pull request #37616 from ClickHouse/remove-resursive-submodules
Remove resursive submodules
2022-05-31 11:58:04 +02:00
Robert Schulze
557bb2d235
Disable amqp-cpp and cassandra build if libuv is disabled
On MacOS/GCC, the libuv build is disabled due to a compiler bug. This
is now propagated to dependent libraries amqp-cpp and cassandra.
Oddly enough, the Mac/GCC build was broken since at least Jan 2022
without someone noticing.
2022-05-31 10:34:03 +02:00
jasperzhu
fc03af2259
Merge branch 'master' into dev_intel_iaa_deflate 2022-05-30 17:49:04 +08:00
jinjunzh
4857d6e2c3 add nasm into docker configuration 2022-05-30 17:45:26 -04:00
Alexey Milovidov
7281d51e45 Remove recursive submodules 2022-05-28 04:01:03 +02:00
tchepavel
42cd854688
Merge branch 'master' into nats-integration 2022-05-27 16:05:08 +03:00
Robert Schulze
7543841438
Merge pull request #37518 from ClickHouse/bump-cctz-to-2022-05-15
Bump cctz to 2022-05-15
2022-05-25 22:14:41 +02:00
Robert Schulze
90deef1c3c
Bump cctz to 2022-05-15 2022-05-25 12:21:05 +02:00
Kseniia Sumarokova
02d162c25d
Merge branch 'master' into nats-integration 2022-05-25 10:04:39 +02:00
Antonio Andelic
fe72cd7478 Merge branch 'master' into keeper-real-time-digest 2022-05-25 07:41:31 +00:00
tchepavel
43226a57fc
Merge branch 'master' into nats-integration 2022-05-24 18:15:11 +03:00
Alexander Gololobov
7d0ed7e51a Remove eigen library 2022-05-24 10:24:50 +02:00
Alexey Milovidov
dd2b2380fa Add a comment #37078 2022-05-24 04:22:51 +02:00
tchepavel
d9436ec7dd
Merge branch 'master' into nats-integration 2022-05-23 14:30:09 +03:00
Antonio Andelic
8cb6101a3c Merge branch 'master' into keeper-real-time-digest 2022-05-23 10:34:20 +00:00
mergify[bot]
cc1362511a
Merge branch 'master' into patch-2 2022-05-23 00:12:44 +00:00
Yakov Olkhovskiy
d878f193d8
Merge pull request #37013 from mnutt/hashid
Add hashid support
2022-05-21 17:14:54 -04:00
Michael Nutt
23dbf1b257 Merge branch 'master' into hashid 2022-05-20 08:42:01 -04:00
Antonio Andelic
e5f7f5f689 Update NuRaft commit 2022-05-20 09:59:13 +00:00
Alexander Gololobov
4350935377 Re-enable SSE2 for PowerPC 2022-05-20 08:51:48 +02:00
Alexander Gololobov
4885940378 Removed ENABLE_MKL option, because we cannot depend on non-contrib libs 2022-05-20 08:51:48 +02:00