Commit Graph

3420 Commits

Author SHA1 Message Date
Nikita Keba
636d50caa0 fix cmake + add unit tests for TarArchiveReader 2023-05-29 19:35:24 +00:00
Nikita Keba
f07999699f add libarchive support 2023-05-29 17:00:38 +00:00
Robert Schulze
f0ed55bac4
QPL: Add a comment about isal 2023-05-29 07:43:58 +00:00
ltrk2
4c218f2892
Upgrade boost submodule (#50188) 2023-05-26 15:59:03 +02:00
Nikita Taranov
243207aa4e
Update S3 sdk to v1.11.61 (#50037) 2023-05-25 16:00:50 +02:00
Kseniia Sumarokova
2e17503d36
Merge pull request #50187 from kssenii/fix-pg-source
Fix PostgreSQLSource reading all unread the data in onFinish
2023-05-24 22:51:48 +02:00
kssenii
07eedc8ef1 Fix 2023-05-24 15:03:11 +02:00
Azat Khuzhin
885dea3658 Switch to upstream repository of vectorscan
Everything that is requried already merged:
- https://github.com/VectorCamp/vectorscan/pull/144
- https://github.com/VectorCamp/vectorscan/pull/149
- https://github.com/VectorCamp/vectorscan/pull/148

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-23 22:13:35 +02:00
Alexey Milovidov
70c83f5133
Merge pull request #49991 from amosbird/clickhouse_as_library
Use PROJECT_*_DIR instead of CMAKE_*_DIR.
2023-05-19 12:37:18 +03:00
Amos Bird
6b4dcbd3ed
Use PROJECT_*_DIR instead of CMAKE_*_DIR. 2023-05-18 23:23:39 +08:00
Kruglov Pavel
b414760d43
Merge pull request #49673 from Avogar/fiber-local-var
Fix assert in SpanHolder::finish() with fibers
2023-05-16 11:59:33 +02:00
Sema Checherinda
03c51208d1
Merge pull request #44869 from CheSema/multi_part_upload
rework WriteBufferFromS3, add tests, add abortion
2023-05-16 10:52:01 +02:00
avogar
b23afdc533 Fix build for aarch64-darwin 2023-05-15 15:48:00 +00:00
Alexey Milovidov
6df457dcaf
Merge pull request #49811 from jinjunzh/iaadeflate_swpath_compat
qpl_deflate codec lower the minimum SIMD version to SSE 4.2
2023-05-13 04:21:54 +03:00
Robert Schulze
13494ffe9b
Include msan fixes in vectorscan 2023-05-12 17:58:54 +00:00
Robert Schulze
a6d4c17afb
Add vectorscan submodule 2023-05-12 17:52:45 +00:00
Robert Schulze
e468b92b9c
Remove vectorscan 2023-05-12 17:47:46 +00:00
avogar
37e4c531ba Don't update contrib 2023-05-12 15:02:56 +00:00
Robert Schulze
9d34233e65
Merge branch 'master' into iaadeflate_swpath_compat 2023-05-12 16:39:17 +02:00
jinjunzh
e72a6fe973 qpl-deflate codec lower the minimum SIMD version to SSE 4.2 2023-05-12 09:56:01 -04:00
Kruglov Pavel
084a696b54
Merge branch 'master' into fiber-local-var 2023-05-11 17:55:25 +02:00
Sema Checherinda
9ef14d5ed4
Merge branch 'master' into multi_part_upload 2023-05-11 08:21:02 +02:00
Alexey Milovidov
f82dc03b14 Fix build of libfiu on clang-16 2023-05-11 04:43:00 +02:00
Sema Checherinda
7fbf87be17 rework WriteBufferFromS3, squashed 2023-05-10 18:31:47 +00:00
Azat Khuzhin
dde535797e Update libfiu to fix the build
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-10 19:35:45 +02:00
Kruglov Pavel
289af626ad
Merge branch 'master' into fiber-local-var 2023-05-10 18:21:46 +02:00
Azat Khuzhin
a0cc5b7e47 Merge remote-tracking branch 'u/master' into build/llvm-16 2023-05-10 16:28:36 +02:00
Azat Khuzhin
88b07d121c Update vectorscan library with fixes for MSan
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-10 16:01:29 +02:00
Han Fei
d17aa828b3
Merge pull request #49361 from hanfei1991/hanfei/fiu
support named fault injection and add a simple test
2023-05-10 15:51:51 +02:00
avogar
0cf6b9f145 Inherit context from parent fiber 2023-05-10 12:27:13 +00:00
Han Fei
505d9be7b2 address comments 2023-05-10 13:56:17 +02:00
avogar
66971662de Update cmake 2023-05-09 18:56:59 +00:00
Azat Khuzhin
6ae41be0cc Add riscv64 support for boringssl
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-09 10:33:37 +02:00
Han Fei
64b67b9a37 Merge branch 'master' into hanfei/fiu 2023-05-09 01:14:30 +02:00
avogar
c961e3706e Clean up 2023-05-08 16:52:57 +00:00
avogar
5527d43a5d Use only needed src files 2023-05-08 16:51:17 +00:00
avogar
b320527158 Fix assert in SpanHolder::finish() with fibers 2023-05-08 16:33:39 +00:00
jasperzhu
d92ff92966
Merge branch 'master' into iaadeflate_idxd_config_amend 2023-05-08 16:36:23 +08:00
jinjunzh
d2d291fe89 resolved conflict with master 2023-05-08 16:46:27 -04:00
jinjunzh
17cb445c1b refine content of cmake for qpl 2023-05-08 16:43:37 -04:00
jinjunzh
9fad9f234f add missing idxd-config module for qpl-deflate codec 2023-05-08 15:20:55 -04:00
Robert Schulze
156cd1de6f
Revert "Remove trash" 2023-05-07 22:03:37 +02:00
Alexey Milovidov
bcafd7002a
Merge pull request #49597 from ClickHouse/remove-locales
Remove "locale"
2023-05-07 07:26:02 +03:00
Alexey Milovidov
49766769df
Merge pull request #49584 from jinjunzh/iaadeflate_isal_issuefix
fixed symbol conflict between contrib/isa-l and isa-l in qpl
2023-05-07 04:52:08 +03:00
Alexey Milovidov
13ed528e0b Remove "locale" 2023-05-06 18:45:14 +02:00
jasperzhu
6b9df33ca1
Merge branch 'master' into iaadeflate_isal_issuefix 2023-05-06 10:32:58 +08:00
jinjunzh
576fbb9c25 fixed symbol conflict between contrib/isal and isal in qpl 2023-05-06 10:38:11 -04:00
ltrk2
20cd799e51 Add CMake option for BOOST_USE_UCONTEXT 2023-05-05 16:29:21 +00:00
Alexey Milovidov
3a33f0eefb
Merge pull request #49531 from ClickHouse/remove-garbage-hdfs
Remove garbage from HDFS
2023-05-05 17:47:23 +03:00
Nikolay Degterinsky
7a727bbbe3
Merge pull request #49520 from IvanTakarlikov-st/it-grammar-fixes
Fix some grammar mistakes in documentation, code and tests
2023-05-05 15:45:58 +02:00
Alexey Milovidov
34798f5358 Remove garbage from HDFS 2023-05-05 03:27:03 +02:00
Alexey Milovidov
bbd6be85bf
Merge pull request #49457 from ClibMouse/fix_json_float_s390x
Fix the code to use the RapidJSONParser in case of big-endian system
2023-05-05 00:21:30 +03:00
MeenaRenganathan22
9b75f08794 Modified the code to disable the build of SimdJSONParser library in case of S390X and use the RapidJSONParser library instead. 2023-05-04 19:48:46 +00:00
Ivan Takarlikov
8873856ce5 Fix some grammar mistakes in documentation, code and tests 2023-05-04 13:35:18 -03:00
Alexey Milovidov
c799bcf6bf
Merge pull request #49437 from azat/build/disable-libraries-fixes
Build fixes for ENABLE_LIBRARIES=OFF
2023-05-03 23:55:50 +03:00
Nikolay Degterinsky
048b4ec738
Merge branch 'master' into bcrypt 2023-05-03 16:14:57 +02:00
alesapin
129d123956
Merge pull request #49423 from ClickHouse/remove-trash-7
Remove trash
2023-05-03 14:19:08 +02:00
Azat Khuzhin
2045cf1550 Respect ENABLE_LIBRARIES for ISA-L library
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-03 09:50:42 +02:00
Alexey Milovidov
7075c16b3e Remove trash 2023-05-02 19:25:40 +02:00
Han Fei
5a31d2129e fix build in fast test 2023-05-02 14:54:10 +02:00
Han Fei
d608ba41e7 try to fix 2023-05-02 00:05:36 +02:00
Robert Schulze
550e430c28
A better way of excluding ISA-L on non-x86
Follow-up to #49256. More 'modern', i.e. uses a CMake TARGET exists
check instead of an internal variable.
2023-05-01 20:42:57 +00:00
Han Fei
4d18a4f8d3
Merge branch 'master' into hanfei/fiu 2023-05-01 17:51:41 +02:00
Han Fei
b701293d46 support named fault injection and add a simple test 2023-05-01 17:44:37 +02:00
Nikolay Degterinsky
f64ef88197 Merge remote-tracking branch 'upstream/master' into bcrypt 2023-04-30 21:39:16 +00:00
Boris Kuschel
e640d79765
Update Curl to latest 2023-04-28 04:59:06 -07:00
Boris Kuschel
dcfee036a8
One more file 2023-04-28 04:59:05 -07:00
Boris Kuschel
449f63a2ef
Add missing files 2023-04-28 04:59:04 -07:00
Boris Kuschel
2246306370
remove commented lines 2023-04-28 04:59:03 -07:00
Boris Kuschel
7f91105e7d
Update curl to 8.0.1 2023-04-28 04:59:02 -07:00
Robert Schulze
744acc943c
Update CMakeLists.txt 2023-04-27 19:43:51 +02:00
Robert Schulze
742a93f168
Check NASM exists 2023-04-27 17:42:09 +00:00
Nikolay Degterinsky
df1e56b985 Merge remote-tracking branch 'upstream/master' into bcrypt 2023-04-27 17:01:58 +00:00
Jordi
be702ee584 Disable ISA-L on aarch64 architectures 2023-04-27 12:15:37 +02:00
Alexey Milovidov
ce00aa74a0
Merge pull request #48833 from M1eyu2018/update-hdfs
Update HDFS: Support for erasure codes
2023-04-27 01:36:05 +03:00
Alexey Milovidov
0c3dfe9d86
Merge branch 'master' into iaadeflate_upgrade_qpl_v1.1.0 2023-04-26 13:57:16 +03:00
Alexey Milovidov
038402c9d2
Merge branch 'master' into update-hdfs 2023-04-26 13:52:59 +03:00
jinjunzh
260eb5450b Upgrade IAA-Deflate codec library:qpl from v1.0.0 to v1.1.0 2023-04-25 14:52:28 -04:00
alesapin
2495e30b7d Bump sysroot 2023-04-25 18:15:07 +02:00
M1eyu2018
dff3c0c867 Update HDFS: Support for erasure codes
Signed-off-by: M1eyu2018 <857037797@qq.com>
2023-04-24 09:59:16 +08:00
Azat Khuzhin
fff6062c7b Update llvm to fix std::stringstream for payload > INT_MAX
Refs: https://reviews.llvm.org/D146294
Refs: https://github.com/ClickHouse/llvm-project/pull/9
Refs: https://github.com/ClickHouse/llvm-project/pull/16
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-04-17 10:49:55 +02:00
Robert Schulze
5553a521ba
Bump ZSTD to 1.5.5-pre 2023-04-13 12:11:43 +00:00
Robert Schulze
3f7ce60e03
Merge branch 'master' into rs/gcc-removal 2023-04-12 22:17:04 +02:00
Alexey Milovidov
83ca36d621
Merge pull request #48614 from ClickHouse/update-hdfs
Update HDFS
2023-04-12 22:10:11 +03:00
Robert Schulze
1477887259
Initial removal of logic under COMPILER_GCC 2023-04-11 16:27:32 +00:00
Alexander Tokmakov
327bfbc6c4
Merge pull request #48183 from ClickHouse/contrib_sparse_checkout
Add scripts for sparse checkout of some contribs
2023-04-11 16:18:27 +03:00
Alexey Milovidov
9f420ecad0 Update HDFS 2023-04-10 22:00:03 +02:00
Alexey Milovidov
438cd4af09
Merge pull request #48579 from ClickHouse/kerberos-fix-tsan
Fix TSan report in Kerberos
2023-04-10 20:58:50 +03:00
Alexey Milovidov
6738ab6660 Fix TSan report in Kerberos 2023-04-10 04:22:17 +02:00
Alexey Milovidov
98cabda66d Update CCTZ 2023-04-10 00:15:15 +02:00
Alexander Tokmakov
3c509214e4 Merge branch 'master' into contrib_sparse_checkout 2023-04-07 23:44:38 +02:00
Yakov Olkhovskiy
5841c415a7
Merge pull request #48407 from ClibMouse/krb5_openssl
Fix issue with krb5 and building w/ OpenSSL
2023-04-06 14:15:02 -04:00
Boris Kuschel
76738017a8
Fix krb5 with openssl 2023-04-04 15:28:40 -07:00
Alexander Tokmakov
686b284e6c fix 2023-04-01 02:00:45 +02:00
Alexander Tokmakov
8169f01a24 exclude more subdirs 2023-03-31 20:58:57 +02:00
avogar
c23eec876c Try to update arrow library with 11.0.0 release 2023-03-31 14:38:16 +00:00
Alexander Tokmakov
2ab198f19d Merge branch 'master' into contrib_sparse_checkout 2023-03-31 16:10:15 +02:00
Robert Schulze
e464ef1f7a
Remove support for std::unary/binary_function (removed in C++17) 2023-03-30 09:44:23 +00:00
Alexander Tokmakov
905975f6e6 update docs 2023-03-29 18:47:38 +02:00
Alexander Tokmakov
499b58dcf6 add scripts for sparse checkout of some contribs 2023-03-29 17:03:57 +02:00
robot-ch-test-poll2
9bea890906
Merge pull request #48101 from evillique/update-sqlite
Update SQLite to 3.41.2
2023-03-29 07:15:34 +02:00
Nikolay Degterinsky
a2df2b73fa Update SQLite to 3.41.2 2023-03-28 10:51:27 +00:00
Robert Schulze
6b3d0c1a34
Bump vectorscan to 5.4.9
As a consequence, this enables to remove a temporary workaround from ClickHouse's llvm-fork
2023-03-23 20:07:13 +00:00
Yakov Olkhovskiy
e04ba4ae30
Merge pull request #47036 from HarryLeeIBM/hlee-s390x-murmurhash
Fix murmurhash for s390x
2023-03-22 08:19:05 -04:00
Robert Schulze
382aa60056
Merge pull request #47745 from jinjunzh/iaadeflate_doc_update
Create doc and scripts for qpl_deflate benchmark
2023-03-22 10:15:26 +01:00
jinjunzh
038b56ad6a reformat doc 2023-03-21 16:31:47 -04:00
jinjunzh
a721c3e392 remove unused space 2023-03-21 16:02:03 -04:00
jinjunzh
bdb59db8ed fixed spelling issues 2023-03-21 15:36:38 -04:00
Yakov Olkhovskiy
3d47b051a7
Merge branch 'master' into hlee-s390x-murmurhash 2023-03-21 14:55:11 -04:00
jinjunzh
d65d23bf0e remove blank spaces 2023-03-21 12:06:29 -04:00
jinjunzh
ffc8d831c5 improve doc path and structure 2023-03-21 12:00:57 -04:00
jinjunzh
18c59fb5d3 Create doc and scripts for qpl_deflate benchmark 2023-03-20 17:19:34 -04:00
Alexey Milovidov
ddf29b69f9
Merge branch 'master' into fuzzer-of-data-formats 2023-03-20 03:26:51 +03:00
Robert Schulze
de760578d8
Fixup git reference to LLVM
(motivated by [0])

PRs [0]/[1] switched the git reference in ClickHouse's main repo to a
feature branch derived from the correct branch
(ClickHouse/releases/15.x). As per this PR, this is now fixed. The
actual code state of llvm-project doesn't change.

[0] https://github.com/ClickHouse/llvm-project/pull/10
[1] https://github.com/ClickHouse/llvm-project/pull/8
[2] https://github.com/ClickHouse/ClickHouse/pull/46600
2023-03-19 14:34:25 +00:00
Alexey Milovidov
a270f985a7 Update roaring bitmaps, because the previous version had a bug 2023-03-19 04:35:20 +01:00
Robert Schulze
145eed9455
Merge pull request #46485 from ClibMouse/KRB_CVE_Fix
Update krb5 to 1.20.1-final to mitigate CVE-2022-42898
2023-03-15 11:00:06 +01:00
MeenaRenganathan22
91625184a3 Updated the krb5 submodule reference 2023-03-14 06:23:22 -07:00
Robert Schulze
348a40aa5d
Compile with C++23 2023-03-10 19:11:58 +00:00
MeenaRenganathan22
f4f7336fd0 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into KRB_CVE_Fix 2023-03-10 09:08:02 -08:00
MeenaRenganathan22
65890de50c Updating the submodule to the new PR#9 2023-03-10 09:05:25 -08:00
Kruglov Pavel
71b6d6c6ae
Merge pull request #47114 from Avogar/parquet-compression
Improve working with compression methods in Parquet/ORC/Arrow formats
2023-03-09 13:02:18 +01:00
MeenaRenganathan22
30fd798a2c Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into KRB_CVE_Fix 2023-03-08 06:08:59 -08:00
HarryLeeIBM
bbbe529e24 Fix farmhash for s390x 2023-03-03 09:29:35 -08:00
Kruglov Pavel
3b034e7c35
Merge branch 'master' into parquet-compression 2023-03-02 15:55:48 +01:00
avogar
5ab5902f38 Allow control compression in Parquet/ORC/Arrow output formats, support more compression for input formats 2023-03-01 21:27:46 +00:00
Amos Bird
8162446496
The three-way comparison operator
Please refer to
https://www.open-std.org/jtc1/sc22/wg21/docs/papers/2022/p2468r2.html
for more information on why it is necessary to modify the code in this
way.
2023-03-01 11:06:34 +08:00
HarryLeeIBM
5f649542a3 Fix murmurhash for s390x 2023-02-28 10:08:57 -08:00
Amos Bird
620f3297fa
Simplify the LLVM build process 2023-02-28 22:41:52 +08:00
MeenaRenganathan22
6b1bb3f7ad Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into KRB_CVE_Fix 2023-02-27 05:52:25 -08:00
MeenaRenganathan22
a17edd224a Updated the krb5 submodule reference 2023-02-27 05:49:28 -08:00
Alexey Milovidov
1afbf49a63
Merge pull request #46832 from HarryLeeIBM/hlee-s390x-xz
Fix http xz compression issue for s390x
2023-02-26 22:31:57 +03:00
Alexey Milovidov
52beeadac7
Merge pull request #46755 from HarryLeeIBM/hlee-s390x-new-libunwind
Use latest libunwind for s390x
2023-02-25 00:40:06 +03:00
MeenaRenganathan22
2d967a1b45 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into KRB_CVE_Fix 2023-02-24 13:34:12 -08:00
MeenaRenganathan22
ebcd00e1c5 Changes to reflect the latest submodule and corresponding CMakeLists.txt 2023-02-24 13:31:40 -08:00
HarryLeeIBM
e8458048a9 Fix http xz compression issue for s390x 2023-02-24 07:33:57 -08:00
Robert Schulze
d26a12b6b2
Remove ZSTD version from CMake output
- produced wrong output:

  > ZSTD VERSION 1.5.0

  (see any recent local or CI build log), whereas the current version is 1.5.4

- that could be fixed, on the other hand other contrib's also don't
  print their version (it is given implicitly by ClickHouse's source
  Git hash), the parsing regex is fragile and it hasn't changed since
  2016 so it was probably broken for a long time already

- therefore remove it
2023-02-23 20:27:30 +00:00
HarryLeeIBM
6fa908ff10 Use latest libunwind for s390x 2023-02-22 17:24:15 -08:00
Han Fei
4715e2c172 update llvm-project to fix gwp-asan 2023-02-20 15:36:45 +01:00
MeenaRenganathan22
09323457b9 :wMerge branch 'master' of https://github.com/ClickHouse/ClickHouse into KRB_CVE_Fix 2023-02-17 07:48:05 -08:00
MeenaRenganathan22
fdde8de47c Updated the krb5 submodule reference to branch CVE_Fix in ClibMouse/krb5 2023-02-17 07:45:13 -08:00
MeenaRenganathan22
537c9914ce Updating the CMakeLists.txt to include the latest changes in the KRB5 submodule 2023-02-16 06:21:09 -08:00
Nikolay Degterinsky
e61947bf47
Merge pull request #44662 from evillique/ulid
Add generateULID function
2023-02-16 11:21:23 +01:00
Antonio Andelic
17494d79c2
Merge pull request #46070 from ClickHouse/s3-client-polish
Polish S3 client
2023-02-15 21:22:47 +01:00
Nikolay Degterinsky
494fd472f0
Merge branch 'master' into ulid 2023-02-15 07:24:32 +01:00
Mallik Hassan
7f0ad0e6ba
Merge branch 'master' into unixodbc_update_v_2_3_11 2023-02-14 19:22:48 -04:00
Nikolay Degterinsky
94d52d2b28 Fix include 2023-02-14 16:45:46 +00:00
Nikolay Degterinsky
09da5575e3 Merge remote-tracking branch 'upstream/master' into ulid 2023-02-14 13:41:17 +00:00
SadiHassan
5bb2144e12 updated files 2023-02-14 05:25:50 -08:00
Antonio Andelic
1826c29c82 Merge branch 'master' into s3-client-polish 2023-02-14 13:08:27 +00:00
SadiHassan
df68017fff update unixodbc to v2.3.11 to mitigate CVE-2011-1145 2023-02-13 08:43:46 -08:00