Commit Graph

3064 Commits

Author SHA1 Message Date
Antonio Andelic
f79af2aea7 Merge branch 'master' into parallel-log-appending 2022-11-24 11:13:04 +00:00
Antonio Andelic
2d2c6eee30 Update NuRaft 2022-11-21 15:06:33 +00:00
Suzy Wang
d1a2af8670 Enable base64 on s390x platform 2022-11-16 13:01:10 -08:00
Azat Khuzhin
ddfea23804 Do not include libcxx library for C
If you will have the same header in both libraries you may have some
tricky failures.

And there is at least one header that exists in both: stdatomic.h

Right now there is a workaround for this header, that allows to use C++
version of this header for C - the workaround is called "set
_LIBCPP_COMPILER_CLANG_BASED not only for CXX" [1] and use include_next
[2].

  [1]: 9a457ab3c6/include/__config (L39)
  [2]: 9a457ab3c6/include/stdatomic.h (L223-L231)

However #42730 changes this, and now it fails to compile because of this.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-11 14:43:14 +01:00
Antonio Andelic
25b19e6ba0
Merge branch 'master' into manual_snapshot_for_keeper 2022-11-03 08:55:01 +01:00
Robert Schulze
c8068bdfa2
Merge pull request #42816 from azat/build/llvm-fix
Fix compilation of LLVM with cmake cache
2022-11-01 08:22:06 +01:00
Azat Khuzhin
b62170426a Fix compilation of LLVM with cmake cache
Simple reproducer:

    $ cmake
    $ ninja contrib/llvm-project/llvm/lib/MC/MCParser/CMakeFiles/LLVMMCParser.dir/MasmParser.cpp.o # will have -std=c++14
    $ touch CMakeLists.txt
    $ cmake
    $ ninja contrib/llvm-project/llvm/lib/MC/MCParser/CMakeFiles/LLVMMCParser.dir/MasmParser.cpp.o # will have -std=c++20 and fail
    (fails because std::vector cannot work with opaque types anymore)

Fixes: #42249 (cc @rschu1ze)
2022-10-31 10:56:05 +01:00
Alexey Milovidov
25d35a97f9 Update CCTZ to 2022f 2022-10-29 18:10:33 +02:00
Sema Checherinda
df3e4d26ad
Merge pull request #42463 from ClibMouse/update_zlib
Update zlib-ng to latest commit
2022-10-27 12:45:23 +02:00
Robert Schulze
a9427888be
Build libcxx and libcxxabi from llvm-project
Resolves #42245
2022-10-27 09:55:27 +00:00
Robert Schulze
31ef6c66cb
Merge pull request #42513 from ClickHouse/update-libcxx-to-15
Build with libcxx(abi) 15
2022-10-27 10:30:36 +02:00
Alexey Milovidov
8a56beb74a
Merge branch 'master' into update_zlib 2022-10-25 08:55:44 +02:00
Alexey Milovidov
c48127534b
Merge pull request #41753 from pkit/morton_coding
add Morton Coding (ZCurve)
2022-10-25 06:10:37 +02:00
Alexey Milovidov
dcf45e83a9
Merge branch 'master' into update_zlib 2022-10-25 05:08:09 +02:00
Robert Schulze
240637f8f1
Merge branch 'master' into update-libcxx-to-15 2022-10-24 11:11:01 +02:00
Robert Schulze
7243e12ef8
Fix build 2022-10-24 07:42:20 +00:00
Alexey Milovidov
729692f862
Merge pull request #42462 from ClibMouse/power_build_fix
Fix power8+ support add power9+ support
2022-10-24 09:30:38 +02:00
Robert Schulze
c119cd2f00
Merge branch 'master' into update-libcxx-to-15 2022-10-24 08:29:37 +02:00
JackyWoo
39c88c74e8 check whether last manually created snapshot is done 2022-10-22 22:31:17 +08:00
Yakov Olkhovskiy
d285c9e7ff move libfuzzer to dedicated contrib/libfuzzer-cmake 2022-10-21 14:04:01 +00:00
Yakov Olkhovskiy
bd33c4f180 add lib_fuzzer and lib_fuzzer_no_main to llvm-project build 2022-10-21 01:25:51 +00:00
Robert Schulze
eda3955f01
Update libcxx submodule 2022-10-20 14:50:51 +00:00
Robert Schulze
820e6b4276
Build with libcxx(abi) 15 2022-10-20 10:52:43 +00:00
Constantine Peresypkin
5b3b11b517 add Morton Coding (ZCurve) 2022-10-19 15:59:25 +02:00
Boris Kuschel
4645d465b1
update zlib-ng to latest 2022-10-18 17:38:06 -05:00
Boris Kuschel
e45c800cdf Fix power8+ support add power9+ support 2022-10-18 17:14:43 -05:00
Alexey Milovidov
87296eb90b Update CCTZ to 2022e. 2022-10-14 22:01:26 +02:00
Dom Del Nano
6bbbbda868 Update cctz to pull in upstream 2022e changes 2022-10-12 21:46:51 -07:00
Robert Schulze
50ae7d8484
Merge branch 'master' into cleanup-llvm 2022-10-12 10:02:55 +02:00
Robert Schulze
c08387eb0d
Minor cleanups of LLVM integration 2022-10-11 14:18:52 +00:00
Raúl Marín
dbed82e74c Fix LLVM build 2022-10-10 12:18:05 +02:00
Maksim Kita
4eb29f7428 Updated submodule 2022-10-07 10:55:08 +02:00
Alexey Milovidov
25d13b89e9
Merge pull request #41142 from MeenaRenganathan22/OpenSSL_InHouse
Changes to support the OpenSSL In-house build.
2022-10-05 23:02:04 +03:00
Kseniia Sumarokova
46c20a7197
Merge pull request #42031 from kssenii/update-amqp
Update amqp-cpp
2022-10-05 12:06:58 +02:00
Kseniia Sumarokova
7935337513
Update CMakeLists.txt 2022-10-04 19:59:08 +02:00
Robert Schulze
af8d32bb1f
Merge pull request #42023 from ClickHouse/llvm-without-clothes
Build against an LLVM version which has clang[-extra-tools], lldb and lld removed
2022-10-04 17:13:50 +02:00
Kseniia Sumarokova
aacb314a41
Update cmake 2022-10-04 16:15:33 +02:00
kssenii
620b0673d0 Update AMQP 2022-10-03 17:24:57 +02:00
Vitaly Baranov
65c61877c7
Merge pull request #33435 from BoloniniD/BLAKE3
Integrating Rust code into ClickHouse
2022-10-03 15:25:06 +02:00
Robert Schulze
aadb999913
Build against an LLVM version which has clang[-extra-tools], lldb and lld removed
Saves ca. 600 MB of disk space
2022-10-03 12:44:11 +00:00
Robert Schulze
aa9373c9c2
Merge pull request #41951 from ClickHouse/llvm-14
Bump LLVM from 13 to 14
2022-10-03 12:34:31 +02:00
BoloniniD
92e6bf57dc Remove old if-statement in corrosion-cmake 2022-10-02 22:29:47 +03:00
BoloniniD
a3c0b8e815
Fix CMake style in corrosion-cmake
Co-authored-by: Vitaly Baranov <vitlibar@yandex.ru>
2022-10-02 21:25:10 +03:00
Alexey Milovidov
2194c549ba
Merge pull request #41974 from ClibMouse/enable_base64_ppc64le
Enable lib base64 for powerpc platform
2022-10-01 18:10:08 +03:00
root
7e4edfeb5a Merge branch 'master' of https://github.com/MeenaRenganathan22/ClickHouse into OpenSSL_InHouse 2022-09-30 15:50:46 -07:00
root
4318ec125e Merge branch 'master' of https://github.com/MeenaRenganathan22/ClickHouse into OpenSSL_InHouse 2022-09-30 15:50:22 -07:00
root
bb1771e159 Update the macro ENABLE_CH_BUNDLE_BORINGSSLL to ENABLE_EXTERNAL_OPENSSL 2022-09-30 10:35:49 -07:00
BoloniniD
758d4b79fb Fix submodules 2022-09-30 20:31:01 +03:00
Suzy Wang
29c8023b7f Enable lib base64 for powerpc platform 2022-09-30 07:04:47 -07:00
Robert Schulze
4ac308a7a6
Update submodule + fix compile error 2022-09-30 09:23:41 +00:00
BoloniniD
55c79230b3 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-09-29 23:53:25 +03:00
Robert Schulze
32f0aa75e6
Bump to LLVM 14 2022-09-29 19:16:11 +00:00
Robert Schulze
a300ea6024
Try to fix binary compatibility check + extend check to library-bridge 2022-09-28 09:56:58 +00:00
Robert Schulze
9c62797d28
Bump LLVM from 12 to 13 2022-09-26 07:13:46 +00:00
Nikolay Degterinsky
6edf8ec3f2 Better S3 logs 2022-09-22 22:34:13 +00:00
BoloniniD
7642212ff8 Fix find_package(Rust) for corrosion-cmake 2022-09-22 21:53:55 +03:00
Alexey Milovidov
33c751a561
Merge pull request #41603 from ClickHouse/cut-openldap
Update OpenLDAP library
2022-09-22 07:26:01 +03:00
Alexey Milovidov
2d6350b114 Update OpenLDAP library 2022-09-21 06:27:10 +02:00
Filatenkov Artur
2139d5be17
Merge branch 'master' into annoy 2022-09-20 15:28:08 +03:00
FArthur-cmd
14c963e4ee update submodule 2022-09-20 11:29:13 +03:00
BoloniniD
55fcb98f29 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-09-19 21:53:14 +03:00
BoloniniD
4f2915c8f7 Fix aarch64-darwin build 2022-09-19 21:52:57 +03:00
BoloniniD
5b4fb4bf66
Merge branch 'master' into BLAKE3 2022-09-18 23:14:37 +03:00
BoloniniD
7b5d3e3d82 Fix Rust installation for Corrosion 2022-09-18 23:14:16 +03:00
Alexey Milovidov
3eb7ee8308 Remove noise from build process 2022-09-18 10:35:25 +02:00
Alexey Milovidov
7e93dbfcd6
Merge pull request #41094 from HarryLeeIBM/hlee-s390x-zlib-ng
Fix zlib-ng build issue for s390x
2022-09-18 07:55:20 +03:00
Alexey Milovidov
59d05b949b
Merge branch 'master' into bump-replxx 2022-09-17 22:49:34 +03:00
BoloniniD
627dea333e Merge branch 'master' into BLAKE3 2022-09-17 22:14:30 +03:00
Alexander Tokmakov
42dab6dc02 Revert "Merge pull request #38200 from ClickHouse/keeper-linearizable-reads"
This reverts commit 222b964070, reversing
changes made to da01982652.
2022-09-17 19:22:58 +02:00
BoloniniD
1c0047dbff Review fixes 2022-09-17 16:34:19 +03:00
Alexey Milovidov
cb45f51e51
Merge branch 'master' into bump-replxx 2022-09-17 03:22:10 +03:00
BoloniniD
452ef4435b Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-09-16 20:05:56 +03:00
Robert Schulze
545893f56a
Merge pull request #41239 from ClickHouse/bundled-c-ares
Bundle c-ares 3rd-party library
2022-09-16 12:06:54 +02:00
Antonio Andelic
222b964070
Merge pull request #38200 from ClickHouse/keeper-linearizable-reads
Keeper faster linearizable reads
2022-09-16 07:58:52 +02:00
Alexey Milovidov
da01982652
Merge pull request #41046 from azat/build/llvm-15
Switch to llvm/clang 15
2022-09-16 07:31:06 +03:00
Robert Schulze
2b9938fb3a
Merge branch 'master' into bundled-c-ares 2022-09-16 02:15:19 +02:00
BoloniniD
0df426d329 Corrosion fixes + review fixes 2022-09-16 00:05:21 +03:00
Antonio Andelic
761d53b438 Use merged NuRaft 2022-09-15 16:14:45 +00:00
Antonio Andelic
0dbd0c1f72 Merge branch 'master' into keeper-linearizable-reads 2022-09-15 16:03:18 +00:00
Robert Schulze
065e668182
Merge branch 'master' into bundled-c-ares 2022-09-14 09:31:06 +02:00
Robert Schulze
5aedf60689
fix: repair aarch64 build 2022-09-13 20:51:51 +00:00
Robert Schulze
fb5812f554
Bump vectorscan to 5.4.8
Brings good stuff like
- https://github.com/VectorCamp/vectorscan/pull/119
- https://github.com/VectorCamp/vectorscan/pull/118
2022-09-13 17:06:09 +00:00
Robert Schulze
d2d6e6787b
style: remove obsolete comments 2022-09-13 17:42:57 +02:00
Robert Schulze
5fcad783d2
fix: make musl build work 2022-09-13 07:21:27 +00:00
Robert Schulze
134def1cff
build: bundle c-ares 2022-09-12 20:36:35 +00:00
BoloniniD
147dfac11e Try using Corrosion 2022-09-12 23:05:41 +03:00
Meena Renganathan
51d6611b96 Committing the ClickHouse core changes and other libraries to support OpenSSL. BoringSSL is still set as default 2022-09-12 09:05:38 -07:00
Alexey Milovidov
485262991e
Merge pull request #41033 from ClickHouse/regen-vectorscan-assets
Regenerate vectorscan assets with latest and greatest ragel/colm
2022-09-11 22:57:39 +03:00
Azat Khuzhin
3c47d5bbff Add a workaround for strerror_r() libpq for FreeBSD (for clang-15)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:35 +02:00
Azat Khuzhin
38c0b0ee50 Add a workaround for krb5 and musl for strerror_r()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:35 +02:00
Azat Khuzhin
0bb835c66e Add a workaround for clang-15 in libpq for strerror_r()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:35 +02:00
Azat Khuzhin
95b3a02779 Fix strerror_r() configuration for jemalloc with musl under clang-15
Build error [1]:

    Sep 06 18:40:53 FAILED: contrib/jemalloc-cmake/CMakeFiles/_jemalloc.dir/__/jemalloc/src/malloc_io.c.o
    Sep 06 18:40:53 /usr/bin/ccache /usr/bin/clang-15 --target=x86_64-linux-musl --sysroot=/build/cmake/linux/../../contrib/sysroot/linux-x86_64-musl -DHAS_RESERVED_IDENTIFIER -DJEMALLOC_NO_PRIVATE_NAMESPACE -DJEMALLOC_PROF=1 -DJEMALLOC_PROF_LIBGCC=1 -DSTD_EXCEPTION_HAS_STACK_TRACE=1 -DUSE_MUSL=1 -D_LIBCPP_ENABLE_THREAD_SAFETY_ANNOTATIONS -D_LIBCPP_HAS_MUSL_LIBC=1 -I../contrib/jemalloc/include -isystem ../contrib/jemalloc-cmake/include -isystem contrib/jemalloc-cmake/include_linux_x86_64_musl/jemalloc/internal -isystem ../contrib/libcxx/include -isystem ../contrib/libcxxabi/include -isystem ../contrib/libunwind/include --gcc-toolchain=/build/cmake/linux/../../contrib/sysroot/linux-x86_64-musl --gcc-toolchain=/build/cmake/linux/../../contrib/sysroot/linux-x86_64-musl -fdiagnostics-color=always -Xclang -fuse-ctor-homing  -gdwarf-aranges -pipe -mssse3 -msse4.1 -msse4.2 -mpclmul -mpopcnt -fasynchronous-unwind-tables -ffile-prefix-map=/build=. -falign-functions=32 -mbranches-within-32B-boundaries  -fdiagnostics-absolute-paths -fexperimental-new-pass-manager -w -O2 -g -DNDEBUG -O3 -g -gdwarf-4  -flto=thin -fwhole-program-vtables -fno-pie   -D OS_LINUX -D_GNU_SOURCE -Werror -std=gnu11 -MD -MT contrib/jemalloc-cmake/CMakeFiles/_jemalloc.dir/__/jemalloc/src/malloc_io.c.o -MF contrib/jemalloc-cmake/CMakeFiles/_jemalloc.dir/__/jemalloc/src/malloc_io.c.o.d -o contrib/jemalloc-cmake/CMakeFiles/_jemalloc.dir/__/jemalloc/src/malloc_io.c.o   -c ../contrib/jemalloc/src/malloc_io.c
    Sep 06 18:40:53 /build/contrib/jemalloc/src/malloc_io.c💯8: error: incompatible integer to pointer conversion initializing 'char *' with an expression of type 'int' [-Wint-conversion]
    Sep 06 18:40:53         char *b = strerror_r(err, buf, buflen);
    Sep 06 18:40:53               ^   ~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    Sep 06 18:40:53 1 error generated.

  [1]: https://s3.amazonaws.com/clickhouse-builds/41046/0e9265ad951d40cdce3716fb8a679360b2e0c156/package_release/build_log.log

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:35 +02:00
Azat Khuzhin
32d9bb5a7e Update sentry for clang-15 (to fix __msan_unpoison())
CI: https://s3.amazonaws.com/clickhouse-builds/41046/0e9265ad951d40cdce3716fb8a679360b2e0c156/package_msan/build_log.log
Refs: https://github.com/ClickHouse/sentry-native/pull/5
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Azat Khuzhin
aed0897e77 Update libcpuid for clang-15 (for snprintf())
CI: https://s3.amazonaws.com/clickhouse-builds/41046/0e9265ad951d40cdce3716fb8a679360b2e0c156/binary_freebsd/build_log.log
Refs: https://github.com/ClickHouse/libcpuid/pull/2
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Azat Khuzhin
e1cfde8a86 Update librdkafka for clang-15 (do not set _POSIX_C_SOURCE on FreeBSD)
Refs: https://github.com/ClickHouse/librdkafka/pull/7
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Azat Khuzhin
50cc4a6a1f Update llvm to add ability to preserve debug symbols
There are some issues with JIT, you will find details in a patch that
disables one function for it, and it will be great to have an ability to
get full backtrace for this problem during investigations.

Refs: https://github.com/ClickHouse/llvm/pull/9
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Azat Khuzhin
c214875a36 Bump replxx to fix possible uncaught exception
Refs: https://github.com/ClickHouse/replxx/pull/24
2022-09-09 22:02:45 +02:00
Azat Khuzhin
62a105f216 Update capnproto to v0.10.2 (to address issue with ASan in clang-15)
This should address issue with ASan:

- CI report - https://s3.amazonaws.com/clickhouse-test-reports/41046/490a2c75610c4bc3191d55226f8454b3c3d3919a/stateless_tests__asan__[1/2].html

    2022-09-08 19:39:40 kj/exception.c++:977: failed: expected offset < 65536 && offset > -65536; ExceptionCallback must be allocated on the stack.

- Discussion in ML - https://www.mail-archive.com/capnproto@googlegroups.com/msg01451.html

- Fix capnproto/capnproto@c4eef80a13

    "Fix ASAN problems under Clang 15.

    It appears ASAN now by default tries to detect stack-use-after-return. This breaks our assumptions in requireOnStack() and totally breaks fibers.

    For requireOnStack() we can just skip the check in this case.

    For fibers, we need to implement the ASAN hints to tell it when we're switching fibers."

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-09 19:56:25 +02:00
BoloniniD
e8bcbcd016
Merge branch 'master' into BLAKE3 2022-09-09 11:48:31 +03:00
BoloniniD
ff82784b91 Fix MSAN test 2022-09-08 23:41:18 +03:00