Commit Graph

2972 Commits

Author SHA1 Message Date
Azat Khuzhin
95b3a02779 Fix strerror_r() configuration for jemalloc with musl under clang-15
Build error [1]:

    Sep 06 18:40:53 FAILED: contrib/jemalloc-cmake/CMakeFiles/_jemalloc.dir/__/jemalloc/src/malloc_io.c.o
    Sep 06 18:40:53 /usr/bin/ccache /usr/bin/clang-15 --target=x86_64-linux-musl --sysroot=/build/cmake/linux/../../contrib/sysroot/linux-x86_64-musl -DHAS_RESERVED_IDENTIFIER -DJEMALLOC_NO_PRIVATE_NAMESPACE -DJEMALLOC_PROF=1 -DJEMALLOC_PROF_LIBGCC=1 -DSTD_EXCEPTION_HAS_STACK_TRACE=1 -DUSE_MUSL=1 -D_LIBCPP_ENABLE_THREAD_SAFETY_ANNOTATIONS -D_LIBCPP_HAS_MUSL_LIBC=1 -I../contrib/jemalloc/include -isystem ../contrib/jemalloc-cmake/include -isystem contrib/jemalloc-cmake/include_linux_x86_64_musl/jemalloc/internal -isystem ../contrib/libcxx/include -isystem ../contrib/libcxxabi/include -isystem ../contrib/libunwind/include --gcc-toolchain=/build/cmake/linux/../../contrib/sysroot/linux-x86_64-musl --gcc-toolchain=/build/cmake/linux/../../contrib/sysroot/linux-x86_64-musl -fdiagnostics-color=always -Xclang -fuse-ctor-homing  -gdwarf-aranges -pipe -mssse3 -msse4.1 -msse4.2 -mpclmul -mpopcnt -fasynchronous-unwind-tables -ffile-prefix-map=/build=. -falign-functions=32 -mbranches-within-32B-boundaries  -fdiagnostics-absolute-paths -fexperimental-new-pass-manager -w -O2 -g -DNDEBUG -O3 -g -gdwarf-4  -flto=thin -fwhole-program-vtables -fno-pie   -D OS_LINUX -D_GNU_SOURCE -Werror -std=gnu11 -MD -MT contrib/jemalloc-cmake/CMakeFiles/_jemalloc.dir/__/jemalloc/src/malloc_io.c.o -MF contrib/jemalloc-cmake/CMakeFiles/_jemalloc.dir/__/jemalloc/src/malloc_io.c.o.d -o contrib/jemalloc-cmake/CMakeFiles/_jemalloc.dir/__/jemalloc/src/malloc_io.c.o   -c ../contrib/jemalloc/src/malloc_io.c
    Sep 06 18:40:53 /build/contrib/jemalloc/src/malloc_io.c💯8: error: incompatible integer to pointer conversion initializing 'char *' with an expression of type 'int' [-Wint-conversion]
    Sep 06 18:40:53         char *b = strerror_r(err, buf, buflen);
    Sep 06 18:40:53               ^   ~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    Sep 06 18:40:53 1 error generated.

  [1]: https://s3.amazonaws.com/clickhouse-builds/41046/0e9265ad951d40cdce3716fb8a679360b2e0c156/package_release/build_log.log

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:35 +02:00
Azat Khuzhin
32d9bb5a7e Update sentry for clang-15 (to fix __msan_unpoison())
CI: https://s3.amazonaws.com/clickhouse-builds/41046/0e9265ad951d40cdce3716fb8a679360b2e0c156/package_msan/build_log.log
Refs: https://github.com/ClickHouse/sentry-native/pull/5
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Azat Khuzhin
aed0897e77 Update libcpuid for clang-15 (for snprintf())
CI: https://s3.amazonaws.com/clickhouse-builds/41046/0e9265ad951d40cdce3716fb8a679360b2e0c156/binary_freebsd/build_log.log
Refs: https://github.com/ClickHouse/libcpuid/pull/2
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Azat Khuzhin
e1cfde8a86 Update librdkafka for clang-15 (do not set _POSIX_C_SOURCE on FreeBSD)
Refs: https://github.com/ClickHouse/librdkafka/pull/7
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Azat Khuzhin
50cc4a6a1f Update llvm to add ability to preserve debug symbols
There are some issues with JIT, you will find details in a patch that
disables one function for it, and it will be great to have an ability to
get full backtrace for this problem during investigations.

Refs: https://github.com/ClickHouse/llvm/pull/9
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Azat Khuzhin
c214875a36 Bump replxx to fix possible uncaught exception
Refs: https://github.com/ClickHouse/replxx/pull/24
2022-09-09 22:02:45 +02:00
Azat Khuzhin
62a105f216 Update capnproto to v0.10.2 (to address issue with ASan in clang-15)
This should address issue with ASan:

- CI report - https://s3.amazonaws.com/clickhouse-test-reports/41046/490a2c75610c4bc3191d55226f8454b3c3d3919a/stateless_tests__asan__[1/2].html

    2022-09-08 19:39:40 kj/exception.c++:977: failed: expected offset < 65536 && offset > -65536; ExceptionCallback must be allocated on the stack.

- Discussion in ML - https://www.mail-archive.com/capnproto@googlegroups.com/msg01451.html

- Fix capnproto/capnproto@c4eef80a13

    "Fix ASAN problems under Clang 15.

    It appears ASAN now by default tries to detect stack-use-after-return. This breaks our assumptions in requireOnStack() and totally breaks fibers.

    For requireOnStack() we can just skip the check in this case.

    For fibers, we need to implement the ASAN hints to tell it when we're switching fibers."

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-09 19:56:25 +02:00
BoloniniD
e8bcbcd016
Merge branch 'master' into BLAKE3 2022-09-09 11:48:31 +03:00
BoloniniD
ff82784b91 Fix MSAN test 2022-09-08 23:41:18 +03:00
Robert Schulze
0df6173e4a
Merge remote-tracking branch 'origin/master' into regen-vectorscan-assets 2022-09-08 08:37:30 +00:00
BoloniniD
c08b41b611 Clean files and compatibility code 2022-09-08 09:34:59 +03:00
Robert Schulze
9b868f8b7d
doc: add note about upstream colm/ragel 2022-09-07 20:10:17 +00:00
Robert Schulze
151bf1e074
fix: suppress warnings for ARM ragel assets 2022-09-07 20:08:31 +00:00
HarryLeeIBM
af603f9ac6 Fix zlib-ng build for s390x 2022-09-07 12:20:39 -07:00
Robert Schulze
d1d6e5cb23
fix: build ragel assets for amd64 and aarch64 separately 2022-09-07 11:56:09 +00:00
Antonio Andelic
61398cee80 Merge branch 'master' into keeper-linearizable-reads 2022-09-07 10:25:35 +00:00
Robert Schulze
c4297c6c99
fix: disable narrowing warnings 2022-09-06 22:02:02 +00:00
Robert Schulze
0e363ca6e3
chore: regenerate vectorscan assets with ragel/colm head 2022-09-06 21:15:30 +00:00
BoloniniD
d635c3f9be Disable BLAKE3 for aarch64-darwin 2022-09-06 21:22:40 +03:00
Robert Schulze
cc1bd3ac36
fix: disable vectorscan when building w/o SSE >=3 2022-09-06 16:15:50 +00:00
Filatenkov Artur
7949b3fb74
Merge branch 'master' into annoy 2022-09-06 11:23:15 +03:00
FArthur-cmd
7f311ad03c add words about setting to docs 2022-09-05 13:20:49 +00:00
FArthur-cmd
9096b73084 add setting 2022-09-05 12:41:46 +00:00
Kruglov Pavel
582216a3ca
Merge pull request #39919 from pzhdfy/UniqSketch
UniqThetaSketch support set operation such as union/intersect/not
2022-09-05 13:42:14 +02:00
Antonio Andelic
110ad53300 Merge branch 'master' into keeper-linearizable-reads 2022-09-05 07:12:45 +00:00
alesapin
3da9e8646d
Merge pull request #40941 from ClickHouse/keeper-fix-shutdown-increase-request-size
Fix in Keeper shutdown during long commit and increase allowed request size
2022-09-04 13:39:33 +02:00
Antonio Andelic
396500aaa7 Update NuRaft 2022-09-02 13:14:33 +00:00
Azat Khuzhin
dd8478422a Fix usage of generator expressions for libcxx cmake
Before, if you store clickhouse sources in /src, there was a typo and it
produce the following error:

    CMake Error in contrib/libcxx-cmake/CMakeLists.txt:
      Target "cxx" INTERFACE_INCLUDE_DIRECTORIES property contains path:

        "/src"

      which is prefixed in the source directory.

Also move "src" into PRIVATE, since it is required only for libcxx
itself.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-02 14:21:43 +02:00
Fangyuan Deng
bc7d661668
Merge branch 'master' into UniqSketch 2022-09-01 19:31:53 +08:00
Antonio Andelic
9acb253334 Update NuRaft 2022-09-01 08:44:20 +00:00
Antonio Andelic
91aff95298 Merge branch 'master' into keeper-linearizable-reads 2022-09-01 08:43:50 +00:00
Filatenkov Artur
899a2e29df
Enable UBsan 2022-08-31 16:44:52 +03:00
Antonio Andelic
97fd3d9123
Merge branch 'master' into fix-install-snapshot 2022-08-31 08:42:00 +02:00
Fangyuan Deng
5c2f35c302
Merge branch 'master' into UniqSketch 2022-08-31 10:23:46 +08:00
FArthur-cmd
941cceda7f fix build 2022-08-30 23:09:22 +00:00
FArthur-cmd
c7d31c3a90 fix indexes for ColumnArray 2022-08-30 15:32:05 +00:00
FArthur-cmd
e7abc06c89 Revert "Revert "Add Annoy index""
This reverts commit 6fdfb964d0.
2022-08-30 15:26:56 +00:00
Alexander Tokmakov
6fdfb964d0
Revert "Add Annoy index" 2022-08-30 15:10:10 +03:00
pzhdfy
92f88c1429 update datasketches-cpp 2022-08-30 20:02:47 +08:00
Alexander Tokmakov
44c6c85f75
Merge pull request #40756 from ClickHouse/libuv_update
Merging #39398
2022-08-30 14:38:50 +03:00
Alexander Tokmakov
ff2db8e2a7 update submodule 2022-08-29 16:46:21 +02:00
FArthur-cmd
c6e45fe690 remove build with UBSan 2022-08-29 09:18:15 +00:00
Antonio Andelic
b4af21b6fb Small fixes 2022-08-29 07:06:51 +00:00
FArthur-cmd
f3d0083e57 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into annoy-2 2022-08-26 13:53:53 +00:00
Antonio Andelic
dae65178b7 Improve preprocessing performance 2022-08-26 10:46:14 +00:00
Antonio Andelic
4bbcbda7cc NuRaft fix for install snapshot 2022-08-25 14:12:17 +00:00
BoloniniD
78d00c3371 Add glibc symbols to glibc_compatibility 2022-08-24 21:30:48 +03:00
Antonio Andelic
073b168b31 add msg type string for leader status 2022-08-24 07:50:08 +00:00
Antonio Andelic
99d23cb67e Merge branch 'master' into keeper-linearizable-reads 2022-08-23 07:03:20 +00:00
BoloniniD
c7a6c4d56f Test with Ubuntu 14.04 static libs 2022-08-22 20:09:37 +03:00
Antonio Andelic
af02c76a3c
Merge branch 'master' into keeper-listen-host 2022-08-21 18:43:55 +02:00
FArthur-cmd
1e8910f048 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into annoy-2 2022-08-21 08:45:03 +00:00
BoloniniD
a30d43ba19 Add RUSTFLAGS to link crates to glibc 2022-08-19 21:45:19 +03:00
Suzy Wang
c273ef125d
Merge branch 'master' into libuv_update 2022-08-18 16:30:52 -04:00
BoloniniD
256d4a5e61 Move -l rustc flag out of target part 2022-08-18 23:26:44 +03:00
Alexey Milovidov
aaf6a3c862
Merge pull request #40184 from ClickHouse/update-cctz
Update cctz
2022-08-18 10:13:04 +03:00
Antonio Andelic
26b7117b6c Merge branch 'master' into keeper-listen-host 2022-08-18 07:05:20 +00:00
BoloniniD
eba479101a Fix glibc compat 2022-08-17 21:03:35 +03:00
Suzy Wang
9d14397a2a rm duplicated declaration 2022-08-17 08:15:08 -07:00
Antonio Andelic
833c4bc5f6 Update commit for NuRaft 2022-08-17 09:28:57 +00:00
Robert Schulze
2110d4334b
Merge pull request #40272 from ClibMouse/librdkafka_update
(negligible) rdkafka library: update lz4.c from upstream, cve fixes
2022-08-17 10:32:33 +02:00
Antonio Andelic
b5358ba8de Merge branch 'master' into keeper-listen-host 2022-08-17 08:31:43 +00:00
Suzy Wang
6539273c86 update lz4.c from upstream, cve fixes 2022-08-16 06:50:37 -07:00
Suzy Wang
ec7f89f287 Update libuv commits, pull changes from upstream 2022-08-15 12:47:23 -07:00
Suzy Wang
cceab1cd3e Merge remote-tracking branch 'upstream/master' into libuv_update 2022-08-15 12:27:29 -07:00
BoloniniD
1691a8b3f5 Merge branch 'BLAKE3' of github.com:BoloniniD/ClickHouse into BLAKE3 2022-08-15 20:44:49 +03:00
BoloniniD
00b57b8af8 Fix compatibility with glibc 2022-08-15 20:44:31 +03:00
FArthur-cmd
1d048432a1 update contrib and update cmake 2022-08-15 14:35:51 +00:00
Alexey Milovidov
970d482469 Merge branch 'master' into update-cctz 2022-08-14 04:49:29 +02:00
Alexey Milovidov
055c80d80c Update cctz 2022-08-13 07:48:11 +02:00
Alexey Milovidov
a6a51f4fb8 Minor build changes 2022-08-13 06:39:20 +02:00
avogar
347ffbf178 Fix special build 2022-08-10 14:19:27 +00:00
avogar
4c102adaf3 Fix deadlock with msan 2022-08-09 11:39:40 +00:00
Kruglov Pavel
704bdd08ec
Merge branch 'master' into revert-39804-revert-39510-update-arrow 2022-08-08 15:51:29 +02:00
Antonio Andelic
3b1117dafd use correct NuRaft commit 2022-08-08 11:12:12 +00:00
Antonio Andelic
6b935a252f Support multiple listen hosts 2022-08-08 09:08:19 +00:00
BoloniniD
244c37cbbf Fix submodules 2022-08-07 16:03:44 +03:00
BoloniniD
c1f09655cf Fix include directory for BLAKE3 2022-08-07 11:38:23 +03:00
BoloniniD
24f3b00193
Merge branch 'master' into BLAKE3 2022-08-06 19:48:10 +03:00
BoloniniD
ef4ca4279a Fix build cfg for BLAKE3 2022-08-06 18:24:25 +03:00
BoloniniD
d2e554e4f6 Fix build cfg for BLAKE3 2022-08-06 11:11:45 +03:00
Alexey Milovidov
adc880f362
Merge pull request #39867 from ClickHouse/keeper-block-memory-tracker-commit
Block memory tracker in Keeper during commit
2022-08-06 02:02:29 +03:00
Kseniia Sumarokova
ba53ed274b
Merge pull request #39327 from kssenii/update-azure-lib
Update azure library (removed "harmful" function)
2022-08-05 00:20:43 +02:00
BoloniniD
48c91619b0
Merge branch 'master' into BLAKE3 2022-08-04 20:30:47 +03:00
Antonio Andelic
f63e4ba261 Update NuRaft 2022-08-04 13:14:57 +00:00
Antonio Andelic
c99c5a0dd1 Merge branch 'master' into keeper-block-memory-tracker-commit 2022-08-04 13:04:11 +00:00
Kseniia Sumarokova
92882fe337
Update CMakeLists.txt 2022-08-04 11:08:59 +02:00
BoloniniD
f09c8c8a50
Enable aarch64-darwin build 2022-08-04 09:02:46 +03:00
Alexey Milovidov
f474eb957d
Merge pull request #39758 from ClickHouse/tsan_clang_15
Try clang-15 for build with tsan
2022-08-04 01:56:52 +03:00
Kseniia Sumarokova
bd5610b732
Merge branch 'master' into update-azure-lib 2022-08-03 23:00:57 +02:00
Antonio Andelic
56ca93ca3f Block memory tracker in Keeper during commit 2022-08-03 14:14:57 +00:00
kssenii
da49a0cc02 Fix build 2022-08-03 12:32:55 +02:00
BoloniniD
be8eefa3cd
Fix BLAKE3 crate name 2022-08-03 11:18:35 +03:00
BoloniniD
29084d92d8 Fix CMake for ENABLE_RUST 2022-08-02 20:44:12 +03:00
Alexander Tokmakov
82b50e79cf
Merge branch 'master' into tsan_clang_15 2022-08-02 13:00:55 +03:00
avogar
3be13e4f92 Try fix build under ppc64 2022-08-02 08:25:46 +00:00
Kruglov Pavel
6976c690bd
Revert "Revert "Update arrow to fix possible data race"" 2022-08-02 10:09:18 +02:00
Alexander Tokmakov
55af8878a5
Revert "Update arrow to fix possible data race" 2022-08-01 22:18:34 +03:00
BoloniniD
aee6a72049 Add BLAKE3 as shims only with blake3 as Rust crate 2022-08-01 21:31:38 +03:00
BoloniniD
15773e5b01 Remove BLAKE3 as submodule 2022-08-01 21:30:15 +03:00