Commit Graph

2989 Commits

Author SHA1 Message Date
Alexey Milovidov
da01982652
Merge pull request #41046 from azat/build/llvm-15
Switch to llvm/clang 15
2022-09-16 07:31:06 +03:00
Robert Schulze
2b9938fb3a
Merge branch 'master' into bundled-c-ares 2022-09-16 02:15:19 +02:00
BoloniniD
0df426d329 Corrosion fixes + review fixes 2022-09-16 00:05:21 +03:00
Antonio Andelic
761d53b438 Use merged NuRaft 2022-09-15 16:14:45 +00:00
Antonio Andelic
0dbd0c1f72 Merge branch 'master' into keeper-linearizable-reads 2022-09-15 16:03:18 +00:00
Robert Schulze
065e668182
Merge branch 'master' into bundled-c-ares 2022-09-14 09:31:06 +02:00
Robert Schulze
5aedf60689
fix: repair aarch64 build 2022-09-13 20:51:51 +00:00
Robert Schulze
fb5812f554
Bump vectorscan to 5.4.8
Brings good stuff like
- https://github.com/VectorCamp/vectorscan/pull/119
- https://github.com/VectorCamp/vectorscan/pull/118
2022-09-13 17:06:09 +00:00
Robert Schulze
d2d6e6787b
style: remove obsolete comments 2022-09-13 17:42:57 +02:00
Robert Schulze
5fcad783d2
fix: make musl build work 2022-09-13 07:21:27 +00:00
Robert Schulze
134def1cff
build: bundle c-ares 2022-09-12 20:36:35 +00:00
BoloniniD
147dfac11e Try using Corrosion 2022-09-12 23:05:41 +03:00
Meena Renganathan
51d6611b96 Committing the ClickHouse core changes and other libraries to support OpenSSL. BoringSSL is still set as default 2022-09-12 09:05:38 -07:00
Alexey Milovidov
485262991e
Merge pull request #41033 from ClickHouse/regen-vectorscan-assets
Regenerate vectorscan assets with latest and greatest ragel/colm
2022-09-11 22:57:39 +03:00
Azat Khuzhin
3c47d5bbff Add a workaround for strerror_r() libpq for FreeBSD (for clang-15)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:35 +02:00
Azat Khuzhin
38c0b0ee50 Add a workaround for krb5 and musl for strerror_r()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:35 +02:00
Azat Khuzhin
0bb835c66e Add a workaround for clang-15 in libpq for strerror_r()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:35 +02:00
Azat Khuzhin
95b3a02779 Fix strerror_r() configuration for jemalloc with musl under clang-15
Build error [1]:

    Sep 06 18:40:53 FAILED: contrib/jemalloc-cmake/CMakeFiles/_jemalloc.dir/__/jemalloc/src/malloc_io.c.o
    Sep 06 18:40:53 /usr/bin/ccache /usr/bin/clang-15 --target=x86_64-linux-musl --sysroot=/build/cmake/linux/../../contrib/sysroot/linux-x86_64-musl -DHAS_RESERVED_IDENTIFIER -DJEMALLOC_NO_PRIVATE_NAMESPACE -DJEMALLOC_PROF=1 -DJEMALLOC_PROF_LIBGCC=1 -DSTD_EXCEPTION_HAS_STACK_TRACE=1 -DUSE_MUSL=1 -D_LIBCPP_ENABLE_THREAD_SAFETY_ANNOTATIONS -D_LIBCPP_HAS_MUSL_LIBC=1 -I../contrib/jemalloc/include -isystem ../contrib/jemalloc-cmake/include -isystem contrib/jemalloc-cmake/include_linux_x86_64_musl/jemalloc/internal -isystem ../contrib/libcxx/include -isystem ../contrib/libcxxabi/include -isystem ../contrib/libunwind/include --gcc-toolchain=/build/cmake/linux/../../contrib/sysroot/linux-x86_64-musl --gcc-toolchain=/build/cmake/linux/../../contrib/sysroot/linux-x86_64-musl -fdiagnostics-color=always -Xclang -fuse-ctor-homing  -gdwarf-aranges -pipe -mssse3 -msse4.1 -msse4.2 -mpclmul -mpopcnt -fasynchronous-unwind-tables -ffile-prefix-map=/build=. -falign-functions=32 -mbranches-within-32B-boundaries  -fdiagnostics-absolute-paths -fexperimental-new-pass-manager -w -O2 -g -DNDEBUG -O3 -g -gdwarf-4  -flto=thin -fwhole-program-vtables -fno-pie   -D OS_LINUX -D_GNU_SOURCE -Werror -std=gnu11 -MD -MT contrib/jemalloc-cmake/CMakeFiles/_jemalloc.dir/__/jemalloc/src/malloc_io.c.o -MF contrib/jemalloc-cmake/CMakeFiles/_jemalloc.dir/__/jemalloc/src/malloc_io.c.o.d -o contrib/jemalloc-cmake/CMakeFiles/_jemalloc.dir/__/jemalloc/src/malloc_io.c.o   -c ../contrib/jemalloc/src/malloc_io.c
    Sep 06 18:40:53 /build/contrib/jemalloc/src/malloc_io.c💯8: error: incompatible integer to pointer conversion initializing 'char *' with an expression of type 'int' [-Wint-conversion]
    Sep 06 18:40:53         char *b = strerror_r(err, buf, buflen);
    Sep 06 18:40:53               ^   ~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    Sep 06 18:40:53 1 error generated.

  [1]: https://s3.amazonaws.com/clickhouse-builds/41046/0e9265ad951d40cdce3716fb8a679360b2e0c156/package_release/build_log.log

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:35 +02:00
Azat Khuzhin
32d9bb5a7e Update sentry for clang-15 (to fix __msan_unpoison())
CI: https://s3.amazonaws.com/clickhouse-builds/41046/0e9265ad951d40cdce3716fb8a679360b2e0c156/package_msan/build_log.log
Refs: https://github.com/ClickHouse/sentry-native/pull/5
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Azat Khuzhin
aed0897e77 Update libcpuid for clang-15 (for snprintf())
CI: https://s3.amazonaws.com/clickhouse-builds/41046/0e9265ad951d40cdce3716fb8a679360b2e0c156/binary_freebsd/build_log.log
Refs: https://github.com/ClickHouse/libcpuid/pull/2
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Azat Khuzhin
e1cfde8a86 Update librdkafka for clang-15 (do not set _POSIX_C_SOURCE on FreeBSD)
Refs: https://github.com/ClickHouse/librdkafka/pull/7
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Azat Khuzhin
50cc4a6a1f Update llvm to add ability to preserve debug symbols
There are some issues with JIT, you will find details in a patch that
disables one function for it, and it will be great to have an ability to
get full backtrace for this problem during investigations.

Refs: https://github.com/ClickHouse/llvm/pull/9
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Azat Khuzhin
c214875a36 Bump replxx to fix possible uncaught exception
Refs: https://github.com/ClickHouse/replxx/pull/24
2022-09-09 22:02:45 +02:00
Azat Khuzhin
62a105f216 Update capnproto to v0.10.2 (to address issue with ASan in clang-15)
This should address issue with ASan:

- CI report - https://s3.amazonaws.com/clickhouse-test-reports/41046/490a2c75610c4bc3191d55226f8454b3c3d3919a/stateless_tests__asan__[1/2].html

    2022-09-08 19:39:40 kj/exception.c++:977: failed: expected offset < 65536 && offset > -65536; ExceptionCallback must be allocated on the stack.

- Discussion in ML - https://www.mail-archive.com/capnproto@googlegroups.com/msg01451.html

- Fix capnproto/capnproto@c4eef80a13

    "Fix ASAN problems under Clang 15.

    It appears ASAN now by default tries to detect stack-use-after-return. This breaks our assumptions in requireOnStack() and totally breaks fibers.

    For requireOnStack() we can just skip the check in this case.

    For fibers, we need to implement the ASAN hints to tell it when we're switching fibers."

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-09 19:56:25 +02:00
BoloniniD
e8bcbcd016
Merge branch 'master' into BLAKE3 2022-09-09 11:48:31 +03:00
BoloniniD
ff82784b91 Fix MSAN test 2022-09-08 23:41:18 +03:00
Robert Schulze
0df6173e4a
Merge remote-tracking branch 'origin/master' into regen-vectorscan-assets 2022-09-08 08:37:30 +00:00
BoloniniD
c08b41b611 Clean files and compatibility code 2022-09-08 09:34:59 +03:00
Robert Schulze
9b868f8b7d
doc: add note about upstream colm/ragel 2022-09-07 20:10:17 +00:00
Robert Schulze
151bf1e074
fix: suppress warnings for ARM ragel assets 2022-09-07 20:08:31 +00:00
HarryLeeIBM
af603f9ac6 Fix zlib-ng build for s390x 2022-09-07 12:20:39 -07:00
Robert Schulze
d1d6e5cb23
fix: build ragel assets for amd64 and aarch64 separately 2022-09-07 11:56:09 +00:00
Antonio Andelic
61398cee80 Merge branch 'master' into keeper-linearizable-reads 2022-09-07 10:25:35 +00:00
Robert Schulze
c4297c6c99
fix: disable narrowing warnings 2022-09-06 22:02:02 +00:00
Robert Schulze
0e363ca6e3
chore: regenerate vectorscan assets with ragel/colm head 2022-09-06 21:15:30 +00:00
BoloniniD
d635c3f9be Disable BLAKE3 for aarch64-darwin 2022-09-06 21:22:40 +03:00
Robert Schulze
cc1bd3ac36
fix: disable vectorscan when building w/o SSE >=3 2022-09-06 16:15:50 +00:00
Filatenkov Artur
7949b3fb74
Merge branch 'master' into annoy 2022-09-06 11:23:15 +03:00
FArthur-cmd
7f311ad03c add words about setting to docs 2022-09-05 13:20:49 +00:00
FArthur-cmd
9096b73084 add setting 2022-09-05 12:41:46 +00:00
Kruglov Pavel
582216a3ca
Merge pull request #39919 from pzhdfy/UniqSketch
UniqThetaSketch support set operation such as union/intersect/not
2022-09-05 13:42:14 +02:00
Antonio Andelic
110ad53300 Merge branch 'master' into keeper-linearizable-reads 2022-09-05 07:12:45 +00:00
alesapin
3da9e8646d
Merge pull request #40941 from ClickHouse/keeper-fix-shutdown-increase-request-size
Fix in Keeper shutdown during long commit and increase allowed request size
2022-09-04 13:39:33 +02:00
Antonio Andelic
396500aaa7 Update NuRaft 2022-09-02 13:14:33 +00:00
Azat Khuzhin
dd8478422a Fix usage of generator expressions for libcxx cmake
Before, if you store clickhouse sources in /src, there was a typo and it
produce the following error:

    CMake Error in contrib/libcxx-cmake/CMakeLists.txt:
      Target "cxx" INTERFACE_INCLUDE_DIRECTORIES property contains path:

        "/src"

      which is prefixed in the source directory.

Also move "src" into PRIVATE, since it is required only for libcxx
itself.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-02 14:21:43 +02:00
Fangyuan Deng
bc7d661668
Merge branch 'master' into UniqSketch 2022-09-01 19:31:53 +08:00
Antonio Andelic
9acb253334 Update NuRaft 2022-09-01 08:44:20 +00:00
Antonio Andelic
91aff95298 Merge branch 'master' into keeper-linearizable-reads 2022-09-01 08:43:50 +00:00
Filatenkov Artur
899a2e29df
Enable UBsan 2022-08-31 16:44:52 +03:00
Antonio Andelic
97fd3d9123
Merge branch 'master' into fix-install-snapshot 2022-08-31 08:42:00 +02:00
Fangyuan Deng
5c2f35c302
Merge branch 'master' into UniqSketch 2022-08-31 10:23:46 +08:00
FArthur-cmd
941cceda7f fix build 2022-08-30 23:09:22 +00:00
FArthur-cmd
c7d31c3a90 fix indexes for ColumnArray 2022-08-30 15:32:05 +00:00
FArthur-cmd
e7abc06c89 Revert "Revert "Add Annoy index""
This reverts commit 6fdfb964d0.
2022-08-30 15:26:56 +00:00
Alexander Tokmakov
6fdfb964d0
Revert "Add Annoy index" 2022-08-30 15:10:10 +03:00
pzhdfy
92f88c1429 update datasketches-cpp 2022-08-30 20:02:47 +08:00
Alexander Tokmakov
44c6c85f75
Merge pull request #40756 from ClickHouse/libuv_update
Merging #39398
2022-08-30 14:38:50 +03:00
Alexander Tokmakov
ff2db8e2a7 update submodule 2022-08-29 16:46:21 +02:00
FArthur-cmd
c6e45fe690 remove build with UBSan 2022-08-29 09:18:15 +00:00
Antonio Andelic
b4af21b6fb Small fixes 2022-08-29 07:06:51 +00:00
FArthur-cmd
f3d0083e57 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into annoy-2 2022-08-26 13:53:53 +00:00
Antonio Andelic
dae65178b7 Improve preprocessing performance 2022-08-26 10:46:14 +00:00
Antonio Andelic
4bbcbda7cc NuRaft fix for install snapshot 2022-08-25 14:12:17 +00:00
BoloniniD
78d00c3371 Add glibc symbols to glibc_compatibility 2022-08-24 21:30:48 +03:00
Antonio Andelic
073b168b31 add msg type string for leader status 2022-08-24 07:50:08 +00:00
Antonio Andelic
99d23cb67e Merge branch 'master' into keeper-linearizable-reads 2022-08-23 07:03:20 +00:00
BoloniniD
c7a6c4d56f Test with Ubuntu 14.04 static libs 2022-08-22 20:09:37 +03:00
Antonio Andelic
af02c76a3c
Merge branch 'master' into keeper-listen-host 2022-08-21 18:43:55 +02:00
FArthur-cmd
1e8910f048 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into annoy-2 2022-08-21 08:45:03 +00:00
BoloniniD
a30d43ba19 Add RUSTFLAGS to link crates to glibc 2022-08-19 21:45:19 +03:00
Suzy Wang
c273ef125d
Merge branch 'master' into libuv_update 2022-08-18 16:30:52 -04:00
BoloniniD
256d4a5e61 Move -l rustc flag out of target part 2022-08-18 23:26:44 +03:00
Alexey Milovidov
aaf6a3c862
Merge pull request #40184 from ClickHouse/update-cctz
Update cctz
2022-08-18 10:13:04 +03:00
Antonio Andelic
26b7117b6c Merge branch 'master' into keeper-listen-host 2022-08-18 07:05:20 +00:00
BoloniniD
eba479101a Fix glibc compat 2022-08-17 21:03:35 +03:00
Suzy Wang
9d14397a2a rm duplicated declaration 2022-08-17 08:15:08 -07:00
Antonio Andelic
833c4bc5f6 Update commit for NuRaft 2022-08-17 09:28:57 +00:00
Robert Schulze
2110d4334b
Merge pull request #40272 from ClibMouse/librdkafka_update
(negligible) rdkafka library: update lz4.c from upstream, cve fixes
2022-08-17 10:32:33 +02:00
Antonio Andelic
b5358ba8de Merge branch 'master' into keeper-listen-host 2022-08-17 08:31:43 +00:00
Suzy Wang
6539273c86 update lz4.c from upstream, cve fixes 2022-08-16 06:50:37 -07:00
Suzy Wang
ec7f89f287 Update libuv commits, pull changes from upstream 2022-08-15 12:47:23 -07:00
Suzy Wang
cceab1cd3e Merge remote-tracking branch 'upstream/master' into libuv_update 2022-08-15 12:27:29 -07:00
BoloniniD
1691a8b3f5 Merge branch 'BLAKE3' of github.com:BoloniniD/ClickHouse into BLAKE3 2022-08-15 20:44:49 +03:00
BoloniniD
00b57b8af8 Fix compatibility with glibc 2022-08-15 20:44:31 +03:00
FArthur-cmd
1d048432a1 update contrib and update cmake 2022-08-15 14:35:51 +00:00
Alexey Milovidov
970d482469 Merge branch 'master' into update-cctz 2022-08-14 04:49:29 +02:00
Alexey Milovidov
055c80d80c Update cctz 2022-08-13 07:48:11 +02:00
Alexey Milovidov
a6a51f4fb8 Minor build changes 2022-08-13 06:39:20 +02:00
avogar
347ffbf178 Fix special build 2022-08-10 14:19:27 +00:00
avogar
4c102adaf3 Fix deadlock with msan 2022-08-09 11:39:40 +00:00
Kruglov Pavel
704bdd08ec
Merge branch 'master' into revert-39804-revert-39510-update-arrow 2022-08-08 15:51:29 +02:00
Antonio Andelic
3b1117dafd use correct NuRaft commit 2022-08-08 11:12:12 +00:00
Antonio Andelic
6b935a252f Support multiple listen hosts 2022-08-08 09:08:19 +00:00
BoloniniD
244c37cbbf Fix submodules 2022-08-07 16:03:44 +03:00
BoloniniD
c1f09655cf Fix include directory for BLAKE3 2022-08-07 11:38:23 +03:00
BoloniniD
24f3b00193
Merge branch 'master' into BLAKE3 2022-08-06 19:48:10 +03:00
BoloniniD
ef4ca4279a Fix build cfg for BLAKE3 2022-08-06 18:24:25 +03:00
BoloniniD
d2e554e4f6 Fix build cfg for BLAKE3 2022-08-06 11:11:45 +03:00
Alexey Milovidov
adc880f362
Merge pull request #39867 from ClickHouse/keeper-block-memory-tracker-commit
Block memory tracker in Keeper during commit
2022-08-06 02:02:29 +03:00
Kseniia Sumarokova
ba53ed274b
Merge pull request #39327 from kssenii/update-azure-lib
Update azure library (removed "harmful" function)
2022-08-05 00:20:43 +02:00