Commit Graph

3014 Commits

Author SHA1 Message Date
BoloniniD
ff82784b91 Fix MSAN test 2022-09-08 23:41:18 +03:00
Robert Schulze
0df6173e4a
Merge remote-tracking branch 'origin/master' into regen-vectorscan-assets 2022-09-08 08:37:30 +00:00
BoloniniD
c08b41b611 Clean files and compatibility code 2022-09-08 09:34:59 +03:00
Robert Schulze
9b868f8b7d
doc: add note about upstream colm/ragel 2022-09-07 20:10:17 +00:00
Robert Schulze
151bf1e074
fix: suppress warnings for ARM ragel assets 2022-09-07 20:08:31 +00:00
HarryLeeIBM
af603f9ac6 Fix zlib-ng build for s390x 2022-09-07 12:20:39 -07:00
Robert Schulze
d1d6e5cb23
fix: build ragel assets for amd64 and aarch64 separately 2022-09-07 11:56:09 +00:00
Antonio Andelic
61398cee80 Merge branch 'master' into keeper-linearizable-reads 2022-09-07 10:25:35 +00:00
Robert Schulze
c4297c6c99
fix: disable narrowing warnings 2022-09-06 22:02:02 +00:00
Robert Schulze
0e363ca6e3
chore: regenerate vectorscan assets with ragel/colm head 2022-09-06 21:15:30 +00:00
BoloniniD
d635c3f9be Disable BLAKE3 for aarch64-darwin 2022-09-06 21:22:40 +03:00
Robert Schulze
cc1bd3ac36
fix: disable vectorscan when building w/o SSE >=3 2022-09-06 16:15:50 +00:00
Filatenkov Artur
7949b3fb74
Merge branch 'master' into annoy 2022-09-06 11:23:15 +03:00
FArthur-cmd
7f311ad03c add words about setting to docs 2022-09-05 13:20:49 +00:00
FArthur-cmd
9096b73084 add setting 2022-09-05 12:41:46 +00:00
Kruglov Pavel
582216a3ca
Merge pull request #39919 from pzhdfy/UniqSketch
UniqThetaSketch support set operation such as union/intersect/not
2022-09-05 13:42:14 +02:00
Antonio Andelic
110ad53300 Merge branch 'master' into keeper-linearizable-reads 2022-09-05 07:12:45 +00:00
alesapin
3da9e8646d
Merge pull request #40941 from ClickHouse/keeper-fix-shutdown-increase-request-size
Fix in Keeper shutdown during long commit and increase allowed request size
2022-09-04 13:39:33 +02:00
Antonio Andelic
396500aaa7 Update NuRaft 2022-09-02 13:14:33 +00:00
Azat Khuzhin
dd8478422a Fix usage of generator expressions for libcxx cmake
Before, if you store clickhouse sources in /src, there was a typo and it
produce the following error:

    CMake Error in contrib/libcxx-cmake/CMakeLists.txt:
      Target "cxx" INTERFACE_INCLUDE_DIRECTORIES property contains path:

        "/src"

      which is prefixed in the source directory.

Also move "src" into PRIVATE, since it is required only for libcxx
itself.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-02 14:21:43 +02:00
Fangyuan Deng
bc7d661668
Merge branch 'master' into UniqSketch 2022-09-01 19:31:53 +08:00
Antonio Andelic
9acb253334 Update NuRaft 2022-09-01 08:44:20 +00:00
Antonio Andelic
91aff95298 Merge branch 'master' into keeper-linearizable-reads 2022-09-01 08:43:50 +00:00
Filatenkov Artur
899a2e29df
Enable UBsan 2022-08-31 16:44:52 +03:00
Antonio Andelic
97fd3d9123
Merge branch 'master' into fix-install-snapshot 2022-08-31 08:42:00 +02:00
Fangyuan Deng
5c2f35c302
Merge branch 'master' into UniqSketch 2022-08-31 10:23:46 +08:00
FArthur-cmd
941cceda7f fix build 2022-08-30 23:09:22 +00:00
FArthur-cmd
c7d31c3a90 fix indexes for ColumnArray 2022-08-30 15:32:05 +00:00
FArthur-cmd
e7abc06c89 Revert "Revert "Add Annoy index""
This reverts commit 6fdfb964d0.
2022-08-30 15:26:56 +00:00
Alexander Tokmakov
6fdfb964d0
Revert "Add Annoy index" 2022-08-30 15:10:10 +03:00
pzhdfy
92f88c1429 update datasketches-cpp 2022-08-30 20:02:47 +08:00
Alexander Tokmakov
44c6c85f75
Merge pull request #40756 from ClickHouse/libuv_update
Merging #39398
2022-08-30 14:38:50 +03:00
Alexander Tokmakov
ff2db8e2a7 update submodule 2022-08-29 16:46:21 +02:00
FArthur-cmd
c6e45fe690 remove build with UBSan 2022-08-29 09:18:15 +00:00
Antonio Andelic
b4af21b6fb Small fixes 2022-08-29 07:06:51 +00:00
FArthur-cmd
f3d0083e57 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into annoy-2 2022-08-26 13:53:53 +00:00
Antonio Andelic
dae65178b7 Improve preprocessing performance 2022-08-26 10:46:14 +00:00
Antonio Andelic
4bbcbda7cc NuRaft fix for install snapshot 2022-08-25 14:12:17 +00:00
BoloniniD
78d00c3371 Add glibc symbols to glibc_compatibility 2022-08-24 21:30:48 +03:00
Antonio Andelic
073b168b31 add msg type string for leader status 2022-08-24 07:50:08 +00:00
Antonio Andelic
99d23cb67e Merge branch 'master' into keeper-linearizable-reads 2022-08-23 07:03:20 +00:00
BoloniniD
c7a6c4d56f Test with Ubuntu 14.04 static libs 2022-08-22 20:09:37 +03:00
Antonio Andelic
af02c76a3c
Merge branch 'master' into keeper-listen-host 2022-08-21 18:43:55 +02:00
FArthur-cmd
1e8910f048 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into annoy-2 2022-08-21 08:45:03 +00:00
BoloniniD
a30d43ba19 Add RUSTFLAGS to link crates to glibc 2022-08-19 21:45:19 +03:00
Suzy Wang
c273ef125d
Merge branch 'master' into libuv_update 2022-08-18 16:30:52 -04:00
BoloniniD
256d4a5e61 Move -l rustc flag out of target part 2022-08-18 23:26:44 +03:00
Alexey Milovidov
aaf6a3c862
Merge pull request #40184 from ClickHouse/update-cctz
Update cctz
2022-08-18 10:13:04 +03:00
Antonio Andelic
26b7117b6c Merge branch 'master' into keeper-listen-host 2022-08-18 07:05:20 +00:00
BoloniniD
eba479101a Fix glibc compat 2022-08-17 21:03:35 +03:00
Suzy Wang
9d14397a2a rm duplicated declaration 2022-08-17 08:15:08 -07:00
Antonio Andelic
833c4bc5f6 Update commit for NuRaft 2022-08-17 09:28:57 +00:00
Robert Schulze
2110d4334b
Merge pull request #40272 from ClibMouse/librdkafka_update
(negligible) rdkafka library: update lz4.c from upstream, cve fixes
2022-08-17 10:32:33 +02:00
Antonio Andelic
b5358ba8de Merge branch 'master' into keeper-listen-host 2022-08-17 08:31:43 +00:00
Suzy Wang
6539273c86 update lz4.c from upstream, cve fixes 2022-08-16 06:50:37 -07:00
Suzy Wang
ec7f89f287 Update libuv commits, pull changes from upstream 2022-08-15 12:47:23 -07:00
Suzy Wang
cceab1cd3e Merge remote-tracking branch 'upstream/master' into libuv_update 2022-08-15 12:27:29 -07:00
BoloniniD
1691a8b3f5 Merge branch 'BLAKE3' of github.com:BoloniniD/ClickHouse into BLAKE3 2022-08-15 20:44:49 +03:00
BoloniniD
00b57b8af8 Fix compatibility with glibc 2022-08-15 20:44:31 +03:00
FArthur-cmd
1d048432a1 update contrib and update cmake 2022-08-15 14:35:51 +00:00
Alexey Milovidov
970d482469 Merge branch 'master' into update-cctz 2022-08-14 04:49:29 +02:00
Alexey Milovidov
055c80d80c Update cctz 2022-08-13 07:48:11 +02:00
Alexey Milovidov
a6a51f4fb8 Minor build changes 2022-08-13 06:39:20 +02:00
avogar
347ffbf178 Fix special build 2022-08-10 14:19:27 +00:00
avogar
4c102adaf3 Fix deadlock with msan 2022-08-09 11:39:40 +00:00
Kruglov Pavel
704bdd08ec
Merge branch 'master' into revert-39804-revert-39510-update-arrow 2022-08-08 15:51:29 +02:00
Antonio Andelic
3b1117dafd use correct NuRaft commit 2022-08-08 11:12:12 +00:00
Antonio Andelic
6b935a252f Support multiple listen hosts 2022-08-08 09:08:19 +00:00
BoloniniD
244c37cbbf Fix submodules 2022-08-07 16:03:44 +03:00
BoloniniD
c1f09655cf Fix include directory for BLAKE3 2022-08-07 11:38:23 +03:00
BoloniniD
24f3b00193
Merge branch 'master' into BLAKE3 2022-08-06 19:48:10 +03:00
BoloniniD
ef4ca4279a Fix build cfg for BLAKE3 2022-08-06 18:24:25 +03:00
BoloniniD
d2e554e4f6 Fix build cfg for BLAKE3 2022-08-06 11:11:45 +03:00
Alexey Milovidov
adc880f362
Merge pull request #39867 from ClickHouse/keeper-block-memory-tracker-commit
Block memory tracker in Keeper during commit
2022-08-06 02:02:29 +03:00
Kseniia Sumarokova
ba53ed274b
Merge pull request #39327 from kssenii/update-azure-lib
Update azure library (removed "harmful" function)
2022-08-05 00:20:43 +02:00
BoloniniD
48c91619b0
Merge branch 'master' into BLAKE3 2022-08-04 20:30:47 +03:00
Antonio Andelic
f63e4ba261 Update NuRaft 2022-08-04 13:14:57 +00:00
Antonio Andelic
c99c5a0dd1 Merge branch 'master' into keeper-block-memory-tracker-commit 2022-08-04 13:04:11 +00:00
Kseniia Sumarokova
92882fe337
Update CMakeLists.txt 2022-08-04 11:08:59 +02:00
BoloniniD
f09c8c8a50
Enable aarch64-darwin build 2022-08-04 09:02:46 +03:00
Alexey Milovidov
f474eb957d
Merge pull request #39758 from ClickHouse/tsan_clang_15
Try clang-15 for build with tsan
2022-08-04 01:56:52 +03:00
Kseniia Sumarokova
bd5610b732
Merge branch 'master' into update-azure-lib 2022-08-03 23:00:57 +02:00
Antonio Andelic
56ca93ca3f Block memory tracker in Keeper during commit 2022-08-03 14:14:57 +00:00
kssenii
da49a0cc02 Fix build 2022-08-03 12:32:55 +02:00
BoloniniD
be8eefa3cd
Fix BLAKE3 crate name 2022-08-03 11:18:35 +03:00
BoloniniD
29084d92d8 Fix CMake for ENABLE_RUST 2022-08-02 20:44:12 +03:00
Alexander Tokmakov
82b50e79cf
Merge branch 'master' into tsan_clang_15 2022-08-02 13:00:55 +03:00
avogar
3be13e4f92 Try fix build under ppc64 2022-08-02 08:25:46 +00:00
Kruglov Pavel
6976c690bd
Revert "Revert "Update arrow to fix possible data race"" 2022-08-02 10:09:18 +02:00
Alexander Tokmakov
55af8878a5
Revert "Update arrow to fix possible data race" 2022-08-01 22:18:34 +03:00
BoloniniD
aee6a72049 Add BLAKE3 as shims only with blake3 as Rust crate 2022-08-01 21:31:38 +03:00
BoloniniD
15773e5b01 Remove BLAKE3 as submodule 2022-08-01 21:30:15 +03:00
BoloniniD
720cc6335b Merge branch 'BLAKE3' of github.com:BoloniniD/ClickHouse into BLAKE3 2022-08-01 20:44:50 +03:00
Alexander Tokmakov
0d68b1c67f fix build with clang-15 2022-08-01 18:00:54 +02:00
kssenii
96f476d078 Merge remote-tracking branch 'upstream/master' into update-azure-lib 2022-07-31 20:17:10 +03:00
Alexey Milovidov
075ff5005e
Merge branch 'master' into update-arrow 2022-07-31 03:05:53 +03:00
Alexey Milovidov
36e6500e54
Merge branch 'master' into BLAKE3 2022-07-30 23:14:05 +03:00
kssenii
f5f6c74648 One more update 2022-07-29 22:00:21 +03:00
Antonio Andelic
3b96ff0fe4 Merge branch 'master' into fix-rollback-inconsistency-keeper 2022-07-29 07:53:00 +00:00
Yakov Olkhovskiy
7c48886d23
Merge pull request #39411 from michael1589/for-update-libgsasl
compile secure rpc need the latest libgsasl
2022-07-28 16:07:53 -04:00
Antonio Andelic
c0a5d45258 Rollback on failed PreAppend 2022-07-28 14:06:45 +00:00
Antonio Andelic
1090d6bca7 Rollback request if storing log fails 2022-07-28 12:55:29 +00:00
Antonio Andelic
0ff9fc2eb9 Use commit with init 2022-07-28 07:11:03 +00:00
Yakov Olkhovskiy
c865c85b61
Merge branch 'master' into for-update-libgsasl 2022-07-27 19:01:29 -04:00
Filatenkov Artur
a218597546
Merge branch 'master' into annoy-2 2022-07-27 15:37:58 +03:00
avogar
c9ad914164 Update arrow to fix special build 2022-07-27 09:32:54 +00:00
Kruglov Pavel
79c455fadd
Merge branch 'master' into update-arrow 2022-07-27 11:25:58 +02:00
Antonio Andelic
c5bbf44492 Update NuRaft 2022-07-26 10:58:10 +00:00
avogar
9302d67fc9 Fix special build 2022-07-26 10:30:12 +00:00
Alexey Milovidov
c78fe0fc10
Merge pull request #39498 from Avogar/fix-avro
Fix data race and possible heap-buffer-overflow in Avro format
2022-07-26 03:20:01 +03:00
Alexander Tokmakov
917fbb9b07 remove c-ares from grpc 2022-07-25 15:49:03 +02:00
Kruglov Pavel
0655ff3265
Merge branch 'master' into fix-avro 2022-07-25 13:41:21 +02:00
avogar
5503d92d97 Fix submodules 2022-07-25 11:30:23 +00:00
Robert Schulze
c788e05c77
Merge pull request #39292 from zvonand/zvonand-b58-datatype
Simplify Base58 encoding/decoding
2022-07-24 18:09:40 +02:00
avogar
d41292bf42 Update arrow to fix possible data race 2022-07-22 18:51:26 +00:00
avogar
8283cc9e2c Fix possible heap-buffer-overflow in Avro 2022-07-22 17:59:43 +00:00
avogar
c6d0ca2940 Fix data race in Avro format 2022-07-22 14:23:05 +00:00
jinjunzh
8fb0d63010 Merge branch 'dev_intel_iaa_deflate' of https://github.com/jinjunzh/ClickHouse into dev_intel_iaa_deflate 2022-07-22 12:02:32 -04:00
jinjunzh
e7562f85fe Update sysroot aligned with master for missing files 2022-07-22 12:00:53 -04:00
jinjunzh
aab7ce1aa8 Revert "restore aarch64 files due to a oversight"
This reverts commit 151a98b18e.
2022-07-22 10:25:14 -04:00
jinjunzh
151a98b18e restore aarch64 files due to a oversight 2022-07-22 10:08:46 -04:00
jasperzhu
614f3b14a2
Merge branch 'master' into dev_intel_iaa_deflate 2022-07-22 11:05:44 +08:00
Andrey Zvonov
e473606cd1
Merge branch 'master' into zvonand-b58-datatype 2022-07-21 15:55:05 +02:00
Alexander Tokmakov
9e9969cea7
Merge pull request #37827 from arthurpassos/host_regexp_multiple_domains
Test host_regexp against all PTR records instead of only one
2022-07-21 16:43:05 +03:00
Azat Khuzhin
0e95dba3ef Fix make clean (due to crosscompile of llvm)
Without ADDITIONAL_CLEAN_FILES it reports an error:

    Cleaning... ninja: error: remove(contrib/llvm/llvm/NATIVE): Directory not empty
    ninja: error: remove(/bld/contrib/llvm/llvm/NATIVE): Directory not empty
    0 files.

Note, that ADDITIONAL_CLEAN_FILES had been added since cmake 3.15.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-20 17:34:10 +03:00
zvonand
562148e0e2 remove basex 2022-07-20 15:04:15 +02:00
zvonand
260d4e5455 fix remaining basex files 2022-07-20 15:02:30 +02:00
FArthur-cmd
4b71760f7d fix build 2022-07-20 15:32:41 +03:00
Peng Liu
af50b04cd0
Merge branch 'master' into for-update-libgsasl 2022-07-20 17:47:24 +08:00
FArthur-cmd
f290f7692f annoy interface 2022-07-20 12:38:56 +03:00
Peng Liu
128e3ec97f compile secure rpc need the latest libgsasl 2022-07-20 17:33:55 +08:00
Suzy Wang
0c9d7f7060 Update libuv to 1.44.1 2022-07-19 12:42:50 -07:00
jasperzhu
c044c67745
Merge branch 'master' into dev_intel_iaa_deflate 2022-07-19 15:32:57 +08:00
FArthur-cmd
25dc3e26aa change submodule path 2022-07-19 01:00:50 +03:00
FArthur-cmd
3b30cd9259 improvements 2022-07-19 00:59:07 +03:00
kssenii
8eb628f7fa Update azure 2022-07-18 17:23:50 +02:00
Azat Khuzhin
d99851bcbe Fix googletest contrib compilation (due to GTEST_HAS_POSIX_RE=0)
By some reason cmake rules for googletest sets GTEST_HAS_POSIX_RE=0
(Compatibilty? But which platform that does support ClickHouse does not
have it?)

But everything will be okay, if these macros was set PUBLIC (i.e. for
compiling googletest library itself and it's users), however it was
added as INTERFACE only (so library itself does not know about
GTEST_HAS_POSIX_RE=0), and this leads to UB, here ASan report (while I
was trying to use ASSERT_EXIT()).

<details>

<summary>ASan report</summary>

    [ RUN      ] Common.LSan
    =================================================================
    ==7566==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x6030005b2388 at pc 0x00000d00924c bp 0x7ffcd3b7cfb0 sp 0x7ffcd3b7c770
    WRITE of size 64 at 0x6030005b2388 thread T0
        0 0xd00924b in regcomp (/bld/src/unit_tests_dbms+0xd00924b) (BuildId: 40d3fa83125f9047)
        1 0x29ca243b in testing::internal::RE::Init(char const*) /bld/./contrib/googletest/googletest/src/gtest-port.cc:750:15
        2 0xd4d92b3 in testing::internal::RE::RE(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) /bld/./contrib/googletest/googletest/include/gtest/internal/gtest-port.h:896:36
        3 0xd4d92b3 in testing::PolymorphicMatcher<testing::internal::MatchesRegexMatcher> testing::ContainsRegex<char const*>(char const* const&) /bld/./contrib/googletest/googletest/include/gtest/gtest-matchers.h:868:28
        4 0xd4d813a in testing::internal::MakeDeathTestMatcher(char const*) /bld/./contrib/googletest/googletest/include/gtest/internal/gtest-death-test-internal.h:173:10
        5 0xd4d813a in Common_LSan_Test::TestBody() /bld/./src/Common/tests/gtest_lsan.cpp:11:5

    0x6030005b2388 is located 0 bytes to the right of 24-byte region [0x6030005b2370,0x6030005b2388)
    allocated by thread T0 here:
        0 0xd066fbd in operator new(unsigned long) (/bld/src/unit_tests_dbms+0xd066fbd) (BuildId: 40d3fa83125f9047)
        1 0xd4d913d in testing::PolymorphicMatcher<testing::internal::MatchesRegexMatcher> testing::ContainsRegex<char const*>(char const* const&) /bld/./contrib/googletest/googletest/include/gtest/gtest-matchers.h:868:24
        2 0xd4d813a in testing::internal::MakeDeathTestMatcher(char const*) /bld/./contrib/googletest/googletest/include/gtest/internal/gtest-death-test-internal.h:173:10
        3 0xd4d813a in Common_LSan_Test::TestBody() /bld/./src/Common/tests/gtest_lsan.cpp:11:5

</details>
2022-07-17 17:24:02 +03:00
zvonand
91be72dbb4 updated 2022-07-17 12:17:16 +02:00
zvonand
d07a652883 merge 2022-07-16 19:05:07 +02:00
zvonand
4ab52b6873 added new DataType + fixes 2022-07-16 18:58:47 +02:00
Robert Schulze
1d61ff1474
Merge pull request #38280 from ClibMouse/thrift_update
Update thrift to 0.16.0
2022-07-15 09:19:22 +02:00
Suzy Wang
f3650d8769 Add back accidentally removed line 2022-07-14 18:42:41 -07:00
Suzy Wang
0804ff9284 Update as suggested 2022-07-14 07:12:59 -07:00
FArthur-cmd
ad459bc6e4 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into annoy-2 2022-07-14 14:10:44 +03:00
Arthur Passos
a0055fc47a Add force cache to gRPC_CARES_PROVIDER set 2022-07-13 15:49:22 -03:00
Arthur Passos
7f4043a3ed Force use of c-ares inet_net_pton and style adjustments 2022-07-13 11:51:43 -03:00
Antonio Andelic
b49ac48bfd Merge branch 'master' into keeper-linearizable-reads 2022-07-13 09:30:21 +00:00
Suzy Wang
0dde11d5dd Merge remote-tracking branch 'upstream/master' into thrift_update 2022-07-12 08:02:59 -07:00
Antonio Andelic
5f661e3e2b Merge branch 'master' into keeper-linearizable-reads 2022-07-12 07:33:34 +00:00
Azat Khuzhin
1f049e8bac Bump jemalloc to fix possible assertion
This patch also updates the jemalloc version.

Note, that I've enabled page_id for jemalloc
PR_SET_VMA/PR_SET_VMA_ANON_NAME, that requires linux 5.17+ (but ignores
EINVAL anyway).

v2: add -isystem to fix reserved name for JEMALLOC_OVERRIDE___LIBC_PVALLOC
Refs: https://github.com/jemalloc/jemalloc/pull/2304
Refs: https://github.com/ClickHouse/ClickHouse/issues/31531
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-12 07:57:27 +03:00