thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-21 15:12:02 +00:00
Code Issues Packages Projects Releases Wiki Activity
97,803 Commits 9,143 Branches 1,778 Tags 2.1 GiB
6a09340f11
Commit Graph

2867 Commits

Author SHA1 Message Date
Alexander Tokmakov
cfe0e434e5
Revert "Add support for io_uring read method" 2022-06-24 12:19:41 +03:00
Robert Schulze
2c828338f4
Replace hyperscan by vectorscan 
This commit migrates ClickHouse to Vectorscan. The first 10 min of
[0] explain the reasons for it.

(*) Addresses (but does not resolve) #38046

(*) Config parameter names (e.g. "max_hyperscan_regexp_length") are
    preserved for compatibility. Likewise, error codes (e.g.
    "ErrorCodes::HYPERSCAN_CANNOT_SCAN_TEXT") and function/class names (e.g.
    "HyperscanDeleter") are preserved as vectorscan aims to be a drop-in
    replacement.

[0] https://www.youtube.com/watch?v=KlZWmmflW6M
 2022-06-24 10:47:52 +02:00
Andrey Zvonov
c18d09a617
Merge branch 'master' into zvonand-base58 2022-06-24 07:05:49 +03:00
Alexey Milovidov
812ab9bd6b
Merge pull request #36103 from sauliusvl/uring 
Add support for io_uring read method
 2022-06-24 00:34:29 +03:00
Suzy Wang
45f94c3d23 Add new files to makefile for thrift 0.16.0 2022-06-23 14:01:45 -07:00
Alexey Milovidov
e7c8023ef5
Merge pull request #38201 from ClickHouse/revert-35914-FIPS_compliance 
Revert "ClickHouse's boringssl module updated to the official version of the FIPS compliant."
 2022-06-23 20:22:03 +03:00
Antonio Andelic
91637bf79a Merge branch 'master' into keeper-linearizable-reads 2022-06-23 14:07:00 +00:00
mergify[bot]
234f0c6399
Merge branch 'master' into revert-35914-FIPS_compliance 2022-06-23 12:06:17 +00:00
zvonand
946117ec89 Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-base58 2022-06-23 17:04:40 +05:00
zvonand
267025c35b update base-x cmakelists 2022-06-23 16:51:15 +05:00
Robert Schulze
42e70b7cd3
Document why the submodule check does not halt the configuration 2022-06-23 13:41:05 +02:00
Suzy Wang
4deddbf900 Update thrift to 0.16.0(latest) 2022-06-21 12:28:40 -07:00
Robert Schulze
0d80874d40
Merge pull request #38068 from ClickHouse/clang-tsa 
Support for Clang Thread Safety Analysis (TSA)
 2022-06-21 20:19:33 +02:00
Suzy Wang
1a23dfa827 Update thrift to 0.13.0 2022-06-21 06:54:54 -07:00
Saulius Valatka
a7152fe5ec bump liburing 2022-06-21 13:20:46 +03:00
Saulius Valatka
7b5e13a9eb implement pending request queue to prevent CQ overflows, more error checking, reduce size of io_uring 2022-06-21 13:17:56 +03:00
Saulius Valatka
6bbabf59d9 simplify build, add read method randomized tests, fix typos 2022-06-21 09:59:46 +03:00
Saulius Valatka
3f755a2505 add liburing to build 2022-06-21 09:59:46 +03:00
zvonand
22af00b757 rename variable + fix handling of ENABLE_LIBRARIES 2022-06-20 23:53:47 +05:00
Robert Schulze
55b39e709d
Merge remote-tracking branch 'origin/master' into clang-tsa 2022-06-20 16:39:32 +02:00
Robert Schulze
5a4f21c50f
Support for Clang Thread Safety Analysis (TSA) 
- TSA is a static analyzer build by Google which finds race conditions
  and deadlocks at compile time.

- It works by associating a shared member variable with a
  synchronization primitive that protects it. The compiler can then
  check at each access if proper locking happened before. A good
  introduction are [0] and [1].

- TSA requires some help by the programmer via annotations. Luckily,
  LLVM's libcxx already has annotations for std::mutex, std::lock_guard,
  std::shared_mutex and std::scoped_lock. This commit enables them
  (--> contrib/libcxx-cmake/CMakeLists.txt).

- Further, this commit adds convenience macros for the low-level
  annotations for use in ClickHouse (--> base/defines.h). For
  demonstration, they are leveraged in a few places.

- As we compile with "-Wall -Wextra -Weverything", the required compiler
  flag "-Wthread-safety-analysis" was already enabled. Negative checks
  are an experimental feature of TSA and disabled
  (--> cmake/warnings.cmake). Compile times did not increase noticeably.

- TSA is used in a few places with simple locking. I tried TSA also
  where locking is more complex. The problem was usually that it is
  unclear which data is protected by which lock :-(. But there was
  definitely some weird code where locking looked broken. So there is
  some potential to find bugs.

*** Limitations of TSA besides the ones listed in [1]:

- The programmer needs to know which lock protects which piece of shared
  data. This is not always easy for large classes.

- Two synchronization primitives used in ClickHouse are not annotated in
  libcxx:
  (1) std::unique_lock: A releaseable lock handle often together with
      std::condition_variable, e.g. in solve producer-consumer problems.
  (2) std::recursive_mutex: A re-entrant mutex variant. Its usage can be
      considered a design flaw + typically it is slower than a standard
      mutex. In this commit, one std::recursive_mutex was converted to
      std::mutex and annotated with TSA.

- For free-standing functions (e.g. helper functions) which are passed
  shared data members, it can be tricky to specify the associated lock.
  This is because the annotations use the normal C++ rules for symbol
  resolution.

[0] https://clang.llvm.org/docs/ThreadSafetyAnalysis.html
[1] https://static.googleusercontent.com/media/research.google.com/en//pubs/archive/42958.pdf
 2022-06-20 16:13:25 +02:00
Rafael Acevedo
51035ee300
Update librdkafka 
Update to get fixes from https://github.com/ClickHouse/librdkafka/pull/5

Refs https://github.com/ClickHouse/ClickHouse/issues/38151
 2022-06-20 07:19:58 -03:00
zvonand
832fd6e0a9 Added tests + minor updates 2022-06-19 23:10:28 +05:00
Alexey Milovidov
0cf88e0950
Revert "ClickHouse's boringssl module updated to the official version of the FIPS compliant." 2022-06-18 23:16:18 +03:00
Antonio Andelic
fdef4cc44d Update NuRaft 2022-06-18 19:25:43 +00:00
alesapin
0ae0cc54aa
Merge pull request #38106 from ClickHouse/tsan_less_flaky_tests 
Some fixes for tests with tsan
 2022-06-18 14:22:43 +02:00
Alexey Milovidov
d43492a512
Merge pull request #37795 from DevTeamBK/curl_upgrade 
Upgrade curl to 7.83.1
 2022-06-18 04:14:09 +03:00
Antonio Andelic
fa8bfced1a Update NuRaft 2022-06-17 18:19:09 +00:00
alesapin
ca33ff93cb
Merge pull request #37555 from ClickHouse/revert-37534-revert-37036-keeper-preprocess-operations 
Add support for preprocessing ZooKeeper operations and real-time digest in `clickhouse-keeper`
 2022-06-16 17:29:00 +02:00
Suzy Wang
b80b9ec8b9 Merge branch 'master' into curl_upgrade 2022-06-16 08:09:15 -07:00
jasperzhu
bca18b2caf
Merge branch 'master' into dev_intel_iaa_deflate 2022-06-16 08:56:27 +08:00
Daniel Kutenin
a769dea8ef
Merge branch 'ClickHouse:master' into master 2022-06-15 19:12:10 +01:00
Alexander Tokmakov
9cac78b498 make tests with tsan less flaky 2022-06-15 19:54:46 +02:00
Maksim Kita
5729210f22
Merge pull request #37797 from kitaisreal/libunwind-update-version 
libunwind update version
 2022-06-15 19:32:42 +02:00
Danila Kutenin
08e3f77a9c Optimize most important parts with NEON SIMD 
First part, updated most UTF8, hashing, memory and codecs. Except
utf8lower and upper, maybe a little later.

That includes huge amount of research with movemask dealing. Exact
details and blog post TBD.
 2022-06-15 13:19:29 +00:00
mergify[bot]
68d043869c
Merge branch 'master' into libunwind-update-version 2022-06-15 11:43:01 +00:00
Maksim Kita
1c841fadcd Updated libunwind 2022-06-15 10:59:23 +02:00
zvonand
c149c916ec initial setup 2022-06-15 11:49:55 +05:00
mergify[bot]
17cc36e0e2
Merge branch 'master' into grpc_update_to_PR9 2022-06-15 02:10:38 +00:00
Antonio Andelic
b7bd5a8eb1 Merge branch 'master' into revert-37534-revert-37036-keeper-preprocess-operations 2022-06-14 12:51:35 +00:00
Maksim Kita
4a37e36d78 Updated libunwind 2022-06-14 12:52:52 +02:00
Antonio Andelic
e5504f1b33 Merge branch 'master' into revert-37534-revert-37036-keeper-preprocess-operations 2022-06-13 15:43:10 +00:00
Robert Schulze
027fe1db9d
Merge pull request #37970 from ClickHouse/color_diagnostics 
Always disable --color-diagnostics for LLVM
 2022-06-13 13:32:19 +02:00
Maksim Kita
fb54a1cb6a Updated libunwind 2022-06-13 11:44:45 +02:00
Maksim Kita
8907c4b5b0 Updated libunwind 2022-06-13 11:44:45 +02:00
Maksim Kita
25a886a78c libunwind update version fix sanitizers 2022-06-13 11:44:45 +02:00
Maksim Kita
d8c4af725a libunwind update version 2022-06-13 11:44:45 +02:00
Robert Schulze
0696ee3758
Always disable --color-diagnostics for LLVM 
The flag is not only not recognized on MacOS, it is not recognized by
the gold linker in general.
 2022-06-10 10:39:38 +02:00
Antonio Andelic
2c37fe3d7b Merge branch 'master' into revert-37534-revert-37036-keeper-preprocess-operations 2022-06-06 12:39:55 +00:00
jinjunzh
c7ca746994 fixed build issues in clickhouse-keeper 2022-06-05 14:46:28 -04:00
Peng Liu
6de7590af4 compile the new libgsasl with supportting three modes(privacy/integrity/authentication) 2022-06-04 23:30:38 +08:00
Bharat Nallan Chakravarthy
5fb9336159 add ssl version to build options 2022-06-04 15:31:08 +05:30
jinjunzh
2170a99484 revise ENABLE_QPL_COMPRESSION build option 2022-06-03 21:06:55 -04:00
Alexey Milovidov
4387379090
Merge pull request #37745 from DevTeamBK/libxml2_upgrade 
Upgrade libxml2 to 2.9.14
 2022-06-02 18:39:09 +03:00
jinjunzh
041a8e42ca revise code style 2022-06-02 10:34:11 -04:00
Antonio Andelic
7ee47fc5bb Merge branch 'master' into revert-37534-revert-37036-keeper-preprocess-operations 2022-06-02 13:38:52 +00:00
Alexey Milovidov
eef6a5ec96
Revert "Remove resursive submodules" 2022-06-02 09:41:12 +03:00
Suzy Wang
17fb5d8068 upgrade curl to 7.83.1 2022-06-01 21:30:02 -07:00
jinjunzh
e1426c7e9d add build option for iaa compression 2022-06-01 11:47:43 -04:00
Robert Schulze
7813cf5a8b
Merge pull request #37719 from ClickHouse/lib-dependency-mgmt 
Fix build with -DENABLE_LIBRARIES=0
 2022-06-01 16:53:49 +02:00
Suzy Wang
9bef38effb Upgrade libxml2 to 2.9.14 2022-06-01 06:10:05 -07:00
mergify[bot]
4aefcf29e3
Merge branch 'revert-37534-revert-37036-keeper-preprocess-operations' into keeper-real-time-digest 2022-06-01 10:17:49 +00:00
Robert Schulze
393b97763a
Make SSL a mandatory dependency for now 
- SSL is a dependency of too many libs + unit tests (via poco crypto
  which requires SSL)

- optional SSL is desirable but right now, turning off SSL (via
  -DENABLE_LIBRARIES=0 or =DENABLE_SSL=0) breaks the build

- therefore make SSL mandatory for now + add a TODO comment
 2022-06-01 11:26:24 +02:00
Robert Schulze
933f98a900
Removed warning flags in contribs 
warnings are disabled for all contribs in contrib/CMakeLists.txt already
 2022-06-01 11:02:39 +02:00
Robert Schulze
a4e037c728
Remove unused M_LIBRARY link 2022-06-01 11:02:39 +02:00
Robert Schulze
12871a43e1
Cosmetics 2022-06-01 11:02:39 +02:00
Robert Schulze
249fe561f4
Fix build with -DENABLE_LIBRARIES=0 / -DENABLE_REPLXX=0 
Replxx: When disabled via -DENABLE_LIBRARIES=0 or -DENABLE_REPLXX (the
latter was undocumented) the build broke because replxx symbols were
used since [0] in header LineReader.h. This header should in theory
stay clean of replxx but doesn't for efficiency reasons.

This change makes compilation of replxx mandatory. As replxx is quite
small, I guess this is okay. (The alternative is to litter the code
with ifdefs for non-replxx and a replxx paths.)

[0] https://github.com/ClickHouse/ClickHouse/pull/33201
 2022-06-01 10:02:28 +02:00
HarryLeeIBM
93be56a151 Update grpc submodule to PR 9 2022-05-31 14:12:44 -07:00
jinjunzh
330a46c418 Remove eigen library according to master commit: 7d0ed7e51a 2022-05-31 09:55:06 -04:00
alesapin
65057bf8c4
Merge pull request #37616 from ClickHouse/remove-resursive-submodules 
Remove resursive submodules
 2022-05-31 11:58:04 +02:00
Robert Schulze
557bb2d235
Disable amqp-cpp and cassandra build if libuv is disabled 
On MacOS/GCC, the libuv build is disabled due to a compiler bug. This
is now propagated to dependent libraries amqp-cpp and cassandra.
Oddly enough, the Mac/GCC build was broken since at least Jan 2022
without someone noticing.
 2022-05-31 10:34:03 +02:00
jasperzhu
fc03af2259
Merge branch 'master' into dev_intel_iaa_deflate 2022-05-30 17:49:04 +08:00
jinjunzh
4857d6e2c3 add nasm into docker configuration 2022-05-30 17:45:26 -04:00
Alexey Milovidov
7281d51e45 Remove recursive submodules 2022-05-28 04:01:03 +02:00
tchepavel
42cd854688
Merge branch 'master' into nats-integration 2022-05-27 16:05:08 +03:00
Robert Schulze
7543841438
Merge pull request #37518 from ClickHouse/bump-cctz-to-2022-05-15 
Bump cctz to 2022-05-15
 2022-05-25 22:14:41 +02:00
Robert Schulze
90deef1c3c
Bump cctz to 2022-05-15 2022-05-25 12:21:05 +02:00
Kseniia Sumarokova
02d162c25d
Merge branch 'master' into nats-integration 2022-05-25 10:04:39 +02:00
Antonio Andelic
fe72cd7478 Merge branch 'master' into keeper-real-time-digest 2022-05-25 07:41:31 +00:00
tchepavel
43226a57fc
Merge branch 'master' into nats-integration 2022-05-24 18:15:11 +03:00
Alexander Gololobov
7d0ed7e51a Remove eigen library 2022-05-24 10:24:50 +02:00
Alexey Milovidov
dd2b2380fa Add a comment #37078 2022-05-24 04:22:51 +02:00
tchepavel
d9436ec7dd
Merge branch 'master' into nats-integration 2022-05-23 14:30:09 +03:00
Antonio Andelic
8cb6101a3c Merge branch 'master' into keeper-real-time-digest 2022-05-23 10:34:20 +00:00
mergify[bot]
cc1362511a
Merge branch 'master' into patch-2 2022-05-23 00:12:44 +00:00
Yakov Olkhovskiy
d878f193d8
Merge pull request #37013 from mnutt/hashid 
Add hashid support
 2022-05-21 17:14:54 -04:00
Michael Nutt
23dbf1b257 Merge branch 'master' into hashid 2022-05-20 08:42:01 -04:00
Antonio Andelic
e5f7f5f689 Update NuRaft commit 2022-05-20 09:59:13 +00:00
Alexander Gololobov
4350935377 Re-enable SSE2 for PowerPC 2022-05-20 08:51:48 +02:00
Alexander Gololobov
4885940378 Removed ENABLE_MKL option, because we cannot depend on non-contrib libs 2022-05-20 08:51:48 +02:00
Michael Nutt
e453132db8 remove hashid define guard 2022-05-18 15:26:54 -04:00
Vladimir Makarov
7017c3eaea update submodule 2022-05-16 15:04:23 +00:00
Antonio Andelic
4a91ab6560 Use NuRaft with PreAppendLogs 2022-05-16 13:38:49 +00:00
tchepavel
7317c76d3c
Merge branch 'master' into nats-integration 2022-05-15 14:41:22 +03:00
Vladimir Makarov
d6512d257f fixes 2022-05-15 08:57:57 +00:00
Vladimir Makarov
e502ab2f55 disable mac os and try to fix sanitizer error 2022-05-15 08:25:46 +00:00
Robert Schulze
eb9f11da3d
Replace variable ARCH_ARM by ARCH_AARCH64 
Both are equivalent and removing the duplication was a leftover of PR #36614
 2022-05-15 09:48:02 +02:00
jasperzhu
5e607e6cf5
Merge branch 'master' into dev_intel_iaa_deflate 2022-05-15 10:59:07 +08:00
VVMak
1b9834548d
Merge branch 'master' into annoy-2 2022-05-15 00:01:28 +03:00
Vladimir Makarov
a8a52c9113 fix cmakelist 2022-05-14 13:32:31 +00:00
Vladimir Makarov
d1880f3c10 fix cmake and style 2022-05-14 10:27:05 +00:00
Vladimir Makarov
8f8c622e7c fix 2022-05-14 08:24:54 +00:00
Michael Nutt
8bff9b8ce9
Merge branch 'master' into hashid 2022-05-14 09:52:05 +09:00
Yakov Olkhovskiy
f5562f354a update poco 2022-05-13 17:34:29 -04:00
Vladimir Makarov
a800e0fdf9 remove extra files 2022-05-13 20:47:06 +00:00
Alexander Gololobov
fe2aa1861f
Merge pull request #37033 from qieqieplus/array-distance-functions 
Distance/ Norm functions for array
 2022-05-13 17:28:19 +02:00
Nikolai Kochetov
b2c363a38a
Merge pull request #37157 from ClickHouse/try-enable-cache-for-https-session 
Enable DNS cache for HTTPSClientSession.
 2022-05-13 15:42:30 +02:00
Vladimir Makarov
5b69e4cc43 add cmake flags 2022-05-13 10:37:04 +00:00
Vladimir Makarov
b6fbf0da07 fix cmakelists 2022-05-13 09:20:06 +00:00
Vladimir Makarov
1997ee311a fix contribs 2022-05-12 21:17:31 +00:00
tchepavel
cc94378698 Add nats-io cmake; finally fix publishing 2022-05-12 19:11:32 +03:00
Nikolai Kochetov
77fb1b84ac Enable DNS cache for HTTPSClientSession. 2022-05-12 15:21:29 +00:00
jasperzhu
c74732ae79
Merge branch 'master' into dev_intel_iaa_deflate 2022-05-12 21:28:13 +08:00
tchepavel
d9a19910a8 Add nats-io cmake; move subscribe 2022-05-12 15:32:51 +03:00
tchepavel
f53ec6a3a5 Preparing for first draft 2022-05-12 14:08:45 +03:00
tchepavel
5f8fcb748f Select, MV, Insert working 2022-05-12 13:58:50 +03:00
tchepavel
30ff0de33e Change submodule to patched 2022-05-12 13:58:50 +03:00
tchepavel
944a729fc5 Copy Rabbit to become NATS 2022-05-12 13:58:49 +03:00
VVMak
6adbd516cc
Annoy tests (#58) 
* Added diskann to contrib

* Made cmake changes cleaner

* Implemented DiskANN aggregator

* Renamed index from Simple to DiskANN

* Implemented index aggregator

* Implemented index serialization

* Added condition to DiskANN index

* Implemented condition for diskann

* removed maybe_unused_attr

* Condition

* added some metrics and comparison operators

* Added common condition

* Added tests

* enchanced some tests

* Added inddex to tests

* Updated functional tests

* Added annoy tests

Co-authored-by: Danila Mishin <mishin.dk@phystech.edu>
Co-authored-by: Hakob Saghatelyan <sagatelyan.aa@phystech.edu>
 2022-05-12 13:49:31 +03:00
Michael Nutt
2ff13c4e5d
Merge branch 'master' into hashid 2022-05-12 03:12:10 +09:00
Alexander Gololobov
b34a55c9e9
Merge branch 'master' into array-distance-functions 2022-05-11 16:55:02 +02:00
Yakov Olkhovskiy
6d3a54a044
Merge pull request #36467 from olevino/wyhash 
Wyhash
 2022-05-11 09:57:09 -04:00
Alexander Gololobov
118dd64c93 Only enable MPL2-licensed code in eigen library 2022-05-11 14:45:10 +02:00
qieqieplus
5f9eee976f fix & format 2022-05-11 16:14:43 +08:00
Yuriy Chernyshov
6d28b22687
Fix jemalloc compatibility with LLVM libunwind 
jemalloc provides support for two different libunwind flavors: the original HP libunwind and the one coming with gcc / g++ / libstdc++.

The latter is identified by `JEMALLOC_PROF_LIBGCC` and provides `_Unwind_Backtrace` method instead of `unw_backtrace`.
At the time ClickHouse uses LLVM libunwind which follows libgcc's way of backtracing.

ClickHouse has to provide `unw_backtrace` method by the means of [commit 8e2b31e](8e2b31e766).

While this PR does not allow complete remove of the patch (as ClickHouse itself uses unw_backtrace directly), it definitely sorts the things out.
 2022-05-10 16:14:59 +03:00
Yakov Olkhovskiy
c8c6deb2ff
Update CMakeLists.txt 2022-05-09 08:48:51 -04:00
Sean Lafferty
fe5afa6b37
Support ZSTD compression for Arrow (#35486) 2022-05-09 13:41:08 +02:00
qieqieplus
b00a17ca38 Merge branch 'master' into array-distance-functions 2022-05-09 15:15:07 +08:00
Yakov Olkhovskiy
09765028ae
Update CMakeLists.txt 2022-05-09 01:15:18 -04:00
jinjunzh
05fc3914c1 add folder for contrib/nasm 2022-05-08 10:40:17 -04:00
Michael Nutt
c16ce7657e add hashid support 2022-05-08 06:42:51 +09:00
jinjunzh
fd5085c290 Merge branch 'dev_intel_iaa_deflate' of https://github.com/jinjunzh/ClickHouse into dev_intel_iaa_deflate 2022-05-05 12:00:30 -04:00
jinjunzh
c4bce5234e add nasm source into contrib for nasm compiler 2022-05-05 11:56:11 -04:00
jasperzhu
7f47e9b934
Merge branch 'master' into dev_intel_iaa_deflate 2022-05-03 15:47:57 +08:00
mergify[bot]
1b7b1e852b
Merge branch 'master' into bump-minizip 2022-05-02 12:14:04 +00:00
Alexey Milovidov
a31e425872
Merge pull request #36798 from ClickHouse/poco-update-58 
pull poco #58
 2022-05-01 13:48:29 +03:00
Alexey Milovidov
6c75b63953
Merge pull request #35914 from DevTeamBK/FIPS_compliance 
ClickHouse's boringssl module updated to the official version of the FIPS compliant.
 2022-04-29 21:08:51 +03:00
jinjunzh
4e8c6cb123 modify uuid content 2022-04-29 13:41:09 -04:00
Yakov Olkhovskiy
970191234f pull poco #58 2022-04-29 09:48:31 -04:00
Nikita Mikhaylov
0c001df252
Better error message from NuRaft in case of CRC mismatch (#36746) 2022-04-28 17:19:28 +02:00
Meena Renganathan
ccd6f5a572 Merge branch 'master' of https://github.com/DevTeamBK/ClickHouse into FIPS_compliance 2022-04-28 07:33:12 -07:00
Meena Renganathan
bdaf5391cf Merge branch 'master' of https://github.com/DevTeamBK/ClickHouse into FIPS_compliance 2022-04-28 06:15:46 -07:00
jinjunzh
a74e8dbc84 add definition for qpl version 2022-04-27 13:54:57 -04:00
jinjunzh
02fe0940d5 Merge branch 'dev_intel_iaa_deflate' of https://github.com/jinjunzh/ClickHouse into dev_intel_iaa_deflate 2022-04-26 21:39:51 -04:00
jinjunzh
484b08b815 improve qpl-cmake to build qpl independently 2022-04-26 21:37:38 -04:00
jinjunzh
53f29f837d fixed submodule:qpl build issue 2022-04-26 14:51:31 -04:00
mergify[bot]
314d553ab1
Merge branch 'master' into bump-minizip 2022-04-26 18:46:51 +00:00
jinjunzh
9f06ec1f14 prepare cmake and submodule link for new compression solution named intel IAA deflate 2022-04-26 13:52:35 -04:00
jasperzhu
05769b4a9c
Merge branch 'master' into dev_intel_iaa_deflate 2022-04-26 16:30:27 +08:00
Antonio Andelic
9646487c09 Address PR review comments 2022-04-26 07:32:02 +00:00
Antonio Andelic
cf022542bd Merge branch 'master' into keeper-recovery-mode 2022-04-26 06:50:02 +00:00
Meena Renganathan
5b19d63426 Merge branch 'FIPS_compliance' of https://github.com/DevTeamBK/ClickHouse into FIPS_compliance 2022-04-25 06:56:52 -07:00
Meena Renganathan
ab329721d7 Merge branch 'master' of https://github.com/DevTeamBK/ClickHouse into FIPS_compliance 2022-04-25 06:21:44 -07:00
Antonio Andelic
85071f8e32 update NuRaft 2022-04-21 12:37:01 +00:00
Antonio Andelic
03779fd463 Merge branch 'master' into keeper-recovery-mode 2022-04-21 12:34:18 +00:00
olevino999
59c7b6119f wyhash 2022-04-21 02:29:53 +03:00
olevino999
64989afa52 wyhash 2022-04-21 02:26:37 +03:00
mergify[bot]
0df5fda6ed
Merge branch 'master' into musl-check 2022-04-20 09:28:40 +00:00
Meena Renganathan
634838f4c2 Updated the boringssl submodule to the latest commit 2022-04-19 11:23:53 -07:00
Azat Khuzhin
f4543f4b4e
Respect library type for contrib libraries (#36399) 
The following libraries forces STATIC:
- rockdb
- libstemmer-c
- lemmagen
- mariadb-connector-c

This is a preparation for USE_STATIC_LIBRARIES=OFF

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-19 18:05:42 +02:00
alesapin
ffca5c3cdc
Merge branch 'master' into musl-check 2022-04-19 17:51:54 +02:00
Alexey Milovidov
7629016f66 Fix clang-tidy-14 (part 1) 2022-04-19 17:44:27 +02:00
Antonio Andelic
70f3d3a863 Merge branch 'master' into keeper-recovery-mode 2022-04-19 12:32:48 +00:00
Antonio Andelic
4bd24e9fd3 Update NuRaft 2022-04-19 08:08:36 +00:00
qieqieplus
2865c8141d Merge branch 'master' into array-distance-functions 2022-04-19 14:46:39 +08:00
qieqieplus
c4b5c45740 refactor & add tests 2022-04-19 14:39:40 +08:00
Azat Khuzhin
91979cdd17 jemalloc: enable logging in debug build 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-18 23:06:41 +03:00
Alexey Milovidov
294efeccfe Fix clang-tidy-14 (part 1) 2022-04-16 04:54:04 +02:00
Amos Bird
9a80f96a33
Bump minizip-ng to a sane version 2022-04-15 20:03:13 +08:00
alesapin
f011864386 Build clickhouse-keeper with musl 2022-04-12 18:48:16 +02:00
Meena Renganathan
a6ba73b6c6 Updated the contrib/boringssl, contrib/boringssl-cmake and .gitmodules 2022-04-08 12:02:35 -07:00
Alexey Milovidov
4691a428cb
Merge pull request #35130 from DevTeamBK/curl_upgrade 
curl package upgraded to 7.81.0
 2022-04-08 16:37:28 +03:00
alesapin
1be539e194
Merge pull request #36007 from amosbird/better-replxx1 
Bump replxx to fix wrong assertion
 2022-04-07 13:03:45 +02:00
taiyang-li
2ef316801c Merge branch 'master' into use_minmax_index 2022-04-07 10:53:25 +08:00
Meena Renganathan
645e156af6 Updated the boringssl-cmake to match the latest broingssl module update 2022-04-06 14:52:33 -07:00
Amos Bird
33ea119013
Bump replxx to fix wrong assertion 2022-04-07 00:56:10 +08:00
Meena Renganathan
0d0b1ef7dc Fix to restrict the curl, azure and sentry build in MacOS 2022-04-06 06:28:35 -07:00
Mikhail f. Shiryaev
74dea085a9
Merge pull request #35943 from ClickHouse/update-unixodbc 
Update unixodbc to mitigate CVE-2018-7485
 2022-04-05 09:59:44 +02:00
Kseniia Sumarokova
9e2f0d25f3
Merge pull request #35832 from tonickkozlov/patch-1 
Do not build krb5 if ENABLE_LIBRARIES is not set
 2022-04-05 00:49:10 +02:00
Mikhail f. Shiryaev
6c7b8a0fd4
Update unixodbc to mitigate CVE-2018-7485 2022-04-04 23:34:33 +02:00
Azat Khuzhin
4cd159746e Fix polling of socket with negative timeout (when poll() interrupted by EINTR) 
In case of EINTR the timeout will be adjusted, but this should not be
done in case of negative timeout since it means infinite timeout, and
in that adjustment block negative timeout will be reset to 0, which will
make poll() return (since zero timeout means return immediatelly even if
no fd is ready).

This should also fix 02127_connection_drain flap on CI [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/32928/ddd5bebe555ce8feebcdd339e47fc45184c20dd1/stateless_tests__release__wide_parts_enabled__actions_.html

Refs: https://github.com/ClickHouse/poco/pull/55
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-04 10:24:07 +03:00
Vladimir Makarov
c2d8498f1a Add first version of annoy-based skip-index 2022-04-01 18:47:48 +00:00
mergify[bot]
dc9af4701a
Merge branch 'master' into patch-1 2022-04-01 14:59:31 +00:00
Maksim Kita
dd7ae2b9aa Fix enable LLVM for JIT compilation in CMake 2022-03-30 17:43:52 +02:00
taiyang-li
fcfabf4a0c Merge remote-tracking branch 'ck/master' into use_minmax_index 2022-03-30 11:23:24 +08:00
Azat Khuzhin
d9044cc2ac Do not require writable source directory for generating krb5 error tables 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-03-29 20:09:47 +03:00
tavplubix
693b47cdc9
Revert "Fix enable LLVM for JIT compilation in CMake" 2022-03-29 17:51:56 +03:00
taiyang-li
59727a423e Merge remote-tracking branch 'ck/master' into use_minmax_index 2022-03-29 19:39:09 +08:00
Maksim Kita
c566c52c16
Merge pull request #35683 from kitaisreal/llvm-cmake-fix 
Fix enable LLVM for JIT compilation in CMake
 2022-03-29 13:10:10 +02:00
mergify[bot]
c609426d09
Merge branch 'master' into llvm-cmake-fix 2022-03-28 21:16:25 +00:00
Maksim Kita
4c336c45fb Fix enable LLVM for JIT compilation in CMake 2022-03-28 23:15:31 +02:00
Azat Khuzhin
53eb49a2e2 avro: create symlink in binary dir (over source dir) 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-03-27 14:11:11 +03:00
Azat Khuzhin
6151e9b059 Avoid using std::result_of (deprecated in c++ > 17) 
Fixes: #34906
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-03-27 11:19:56 +03:00
Alexey Milovidov
619e11bcf6
Merge pull request #34906 from Algunenano/libcxx14 
Switch to libcxx / libcxxabi from LLVM 14
 2022-03-26 19:12:30 +03:00
Raúl Marín
e4558b1568 Update submodules libc++ to LLVM 14 2022-03-26 11:12:22 +01:00
Meena Renganathan
05ffa45907 Further updates to the CMakeLists.txt to fix the build error in MacOS 2022-03-25 16:22:34 -07:00
Alexey Milovidov
e426a9a2f1
Merge pull request #35541 from amosbird/betterbracketedpaste 
Pasting improvement of clickhouse-client
 2022-03-25 22:15:40 +03:00
Vladimir Makarov
2f1213d25f Add original and new Annoy 2022-03-25 18:22:59 +00:00
taiyang-li
4aaa361f2e Merge remote-tracking branch 'ck/master' into use_minmax_index 2022-03-25 22:48:03 +08:00
Vladimir Makarov
4a9fbdf4dc try to add spotify-annoy 2022-03-25 12:48:04 +00:00
Vladimir Makarov
dd1df58559 Fix and move Annoy 2022-03-24 19:40:09 +00:00
mergify[bot]
0b95348215
Merge branch 'master' into libcxx14 2022-03-24 17:39:01 +00:00
Meena Renganathan
db58a87fcb Updated the curl-cmake/curl_config.h to resolve the build error in MacOS 2022-03-24 06:36:03 -07:00
Raúl Marín
9ad485af4c Update LLVM to llvmorg-14.0.0 / 329fda39c507 2022-03-24 11:04:26 +01:00
Raúl Marín
7fd4f06020 Temp fork of hyperscan to fix C++20 issue 2022-03-24 10:28:27 +01:00
Raúl Marín
841bf613ba Apply latest LLVM bug fixes to filesystem remove_all 2022-03-24 10:27:10 +01:00
Raúl Marín
9466e581bb Temporarily use my forks for libcxx / libcxxabi 2022-03-24 10:27:08 +01:00
Raúl Marín
f061e54acb Adapt libcxx CMakefiles to LLVM 14 changes 2022-03-24 10:25:04 +01:00
Amos Bird
e0694ea5ba
Pasting improvement of clickhouse-client 2022-03-23 23:25:58 +08:00
qieqieplus
91bc253f86 impl distance functions for array 2022-03-22 18:19:12 +08:00
Rajkumar Varada
6481d62c6e
Merge branch 'ClickHouse:master' into libxml_upgrade 2022-03-21 09:23:57 -03:00
taiyang-li
fe67d86869 update contrib/arrow 2022-03-21 20:08:56 +08:00
taiyang-li
49b6f3dfc5 merge master and fix conflict 2022-03-21 15:05:43 +08:00
Anton Kozlov
c2d1935080
Do not build krb5 if ENABLE_LIBRARIES is not set 
This module has hard dependency on SSL. If ENABLE_LIBRARIES is off then SSL is disabled. With this change, building this module will not break.
 2022-03-18 15:56:25 +00:00
Meena Renganathan
d19090fdaf Merge branch 'master' of https://github.com/DevTeamBK/ClickHouse into curl_upgrade 2022-03-15 10:33:47 -07:00
Maksim Kita
ad6b3693e1
Merge pull request #35123 from zhanghuajieHIT/fix_build_fail_with_gcc 
fix build fail with gcc
 2022-03-14 10:36:15 +01:00
zhanghuajie
53a8987b3b fix build fail with gcc --fix warnings without disabling some parameters 2022-03-11 21:59:19 +08:00
Maksim Kita
24231804ae
Merge pull request #35103 from ClickHouse/arm-build-llvm 
Try to build llvm for Aarch64
 2022-03-10 22:11:00 +01:00
Nikita Mikhaylov
af71df6054 Added comment 2022-03-09 16:51:44 +01:00
kashwy
bd7e48e87c Upgrade icu to icu-release-70-1 
upgrade due to vulnerabilities of WS-2019-0513 and CVE-2020-10531
 2022-03-08 21:37:26 -08:00
Meena Renganathan
b85ada8ff6 Upgrdaed the curl package to fix vulnerabilities reported by WhiteSource 2022-03-08 09:35:56 -08:00
Nikita Mikhaylov
3b97f5f5c3 Better 2022-03-07 23:33:48 +01:00
Nikita Mikhaylov
b2345134e3 Try 2022-03-07 19:36:33 +01:00
Rajkumar
61639bb91b libxml2 package is upgraded to 2.9.13 2022-03-03 17:54:14 -08:00
Azat Khuzhin
71c9d4f39c Fix possible "nmalloc >= ndalloc" jemalloc assertion 
Fixes: #31531
Refs: https://github.com/jemalloc/jemalloc/pull/2234
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-03-02 06:55:27 +03:00
taiyang-li
74bc819f12 fix conflict with master and update contrib/arrow version 2022-03-01 20:14:23 +08:00
Azat Khuzhin
01583ba10e jemalloc: fix includes order to avoid overlaps 
If you had jemalloc build in contrib/jemalloc, and not current version
but some outdated, then compiler will pick incorrect file and may fail.

Also SYSTEM should be removed since regular -I is in the different list,
and will be checked before -isystem.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-21 08:32:45 +03:00
alexey-milovidov
26d0e5438c
Merge pull request #33057 from azat/jemalloc-dev-branch 
[RFC] Update jemalloc to 5.3RC
 2022-02-20 14:19:41 +03:00
Maksim Kita
6f9b436e3c
Merge pull request #34698 from kitaisreal/cmake-llvm-add-status-message-if-not-used 
CMake llvm add status message if not used
 2022-02-17 22:48:41 +01:00
Maksim Kita
0cf2b6eb07 CMake llvm add status message if not used 2022-02-17 19:46:15 +00:00
Azat Khuzhin
5a8cf3ac98 jemalloc: update version (to 5.3-rc) and commit SHA1 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-17 21:30:55 +03:00
Azat Khuzhin
c045a95a37 jemalloc: update provisioned headers for freebsd aarch64 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-17 21:25:58 +03:00
Azat Khuzhin
d3b60c011c jemalloc: update provisioned headers for freebsd x86_64 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-17 21:25:58 +03:00
Azat Khuzhin
04be7a5809 jemalloc: update provisioned headers for darwin aarch64 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-17 21:25:58 +03:00
Azat Khuzhin
ac31c648ab jemalloc: update provisioned headers for darwin x86_64 
Generated on osx 10.14

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-17 21:25:58 +03:00
Azat Khuzhin
054e84c382 jemalloc: add a note about JEMALLOC_PREFIX 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-17 21:25:58 +03:00
Azat Khuzhin
4d3c4c7c8c jemalloc: update provisioned headers for linux aarch64 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-17 21:25:58 +03:00
Azat Khuzhin
ddcf0f96e8 jemalloc: update provisioned headers for linux ppc64le 
v2: define JEMALLOC_DEFINE_MADVISE_FREE
    https://s3.amazonaws.com/clickhouse-builds/33057/6482a1c48f22d80f704bf869857091045a3f6917/binary_ppc64le/build_log.log
v3: fix pthread_atfork
    https://github.com/ClickHouse/ClickHouse/runs/5128801105?check_suite_focus=true

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

f
 2022-02-17 21:25:58 +03:00
Azat Khuzhin
bd5137db15 jemalloc: update provisioned headers for linux riscv64 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-17 21:25:58 +03:00
Azat Khuzhin
bc5aeb4dcf jemalloc: add a note about musl support 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-17 21:25:58 +03:00
Azat Khuzhin
daa292cf5a jemalloc: remove README for linux x86_64 
Note, that there is no need to disable JEMALLOC_PURGE_MADVISE_FREE,
since jemalloc does check in runtime, and ClickHouse already
successfully works w/o this change.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-17 21:25:58 +03:00
Azat Khuzhin
1a98c1aace jemalloc: move JEMALLOC_HAVE_ATTR_FORMAT_GNU_PRINTF out from per-arch 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-17 21:25:58 +03:00
Azat Khuzhin
e962649899 jemalloc: correctly disable JEMALLOC_HAVE_ATTR_FORMAT_GNU_PRINTF 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-17 21:25:58 +03:00
Azat Khuzhin
560f813c46 jemalloc: cleanup README for linux x86_64 
- remove GNU_SOURCE it is done in common CMakeLists.txt
- remove JEMALLOC_OVERRIDE___POSIX_MEMALIGN (there is no need to since
  __posix_memalign() does not exists in linux)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-17 21:25:58 +03:00
Azat Khuzhin
be4d95e444 jemalloc: remove superfluous READMEs 
Those were just copied from include_linux_x86_64, and replaced x86_64
with the arch.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-17 21:25:58 +03:00
Azat Khuzhin
bc183223c5 jemalloc: update provisioned headers for linux x86_64 
v2: update jemalloc

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-17 21:25:58 +03:00
Azat Khuzhin
0c73b860e5 jemalloc: update generic headers 
v2: update jemalloc one more time
v3:
- do not include jemalloc_mangle*.h
- do not change jemalloc.h
- fix for JEMALLOC_NOTHROW/JEMALLOC_SYS_NOTHROW

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-17 21:25:58 +03:00
Azat Khuzhin
569d613326 jemalloc: update cmake rules 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-17 21:25:58 +03:00
Azat Khuzhin
14446290f7 jemalloc: update to dev/5.3RC 
And now we can use upstream jemalloc, since all required patches had
been merged into upstream (we have to use fork since there was no new
5.2.x releases).

v2: rebase to include patch for failed assert
 2022-02-17 21:25:11 +03:00
Mikhail f. Shiryaev
c3bf9eb2f9
Remove PVS test 2022-02-17 12:59:47 +01:00