Commit Graph

1991 Commits

Author SHA1 Message Date
alesapin
6d8efe5d5b
Merge pull request #22992 from ClickHouse/ssl_keeper
Add SSL to keeper (both client and internal)
2021-04-13 19:15:07 +03:00
Nikolai Kochetov
8a41e63e2a Add JSON for Modern C++ 2021-04-13 18:12:12 +03:00
alesapin
ef34c95c7e Add SSL to keeper (both client and internal) 2021-04-12 15:25:52 +03:00
kssenii
7a287e6fe9 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc 2021-04-11 21:36:08 +00:00
changvvb
03a2ba315b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into support-apple-m1 2021-04-10 21:31:38 +08:00
changvvb
06e23ab981
Apply suggestions from code review
Co-authored-by: Denis Glazachev <traceon@users.noreply.github.com>
2021-04-10 20:08:49 +08:00
alexey-milovidov
2d4a8c4787
Merge pull request #22885 from traceon/gcc-macos-compilation-fixes
Fix vanilla GCC compilation in macOS
2021-04-10 14:17:11 +03:00
changvvb
facbb0368b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into support-apple-m1 2021-04-09 23:19:19 +08:00
Denis Glazachev
55e6b65825 Bump submodules to versions with fixes
Change flatbuffers submodule to internal fork
2021-04-09 18:07:11 +04:00
Alexander Kuzmenkov
db78cc7b86
Merge pull request #22834 from nvartolomei/nv/exp-jemalloc-prof-disabled-overhead
Experiment building jemalloc with profiling support for all builds to see how it impacts performance tests
2021-04-09 15:51:28 +03:00
Nikolai Kochetov
e279040813 Update boost. 2021-04-09 14:38:19 +03:00
kssenii
72d89bc933 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc 2021-04-09 11:13:01 +00:00
Denis Glazachev
e8464d61f1 Fix vanilla GCC compilation in macOS 2021-04-09 04:28:24 +04:00
Maksim Kita
a7e761d04f Updated MariaDB connector fix cmake 2021-04-08 21:47:12 +03:00
Denis Glazachev
392000891d Bump zlib-ng with a fix for arm64 AppleClang linker 2021-04-08 19:08:13 +04:00
Denis Glazachev
4e58b6fe11 Syntax fix 2021-04-08 19:07:34 +04:00
Denis Glazachev
4b116c214c Disable jemalloc for ALL macOS non-RelWithDebInfo builds
Revisit default ENABLE_* flag setting
2021-04-08 19:05:04 +04:00
changvvb
cf8abfd9b7 Revert "Update openldap header files"
This reverts commit 21a2eb32f2.
2021-04-08 22:45:17 +08:00
changvvb
b070090ca7 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into support-apple-m1 2021-04-08 18:11:16 +08:00
Nicolae Vartolomei
dd75447514 Experiment building jemalloc with profiling support for all builds to see how it impacts performance tests 2021-04-08 09:52:28 +01:00
changvvb
21a2eb32f2 Update openldap header files 2021-04-08 10:28:51 +08:00
alesapin
c85a60d795
Merge pull request #22743 from ClickHouse/fix_potential_segfault_on_startup
Fix potential segfault on Keeper startup
2021-04-07 23:10:29 +03:00
alexey-milovidov
a5179cf444
Merge pull request #22744 from amosbird/librdkafkaharmful
Avoid using harmful function rand()
2021-04-07 20:05:13 +03:00
alesapin
36c0e601a9 Better non-dirty fix 2021-04-07 13:18:07 +03:00
Amos Bird
1364d939a1
Avoid using harmful function rand() 2021-04-07 17:04:35 +08:00
kssenii
5a143a4d12 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc 2021-04-06 16:50:13 +00:00
changvvb
46c52b4f83 revert rocksdb submodule 2021-04-06 21:48:33 +08:00
alexey-milovidov
bee6cddb95
Merge pull request #22656 from mastertheknife/allow_unbundled_xz_lzma
Skip compiling xz if we're using system xz (unbundled)
2021-04-06 14:41:18 +03:00
changvvb
fdcf077cf5 Disabled rocksdb jemalloc 2021-04-06 17:06:18 +08:00
changvvb
1f8bd034a3 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into support-apple-m1 2021-04-06 15:55:03 +08:00
kssenii
38f135ab39 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc 2021-04-05 15:37:53 +00:00
pingyu
e05ee09621 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into datasketches-uniq 2021-04-05 16:47:53 +08:00
mastertheknife
3c3da1f120 Skip compiling xz if we're using system xz (unbundled) 2021-04-05 09:16:08 +03:00
alesapin
76d0e60e26 Merge branch 'master' into jepsen_for_ci 2021-04-04 16:07:53 +03:00
alesapin
925f2103f0 Update NuRaft submodules (merge with master + better autoforwarding 2021-04-03 15:37:24 +03:00
kssenii
90db0be8e9 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc 2021-04-03 08:01:13 +00:00
alexey-milovidov
18cb1bad25
Merge pull request #22475 from mastertheknife/ppc64le_disable_incompatible_libraries
ppc64le: Disable incompatible libraries (platform specific typically)
2021-04-02 21:29:11 +03:00
mastertheknife
2952cb296d Disable base64, fastops and libcpuid on unsupported platforms better 2021-04-02 13:57:46 +03:00
alexey-milovidov
e1d334b8e2
Merge pull request #22487 from mastertheknife/ppc64le_enable_bundled_openldap
ppc64le: Enable the bundled openldap
2021-04-02 10:07:14 +03:00
alexey-milovidov
172835eff0
Merge pull request #22474 from mastertheknife/ppc64le_fix_compile_boost
ppc64le: Fix compiling boost
2021-04-02 10:02:18 +03:00
alexey-milovidov
eec4ac75b0
Merge pull request #22445 from mastertheknife/ppc64le_fix_embedding
ppc64le: Fix config and timezone embedding.
2021-04-02 09:59:36 +03:00
mastertheknife
b4003a07d2 ppc64le: Enable the bundled openldap 2021-04-02 06:32:09 +03:00
mastertheknife
0692459f9f ppc64le: Disable incompatible libraries (platform specific typically) 2021-04-02 00:06:21 +03:00
mastertheknife
deb10ab122 ppc64le: Fix compiling boost 2021-04-01 23:38:57 +03:00
mastertheknife
2d83cb38a3 ppc64le: Enable building with jemalloc 2021-04-01 18:25:42 +03:00
mastertheknife
eb127ded95 ppc64le: Fix config and timezone embedding. 2021-04-01 18:12:51 +03:00
Kseniia Sumarokova
e3fac9ef32
Merge branch 'master' into nanodbc 2021-04-01 16:38:00 +03:00
pingyu
86d8bc1c54 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into datasketches-uniq 2021-04-01 12:35:24 +08:00
Alexey Milovidov
88d84f1934 Update submodule 2021-04-01 03:18:24 +03:00
Alexey Milovidov
12ff56673b Merge branch 'master' into datasketches-cmake 2021-04-01 03:17:05 +03:00
Alexey Milovidov
2f7ac2424d Merge branch 'master' into datasketches-cmake 2021-03-31 08:47:27 +03:00
Alexey Milovidov
1b218465c5 Remove recursive submodules 2021-03-31 04:41:25 +03:00
alexey-milovidov
d7c15c6b9a
Merge pull request #22289 from traceon/fix-apple-clang-build
Fix native macOS build for ALL_BUILD (Xcode/AppleClang)
2021-03-30 23:55:13 +03:00
kssenii
9b565b37b5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc 2021-03-30 10:35:24 +00:00
alexey-milovidov
4e4d33e93b
Merge branch 'master' into fix-apple-clang-build 2021-03-30 13:15:07 +03:00
Alexey Milovidov
e9e4e0e490 Maybe fix false MSan report in GRPC 2021-03-30 04:08:52 +03:00
Alexey Milovidov
b005081103 Update libdivide to the latest master (2) 2021-03-30 00:37:27 +03:00
kssenii
4cb50a2995 Update nanodbc 2021-03-29 17:36:17 +00:00
changvvb
c1c5db1944 Update jemalloc_internal_defs & fix unit test 2021-03-30 00:07:34 +08:00
Denis Glazachev
9ab41fe4c4 Fix C++ standard version for LLVM subproject 2021-03-29 17:09:50 +04:00
Denis Glazachev
b84c55794d Set C++20 standard version consistently (based on CMake version, etc.)
Use C++17 when building the bundled cassandra subproject, since it (and rapidjson) is failing to compile with C++20
2021-03-29 14:52:09 +04:00
pingyu
69ac23e870 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into datasketches-uniq 2021-03-29 14:48:14 +08:00
kssenii
364a6a5e7a Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc 2021-03-28 21:19:49 +00:00
pingyu
48b745206c wip #14893 2021-03-28 11:49:49 +08:00
alesapin
ced6d8e6bd
Merge pull request #21677 from ClickHouse/jepsen_for_nukeeper
Jepsen for nukeeper
2021-03-27 10:18:42 +03:00
pingyu
8337792722 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into datasketches-cmake 2021-03-27 11:31:26 +08:00
kssenii
5f5be3c0de Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc 2021-03-26 20:14:09 +00:00
changvvb
5e07551d17 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into support-apple-m1 2021-03-26 16:57:26 +08:00
alexey-milovidov
e5b96bd93b
Merge pull request #22105 from amosbird/rp
Bump replxx
2021-03-25 16:04:13 +03:00
alesapin
4c28c25a75 Merge branch 'master' into jepsen_for_nukeeper 2021-03-25 14:34:00 +03:00
Vitaly Baranov
86a293d6c8
Merge pull request #22057 from vitlibar/update-simdjson
Update simdjson
2021-03-25 13:27:05 +03:00
alesapin
d36d3f036d Fix several races in NuRaft 2021-03-25 13:04:16 +03:00
Amos Bird
1bdf12b3f1
bump replxx 2021-03-25 10:44:10 +08:00
Vitaly Baranov
1f4df07e08 Update used version of simdjson to 0.9.1 2021-03-23 20:58:30 +03:00
kssenii
167c9d3aeb Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc 2021-03-23 05:52:21 +00:00
kssenii
c81ab04e8f Switch to nanodbc 2021-03-22 12:37:05 +00:00
pingyu
83b7ab1fb5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into datasketches-cmake 2021-03-20 21:15:07 +08:00
changvvb
a8a38ae9e9 Update 2021-03-19 14:41:05 +08:00
changvvb
d6de2005c8 Update 2021-03-19 14:34:52 +08:00
changvvb
8efd6c5e20 Update 2021-03-19 14:34:30 +08:00
changvvb
7d716fe56c Update 2021-03-19 14:04:57 +08:00
kssenii
f1ef87d966 Fix 2021-03-18 20:04:54 +00:00
changvvb
bba600d558 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into support-apple-m1 2021-03-16 13:26:00 +08:00
Maksim Kita
1b2ed51ff5
Merge pull request #21695 from azat/O_CLOEXEC-for-listen-sockets
Set SOCK_CLOEXEC for sockets (hardcoded via poco update)
2021-03-15 23:43:32 +03:00
changvvb
abe71ebbaa try to fix rocksdb but not success 2021-03-15 19:03:24 +08:00
Azat Khuzhin
092b0b49f0 Set SOCK_CLOEXEC for sockets (hardcoded via poco update)
Found this in [1]:

    [Detaching after fork from child process 184152]
    ...
    Cannot get server pid with {}, got {}: {} lsof -i tcp:9000 -s tcp:LISTEN -Fp | awk '/^p[0-9]+$/{print substr($0, 2)}' b'301\n184152\n' invalid literal for int() with base 10: b'301\n184152\n'

But the major idea is that parent process should not export any file
descriptors to childrens, otherwise this may create security and other
breaches (like extra pipe endpoints, ...)

  [1]: https://clickhouse-test-reports.s3.yandex.net/21511/d7d9638ceb6bd702f34a88ee54f8f83197e90af5/stress_test_(address).html#fail1

Refs: https://github.com/ClickHouse-Extras/poco/pull/35
2021-03-13 13:00:16 +03:00
Alexey Milovidov
e8919c49fb Merge branch 'master' into replace-memcpy 2021-03-13 09:39:58 +03:00
changvvb
1c973c164b Update submodule url 2021-03-12 13:54:00 +08:00
changvvb
1819137756 revert submodule commit 2021-03-12 13:35:39 +08:00
changvvb
99ce2de107 Update 2021-03-12 13:24:29 +08:00
alexey-milovidov
494c6294b3
Merge pull request #21597 from qoega/fixes-clang-12-cmake-3.19
Prepare to use clang 12 and cmake 3.19
2021-03-11 23:45:53 +03:00
Denis Glazachev
290a6d273e
Add Kerberos support for authenticating existing users when accessing over HTTP 2021-03-11 23:41:10 +03:00
changvvb
ce4c81c5ff Update 2021-03-12 01:40:08 +08:00
changvvb
fcb238715b Support apple m1 2021-03-12 01:12:52 +08:00
alesapin
b30a0c68da
Merge pull request #21593 from ClickHouse/enable_ipv6_in_nuraft
Enable ipv6 in NuRaft
2021-03-11 12:13:19 +03:00
Yatsishin Ilya
abbf4b01c2 Merge remote-tracking branch 'origin/master' into fixes-clang-12-cmake-3.19 2021-03-11 09:44:30 +03:00
Nikita Mikhaylov
39b59e86b0
Merge pull request #21456 from nikitamikhaylov/zookeeper-secure-race
Fix race in SecureSocket
2021-03-10 20:49:56 +03:00
alesapin
a9032215a6 Enable ipv6 in NuRaft 2021-03-10 16:38:15 +03:00
Yatsishin Ilya
f5758b8fbf updated submodules to build with CMake 3.19 2021-03-10 11:36:07 +03:00
Maksim Kita
43ba554191
Merge pull request #20595 from kitaisreal/cache-dictionaries-lru-cache
Cache dictionaries lru cache
2021-03-09 19:14:30 +03:00
Nikita Mikhaylov
dfad6dca64 bump poco to merged PR 2021-03-09 16:24:53 +03:00
Nikita Mikhaylov
0a44cdc50c bump poco 2021-03-09 16:24:53 +03:00
Nikita Mikhaylov
3acc4795ea bump poco 2021-03-09 16:24:53 +03:00
Nikita Mikhaylov
2c6fe0ea69 add poco 2021-03-09 16:24:53 +03:00
Alexey Milovidov
e02de2355e Remove useless files 2021-03-08 13:22:17 +03:00
Alexey Milovidov
da32a617b2 Merge branch 'jart-memcpy' into replace-memcpy 2021-03-08 12:15:49 +03:00
Alexey Milovidov
2c86bc4ea3 Addition to prev. revision 2021-03-08 10:00:54 +03:00
Alexey Milovidov
cc2837485f Remove prefetch 2021-03-08 09:25:02 +03:00
Maksim Kita
ae88bbda5a Updated CacheDictionary 2021-03-06 14:36:37 +03:00
Alexey Milovidov
680b0d1531 Merge branch 'master' into jart-memcpy 2021-03-03 20:11:38 +03:00
alesapin
eb5e416fd5 Merge branch 'master' into persistent_nukeeper_snapshot_storage 2021-03-03 19:19:02 +03:00
alesapin
e6f4ce1741 Better initial batch callback 2021-03-03 19:16:55 +03:00
alesapin
e77f7e57e2 Better initial batch callback 2021-03-03 19:13:29 +03:00
Alexey Milovidov
50c62c3b4c Add memcpy implementation from @jart 2021-03-02 22:12:30 +03:00
Pavel Kruglov
153bfbfc28 Merge branch 'master' of github.com:ClickHouse/ClickHouse into hedged-requests 2021-03-02 11:59:32 +03:00
Pavel Kruglov
197058dc12 Merge branch 'master' of github.com:ClickHouse/ClickHouse into hedged-requests 2021-02-27 00:36:33 +03:00
kssenii
991718d459 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into brotli 2021-02-26 14:31:24 +00:00
kssenii
2b401cfa7c Update brotli to a version with a recent origin fix: "encoder: fix rare access to uninitialized data in ring-buffer" 2021-02-26 11:50:01 +00:00
pingyu
08126030d6 wip #14893 2021-02-26 00:44:01 +08:00
alesapin
cdaad3ad94 Fix server stop 2021-02-24 16:51:56 +03:00
alesapin
a1901383ae Improve performance and fix condition variable wait 2021-02-24 14:54:14 +03:00
Pavel Kruglov
e08be0a9a1 Commit contrib change 2021-02-21 20:38:54 +03:00
alesapin
12d05c2792 Better startup 2021-02-19 17:47:53 +03:00
alesapin
786e687b2f Trying to avoid unlimited wait 2021-02-08 14:01:50 +03:00
alesapin
d5ee7d33e9 Merge branch 'master' into in_memory_raft 2021-02-08 10:30:31 +03:00
Alexey Milovidov
375a9b4407 Fix build 2021-02-07 16:20:00 +03:00
alesapin
7b96ef61e8 Add logging if Poco cannot allocate thread in tcp server 2021-02-05 14:48:09 +03:00
alesapin
0aca40d8cb Merge branch 'master' into in_memory_raft 2021-02-01 14:30:11 +03:00
alesapin
eb5c77f558 Fix some races and better reaction to leader change 2021-02-01 14:27:26 +03:00
alesapin
67412bd529 Don't accept connections if we don't see leader + race fix from upstream 2021-02-01 10:51:10 +03:00
alexey-milovidov
7567bb2e31
Merge pull request #19860 from ClickHouse/hyperscan-assert
Fix debug assertion in Hyperscan
2021-02-01 03:45:08 +03:00
Alexey Milovidov
e5736c4c8d Fix debug assertion in Hyperscan 2021-01-31 07:23:07 +03:00
alesapin
6781c9f61d One more fix 2021-01-29 15:34:53 +03:00
alesapin
b602f259f5 Fix race in NuRaft 2021-01-29 15:24:52 +03:00
alesapin
c3db529543 Merge branch 'master' into in_memory_raft 2021-01-28 12:01:54 +03:00
Alexey Milovidov
d42afe703c Merge branch 'master' into unicode-asan 2021-01-28 10:45:46 +03:00
alexey-milovidov
7c240d0ca7
Merge pull request #17870 from excitoon-favorites/s3testiostream
Update of AWS C++ SDK
2021-01-28 07:12:52 +03:00
Alexey Milovidov
71d3482cea Fix potentially unsafe code in Poco 2021-01-28 03:43:42 +03:00
alesapin
dd54e5afe8 Merge branch 'master' into in_memory_raft 2021-01-27 15:32:16 +03:00
Vladimir Chebotarev
3322cc812d Updated AWS C++ SDK. 2021-01-26 20:58:02 +03:00
alesapin
45192a2ef2 Fix epoll events in boost asio for msan 2021-01-26 11:46:05 +03:00
alesapin
a65430fcee Trying to fix fast test 2021-01-26 11:33:16 +03:00
Alexey Milovidov
b2607a358d Applied a patch from Alexei Fedotov @leshikus 2021-01-26 00:28:43 +03:00
alexey-milovidov
303db08231
Merge pull request #19369 from filimonov/kafka_for_arm64
Kafka for arm64
2021-01-23 01:52:07 +03:00
alexey-milovidov
7b62871765
Merge pull request #19383 from ClickHouse/h3-fix-buffer-overflow
Fix buffer overflow in Uber H3
2021-01-22 17:14:29 +03:00
Ilya Yatsishin
8f280aa1c6
Merge pull request #19337 from filimonov/kafka_wo_ssl
Allow building librdkafka without ssl
2021-01-22 15:22:30 +03:00
filimonov
2adcde89f8
use __ARM_FEATURE_CRC32 2021-01-22 09:52:59 +01:00
Maksim Kita
e06383e0ae Darwin fixed build issues 2021-01-21 22:32:17 +03:00
Alexey Milovidov
bb56daf026 Fix build 2021-01-21 21:42:26 +03:00
Alexey Milovidov
3d931df276 Fix buffer overflow in Uber H3 library 2021-01-21 21:40:14 +03:00
Mikhail Filimonov
066fbfff0e
librdkafka support for arm64 2021-01-21 16:04:55 +01:00
Mikhail Filimonov
58c57bbb9d
Allow building librdkafka without ssl 2021-01-21 08:43:35 +01:00
Alexander Tokmakov
e2467427d1 Merge branch 'master' into update_cassandra 2021-01-19 14:10:15 +03:00
alexey-milovidov
8a88e213b1
Merge pull request #18671 from filimonov/librdkafka-v1.5.3
Update librdkafka to v1.6.0-RC2
2021-01-19 13:28:53 +03:00
alesapin
33d4154146
Merge pull request #19244 from ClickHouse/disable_msan_for_libuv
Disable msan for epoll array in libuv
2021-01-19 12:45:35 +03:00
Alexander Tokmakov
39cb72d1d4 fix 2021-01-19 01:02:48 +03:00
Mikhail Filimonov
9a4f34959c
Try clickhouse/v1.6.0-RC2 2021-01-18 19:15:57 +01:00
alesapin
c3d7a0cbc4
Merge pull request #19215 from ClickHouse/kerberos-fix-msan
Fix MSan report in Kerberos library
2021-01-18 17:17:51 +03:00
alesapin
f6630ddc4c Disable msan for epoll array in libuv 2021-01-18 16:15:00 +03:00
alexey-milovidov
b282df488f
Merge pull request #19218 from ClickHouse/update-dragonbox
Update Dragonbox
2021-01-18 14:23:33 +03:00
Alexey Milovidov
c02f2d45ad Update Dragonbox 2021-01-17 23:38:59 +03:00
Alexey Milovidov
ce6dc40888 Fix MSan report in Kerberos library 2021-01-17 21:35:53 +03:00
Azat Khuzhin
d61a6379fc Update comment for curl dependency for aws
It is not true since #13628
2021-01-17 18:38:29 +03:00
Azat Khuzhin
32ffa99461 Disable curl for mariadb-connector-c (it is not required) 2021-01-17 18:38:11 +03:00
Alexander Tokmakov
e57e242482 fix 2021-01-16 22:56:07 +03:00
Alexey Milovidov
a19e7edd14 Merge branch 'master' into kssenii-pg2ch 2021-01-15 17:33:19 +03:00
Mikhail Filimonov
83cfc08837
Try fix cmake scripts for librdkafka 1.6.0 2021-01-15 15:11:56 +01:00
Mikhail Filimonov
4361a5e0d6
Give a try for 1.6.0-RC1 2021-01-15 11:07:35 +01:00
Alexander Tokmakov
588d9f0a56 fix 2021-01-15 01:51:55 +03:00
Mikhail Filimonov
04da361f64
Update librdkafka to v1.5.3 2021-01-14 21:53:58 +01:00
Alexander Tokmakov
f2184eea5e try update cassandra driver library 2021-01-14 21:05:08 +03:00
Ilya Yatsishin
8004b0446f
Merge pull request #18924 from snar/enable-kafka-on-freebsd
Restore kafka on freebsd
2021-01-12 19:16:35 +03:00
Alexandre Snarskii
af2fa52436 fix freebsd build 2021-01-11 13:25:09 +03:00
Danila Kutenin
0832da77eb Update libcxx to head 2021-01-11 02:59:49 +00:00
Danila Kutenin
797a4052d8 Update libcxx and use unstable ABI to provide better performance 2021-01-11 02:08:33 +00:00
alexey-milovidov
7d25c1f7f7
Merge pull request #18862 from sundy-li/update-rocksdb
Update contrib from ClickHouse-Extras/rocksdb
2021-01-08 22:54:52 +03:00
sundy-li
0506d4bf47 Update contrib from ClickHouse-Extras/rocksdb 2021-01-08 15:41:15 +08:00
myrrc
0fc2020f2a fix gcc build 2021-01-07 19:38:58 +03:00
alexey-milovidov
72b142a00a
Merge branch 'master' into pg2ch 2021-01-06 23:18:59 +03:00
alexey-milovidov
6430fd3b2a
Merge pull request #18700 from azat/history-load-fix-multiline-entries
Bump replxx to fix loading of multi-line entries from the history
2021-01-06 05:33:51 +03:00
Azat Khuzhin
66ffb2c07a Bump replxx to fix loading of multi-line entries from the history 2021-01-03 22:12:35 +03:00
Alexey Milovidov
7e2a14fd2c Proper submodule update 2021-01-03 21:19:44 +03:00
Alexey Milovidov
21f8ba08fb Update submodule 2021-01-02 00:23:56 +03:00
Alexey Milovidov
886d61c2e0 Fix build 2021-01-02 00:12:43 +03:00
Alexey Milovidov
4c466c2fb5 Remove "harmful" function from mariadbclient 2021-01-01 21:32:22 +03:00
Alexey Milovidov
aa2e89611d Remove sumburConsistentHash function 2020-12-31 02:22:04 +03:00
kssenii
62b06de97e Try fix build 2020-12-30 16:00:05 +00:00
kssenii
d146974058 Update libpq 2020-12-29 20:05:42 +00:00
kssenii
8efd85bef2 Fix build 2020-12-29 16:56:50 +00:00
kssenii
ff6f76e2d1 Fix build, update libpq 2020-12-29 06:41:55 +00:00
kssenii
fa3297bf72 Fix build, update libpq 2020-12-28 19:16:10 +00:00
kssenii
82074bfa65 Update libpq 2020-12-27 14:18:36 +00:00
kssenii
2ab07fbd71 Update libraries 2020-12-27 12:24:14 +00:00
kssenii
2d8e35b4bd Add libpq and libpqxx 2020-12-27 12:02:41 +00:00
alesapin
e81485653b
Merge pull request #18491 from ClickHouse/add_nuraft
Add NuRaft to contrib
2020-12-26 16:19:05 +03:00
alexey-milovidov
00bc167872
Merge pull request #18531 from ClickHouse/update_cctz
Update timezones to 2020e
2020-12-26 09:58:12 +03:00
Nikita Mikhaylov
7b23b866a2
Merge pull request #18475 from nikitamikhaylov/andyyzh-bitmap64A
Merging #17858
2020-12-26 04:31:49 +03:00
alesapin
4b51a401ec Update cctz to 2020e 2020-12-25 23:36:44 +03:00
alesapin
34e298006d Update to master boost 2020-12-25 22:24:26 +03:00
alesapin
8ef23dde57 Better asio 2020-12-25 16:06:54 +03:00
alesapin
b4cac6a8a4 Fix unbundled, splitted and disable freebsd build 2020-12-25 15:36:49 +03:00
alesapin
dc77b06d30 Fix build 2020-12-25 14:04:39 +03:00
alesapin
8d1b6f67b6 Trying asio standalone 2020-12-25 12:28:08 +03:00
alesapin
236d8185e9 Update boost 2020-12-25 11:18:26 +03:00
alesapin
266d388139 Better formatting 2020-12-25 11:06:10 +03:00
alesapin
3c104035b1 Add NuRaft library 2020-12-24 23:10:47 +03:00
alesapin
cf4337ca41 Some intermediate stage 2020-12-24 18:47:38 +03:00
Amos Bird
ccc426cd10 update croaring 2020-12-24 17:43:20 +03:00
Andy Yang
ccb2fcc161 Support bitmap64 feature 2020-12-24 17:43:20 +03:00
alesapin
3e9d177813 Slightly simplier cmake 2020-12-24 16:06:32 +03:00
alesapin
e68bafd508 Merge branch 'master' into simplier_coverage 2020-12-24 12:39:33 +03:00
Azat Khuzhin
763844beac Make poco library path variable scope less global 2020-12-23 23:55:39 +03:00
Azat Khuzhin
92bc52d765 Fix Poco::Crypto library (missing linking with crypto) 2020-12-23 23:13:21 +03:00
Nikita Mikhaylov
c005dcdd26
Merge pull request #17641 from nikitamikhaylov/parallel_row_numbers
Added an offset to exception message for parallel parsing
2020-12-23 17:24:35 +03:00
alexey-milovidov
568119535a
Merge pull request #18378 from azat/ccache-fix
Do not override RULE_LAUNCH_COMPILE/RULE_LAUNCH_LINK in rocksdb
2020-12-23 15:35:25 +03:00
alesapin
b6ff4713ee Build contrib in release 2020-12-23 15:31:18 +03:00
Nikolai Kochetov
af7f5c9518
Merge pull request #17868 from ClickHouse/async-read-from-socket
Async read from socket
2020-12-23 12:20:42 +03:00
nikitamikhaylov
0dafcc38a5 better 2020-12-23 01:02:45 +03:00
Azat Khuzhin
e49021630e Do not override RULE_LAUNCH_COMPILE/RULE_LAUNCH_LINK in rocksdb
- it is already done in in find/ccache.cmake
- it does not respect disabling ccache
- it does not allow to override ccache using custom location (not in
  PATH)
2020-12-22 22:22:33 +03:00
Azat Khuzhin
5fc2c2169a Drop libnsl dependency (because of gRPC -> c-ares)
c-ares searching for gethostbyname in the libnsl library, however in the
version that shipped with gRPC it doing it wrong [1], since it uses
CHECK_LIBRARY_EXISTS(), which will return TRUE even if the function exists in
another dependent library. The upstream already contains correct macro [2],
but it is not included in gRPC (even upstream gRPC, not the one that is
shipped with clickhousee).

  [1]: e982924ace/CMakeLists.txt (L125)
  [2]: 44fbc81368/CMakeLists.txt (L146)

And because if you by some reason have libnsl [3] installed, clickhouse will
reject to start w/o it. While this is completelly different library.

  [3]: https://packages.debian.org/bullseye/libnsl2
2020-12-22 22:07:07 +03:00
alexey-milovidov
a4b0d9ba4c
Merge pull request #16664 from FawnD2/switch-upstream-for-arrow-submodule
Switch upstream repo for Arrow submodule
2020-12-22 10:55:23 +03:00
Alexey Milovidov
bf2df558d4 Merge branch 'master' into FawnD2-switch-upstream-for-arrow-submodule 2020-12-20 09:38:46 +03:00
Azat Khuzhin
e379b80d45 MADV_DONTNEED check in runtime for qemu (via patching jemalloc)
qemu does not support MADV_DONTNEED, and by not support it simply ignore
it (i.e. return 0 -- no error).

This issue has been "fixed" in #15590, however it just
terminates the process, and completely breaks clickhouse under qemu
(see also #15174).

But there is no need in such strong protection, we can stop using
madvise in jemalloc if MADV_DONTNEED does not work properly.
And this is what #18169 was tried to do (by override madvise), however
this will break sanitizers, at least TSAN and UBSAN.
The problem there is that sanitizers initialization code uses madvise
(and there is no way to turn this off with TSAN_OPTIONS) and overwritten
madvise function will have sanitizers traits (__tsan_func_entry), while
TSAN is not ready for this, and eventually it SIGSEGV.
Interesting thing is that in the recent clang-12, madvise was replaced
with direct syscall [1].

  [1]: 9f8c4039f2

But it is better to make clickhouse compatible with clang < 12 too, so
instead of override madvise completely, the runtime check was moved into
the jemalloc code [2].

  [2]: https://github.com/ClickHouse-Extras/jemalloc/pull/1
2020-12-19 15:34:12 +03:00
alexey-milovidov
41b2503d1a
Merge pull request #18114 from azat/20.13-gcc10-sanitizers
gcc10 sanitizers support
2020-12-19 12:54:36 +03:00
alexey-milovidov
7ec772f480
Merge pull request #18129 from ClickHouse/boringssl2
Port to BoringSSL (part 2)
2020-12-18 18:00:10 +03:00
alexey-milovidov
c343fa1ae4
Merge pull request #18202 from ClickHouse/update-libc-headers-2
Update libc headers
2020-12-18 08:03:11 +03:00
Alexey Milovidov
1be41beca0 Merge branch 'master' into boringssl2 2020-12-18 05:59:30 +03:00
alesapin
799997db35
Merge pull request #16621 from arenadata/ADQM-148
HDFS configuration and Kerberos Authenticaiton
2020-12-17 23:16:58 +03:00
Alexey Milovidov
3060743b9f Merge branch 'master' into boringssl2 2020-12-17 22:09:30 +03:00
Alexey Milovidov
4a1618d0b8 Update libc headers 2020-12-17 20:25:51 +03:00
Nikolai Kochetov
53d5012a20 Update boost. 2020-12-17 10:32:51 +03:00
Nikolai Kochetov
10449695bc Update boost. 2020-12-17 10:32:11 +03:00
Nikolai Kochetov
c91c5d0a68 Update boost. 2020-12-17 10:29:47 +03:00
Alexey Milovidov
8d9c5f0fc9 Fix splitted build 2020-12-17 01:59:58 +03:00
Alexey Milovidov
f09921b31a Update BoringSSL; add missing mode 2020-12-17 01:18:50 +03:00
Azat Khuzhin
a95d864a3f Bump libcxx to fix extern "C" at the middle of the line in gcc10 2020-12-16 21:31:03 +03:00
Nikolai Kochetov
a85d6e2fbc Try use tsan annotated boost fibre. 2020-12-16 19:52:29 +03:00
Nikolai Kochetov
a6b4dabab6 Use ucontext for tsan. 2020-12-16 19:51:58 +03:00
Alexey Milovidov
9f92844b93 Port Kerberos to BoringSSL 2020-12-16 19:30:23 +03:00
Alexey Milovidov
5c7e35508b Better dependencies in CMake 2020-12-16 19:30:23 +03:00
Alexey Milovidov
c8eaecf302 Enable AES-CFB mode 2020-12-16 19:30:23 +03:00
Alexey Milovidov
4385d3a89d Remove dependency on too new glibc 2020-12-16 19:30:23 +03:00
Alexey Milovidov
8a3ef80ee0 Remove OpenSSL 2020-12-16 19:30:23 +03:00
Alexey Milovidov
f289ef24e2 Remove OpenSSL 2020-12-16 19:30:23 +03:00
Alexey Milovidov
dabde573df Adjust CMake 2020-12-16 19:30:23 +03:00
Alexey Milovidov
25bc545b20 Enable BoringSSL 2020-12-16 19:30:23 +03:00
Alexey Milovidov
5345ffb233 Edit the file 2020-12-16 19:30:23 +03:00
Alexey Milovidov
bbc0c3eb1f Add BoringSSL, generate CMakeFiles 2020-12-16 19:30:23 +03:00
Ilya Golshtein
fc0a1af214 doc minor changes, cleanup, krb5-user as a recommended package 2020-12-16 14:48:33 +03:00
Ilya Golshtein
7e97814859 cleanup, fixes, new submodules, ShellCommand, WriteBufferFromString 2020-12-16 14:48:33 +03:00
Ilya Golshtein
185ac744b1 kerberized hdfs compiled 2020-12-16 14:48:33 +03:00
Alexey Milovidov
e3b490e9b3 Port Kerberos to BoringSSL 2020-12-16 09:37:28 +03:00
Nikolai Kochetov
4905201985 Merge branch 'master' into async-read-from-socket 2020-12-15 21:04:47 +03:00
Nikolai Kochetov
01286a6a09 Update libunwind. 2020-12-15 19:18:28 +03:00
Nikolai Kochetov
8de5cd5bc7 Merge branch 'master' into async-read-from-socket 2020-12-14 17:45:38 +03:00
Nikolai Kochetov
75ac87c241 Fixing build. 2020-12-14 17:42:12 +03:00
Nikolai Kochetov
e295dfe6e3 Use ucontext for asan 2020-12-14 17:42:08 +03:00
Nikolai Kochetov
116bed2cfd Fixing build. 2020-12-14 17:42:00 +03:00
Azat Khuzhin
3b431b054e Bump librdkafka to fix UB in snappy decompression.
In incremental_copy_fast_path there is undefined behavior (and in some
other places too).

And under this circumstances gcc10 with -O1 -ftree-loop-vectorize (or
simply -O3), due to loop unroll, generates code that do copy by 16 bytes
at a time for the second loop (MOVDQU+MOVUPS), while this is not correct
since the memory may be overlapped and may be changed in the previous
iteration.

Updated version includes [1], that fixes those UB, by using memcpy over
direct store/load since these days direct store/loads looks redundant.
Even on ARM.

  [1]: https://github.com/ClickHouse-Extras/librdkafka/pull/3

NOTE: clang is fine, and other older versions of gcc too
2020-12-14 00:38:07 +03:00
Nikolai Kochetov
ca20058cdc Update libunwind. 2020-12-12 14:10:27 +03:00
alexey-milovidov
932493f12e
Merge pull request #17982 from azat/build
Tiny build changes
2020-12-12 02:37:14 +03:00
Amos Bird
88341fec82
client SIGWINCH fix 2020-12-12 00:34:40 +08:00
Azat Khuzhin
5cc35d4d38 build: switch llvm to -std=gnu++17 2020-12-11 01:32:38 +03:00
Azat Khuzhin
8e035a7518 build: pass the c++ standard for compiling llvm
Yes clickhosue set gnu++2a globally, but this will not work, since
default -std=c++11 will be added later, look:

    clang++ -std=gnu++2a ... -std=c++11 -Wall -Wextra contrib/llvm/...
2020-12-11 01:32:38 +03:00
alexey-milovidov
7f35db47c5
Merge pull request #17869 from nikitamikhaylov/dragonbox-cmake
Add dragonbox-cmake
2020-12-10 22:42:05 +03:00
Alexander Kuzmenkov
678b8f0efb
Merge pull request #17905 from ClickHouse/aku/poco-log-rotation
Fix integer overflow in max log size calculation
2020-12-10 18:49:08 +03:00
Nikita Mikhaylov
34375ae26e
Merge branch 'master' into dragonbox-cmake 2020-12-10 02:26:01 +03:00
Nikolai Kochetov
32b38f389e Merge branch 'master' into async-read-from-socket 2020-12-09 17:15:36 +03:00
Nikolai Kochetov
faa5b71efc Update boost submodule 2020-12-09 17:11:20 +03:00
Nikolai Kochetov
a1d4d92b54 Use poco from master. Fixing tests. 2020-12-09 17:12:42 +03:00
Nikolai Kochetov
e8667bad45 Fix build and tests. 2020-12-09 17:12:27 +03:00
alexey-milovidov
e127636a4b
Merge pull request #16787 from kitaisreal/fast-float-integration
FastFloat library integration
2020-12-08 21:34:34 +03:00
Alexander Kuzmenkov
cb1a71fd3f fixup 2020-12-08 20:29:17 +03:00
Alexander Kuzmenkov
52995b4d33 Fix integer overflow in max log size calculation.
If the `<size>` was more than 4G, the logs were not rotated properly.
Also log errors that occur during rotation of logs.

CLICKHOUSE-4975
2020-12-08 19:42:03 +03:00
alexey-milovidov
ab10cb4bf9
Merge pull request #17707 from ClickHouse/quota-by-x-forwarded-for
Allow quotas to be keyed by proxy-forwarded IP address; add support for PROXY protocol
2020-12-08 14:48:05 +03:00
Nikita Mikhaylov
1a01dbaa00
Merge pull request #17643 from nikitamikhaylov/rocksdb-patch
Switch RocksDB to patched version
2020-12-08 00:01:46 +03:00
Alexey Milovidov
0f437c86d3 Fix clang-tidy warning 2020-12-07 23:38:33 +03:00
nikitamikhaylov
ecb424a773 better 2020-12-07 21:26:02 +03:00
Alexey Milovidov
44d1259148 Fix clang-tidy warning 2020-12-07 19:21:29 +03:00
Nikolai Kochetov
65f9fda328 Update Poco 2020-12-07 17:23:01 +03:00
nikitamikhaylov
b10db16d3b done 2020-12-07 16:23:10 +03:00
nikitamikhaylov
19a2c59610 last update 2020-12-07 15:48:58 +03:00
Maksim Kita
c3864d2fbf Updated contrib CMakeLists 2020-12-07 14:08:19 +03:00
Maksim Kita
5b57c59a3b Updated fast_float integration 2020-12-06 23:37:55 +03:00
Maksim Kita
42f2243fd4 Updated submodule 2020-12-06 23:37:36 +03:00
Maksim Kita
80d66b8868 FastFloat library integration 2020-12-06 23:37:35 +03:00
Maksim Kita
6a7ffbec1d Fixed contrib CMakeLists.txt 2020-12-06 15:41:18 +03:00
Maksim Kita
977da3d052 Removed ryu 2020-12-06 15:39:39 +03:00
Maksim Kita
074d0ee6ae Updated dragonbox commit 2020-12-06 00:49:32 +03:00
Maksim Kita
64549702a2 DragonBox integration 2020-12-06 00:32:03 +03:00
Ivan
315ff4f0d9
ANTLR4 Grammar for ClickHouse and new parser (#11298) 2020-12-04 05:15:44 +03:00
nikitamikhaylov
326c79d42d better 2020-12-01 19:32:21 +03:00
nikitamikhaylov
65f33e6c45 diff 2020-12-01 19:30:55 +03:00
nikitamikhaylov
43614d2b86 better cmake 2020-12-01 19:30:55 +03:00
nikitamikhaylov
0c35422b3f switch to master 2020-12-01 19:30:54 +03:00
Nikolai Kochetov
319d36a3b7 Update CMakeLists.txt 2020-11-30 19:11:56 +03:00
Nikolai Kochetov
0e04320259 Update CMakeLists.txt 2020-11-30 19:10:18 +03:00
Nikolai Kochetov
4f442cd8f3 Update CMakeLists.txt for boost 2020-11-30 18:32:01 +03:00
Nikolai Kochetov
0f293e60e1 Update CMakeLists.txt for boost 2020-11-30 18:22:34 +03:00
Nikolai Kochetov
fa9814921c Updae boost. 2020-11-30 17:57:31 +03:00