thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-25 09:02:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
58,024 Commits 9,170 Branches 1,781 Tags 2.1 GiB
5b72cd231f
Commit Graph

1621 Commits

Author SHA1 Message Date
alexey-milovidov
a4b0d9ba4c
Merge pull request #16664 from FawnD2/switch-upstream-for-arrow-submodule 
Switch upstream repo for Arrow submodule
 2020-12-22 10:55:23 +03:00
Alexey Milovidov
bf2df558d4 Merge branch 'master' into FawnD2-switch-upstream-for-arrow-submodule 2020-12-20 09:38:46 +03:00
Azat Khuzhin
e379b80d45 MADV_DONTNEED check in runtime for qemu (via patching jemalloc) 
qemu does not support MADV_DONTNEED, and by not support it simply ignore
it (i.e. return 0 -- no error).

This issue has been "fixed" in #15590, however it just
terminates the process, and completely breaks clickhouse under qemu
(see also #15174).

But there is no need in such strong protection, we can stop using
madvise in jemalloc if MADV_DONTNEED does not work properly.
And this is what #18169 was tried to do (by override madvise), however
this will break sanitizers, at least TSAN and UBSAN.
The problem there is that sanitizers initialization code uses madvise
(and there is no way to turn this off with TSAN_OPTIONS) and overwritten
madvise function will have sanitizers traits (__tsan_func_entry), while
TSAN is not ready for this, and eventually it SIGSEGV.
Interesting thing is that in the recent clang-12, madvise was replaced
with direct syscall [1].

  [1]: 9f8c4039f2

But it is better to make clickhouse compatible with clang < 12 too, so
instead of override madvise completely, the runtime check was moved into
the jemalloc code [2].

  [2]: https://github.com/ClickHouse-Extras/jemalloc/pull/1
 2020-12-19 15:34:12 +03:00
alexey-milovidov
41b2503d1a
Merge pull request #18114 from azat/20.13-gcc10-sanitizers 
gcc10 sanitizers support
 2020-12-19 12:54:36 +03:00
alexey-milovidov
7ec772f480
Merge pull request #18129 from ClickHouse/boringssl2 
Port to BoringSSL (part 2)
 2020-12-18 18:00:10 +03:00
alexey-milovidov
c343fa1ae4
Merge pull request #18202 from ClickHouse/update-libc-headers-2 
Update libc headers
 2020-12-18 08:03:11 +03:00
Alexey Milovidov
1be41beca0 Merge branch 'master' into boringssl2 2020-12-18 05:59:30 +03:00
alesapin
799997db35
Merge pull request #16621 from arenadata/ADQM-148 
HDFS configuration and Kerberos Authenticaiton
 2020-12-17 23:16:58 +03:00
Alexey Milovidov
3060743b9f Merge branch 'master' into boringssl2 2020-12-17 22:09:30 +03:00
Alexey Milovidov
4a1618d0b8 Update libc headers 2020-12-17 20:25:51 +03:00
Nikolai Kochetov
53d5012a20 Update boost. 2020-12-17 10:32:51 +03:00
Nikolai Kochetov
10449695bc Update boost. 2020-12-17 10:32:11 +03:00
Nikolai Kochetov
c91c5d0a68 Update boost. 2020-12-17 10:29:47 +03:00
Alexey Milovidov
8d9c5f0fc9 Fix splitted build 2020-12-17 01:59:58 +03:00
Alexey Milovidov
f09921b31a Update BoringSSL; add missing mode 2020-12-17 01:18:50 +03:00
Azat Khuzhin
a95d864a3f Bump libcxx to fix extern "C" at the middle of the line in gcc10 2020-12-16 21:31:03 +03:00
Nikolai Kochetov
a85d6e2fbc Try use tsan annotated boost fibre. 2020-12-16 19:52:29 +03:00
Nikolai Kochetov
a6b4dabab6 Use ucontext for tsan. 2020-12-16 19:51:58 +03:00
Alexey Milovidov
9f92844b93 Port Kerberos to BoringSSL 2020-12-16 19:30:23 +03:00
Alexey Milovidov
5c7e35508b Better dependencies in CMake 2020-12-16 19:30:23 +03:00
Alexey Milovidov
c8eaecf302 Enable AES-CFB mode 2020-12-16 19:30:23 +03:00
Alexey Milovidov
4385d3a89d Remove dependency on too new glibc 2020-12-16 19:30:23 +03:00
Alexey Milovidov
8a3ef80ee0 Remove OpenSSL 2020-12-16 19:30:23 +03:00
Alexey Milovidov
f289ef24e2 Remove OpenSSL 2020-12-16 19:30:23 +03:00
Alexey Milovidov
dabde573df Adjust CMake 2020-12-16 19:30:23 +03:00
Alexey Milovidov
25bc545b20 Enable BoringSSL 2020-12-16 19:30:23 +03:00
Alexey Milovidov
5345ffb233 Edit the file 2020-12-16 19:30:23 +03:00
Alexey Milovidov
bbc0c3eb1f Add BoringSSL, generate CMakeFiles 2020-12-16 19:30:23 +03:00
Ilya Golshtein
fc0a1af214 doc minor changes, cleanup, krb5-user as a recommended package 2020-12-16 14:48:33 +03:00
Ilya Golshtein
7e97814859 cleanup, fixes, new submodules, ShellCommand, WriteBufferFromString 2020-12-16 14:48:33 +03:00
Ilya Golshtein
185ac744b1 kerberized hdfs compiled 2020-12-16 14:48:33 +03:00
Alexey Milovidov
e3b490e9b3 Port Kerberos to BoringSSL 2020-12-16 09:37:28 +03:00
Nikolai Kochetov
4905201985 Merge branch 'master' into async-read-from-socket 2020-12-15 21:04:47 +03:00
Nikolai Kochetov
01286a6a09 Update libunwind. 2020-12-15 19:18:28 +03:00
Nikolai Kochetov
8de5cd5bc7 Merge branch 'master' into async-read-from-socket 2020-12-14 17:45:38 +03:00
Nikolai Kochetov
75ac87c241 Fixing build. 2020-12-14 17:42:12 +03:00
Nikolai Kochetov
e295dfe6e3 Use ucontext for asan 2020-12-14 17:42:08 +03:00
Nikolai Kochetov
116bed2cfd Fixing build. 2020-12-14 17:42:00 +03:00
Azat Khuzhin
3b431b054e Bump librdkafka to fix UB in snappy decompression. 
In incremental_copy_fast_path there is undefined behavior (and in some
other places too).

And under this circumstances gcc10 with -O1 -ftree-loop-vectorize (or
simply -O3), due to loop unroll, generates code that do copy by 16 bytes
at a time for the second loop (MOVDQU+MOVUPS), while this is not correct
since the memory may be overlapped and may be changed in the previous
iteration.

Updated version includes [1], that fixes those UB, by using memcpy over
direct store/load since these days direct store/loads looks redundant.
Even on ARM.

  [1]: https://github.com/ClickHouse-Extras/librdkafka/pull/3

NOTE: clang is fine, and other older versions of gcc too
 2020-12-14 00:38:07 +03:00
Nikolai Kochetov
ca20058cdc Update libunwind. 2020-12-12 14:10:27 +03:00
alexey-milovidov
932493f12e
Merge pull request #17982 from azat/build 
Tiny build changes
 2020-12-12 02:37:14 +03:00
Amos Bird
88341fec82
client SIGWINCH fix 2020-12-12 00:34:40 +08:00
Azat Khuzhin
5cc35d4d38 build: switch llvm to -std=gnu++17 2020-12-11 01:32:38 +03:00
Azat Khuzhin
8e035a7518 build: pass the c++ standard for compiling llvm 
Yes clickhosue set gnu++2a globally, but this will not work, since
default -std=c++11 will be added later, look:

    clang++ -std=gnu++2a ... -std=c++11 -Wall -Wextra contrib/llvm/...
 2020-12-11 01:32:38 +03:00
alexey-milovidov
7f35db47c5
Merge pull request #17869 from nikitamikhaylov/dragonbox-cmake 
Add dragonbox-cmake
 2020-12-10 22:42:05 +03:00
Alexander Kuzmenkov
678b8f0efb
Merge pull request #17905 from ClickHouse/aku/poco-log-rotation 
Fix integer overflow in max log size calculation
 2020-12-10 18:49:08 +03:00
Nikita Mikhaylov
34375ae26e
Merge branch 'master' into dragonbox-cmake 2020-12-10 02:26:01 +03:00
Nikolai Kochetov
32b38f389e Merge branch 'master' into async-read-from-socket 2020-12-09 17:15:36 +03:00
Nikolai Kochetov
faa5b71efc Update boost submodule 2020-12-09 17:11:20 +03:00
Nikolai Kochetov
a1d4d92b54 Use poco from master. Fixing tests. 2020-12-09 17:12:42 +03:00
Nikolai Kochetov
e8667bad45 Fix build and tests. 2020-12-09 17:12:27 +03:00
alexey-milovidov
e127636a4b
Merge pull request #16787 from kitaisreal/fast-float-integration 
FastFloat library integration
 2020-12-08 21:34:34 +03:00
Alexander Kuzmenkov
cb1a71fd3f fixup 2020-12-08 20:29:17 +03:00
Alexander Kuzmenkov
52995b4d33 Fix integer overflow in max log size calculation. 
If the `<size>` was more than 4G, the logs were not rotated properly.
Also log errors that occur during rotation of logs.

CLICKHOUSE-4975
 2020-12-08 19:42:03 +03:00
alexey-milovidov
ab10cb4bf9
Merge pull request #17707 from ClickHouse/quota-by-x-forwarded-for 
Allow quotas to be keyed by proxy-forwarded IP address; add support for PROXY protocol
 2020-12-08 14:48:05 +03:00
Nikita Mikhaylov
1a01dbaa00
Merge pull request #17643 from nikitamikhaylov/rocksdb-patch 
Switch RocksDB to patched version
 2020-12-08 00:01:46 +03:00
Alexey Milovidov
0f437c86d3 Fix clang-tidy warning 2020-12-07 23:38:33 +03:00
nikitamikhaylov
ecb424a773 better 2020-12-07 21:26:02 +03:00
Alexey Milovidov
44d1259148 Fix clang-tidy warning 2020-12-07 19:21:29 +03:00
Nikolai Kochetov
65f9fda328 Update Poco 2020-12-07 17:23:01 +03:00
nikitamikhaylov
b10db16d3b done 2020-12-07 16:23:10 +03:00
nikitamikhaylov
19a2c59610 last update 2020-12-07 15:48:58 +03:00
Maksim Kita
c3864d2fbf Updated contrib CMakeLists 2020-12-07 14:08:19 +03:00
Maksim Kita
5b57c59a3b Updated fast_float integration 2020-12-06 23:37:55 +03:00
Maksim Kita
42f2243fd4 Updated submodule 2020-12-06 23:37:36 +03:00
Maksim Kita
80d66b8868 FastFloat library integration 2020-12-06 23:37:35 +03:00
Maksim Kita
6a7ffbec1d Fixed contrib CMakeLists.txt 2020-12-06 15:41:18 +03:00
Maksim Kita
977da3d052 Removed ryu 2020-12-06 15:39:39 +03:00
Maksim Kita
074d0ee6ae Updated dragonbox commit 2020-12-06 00:49:32 +03:00
Maksim Kita
64549702a2 DragonBox integration 2020-12-06 00:32:03 +03:00
Ivan
315ff4f0d9
ANTLR4 Grammar for ClickHouse and new parser (#11298) 2020-12-04 05:15:44 +03:00
nikitamikhaylov
326c79d42d better 2020-12-01 19:32:21 +03:00
nikitamikhaylov
65f33e6c45 diff 2020-12-01 19:30:55 +03:00
nikitamikhaylov
43614d2b86 better cmake 2020-12-01 19:30:55 +03:00
nikitamikhaylov
0c35422b3f switch to master 2020-12-01 19:30:54 +03:00
Nikolai Kochetov
319d36a3b7 Update CMakeLists.txt 2020-11-30 19:11:56 +03:00
Nikolai Kochetov
0e04320259 Update CMakeLists.txt 2020-11-30 19:10:18 +03:00
Nikolai Kochetov
4f442cd8f3 Update CMakeLists.txt for boost 2020-11-30 18:32:01 +03:00
Nikolai Kochetov
0f293e60e1 Update CMakeLists.txt for boost 2020-11-30 18:22:34 +03:00
Nikolai Kochetov
fa9814921c Updae boost. 2020-11-30 17:57:31 +03:00
Nikolai Kochetov
ad9a0c6144 Update poco 2020-11-30 15:43:37 +03:00
alexey-milovidov
d69d323b5f
Merge pull request #17547 from ClickHouse/boringssl-ldap 
Update OpenLDAP for BoringSSL
 2020-11-30 09:37:41 +03:00
alexey-milovidov
02825541ed
Merge pull request #17546 from ClickHouse/boringssl-mariadb 
Update MariaDB for BoringSSL
 2020-11-30 09:37:21 +03:00
alexey-milovidov
8bf9855740
Merge pull request #17544 from ClickHouse/boringssl-cassandra 
Update Cassandra for BoringSSL
 2020-11-30 09:37:01 +03:00
alexey-milovidov
c041a3ad7d
Merge pull request #17545 from ClickHouse/boringssl-rdkafka 
Update Kafka for BoringSSL
 2020-11-30 09:36:39 +03:00
alexey-milovidov
80e996d37f
Merge pull request #17548 from ClickHouse/boringssl-amqp 
Update AMQP for BoringSSL
 2020-11-30 09:36:03 +03:00
FawnD2
26488467f8 Merge branch 'master' into switch-upstream-for-arrow-submodule 2020-11-29 15:53:28 +03:00
Alexey Milovidov
a96d9104d9 Update AMQP for BoringSSL 2020-11-29 11:53:15 +03:00
Alexey Milovidov
4d4aa93165 Update OpenLDAP for BoringSSL 2020-11-29 11:51:32 +03:00
Alexey Milovidov
6f660f4903 Update MariaDB for BoringSSL 2020-11-29 11:49:46 +03:00
Alexey Milovidov
1f4087b8d0 Update Kafka for BoringSSL 2020-11-29 11:48:43 +03:00
Alexey Milovidov
c679d8b357 Update Cassandra for BoringSSL 2020-11-29 11:42:17 +03:00
Alexey Milovidov
27063ad160 Update Poco: Fix thread counter leak 2020-11-29 11:10:39 +03:00
Azat Khuzhin
c89b263a87 Drop include of the removed libbtrie in cmake rules 
Refs: #16804
 2020-11-26 21:38:31 +03:00
Nikolai Kochetov
729272391f
Merge branch 'master' into ip-dict-no-trie 2020-11-25 23:07:19 +03:00
alesapin
77efcbcdbc
Merge pull request #17271 from azat/libunwind-cmake-3.19-build-fix 
Fix libunwind build for cmake 3.19+
 2020-11-25 17:09:40 +03:00
Vitaly Baranov
a32ed23198 Fork abseil-cpp to remove dependency on errno@GLIBC_PRIVATE, __pthread_unwind@GLIBC_PRIVATE and to fix shared build. 2020-11-24 17:55:02 +03:00
Vitaly Baranov
8d96a11d8d Update grpc build scripts. 2020-11-24 17:53:34 +03:00
Vitaly Baranov
5dde87fdcc Update contrib/grpc & contrib/protobuf. 2020-11-24 17:53:34 +03:00
Azat Khuzhin
83f27c8d4f Fix libunwind build for cmake 3.19+ 2020-11-22 12:19:17 +03:00
vdimir
e2fac19686
Remove libbtrie 2020-11-21 21:31:15 +03:00
Mikhail Filimonov
e7266625e8
Update cctz to the latest master, update tzdb to 2020d. 2020-11-19 14:52:44 +01:00
Nikita Mikhaylov
0d78002a22
Merge pull request #17179 from sundy-li/update-rocksdb-version 
bump up rocksdb version to  v6.14.5
 2020-11-19 15:32:46 +03:00
sundy-li
ddd62edf53 add submodule commits 2020-11-18 20:12:18 +08:00
sundy-li
c2ff8a421c bump up rocksdb version to v6.14.5 2020-11-18 19:57:28 +08:00
Alexey Milovidov
2872f90a83 Fix the case when CFA register is RAX 2020-11-15 18:32:41 +03:00
sundyli
5ef809931e
Merge branch 'master' into storage-rocksdb 2020-11-12 08:26:27 +08:00
alexey-milovidov
34b2a460ba
Merge pull request #16578 from fibersel/issue-8828 
add compression method for files: Xz
 2020-11-12 02:58:52 +03:00
sundy-li
5a38e80b00 disable JeMalloc in rocksdb contrib 2020-11-11 22:53:42 +08:00
a.palagashvili
55d05c95bf fixed style, xz check fasttest skipped, removed fast-lzma2 2020-11-11 15:34:28 +03:00
sundy-li
ed93ec673f add zstd include directory for rocksdb 2020-11-11 19:41:54 +08:00
sundy-li
579f4c50ed improve rocksdb-cmake build 2020-11-11 17:39:23 +08:00
a.palagashvili
124ef2f5fa added and successfully passed tests for content encoding and file() function, formatted code 2020-11-11 04:50:56 +03:00
sundy-li
c56d1212a2 rocksdb-cmake && fix iteration bug && improve tests 2020-11-11 09:39:09 +08:00
sundy-li
ad78e0b3f5 trigger 2020-11-11 09:08:52 +08:00
sundy-li
1270ede0c0 USE PORTABLE to avoid Illegal instruction, add SANITIZE for rocksdb cmake build 
options
 2020-11-11 09:08:52 +08:00
sundy-li
03ad32a3fa disable WITH_GFLAGS 2020-11-11 09:08:52 +08:00
root
e9de5b6ad4 Add StorageEmbeddedRocksdb Engine 2020-11-11 09:08:52 +08:00
Alexey Milovidov
0cca51f4aa Check for wrong DWARF expressions for CFA 2020-11-11 02:44:09 +03:00
a.palagashvili
f999ea2a6f renamed files, added new library, changed error codes, added tests for file() function 2020-11-10 01:52:22 +03:00
Danila Kutenin
d0840bfc5d Move miniselect to submodule and replace quantile exact with better algorithm 2020-11-10 00:53:43 +03:00
Danila Kutenin
3c6794bf37 Add Floyd-Rivest selection algorithm instead of std::partial_sort 2020-11-09 20:22:05 +03:00
FawnD2
43799204f9 Remove misleading comment 2020-11-08 05:16:41 +03:00
FawnD2
6a89d965fd Merge branch 'master' into switch-upstream-for-arrow-submodule 2020-11-07 22:34:55 +03:00
FawnD2
65e4fa555b Remove build branch with internal parquet native cmake 2020-11-07 19:49:36 +03:00
FawnD2
bd1daf93fa Set correct sha for submodule 2020-11-07 17:32:45 +03:00
FawnD2
6cf4d58ce1 Fix parquet reader in submodule 2020-11-07 17:27:25 +03:00
a.palagashvili
268f289bd1 resolved conflict 2020-11-07 16:36:38 +03:00
FawnD2
9be0340d98 Regenerate parquet config 2020-11-07 16:25:48 +03:00
FawnD2
8fd417f9a3 Fix build 2020-11-07 16:25:38 +03:00
FawnD2
066a3032e1 Move arrow config from SOURCE_DIR to BINARY_DIR 2020-11-07 16:25:30 +03:00
FawnD2
4598046176 Update cmake 2020-11-07 16:24:50 +03:00
alexey-milovidov
010f0cb33d
Merge pull request #16764 from ClickHouse/3rdparty-no-ubsan 
Do not instrument 3rd-party libraries with UBSan
 2020-11-07 13:39:50 +03:00
Alexey Milovidov
8ec6653fb1 Fix UBSan report in Poco 2020-11-06 20:56:21 +03:00
Alexey Milovidov
584f1a83be Do not instrument 3rd-party libraries with UBSan 2020-11-06 20:52:28 +03:00
FawnD2
069e3dec0d Do not use deprecated API 2020-11-05 20:10:11 +03:00
FawnD2
4f82e95a46 Update submodule to the latest release 2020-11-05 19:49:11 +03:00
Anton Ivashkin
6f96cd04cc Update aws submodule, use version with patch for non-empty http path in urls 2020-11-05 15:53:40 +03:00
FawnD2
b0277e99a5 Update sources list 2020-11-04 19:51:43 +03:00
FawnD2
19f81e0f82 Update submodule sha 2020-11-04 15:51:10 +03:00
a.palagashvili
ba6fa5d828 fixed whitespaces, added hidden submodule file 2020-11-02 23:04:49 +03:00
a.palagashvili
805bfd286c resolved git modules 2020-11-02 15:16:49 +03:00
a.palagashvili
be2b002ff4 fixed cmake for building, added test for compression method, added basic code for encoding 2020-11-01 21:40:05 +03:00
a.palagashvili
c1abf5d13c *added adapters' boilerplate for Lzma buffers, *added submodule to gitmodules, *added cmake for xz 2020-11-01 02:56:41 +03:00
Alexander Kuzmenkov
ba34145817
Merge pull request #16425 from filimonov/minumum 
Fix typos reported by codespell
 2020-10-28 08:07:18 +03:00
Alexey Milovidov
eee81eef43 Remove dependency on "services" database 2020-10-28 01:58:53 +03:00
Mikhail Filimonov
41971e073a
Fix typos reported by codespell 2020-10-27 12:04:03 +01:00
sundy-li
f407504a7a try use cmake version for croaring instead of amalgamation.sh 2020-10-23 19:42:21 +08:00
Azat Khuzhin
f211d33841 Avoid creating separate replxx instance 
This replxx object is pretty heavy and in debug build may slow down [1]
(although I cannot confirm 0.5s delay for each query in debug build) the
client and besides it is not required since ClickHouse-Extras/replxx#10,
which changes the behaviour of history_save(), and now it will not
update current session anymore, only save the history to the disk.

  [1]: https://github.com/ClickHouse/ClickHouse/pull/13086#issuecomment-667719026
 2020-10-12 23:56:29 +03:00
alexey-milovidov
557002262f
Merge pull request #15828 from azat/unbundled-INTERFACE_COMPILE_DEFINITIONS 
Fix INTERFACE_COMPILE_DEFINITIONS for IMPORTED targets
 2020-10-11 19:28:18 +03:00