Commit Graph

1605 Commits

Author SHA1 Message Date
Nikolai Kochetov
a85d6e2fbc Try use tsan annotated boost fibre. 2020-12-16 19:52:29 +03:00
Nikolai Kochetov
a6b4dabab6 Use ucontext for tsan. 2020-12-16 19:51:58 +03:00
Alexey Milovidov
9f92844b93 Port Kerberos to BoringSSL 2020-12-16 19:30:23 +03:00
Alexey Milovidov
5c7e35508b Better dependencies in CMake 2020-12-16 19:30:23 +03:00
Alexey Milovidov
c8eaecf302 Enable AES-CFB mode 2020-12-16 19:30:23 +03:00
Alexey Milovidov
4385d3a89d Remove dependency on too new glibc 2020-12-16 19:30:23 +03:00
Alexey Milovidov
8a3ef80ee0 Remove OpenSSL 2020-12-16 19:30:23 +03:00
Alexey Milovidov
f289ef24e2 Remove OpenSSL 2020-12-16 19:30:23 +03:00
Alexey Milovidov
dabde573df Adjust CMake 2020-12-16 19:30:23 +03:00
Alexey Milovidov
25bc545b20 Enable BoringSSL 2020-12-16 19:30:23 +03:00
Alexey Milovidov
5345ffb233 Edit the file 2020-12-16 19:30:23 +03:00
Alexey Milovidov
bbc0c3eb1f Add BoringSSL, generate CMakeFiles 2020-12-16 19:30:23 +03:00
Ilya Golshtein
fc0a1af214 doc minor changes, cleanup, krb5-user as a recommended package 2020-12-16 14:48:33 +03:00
Ilya Golshtein
7e97814859 cleanup, fixes, new submodules, ShellCommand, WriteBufferFromString 2020-12-16 14:48:33 +03:00
Ilya Golshtein
185ac744b1 kerberized hdfs compiled 2020-12-16 14:48:33 +03:00
Alexey Milovidov
e3b490e9b3 Port Kerberos to BoringSSL 2020-12-16 09:37:28 +03:00
Nikolai Kochetov
4905201985 Merge branch 'master' into async-read-from-socket 2020-12-15 21:04:47 +03:00
Nikolai Kochetov
01286a6a09 Update libunwind. 2020-12-15 19:18:28 +03:00
Nikolai Kochetov
8de5cd5bc7 Merge branch 'master' into async-read-from-socket 2020-12-14 17:45:38 +03:00
Nikolai Kochetov
75ac87c241 Fixing build. 2020-12-14 17:42:12 +03:00
Nikolai Kochetov
e295dfe6e3 Use ucontext for asan 2020-12-14 17:42:08 +03:00
Nikolai Kochetov
116bed2cfd Fixing build. 2020-12-14 17:42:00 +03:00
Azat Khuzhin
3b431b054e Bump librdkafka to fix UB in snappy decompression.
In incremental_copy_fast_path there is undefined behavior (and in some
other places too).

And under this circumstances gcc10 with -O1 -ftree-loop-vectorize (or
simply -O3), due to loop unroll, generates code that do copy by 16 bytes
at a time for the second loop (MOVDQU+MOVUPS), while this is not correct
since the memory may be overlapped and may be changed in the previous
iteration.

Updated version includes [1], that fixes those UB, by using memcpy over
direct store/load since these days direct store/loads looks redundant.
Even on ARM.

  [1]: https://github.com/ClickHouse-Extras/librdkafka/pull/3

NOTE: clang is fine, and other older versions of gcc too
2020-12-14 00:38:07 +03:00
Nikolai Kochetov
ca20058cdc Update libunwind. 2020-12-12 14:10:27 +03:00
alexey-milovidov
932493f12e
Merge pull request #17982 from azat/build
Tiny build changes
2020-12-12 02:37:14 +03:00
Amos Bird
88341fec82
client SIGWINCH fix 2020-12-12 00:34:40 +08:00
Azat Khuzhin
5cc35d4d38 build: switch llvm to -std=gnu++17 2020-12-11 01:32:38 +03:00
Azat Khuzhin
8e035a7518 build: pass the c++ standard for compiling llvm
Yes clickhosue set gnu++2a globally, but this will not work, since
default -std=c++11 will be added later, look:

    clang++ -std=gnu++2a ... -std=c++11 -Wall -Wextra contrib/llvm/...
2020-12-11 01:32:38 +03:00
alexey-milovidov
7f35db47c5
Merge pull request #17869 from nikitamikhaylov/dragonbox-cmake
Add dragonbox-cmake
2020-12-10 22:42:05 +03:00
Alexander Kuzmenkov
678b8f0efb
Merge pull request #17905 from ClickHouse/aku/poco-log-rotation
Fix integer overflow in max log size calculation
2020-12-10 18:49:08 +03:00
Nikita Mikhaylov
34375ae26e
Merge branch 'master' into dragonbox-cmake 2020-12-10 02:26:01 +03:00
Nikolai Kochetov
32b38f389e Merge branch 'master' into async-read-from-socket 2020-12-09 17:15:36 +03:00
Nikolai Kochetov
faa5b71efc Update boost submodule 2020-12-09 17:11:20 +03:00
Nikolai Kochetov
a1d4d92b54 Use poco from master. Fixing tests. 2020-12-09 17:12:42 +03:00
Nikolai Kochetov
e8667bad45 Fix build and tests. 2020-12-09 17:12:27 +03:00
alexey-milovidov
e127636a4b
Merge pull request #16787 from kitaisreal/fast-float-integration
FastFloat library integration
2020-12-08 21:34:34 +03:00
Alexander Kuzmenkov
cb1a71fd3f fixup 2020-12-08 20:29:17 +03:00
Alexander Kuzmenkov
52995b4d33 Fix integer overflow in max log size calculation.
If the `<size>` was more than 4G, the logs were not rotated properly.
Also log errors that occur during rotation of logs.

CLICKHOUSE-4975
2020-12-08 19:42:03 +03:00
alexey-milovidov
ab10cb4bf9
Merge pull request #17707 from ClickHouse/quota-by-x-forwarded-for
Allow quotas to be keyed by proxy-forwarded IP address; add support for PROXY protocol
2020-12-08 14:48:05 +03:00
Nikita Mikhaylov
1a01dbaa00
Merge pull request #17643 from nikitamikhaylov/rocksdb-patch
Switch RocksDB to patched version
2020-12-08 00:01:46 +03:00
Alexey Milovidov
0f437c86d3 Fix clang-tidy warning 2020-12-07 23:38:33 +03:00
nikitamikhaylov
ecb424a773 better 2020-12-07 21:26:02 +03:00
Alexey Milovidov
44d1259148 Fix clang-tidy warning 2020-12-07 19:21:29 +03:00
Nikolai Kochetov
65f9fda328 Update Poco 2020-12-07 17:23:01 +03:00
nikitamikhaylov
b10db16d3b done 2020-12-07 16:23:10 +03:00
nikitamikhaylov
19a2c59610 last update 2020-12-07 15:48:58 +03:00
Maksim Kita
c3864d2fbf Updated contrib CMakeLists 2020-12-07 14:08:19 +03:00
Maksim Kita
5b57c59a3b Updated fast_float integration 2020-12-06 23:37:55 +03:00
Maksim Kita
42f2243fd4 Updated submodule 2020-12-06 23:37:36 +03:00
Maksim Kita
80d66b8868 FastFloat library integration 2020-12-06 23:37:35 +03:00
Maksim Kita
6a7ffbec1d Fixed contrib CMakeLists.txt 2020-12-06 15:41:18 +03:00
Maksim Kita
977da3d052 Removed ryu 2020-12-06 15:39:39 +03:00
Maksim Kita
074d0ee6ae Updated dragonbox commit 2020-12-06 00:49:32 +03:00
Maksim Kita
64549702a2 DragonBox integration 2020-12-06 00:32:03 +03:00
Ivan
315ff4f0d9
ANTLR4 Grammar for ClickHouse and new parser (#11298) 2020-12-04 05:15:44 +03:00
nikitamikhaylov
326c79d42d better 2020-12-01 19:32:21 +03:00
nikitamikhaylov
65f33e6c45 diff 2020-12-01 19:30:55 +03:00
nikitamikhaylov
43614d2b86 better cmake 2020-12-01 19:30:55 +03:00
nikitamikhaylov
0c35422b3f switch to master 2020-12-01 19:30:54 +03:00
Nikolai Kochetov
319d36a3b7 Update CMakeLists.txt 2020-11-30 19:11:56 +03:00
Nikolai Kochetov
0e04320259 Update CMakeLists.txt 2020-11-30 19:10:18 +03:00
Nikolai Kochetov
4f442cd8f3 Update CMakeLists.txt for boost 2020-11-30 18:32:01 +03:00
Nikolai Kochetov
0f293e60e1 Update CMakeLists.txt for boost 2020-11-30 18:22:34 +03:00
Nikolai Kochetov
fa9814921c Updae boost. 2020-11-30 17:57:31 +03:00
Nikolai Kochetov
ad9a0c6144 Update poco 2020-11-30 15:43:37 +03:00
alexey-milovidov
d69d323b5f
Merge pull request #17547 from ClickHouse/boringssl-ldap
Update OpenLDAP for BoringSSL
2020-11-30 09:37:41 +03:00
alexey-milovidov
02825541ed
Merge pull request #17546 from ClickHouse/boringssl-mariadb
Update MariaDB for BoringSSL
2020-11-30 09:37:21 +03:00
alexey-milovidov
8bf9855740
Merge pull request #17544 from ClickHouse/boringssl-cassandra
Update Cassandra for BoringSSL
2020-11-30 09:37:01 +03:00
alexey-milovidov
c041a3ad7d
Merge pull request #17545 from ClickHouse/boringssl-rdkafka
Update Kafka for BoringSSL
2020-11-30 09:36:39 +03:00
alexey-milovidov
80e996d37f
Merge pull request #17548 from ClickHouse/boringssl-amqp
Update AMQP for BoringSSL
2020-11-30 09:36:03 +03:00
FawnD2
26488467f8 Merge branch 'master' into switch-upstream-for-arrow-submodule 2020-11-29 15:53:28 +03:00
Alexey Milovidov
a96d9104d9 Update AMQP for BoringSSL 2020-11-29 11:53:15 +03:00
Alexey Milovidov
4d4aa93165 Update OpenLDAP for BoringSSL 2020-11-29 11:51:32 +03:00
Alexey Milovidov
6f660f4903 Update MariaDB for BoringSSL 2020-11-29 11:49:46 +03:00
Alexey Milovidov
1f4087b8d0 Update Kafka for BoringSSL 2020-11-29 11:48:43 +03:00
Alexey Milovidov
c679d8b357 Update Cassandra for BoringSSL 2020-11-29 11:42:17 +03:00
Alexey Milovidov
27063ad160 Update Poco: Fix thread counter leak 2020-11-29 11:10:39 +03:00
Azat Khuzhin
c89b263a87 Drop include of the removed libbtrie in cmake rules
Refs: #16804
2020-11-26 21:38:31 +03:00
Nikolai Kochetov
729272391f
Merge branch 'master' into ip-dict-no-trie 2020-11-25 23:07:19 +03:00
alesapin
77efcbcdbc
Merge pull request #17271 from azat/libunwind-cmake-3.19-build-fix
Fix libunwind build for cmake 3.19+
2020-11-25 17:09:40 +03:00
Vitaly Baranov
a32ed23198 Fork abseil-cpp to remove dependency on errno@GLIBC_PRIVATE, __pthread_unwind@GLIBC_PRIVATE and to fix shared build. 2020-11-24 17:55:02 +03:00
Vitaly Baranov
8d96a11d8d Update grpc build scripts. 2020-11-24 17:53:34 +03:00
Vitaly Baranov
5dde87fdcc Update contrib/grpc & contrib/protobuf. 2020-11-24 17:53:34 +03:00
Azat Khuzhin
83f27c8d4f Fix libunwind build for cmake 3.19+ 2020-11-22 12:19:17 +03:00
vdimir
e2fac19686
Remove libbtrie 2020-11-21 21:31:15 +03:00
Mikhail Filimonov
e7266625e8
Update cctz to the latest master, update tzdb to 2020d. 2020-11-19 14:52:44 +01:00
Nikita Mikhaylov
0d78002a22
Merge pull request #17179 from sundy-li/update-rocksdb-version
bump up rocksdb version to  v6.14.5
2020-11-19 15:32:46 +03:00
sundy-li
ddd62edf53 add submodule commits 2020-11-18 20:12:18 +08:00
sundy-li
c2ff8a421c bump up rocksdb version to v6.14.5 2020-11-18 19:57:28 +08:00
Alexey Milovidov
2872f90a83 Fix the case when CFA register is RAX 2020-11-15 18:32:41 +03:00
sundyli
5ef809931e
Merge branch 'master' into storage-rocksdb 2020-11-12 08:26:27 +08:00
alexey-milovidov
34b2a460ba
Merge pull request #16578 from fibersel/issue-8828
add compression method for files: Xz
2020-11-12 02:58:52 +03:00
sundy-li
5a38e80b00 disable JeMalloc in rocksdb contrib 2020-11-11 22:53:42 +08:00
a.palagashvili
55d05c95bf fixed style, xz check fasttest skipped, removed fast-lzma2 2020-11-11 15:34:28 +03:00
sundy-li
ed93ec673f add zstd include directory for rocksdb 2020-11-11 19:41:54 +08:00
sundy-li
579f4c50ed improve rocksdb-cmake build 2020-11-11 17:39:23 +08:00
a.palagashvili
124ef2f5fa added and successfully passed tests for content encoding and file() function, formatted code 2020-11-11 04:50:56 +03:00
sundy-li
c56d1212a2 rocksdb-cmake && fix iteration bug && improve tests 2020-11-11 09:39:09 +08:00
sundy-li
ad78e0b3f5 trigger 2020-11-11 09:08:52 +08:00
sundy-li
1270ede0c0 USE PORTABLE to avoid Illegal instruction, add SANITIZE for rocksdb cmake build
options
2020-11-11 09:08:52 +08:00
sundy-li
03ad32a3fa disable WITH_GFLAGS 2020-11-11 09:08:52 +08:00
root
e9de5b6ad4 Add StorageEmbeddedRocksdb Engine 2020-11-11 09:08:52 +08:00
Alexey Milovidov
0cca51f4aa Check for wrong DWARF expressions for CFA 2020-11-11 02:44:09 +03:00
a.palagashvili
f999ea2a6f renamed files, added new library, changed error codes, added tests for file() function 2020-11-10 01:52:22 +03:00
Danila Kutenin
d0840bfc5d Move miniselect to submodule and replace quantile exact with better algorithm 2020-11-10 00:53:43 +03:00
Danila Kutenin
3c6794bf37 Add Floyd-Rivest selection algorithm instead of std::partial_sort 2020-11-09 20:22:05 +03:00
FawnD2
43799204f9 Remove misleading comment 2020-11-08 05:16:41 +03:00
FawnD2
6a89d965fd Merge branch 'master' into switch-upstream-for-arrow-submodule 2020-11-07 22:34:55 +03:00
FawnD2
65e4fa555b Remove build branch with internal parquet native cmake 2020-11-07 19:49:36 +03:00
FawnD2
bd1daf93fa Set correct sha for submodule 2020-11-07 17:32:45 +03:00
FawnD2
6cf4d58ce1 Fix parquet reader in submodule 2020-11-07 17:27:25 +03:00
a.palagashvili
268f289bd1 resolved conflict 2020-11-07 16:36:38 +03:00
FawnD2
9be0340d98 Regenerate parquet config 2020-11-07 16:25:48 +03:00
FawnD2
8fd417f9a3 Fix build 2020-11-07 16:25:38 +03:00
FawnD2
066a3032e1 Move arrow config from SOURCE_DIR to BINARY_DIR 2020-11-07 16:25:30 +03:00
FawnD2
4598046176 Update cmake 2020-11-07 16:24:50 +03:00
alexey-milovidov
010f0cb33d
Merge pull request #16764 from ClickHouse/3rdparty-no-ubsan
Do not instrument 3rd-party libraries with UBSan
2020-11-07 13:39:50 +03:00
Alexey Milovidov
8ec6653fb1 Fix UBSan report in Poco 2020-11-06 20:56:21 +03:00
Alexey Milovidov
584f1a83be Do not instrument 3rd-party libraries with UBSan 2020-11-06 20:52:28 +03:00
FawnD2
069e3dec0d Do not use deprecated API 2020-11-05 20:10:11 +03:00
FawnD2
4f82e95a46 Update submodule to the latest release 2020-11-05 19:49:11 +03:00
Anton Ivashkin
6f96cd04cc Update aws submodule, use version with patch for non-empty http path in urls 2020-11-05 15:53:40 +03:00
FawnD2
b0277e99a5 Update sources list 2020-11-04 19:51:43 +03:00
FawnD2
19f81e0f82 Update submodule sha 2020-11-04 15:51:10 +03:00
a.palagashvili
ba6fa5d828 fixed whitespaces, added hidden submodule file 2020-11-02 23:04:49 +03:00
a.palagashvili
805bfd286c resolved git modules 2020-11-02 15:16:49 +03:00
a.palagashvili
be2b002ff4 fixed cmake for building, added test for compression method, added basic code for encoding 2020-11-01 21:40:05 +03:00
a.palagashvili
c1abf5d13c *added adapters' boilerplate for Lzma buffers, *added submodule to gitmodules, *added cmake for xz 2020-11-01 02:56:41 +03:00
Alexander Kuzmenkov
ba34145817
Merge pull request #16425 from filimonov/minumum
Fix typos reported by codespell
2020-10-28 08:07:18 +03:00
Alexey Milovidov
eee81eef43 Remove dependency on "services" database 2020-10-28 01:58:53 +03:00
Mikhail Filimonov
41971e073a
Fix typos reported by codespell 2020-10-27 12:04:03 +01:00
sundy-li
f407504a7a try use cmake version for croaring instead of amalgamation.sh 2020-10-23 19:42:21 +08:00
Azat Khuzhin
f211d33841 Avoid creating separate replxx instance
This replxx object is pretty heavy and in debug build may slow down [1]
(although I cannot confirm 0.5s delay for each query in debug build) the
client and besides it is not required since ClickHouse-Extras/replxx#10,
which changes the behaviour of history_save(), and now it will not
update current session anymore, only save the history to the disk.

  [1]: https://github.com/ClickHouse/ClickHouse/pull/13086#issuecomment-667719026
2020-10-12 23:56:29 +03:00
alexey-milovidov
557002262f
Merge pull request #15828 from azat/unbundled-INTERFACE_COMPILE_DEFINITIONS
Fix INTERFACE_COMPILE_DEFINITIONS for IMPORTED targets
2020-10-11 19:28:18 +03:00
alexey-milovidov
2be4995a4e
Merge pull request #15815 from amosbird/h1
Fix undefined behavior in libhdfs3
2020-10-11 13:13:04 +03:00
Azat Khuzhin
c160b251ba Drop support for unbundled jemalloc
unbundled jemalloc cannot be used, since it includes jemalloc_cpp.o that
contains new/delete overrides, so as clickhouse [1]:

    ld.lld: error: duplicate symbol: operator delete(void*, unsigned long)
    >>> defined at new_delete.cpp:147 (../src/Common/new_delete.cpp:147)
    >>>            new_delete.cpp.o:(operator delete(void*, unsigned long)) in archive src/libclickhouse_new_delete.a
    >>> defined at jemalloc_cpp.o:(.text+0x160) in archive /usr/lib/x86_64-linux-gnu/libjemalloc.a

  [1]: https://clickhouse-builds.s3.yandex.net/15828/35335f07dbf8cab89b4188a674b033c28409dc7b/clickhouse_build_check/build_log_793952627_1602401325.txt
2020-10-11 11:18:56 +03:00
Azat Khuzhin
35335f07db Fix INTERFACE_COMPILE_DEFINITIONS for IMPORTED targets
INTERFACE_COMPILE_DEFINITIONS does not work IMPORTED targets:

From 3.6:

    Specify compile definitions to use when compiling a given <target>.
    The named <target> must have been created by a command such as
    add_executable() or add_library() and must not be an Imported Target.

Since 3.11:

    Specify compile definitions to use when compiling a given <target>.
    The named <target> must have been created by a command such as
    add_executable() or add_library() and must not be an ALIAS target.

And this causes the -Wundef warning:
    src/Functions/FunctionsHashing.h:1326:5: warning: 'USE_XXHASH' is not defined, evaluates to 0 [-Wundef]
2020-10-11 09:06:01 +03:00
alexey-milovidov
c2069ad3ee
Merge pull request #15035 from azat/jemalloc-percpu-arena-fix
Update jemalloc to fix percpu_arena with affinity mask
2020-10-10 23:19:56 +03:00
Amos Bird
d13cb2a48b
Fix undefined behavior in libhdfs3 2020-10-11 01:36:00 +08:00
alesapin
efaa7ad1d2 Update openssl 2020-10-09 12:31:01 +03:00
alesapin
4fbe925490
Merge pull request #15686 from ClickHouse/fix_race_mariadb
Fix race in mariadb
2020-10-08 09:42:41 +03:00
alesapin
d093d4c535
Merge pull request #15675 from ClickHouse/fix_races_in_hdfs
Fix races in libhdfs
2020-10-07 20:39:40 +03:00
alesapin
e00583cf2b Build with gcc-9 2020-10-07 11:27:29 +03:00
alesapin
8dbae0966b Apply strange fix for g++ 2020-10-07 10:51:57 +03:00
alesapin
d08909cc24 Update mariadb 2020-10-06 19:28:32 +03:00
alesapin
00f29e400f Fix race condition in hdfs 2020-10-06 16:29:08 +03:00
alesapin
585ca87001 Fix cmake 2020-10-06 14:26:27 +03:00
alesapin
c008555bc5 Trying to fix race in AMQP-CPP 2020-10-06 14:00:52 +03:00
Vitaly Baranov
dd634aa731
Merge pull request #15491 from vitlibar/update-grpc
Update gRPC to the latest version
2020-10-02 15:54:35 +03:00
alesapin
c5df9433f0
Merge pull request #15239 from ClickHouse/100_percent_lld_11_for_clang_11
Build ClickHouse for release with clang-11
2020-10-02 14:59:29 +03:00