Commit Graph

2157 Commits

Author SHA1 Message Date
feng lv
1e3df5780c Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into filelog-engine 2021-10-18 07:33:11 +00:00
Denis Glazachev
9de534f96c Revert special contribs and set folder manually for them until fixed 2021-10-17 23:10:01 +03:00
Denis Glazachev
68a08ffed9
Merge branch 'master' into reorganiza-contrib-ide-folders 2021-10-17 22:13:11 +04:00
Amos Bird
b034c913db
update 2021-10-17 10:41:51 +08:00
Alexey Milovidov
5fc2279adf Add RISC-V build 2021-10-17 01:23:55 +03:00
alexey-milovidov
e9af03ef52
Merge pull request #30248 from ClickHouse/musl-4
Preparation to build with Musl
2021-10-16 18:44:35 +03:00
Nikita Mikhaylov
6b22fdc55a
Merge pull request #30012 from PaulCher/codegen_select_fuzzer_v1
Codegen select fuzzer v1
2021-10-16 14:08:08 +03:00
feng lv
8b7721ae6f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into filelog-engine 2021-10-16 05:14:11 +00:00
Alexey Milovidov
e7d99c3e54 Update submodule 2021-10-16 03:09:38 +03:00
Alexey Milovidov
438d04795e Update toolchain 2021-10-16 03:03:46 +03:00
Alexey Milovidov
41acc52458 Preparation to build with Musl 2021-10-16 00:17:34 +03:00
mergify[bot]
6bf8c4a2b1
Merge branch 'master' into reorganiza-contrib-ide-folders 2021-10-15 19:59:08 +00:00
Nikita Mikhaylov
e9bf496d42 Added an ability to generate data in build time 2021-10-15 14:35:50 +00:00
Artur Filatenkov
f69daace7b attemp to fix build 2021-10-15 16:01:28 +03:00
Artur Filatenkov
74e3978110 commit assert to fix build 2021-10-14 22:55:17 +03:00
Kruglov Pavel
dd4421d4b1 Fix build 2021-10-14 16:43:23 +03:00
avogar
5d16dc7f9a Try to fix tests, update capnp lib to eliminate problem with UB sanitizer 2021-10-14 16:43:23 +03:00
feng lv
21f7ecbd9f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into filelog-engine 2021-10-14 02:09:51 +00:00
Artur Filatenkov
3c82fb756c Merge branch 'Check' of https://github.com/FArthur-cmd/ClickHouse into Check 2021-10-13 20:19:16 +03:00
Artur Filatenkov
91084895ce attemp to fix build 2021-10-13 20:18:51 +03:00
Amos Bird
8851cb8459
Use upstream replxx 2021-10-14 00:52:53 +08:00
Filatenkov Artur
5348cd5bd4
Merge branch 'ClickHouse:master' into Check 2021-10-13 16:15:56 +03:00
Nikita Mikhaylov
57a623aba0
Merge branch 'master' into codegen_select_fuzzer_v1 2021-10-13 16:01:40 +03:00
Artur Filatenkov
7cef607cb9 move on merge branch 2021-10-13 15:01:07 +03:00
Alexey Milovidov
4d5b793f2b Update submodule 2021-10-12 22:22:49 +03:00
feng lv
b2a17cb320 fix build and conflict 2021-10-12 16:50:50 +00:00
alexey-milovidov
e63506fde7
Merge branch 'master' into protobuf-host-build 2021-10-12 16:19:15 +03:00
Alexey Milovidov
3a8e65f01e Another try 2021-10-12 06:28:05 +03:00
Alexey Milovidov
5ba876cad2 Build protoc for host architecture during cross-compilation 2021-10-12 05:46:19 +03:00
Pavel Cheremushkin
7b9358a597 adding codegen fuzzer + code generation script. new contrib added: libprotobuf-mutator 2021-10-12 03:21:31 +03:00
Alexey Milovidov
fa14dbdf42 Update submodules 2021-10-12 02:03:00 +03:00
Alexey Milovidov
0c6c716bdd Update submodule 2021-10-12 01:49:29 +03:00
Alexey Milovidov
d4e496c314 Add support for PowerPC build 2021-10-12 01:47:57 +03:00
alexey-milovidov
f1b550cdaf
Merge pull request #29974 from ClickHouse/minimized-toolchain
Experiment with minimized toolchain (2)
2021-10-11 22:04:01 +03:00
Artur Filatenkov
0d1fcdf9fc add submodule update 2021-10-11 15:08:40 +03:00
Artur Filatenkov
351f2a3a84 Update BorinSSL 2021-10-11 14:53:26 +03:00
alexey-milovidov
3b8d7a5030
Merge pull request #29952 from MikaelUrankar/freebsd-aarch64
Add support for FreeBSD aarch64
2021-10-11 14:43:23 +03:00
Alexey Milovidov
e24be8dfb0 Update submodule 2021-10-11 14:41:49 +03:00
Alexey Milovidov
e0a4fb31a9 Update submodules to simplify cross build 2021-10-11 14:34:05 +03:00
feng lv
a57e97d2e0 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into filelog-engine 2021-10-11 06:09:43 +00:00
Alexey Milovidov
e7d3ead754 Fix error 2021-10-11 08:52:41 +03:00
Alexey Milovidov
264b278e1e Fix error 2021-10-11 08:29:50 +03:00
Alexey Milovidov
31e9214e43 Fix error 2021-10-11 07:52:05 +03:00
Alexey Milovidov
0ec1f3bd3f Fix error 2021-10-11 07:48:41 +03:00
Alexey Milovidov
c581a40a36 Update sysroot 2021-10-11 07:46:08 +03:00
Alexey Milovidov
1338f3daf8 Add missing files to libc-headers. 2021-10-11 07:44:12 +03:00
feng lv
e5857618d8 update poco 2021-10-11 04:12:04 +00:00
Alexey Milovidov
778793267b Add toolchain for linux-x86_64 2021-10-11 07:02:48 +03:00
Alexey Milovidov
8196f89481 Remove trash from CMake 2021-10-11 06:58:08 +03:00
Alexey Milovidov
fa3c13cf81 Experiment with minimized toolchain 2021-10-11 04:37:04 +03:00
mikael
5bd2fd0ba3 Add the missing bits for FreeBSD aarch64 2021-10-10 14:52:42 +02:00
mikael
714ac8efc4 FreeBSD aarch64 doesn't implement sbrk 2021-10-10 14:52:42 +02:00
alexey-milovidov
fbbc515a2f
Merge pull request #29925 from ClickHouse/update-cctz-2
Update CCTZ
2021-10-10 02:17:09 +03:00
Alexey Milovidov
f25fbe3740 Update CCTZ 2021-10-09 18:37:38 +03:00
feng lv
764b17787b update poco 2021-10-09 14:25:04 +00:00
feng lv
0e8d2f33d7 update poco 2021-10-09 10:51:10 +00:00
feng lv
aae07e1947 run test again 2021-10-09 10:34:57 +00:00
feng lv
ddf9e524cc test poco 2021-10-09 05:14:33 +00:00
Nikolai Kochetov
21bdc12b9c Pull libcxx 2021-10-08 21:38:12 +03:00
feng lv
1ea2323084 update poco 2021-10-05 06:40:00 +00:00
feng lv
873805d4da update poco
update

fix unbundled build
2021-10-04 13:55:49 +00:00
Denis Glazachev
7be521b024
Do not manipulate FOLDER property on INTERFACE library targets 2021-10-03 21:07:44 +04:00
Denis Glazachev
365a6b469e
Remove debug message 2021-10-03 20:30:20 +04:00
Denis Glazachev
ece880184b Reorganiza contrib IDE folders 2021-10-03 20:26:48 +04:00
Azat Khuzhin
42af45b2ba rocksdb: fix race condition during multiple DB opening
This should fix the following SIGSEGV, that was found on CI [1]:

    <Fatal> BaseDaemon: Address: NULL pointer. Access: read. Unknown si_code.
    <Fatal> BaseDaemon: 4.4. inlined from ../contrib/rocksdb/utilities/object_registry.cc:19: rocksdb::ObjectLibrary::FindEntry() const
    ...
    <Fatal> BaseDaemon: 7.3. inlined from ../contrib/rocksdb/options/cf_options.cc:678: rocksdb::$_7::operator()()

  [1]: https://clickhouse-test-reports.s3.yandex.net/29341/2b2bec3679df7965af908ce3f1e8e17e39bd12fe/integration_tests_flaky_check_(asan).html#fail1

And also I checked manually with TSan binary, and here is a data race
reported by TSan:

    WARNING: ThreadSanitizer: data race (pid=3356)
      Read of size 8 at 0x7b0c0008cca8 by thread T40:
        2 rocksdb::ObjectLibrary::FindEntry() const obj-x86_64-linux-gnu/../contrib/rocksdb/utilities/object_registry.cc:18:27 (clickhouse-tsan+0x1b839a6c)
        ...
        6 rocksdb::$_7::operator()() const obj-x86_64-linux-gnu/../contrib/rocksdb/options/cf_options.cc:676:32 (clickhouse-tsan+0x1b6bfa63)
        ...
        28 rocksdb::GetColumnFamilyOptionsFromMap() obj-x86_64-linux-gnu/../contrib/rocksdb/options/options_helper.cc:727:10 (clickhouse-tsan+0x1b6fffd2)
        29 DB::StorageEmbeddedRocksDB::initDb() obj-x86_64-linux-gnu/../src/Storages/RocksDB/StorageEmbeddedRocksDB.cpp:359:26 (clickhouse-tsan+0x14195e31)
        ...

      Previous write of size 8 at 0x7b0c0008cca8 by thread T41:
        ...
        9 rocksdb::ObjectLibrary::AddEntry() obj-x86_64-linux-gnu/../contrib/rocksdb/utilities/object_registry.cc:31:19 (clickhouse-tsan+0x1b8392fc)
        ...
        11 rocksdb::RegisterTableFactories()::$_0::operator()() const obj-x86_64-linux-gnu/../contrib/rocksdb/table/table_factory.cc:23:14 (clickhouse-tsan+0x1b7ea94c)
        ...
        43 rocksdb::GetColumnFamilyOptionsFromMap() obj-x86_64-linux-gnu/../contrib/rocksdb/options/options_helper.cc:727:10 (clickhouse-tsan+0x1b6fffd2)
        44 DB::StorageEmbeddedRocksDB::initDb() obj-x86_64-linux-gnu/../src/Storages/RocksDB/StorageEmbeddedRocksDB.cpp:359:26 (clickhouse-tsan+0x14195e31)

Refs: https://github.com/ClickHouse-Extras/rocksdb/pull/13
Fixes: #29341
2021-09-26 23:41:43 +03:00
Alexey Milovidov
6f65029daf Update libhdfs3 2021-09-25 02:54:18 +03:00
alexey-milovidov
60f76d9254
Merge pull request #28759 from nikitamikhaylov/enable-gcc-11
Switch CI to GCC-11
2021-09-12 15:56:57 +03:00
alexey-milovidov
ea13a8b562
Merge pull request #28659 from myrrc/improvement/tostring_to_magic_enum
Improving CH type system with concepts
2021-09-12 15:26:29 +03:00
Mike Kot
c4385a2c40 Simplifying exception messages 2021-09-11 00:40:18 +02:00
Nikita Mikhaylov
d7dafd6d2f Switch performance and merge contrib 2021-09-10 11:10:45 +00:00
mergify[bot]
937eeb9fed
Merge branch 'master' into enable-gcc-11 2021-09-09 22:44:10 +00:00
Maksim Kita
31766575e0
Merge pull request #28820 from azat/llvm-shared
Fix shared build with ENABLE_EMBEDDED_COMPILER
2021-09-10 00:49:18 +03:00
Nikita Mikhaylov
a796b9f039 Fix build 2021-09-09 21:17:22 +00:00
Azat Khuzhin
0d0c19c617 Fix RPATH for llvm in shared build
Before this patch:

    $ readelf -d contrib/llvm/llvm/bin/llvm-tblgen  | fgrep -i runpath
     0x000000000000001d (RUNPATH)            Library runpath: [$ORIGIN/../lib]

After:

    $ readelf -d contrib/llvm/llvm/bin/llvm-tblgen  | fgrep -i runpath
     0x000000000000001d (RUNPATH)            Library runpath: [/src/ch/clickhouse/.cmake/contrib/llvm/llvm/lib:/src/ch/clickhouse/.cmake/contrib/libcxx-cmake:/src/ch/clickhouse/.cmake/contrib/libcxxabi-cmake:/src/ch/clickhouse/.cmake/contrib/libunwind-cmake]
2021-09-09 22:41:27 +03:00
Azat Khuzhin
784d468f4b Include llvm from function to guard CMAKE_CXX_STANDARD scope 2021-09-09 22:41:26 +03:00
Nikita Mikhaylov
dcf7cb4a5c Done 2021-09-08 17:33:40 +00:00
Nikita Mikhaylov
474f34e78c Move back 2021-09-06 16:41:49 +00:00
Nikita Mikhaylov
a327144d40 Better 2021-09-06 16:39:46 +00:00
Nikita Mikhaylov
29a18d8d10 Try to fix unbundled 2021-09-06 15:58:08 +00:00
Nikita Mikhaylov
7c39f84a5e Merge upstream/master into global-merge-executor (using imerge) 2021-09-06 15:37:18 +00:00
Mike Kot
8e9aacadd1 Initial: replacing hardcoded toString for enums with magic_enum 2021-09-06 16:24:03 +02:00
Nikita Mikhaylov
0249015515 added priority queue 2021-09-06 11:37:51 +00:00
alesapin
36a11af351 Merge branch 'master' into add_test_logs_level 2021-09-04 15:48:47 +03:00
Nikita Mikhaylov
3eec8a3c2f Use boost::circular_buffer 2021-09-03 22:15:20 +00:00
Maksim Kita
5112b6e00d
Merge pull request #28537 from azat/bump-poco-remove-getpid
Bump poco to remove getpid() calls
2021-09-03 22:03:12 +03:00
Kseniia Sumarokova
8c5acc371a
Merge pull request #28365 from kssenii/rabbitmq-ssl
Allow ssl connection for rabbitmq
2021-09-03 16:53:28 +03:00
alesapin
497c225203 Test log level for CI 2021-09-03 13:07:40 +03:00
Azat Khuzhin
5bab06ed90 Bump poco to remove getpid() calls
Refs: https://github.com/ClickHouse-Extras/poco/pull/46
2021-09-03 07:45:58 +03:00
Nikita Mikhaylov
7e936c248f contrib/aws/ 2021-08-31 12:54:45 +00:00
kssenii
335b6f12fd Fix 2021-08-30 20:59:03 +03:00
Kseniia Sumarokova
31afd7d09c
Merge pull request #28081 from kssenii/pg-conflict
Support `on conflict` for postgres engine
2021-08-26 16:30:30 +03:00
mergify[bot]
9520ceba7e
Merge branch 'master' into update-libunwind-protect-from-wrong-cfa-expressions 2021-08-24 20:45:38 +00:00
Maksim Kita
0486d1bd37
Merge pull request #28084 from kssenii/nanodbc-update
Update nanodbc
2021-08-24 21:39:10 +03:00
Maksim Kita
027728a7a5 Updated libunwind to protect from wrong CFA expressions 2021-08-24 21:36:45 +03:00
kssenii
c467178a93 Update nanodbc 2021-08-24 12:50:07 +00:00
kssenii
0ec716292c Postgres ON CONFLICT 2021-08-24 12:37:32 +00:00
Azat Khuzhin
67a3ce1891 Bump replxx
Refs: https://github.com/ClickHouse-Extras/replxx/pull/17
2021-08-23 22:27:54 +03:00
alexey-milovidov
fa2a2817c9
Merge pull request #27883 from azat/bump-librdkafka-to-fix-TSan
Bump librdkafka (fixes use of an invalid/destroyed mutex)
2021-08-20 09:03:02 +03:00
Azat Khuzhin
941eba908c Bump librdkafka (to fix metadata cache destroying)
This should fix CI under TSan [1].

  [1]: https://clickhouse-test-reports.s3.yandex.net/0/9292869c4f92664a28b8c9ddef1e62ddfd13b285/integration_tests_(thread).html

Refs: edenhill/librdkafka#3279
2021-08-19 21:38:06 +03:00
Azat Khuzhin
6a600e5f6f jemalloc: fix under osx (zone_register() had been optimized out again)
v2: use ld -u
v3: move -u to executable
2021-08-18 09:47:59 +03:00
Azat Khuzhin
342c3fae3a Revert "Disable jemalloc under OSX" (only jemalloc hunk)
This reverts commit f062aa8574.
2021-08-18 09:47:59 +03:00
alexey-milovidov
67b2f49c8a
Merge pull request #27751 from Algunenano/osx_jemalloc
Disable jemalloc under OSX
2021-08-17 04:45:43 +03:00
Raúl Marín
f062aa8574 Disable jemalloc under OSX 2021-08-16 18:04:46 +02:00
taiyang-li
d417bd3247 remove duplicated source files in arrow-cmake 2021-08-16 18:56:14 +08:00
alexey-milovidov
135a5a2453
Merge pull request #27683 from ClickHouse/unbundled-sse2
Use only SSE2 in "unbundled" build
2021-08-15 13:25:44 +03:00
Alexey Milovidov
ba0ba988ba Fix build 2021-08-15 11:21:46 +03:00
Alexey Milovidov
cf87dacd4e Disable memory tracking for roaring bitmaps on Mac OS 2021-08-15 09:01:04 +03:00
Raúl Marín
61c4d94f1e Add explicit dependency between roaring and clickhouse_common_io
Fixes roaring memory tracker for split builds
2021-08-11 11:21:39 +02:00
Alexey Milovidov
3449e611fd Allow to build with AVX2 2021-08-10 03:46:03 +03:00
mergify[bot]
8d05b7c5e5
Merge branch 'master' into roaring-memory-tracker 2021-08-08 15:19:57 +00:00
alexey-milovidov
e6e9a27d8f
Merge pull request #27377 from evillique/bz2
Add support for bzip2 compression method
2021-08-08 04:40:13 +03:00
Alexey Milovidov
e7afb7e159 Merge branch 'master' into roaring-memory-tracker 2021-08-08 04:33:33 +03:00
alexey-milovidov
b8f4d480a3
Merge pull request #27081 from ClickHouse/fix_logs_in_nuraft
Fix excessive logging in NuRaft on server shutdown
2021-08-07 19:48:53 +03:00
Alexey Milovidov
161aa40206 Fix build; add comments 2021-08-07 19:30:59 +03:00
Alexey Milovidov
c9d66defa0 Merge branch 'master' into roaring-memory-tracker 2021-08-07 19:01:31 +03:00
Nikolay Degterinsky
c6a6bc8b1a Add submodule bzip2 2021-08-07 06:18:14 +00:00
Nikolay Degterinsky
9a45458faf Add bzip2 file compression 2021-08-07 00:25:52 +00:00
Yatsishin Ilya
2742128429 Try update contrib/zlib-ng 2021-08-06 18:03:05 +03:00
Alexey Milovidov
bd776e432f Advancements 2021-08-05 23:36:46 +03:00
Alexey Milovidov
7fa700de00 Merge branch 'master' into roaring-memory-tracker 2021-08-05 22:17:10 +03:00
Ilya Yatsishin
553fed9ad5
Merge pull request #27095 from qoega/amqp-cpp-update 2021-08-04 19:48:52 +03:00
Yatsishin Ilya
019a221550 fix unbundled build 2021-08-03 17:29:59 +03:00
Yatsishin Ilya
06903485d7 Fix build on freebsd 2021-08-03 14:38:29 +03:00
Yatsishin Ilya
7ad4a42003 upadte CMakeLists 2021-08-03 11:27:23 +03:00
Yatsishin Ilya
d6844facaf one more fix 2021-08-03 11:01:01 +03:00
Yatsishin Ilya
31d027b8d0 Try update arrow 2021-08-02 19:33:15 +03:00
Yatsishin Ilya
c645dc9d7d fix 2021-08-02 19:23:13 +03:00
Yatsishin Ilya
7a2e711765 Try update AMQP-CPP 2021-08-02 17:48:53 +03:00
alesapin
f3e0f648d0 Fixup 2021-08-02 15:00:05 +03:00
alesapin
53c3a4fbc6 Fix excessive logging in NuRaft on server shutdown 2021-08-02 14:57:51 +03:00
alesapin
181f93c60a
Merge pull request #24997 from evillique/nlp
NLP functions
2021-08-02 10:50:40 +03:00
mergify[bot]
534b117ee1
Merge branch 'master' into protobuf-3.17.3 2021-07-30 14:11:32 +00:00
alesapin
4746002776 Add an ability to build ClickHouse without NLP functions 2021-07-30 16:30:30 +03:00
alesapin
916594fe23 Merge branch 'master' into evillique-nlp 2021-07-30 13:03:10 +03:00
alesapin
6472ac8a26 Followup 2021-07-29 14:18:44 +03:00
alesapin
3654627cb9 Fix build 2021-07-29 14:12:46 +03:00
alesapin
32012eea6a Update NuRaft 2021-07-28 19:07:55 +03:00
Yatsishin Ilya
1af7650622 Try update protobuf to 3.17.3 2021-07-26 09:49:00 +00:00
Alexey Milovidov
bd364aeea1 Fix double unlock in RocksDB 2021-07-25 22:52:46 +03:00
Alexey Milovidov
2df3e14559 Attempt to add memory tracking to RoaringBitmaps 2021-07-22 02:56:17 +03:00
Nikita Mikhaylov
234b03304f done 2021-07-19 17:47:24 +03:00
Alexey Milovidov
73bed2f078 Update RocksDB to master 2021-07-16 15:38:16 +03:00
Azat Khuzhin
61d6e30ffa Make socket poll() 7x faster (by replacing epoll() with poll()) 2021-07-14 21:22:23 +03:00
Azat Khuzhin
c481142720 Bump poco (now poco fork has CI via github actions) 2021-07-13 23:34:52 +03:00
Nikita Mikhaylov
625576796c final fix 2021-07-13 10:51:35 +00:00
Nikita Mikhaylov
1d079eb745 fix submodule 2021-07-13 10:50:38 +00:00
Nikita Mikhaylov
926380e7a7 fix fast test build 2021-07-13 10:50:38 +00:00
Nikita Mikhaylov
3d97f91c1b fix build 2021-07-13 10:50:12 +00:00
Nikita Mikhaylov
6cdac2a56f link error 2021-07-13 10:50:12 +00:00
Nikita Mikhaylov
3f36a93656 better 2021-07-13 10:50:12 +00:00