Commit Graph

2062 Commits

Author SHA1 Message Date
Alexey Milovidov
1338f3daf8 Add missing files to libc-headers. 2021-10-11 07:44:12 +03:00
feng lv
e5857618d8 update poco 2021-10-11 04:12:04 +00:00
Alexey Milovidov
778793267b Add toolchain for linux-x86_64 2021-10-11 07:02:48 +03:00
Alexey Milovidov
8196f89481 Remove trash from CMake 2021-10-11 06:58:08 +03:00
Alexey Milovidov
fa3c13cf81 Experiment with minimized toolchain 2021-10-11 04:37:04 +03:00
mikael
5bd2fd0ba3 Add the missing bits for FreeBSD aarch64 2021-10-10 14:52:42 +02:00
mikael
714ac8efc4 FreeBSD aarch64 doesn't implement sbrk 2021-10-10 14:52:42 +02:00
alexey-milovidov
fbbc515a2f
Merge pull request #29925 from ClickHouse/update-cctz-2
Update CCTZ
2021-10-10 02:17:09 +03:00
Alexey Milovidov
f25fbe3740 Update CCTZ 2021-10-09 18:37:38 +03:00
feng lv
764b17787b update poco 2021-10-09 14:25:04 +00:00
feng lv
0e8d2f33d7 update poco 2021-10-09 10:51:10 +00:00
feng lv
aae07e1947 run test again 2021-10-09 10:34:57 +00:00
feng lv
ddf9e524cc test poco 2021-10-09 05:14:33 +00:00
Nikolai Kochetov
21bdc12b9c Pull libcxx 2021-10-08 21:38:12 +03:00
feng lv
1ea2323084 update poco 2021-10-05 06:40:00 +00:00
feng lv
873805d4da update poco
update

fix unbundled build
2021-10-04 13:55:49 +00:00
Denis Glazachev
7be521b024
Do not manipulate FOLDER property on INTERFACE library targets 2021-10-03 21:07:44 +04:00
Denis Glazachev
365a6b469e
Remove debug message 2021-10-03 20:30:20 +04:00
Denis Glazachev
ece880184b Reorganiza contrib IDE folders 2021-10-03 20:26:48 +04:00
Azat Khuzhin
42af45b2ba rocksdb: fix race condition during multiple DB opening
This should fix the following SIGSEGV, that was found on CI [1]:

    <Fatal> BaseDaemon: Address: NULL pointer. Access: read. Unknown si_code.
    <Fatal> BaseDaemon: 4.4. inlined from ../contrib/rocksdb/utilities/object_registry.cc:19: rocksdb::ObjectLibrary::FindEntry() const
    ...
    <Fatal> BaseDaemon: 7.3. inlined from ../contrib/rocksdb/options/cf_options.cc:678: rocksdb::$_7::operator()()

  [1]: https://clickhouse-test-reports.s3.yandex.net/29341/2b2bec3679df7965af908ce3f1e8e17e39bd12fe/integration_tests_flaky_check_(asan).html#fail1

And also I checked manually with TSan binary, and here is a data race
reported by TSan:

    WARNING: ThreadSanitizer: data race (pid=3356)
      Read of size 8 at 0x7b0c0008cca8 by thread T40:
        2 rocksdb::ObjectLibrary::FindEntry() const obj-x86_64-linux-gnu/../contrib/rocksdb/utilities/object_registry.cc:18:27 (clickhouse-tsan+0x1b839a6c)
        ...
        6 rocksdb::$_7::operator()() const obj-x86_64-linux-gnu/../contrib/rocksdb/options/cf_options.cc:676:32 (clickhouse-tsan+0x1b6bfa63)
        ...
        28 rocksdb::GetColumnFamilyOptionsFromMap() obj-x86_64-linux-gnu/../contrib/rocksdb/options/options_helper.cc:727:10 (clickhouse-tsan+0x1b6fffd2)
        29 DB::StorageEmbeddedRocksDB::initDb() obj-x86_64-linux-gnu/../src/Storages/RocksDB/StorageEmbeddedRocksDB.cpp:359:26 (clickhouse-tsan+0x14195e31)
        ...

      Previous write of size 8 at 0x7b0c0008cca8 by thread T41:
        ...
        9 rocksdb::ObjectLibrary::AddEntry() obj-x86_64-linux-gnu/../contrib/rocksdb/utilities/object_registry.cc:31:19 (clickhouse-tsan+0x1b8392fc)
        ...
        11 rocksdb::RegisterTableFactories()::$_0::operator()() const obj-x86_64-linux-gnu/../contrib/rocksdb/table/table_factory.cc:23:14 (clickhouse-tsan+0x1b7ea94c)
        ...
        43 rocksdb::GetColumnFamilyOptionsFromMap() obj-x86_64-linux-gnu/../contrib/rocksdb/options/options_helper.cc:727:10 (clickhouse-tsan+0x1b6fffd2)
        44 DB::StorageEmbeddedRocksDB::initDb() obj-x86_64-linux-gnu/../src/Storages/RocksDB/StorageEmbeddedRocksDB.cpp:359:26 (clickhouse-tsan+0x14195e31)

Refs: https://github.com/ClickHouse-Extras/rocksdb/pull/13
Fixes: #29341
2021-09-26 23:41:43 +03:00
Alexey Milovidov
6f65029daf Update libhdfs3 2021-09-25 02:54:18 +03:00
alexey-milovidov
60f76d9254
Merge pull request #28759 from nikitamikhaylov/enable-gcc-11
Switch CI to GCC-11
2021-09-12 15:56:57 +03:00
alexey-milovidov
ea13a8b562
Merge pull request #28659 from myrrc/improvement/tostring_to_magic_enum
Improving CH type system with concepts
2021-09-12 15:26:29 +03:00
Mike Kot
c4385a2c40 Simplifying exception messages 2021-09-11 00:40:18 +02:00
Nikita Mikhaylov
d7dafd6d2f Switch performance and merge contrib 2021-09-10 11:10:45 +00:00
mergify[bot]
937eeb9fed
Merge branch 'master' into enable-gcc-11 2021-09-09 22:44:10 +00:00
Maksim Kita
31766575e0
Merge pull request #28820 from azat/llvm-shared
Fix shared build with ENABLE_EMBEDDED_COMPILER
2021-09-10 00:49:18 +03:00
Nikita Mikhaylov
a796b9f039 Fix build 2021-09-09 21:17:22 +00:00
Azat Khuzhin
0d0c19c617 Fix RPATH for llvm in shared build
Before this patch:

    $ readelf -d contrib/llvm/llvm/bin/llvm-tblgen  | fgrep -i runpath
     0x000000000000001d (RUNPATH)            Library runpath: [$ORIGIN/../lib]

After:

    $ readelf -d contrib/llvm/llvm/bin/llvm-tblgen  | fgrep -i runpath
     0x000000000000001d (RUNPATH)            Library runpath: [/src/ch/clickhouse/.cmake/contrib/llvm/llvm/lib:/src/ch/clickhouse/.cmake/contrib/libcxx-cmake:/src/ch/clickhouse/.cmake/contrib/libcxxabi-cmake:/src/ch/clickhouse/.cmake/contrib/libunwind-cmake]
2021-09-09 22:41:27 +03:00
Azat Khuzhin
784d468f4b Include llvm from function to guard CMAKE_CXX_STANDARD scope 2021-09-09 22:41:26 +03:00
Nikita Mikhaylov
dcf7cb4a5c Done 2021-09-08 17:33:40 +00:00
Nikita Mikhaylov
474f34e78c Move back 2021-09-06 16:41:49 +00:00
Nikita Mikhaylov
a327144d40 Better 2021-09-06 16:39:46 +00:00
Nikita Mikhaylov
29a18d8d10 Try to fix unbundled 2021-09-06 15:58:08 +00:00
Nikita Mikhaylov
7c39f84a5e Merge upstream/master into global-merge-executor (using imerge) 2021-09-06 15:37:18 +00:00
Mike Kot
8e9aacadd1 Initial: replacing hardcoded toString for enums with magic_enum 2021-09-06 16:24:03 +02:00
Nikita Mikhaylov
0249015515 added priority queue 2021-09-06 11:37:51 +00:00
alesapin
36a11af351 Merge branch 'master' into add_test_logs_level 2021-09-04 15:48:47 +03:00
Nikita Mikhaylov
3eec8a3c2f Use boost::circular_buffer 2021-09-03 22:15:20 +00:00
Maksim Kita
5112b6e00d
Merge pull request #28537 from azat/bump-poco-remove-getpid
Bump poco to remove getpid() calls
2021-09-03 22:03:12 +03:00
Kseniia Sumarokova
8c5acc371a
Merge pull request #28365 from kssenii/rabbitmq-ssl
Allow ssl connection for rabbitmq
2021-09-03 16:53:28 +03:00
alesapin
497c225203 Test log level for CI 2021-09-03 13:07:40 +03:00
Azat Khuzhin
5bab06ed90 Bump poco to remove getpid() calls
Refs: https://github.com/ClickHouse-Extras/poco/pull/46
2021-09-03 07:45:58 +03:00
Nikita Mikhaylov
7e936c248f contrib/aws/ 2021-08-31 12:54:45 +00:00
kssenii
335b6f12fd Fix 2021-08-30 20:59:03 +03:00
Kseniia Sumarokova
31afd7d09c
Merge pull request #28081 from kssenii/pg-conflict
Support `on conflict` for postgres engine
2021-08-26 16:30:30 +03:00
mergify[bot]
9520ceba7e
Merge branch 'master' into update-libunwind-protect-from-wrong-cfa-expressions 2021-08-24 20:45:38 +00:00
Maksim Kita
0486d1bd37
Merge pull request #28084 from kssenii/nanodbc-update
Update nanodbc
2021-08-24 21:39:10 +03:00
Maksim Kita
027728a7a5 Updated libunwind to protect from wrong CFA expressions 2021-08-24 21:36:45 +03:00
kssenii
c467178a93 Update nanodbc 2021-08-24 12:50:07 +00:00
kssenii
0ec716292c Postgres ON CONFLICT 2021-08-24 12:37:32 +00:00
Azat Khuzhin
67a3ce1891 Bump replxx
Refs: https://github.com/ClickHouse-Extras/replxx/pull/17
2021-08-23 22:27:54 +03:00
alexey-milovidov
fa2a2817c9
Merge pull request #27883 from azat/bump-librdkafka-to-fix-TSan
Bump librdkafka (fixes use of an invalid/destroyed mutex)
2021-08-20 09:03:02 +03:00
Azat Khuzhin
941eba908c Bump librdkafka (to fix metadata cache destroying)
This should fix CI under TSan [1].

  [1]: https://clickhouse-test-reports.s3.yandex.net/0/9292869c4f92664a28b8c9ddef1e62ddfd13b285/integration_tests_(thread).html

Refs: edenhill/librdkafka#3279
2021-08-19 21:38:06 +03:00
Azat Khuzhin
6a600e5f6f jemalloc: fix under osx (zone_register() had been optimized out again)
v2: use ld -u
v3: move -u to executable
2021-08-18 09:47:59 +03:00
Azat Khuzhin
342c3fae3a Revert "Disable jemalloc under OSX" (only jemalloc hunk)
This reverts commit f062aa8574.
2021-08-18 09:47:59 +03:00
alexey-milovidov
67b2f49c8a
Merge pull request #27751 from Algunenano/osx_jemalloc
Disable jemalloc under OSX
2021-08-17 04:45:43 +03:00
Raúl Marín
f062aa8574 Disable jemalloc under OSX 2021-08-16 18:04:46 +02:00
taiyang-li
d417bd3247 remove duplicated source files in arrow-cmake 2021-08-16 18:56:14 +08:00
alexey-milovidov
135a5a2453
Merge pull request #27683 from ClickHouse/unbundled-sse2
Use only SSE2 in "unbundled" build
2021-08-15 13:25:44 +03:00
Alexey Milovidov
ba0ba988ba Fix build 2021-08-15 11:21:46 +03:00
Alexey Milovidov
cf87dacd4e Disable memory tracking for roaring bitmaps on Mac OS 2021-08-15 09:01:04 +03:00
Raúl Marín
61c4d94f1e Add explicit dependency between roaring and clickhouse_common_io
Fixes roaring memory tracker for split builds
2021-08-11 11:21:39 +02:00
Alexey Milovidov
3449e611fd Allow to build with AVX2 2021-08-10 03:46:03 +03:00
mergify[bot]
8d05b7c5e5
Merge branch 'master' into roaring-memory-tracker 2021-08-08 15:19:57 +00:00
alexey-milovidov
e6e9a27d8f
Merge pull request #27377 from evillique/bz2
Add support for bzip2 compression method
2021-08-08 04:40:13 +03:00
Alexey Milovidov
e7afb7e159 Merge branch 'master' into roaring-memory-tracker 2021-08-08 04:33:33 +03:00
alexey-milovidov
b8f4d480a3
Merge pull request #27081 from ClickHouse/fix_logs_in_nuraft
Fix excessive logging in NuRaft on server shutdown
2021-08-07 19:48:53 +03:00
Alexey Milovidov
161aa40206 Fix build; add comments 2021-08-07 19:30:59 +03:00
Alexey Milovidov
c9d66defa0 Merge branch 'master' into roaring-memory-tracker 2021-08-07 19:01:31 +03:00
Nikolay Degterinsky
c6a6bc8b1a Add submodule bzip2 2021-08-07 06:18:14 +00:00
Nikolay Degterinsky
9a45458faf Add bzip2 file compression 2021-08-07 00:25:52 +00:00
Yatsishin Ilya
2742128429 Try update contrib/zlib-ng 2021-08-06 18:03:05 +03:00
Alexey Milovidov
bd776e432f Advancements 2021-08-05 23:36:46 +03:00
Alexey Milovidov
7fa700de00 Merge branch 'master' into roaring-memory-tracker 2021-08-05 22:17:10 +03:00
Ilya Yatsishin
553fed9ad5
Merge pull request #27095 from qoega/amqp-cpp-update 2021-08-04 19:48:52 +03:00
Yatsishin Ilya
019a221550 fix unbundled build 2021-08-03 17:29:59 +03:00
Yatsishin Ilya
06903485d7 Fix build on freebsd 2021-08-03 14:38:29 +03:00
Yatsishin Ilya
7ad4a42003 upadte CMakeLists 2021-08-03 11:27:23 +03:00
Yatsishin Ilya
d6844facaf one more fix 2021-08-03 11:01:01 +03:00
Yatsishin Ilya
31d027b8d0 Try update arrow 2021-08-02 19:33:15 +03:00
Yatsishin Ilya
c645dc9d7d fix 2021-08-02 19:23:13 +03:00
Yatsishin Ilya
7a2e711765 Try update AMQP-CPP 2021-08-02 17:48:53 +03:00
alesapin
f3e0f648d0 Fixup 2021-08-02 15:00:05 +03:00
alesapin
53c3a4fbc6 Fix excessive logging in NuRaft on server shutdown 2021-08-02 14:57:51 +03:00
alesapin
181f93c60a
Merge pull request #24997 from evillique/nlp
NLP functions
2021-08-02 10:50:40 +03:00
mergify[bot]
534b117ee1
Merge branch 'master' into protobuf-3.17.3 2021-07-30 14:11:32 +00:00
alesapin
4746002776 Add an ability to build ClickHouse without NLP functions 2021-07-30 16:30:30 +03:00
alesapin
916594fe23 Merge branch 'master' into evillique-nlp 2021-07-30 13:03:10 +03:00
alesapin
6472ac8a26 Followup 2021-07-29 14:18:44 +03:00
alesapin
3654627cb9 Fix build 2021-07-29 14:12:46 +03:00
alesapin
32012eea6a Update NuRaft 2021-07-28 19:07:55 +03:00
Yatsishin Ilya
1af7650622 Try update protobuf to 3.17.3 2021-07-26 09:49:00 +00:00
Alexey Milovidov
bd364aeea1 Fix double unlock in RocksDB 2021-07-25 22:52:46 +03:00
Alexey Milovidov
2df3e14559 Attempt to add memory tracking to RoaringBitmaps 2021-07-22 02:56:17 +03:00
Nikita Mikhaylov
234b03304f done 2021-07-19 17:47:24 +03:00
Alexey Milovidov
73bed2f078 Update RocksDB to master 2021-07-16 15:38:16 +03:00
Azat Khuzhin
61d6e30ffa Make socket poll() 7x faster (by replacing epoll() with poll()) 2021-07-14 21:22:23 +03:00
Azat Khuzhin
c481142720 Bump poco (now poco fork has CI via github actions) 2021-07-13 23:34:52 +03:00
Nikita Mikhaylov
625576796c final fix 2021-07-13 10:51:35 +00:00