Commit Graph

2193 Commits

Author SHA1 Message Date
Alexey Milovidov
046af7295f Fix build on AArch64 2021-11-21 14:37:34 +03:00
Alexey Milovidov
6246cec409 Fix build on AArch64 2021-11-21 14:30:04 +03:00
Alexey Milovidov
258fcc917f Fix build 2021-11-21 14:09:05 +03:00
Alexey Milovidov
d604cf5573 Remove the infamous "unbundled" build 2021-11-21 13:58:26 +03:00
Alexey Milovidov
9a82c62685 Merge branch 'master' into zlib-ng-own-cmake 2021-11-21 11:38:29 +03:00
Nikolay Degterinsky
ddef6d86ca Minor fixes 2021-11-16 23:02:47 +00:00
Nikolay Degterinsky
2ae79233e4 Better 2021-11-16 23:02:47 +00:00
Nikolay Degterinsky
b3b061eeb9 Update Poco 2021-11-16 23:02:46 +00:00
Nikolay Degterinsky
eafd3ddfac Add lz4 stream compression 2021-11-16 22:30:29 +00:00
Vladimir Smirnov
48451182f8 Initial support for risc-v
Make ClickHouse compilable and runnable on risc-v 64

So far only basic functionality was tested (on real hw),
clickhouse server runs, exceptions works, client works,
simple tests works.

What doesn't work:
 1. traces - they are always empty
 2. system.stack_trace only have first frame
2021-11-11 19:23:34 +01:00
avogar
f2652051e3 Fix assert in hdfs, add test 2021-11-03 12:53:33 +03:00
taiyang-li
45676e4334 update version of snappy 2021-11-01 11:18:59 +08:00
alesapin
fc19a06a99
Merge pull request #30646 from ianton-ru/MDB-14537-2
Retry on Yandex.S3 throttle
2021-10-27 11:18:38 +03:00
Nikita Mikhaylov
aae30a9e37
Fix fuzzer build (#30344) 2021-10-26 20:30:34 +03:00
mergify[bot]
1843f6504a
Merge branch 'master' into MDB-14537-2 2021-10-26 10:47:39 +00:00
alesapin
0e4925584b Revert "Fix style regressions on benchmark page (#30506)"
This reverts commit 5ddccabef0.
2021-10-25 20:02:35 +03:00
Cody Baker
5ddccabef0
Fix style regressions on benchmark page (#30506)
* Update styles on benchmark page

* Update h3 -> h2
2021-10-25 17:53:13 +03:00
Anton Ivashkin
55e887728e Retry on Yandex.S3 throttle 2021-10-25 17:34:59 +03:00
alesapin
aca3166a7c
Merge pull request #30550 from ClickHouse/fix_typo_update_nuraft
Fix typo and update NuRaft
2021-10-25 10:36:06 +03:00
Alexey Milovidov
de7919555e Cut away some trash 2021-10-25 02:33:08 +03:00
Alexey Milovidov
a06a54e411 Fix build 2021-10-25 01:05:12 +03:00
Alexey Milovidov
de9accff4c Fix build 2021-10-24 23:44:35 +03:00
Alexey Milovidov
9180329850 Fix build 2021-10-24 12:06:59 +03:00
Alexey Milovidov
4af0c08b02 Fix build 2021-10-24 11:28:09 +03:00
Alexey Milovidov
70f2b976f2 Fix build 2021-10-24 10:10:34 +03:00
Alexey Milovidov
f6e7be8601 Fix build 2021-10-24 09:05:30 +03:00
Alexey Milovidov
f9635840ea Fix build 2021-10-24 07:35:19 +03:00
Alexey Milovidov
ed09496593 Our own CMakeLists for Cassandra (half-baked) 2021-10-24 06:35:01 +03:00
Alexey Milovidov
34f63a37a4 Our own CMakeLists for MariaDB (half-baked) 2021-10-24 04:36:30 +03:00
Alexey Milovidov
c4859ef409 Use our own CMakeLists for zlib-ng 2021-10-24 01:51:05 +03:00
alesapin
d849f56cd4 Fix typo and update NuRaft 2021-10-22 11:24:18 +03:00
feng lv
6565e1d4b2 fix conflict 2021-10-20 15:22:16 +00:00
mergify[bot]
506c05a520
Merge branch 'master' into reorganiza-contrib-ide-folders 2021-10-19 15:32:57 +00:00
Maksim Kita
0b3926950d
Merge pull request #30143 from amosbird/useupstreamreplxx
Use upstream replxx
2021-10-19 17:50:43 +03:00
feng lv
05fd6f7caf fix comflict 2021-10-19 12:50:22 +00:00
Kruglov Pavel
1e2ceeb2e7
Merge pull request #29291 from Avogar/capnproto
Add CapnProto output format, refactor CapnProto input format
2021-10-19 11:54:55 +03:00
feng lv
1e3df5780c Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into filelog-engine 2021-10-18 07:33:11 +00:00
Denis Glazachev
9de534f96c Revert special contribs and set folder manually for them until fixed 2021-10-17 23:10:01 +03:00
Denis Glazachev
68a08ffed9
Merge branch 'master' into reorganiza-contrib-ide-folders 2021-10-17 22:13:11 +04:00
Amos Bird
b034c913db
update 2021-10-17 10:41:51 +08:00
Alexey Milovidov
5fc2279adf Add RISC-V build 2021-10-17 01:23:55 +03:00
alexey-milovidov
e9af03ef52
Merge pull request #30248 from ClickHouse/musl-4
Preparation to build with Musl
2021-10-16 18:44:35 +03:00
Nikita Mikhaylov
6b22fdc55a
Merge pull request #30012 from PaulCher/codegen_select_fuzzer_v1
Codegen select fuzzer v1
2021-10-16 14:08:08 +03:00
feng lv
8b7721ae6f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into filelog-engine 2021-10-16 05:14:11 +00:00
Alexey Milovidov
e7d99c3e54 Update submodule 2021-10-16 03:09:38 +03:00
Alexey Milovidov
438d04795e Update toolchain 2021-10-16 03:03:46 +03:00
Alexey Milovidov
41acc52458 Preparation to build with Musl 2021-10-16 00:17:34 +03:00
mergify[bot]
6bf8c4a2b1
Merge branch 'master' into reorganiza-contrib-ide-folders 2021-10-15 19:59:08 +00:00
Nikita Mikhaylov
e9bf496d42 Added an ability to generate data in build time 2021-10-15 14:35:50 +00:00
Artur Filatenkov
f69daace7b attemp to fix build 2021-10-15 16:01:28 +03:00
Artur Filatenkov
74e3978110 commit assert to fix build 2021-10-14 22:55:17 +03:00
Kruglov Pavel
dd4421d4b1 Fix build 2021-10-14 16:43:23 +03:00
avogar
5d16dc7f9a Try to fix tests, update capnp lib to eliminate problem with UB sanitizer 2021-10-14 16:43:23 +03:00
feng lv
21f7ecbd9f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into filelog-engine 2021-10-14 02:09:51 +00:00
Artur Filatenkov
3c82fb756c Merge branch 'Check' of https://github.com/FArthur-cmd/ClickHouse into Check 2021-10-13 20:19:16 +03:00
Artur Filatenkov
91084895ce attemp to fix build 2021-10-13 20:18:51 +03:00
Amos Bird
8851cb8459
Use upstream replxx 2021-10-14 00:52:53 +08:00
Filatenkov Artur
5348cd5bd4
Merge branch 'ClickHouse:master' into Check 2021-10-13 16:15:56 +03:00
Nikita Mikhaylov
57a623aba0
Merge branch 'master' into codegen_select_fuzzer_v1 2021-10-13 16:01:40 +03:00
Artur Filatenkov
7cef607cb9 move on merge branch 2021-10-13 15:01:07 +03:00
Alexey Milovidov
4d5b793f2b Update submodule 2021-10-12 22:22:49 +03:00
feng lv
b2a17cb320 fix build and conflict 2021-10-12 16:50:50 +00:00
alexey-milovidov
e63506fde7
Merge branch 'master' into protobuf-host-build 2021-10-12 16:19:15 +03:00
Alexey Milovidov
3a8e65f01e Another try 2021-10-12 06:28:05 +03:00
Alexey Milovidov
5ba876cad2 Build protoc for host architecture during cross-compilation 2021-10-12 05:46:19 +03:00
Pavel Cheremushkin
7b9358a597 adding codegen fuzzer + code generation script. new contrib added: libprotobuf-mutator 2021-10-12 03:21:31 +03:00
Alexey Milovidov
fa14dbdf42 Update submodules 2021-10-12 02:03:00 +03:00
Alexey Milovidov
0c6c716bdd Update submodule 2021-10-12 01:49:29 +03:00
Alexey Milovidov
d4e496c314 Add support for PowerPC build 2021-10-12 01:47:57 +03:00
alexey-milovidov
f1b550cdaf
Merge pull request #29974 from ClickHouse/minimized-toolchain
Experiment with minimized toolchain (2)
2021-10-11 22:04:01 +03:00
Artur Filatenkov
0d1fcdf9fc add submodule update 2021-10-11 15:08:40 +03:00
Artur Filatenkov
351f2a3a84 Update BorinSSL 2021-10-11 14:53:26 +03:00
alexey-milovidov
3b8d7a5030
Merge pull request #29952 from MikaelUrankar/freebsd-aarch64
Add support for FreeBSD aarch64
2021-10-11 14:43:23 +03:00
Alexey Milovidov
e24be8dfb0 Update submodule 2021-10-11 14:41:49 +03:00
Alexey Milovidov
e0a4fb31a9 Update submodules to simplify cross build 2021-10-11 14:34:05 +03:00
feng lv
a57e97d2e0 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into filelog-engine 2021-10-11 06:09:43 +00:00
Alexey Milovidov
e7d3ead754 Fix error 2021-10-11 08:52:41 +03:00
Alexey Milovidov
264b278e1e Fix error 2021-10-11 08:29:50 +03:00
Alexey Milovidov
31e9214e43 Fix error 2021-10-11 07:52:05 +03:00
Alexey Milovidov
0ec1f3bd3f Fix error 2021-10-11 07:48:41 +03:00
Alexey Milovidov
c581a40a36 Update sysroot 2021-10-11 07:46:08 +03:00
Alexey Milovidov
1338f3daf8 Add missing files to libc-headers. 2021-10-11 07:44:12 +03:00
feng lv
e5857618d8 update poco 2021-10-11 04:12:04 +00:00
Alexey Milovidov
778793267b Add toolchain for linux-x86_64 2021-10-11 07:02:48 +03:00
Alexey Milovidov
8196f89481 Remove trash from CMake 2021-10-11 06:58:08 +03:00
Alexey Milovidov
fa3c13cf81 Experiment with minimized toolchain 2021-10-11 04:37:04 +03:00
mikael
5bd2fd0ba3 Add the missing bits for FreeBSD aarch64 2021-10-10 14:52:42 +02:00
mikael
714ac8efc4 FreeBSD aarch64 doesn't implement sbrk 2021-10-10 14:52:42 +02:00
alexey-milovidov
fbbc515a2f
Merge pull request #29925 from ClickHouse/update-cctz-2
Update CCTZ
2021-10-10 02:17:09 +03:00
Alexey Milovidov
f25fbe3740 Update CCTZ 2021-10-09 18:37:38 +03:00
feng lv
764b17787b update poco 2021-10-09 14:25:04 +00:00
feng lv
0e8d2f33d7 update poco 2021-10-09 10:51:10 +00:00
feng lv
aae07e1947 run test again 2021-10-09 10:34:57 +00:00
feng lv
ddf9e524cc test poco 2021-10-09 05:14:33 +00:00
Nikolai Kochetov
21bdc12b9c Pull libcxx 2021-10-08 21:38:12 +03:00
feng lv
1ea2323084 update poco 2021-10-05 06:40:00 +00:00
feng lv
873805d4da update poco
update

fix unbundled build
2021-10-04 13:55:49 +00:00
Denis Glazachev
7be521b024
Do not manipulate FOLDER property on INTERFACE library targets 2021-10-03 21:07:44 +04:00
Denis Glazachev
365a6b469e
Remove debug message 2021-10-03 20:30:20 +04:00
Denis Glazachev
ece880184b Reorganiza contrib IDE folders 2021-10-03 20:26:48 +04:00
Azat Khuzhin
42af45b2ba rocksdb: fix race condition during multiple DB opening
This should fix the following SIGSEGV, that was found on CI [1]:

    <Fatal> BaseDaemon: Address: NULL pointer. Access: read. Unknown si_code.
    <Fatal> BaseDaemon: 4.4. inlined from ../contrib/rocksdb/utilities/object_registry.cc:19: rocksdb::ObjectLibrary::FindEntry() const
    ...
    <Fatal> BaseDaemon: 7.3. inlined from ../contrib/rocksdb/options/cf_options.cc:678: rocksdb::$_7::operator()()

  [1]: https://clickhouse-test-reports.s3.yandex.net/29341/2b2bec3679df7965af908ce3f1e8e17e39bd12fe/integration_tests_flaky_check_(asan).html#fail1

And also I checked manually with TSan binary, and here is a data race
reported by TSan:

    WARNING: ThreadSanitizer: data race (pid=3356)
      Read of size 8 at 0x7b0c0008cca8 by thread T40:
        2 rocksdb::ObjectLibrary::FindEntry() const obj-x86_64-linux-gnu/../contrib/rocksdb/utilities/object_registry.cc:18:27 (clickhouse-tsan+0x1b839a6c)
        ...
        6 rocksdb::$_7::operator()() const obj-x86_64-linux-gnu/../contrib/rocksdb/options/cf_options.cc:676:32 (clickhouse-tsan+0x1b6bfa63)
        ...
        28 rocksdb::GetColumnFamilyOptionsFromMap() obj-x86_64-linux-gnu/../contrib/rocksdb/options/options_helper.cc:727:10 (clickhouse-tsan+0x1b6fffd2)
        29 DB::StorageEmbeddedRocksDB::initDb() obj-x86_64-linux-gnu/../src/Storages/RocksDB/StorageEmbeddedRocksDB.cpp:359:26 (clickhouse-tsan+0x14195e31)
        ...

      Previous write of size 8 at 0x7b0c0008cca8 by thread T41:
        ...
        9 rocksdb::ObjectLibrary::AddEntry() obj-x86_64-linux-gnu/../contrib/rocksdb/utilities/object_registry.cc:31:19 (clickhouse-tsan+0x1b8392fc)
        ...
        11 rocksdb::RegisterTableFactories()::$_0::operator()() const obj-x86_64-linux-gnu/../contrib/rocksdb/table/table_factory.cc:23:14 (clickhouse-tsan+0x1b7ea94c)
        ...
        43 rocksdb::GetColumnFamilyOptionsFromMap() obj-x86_64-linux-gnu/../contrib/rocksdb/options/options_helper.cc:727:10 (clickhouse-tsan+0x1b6fffd2)
        44 DB::StorageEmbeddedRocksDB::initDb() obj-x86_64-linux-gnu/../src/Storages/RocksDB/StorageEmbeddedRocksDB.cpp:359:26 (clickhouse-tsan+0x14195e31)

Refs: https://github.com/ClickHouse-Extras/rocksdb/pull/13
Fixes: #29341
2021-09-26 23:41:43 +03:00
Alexey Milovidov
6f65029daf Update libhdfs3 2021-09-25 02:54:18 +03:00
alexey-milovidov
60f76d9254
Merge pull request #28759 from nikitamikhaylov/enable-gcc-11
Switch CI to GCC-11
2021-09-12 15:56:57 +03:00
alexey-milovidov
ea13a8b562
Merge pull request #28659 from myrrc/improvement/tostring_to_magic_enum
Improving CH type system with concepts
2021-09-12 15:26:29 +03:00
Mike Kot
c4385a2c40 Simplifying exception messages 2021-09-11 00:40:18 +02:00
Nikita Mikhaylov
d7dafd6d2f Switch performance and merge contrib 2021-09-10 11:10:45 +00:00
mergify[bot]
937eeb9fed
Merge branch 'master' into enable-gcc-11 2021-09-09 22:44:10 +00:00
Maksim Kita
31766575e0
Merge pull request #28820 from azat/llvm-shared
Fix shared build with ENABLE_EMBEDDED_COMPILER
2021-09-10 00:49:18 +03:00
Nikita Mikhaylov
a796b9f039 Fix build 2021-09-09 21:17:22 +00:00
Azat Khuzhin
0d0c19c617 Fix RPATH for llvm in shared build
Before this patch:

    $ readelf -d contrib/llvm/llvm/bin/llvm-tblgen  | fgrep -i runpath
     0x000000000000001d (RUNPATH)            Library runpath: [$ORIGIN/../lib]

After:

    $ readelf -d contrib/llvm/llvm/bin/llvm-tblgen  | fgrep -i runpath
     0x000000000000001d (RUNPATH)            Library runpath: [/src/ch/clickhouse/.cmake/contrib/llvm/llvm/lib:/src/ch/clickhouse/.cmake/contrib/libcxx-cmake:/src/ch/clickhouse/.cmake/contrib/libcxxabi-cmake:/src/ch/clickhouse/.cmake/contrib/libunwind-cmake]
2021-09-09 22:41:27 +03:00
Azat Khuzhin
784d468f4b Include llvm from function to guard CMAKE_CXX_STANDARD scope 2021-09-09 22:41:26 +03:00
Nikita Mikhaylov
dcf7cb4a5c Done 2021-09-08 17:33:40 +00:00
Nikita Mikhaylov
474f34e78c Move back 2021-09-06 16:41:49 +00:00
Nikita Mikhaylov
a327144d40 Better 2021-09-06 16:39:46 +00:00
Nikita Mikhaylov
29a18d8d10 Try to fix unbundled 2021-09-06 15:58:08 +00:00
Nikita Mikhaylov
7c39f84a5e Merge upstream/master into global-merge-executor (using imerge) 2021-09-06 15:37:18 +00:00
Mike Kot
8e9aacadd1 Initial: replacing hardcoded toString for enums with magic_enum 2021-09-06 16:24:03 +02:00
Nikita Mikhaylov
0249015515 added priority queue 2021-09-06 11:37:51 +00:00
alesapin
36a11af351 Merge branch 'master' into add_test_logs_level 2021-09-04 15:48:47 +03:00
Nikita Mikhaylov
3eec8a3c2f Use boost::circular_buffer 2021-09-03 22:15:20 +00:00
Maksim Kita
5112b6e00d
Merge pull request #28537 from azat/bump-poco-remove-getpid
Bump poco to remove getpid() calls
2021-09-03 22:03:12 +03:00
Kseniia Sumarokova
8c5acc371a
Merge pull request #28365 from kssenii/rabbitmq-ssl
Allow ssl connection for rabbitmq
2021-09-03 16:53:28 +03:00
alesapin
497c225203 Test log level for CI 2021-09-03 13:07:40 +03:00
Azat Khuzhin
5bab06ed90 Bump poco to remove getpid() calls
Refs: https://github.com/ClickHouse-Extras/poco/pull/46
2021-09-03 07:45:58 +03:00
Nikita Mikhaylov
7e936c248f contrib/aws/ 2021-08-31 12:54:45 +00:00
kssenii
335b6f12fd Fix 2021-08-30 20:59:03 +03:00
Kseniia Sumarokova
31afd7d09c
Merge pull request #28081 from kssenii/pg-conflict
Support `on conflict` for postgres engine
2021-08-26 16:30:30 +03:00
mergify[bot]
9520ceba7e
Merge branch 'master' into update-libunwind-protect-from-wrong-cfa-expressions 2021-08-24 20:45:38 +00:00
Maksim Kita
0486d1bd37
Merge pull request #28084 from kssenii/nanodbc-update
Update nanodbc
2021-08-24 21:39:10 +03:00
Maksim Kita
027728a7a5 Updated libunwind to protect from wrong CFA expressions 2021-08-24 21:36:45 +03:00
kssenii
c467178a93 Update nanodbc 2021-08-24 12:50:07 +00:00
kssenii
0ec716292c Postgres ON CONFLICT 2021-08-24 12:37:32 +00:00
Azat Khuzhin
67a3ce1891 Bump replxx
Refs: https://github.com/ClickHouse-Extras/replxx/pull/17
2021-08-23 22:27:54 +03:00
alexey-milovidov
fa2a2817c9
Merge pull request #27883 from azat/bump-librdkafka-to-fix-TSan
Bump librdkafka (fixes use of an invalid/destroyed mutex)
2021-08-20 09:03:02 +03:00
Azat Khuzhin
941eba908c Bump librdkafka (to fix metadata cache destroying)
This should fix CI under TSan [1].

  [1]: https://clickhouse-test-reports.s3.yandex.net/0/9292869c4f92664a28b8c9ddef1e62ddfd13b285/integration_tests_(thread).html

Refs: edenhill/librdkafka#3279
2021-08-19 21:38:06 +03:00
Azat Khuzhin
6a600e5f6f jemalloc: fix under osx (zone_register() had been optimized out again)
v2: use ld -u
v3: move -u to executable
2021-08-18 09:47:59 +03:00
Azat Khuzhin
342c3fae3a Revert "Disable jemalloc under OSX" (only jemalloc hunk)
This reverts commit f062aa8574.
2021-08-18 09:47:59 +03:00
alexey-milovidov
67b2f49c8a
Merge pull request #27751 from Algunenano/osx_jemalloc
Disable jemalloc under OSX
2021-08-17 04:45:43 +03:00
Raúl Marín
f062aa8574 Disable jemalloc under OSX 2021-08-16 18:04:46 +02:00
taiyang-li
d417bd3247 remove duplicated source files in arrow-cmake 2021-08-16 18:56:14 +08:00
alexey-milovidov
135a5a2453
Merge pull request #27683 from ClickHouse/unbundled-sse2
Use only SSE2 in "unbundled" build
2021-08-15 13:25:44 +03:00
Alexey Milovidov
ba0ba988ba Fix build 2021-08-15 11:21:46 +03:00
Alexey Milovidov
cf87dacd4e Disable memory tracking for roaring bitmaps on Mac OS 2021-08-15 09:01:04 +03:00
Raúl Marín
61c4d94f1e Add explicit dependency between roaring and clickhouse_common_io
Fixes roaring memory tracker for split builds
2021-08-11 11:21:39 +02:00
Alexey Milovidov
3449e611fd Allow to build with AVX2 2021-08-10 03:46:03 +03:00
mergify[bot]
8d05b7c5e5
Merge branch 'master' into roaring-memory-tracker 2021-08-08 15:19:57 +00:00
alexey-milovidov
e6e9a27d8f
Merge pull request #27377 from evillique/bz2
Add support for bzip2 compression method
2021-08-08 04:40:13 +03:00
Alexey Milovidov
e7afb7e159 Merge branch 'master' into roaring-memory-tracker 2021-08-08 04:33:33 +03:00
alexey-milovidov
b8f4d480a3
Merge pull request #27081 from ClickHouse/fix_logs_in_nuraft
Fix excessive logging in NuRaft on server shutdown
2021-08-07 19:48:53 +03:00
Alexey Milovidov
161aa40206 Fix build; add comments 2021-08-07 19:30:59 +03:00