Commit Graph

74277 Commits

Author SHA1 Message Date
Alexey Milovidov
3a8e65f01e Another try 2021-10-12 06:28:05 +03:00
Alexey Milovidov
12168e7762 Enable Protobuf, Arrow, ORC, Parquet for AArch64 and Darwin 2021-10-12 05:46:50 +03:00
Alexey Milovidov
5ba876cad2 Build protoc for host architecture during cross-compilation 2021-10-12 05:46:19 +03:00
alexey-milovidov
84e16f9c8e
Merge pull request #29979 from azat/memory-profiler-sanitizers
Allow memory profiler under sanitizers (ASan/UBsan/MSan only)
2021-10-12 03:12:19 +03:00
alexey-milovidov
f1b550cdaf
Merge pull request #29974 from ClickHouse/minimized-toolchain
Experiment with minimized toolchain (2)
2021-10-11 22:04:01 +03:00
Dmitry Novik
a651c1bb67
Merge pull request #29820 from azat/MINSIGSTKSZ-fix
Fix compilation with glibc 2.34 (MINSIGSTKSZ defined as sysconf(_SC_SIGSTKSZ))
2021-10-11 17:06:29 +03:00
alexey-milovidov
f2d97e3225
Update build-cross-arm.md 2021-10-11 14:53:12 +03:00
alexey-milovidov
467b45f3b5
Update build-cross-arm.md 2021-10-11 14:52:44 +03:00
alexey-milovidov
0ca8660af6
Update build-cross-arm.md 2021-10-11 14:52:31 +03:00
alexey-milovidov
3b8d7a5030
Merge pull request #29952 from MikaelUrankar/freebsd-aarch64
Add support for FreeBSD aarch64
2021-10-11 14:43:23 +03:00
Alexey Milovidov
e24be8dfb0 Update submodule 2021-10-11 14:41:49 +03:00
Alexey Milovidov
e0a4fb31a9 Update submodules to simplify cross build 2021-10-11 14:34:05 +03:00
Alexey Milovidov
2370a8d6da Fix PVS-Studio 2021-10-11 14:28:46 +03:00
tavplubix
a9a7fd94cd
Merge pull request #29929 from azat/db-fix-lock-order-inversion
Fix lock-order-inversion between DROP TABLE for DatabaseMemory and LiveView
2021-10-11 13:23:58 +03:00
Kseniia Sumarokova
20e8074b5e
Merge pull request #29912 from taiyang-li/remove_unused_var
Remove unused variable in s3cluster
2021-10-11 12:45:04 +03:00
Nikita Mikhaylov
32d77aafe2
Merge pull request #29921 from azat/copier-fixes
copier: add ability to configure retries and delays between them
2021-10-11 12:11:38 +03:00
Maksim Kita
c368b20dce
Merge pull request #29982 from kitaisreal/tests-naming-fix
Tests naming fix
2021-10-11 11:35:37 +03:00
Maksim Kita
e05d041537 Tests naming fix 2021-10-11 11:34:58 +03:00
Azat Khuzhin
063f9cffab Allow memory profiler under sanitizers
Only query profiler cannot work reliably with sanitizers (due to
unwinding from signal handler), but memory profiler should be fine.

Plus sometimes the problem appears only on build with sanitizers, so it
will be useful to have memory related profiling in trace_log.

Also there is a flaky check for stateless tests, that uses build with
ASan, and now trace_log there is empty, which sometimes does not allow
to debug further.
2021-10-11 10:21:26 +03:00
Vladimir C
d2b8d293b4
Merge pull request #29976 from hexiaoting/dev_quantile_fuse2 2021-10-11 10:06:40 +03:00
Vladimir C
6c7fbf0b88
Merge pull request #29956 from azat/fix-tuple-filter 2021-10-11 10:02:47 +03:00
Alexey Milovidov
284e547bc3 Fix error 2021-10-11 09:01:23 +03:00
Alexey Milovidov
e7d3ead754 Fix error 2021-10-11 08:52:41 +03:00
Vitaly Baranov
e74a4a8b6c
Merge pull request #28934 from vitlibar/allow-macros-in-rabbitmq-settings-test
Add test for expanding macros in RabbitMQ settings.
2021-10-11 08:32:24 +03:00
Alexey Milovidov
264b278e1e Fix error 2021-10-11 08:29:50 +03:00
Alexey Milovidov
31e9214e43 Fix error 2021-10-11 07:52:05 +03:00
Alexey Milovidov
0ec1f3bd3f Fix error 2021-10-11 07:48:41 +03:00
Alexey Milovidov
c581a40a36 Update sysroot 2021-10-11 07:46:08 +03:00
Alexey Milovidov
1338f3daf8 Add missing files to libc-headers. 2021-10-11 07:44:12 +03:00
Alexey Milovidov
1df4792a45 Fix error 2021-10-11 07:07:58 +03:00
Alexey Milovidov
778793267b Add toolchain for linux-x86_64 2021-10-11 07:02:48 +03:00
Alexey Milovidov
0dbe7c4036 Remove old toolchain 2021-10-11 07:02:19 +03:00
Alexey Milovidov
8196f89481 Remove trash from CMake 2021-10-11 06:58:08 +03:00
Alexey Milovidov
7597763d6d Improve search for ar and ranlib 2021-10-11 06:55:00 +03:00
hexiaoting
aabe52e3e9 Fix bug for quantile fusion 2021-10-11 10:39:55 +08:00
Alexey Milovidov
fa3c13cf81 Experiment with minimized toolchain 2021-10-11 04:37:04 +03:00
alexey-milovidov
0adbcd58c9
Merge pull request #29930 from azat/buffer-fix-data-race
Fix data-race between flush() and startup() in StorageBuffer
2021-10-11 01:11:39 +03:00
alexey-milovidov
c64ca7be08
Merge pull request #29947 from azat/stateless-tests-fixes-v21.10
Stateless flaky tests fixes
2021-10-11 01:09:57 +03:00
alexey-milovidov
765f7b692c
Merge pull request #29919 from azat/integration-tests-fixes-v21.10
Fix flaky integration tests (test_backup_restore/test_input_format_parallel_parsing_memory_tracking)
2021-10-11 00:14:06 +03:00
alexey-milovidov
a70249f8f7
Merge pull request #29932 from ClickHouse/Whitespaces
Minor changes
2021-10-11 00:11:51 +03:00
alexey-milovidov
341eb1f9bf
Update adopters.md 2021-10-11 00:05:53 +03:00
Vitaly Baranov
07aea95a75 Fix rabbitmq tests. 2021-10-11 00:00:12 +03:00
Maksim Kita
85f280f017
Merge pull request #29951 from vitlibar/fix-access-control-shutdown
Fix shutdown of AccessControlManager
2021-10-10 23:56:40 +03:00
Azat Khuzhin
f37dac03f4 Fix lock-order-inversion between DROP TABLE for DatabaseMemory and LiveView
CI stress founds [1], TSan report:

WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=509)
  Cycle in lock order graph: M71436201 (0x7b5800a91308) => M237700395169415472 (0x000000000000) => M71436201

  Mutex M237700395169415472 acquired here while holding mutex M71436201 in thread T723:
    3 std::__1::lock_guard<std::__1::mutex>::lock_guard(std::__1::mutex&) obj-x86_64-linux-gnu/../contrib/libcxx/include/__mutex_base:91:27 (clickhouse+0x154b0db9)
    4 DB::DatabaseWithOwnTablesBase::tryGetTable() const obj-x86_64-linux-gnu/../src/Databases/DatabasesCommon.cpp:37:21 (clickhouse+0x154b0db9)
    5 DB::DatabaseMemory::tryGetTableUUID() const obj-x86_64-linux-gnu/../src/Databases/DatabaseMemory.cpp:95:22 (clickhouse+0x15466bb5)
    6 DB::Context::resolveStorageID() const obj-x86_64-linux-gnu/../src/Interpreters/Context.cpp:2672:90 (clickhouse+0x155e6aa1)
    7 DB::JoinedTables::getLeftTableStorage() obj-x86_64-linux-gnu/../src/Interpreters/JoinedTables.cpp:200:29 (clickhouse+0x15eee962)
    8 DB::InterpreterSelectQuery::InterpreterSelectQuery() obj-x86_64-linux-gnu/../src/Interpreters/InterpreterSelectQuery.cpp:321:33 (clickhouse+0x15b792be)
    9 DB::InterpreterSelectQuery::InterpreterSelectQuery() obj-x86_64-linux-gnu/../src/Interpreters/InterpreterSelectQuery.cpp:160:7 (clickhouse+0x15b78160)
    10 DB::StorageLiveView::collectMergeableBlocks() obj-x86_64-linux-gnu/../src/Storages/LiveView/StorageLiveView.cpp:113:28 (clickhouse+0x16aae192)
    11 DB::StorageLiveView::getNewBlocks() obj-x86_64-linux-gnu/../src/Storages/LiveView/StorageLiveView.cpp:384:33 (clickhouse+0x16ab393a)
    12 DB::StorageLiveView::refresh(bool) obj-x86_64-linux-gnu/../src/Storages/LiveView/StorageLiveView.cpp:528:13 (clickhouse+0x16ab6395)
    13 DB::StorageLiveView::read() obj-x86_64-linux-gnu/../src/Storages/LiveView/StorageLiveView.cpp:545:9 (clickhouse+0x16ab6395)
    21 DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) obj-x86_64-linux-gnu/../src/Interpreters/executeQuery.cpp:950:30 (clickhouse+0x16101441)

    Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message

  Mutex M71436201 acquired here while holding mutex M237700395169415472 in thread T723:
    3 std::__1::lock_guard<std::__1::mutex>::lock_guard(std::__1::mutex&) obj-x86_64-linux-gnu/../contrib/libcxx/include/__mutex_base:91:27 (clickhouse+0x16ab5c29)
    4 DB::StorageLiveView::drop() obj-x86_64-linux-gnu/../src/Storages/LiveView/StorageLiveView.cpp:477:21 (clickhouse+0x16ab5c29)
    5 DB::DatabaseMemory::dropTable() obj-x86_64-linux-gnu/../src/Databases/DatabaseMemory.cpp:44:16 (clickhouse+0x15465cd6)
    8 DB::InterpreterDropQuery::execute() obj-x86_64-linux-gnu/../src/Interpreters/InterpreterDropQuery.cpp:62:16 (clickhouse+0x15afa679)

  [1]: https://clickhouse-test-reports.s3.yandex.net/29856/42ca2b4bb241827edf69bbd6938d6b19c31935f1/stress_test_(thread).html#fail1

v2: fix attachTableUnlocked() (as pointed by @tavplubix)
v3: use SCOPE_EXIT() and so avoid holding a lock during removing from fs
2021-10-10 23:51:36 +03:00
Azat Khuzhin
6c33eaee32 Fix filtering by tuple (some conditions was lost during analyzing)
Fixes: #29281
Fixes: test_cluster_copier/test_three_nodes.py::test
2021-10-10 22:37:52 +03:00
Nikolai Kochetov
a95c28ec4b
Merge pull request #29898 from ClickHouse/remove-native-stream
Remove some more streams.
2021-10-10 21:01:16 +03:00
mikael
934b72ddd1 Add FreeBSD aarch64 bits for cross-builds for CI. 2021-10-10 18:54:38 +02:00
alexey-milovidov
af5150c38b
Merge pull request #29935 from ClickHouse/remove-trash-printf
Remove `printf` function usage.
2021-10-10 16:11:00 +03:00
mikael
5bd2fd0ba3 Add the missing bits for FreeBSD aarch64 2021-10-10 14:52:42 +02:00
mikael
714ac8efc4 FreeBSD aarch64 doesn't implement sbrk 2021-10-10 14:52:42 +02:00