thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-11 08:52:06 +00:00
Code Issues Packages Projects Releases Wiki Activity
149,881 Commits 9,280 Branches 1,782 Tags 2.1 GiB
96b54df163
Commit Graph

4105 Commits

Author SHA1 Message Date
Robert Schulze
70f7f54064
Fix 01747_system_session_log_long 2024-04-08 11:04:49 +00:00
Robert Schulze
9400fee0e4
Fix leak-san false positive 
This commit adresses below leaksan find.

I tried to reproduce this locally but 02802_clickhouse_disks_s3_copy.sh
but couldn't. clickhouse-disks did not do anything useful (it would not
even print logging), neither with a standard build nor with a leaksan
build. Could not find further documentation of it or even what this tool
is supposed to do, perhaps it is just for internal use. Also,
- line numbers in the leaksan report were partially missing,
- I am not really sure how Sha256HMACOpenSSLImpl::Calculate is calling
  into hmac_init (there must be some sort of static initialization
  somewhere but I did not find it), and
- my fix is in a weird place due to other restrictions (see the commit
  in the aws-sdk-cpp contrib repo).

The chance that this fix fixes the leak are low.
If it doesn't work, add "# Tag no-asan" + a comment to
02802_clickhouse_disks_s3_copy.sh and don't worry further.

EDIT: The commit fixes the issue, everything is good.

https://s3.amazonaws.com/clickhouse-test-reports/59870/b452e3d1ab87b8cc5810693aeea28f69ad28d671/stateless_tests__asan__[3_4].html

2024-03-19 08:34:03 =================================================================
2024-03-19 08:34:03 ==13149==ERROR: LeakSanitizer: detected memory leaks
2024-03-19 08:34:03
2024-03-19 08:34:03 Direct leak of 904 byte(s) in 1 object(s) allocated from:
2024-03-19 08:34:03     #0 0x55f9cb5a18ee in malloc (/usr/bin/clickhouse+0xa9a48ee) (BuildId: b3766b865d6580f6dcba75acf37673d4aeedc2b6)
2024-03-19 08:34:03     #1 0x55fa01e34070 in CRYPTO_malloc build_docker/./contrib/openssl/crypto/mem.c:202:11
2024-03-19 08:34:03     #2 0x55fa01e34070 in CRYPTO_zalloc build_docker/./contrib/openssl/crypto/mem.c:222:11
2024-03-19 08:34:03     #3 0x55fa01d6dcca in ossl_err_get_state_int build_docker/./contrib/openssl/crypto/err/err.c:691:17
2024-03-19 08:34:03     #4 0x55fa01d71748 in ERR_set_mark build_docker/./contrib/openssl/crypto/err/err_mark.c:19:10
2024-03-19 08:34:03     #5 0x55fa01f4735b in ossl_prov_digest_load_from_params build_docker/./contrib/openssl/providers/common/provider_util.c:194:5
2024-03-19 08:34:03     #6 0x55fa01ff467a in hmac_set_ctx_params build_docker/./contrib/openssl/providers/implementations/macs/hmac_prov.c:307:10
2024-03-19 08:34:03     #7 0x55fa01ff3ef2 in hmac_init build_docker/./contrib/openssl/providers/implementations/macs/hmac_prov.c:169:37
2024-03-19 08:34:03     #8 0x55f9fb83c75b in Aws::Utils::Crypto::Sha256HMACOpenSSLImpl::Calculate(Aws::Utils::Array<unsigned char> const&, Aws::Utils::Array<unsigned char> const&) (/usr/bin/clickhouse+0x3ac3f75b) (BuildId: b3766b865d6580f6dcba75acf37673d4aeedc2b6)
2024-03-19 08:34:03     #9 0x55f9fb82ebeb in Aws::Utils::Crypto::Sha256HMAC::Calculate(Aws::Utils::Array<unsigned char> const&, Aws::Utils::Array<unsigned char> const&) (/usr/bin/clickhouse+0x3ac31beb) (BuildId: b3766b865d6580f6dcba75acf37673d4aeedc2b6)
2024-03-19 08:34:03     #10 0x55f9fb6d5afd in Aws::Client::AWSAuthV4Signer::ComputeHash(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) const (/usr/bin/clickhouse+0x3aad8afd) (BuildId: b3766b865d6580f6dcba75acf37673d4aeedc2b6)
2024-03-19 08:34:03     #11 0x55f9fb6e0bad in Aws::Client::AWSAuthV4Signer::SignRequest(Aws::Http::HttpRequest&, char const*, char const*, bool) const (/usr/bin/clickhouse+0x3aae3bad) (BuildId: b3766b865d6580f6dcba75acf37673d4aeedc2b6)
2024-03-19 08:34:03     #12 0x55f9fb72651d in bool smithy::components::tracing::TracingUtils::MakeCallWithTiming<bool>(std::__1::function<bool ()>, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, smithy::components::tracing::Meter const&, std::__1::map<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::less<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>, std::__1::allocator<std::__1::pair<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>>>&&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) (/usr/bin/clickhouse+0x3ab2951d) (BuildId: b3766b865d6580f6dcba75acf37673d4aeedc2b6)
2024-03-19 08:34:03     #13 0x55f9fb70adcb in Aws::Client::AWSClient::AttemptOneRequest(std::__1::shared_ptr<Aws::Http::HttpRequest> const&, Aws::AmazonWebServiceRequest const&, char const*, char const*, char const*) const (/usr/bin/clickhouse+0x3ab0ddcb) (BuildId: b3766b865d6580f6dcba75acf37673d4aeedc2b6)
2024-03-19 08:34:03     #14 0x55f9fb6fdb17 in Aws::Client::AWSClient::AttemptExhaustively(Aws::Http::URI const&, Aws::AmazonWebServiceRequest const&, Aws::Http::HttpMethod, char const*, char const*, char cons
 2024-04-08 11:04:43 +00:00
Robert Schulze
d0a08aa963
Suppress tsan failures: use locks instead of atomics 
Fixes integration test_reload_certificate/test.py::test_first_than_second_cert

---

E           Exception: Sanitizer assert found for instance ==================
E           WARNING: ThreadSanitizer: data race (pid=1)
E             Write of size 8 at 0x7b2800025d30 by thread T2 (mutexes: write M0, write M1):
E               #0 free <null> (clickhouse+0x709a3e5) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #1 CRYPTO_free build_docker/./contrib/openssl/crypto/mem.c:282:5 (clickhouse+0x2015f8ea) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #2 EVP_PKEY_free build_docker/./contrib/openssl/crypto/evp/p_lib.c:1809:5 (clickhouse+0x2012a751) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #3 Poco::Crypto::EVPPKey::~EVPPKey() build_docker/./base/poco/Crypto/src/EVPPKey.cpp:121:17 (clickhouse+0x1d00ffa9) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #4 DB::CertificateReloader::Data::~Data() build_docker/./src/Server/CertificateReloader.h:71:12 (clickhouse+0x194fb42d) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #5 std::__1::default_delete<DB::CertificateReloader::Data const>::operator()[abi:v15000](DB::CertificateReloader::Data const*) const build_docker/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (clickhouse+0x194fb42d)
E               #6 std::__1::__shared_ptr_pointer<DB::CertificateReloader::Data const*, std::__1::default_delete<DB::CertificateReloader::Data const>, std::__1::allocator<DB::CertificateReloader::Data const>>::__on_zero_shared() build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:263:5 (clickhouse+0x194fb42d)
E               #7 std::__1::__shared_count::__release_shared[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:174:9 (clickhouse+0x194fade0) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #8 std::__1::__shared_weak_count::__release_shared[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:215:27 (clickhouse+0x194fade0)
E               #9 std::__1::shared_ptr<DB::CertificateReloader::Data const>::~shared_ptr[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:702:23 (clickhouse+0x194fade0)
E               #10 std::__1::shared_ptr<DB::CertificateReloader::Data const>::operator=[abi:v15000](std::__1::shared_ptr<DB::CertificateReloader::Data const>&&) build_docker/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:723:9 (clickhouse+0x194fade0)
E               #11 MultiVersion<DB::CertificateReloader::Data>::set(std::__1::unique_ptr<DB::CertificateReloader::Data const, std::__1::default_delete<DB::CertificateReloader::Data const>>&&) build_docker/./src/Common/MultiVersion.h:76:25 (clickhouse+0x194fade0)
E               #12 DB::CertificateReloader::tryLoad(Poco::Util::AbstractConfiguration const&) build_docker/./src/Server/CertificateReloader.cpp:83:18 (clickhouse+0x194f94ca) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #13 DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&)::$_6::operator()(Poco::AutoPtr<Poco::Util::AbstractConfiguration>, bool) const build_docker/./programs/server/Server.cpp:1546:45 (clickhouse+0xf384df7) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #14 decltype(std::declval<DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&)::$_6&>()(std::declval<Poco::AutoPtr<Poco::Util::AbstractConfiguration>>(), std::declval<bool>())) std::__1::__invoke[abi:v15000]<DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&)::$_6&, Poco::AutoPtr<Poco::Util::AbstractConfiguration>, bool>(DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&)::$_6&, Poco::AutoPtr<Poco::Util::AbstractConfiguration>&&, bool&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xf3827a9) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #15 void std::__1::__invoke_void_return_wrapper<void, true>::__call<DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&)::$_6&, Poco::AutoPtr<Poco::Util::AbstractConfiguration>, bool>(DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&)::$_6&, Poco::AutoPtr<Poco::Util::AbstractConfiguration>&&, bool&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xf3827a9)
E               #16 std::__1::__function::__default_alloc_func<DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&)::$_6, void (Poco::AutoPtr<Poco::Util::AbstractConfiguration>, bool)>::operator()[abi:v15000](Poco::AutoPtr<Poco::Util::AbstractConfiguration>&&, bool&&) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xf3827a9)
E               #17 void std::__1::__function::__policy_invoker<void (Poco::AutoPtr<Poco::Util::AbstractConfiguration>, bool)>::__call_impl<std::__1::__function::__default_alloc_func<DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&)::$_6, void (Poco::AutoPtr<Poco::Util::AbstractConfiguration>, bool)>>(std::__1::__function::__policy_storage const*, Poco::AutoPtr<Poco::Util::AbstractConfiguration>&&, bool) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xf3827a9)
E               #18 std::__1::__function::__policy_func<void (Poco::AutoPtr<Poco::Util::AbstractConfiguration>, bool)>::operator()[abi:v15000](Poco::AutoPtr<Poco::Util::AbstractConfiguration>&&, bool&&) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x19fd2cbe) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #19 std::__1::function<void (Poco::AutoPtr<Poco::Util::AbstractConfiguration>, bool)>::operator()(Poco::AutoPtr<Poco::Util::AbstractConfiguration>, bool) const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x19fd2cbe)
E               #20 DB::ConfigReloader::reloadIfNewer(bool, bool, bool, bool) build_docker/./src/Common/Config/ConfigReloader.cpp:150:13 (clickhouse+0x19fd2cbe)
E               #21 DB::ConfigReloader::reload() build_docker/./src/Common/Config/ConfigReloader.h:51:21 (clickhouse+0xf38767c) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #22 DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&)::$_13::operator()() const build_docker/./programs/server/Server.cpp:1731:31 (clickhouse+0xf38767c)
E               #23 decltype(std::declval<DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&)::$_13&>()()) std::__1::__invoke[abi:v15000]<DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&)::$_13&>(DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&)::$_13&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (clickhouse+0xf38767c)
E               #24 void std::__1::__invoke_void_return_wrapper<void, true>::__call<DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&)::$_13&>(DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&)::$_13&) build_docker/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (clickhouse+0xf38767c)
E               #25 std::__1::__function::__default_alloc_func<DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&)::$_13, void ()>::operator()[abi:v15000]() build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (clickhouse+0xf38767c)
E               #26 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&)::$_13, void ()>>(std::__1::__function::__policy_storage const*) build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (clickhouse+0xf38767c)
E               #27 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (clickhouse+0x16907aa0) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #28 std::__1::function<void ()>::operator()() const build_docker/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (clickhouse+0x16907aa0)
E               #29 DB::Context::reloadConfig() const build_docker/./src/Interpreters/Context.cpp:4357:5 (clickhouse+0x16907aa0)
E               #30 DB::InterpreterSystemQuery::execute() build_docker/./src/Interpreters/InterpreterSystemQuery.cpp:577:29 (clickhouse+0x17e78c19) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #31 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_docker/./src/Interpreters/executeQuery.cpp:1195:40 (clickhouse+0x17e3e462) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #32 DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) build_docker/./src/Interpreters/executeQuery.cpp:1374:26 (clickhouse+0x17e39837) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #33 DB::TCPHandler::runImpl() build_docker/./src/Server/TCPHandler.cpp:518:54 (clickhouse+0x195cc651) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #34 DB::TCPHandler::run() build_docker/./src/Server/TCPHandler.cpp:2329:9 (clickhouse+0x195e8707) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #35 Poco::Net::TCPServerConnection::start() build_docker/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x1d00d942) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #36 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x1d00e1b1) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #37 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1d20f2e6) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #38 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1d20d5af) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #39 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1d20ba69) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E
E             Previous atomic write of size 4 at 0x7b2800025d30 by thread T3 (mutexes: write M2):
E               #0 CRYPTO_DOWN_REF build_docker/./contrib/openssl/include/internal/refcount.h:51:12 (clickhouse+0x2012a6e6) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #1 EVP_PKEY_free build_docker/./contrib/openssl/crypto/evp/p_lib.c:1795:5 (clickhouse+0x2012a6e6)
E               #2 ssl_cert_clear_certs build_docker/./contrib/openssl/ssl/ssl_cert.c:246:9 (clickhouse+0x1ffafd37) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #3 ssl_cert_free build_docker/./contrib/openssl/ssl/ssl_cert.c:277:5 (clickhouse+0x1ffafd37)
E               #4 ossl_ssl_connection_free build_docker/./contrib/openssl/ssl/ssl_lib.c:1458:5 (clickhouse+0x1ffba6af) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #5 SSL_free build_docker/./contrib/openssl/ssl/ssl_lib.c:1417:9 (clickhouse+0x1ffb920e) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #6 Poco::Net::SecureSocketImpl::reset() build_docker/./base/poco/NetSSL_OpenSSL/src/SecureSocketImpl.cpp:583:3 (clickhouse+0x1cfaac60) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #7 Poco::Net::SecureSocketImpl::~SecureSocketImpl() build_docker/./base/poco/NetSSL_OpenSSL/src/SecureSocketImpl.cpp:80:3 (clickhouse+0x1cfaac60)
E               #8 Poco::Net::SecureStreamSocketImpl::~SecureStreamSocketImpl() build_docker/./base/poco/NetSSL_OpenSSL/src/SecureStreamSocketImpl.cpp:52:1 (clickhouse+0x1cfb15dd) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #9 Poco::Net::SecureStreamSocketImpl::~SecureStreamSocketImpl() build_docker/./base/poco/NetSSL_OpenSSL/src/SecureStreamSocketImpl.cpp:43:1 (clickhouse+0x1cfb15dd)
E               #10 Poco::RefCountedObject::release() const build_docker/./base/poco/Foundation/include/Poco/RefCountedObject.h:86:13 (clickhouse+0x1cffc81e) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #11 Poco::Net::Socket::~Socket() build_docker/./base/poco/Net/src/Socket.cpp:68:10 (clickhouse+0x1cffc81e)
E               #12 Poco::Net::StreamSocket::~StreamSocket() build_docker/./base/poco/Net/src/StreamSocket.cpp:63:1 (clickhouse+0x1d009c39) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #13 Poco::Net::TCPConnectionNotification::~TCPConnectionNotification() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:43:2 (clickhouse+0x1d00ef50) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #14 Poco::Net::TCPConnectionNotification::~TCPConnectionNotification() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:42:2 (clickhouse+0x1d00ef50)
E               #15 Poco::RefCountedObject::release() const build_docker/./base/poco/Foundation/include/Poco/RefCountedObject.h:86:13 (clickhouse+0x1d00e203) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #16 Poco::AutoPtr<Poco::Notification>::~AutoPtr() build_docker/./base/poco/Foundation/include/Poco/AutoPtr.h:91:19 (clickhouse+0x1d00e203)
E               #17 Poco::Net::TCPServerDispatcher::run() build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:122:3 (clickhouse+0x1d00e203)
E               #18 Poco::PooledThread::run() build_docker/./base/poco/Foundation/src/ThreadPool.cpp:188:14 (clickhouse+0x1d20f2e6) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #19 Poco::(anonymous namespace)::RunnableHolder::run() build_docker/./base/poco/Foundation/src/Thread.cpp:45:11 (clickhouse+0x1d20d5af) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E               #20 Poco::ThreadImpl::runnableEntry(void*) build_docker/./base/poco/Foundation/src/Thread_POSIX.cpp:335:27 (clickhouse+0x1d20ba69) (BuildId: 706d92b17db171493f293d517643f726ee1b7b1e)
E
 2024-04-08 11:04:37 +00:00
Robert Schulze
75bebc76e1
Clean up mess left by previous attempts to make builds work 2024-04-08 11:04:24 +00:00
Robert Schulze
c86d7534f3
Fix compatibility check, pt. II 2024-04-08 11:04:20 +00:00
Robert Schulze
481f2b0408
Fix compatibility check, pt. I 2024-04-08 11:04:16 +00:00
Robert Schulze
f5b8987e4e
Fix Darwin builds (aarch64 and x86_64) 2024-04-08 11:04:06 +00:00
Robert Schulze
66665aacba
Fix the RISC-V build, try to fix the s390x build 2024-04-08 11:04:02 +00:00
Robert Schulze
b754cc90a8
Fix PPC build 2024-04-08 11:03:58 +00:00
Robert Schulze
f116fda0e5
Fix ARM builds 2024-04-08 11:03:55 +00:00
Robert Schulze
b8b74ff815
Suppress msan false positives 2024-04-08 11:03:35 +00:00
Robert Schulze
7df398a51d
Fix x86 build 2024-04-08 11:03:15 +00:00
Robert Schulze
a8fb77ed8a
Add patch-able OpenSSL submodule back 2024-04-08 11:03:10 +00:00
Robert Schulze
1076aa6ff4
Remove OpenSSL upstream submodule (we need patched OpenSSL) 2024-04-08 11:02:56 +00:00
Robert Schulze
38629d0361
Fix sparse checkout 2024-04-08 11:02:49 +00:00
Robert Schulze
dca6e0abbd
Fix the build (after boringssl submodule removal) 2024-04-08 11:02:41 +00:00
Robert Schulze
0608f7662e
Remove boringssl submodule 2024-04-08 11:01:28 +00:00
Robert Schulze
cd5a06892e
Merge remote-tracking branch 'rschu1ze/master' into double-conversion 2024-04-07 10:27:55 +00:00
Raúl Marín
608d52cc8e Push registries 2024-04-05 13:18:53 +02:00
Robert Schulze
9d8f643f5b
Cleanup SSH-based authentication code 2024-04-05 08:43:23 +00:00
Raúl Marín
032016cc82 Update lock with custom tuikit 2024-04-04 19:42:33 +02:00
Raúl Marín
f77822e732 Vendor rust dependencies 2024-04-04 19:22:38 +02:00
Raúl Marín
24dd34fb29 Update corrosion 2024-04-04 19:00:45 +02:00
alesapin
ff054b5ab3 With better name 2024-04-04 17:14:55 +02:00
alesapin
d9e7c0a662 Add comment 2024-04-04 16:36:12 +02:00
alesapin
34a2119945 Public visibility 2024-04-04 16:32:29 +02:00
avogar
5fadac4994 Update contrib to new commit 2024-04-03 15:24:44 +00:00
Mikhail Koviazin
e7a664e9df
Merge remote-tracking branch 'upstream/master' into mkmkme/protobuf-25.1 2024-04-03 13:51:37 +03:00
alesapin
93d813555b Merge remote-tracking branch 'origin/master' into use_clickhouse_threads_nuraft 2024-04-02 20:51:57 +02:00
alesapin
c2995b13e2 Use ClickHouse threads in NuRaft 2024-04-02 20:44:52 +02:00
Robert Schulze
427ad784e8
Actually bump the submodule 2024-04-02 16:04:24 +00:00
Robert Schulze
7d87adc91a
Upgrade double-conversion to 3.3.0 2024-04-02 13:51:36 +00:00
Robert Schulze
732c215a27
Add ClickHouse double-conversion submodule 2024-04-02 13:40:40 +00:00
Robert Schulze
ee2ec2f1c2
Remove double-conversion submodule 2024-04-02 13:39:58 +00:00
Antonio Andelic
24b02dc9b8 Update CMake 2024-04-02 11:10:09 +02:00
Antonio Andelic
9f51e9825d Update NuRaft 2024-04-02 11:02:23 +02:00
Alexey Milovidov
9dece1a7f6
Merge branch 'master' into libunwind-fix-crash 2024-03-29 02:10:22 +03:00
avogar
8dd3e9ace3 Fix unrelated changes in contrib 2024-03-26 15:03:00 +00:00
avogar
b47d8156ff Merge branch 'master' of github.com:ClickHouse/ClickHouse into try-fix-arrow-abort 2024-03-26 14:16:08 +00:00
Shubham Ranjan
e2974c9f4b
chore: update xxhash to v0.8.2 2024-03-25 01:40:03 +05:30
Alexey Milovidov
145e7e7eca
Merge pull request #61702 from oxidecomputer/43/ares-illumos 
contrib/c-ares: add illumos as a platform
 2024-03-22 03:14:18 +03:00
Alexey Milovidov
96a45fc9ec
Merge pull request #61119 from ilejn/update_cppkafka 
update cppkafka to v0.4.1
 2024-03-22 01:19:42 +03:00
Kruglov Pavel
7738ea5c5c
Merge branch 'master' into try-fix-arrow-abort 2024-03-21 16:40:27 +01:00
avogar
f049159571 Try to fix abort in arrow 2024-03-21 15:37:00 +00:00
Oxide Computer Company
f64001ebfa contrib/curl: Add illumos support 2024-03-21 11:37:26 +00:00
Oxide Computer Company
7abdc66e0d contrib/c-ares: add illumos as a platform 2024-03-21 11:20:16 +00:00
Ilya Golshtein
939554ec0a contrib: update cppkafka to v0.4.1@9c5ea0e3 2024-03-19 14:54:00 +00:00
Robert Schulze
c17536c3b3
Enable clang-tidy in headers 2024-03-18 08:00:09 +00:00
Robert Schulze
06d917fcf0
Merge pull request #61150 from rschu1ze/clang-tidy-list 
Some clang-tidy fixes
 2024-03-14 14:54:41 +01:00
Alexey Milovidov
dc7d1f05a5
Merge pull request #59624 from M1eyu2018/add-pread-in-libhdfs3 
Add positional read in libhdfs3
 2024-03-14 15:04:50 +03:00
Robert Schulze
3486b4a6e3
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-list 2024-03-14 10:44:20 +00:00
Smita Kulkarni
ddd2d92d0f Update curl to curl with data race fix 2024-03-12 18:40:20 +01:00
Robert Schulze
e5e84419af
Fix clang-tidy-s 2024-03-11 10:58:54 +00:00
Alexey Milovidov
784b656c6a Another approach 2024-03-11 00:44:36 +01:00
Alexey Milovidov
bed3e81e65 Merge branch 'master' into libunwind-fix-crash 2024-03-11 00:04:04 +01:00
Alexander Sapin
93e2ed8248 Remove useless message from AWS library 2024-03-06 11:31:24 +01:00
Raúl Marín
7a851bece3 Update tzdata to 2024a 2024-03-04 14:15:15 +01:00
M1eyu2018
671b0f678a Add positional read in libhdfs3 
Signed-off-by: M1eyu2018 <857037797@qq.com>
 2024-03-04 10:12:27 +08:00
Alexey Milovidov
aace0e39f1 Merge branch 'master' into libunwind-fix-crash 2024-03-02 03:19:46 +01:00
Mikhail Koviazin
11371e886c
Update protobuf to v25.1 
The new version deprecates `syntax()` and makes it inaccessible. Instead, the
attributes corresponding to a feature should be used. This commit addresses
this.
 2024-03-01 17:03:10 +02:00
Robert Schulze
3a5c9b627b
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-src 2024-03-01 10:31:55 +00:00
Robert Schulze
4ee1aa8c7c
Fixing more headers 2024-02-29 15:40:30 +00:00
Joshua Hildred
ca9a6f809f add support for .tar.zst and tar.xz 2024-02-29 05:20:53 -08:00
Alexey Milovidov
e77d1076b8 Fix crash in libunwind while interpreting debug info 2024-02-27 23:03:22 +01:00
Nikita Taranov
2ea20004ef upd 2024-02-26 13:54:57 +01:00
Nikita Taranov
49f42eb09d
Merge branch 'master' into fix_head_bucket_after_update 2024-02-24 23:44:10 +01:00
Raúl Marín
d68ed710af
Merge pull request #60346 from Algunenano/rapidjson_submodule 
Fix rapidjson submodule
 2024-02-23 15:22:55 +01:00
Antonio Andelic
eef2c6037c
Merge pull request #60266 from ClickHouse/remove-bad-check-in-keeper 
Remove bad check in Keeper
 2024-02-23 14:39:46 +01:00
Robert Schulze
38d4d1fb57
Merge remote-tracking branch 'ClickHouse/master' into iaadeflate_upgrade_qpl_v1.4.0 2024-02-23 10:01:01 +00:00
Raúl Marín
c160607f82 Fix rapidjson submodule 2024-02-23 10:41:06 +01:00
Alexey Milovidov
e83deb4410
Merge pull request #60178 from ClickHouse/fix-wrong-message-during-compilation 
Fix wrong message during compilation
 2024-02-23 00:00:41 +01:00
Nikita Taranov
b44e4c6d78
Merge branch 'master' into fix_head_bucket_after_update 2024-02-22 14:32:00 +01:00
Robert Schulze
d638820478
Merge remote-tracking branch 'ClickHouse/master' into iaadeflate_upgrade_qpl_v1.4.0 2024-02-22 10:07:49 +00:00
Antonio Andelic
4625f38803 Remove bad check in Keeper 2024-02-22 09:08:13 +01:00
Robert Schulze
310aff9b6f
Merge remote-tracking branch 'ClickHouse/master' into iaadeflate_upgrade_qpl_v1.4.0 2024-02-21 16:22:32 +00:00
Nikita Taranov
8401cd8c41 impl 2024-02-21 00:47:54 +01:00
Alexey Milovidov
1ff3a5aa17 Fix wrong message during compilation 2024-02-20 12:22:12 +01:00
Antonio Andelic
ecaaa5066a Update NuRaft to master 2024-02-20 10:19:36 +01:00
Antonio Andelic
299a0bd996 Merge branch 'master' into keeper-logs-cache 2024-02-19 10:01:31 +01:00
Alexey Milovidov
96113a46c5 Update LZ4 to the latest dev 2024-02-17 05:52:24 +01:00
Joshua Hildred
52bcecf7b0 Bump curl to version 4.6.0 2024-02-16 17:25:41 -08:00
Antonio Andelic
ddfa3dea87 Merge branch 'master' into keeper-logs-cache 2024-02-16 10:07:06 +01:00
Antonio Andelic
1ade535a83 Merge branch 'master' into keeper-logs-cache 2024-02-15 13:06:37 +01:00
Robert Schulze
244aef4cc5
Merge remote-tracking branch 'rschu1ze/master' into libssh-0.9.8 2024-02-10 13:46:26 +00:00
Nikita Mikhaylov
50828dade2
Fix stacktraces on MacOS (#59690) 2024-02-09 14:53:03 +01:00
kssenii
927e00f8f1 Update libuv 2024-02-08 18:53:24 +01:00
Robert Schulze
a740fc7835
Cleanup CMakeLists.txt file 2024-02-07 15:57:02 +00:00
Robert Schulze
e3896a31c6
Upgrade to v0.9.8 2024-02-07 15:56:01 +00:00
Robert Schulze
ae7dcdffd8
Undo terrible silent patching 2024-02-07 15:46:08 +00:00
Antonio Andelic
dd3db5d092 Merge branch 'master' into keeper-logs-cache 2024-02-05 16:56:09 +01:00
Antonio Andelic
b0fde3828b Merge branch 'master' into keeper-logs-cache 2024-02-05 16:55:46 +01:00
Raúl Marín
10efb30e65 Fix aws submodule reference 2024-02-05 10:55:13 +01:00
jinjunzh
ef65864ba3 upgrade to qpl 1.4.0 2024-02-04 13:10:24 -05:00
Alexey Milovidov
6100e4a0ca
Merge pull request #59479 from ClickHouse/revert-59386-update_libxml2 
Revert "Update libxml2 version to address some bogus security issues"
 2024-02-01 19:21:25 +01:00
Alexey Milovidov
847eb86298
Merge pull request #59299 from nickitat/upd_aws_sdk 
Update AWS SDK to 1.11.234
 2024-02-01 19:20:42 +01:00
Raúl Marín
e6061fa9f9
Revert "Update libxml2 version to address some bogus security issues" 2024-02-01 14:46:16 +01:00
Antonio Andelic
b53abf8186 Finalize 2024-02-01 10:04:34 +00:00
Alexey Milovidov
0fca83f5f3
Merge pull request #59309 from aris-aiven/aris-fix-corrosion-cmake-osx 
Update condition required to define Rust target toolchain in corrosion-cmake
 2024-01-31 23:50:54 +01:00
Alexey Milovidov
554bb5668e
Merge pull request #59384 from ClibMouse/update_curl_to_8.50 
update curl submodule to be version 8.50 to address CVE-2023-46218 and CVE-2023-49219
 2024-01-31 20:14:06 +01:00
Alexey Milovidov
f3b539dcf6
Merge pull request #59386 from ClibMouse/update_libxml2 
Update libxml2 version to address some bogus security issues
 2024-01-31 20:13:47 +01:00
Joshua Hildred
b379adde92 Include proper version information 2024-01-30 07:23:13 -08:00
Raúl Marín
1b748fc7b2 Fixes 2024-01-30 10:18:59 +01:00
Nikita Taranov
0677f1f439
Merge branch 'master' into upd_aws_sdk 2024-01-29 22:13:17 +01:00
Joshua Hildred
432fab621f upgrade libxml2 to 12.4 to avoid security issues 2024-01-29 11:27:03 -08:00
Raúl Marín
48061dee94 Merge remote-tracking branch 'blessed/master' into jit_sanitizer 2024-01-29 18:51:46 +01:00
Alexey Milovidov
037d8ef7b2
Merge pull request #59166 from rschu1ze/simdjson-3.6.3 
Upgrade simdjson to v3.6.3
 2024-01-29 18:36:17 +01:00
Aris Tritas
2fa1aebe51
Update condition required to define Rust target toolchain in corrosion-cmake 
The `CMAKE_TOOLCHAIN_FILE` variable is used for cross-compilation. Currently,
the build is blocked when it's unset. Keep the default Rust target toolchain
variable unless the CMake toolchain variable is set.
 2024-01-29 13:54:44 +01:00
Raúl Marín
71e5ee81d8 Enable JIT with UBSAN 2024-01-29 13:36:58 +01:00
Alexey Milovidov
a7483ec10b
Merge pull request #59242 from rschu1ze/dont-force-libssh-on-me 
Make libssh build dependent on `-DENABLE_LIBRARIES`
 2024-01-29 00:02:03 +01:00
Nikita Taranov
368a26a2aa fix build 2024-01-28 15:48:49 +01:00
Maksim Alekseev
b3b2b7a1e6 Fix architecture name in select of Rust target 2024-01-28 17:29:08 +03:00
Nikita Taranov
b54be00783 fix build 2024-01-28 14:36:22 +01:00
Nikita Taranov
bade45d197 impl 2024-01-27 21:30:49 +01:00
Joshua Hildred
8944e7a0b1 update curl submodule to be version 8.50 to address CVE-2023-48795 2024-01-27 12:20:49 -08:00
Azat Khuzhin
50f0a34ecb Enable Rust on OSX 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-01-26 17:20:00 +01:00
Robert Schulze
caeb31940c
Allow to build without libssl 2024-01-25 21:14:03 +00:00
Robert Schulze
383ae86ebb
Upgrade simdjson to v3.6.3 
See https://github.com/ClickHouse/ClickHouse/issues/38621#issuecomment-1908219067
 2024-01-24 15:06:30 +00:00
Alexander Tokmakov
01d9b9a28a add a comment about sparse checkout 2024-01-18 19:22:20 +01:00
Antonio Andelic
b3dc2f6870
Merge pull request #58648 from ClickHouse/jemalloc-disable-muzzy-decay 
Try disabling `muzzy_decay_ms` in jemalloc
 2024-01-17 16:23:25 +01:00
Kruglov Pavel
c701633955
Merge pull request #58805 from ucasfl/avro-zstd 
Avro format support Zstd codec
 2024-01-17 14:55:54 +01:00
flynn
b542b1ac69 update submodule 2024-01-16 02:27:08 +00:00
flynn
20dbe652ae Avro format support zstd codec 2024-01-15 09:14:18 +00:00
Alexey Milovidov
3b1cc5179b Fix error 2024-01-14 08:05:57 +01:00
Robert Schulze
996527e312
Update NuRaft 2024-01-10 19:22:24 +00:00
Robert Schulze
d2187f6512
Don't delete header 2024-01-10 19:10:10 +00:00
Robert Schulze
04f2872abb
Remove <regex> from libcxx 2024-01-10 17:39:07 +00:00
Robert Schulze
a0128e0f51
Merge pull request #58544 from rschu1ze/sqid-decode 
Add `sqidDecode()` function
 2024-01-10 13:47:13 +01:00
Antonio Andelic
f7d171e6a3 Try disabling muzzy_decay_ms 2024-01-10 11:10:30 +00:00
Robert Schulze
ced9e93ac6
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main 2024-01-09 20:36:02 +00:00
jinjunzh
cf53d9a17c add USE_QAT into build_options 2024-01-08 11:05:36 -05:00
Robert Schulze
fb4fd29110
Merge pull request #58454 from rschu1ze/punycode-revert-revert 
Implement IDNA and punycode encoding/decoding (2nd attempt)
 2024-01-08 14:26:03 +01:00
Robert Schulze
0f51e32bb5
Rename from ZSTDQPL to ZSTD_QPL 2024-01-07 17:47:31 +00:00
Robert Schulze
21d14e488b
Cosmetics 2024-01-07 16:47:12 +00:00
Robert Schulze
53965bb9f1
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main 2024-01-07 14:11:22 +00:00
Robert Schulze
394ade4080
Update submodule 2024-01-05 22:01:35 +00:00
Antonio Andelic
e2944890f2 Use master commit 2024-01-05 10:28:08 +00:00
Antonio Andelic
13749f550f Lower log levels for some Raft logs 2024-01-04 07:59:44 +00:00
Robert Schulze
2186aa8f21
Revert "Revert "Implement punycode encoding/decoding"" 
This reverts commit 345d29a3c1.
 2024-01-03 08:03:01 +00:00
Alexey Milovidov
59cbae885e Implement the missing parts 2024-01-01 18:30:06 +01:00
Alexey Milovidov
691803cc94 Merge branch 'master' into mysql-macos 2024-01-01 17:59:26 +01:00
Alexey Milovidov
345d29a3c1
Revert "Implement punycode encoding/decoding" 2023-12-28 09:12:22 +03:00
Robert Schulze
2f1c22a4aa
Maybe fix the build, maybe not fix it 2023-12-20 15:32:33 +00:00
jinjunzh
372de8a046 refine patch 2023-12-20 10:12:24 -05:00
Robert Schulze
5de255b3df
*wip* Bump Azure to 1.7.2 2023-12-20 14:11:44 +00:00
Robert Schulze
4000342b9e
Bump Azure to 1.6.0 2023-12-20 11:17:54 +00:00
Robert Schulze
7cf2a62c7e
Bump Azure to 1.5.0 2023-12-20 11:17:51 +00:00
Robert Schulze
4547e60c9d
Bump Azure to v1.4.0 2023-12-20 11:17:48 +00:00
Robert Schulze
ecb6f31211
Merge pull request #57969 from rschu1ze/punycode-is-cool 
Implement punycode encoding/decoding
 2023-12-20 10:20:34 +01:00
Raúl Marín
80af5cb78a Always build the necessary LLVM modules if blake3 is enabled 2023-12-18 18:32:31 +01:00
Robert Schulze
19c8ac567f
Implement punycodeEncode()/Decode() 2023-12-17 17:04:28 +00:00
Julia Kartseva
7a5b40563a
Merge pull request #57574 from ClibMouse/dev-seriesPeriodDetect 
Revert "Revert "Implemented series period detect method using pocketfft lib""
 2023-12-14 21:10:23 -08:00
jinjunzh
5e1b048e52 refine ZSTDQAT code name 2023-12-13 11:02:06 -05:00
jinjunzh
b4a945ec89 update mqueue.h for build conflict 2023-12-13 10:41:46 -05:00
jinjunzh
846cbc1abe fixed header issue 2023-12-12 18:22:56 -05:00
jinjunzh
d2c4726a46 add a copied features.h 2023-12-12 16:11:21 -05:00
Ilya Golshtein
b31816cc90 atomic_set_in_librdkafka: update librdkafka submodule 2023-12-12 16:48:13 +00:00
jinjunzh
0d788b8dd1 refine defect 2023-12-12 11:27:24 -05:00
jinjunzh
3771acdefb fixed reported code issues 2023-12-12 11:15:11 -05:00
jinjunzh
969c63df83 refine cmake for header issue 2023-12-11 17:56:03 -05:00
jinjunzh
f90953ccc4 refine cmake for header build 2023-12-11 17:54:39 -05:00
jinjunzh
8b6d6d52d4 refine cmake for header 2023-12-11 16:37:49 -05:00
Alexey Milovidov
3d03a44f15 Merge branch 'master' into rschu1ze-azure-darwin2 2023-12-10 01:43:35 +01:00
Alexey Milovidov
b6e3e5691c Fix Musl build 2023-12-09 18:58:35 +01:00
Alexey Milovidov
0157066fc5 Merge branch 'master' into musl-7 2023-12-09 15:19:38 +01:00
Alexey Milovidov
89cce44814 Cut useless code 2023-12-08 23:20:20 +01:00
Alexey Milovidov
57b740f84b Disable iconv in libxml2 2023-12-08 22:14:24 +01:00
Alexey Milovidov
d9520eefb5
Revert "Revert "Update Sentry"" 2023-12-08 22:53:09 +03:00
Bhavna Jindal
1f58b0f150
Merge branch 'master' into dev-seriesPeriodDetect 2023-12-08 10:26:39 -05:00
Alexey Milovidov
7bc7159a3d Update submodule 2023-12-08 03:35:55 +01:00
Alexey Milovidov
063f08cc5d Merge branch 'master' into rschu1ze-azure-darwin2 2023-12-08 03:34:02 +01:00
Alexey Milovidov
15a0e6ab05 Merge branch 'master' into musl-7 2023-12-08 03:19:55 +01:00
jinjunzh
c1c46b655f add build flag to avoid incompatible integer conversion 2023-12-05 18:02:05 -05:00
jinjunzh
f302ba0e31 Implement hardware-assisted(QAT) ZSTD compression 2023-12-05 17:47:18 -05:00
Robert Schulze
f56dd6561f
Merge remote-tracking branch 'rschu1ze/master' into revert-revert-sqid 2023-12-05 18:41:10 +00:00
Alexey Milovidov
d7d83c99e5
Revert "Implemented series period detect method using pocketfft lib" 2023-12-05 18:17:07 +03:00
Robert Schulze
a2cd240317
Revert "Revert "Add sqid() function"" 
This reverts commit 8d5d0ef38f.
 2023-12-05 10:50:30 +00:00
Alexey Milovidov
8d5d0ef38f
Revert "Add sqid() function" 2023-12-05 13:45:33 +03:00
awakeljw
6c70e32da1 rename squids to sqids 2023-12-04 11:26:55 +08:00
Robert Schulze
f6036fbb29
Some fixups 2023-12-03 16:20:59 +00:00
awakeljw
06241de257 fix codes according to the reviews 2023-12-03 22:00:42 +08:00
awakeljw
e5a72f15dd support sqids 2023-12-02 21:12:48 +08:00
robot-ch-test-poll
1b49463bd2
Merge pull request #55841 from nickitat/optimize_reading3 
Optimize reading from cache
 2023-12-01 17:36:57 +01:00
jasperzhu
aefc2f1ce4
Merge branch 'ClickHouse:master' into iaadeflate_upgrade_qpl_v1.3.0 2023-11-29 09:00:03 +08:00
Alexander Tokmakov
3ff7aa8dec
Merge pull request #57231 from jsc0218/FixLibpqxxMemLeak 
Update Libpqxx for Mem Leak
 2023-11-28 22:50:30 +01:00
Nikita Taranov
03450d5077 merge fixes 2023-11-28 18:24:05 +01:00
jinjunzh
3b7811342d upgrade qpl to 1.3.1 and fix qpl_deflate codec bug for the case of BOF=0 2023-11-28 11:39:15 -05:00
Nikita Taranov
52f644c0df Merge branch 'master' into optimize_reading3 2023-11-28 16:36:38 +01:00
János Benjamin Antal
4c2451f837
Merge pull request #56741 from ClickHouse/well-known-protos 2023-11-28 15:21:15 +01:00
Alexey Milovidov
49d4a90a0e Merge branch 'master' of github.com:ClickHouse/ClickHouse into musl-7 2023-11-26 17:55:17 +01:00
jsc0218
96a445d3ac Update Libpqxx for Mem Leak 2023-11-26 02:12:41 +00:00
Alexey Milovidov
e60941f7c5
Revert "Update Sentry" 2023-11-26 04:30:05 +03:00
Alexey Milovidov
9621c519e1 Clarifications 2023-11-26 02:27:54 +01:00
Alexey Milovidov
6d4af13f91 Update HDFS 2023-11-26 02:27:54 +01:00
Alexey Milovidov
6effb1311f Compatibility with Musl in HDFS and RocksDB 2023-11-26 02:27:53 +01:00
Alexey Milovidov
043e9239d6 Update Azure and Sentry 2023-11-26 02:27:53 +01:00
Alexey Milovidov
e5dd78a9e8
Merge pull request #57222 from ClickHouse/update-sentry 
Update Sentry
 2023-11-25 22:53:27 +01:00
Alexey Milovidov
1e00048cf7 Update Sentry 2023-11-25 19:11:52 +01:00
Alexey Milovidov
2222d8cbf2 Update Sentry 2023-11-25 18:47:21 +01:00
Alexey Milovidov
5eb3cafb52 libunwind: fix slowness under Musl 2023-11-25 16:21:17 +01:00
Alexey Milovidov
143617e303 Remove garbage 2023-11-25 16:21:17 +01:00
Alexey Milovidov
de52ddf3bb Merge branch 'master' into rschu1ze-azure-darwin2 2023-11-22 20:26:47 +01:00
Julia Kartseva
753b22f64c
Merge pull request #56171 from ClibMouse/dev-seriesPeriodDetect 
Implemented series period detect method using pocketfft lib
 2023-11-22 09:49:58 -08:00
János Benjamin Antal
6f652133a8 Install well-known protobuf types 2023-11-22 12:39:29 +00:00
Robert Schulze
304b636208
Fix gRPC build fix on Mac 
Fixes #57050
 2023-11-21 16:28:27 +01:00
Bhavna Jindal
ad99cb902f changed method name, updated pocketfft repo reference 2023-11-21 06:52:47 -08:00
Bhavna Jindal
e3826786f1 Added testcases, documentation and addressed comments 2023-11-21 06:52:47 -08:00
Bhavna Jindal
2235adcae5 Implemented series periods detect method using pocketfft lib 2023-11-21 06:52:47 -08:00
Alexey Milovidov
6a1955cb34 Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove-useless-install 2023-11-20 21:34:31 +01:00
Mikhail f. Shiryaev
c3a3cf8d24
Make check for the limited cmake dependencies the part of sparse checkout 2023-11-20 13:08:49 +01:00
Robert Schulze
5ec626127b
Merge pull request #56857 from AVMusorin/fix-update-submodules 
Sparse checkout: Use `--remote` for `git submodule update`
 2023-11-20 12:53:22 +01:00
Aleksandr Musorin
f9a8df4296 Added comment to prevent using --remote to update submodules 2023-11-20 11:44:21 +01:00
Alexey Milovidov
b205d4919d Remove garbage 2023-11-20 01:24:28 +01:00
Alexey Milovidov
b772189fc1 Merge branch 'master' into own-cmake-for-grpc 2023-11-19 16:17:49 +01:00
Alexey Milovidov
3213443ee2 Own CMake for GRPC 2023-11-19 15:42:35 +01:00
Alexey Milovidov
f27018c141 Own CMake for GRPC 2023-11-19 15:21:11 +01:00
Robert Schulze
cb913821fc
Merge pull request #56861 from rschu1ze/cpu_features 
CMake: Small cleanup in cpu_features.cmake
 2023-11-18 18:29:40 +01:00
Robert Schulze
fcce5409f4
Simplify 2023-11-17 17:02:52 +00:00
Alexey Milovidov
01000e8b9e Merge with master 2023-11-17 14:57:02 +01:00
Alexey Milovidov
9b9b0a0b9a Merge branch 'master' into simpler-cmake 2023-11-17 14:44:55 +01:00
Robert Schulze
882d0d17f1
Merge remote-tracking branch 'rschu1ze/master' into bump-grpc-and-protobuf 2023-11-17 11:48:16 +00:00
Alexey Milovidov
4f441ec131 Own CMake for Abseil 2023-11-17 11:32:27 +01:00
Alexey Milovidov
c65607484e Remove garbage 2023-11-17 10:03:10 +01:00
Alexey Milovidov
864dd32b05 Remove garbage 2023-11-17 09:48:42 +01:00
Alexey Milovidov
df3c066591 Remove more trash 2023-11-17 08:42:39 +01:00
Alexey Milovidov
224b282d94 Remove garbage 2023-11-17 08:27:19 +01:00
Alexey Milovidov
c72136b123 Simpler CMake 2023-11-17 08:07:32 +01:00
Alexey Milovidov
482d8ca9d8
Merge pull request #56102 from ClickHouse/coverage 
Granular code coverage with introspection
 2023-11-16 23:23:40 +01:00
Robert Schulze
b13cd9792b
Fix cross build 2023-11-16 14:46:57 +00:00
Robert Schulze
e8c14562ab
Bump absl to HEAD 2023-11-16 11:50:25 +00:00
Robert Schulze
a0934253de
Bump protobuf to v24.4 2023-11-16 11:44:10 +00:00
Robert Schulze
ac7fd357e4
Bump protobuf to v23.2 2023-11-16 11:07:19 +00:00
Robert Schulze
a250c2bb08
Bump gRPC to v1.59.2 2023-11-16 11:07:15 +00:00
Robert Schulze
1ba408eb0b
Bump gRPC to v1.58.2 2023-11-16 11:07:11 +00:00
Robert Schulze
a49db81b9f
Bump gRPC to v1.57.1 2023-11-16 11:07:07 +00:00
Robert Schulze
649d734409
Bump gRPC to v1.56.3 2023-11-16 11:07:03 +00:00
Robert Schulze
8fe093c355
Merge pull request #56664 from rschu1ze/bump-grpc 
Bump gRPC to v1.55.4 and protobuf to v22.5
 2023-11-16 12:05:43 +01:00
Alexey Milovidov
671a401ded Ask linker to remove garbage from external libraries 2023-11-15 12:26:14 +01:00
Robert Schulze
e8eb425ff8
Try to fix new calamities with cross-compilation 2023-11-14 15:13:37 +00:00
Igor Nikonov
ecef6db1fe
Fix: RabbitMQ OpenSSL dynamic loading issue (#56703) 
* Fix: RabbitMQ OpenSSL dynamic loading issue
* Update RabbitMQ
* Fix minor glitch with TLS_client_method()
00f09897ce

---------

Co-authored-by: Robert Schulze <robert@clickhouse.com>
 2023-11-14 15:36:50 +01:00
Robert Schulze
cf7f155ce9
Bump gRPC to v1.55.4 and protobuf to v22.5 2023-11-14 12:01:37 +00:00
Alexey Milovidov
4e3e8e32fd Remove more garbage 2023-11-14 07:24:41 +01:00
Alexey Milovidov
80bbe7dcc6 Less CMake checks 2023-11-14 06:55:06 +01:00
Alexey Milovidov
3ef14f6098 Merge branch 'master' of github.com:ClickHouse/ClickHouse into coverage 2023-11-14 06:08:32 +01:00
Robert Schulze
44830555da
Merge pull request #56671 from Algunenano/revert_grpc 
gRPC: remove build dependency on systemd
 2023-11-13 23:28:54 +01:00
Alexey Milovidov
2ad98a58c9
Better caching of arrow build (#56657) 
* Better caching of Arrow build
* Fix error
* Remove useless files
 2023-11-13 16:51:01 +01:00
Robert Schulze
ed7bfeff69 Update gRPC to not include systemd 2023-11-13 16:27:48 +01:00
Robert Schulze
51e8c58a38 Revert "Revert "Merge pull request #56543 from rschu1ze/bump-grpc"" 
This reverts commit d4840adfd4708729ed8f969e61116f58ffe2fb18.
 2023-11-13 16:27:48 +01:00
Raúl Marín
993f752900 Revert "Merge pull request #56543 from rschu1ze/bump-grpc" 
This reverts commit 213c7cffb5, reversing
changes made to 9ed47749de.
 2023-11-13 16:27:48 +01:00
Kruglov Pavel
b1eb80a478
Merge pull request #54800 from Avogar/update-arrow 
Update arrow to release-13.0.0
 2023-11-13 14:36:33 +00:00
Alexey Milovidov
70d7ef0ca4
Merge pull request #56654 from ClickHouse/Remove-garbage-from-libssh 
Remove garbage from libssh
 2023-11-13 10:18:01 +01:00
Alexey Milovidov
33a33f5c0a Delete a file 2023-11-13 07:06:52 +01:00
Alexey Milovidov
5b3742221a Remove garbage from libssh 2023-11-13 06:30:24 +01:00
Robert Schulze
28dbfb94c2
Bump gRPC to v1.54.3 2023-11-12 10:56:25 +00:00
Robert Schulze
c75497e746
Bump gRPC to v1.53.2 2023-11-12 10:56:25 +00:00
Robert Schulze
a77f9ce7b2
Bump gRPC to v1.52.2 2023-11-12 10:56:25 +00:00
Robert Schulze
f6b001444c
Bump gRPC to 1.51.3 2023-11-12 10:56:24 +00:00
Robert Schulze
528c5a2c0a
Bump gRPC to 1.50.3 2023-11-12 10:56:24 +00:00
Robert Schulze
f017b2d083
Bump gRPC to v1.49.3 2023-11-12 10:56:24 +00:00
Robert Schulze
6e5407f875
Bump gRPC to v1.48.4 2023-11-12 10:56:24 +00:00
Antonio Andelic
ba7b684810
Merge pull request #53481 from myrrc/fix/reconfig-leader-replace 
Keeper `reconfig`: add timeout before yielding/taking leadership
 2023-11-10 09:32:40 +01:00
Mike Kot
785183bb3c Keeper reconfig -- sleep before removing leader to avoid losing accepted 
but uncommitted commands
 2023-11-09 16:22:44 +00:00
Robert Schulze
f5786cf417
Merge remote-tracking branch 'rschu1ze/master' into parallel-submodules 2023-11-09 15:10:23 +00:00
Robert Schulze
44d5617325
12.7% more aesthetic 2023-11-09 14:25:59 +00:00
Robert Schulze
93d8fc231c
Try to fix invocation from outside 2023-11-09 11:39:50 +00:00
Robert Schulze
fe397a3110
Parallelize with xargs 2023-11-09 10:17:49 +00:00
Robert Schulze
fa470b16e5
Parallel clone sparse/shallow submodules 
(buzzword overload in the title, sorry)

Script update-submodules.sh does a sparse and shallow checkout of
submodules. It is offered as convenience for developers who want to
avoid long checkout times and save disk space. The script is called by a
few build jobs in CI to check that it doesn't break. This PR
parallelizes the actual checkout which reduces script runtime from 425
sec to 258 sec.
 2023-11-08 20:02:40 +00:00
Robert Schulze
b9fafb5561
Try to fix sparse checkout 2023-11-08 17:18:05 +00:00
Robert Schulze
85c1588941
Bump gRPC to 1.47.5 2023-11-07 19:53:01 +00:00
Robert Schulze
a1a9cb7577
Bump gRPC to v1.44.1 2023-11-07 19:52:59 +00:00
Robert Schulze
4fe99c77c7
Bump gRPC to v1.43.2 2023-11-07 19:52:58 +00:00
Alexey Milovidov
cd94d02455 Merge branch 'master' into coverage 2023-11-04 21:49:59 +01:00
Alexey Milovidov
788863898d Add an option to disable libssh 2023-11-04 17:10:58 +01:00
avogar
15cb8d1b89 Fix use-of-unitialized-value 2023-11-03 13:16:08 +00:00
jsc0218
7828a4ba85
Merge pull request #56241 from YuanHanzhong/master 
Fix doc typo
 2023-11-02 21:10:18 -04:00
Raúl Marín
f4296962c6 Fix ORC commit 2023-11-02 13:17:19 +00:00
袁焊忠
47d9b0e6a1
[hotfix] [docs] Fix typo 2023-11-02 15:56:45 +08:00
MeenaRenganathan22
568e5d98d1 Update the libhdfs3 submodule 2023-11-01 06:19:19 -07:00
avogar
f53fdbeead Fix vuild for s390 2023-10-30 19:11:03 +00:00
MeenaRenganathan22
92c1dce57a Changes to support the HDFS for s390x 2023-10-30 08:49:55 -07:00
avogar
136f984154 Update arrow to release-13.0.0 2023-10-30 10:52:57 +00:00
Alexey Milovidov
70e3dd808c Granular code coverage with introspection 2023-10-29 02:07:24 +01:00
Nikita Taranov
213ce63ffb
Merge branch 'master' into optimize_reading3 2023-10-28 00:04:20 +02:00
Alexey Milovidov
0794f1faa7
Merge pull request #55775 from kitaisreal/decimal-column-improve-get-permutation-revert-revert 
Improve ColumnDecimal, ColumnVector getPermutation performance using pdqsort with RadixSort fix
 2023-10-26 12:36:57 +02:00
Maksim Kita
aa5fc05a55 Revert "Merge pull request #55682 from ClickHouse/revert-35961-decimal-column-improve-get-permutation" 
This reverts commit f6dee5fe3c, reversing
changes made to f96bda1deb.
 2023-10-25 21:48:13 +03:00
Robert Schulze
50c92dfe11
Update protobuf to v21.9 2023-10-25 11:56:29 +00:00
李扬
465962df7f
Support orc filter push down (file + stripe + rowgroup level) (#55330) 
* support orc filter push down

* update orc lib version

* replace setqueryinfo with setkeycondition

* fix issue https://github.com/ClickHouse/ClickHouse/issues/53536

* refactor source with key condition

* fix building error

* remove std::cout

* update orc

* update orc version

* fix bugs

* improve code

* upgrade orc lib

* fix code style

* change as requested

* add performance tests for orc filter push down

* add performance tests for orc filter push down

* fix all bugs

* fix default as null issue

* add uts for null as default issues

* upgrade orc lib

* fix failed orc lib uts and fix typo

* fix failed uts

* fix failed uts

* fix ast fuzzer tests

* fix bug of uint64 overflow in https://s3.amazonaws.com/clickhouse-test-reports/55330/de22fdcaea2e12c96f300e95f59beba84401712d/fuzzer_astfuzzerubsan/report.html

* fix asan fatal caused by reused column vector batch in native orc input format. refer to https://s3.amazonaws.com/clickhouse-test-reports/55330/be39d23af2d7e27f5ec7f168947cf75aeaabf674/stateless_tests__asan__[4_4].htm

* fix wrong performance tests

* disable 02892_orc_filter_pushdown on aarch64. https://s3.amazonaws.com/clickhouse-test-reports/55330/be39d23af2d7e27f5ec7f168947cf75aeaabf674/stateless_tests__aarch64_.html

* add some comments

* add some comments

* inline range::equals and range::less

* fix data race of key condition

* trigger ci
 2023-10-24 12:08:17 -07:00
Robert Schulze
57df56733f
Merge pull request #55963 from rschu1ze/bump-protobuf 
Bump protobuf to v3.19.6
 2023-10-24 19:20:30 +02:00
Robert Schulze
a962161832
Bump to 3.19.6 2023-10-24 10:22:58 +00:00
Robert Schulze
666f854b27
Bump protobuf to 3.19.3 2023-10-24 10:00:02 +00:00
Robert Schulze
430559c328
Merge remote-tracking branch 'rschu1ze/master' into grpc-1.42.0 2023-10-24 09:16:31 +00:00
Nikita Taranov
3320b12e59
impl (#55787) 2023-10-23 20:50:40 +02:00
Kruglov Pavel
32da07b4ee
Merge pull request #55695 from Avogar/restrict-iceberg 
Fixes and improvements for Iceberg storage
 2023-10-23 13:58:23 +02:00
Robert Schulze
20316c34e9
Bump gRPC to v1.42.0 2023-10-22 20:25:43 +00:00
Robert Schulze
d450314d27
Fix include 2023-10-22 15:40:45 +00:00
Robert Schulze
b2bdb58c09
Bump gRPC to v1.39.1 2023-10-22 15:23:58 +00:00
Nikita Taranov
2a6a97c1fa read sync from cache 2023-10-20 22:24:56 +02:00
Robert Schulze
5a44efb64e
Bump gRPC to v1.37.1 2023-10-19 15:44:23 +00:00
Robert Schulze
f18622b48b
Bump gRPC to 1v.36.4 2023-10-19 09:12:14 +00:00
monchickey
3ef092f83f
Fix the compilation error that occurs when opening avx series instructions (#55049) 
* fix the compilation error that occurs when opening avx series instructions

cmake command example:
```shell
cmake .. -DCMAKE_BUILD_TYPE=Release -DENABLE_AVX=ON -DENABLE_AVX2=ON -DENABLE_AVX2_FOR_SPEC_OP=ON
```

* Update snappy CMakeLists.txt add SNAPPY_HAVE_X86_CRC32 parameter
 2023-10-18 15:04:27 +02:00
Robert Schulze
2c82329ef7
Update submodule 2023-10-17 17:33:23 +00:00