alesapin
444ad67663
Merge pull request #26972 from ClickHouse/fix_zookeeper_log_initialization
...
Fix system.zookeeper_log initialization
2021-07-30 12:24:19 +03:00
PHO
6425dd001a
Add a codec AES_128_GCM_SIV for encrypting columns on disk ( #19896 )
...
* Add a codec Encrypted() for encrypting columns on disk
While this is implemented as a compression codec, it does not actually compress data. It instead encrypts data on disk. The key is obtained by executing a user-specified command at the server startup, or if it's not specified the codec refuses to process any data. For now the only supported cipher is 'AES-128-GCM-SIV'.
2021-07-30 12:12:33 +03:00
Alexander Tokmakov
47995a053e
fix system.zookeeper_log initialization
2021-07-29 17:48:49 +03:00
Realist007
31e26862b5
Merge branch 'master' into feature/create-simple-lambda-function
2021-07-21 10:33:53 +03:00
ANDREI STAROVEROV
7966bded6c
Add storing on disk for created functions
2021-07-20 23:20:23 +03:00
Amos Bird
dbfb699690
Asynchronously drain connections.
2021-07-19 21:53:29 +08:00
Ivan Lezhankin
ab26aed6f9
Merge remote-tracking branch 'upstream/master' into async-insert
2021-07-13 13:54:09 +03:00
Artur
1e90287e9a
Adding tests for system.warnings
2021-07-12 10:57:39 +00:00
mergify[bot]
b7ae4e4ced
Merge branch 'master' into async-insert
2021-07-12 09:21:37 +00:00
Alexey Milovidov
dfe7f2df8b
Simplification
2021-07-10 05:59:11 +03:00
Alexey Milovidov
8b9ed584cd
Merge branch 'master' into dynamic-tls-v20
2021-07-10 05:58:05 +03:00
Alexey Milovidov
9b299fbb56
Simplification
2021-07-10 05:57:44 +03:00
Artur
8113580237
Add warning in debug mode
2021-07-09 14:40:32 +00:00
Alexey Milovidov
e52680479e
Twiddling
2021-07-07 02:15:30 +03:00
alexey-milovidov
9290182112
Update Server.cpp
2021-07-07 01:14:00 +03:00
alexey-milovidov
303c38cb6f
Merge branch 'master' into dynamic-tls-v20
2021-07-07 01:13:03 +03:00
Alexey Milovidov
d437ec2e1d
Merge branch 'master' into system-metrics
2021-07-05 03:03:07 +03:00
Alexey Milovidov
c059d0a0ee
More metrics
2021-07-05 01:41:09 +03:00
Maksim Kita
da8c957167
Aggregator added CompiledExpressionCache
2021-07-01 22:56:36 +03:00
Ivan Lezhankin
d7126682b0
Fix shared build
2021-06-29 15:05:46 +03:00
Ivan Lezhankin
1bb41593d1
Merge remote-tracking branch 'upstream/master' into async-insert
2021-06-28 22:55:56 +03:00
alexey-milovidov
7a0cddcb4c
Merge pull request #25569 from oxidecomputer/master
...
Resolves actual port bound when user requests any available
2021-06-23 22:47:01 +03:00
Alexey Milovidov
dbb2532e88
Minor change
2021-06-23 02:02:57 +03:00
Benjamin Naecker
3275a53723
Resolves the actual port a server binds, in the case the user requests
...
any available port from the OS.
2021-06-21 12:36:32 -07:00
Ivan Lezhankin
37365589ed
Merge branch 'master' into async-insert
2021-06-17 16:57:45 +03:00
Maksim Kita
67e9b85951
Merge ext into common
2021-06-16 23:28:41 +03:00
Ivan Lezhankin
973cea73b7
Merge branch 'master' into async-insert
2021-06-08 15:10:30 +03:00
Amos Bird
9dfa4c06bd
Try reusing built sets during multi-pass analysis
2021-06-03 22:06:05 +08:00
Ivan Lezhankin
791cbcf0b1
Merge remote-tracking branch 'upstream/master' into async-insert
2021-06-02 18:50:37 +03:00
Ivan Lezhankin
84c23dc060
Merge branch 'master' into async-insert
2021-06-02 18:06:21 +03:00
kssenii
f66c67a979
Fixes
2021-05-27 15:42:46 +03:00
kssenii
9b8df78fdd
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
2021-05-17 17:42:05 +03:00
kssenii
2124113aa2
Update programs/*
2021-05-17 01:06:09 +03:00
Azat Khuzhin
aeb2c5d88a
Preserve dictionaries until storage shutdown
...
v2: Context::loadEmbeddedDictionaries()
v3: Context::loadDictionaries()
2021-05-13 22:03:00 +03:00
Amos Bird
264cff6415
Projections
...
TODO (suggested by Nikolai)
1. Build query plan fro current query (inside storage::read) up to WithMergableState
2. Check, that plan is simple enough: Aggregating - Expression - Filter - ReadFromStorage (or simplier)
3. Check, that filter is the same as filter in projection, and also expression calculates the same aggregation keys as in projection
4. Return WithMergableState if projection applies
3 will be easier to do with ActionsDAG, cause it sees all functions, and dependencies are direct (but it is possible with ExpressionActions also)
Also need to figure out how prewhere works for projections, and
row_filter_policies.
wip
2021-05-11 18:12:23 +08:00
alexey-milovidov
066acc71b6
Merge pull request #8482 from ClickHouse/enable-compile-expressions
...
Enable "compile_expressions" by default
2021-05-10 21:09:18 +03:00
Azat Khuzhin
57f97a6a29
Add OS name/version/architecture into log
...
Mostly to print linux kernel version in the logs for various issues.
2021-05-10 08:50:14 +03:00
Maksim Kita
c79d7eae21
Refactored interfaces
2021-05-08 17:39:35 +03:00
Alexey Milovidov
cdef8f33d8
Fix segfault in TSan on _exit
2021-04-25 06:06:38 +03:00
Ivan Lezhankin
484528ba2c
Fix problem with use-after-free inside shared_ptr
2021-04-21 16:19:28 +03:00
Ivan
10c5ba3022
Merge branch 'master' into async-insert
2021-04-20 17:58:15 +03:00
Ivan Lezhankin
a36596e303
Add settings
2021-04-19 22:16:34 +03:00
Ivan Lezhankin
6ed9e34750
[WIP]
2021-04-19 17:51:26 +03:00
Azat Khuzhin
bc5d953ef6
Report an error if jemalloc.background_thread was requested
2021-04-18 23:36:42 +03:00
Azat Khuzhin
c849686b16
Fix current connections count with shutdown_wait_unfinished=0
2021-04-13 21:37:38 +03:00
Azat Khuzhin
8cb0bb4ca8
Fix SIGSEGV by waiting servers thread pool
...
It is easy to reproduce with shutdown_wait_unfinished=0:
=================================================================
==13442==ERROR: AddressSanitizer: heap-use-after-free on address 0x611000210f30 at pc 0x00000a8e55a0 bp 0x7fff2b83e270 sp 0x7fff2b83e268
WRITE of size 8 at 0x611000210f30 thread T2 (TCPHandler)
0 0xa8e559f in long std::__1::__cxx_atomic_fetch_add<long>(std::__1::__cxx_atomic_base_impl<long>*, long, std::__1::memory_order) obj-x86_64-linux-gnu/../contrib/libcxx/include/atomic:1050:12
1 0xa8e559f in std::__1::__atomic_base<long, true>::fetch_add(long, std::__1::memory_order) obj-x86_64-linux-gnu/../contrib/libcxx/include/atomic:1719:17
2 0xa8e559f in MemoryTracker::alloc(long) obj-x86_64-linux-gnu/../src/Common/MemoryTracker.cpp:146:35
3 0xa8e510c in MemoryTracker::alloc(long) obj-x86_64-linux-gnu/../src/Common/MemoryTracker.cpp
4 0xa90b474 in DB::ThreadStatus::~ThreadStatus() obj-x86_64-linux-gnu/../src/Common/ThreadStatus.cpp:92:28
5 0x1f90ee83 in DB::TCPHandler::runImpl() obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:450:1
6 0x1f92dcac in DB::TCPHandler::run() obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:1492:9
7 0x25bdc2fe in Poco::Net::TCPServerConnection::start() obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerConnection.cpp:43:3
8 0x25bdce1b in Poco::Net::TCPServerDispatcher::run() obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerDispatcher.cpp:113:19
9 0x25e9c784 in Poco::PooledThread::run() obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/ThreadPool.cpp:199:14
10 0x25e96cd6 in Poco::ThreadImpl::runnableEntry(void*) obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/Thread_POSIX.cpp:345:27
11 0x7ffff7f723e8 in start_thread (/usr/lib/libpthread.so.0+0x93e8)
12 0x7ffff7ea0292 in clone (/usr/lib/libc.so.6+0x100292)
0x611000210f30 is located 112 bytes inside of 216-byte region [0x611000210ec0,0x611000210f98)
freed by thread T0 here:
0 0xa845d02 in operator delete(void*, unsigned long) (/src/ch/tmp/upstream/clickhouse-asan+0xa845d02)
1 0x1d38328c in void std::__1::__libcpp_operator_delete<void*, unsigned long>(void*, unsigned long) obj-x86_64-linux-gnu/../contrib/libcxx/include/new:245:3
2 0x1d38328c in void std::__1::__do_deallocate_handle_size<>(void*, unsigned long) obj-x86_64-linux-gnu/../contrib/libcxx/include/new:271:10
3 0x1d38328c in std::__1::__libcpp_deallocate(void*, unsigned long, unsigned long) obj-x86_64-linux-gnu/../contrib/libcxx/include/new:285:14
4 0x1d38328c in std::__1::allocator<std::__1::__hash_node<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, void*> >::deallocate(std::__1::__hash_node<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, void*>*, unsigned long) obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:849:13
5 0x1d38328c in std::__1::allocator_traits<std::__1::allocator<std::__1::__hash_node<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, void*> > >::deallocate(std::__1::allocator<std::__1::__hash_node<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, void*> >&, std::__1::__hash_node<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, void*>*, unsigned long) obj-x86_64-linux-gnu/../contrib/libcxx/include/__memory/allocator_traits.h:476:14
6 0x1d38328c in std::__1::__hash_table<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, std::__1::__unordered_map_hasher<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, std::__1::hash<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, std::__1::equal_to<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, true>, std::__1::__unordered_map_equal<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, std::__1::equal_to<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, std::__1::hash<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, true>, std::__1::allocator<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser> > >::__deallocate_node(std::__1::__hash_node_base<std::__1::__hash_node<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, void*>*>*) obj-x86_64-linux-gnu/../contrib/libcxx/include/__hash_table:1581:9
7 0x1d38328c in std::__1::__hash_table<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, std::__1::__unordered_map_hasher<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, std::__1::hash<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, std::__1::equal_to<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, true>, std::__1::__unordered_map_equal<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, std::__1::equal_to<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, std::__1::hash<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, true>, std::__1::allocator<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser> > >::~__hash_table() obj-x86_64-linux-gnu/../contrib/libcxx/include/__hash_table:1519:5
8 0x1d38328c in std::__1::unordered_map<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser, std::__1::hash<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, std::__1::equal_to<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, std::__1::allocator<std::__1::pair<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const, DB::ProcessListForUser> > >::~unordered_map() obj-x86_64-linux-gnu/../contrib/libcxx/include/unordered_map:1044:5
9 0x1d38328c in DB::ProcessList::~ProcessList() obj-x86_64-linux-gnu/../src/Interpreters/ProcessList.h:263:7
10 0x1d38169c in DB::ContextShared::~ContextShared() obj-x86_64-linux-gnu/../src/Interpreters/Context.cpp:417:5
11 0x1d32f3e5 in std::__1::default_delete<DB::ContextShared>::operator()(DB::ContextShared*) const obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:1397:5
12 0x1d32f3e5 in std::__1::unique_ptr<DB::ContextShared, std::__1::default_delete<DB::ContextShared> >::reset(DB::ContextShared*) obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:1658:7
13 0x1d32f3e5 in DB::SharedContextHolder::reset() obj-x86_64-linux-gnu/../src/Interpreters/Context.cpp:485:44
14 0xa8863d4 in DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&)::$_5::operator()() const obj-x86_64-linux-gnu/../programs/server/Server.cpp:880:5
15 0xa8863d4 in ext::basic_scope_guard<DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&)::$_5>::invoke() obj-x86_64-linux-gnu/../base/common/../ext/scope_guard.h:97:9
16 0xa8863d4 in ext::basic_scope_guard<DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&)::$_5>::~basic_scope_guard() obj-x86_64-linux-gnu/../base/common/../ext/scope_guard.h:47:28
17 0xa86d889 in DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&) obj-x86_64-linux-gnu/../programs/server/Server.cpp:1379:1
18 0x25c0c8b5 in Poco::Util::Application::run() obj-x86_64-linux-gnu/../contrib/poco/Util/src/Application.cpp:334:8
19 0xa85070d in DB::Server::run() obj-x86_64-linux-gnu/../programs/server/Server.cpp:340:25
20 0x25c49eb7 in Poco::Util::ServerApplication::run(int, char**) obj-x86_64-linux-gnu/../contrib/poco/Util/src/ServerApplication.cpp:611:9
21 0xa84cd11 in mainEntryClickHouseServer(int, char**) obj-x86_64-linux-gnu/../programs/server/Server.cpp:132:20
22 0xa848c3a in main obj-x86_64-linux-gnu/../programs/main.cpp:368:12
23 0x7ffff7dc8151 in __libc_start_main (/usr/lib/libc.so.6+0x28151)
previously allocated by thread T2 (TCPHandler) here:
0 0xa84509d in operator new(unsigned long) (/src/ch/tmp/upstream/clickhouse-asan+0xa84509d)
1 0x1e2a7aa6 in void* std::__1::__libcpp_operator_new<unsigned long>(unsigned long) obj-x86_64-linux-gnu/../contrib/libcxx/include/new:235:10
2 0x1e2a7aa6 in std::__1::__libcpp_allocate(unsigned long, unsigned long) obj-x86_64-linux-gnu/../contrib/libcxx/include/new:261:10
3 0x1e2a7aa6 in std::__1::allocator<std::__1::__hash_node<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, void*> >::allocate(unsigned long) obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:840:38
4 0x1e2a7aa6 in std::__1::allocator_traits<std::__1::allocator<std::__1::__hash_node<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, void*> > >::allocate(std::__1::allocator<std::__1::__hash_node<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, void*> >&, unsigned long) obj-x86_64-linux-gnu/../contrib/libcxx/include/__memory/allocator_traits.h:468:21
5 0x1e2a7aa6 in std::__1::unique_ptr<std::__1::__hash_node<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, void*>, std::__1::__hash_node_destructor<std::__1::allocator<std::__1::__hash_node<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, void*> > > > std::__1::__hash_table<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, std::__1::__unordered_map_hasher<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, std::__1::hash<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, std::__1::equal_to<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, true>, std::__1::__unordered_map_equal<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, std::__1::equal_to<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, std::__1::hash<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, true>, std::__1::allocator<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser> > >::__construct_node_hash<std::__1::piecewise_construct_t const&, std::__1::tuple<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&>, std::__1::tuple<> >(unsigned long, std::__1::piecewise_construct_t const&, std::__1::tuple<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&>&&, std::__1::tuple<>&&) obj-x86_64-linux-gnu/../contrib/libcxx/include/__hash_table:2472:23
6 0x1e2a7aa6 in std::__1::pair<std::__1::__hash_iterator<std::__1::__hash_node<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, void*>*>, bool> std::__1::__hash_table<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, std::__1::__unordered_map_hasher<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, std::__1::hash<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, std::__1::equal_to<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, true>, std::__1::__unordered_map_equal<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser>, std::__1::equal_to<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, std::__1::hash<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, true>, std::__1::allocator<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser> > >::__emplace_unique_key_args<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::piecewise_construct_t const&, std::__1::tuple<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&>, std::__1::tuple<> >(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::piecewise_construct_t const&, std::__1::tuple<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&>&&, std::__1::tuple<>&&) obj-x86_64-linux-gnu/../contrib/libcxx/include/__hash_table:2093:29
7 0x1e29c13d in std::__1::unordered_map<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, DB::ProcessListForUser, std::__1::hash<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, std::__1::equal_to<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, std::__1::allocator<std::__1::pair<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const, DB::ProcessListForUser> > >::operator[](std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) obj-x86_64-linux-gnu/../contrib/libcxx/include/unordered_map:1740:21
8 0x1e29c13d in DB::ProcessList::insert(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, DB::IAST const*, DB::Context&) obj-x86_64-linux-gnu/../src/Interpreters/ProcessList.cpp:183:50
9 0x1e5a3a58 in DB::executeQueryImpl(char const*, char const*, DB::Context&, bool, DB::QueryProcessingStage::Enum, bool, DB::ReadBuffer*) obj-x86_64-linux-gnu/../src/Interpreters/executeQuery.cpp:486:59
10 0x1e5a153e in DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, DB::Context&, bool, DB::QueryProcessingStage::Enum, bool) obj-x86_64-linux-gnu/../src/Interpreters/executeQuery.cpp:904:30
11 0x1f909bdc in DB::TCPHandler::runImpl() obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:289:24
12 0x1f92dcac in DB::TCPHandler::run() obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:1492:9
13 0x25bdc2fe in Poco::Net::TCPServerConnection::start() obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerConnection.cpp:43:3
14 0x25bdce1b in Poco::Net::TCPServerDispatcher::run() obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerDispatcher.cpp:113:19
15 0x25e9c784 in Poco::PooledThread::run() obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/ThreadPool.cpp:199:14
16 0x25e96cd6 in Poco::ThreadImpl::runnableEntry(void*) obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/Thread_POSIX.cpp:345:27
17 0x7ffff7f723e8 in start_thread (/usr/lib/libpthread.so.0+0x93e8)
Thread T2 (TCPHandler) created by T0 here:
0 0xa7ffe0a in pthread_create (/src/ch/tmp/upstream/clickhouse-asan+0xa7ffe0a)
1 0x25e9606f in Poco::ThreadImpl::startImpl(Poco::SharedPtr<Poco::Runnable, Poco::ReferenceCounter, Poco::ReleasePolicy<Poco::Runnable> >) obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/Thread_POSIX.cpp:202:6
2 0x25e98eea in Poco::Thread::start(Poco::Runnable&) obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/Thread.cpp:128:2
3 0x25e9cd28 in Poco::PooledThread::start() obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/ThreadPool.cpp:85:10
4 0x25e9cd28 in Poco::ThreadPool::ThreadPool(int, int, int, int) obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/ThreadPool.cpp:252:12
5 0xa865aff in DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&) obj-x86_64-linux-gnu/../programs/server/Server.cpp:831:22
6 0x25c0c8b5 in Poco::Util::Application::run() obj-x86_64-linux-gnu/../contrib/poco/Util/src/Application.cpp:334:8
7 0xa85070d in DB::Server::run() obj-x86_64-linux-gnu/../programs/server/Server.cpp:340:25
8 0x25c49eb7 in Poco::Util::ServerApplication::run(int, char**) obj-x86_64-linux-gnu/../contrib/poco/Util/src/ServerApplication.cpp:611:9
9 0xa84cd11 in mainEntryClickHouseServer(int, char**) obj-x86_64-linux-gnu/../programs/server/Server.cpp:132:20
10 0xa848c3a in main obj-x86_64-linux-gnu/../programs/main.cpp:368:12
11 0x7ffff7dc8151 in __libc_start_main (/usr/lib/libc.so.6+0x28151)
SUMMARY: AddressSanitizer: heap-use-after-free obj-x86_64-linux-gnu/../contrib/libcxx/include/atomic:1050:12 in long std::__1::__cxx_atomic_fetch_add<long>(std::__1::__cxx_atomic_base_impl<long>*, long, std::__1::memory_order)
Shadow bytes around the buggy address:
0x0c228003a190: fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd
0x0c228003a1a0: fd fd fd fd fd fd fa fa fa fa fa fa fa fa fa fa
0x0c228003a1b0: fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd
0x0c228003a1c0: fd fd fd fd fd fd fd fd fd fd fd fd fd fd fa fa
0x0c228003a1d0: fa fa fa fa fa fa fa fa fd fd fd fd fd fd fd fd
=>0x0c228003a1e0: fd fd fd fd fd fd[fd]fd fd fd fd fd fd fd fd fd
0x0c228003a1f0: fd fd fd fa fa fa fa fa fa fa fa fa fa fa fa fa
0x0c228003a200: fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd
0x0c228003a210: fd fd fd fd fd fd fd fd fd fa fa fa fa fa fa fa
0x0c228003a220: fa fa fa fa fa fa fa fa fd fd fd fd fd fd fd fd
0x0c228003a230: fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd
Shadow byte legend (one shadow byte represents 8 application bytes):
Addressable: 00
Partially addressable: 01 02 03 04 05 06 07
Heap left redzone: fa
Freed heap region: fd
Stack left redzone: f1
Stack mid redzone: f2
Stack right redzone: f3
Stack after return: f5
Stack use after scope: f8
Global redzone: f9
Global init order: f6
Poisoned by user: f7
Container overflow: fc
Array cookie: ac
Intra object redzone: bb
ASan internal: fe
Left alloca redzone: ca
Right alloca redzone: cb
Shadow gap: cc
==13442==ABORTING
2021.02.20 16:39:50.861426 [ 13443 ] {} <Trace> BaseDaemon: Received signal -3
2021.02.20 16:39:50.861668 [ 14989 ] {} <Fatal> BaseDaemon: ########################################
2021.02.20 16:39:50.861749 [ 14989 ] {} <Fatal> BaseDaemon: (version 21.3.1.6073 (official build), build id: AC8A516D2F60B8505FA128074527EC2C86198E64) (from thread 13874) (no query) Received signal Unknown signal (-3)
2021.02.20 16:39:50.861810 [ 14989 ] {} <Fatal> BaseDaemon: Sanitizer trap.
2021.02.20 16:39:50.861880 [ 14989 ] {} <Fatal> BaseDaemon: Stack trace: 0xa8e94a7 0xad25b1b 0xa831a16 0xa819444 0xa81aefe 0xa81bb4b 0xa8e55a0 0xa8e510d 0xa90b475 0x1f90ee84 0x1f92dcad 0x25bdc2ff 0x25bdce1c 0x25e9c785 0x25e96cd7 0x7ffff7f723e9 0x7ffff7ea0293
2021.02.20 16:39:50.903643 [ 14989 ] {} <Fatal> BaseDaemon: 0.1. inlined from ./obj-x86_64-linux-gnu/../src/Common/StackTrace.cpp:298: StackTrace::tryCapture()
2021.02.20 16:39:50.903708 [ 14989 ] {} <Fatal> BaseDaemon: 0. ../src/Common/StackTrace.cpp:259: StackTrace::StackTrace() @ 0xa8e94a7 in /src/ch/tmp/upstream/clickhouse-asan
2021.02.20 16:39:51.041733 [ 14989 ] {} <Fatal> BaseDaemon: 1.1. inlined from ./obj-x86_64-linux-gnu/../src/Common/CurrentThread.h:78: DB::CurrentThread::getQueryId()
2021.02.20 16:39:51.041768 [ 14989 ] {} <Fatal> BaseDaemon: 1. ../base/daemon/BaseDaemon.cpp:381: sanitizerDeathCallback() @ 0xad25b1b in /src/ch/tmp/upstream/clickhouse-asan
2021.02.20 16:39:52.551623 [ 13442 ] {} <Information> Application: shutting down
2021.02.20 16:39:52.551696 [ 13442 ] {} <Debug> Application: Uninitializing subsystem: Logging Subsystem
2021.02.20 16:39:52.551792 [ 13443 ] {} <Trace> BaseDaemon: Received signal -2
2021.02.20 16:39:52.551831 [ 13443 ] {} <Information> BaseDaemon: Stop SignalListener thread
2021-04-13 21:37:38 +03:00
alesapin
cbd8a57fda
Merge branch 'master' into ssl_keeper
2021-04-13 10:34:23 +03:00
alesapin
ef34c95c7e
Add SSL to keeper (both client and internal)
2021-04-12 15:25:52 +03:00
alexey-milovidov
d21ffd83a7
Merge branch 'master' into catboost-reload
2021-04-11 13:29:36 +03:00
Ivan
495c6e03aa
Replace all Context references with std::weak_ptr ( #22297 )
...
* Replace all Context references with std::weak_ptr
* Fix shared context captured by value
* Fix build
* Fix Context with named sessions
* Fix copy context
* Fix gcc build
* Merge with master and fix build
* Fix gcc-9 build
2021-04-11 02:33:54 +03:00
alesapin
2987bbc948
Small improvements
2021-04-07 16:52:11 +03:00
alesapin
1c8e33414f
Merge branch 'master' into johnskopis/dynamic-interserver-creds-v20
2021-04-06 16:28:46 +03:00
Alexey Milovidov
3f2f53d2bb
Allow query profiling only on x86_64
2021-04-04 04:52:41 +03:00
Pavel Kruglov
cc65a1db97
Update paths to the model configs in config reloading
2021-04-01 13:30:05 +03:00
alesapin
be132a32a2
More renames
2021-03-29 11:24:56 +03:00
Alexey Milovidov
2a8ac01cdb
Rename as suggested by Kita
2021-03-28 22:24:28 +03:00
Alexey Milovidov
50f712e198
Integrate mmap cache to the infrastructure
2021-03-28 04:10:30 +03:00
Nikolai Kochetov
c3c393a7aa
Merge branch 'master' into refactor-actions-dag
2021-03-18 14:33:07 +03:00
Azat Khuzhin
ff1cb65f0b
Start accepting connections after DDLWorker and dictionaries initialization
...
Found by integration tests [1]:
Code: 139. DB::Exception: Received from 172.18.0.6:9000. DB::Exception: DDL background thread is not initialized. Stack trace:
[1]: https://clickhouse-test-reports.s3.yandex.net/21643/65f90f2ce9ea9e9d4076f06c58ddd981c82cc098/integration_tests_(thread).html#fail1
2021-03-12 21:48:13 +03:00
Nikolai Kochetov
4f133ae036
Merge branch 'master' into refactor-actions-dag
2021-03-10 12:40:55 +03:00
tavplubix
5a6cc876e4
Merge pull request #20626 from ClickHouse/fix_force_drop_materialized_view
...
Make force_drop_table work with MaterializedView
2021-03-09 20:05:51 +03:00
Nikolai Kochetov
a669f7d641
Merge branch 'master' into refactor-actions-dag
2021-03-05 18:21:14 +03:00
Nikolai Kochetov
c481401b0b
Fix build.
2021-03-05 12:54:17 +03:00
Azat Khuzhin
dfd1c73b31
Load dictionaries before starting accepting connections and DDLWorker
2021-02-28 05:45:12 +03:00
Alexey Milovidov
ac4d3b504e
Allow to start up with modified binary under gdb
2021-02-26 20:15:11 +03:00
tavplubix
103d569885
Merge branch 'master' into fix_force_drop_materialized_view
2021-02-20 20:41:03 +03:00
tavplubix
a697b578bc
Merge pull request #16193 from ClickHouse/database_replicated
...
DatabaseReplicated: continuation of #10485
2021-02-20 19:39:34 +03:00
Alexander Tokmakov
5cfd687dfb
fix
2021-02-19 19:22:47 +03:00
Ivan
414f470c79
Make Poco HTTP Server zero-copy again ( #19516 )
...
* Refactoring: part 1
* Refactoring: part 2
* Handle request using ReadBuffer interface
* Struggles with ReadBuffer's
* Fix URI parsing
* Implement parsing of multipart/form-data
* Check HTTP_LENGTH_REQUIRED before eof() or will hang
* Fix HTTPChunkedReadBuffer
* Fix build and style
* Fix test
* Resist double-eof
* Fix arcadian build
2021-02-19 15:51:26 +03:00
Alexander Tokmakov
cd91ec8de1
fix
2021-02-18 17:13:23 +03:00
Alexander Tokmakov
13ae988eff
make force_drop_table work with materialized view
2021-02-17 17:23:07 +03:00
Alexander Tokmakov
bf6f64a3fb
Merge branch 'master' into database_replicated
2021-02-16 01:28:19 +03:00
Alexander Tokmakov
9c7cf9e92e
remove some debug code
2021-02-15 13:26:34 +03:00
bharatnc
0a3d16196a
fix rebase issues
2021-02-13 22:19:07 -08:00
bharatnc
2f3fca3529
change exception message slightly
2021-02-13 21:19:52 -08:00
bharatnc
8c7f1e0204
Change logging to info and preserve exception
2021-02-13 21:19:52 -08:00
alexey-milovidov
0123911f8b
Update Server.cpp
2021-02-13 21:19:52 -08:00
bharatnc
a21ff1faf7
ServerUUID - simplify UUID generation as per review
2021-02-13 21:19:52 -08:00
bharatnc
daf46d21d8
ServerUUID - fix writing uuid file
2021-02-13 21:18:10 -08:00
bharatnc
5a468a5d32
ServerUUID - initial implementation
2021-02-13 21:18:10 -08:00
alesapin
d265e3b419
Less timeouts
2021-02-02 11:02:25 +03:00
alesapin
365bf65f5a
Fix install script
2021-02-01 17:14:59 +03:00
alesapin
57c9b6c864
Fix build without nuraft
2021-02-01 16:18:17 +03:00
alesapin
a33963e211
Better raft server startup
2021-01-27 20:54:25 +03:00
alesapin
97b9dba460
Multinode config
2021-01-25 17:10:18 +03:00
alesapin
dea4b5009b
Some server initialization
2021-01-25 15:29:12 +03:00
alesapin
173b6fefdf
Merge branch 'master' into in_memory_raft
2021-01-25 12:03:28 +03:00
Alexey Milovidov
8d335b1490
Allow to enable or disable watchdog via env var
2021-01-23 23:58:36 +03:00
alesapin
c1e36cfe70
Something working
2021-01-22 19:04:57 +03:00
Alexey Milovidov
950bfb3ec6
Allow change max_server_memory_usage without restart
2021-01-16 18:33:46 +03:00
Alexey Milovidov
cea1b7dba5
Fix build
2021-01-07 16:37:06 +03:00
Alexey Milovidov
6f481d7512
Add integrity checks for ClickHouse binary
2021-01-07 05:56:57 +03:00
John Skopis
9bcc5a6175
Support interserver credential rotation
...
Restarting a server instance to change the interserver password results
in many replicas being out of sync until all clusters are using the new
credential.
This commit adds dynamic credential loading for both the client
(Replicated* tables) and server (InterserverIOHTTPHandler).
This commit also adds the ability to rotate credentials, i.e. accept more
than one credential during a credential change.
state0 (no auth):
<interserver_http_credentials />
state1 (auth+allow_empty migration):
<interserver_http_credentials>
<user>admin</user>
<password>222</password>
<allow_empty>true</allow_empty>
</interserver_http_credentials>
state2 (auth+new admin password migration):
<interserver_http_credentials>
<user>admin</user>
<password>333</password>
<users>
<admin>222</admin>
</users>
</interserver_http_credentials>
2021-01-04 09:59:09 +00:00
Alexey Milovidov
fdc8950fbe
Do not use watchdog when server is run from tty
2020-12-23 17:31:10 +03:00
alexey-milovidov
29ad7b6d94
Merge pull request #13516 from ClickHouse/watchdog
...
If server was terminated by OOM killer, print message in log.
2020-12-23 05:35:44 +03:00
Alexey Milovidov
f9012b12fb
Proper implementation
2020-12-22 06:01:51 +03:00
Alexey Milovidov
932ade2cb8
Merge branch 'master' into watchdog
2020-12-22 03:10:15 +03:00
nikitamikhaylov
8501c7a831
better
2020-12-22 02:03:08 +03:00
nikitamikhaylov
cd3a73f9d3
done
2020-12-22 00:47:10 +03:00
Amos Bird
c447628d42
Add connection thread metrics
2020-12-18 15:22:55 +08:00
Alexey Milovidov
f7f8ff8758
Merge branch 'master' into sigaltstack
2020-12-17 22:16:30 +03:00
Alexey Milovidov
7f280bef37
Merge branch 'master' into sigaltstack
2020-12-17 05:09:10 +03:00
alesapin
ea4d11cb73
Wait for connections to special servers
2020-12-16 13:04:46 +03:00
Alexander Kuzmenkov
fb1221148d
Merge pull request #17748 from azat/custom-TLD
...
Add ability to use custom TLD list
2020-12-11 12:42:19 +03:00
Azat Khuzhin
840a21d073
Add top_level_domains_path for easier overriding
2020-12-09 21:08:31 +03:00
Azat Khuzhin
916cbd6610
Add ability to use custom TLD list
...
v2: Add a note that top_level_domains_lists aren not applied w/o restart
v3: Remove ExtractFirstSignificantSubdomain{Default,Custom}Lookup.h headers
v4: TLDListsHolder: remove FIXME for dense_hash_map (this is not significant)
2020-12-09 21:08:22 +03:00
alesapin
0dd9c720f4
Better server
2020-12-09 11:58:41 +03:00
alesapin
758dcd1972
Separate factory for test keeper handlers
2020-12-09 11:45:36 +03:00
alesapin
3d0dbbe411
Fix build
2020-12-08 17:49:18 +03:00
Alexey Milovidov
3e2447391b
Support for PROXY protocol
2020-12-03 00:05:51 +03:00
alesapin
fb86eaf6fc
Better errors and better config
2020-11-25 16:19:09 +03:00
alesapin
310307fa72
Replace eventfd with pipes
2020-11-25 11:18:15 +03:00
alesapin
4d40d9be3f
Merge branch 'master' into complete_zk_api
2020-11-25 10:31:16 +03:00
Vitaly Baranov
c2edd9f8ce
Rework async server: switch to coroutine-like approach, no using statuses anymore for control flow.
2020-11-24 17:53:34 +03:00
Vitaly Baranov
ff62fd4967
Add an adapter for protocol servers.
2020-11-24 17:53:34 +03:00
Vitaly Baranov
44717797c9
Fix code style and compilation.
2020-11-24 17:53:34 +03:00
mnkonkova
6cd1557d67
Implement GRPC protocol.
2020-11-24 17:53:34 +03:00
alesapin
1de175257b
More const
2020-11-23 23:22:04 +03:00
alesapin
5a48076802
Trying to get rid of leak
2020-11-23 13:55:00 +03:00
alesapin
0208751a7d
Add dirty hack for connections close
2020-11-20 15:46:05 +03:00
alesapin
991386e37b
Fix stupid error
2020-11-19 13:56:36 +03:00
alesapin
4aad6a597c
Merge branch 'correctly_send_close_request' into complete_zk_api
2020-11-12 17:46:02 +03:00
tavplubix
058aa8f85e
Merge pull request #16824 from ClickHouse/replace_stringstreams_with_buffers
...
Replace std::*stringstreams with DB::*Buffers
2020-11-12 01:11:44 +03:00
alesapin
6398271432
Merge branch 'master' into complete_zk_api
2020-11-11 16:57:24 +03:00
alesapin
d83c68fca8
Fix timeouts
2020-11-11 16:55:28 +03:00
alesapin
66236d6ebb
Refactored a little
2020-11-11 16:07:06 +03:00
Alexander Tokmakov
b94cc5c4e5
remove more stringstreams
2020-11-10 21:22:26 +03:00
alesapin
932ea0ef8b
Merge branch 'master' into complete_zk_api
2020-11-10 13:56:11 +03:00
Amos Bird
aa8e6db786
reload auxiliary zookeepers configuration
2020-11-10 15:56:37 +08:00
alesapin
c2525ef211
Server and client pinging each other
2020-10-30 17:16:47 +03:00
Alexey Milovidov
2e0a979e3a
Fix inconsistency in FormatFactory
2020-10-29 06:39:43 +03:00
Alexey Milovidov
068235c2d7
Disable alt stack for sanitizers
2020-10-26 05:18:36 +03:00
Azat Khuzhin
72d7b6117e
Use total_memory_tracker when there is no other MemoryTracker object.
...
This should significantly reduce the MemoryTracking drift, test shows
that there is 0 drift after query storm (100 queries, via http/tcp/tcp
in one session).
TL;DR;
To track memory, clickhouse creates memory tracker object for each
thread **explicitly**, but until it is not created the memory
allocations are not under account.
There should not be lot of allocations w/o memory tracker, since most of
the time it is created early enough, but even this maybe enough to
trigger some problems.
Plus sometimes it is not possible to create it, for example some 3d
party library does not allow to do this explicitly:
- for example before #15740 allocations from librdkafka threads,
- or even worse, poco threads, they don't have any routines to do this.
This won't be a problem for `MemoryTracking` metric if the deallocation
will be done from the same thread w/o memory tracker (or vise versa),
but this is not always true.
NOTE, that this will slow down per-thread allocations w/o memory
tracker, since before this patch there were no memory tracking for them
while now they will be accounted in total_memory_tracker, and for
total_memory_tracker max_untracked_memory is always reached.
But this should not be significant.
2020-10-23 21:07:52 +03:00
John Skopis
1f9331198d
[WIP] Introduce dynamic TLS server context
...
This is a first pass at setting an x509 keypair dynamically.
I'm not so sure it should be a singleton (especaially because it depends
on the SSLManager singleton).
Needs more better error handling.
Functionally, it works. Simply change the cert/key path in config, or
touch cert; touch config.
2020-10-08 16:34:17 +00:00
Alexey Milovidov
7d97c8b053
Remove useless code
2020-10-07 11:21:32 +03:00
tavplubix
4578d89819
Merge pull request #15348 from ClickHouse/replicate_default_args
...
Continuation of #14791
2020-09-28 18:53:02 +03:00
Alexander Tokmakov
34addcf61f
add review suggestions
2020-09-26 22:18:28 +03:00
alesapin
97671a1771
Ugly fix for default database race
2020-09-25 14:27:00 +03:00
Alexey Milovidov
1f6e55ff35
Allow to run without /proc/self/maps
2020-09-25 05:03:58 +03:00
Alexander Kuzmenkov
679c0988a5
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-22 16:25:52 +03:00
Alexander Kuzmenkov
dde4cf70e1
Merge remote-tracking branch 'origin/master' into HEAD
2020-09-22 14:03:59 +03:00
Alexander Kuzmenkov
478c7309d4
Merge pull request #14843 from ClickHouse/aku/global-pool
...
Exception on double init of global thread pool
2020-09-22 13:44:39 +03:00
alexey-milovidov
3e0509af69
Merge pull request #13573 from amosbird/rms
...
specific ReplicatedMergeTree settings
2020-09-21 01:36:33 +03:00
alexey-milovidov
1474b80ecc
Merge pull request #15008 from ClickHouse/clang-tidy-11-without-enabling
...
Fix terribly wrong code
2020-09-20 02:00:54 +03:00
alexey-milovidov
c461d782e4
Merge pull request #14929 from ClickHouse/mlock-code-segment
...
Only mlock code segment
2020-09-19 13:46:49 +03:00
Alexey Milovidov
ef5363b87f
Fix terribly wrong code
2020-09-19 02:05:13 +03:00
alexey-milovidov
988b20a32c
Merge pull request #14684 from azat/parallel-distributed_ddl
...
Allow parallel execution of distributed DDL
2020-09-18 22:18:17 +03:00
Alexander Kuzmenkov
449189dcda
Initialize global thread pool before we fetch configs from ZK
2020-09-18 13:47:09 +03:00
Alexey Milovidov
eb523f1a7c
Merge branch 'master' into mlock-code-segment
2020-09-17 21:15:09 +03:00
Alexander Kuzmenkov
fb64cf210a
straighten the protocol version
2020-09-17 17:37:29 +03:00
Alexey Milovidov
068e8576b7
Corrections
2020-09-17 15:53:52 +03:00
Alexey Milovidov
8bce20076c
Only mlock code segment
2020-09-17 15:39:37 +03:00
sundy-li
544b2cb20d
add configChanged method for zookeeper
...
fix logic error && skip reload testkeeper
2020-09-17 13:33:45 +08:00
Alexey Milovidov
2ac88ab47d
Added config option
2020-09-14 21:08:09 +03:00
Azat Khuzhin
dd867b787f
Allow parallel execution of distributed DDL
...
Add distributed_ddl.pool_size to control maximum parallel to handle
distributed DDL.
Also:
- convert Exception constructors to fmt-like
- use sleepFor* over std::this_thread::sleep_for()
2020-09-12 02:32:08 +03:00
Alexey Milovidov
a644733139
Attempt to make performance test more reliable
2020-09-10 12:05:57 +03:00
Yatsishin Ilya
45e54f81c7
better resolv.conf, add DNSCacheUpdater logs
2020-09-02 11:07:46 +03:00
Amos Bird
05a5a13e08
specific ReplicatedMergeTree settings
2020-08-27 22:37:41 +08:00
Vitaly Baranov
0759dff12b
Support <user_directories> section in the main config.
2020-08-16 19:15:38 +03:00
Vitaly Baranov
2909ed1bc0
Better initialization of access storages. Make list of access storages dynamic.
2020-08-16 19:15:34 +03:00
Alexey Milovidov
e43746395e
Merge branch 'master' into codespell-2
2020-08-16 14:57:21 +03:00
Alexey Milovidov
6bc8da633c
Minor modification
2020-08-16 14:52:55 +03:00
Alexey Milovidov
8e36bfe54d
Merge branch 'master' into watchdog
2020-08-16 14:37:55 +03:00
Alexander Tokmakov
a6ff049eec
use Atomic for system database
2020-08-12 23:40:13 +03:00
Alexey Milovidov
6c4df0f27a
Better tool
2020-08-08 17:10:49 +03:00
Alexey Milovidov
ae716e13e0
Watchdog (experimental)
2020-08-08 07:52:09 +03:00
Alexey Milovidov
3b8020168f
Add simple watchdog
2020-08-08 07:44:04 +03:00
Vitaly Baranov
1a4a8a219c
Merge pull request #13305 from vitlibar/correct-error-message-if-setting-not-found-in-users_xml
...
Correct error message if setting not found in users.xml
2020-08-07 23:31:23 +03:00
Vitaly Baranov
a804f9499d
Use references while iterating through settings.
2020-08-04 04:00:38 +03:00
Vitaly Baranov
dadebadcac
Print correct error message in log for unknown settings in users.xml
2020-08-04 00:20:33 +03:00
Alexey Milovidov
778abb346f
Merge branch 'master' into merge-tree-settings-sanity-check
2020-08-02 17:13:17 +03:00
Vitaly Baranov
7c4ae5ee65
Add the parameter custom_settings_prefixes to the server config.
2020-07-31 20:57:49 +03:00
Vitaly Baranov
56665a15f7
Rework and rename the template class SettingsCollection => BaseSettings.
2020-07-31 20:54:18 +03:00
Alexey Milovidov
b9f49d31df
Sanity checks for MergeTreeSettings
2020-07-30 22:08:13 +03:00
Denis Glazachev
8688a1f5d0
Recreate ExternalAuthenticators (LDAP) on config update
2020-07-10 15:59:48 +04:00
alesapin
1aa45f203b
bump CI
2020-07-08 13:40:02 +03:00
Denis Glazachev
9effacfbc1
Merge branch 'master' into ldap-per-user-authentication
...
* master: (1102 commits)
Update README.md
Update README.md
Update README.md
Update index.md
[docs] add intrdocution for statements page (#12189 )
Revert "Run perf tests with memory sampling (for allocations >1M)"
Sanitize LINK_LIBRARIES property for the directories (#12160 )
[docs] refactor Domains overview (#12186 )
DOCS-647: toStartOfSecond (#12190 )
[docs] add intrdocution for commercial page (#12187 )
DOCSUP-1348 Russian translation for new functions (#133 ) (#12194 )
changelog fixes
Update index.md (#12191 )
Update zh kafka.md title (#12192 )
Added test for #3767
style fix for #12152
Tests for fixed issues #10846 and #7347
changelog fixes
[docs] introduction for special table engines (#12170 )
[docs] introduction for third-party interfaces (#12175 )
...
# Conflicts:
# src/Access/ya.make
# src/Common/ErrorCodes.cpp
2020-07-08 00:42:09 +04:00
Alexey Milovidov
176a7f2f72
Normalize "pid" file handling #3501
2020-07-04 16:54:24 +03:00
Alexey Milovidov
44f2742a51
Fix bad log message at server startup
2020-06-27 15:56:06 +03:00
Alexander Kuzmenkov
d77f397b38
review fixes
2020-06-26 03:18:33 +03:00
Alexander Kuzmenkov
593a0181bd
Merge pull request #11616 from ClickHouse/aku/perf-benchmark
...
Add concurrent benchmark to performance test
2020-06-25 09:36:52 +03:00
Alexander Kuzmenkov
e0bdbe73d2
Merge remote-tracking branch 'origin/master' into HEAD
2020-06-23 15:31:09 +03:00
Alexander Kuzmenkov
ab809f59b9
memory usage settings
2020-06-23 15:30:45 +03:00
Alexander Kuzmenkov
96d2e9c997
Initialize GlobalThreadPool explicitly
2020-06-22 22:04:12 +03:00
alexey-milovidov
4ee623ccac
Merge pull request #10242 from MovElb/movelb-postgresql-wire-protocol-impl
...
PostgreSQL wire protocol implementation
2020-06-21 14:39:22 +03:00
Denis Glazachev
5db60202b6
Merge branch 'master' into ldap-per-user-authentication
2020-06-19 00:11:08 +04:00
Alexey Milovidov
bb6c0743fc
Change the level of log message about failure to listen, to warning #4406
2020-06-15 23:30:36 +03:00
Denis Glazachev
9e3a28a6b8
Merge branch 'master' into ldap-per-user-authentication
...
* master: (414 commits)
Update file.md
Update merge.md
Update dictionary.md
Update external-data.md
Update distributed.md
Update null.md
Update set.md
Update join.md
Update url.md
Update view.md
Update materializedview.md
Update memory.md
Update buffer.md
Update generate.md
removed a sentence about global lock during rename (#11577 )
greatCircleAngle en translation (#11584 )
Update configuration-files.md
try fix flacky test
Update why.html
Update rich.html
...
# Conflicts:
# src/Common/ErrorCodes.cpp
# utils/ci/jobs/quick-build/run.sh
2020-06-11 03:06:17 +04:00
Denis Glazachev
848330b37a
Expect <ldap_servers> in main config.xml
2020-06-11 02:48:15 +04:00
Alexey Milovidov
fd3ff19868
Fix trivial error in log message #11399
2020-06-10 22:34:23 +03:00
Alexey Milovidov
df19db1509
Added a test for history in clickhouse-client
2020-06-07 20:29:34 +03:00
Alexey Milovidov
3d68cd4df6
Also check for users.xml elements in config.xml
2020-06-04 23:34:33 +03:00
Alexey Milovidov
02e14f9fe8
Also check for users.xml elements in config.xml
2020-06-04 23:33:19 +03:00
Alexey Milovidov
a89ce20d38
Added a check for incorrect settings
2020-06-04 22:30:30 +03:00
Alexey Milovidov
25f941020b
Remove namespace pollution
2020-05-31 00:57:37 +03:00
MovElb
142c63e487
done rebase
2020-05-30 23:02:11 +03:00
MovElb
b4b5c90343
squash
2020-05-30 20:05:05 +03:00
Alexey Milovidov
b79020d0a8
Emit a warning if server was build in debug or with sanitizers
2020-05-30 00:41:33 +03:00
Ivan
5b858de374
Split programs/server into actual program and library ( #11186 )
...
* Split programs/server into actual program and library
2020-05-27 20:52:52 +03:00
Alexey Milovidov
7e1813825b
Return old names of macros
2020-05-24 01:24:01 +03:00
Alexey Milovidov
61cc605ee7
Remove old method
2020-05-24 01:21:29 +03:00
Alexey Milovidov
7e2fb9ad65
Apply all transformations again
2020-05-23 22:38:30 +03:00
Alexey Milovidov
29762240de
Remove duplicate whitespaces (preparation)
2020-05-23 22:31:54 +03:00
Alexey Milovidov
86b4d5a86f
Remove duplicate whitespaces (preparation)
2020-05-23 22:09:06 +03:00
Alexey Milovidov
9d2a0d2dd7
Apply all transformations again
2020-05-23 21:59:49 +03:00
Alexey Milovidov
a2ad11897f
Remove duplicate whitespaces (preparation)
2020-05-23 21:53:58 +03:00
Alexey Milovidov
1f13515a65
Make all LOG in single line (preparation)
2020-05-23 21:31:37 +03:00
Alexey Milovidov
f69cbdcbfc
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" \+ [^+]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" \+ ([^+]+)\);/\1_FORMATTED(\2, "\3{}", \4);/'
2020-05-23 20:09:37 +03:00
Alexey Milovidov
533f86278a
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+"\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)"\);/\1_FORMATTED(\2, "\3{}\5{}\7", \4, \6);/'
2020-05-23 20:00:41 +03:00
Alexey Milovidov
e391b77d81
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+ << "[^"]+"\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)"\);/\1_FORMATTED(\2, "\3{}\5", \4);/'
2020-05-23 19:56:05 +03:00
Alexey Milovidov
ee4ffbc332
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+)\);/\1_FORMATTED(\2, "\3{}", \4);/'
2020-05-23 19:47:56 +03:00
Alexey Milovidov
8d2e80a5e2
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+"\)' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+, "[^"]+")\)/\1_FORMATTED(\2)/'
2020-05-23 19:42:39 +03:00
alesapin
a416813597
Merge pull request #10777 from NanoBjorn/refactor-reservations
...
VolumePtr instead of DiskPtr in MergeTreeData*
2020-05-19 13:27:11 +03:00
Artem Zuikov
97c7447130
Bitonic sort improvements ( #10934 )
2020-05-19 00:41:23 +03:00
Artem Zuikov
bfcbc08bba
arcadia sync fixes
2020-05-18 15:50:23 +03:00
Artem Zuikov
0fe723acc9
Try to fix arcadia sync ( #10959 )
2020-05-18 13:26:23 +03:00
Gleb Novikov
1a25ac6e1f
Merge branch 'master' into refactor-reservations
2020-05-16 23:34:45 +03:00
alesapin
9ae37a054c
Fix build without openCL
2020-05-15 11:31:32 +03:00
Artem Zuikov
8e8a2a17d6
build fixes
2020-05-15 03:01:31 +03:00
Ri
fc7afaa639
Bitonic sort on GPU (OpenCL) ( #10232 )
2020-05-15 03:01:14 +03:00
Gleb Novikov
57b6fb6d80
Merge branch 'master' into refactor-reservations
2020-05-10 13:01:45 +03:00
Gleb Novikov
390b39b272
VolumePtr instead of DiskPtr in MergeTreeData*
2020-05-10 00:24:15 +03:00
Ivan
85d783c247
Poco contrib refactoring ( #10396 )
...
* Remove config_common.h
* Refactor libcpuid contrib
* Remove support for libcpuinfo
* Define USE_CPUID in Arcadia
* Refactor Poco libraries
2020-05-08 17:11:19 +03:00
Alexey Milovidov
600b396f1b
Merge remote-tracking branch 'origin/master' into sampling-memory-profiler
2020-05-01 21:48:20 +03:00
Alexander Kazakov
e9baaa439b
Implementation of new system metrics provider (Procfs) ( #10544 )
...
* New metrics provider (Procfs) + Refactored TasksStatsCounters
* Trivial statless test that ProcFS is provided
* Trivial perf test for ProcfsMetricsProvider
Co-authored-by: alexey-milovidov <milovidov@yandex-team.ru>
2020-05-01 21:47:41 +03:00
Alexey Milovidov
293ae88e7f
Add sampling memory profiler
2020-04-30 16:25:17 +03:00
tavplubix
11c3493676
Merge pull request #10547 from ClickHouse/zhang2014/feature/ISSUES-5436
...
Merging #7572
2020-04-28 12:40:48 +03:00
Alexander Tokmakov
04d6b59ac0
Merge branch 'master' into database_atomic
2020-04-23 17:31:37 +03:00
zhang2014
0070f75218
ISSUES-5436 fix integration test failure & add test
2020-04-23 17:11:20 +08:00
Alexey Milovidov
07dcf40a6a
Simple server wide memory profiler
2020-04-22 20:52:21 +03:00
Alexander Tokmakov
fefbbd37df
Merge branch 'master' into database_atomic
2020-04-22 17:02:30 +03:00
Alexey Milovidov
0482e2e3ea
Implement suggestion from Sergey Veletsky
2020-04-22 01:40:18 +03:00
alexey-milovidov
8c2839d3c9
Merge pull request #10308 from ClickHouse/shared-context-lifetime
...
Shared context lifetime
2020-04-21 00:12:45 +03:00
Alexander Tokmakov
b29bddac12
Merge branch 'master' into database_atomic
2020-04-20 14:09:09 +03:00
zhang2014
318ab3b51e
ISSUES-5436 try fix build failure & pvs & style
2020-04-20 12:49:17 +08:00
Alexey Milovidov
2987e70aab
Introduce "max_server_memory_usage" setting
2020-04-20 01:59:21 +03:00
Alexey Milovidov
ec6b176f3b
Rework total memory tracker #10293
2020-04-20 01:59:21 +03:00
zhang2014
57cbecf935
ISSUES-5436 reworking predefine http
2020-04-20 03:18:36 +08:00
zhang2014
8105a9bbe0
ISSUES-5436 fix review suggestions
2020-04-20 02:26:06 +08:00
zhang2014
fd00757178
ISSUES-5436 support custom http [part 4]
2020-04-20 02:23:18 +08:00
Nikolai Kochetov
84faa9af26
Merge branch 'master' into shared-context-lifetime
2020-04-17 19:13:13 +03:00
Nikolai Kochetov
ce11662ab1
Fix build.
2020-04-17 15:58:52 +03:00
Nikolai Kochetov
d51a9c551b
Remove shared_ptr to SharedContext from Context.
2020-04-17 12:47:40 +03:00
Nikolai Kochetov
025093d354
Fix build.
2020-04-16 17:51:33 +03:00
Nikolai Kochetov
d6db27e372
Modify context.
2020-04-16 17:37:38 +03:00
Ivan Lezhankin
e230632645
Changes required for auto-sync with Arcadia
2020-04-16 15:31:57 +03:00
Alexander Tokmakov
9c67d2716e
Merge branch 'master' into database_atomic
2020-04-03 03:19:11 +03:00
Ivan
97f2a2213e
Move all folders inside /dbms one level up ( #9974 )
...
* Move some code outside dbms/src folder
* Fix paths
2020-04-02 02:51:21 +03:00