Commit Graph

39 Commits

Author SHA1 Message Date
proller
1a33f4da40
Optional current_thread and memory_tracker (#4664) 2019-03-14 21:03:35 +03:00
Alexey Milovidov
f6b9b06307 Attempt to implemnt global thread pool #4018 2019-01-14 22:22:09 +03:00
Marek Vavruša
0652302d9a Common/MemoryTracker: fix metrics not being updated after MemoryTracker reset
The #3230 fixed a problem with memory accounting, but it introduces a regression
in which the memory tracker isn't reset until there are zero queries in process list.
This makes it difficult to see in tests as there's always just one query in-flight,
but in production it produces a sawtooth memory usage pattern that resets when
the allocated memory exceeds set memory limits and all queries are terminated.
2018-10-10 17:37:41 -07:00
Alexey Milovidov
64c7e357e8 Fixed error #3230 2018-10-08 08:30:03 +03:00
Alexey Milovidov
dd88c092b7 Attempt to fix inconsistent values in total memory tracker #3143 2018-09-26 23:45:40 +03:00
Alexey Milovidov
9fbde09725 Memory tracker: added watermark logging #3205 2018-09-24 23:57:10 +03:00
Vitaliy Lyudvichenko
e13ba09004 Rewritten ThreadStatus via adding shared thread state. [#CLICKHOUSE-2910]
Fixed race condition in SystemLog.
2018-06-19 23:30:35 +03:00
Vitaliy Lyudvichenko
c04dfb40a6 Fixed memory tracking. [#CLICKHOUSE-2910] 2018-06-09 18:29:08 +03:00
Vitaliy Lyudvichenko
0355f81f20 [WIP] Introduced query_thread_log. [#CLICKHOUSE-2910] 2018-05-31 18:54:08 +03:00
Vitaliy Lyudvichenko
d81744fd06 Add more perfomance counters. [#CLICKHOUSE-2910] 2018-05-28 23:03:03 +03:00
Vitaliy Lyudvichenko
364f519eea Threads and ProfileEvents in system.processes. [#CLICKHOUSE-2910] 2018-03-07 14:35:54 +03:00
Vitaliy Lyudvichenko
efdda9cc9b Introduced ThreadStatus. [#CLICKHOUSE-2910] 2018-03-07 14:35:10 +03:00
Marek Vavruša
fb1aa84973 Fixed clang build on macOS
- Make sure to use dynamic linking on macOS to avoid OpenSSL static linking bug
- Use -std=c++17 in CFLAGS for files in contrib
- Avoid bad support for thread_local on macOS with clang altogether
2017-12-21 00:46:50 +03:00
Marek Vavruša
ba82b20cbe MemoryTracker: fixed build with clang 9.0.0 not properly supporting thread_local
This fixes #1488.

XCode 9.0 added support for C++11 thread_local:
https://developer.apple.com/library/content/releasenotes/DeveloperTools/RN-Xcode/Chapters/Introduction.html

The 443088ce31 replaced __thread with C++11 thread_local, which
broke the compilation for this platform with an error on link time.

I can't reproduce this with a minimal example yet.
2017-11-15 23:32:31 +03:00
Alexey Milovidov
1d8dc11f40 Fixed one of errors that cause abort when no space left on device with logs (now useless, as ClickHouse will instead refuse all connections) [#CLICKHOUSE-2] 2017-10-27 20:24:33 +03:00
proller
443088ce31 Use c++11 thread_local instaed of gcc's __thread 2017-10-19 22:36:37 +03:00
Alexey Milovidov
bc622c4c45 Better [#CLICKHOUSE-2]. 2017-09-17 03:13:26 +03:00
Alexey Milovidov
253893bf4d Fixed insignificant error, shown by TSan [#CLICKHOUSE-2]. 2017-09-09 07:06:54 +03:00
alexey-milovidov
d68ea42643 Fixed unbounded growth of total memory tracking (that hits max_memory_usage_for_all_queries limit) (#681)
* MemoryTracker: more convenient for investigations [#CLICKHOUSE-2935].

* Investigation [#CLICKHOUSE-2935].

* Investigation [#CLICKHOUSE-2935].

* Added comment [#CLICKHOUSE-2935].
2017-04-11 22:10:31 +03:00
Alexey Milovidov
5b29658aae MemoryTracker: more convenient for investigations [#CLICKHOUSE-2935]. 2017-04-11 00:43:59 +03:00
Alexey Milovidov
310736cd7e Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 12:22:42 +03:00
Alexey Milovidov
137ad95929 Changed tabs to spaces in code [#CLICKHOUSE-3]. 2017-04-01 11:35:09 +03:00
Alexey Milovidov
b8ac19999c Settings 'max_memory_usage_for_user' and 'max_memory_usage_for_all_queries': do not interfere between different queries [#CLICKHOUSE-2796]. 2017-02-01 06:53:10 +03:00
Alexey Milovidov
54587fec1b Tracking memory used in merges [#METR-23888]. 2016-12-20 05:29:35 +03:00
Alexey Milovidov
ea852bb9d8 Separate compilation of CurrentMetrics; Separated AsynchronousMetrics from CurrentMetrics; Comments [#METR-23237]. 2016-10-24 07:06:27 +03:00
Alexey Milovidov
6f4fc79cde Better [#METR-2944]. 2016-07-31 06:53:16 +03:00
Alexey Milovidov
0f3e163c4e dbms: CurrentMetrics: development [#METR-19596]. 2016-01-21 04:47:28 +03:00
Alexey Milovidov
c67d973c51 dbms: added setting 'max_memory_usage_for_all_queries' [#METR-19561]. 2016-01-13 06:59:24 +03:00
Alexey Milovidov
54d3af930c Merge 2016-01-13 04:06:56 +03:00
Alexey Milovidov
13c7d0983a dbms: cutting dependency [#METR-2944].. 2016-01-12 00:46:36 +03:00
Alexey Milovidov
a6b01ee987 dbms: multiple MemoryTrackers: development [#METR-19561]. 2015-12-30 18:39:11 +03:00
Alexey Milovidov
d51e03da61 dbms: added fault injection in memory tracker to more easily reproducing the bug [#METR-19278]. 2015-12-23 10:39:28 +03:00
Alexey Milovidov
918422ad48 Moved files [#METR-17973]. 2015-10-05 04:35:28 +03:00
Alexey Milovidov
1f6def094f dbms: fixed build [#METR-18202]. 2015-09-29 22:19:54 +03:00
Alexey Milovidov
0045133b0e dbms: prepared for fully-functional progress bar [#METR-2944]. 2014-10-25 22:33:52 +04:00
Alexey Milovidov
ea3a22102d dbms: MemoryTracker: added whitespace [#METR-11015]. 2014-05-10 04:29:50 +04:00
Alexey Milovidov
9a6691aa6b dbms: MemoryTracker: fixed error [#METR-11015]. 2014-05-08 19:54:51 +04:00
Michael Kolupaev
8ea2b0f7a7 dbms: human readable sizes logged in MemoryTracker. [#METR-11015] 2014-05-08 16:00:47 +04:00
Alexey Milovidov
0abc554493 dbms: tracking amount of memory usage per query [#METR-11015]. 2014-05-04 02:57:43 +04:00