Alexander Kuzmenkov
75920565c9
Improve flush performance in SystemLog
...
It started having problems under heavy workloads such as saving all
memory allocations to trace_log table. To improve that, stop popping
entries one by one from the log queue, and actually stop using the queue
completely, because we don't use most of its methods or its backpressure
feature. Just keep a vector of messages and flush it to disk
periodically.
2020-02-07 22:32:49 +03:00
Alexander Kuzmenkov
56b065881a
Include FieldVisitors.h in less files.
2019-10-07 20:23:05 +03:00
Nikita Mikhaylov
e07f3d9d10
refactor
2019-08-13 19:47:12 +03:00
Nikita Mikhaylov
875d7aef8b
better
2019-08-13 17:32:32 +03:00
Nikita Mikhaylov
bbe20b3f9f
done
2019-08-13 17:31:46 +03:00
Alexey Milovidov
8c05766888
Attempt to simplify text log
2019-08-04 18:51:04 +03:00
Nikita Mikhaylov
a9fea0314e
better style
2019-08-01 13:31:29 +03:00
Nikita Mikhaylov
ad4459c4a2
fixed flush_logs + added pretty function
2019-07-31 17:03:23 +03:00
Nikita Mikhaylov
e06b3b17b3
some changes to log all text logs
2019-07-30 17:04:18 +03:00
Nikita Mikhaylov
14b384f3e5
Merge branch 'master' into system_text_log
2019-07-23 15:51:04 +03:00
Nikita Mikhaylov
0f3a4a34b4
test + comment
2019-07-22 18:33:38 +03:00
Nikita Mikhaylov
c6667ff888
wip
2019-07-22 16:54:08 +03:00
Nikita Lapkov
0f579860f7
Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler
2019-07-04 22:13:51 +00:00
CurtizJ
ac3072cd9b
better shutdown of system_logs
2019-06-21 20:25:47 +03:00
CurtizJ
5e6ceef224
fix race condition in flushing system log
2019-06-19 19:50:17 +03:00
CurtizJ
047ee38838
fix race condition in flushing system log
2019-06-19 18:38:06 +03:00
CurtizJ
bb95d9a860
fix race condition in flushing system log
2019-06-19 15:28:34 +03:00
Nikita Lapkov
4a4ff8d5bf
Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler
2019-03-23 18:45:22 +00:00
Alexey Milovidov
41fede9c6b
Fixed TSan report on shutdown
2019-03-21 22:22:38 +03:00
Nikita Lapkov
ce4e48d6f4
Merge branch 'master' into query-poor-mans-profiler
2019-03-01 14:22:38 +00:00
Alexey Milovidov
85c0ba1e70
Do not create part_log if it is not defined in configuration file
2019-02-22 19:10:14 +03:00
Alexey Milovidov
ba3cb83a84
Removed duplicate includes
2019-02-10 20:12:22 +03:00
Nikita Lapkov
b8d78807fe
Merge remote-tracking branch 'parent/master' into query-poor-mans-profiler
2019-02-09 21:45:34 +00:00
Nikita Vasilev
a1b0dede07
Data Skipping Indices ( #4143 )
...
* made index parser
* added index parsing
* some fixes
* added index interface and factory
* fixed compilation
* ptrs
* added indexParts
* indextypes
* index condition
* IndexCondition
* added indexes in selectexecutor
* fix
* changed comment
* fix
* added granularity
* comments
* fix
* fix
* added writing indexes
* removed indexpart class
* fix
* added setSkipIndexes
* add rw for MergeTreeIndexes
* fixes
* upd error
* fix
* fix
* reading
* test index
* fixed nullptr error
* fixed
* fix
* unique names
* asts -> exprlist
* minmax index
* fix
* fixed select
* fixed merging
* fixed mutation
* working minmax
* removed test index
* fixed style
* added indexes to checkDataPart
* added tests for minmax index
* fixed constructor
* fix style
* fixed includes
* fixed setSkipIndexes
* added indexes meta to zookeeper
* added parsing
* removed throw
* alter cmds parse
* fix
* added alter
* fix
* alters fix
* fix alters
* fix "after"
* fixed alter
* alter fix + test
* fixes
* upd setSkipIndexes
* fixed alter bug with drop all indices
* fix metadata editing
* new test and repl fix
* rm test files
* fixed repl alter
* fix
* fix
* indices
* MTReadStream
* upd test for bug
* fix
* added useful parsers and ast classes
* fix
* fix comments
* replaced columns
* fix
* fixed parsing
* fixed printing
* fix err
* basic IndicesDescription
* go to IndicesDescr
* moved indices
* go to indicesDescr
* fix test minmax_index*
* fixed MT alter
* fixed bug with replMT indices storing in zk
* rename
* refactoring
* docs ru
* docs ru
* docs en
* refactor
* rename tests
* fix docs
* refactoring
* fix
* fix
* fix
* fixed style
* unique idx
* unique
* fix
* better minmax calculation
* upd
* added getBlock
* unique_condition
* added termForAST
* unique
* fixed not
* uniqueCondition::mayBeTrueOnGranule
* fix
* fixed bug with double column
* is always true
* fix
* key set
* spaces
* test
* tests
* fix
* unique
* fix
* fix
* fixed bug with duplicate column
* removed unused data
* fix
* fixes
* __bitSwapLastTwo
* fix
2019-02-05 17:50:25 +03:00
Nikita Lapkov
5c54bbb750
write traces to trace_log
2019-02-03 21:30:45 +00:00
Alexey Milovidov
f6b9b06307
Attempt to implemnt global thread pool #4018
2019-01-14 22:22:09 +03:00
Alexey Milovidov
9e6d835137
Preparations #2609
2018-12-14 19:17:09 +03:00
Alexey Milovidov
e9a3c93ef0
Merged with master #2609
2018-12-14 18:39:48 +03:00
alexey-milovidov
7cc867de0a
Merge branch 'master' into background-processing-pool-backoff
2018-12-14 17:41:55 +03:00
Amos Bird
af369483a9
Simply Self.
...
> When the normal name of the template (i.e., the name from the enclosing scope, not the injected-class-name) is used, it always refers to the class template itself and not a specialization of the template
http://eel.is/c++draft/temp.local
2018-09-13 22:59:54 +08:00
Alexey Milovidov
d355aa3932
Enlarged the size of system log queue 1000 times. It is reasonable, because multiple records are generated for each query for query_thread_log. The maximum size of system log queue will be few hundred MBs #2482
2018-08-22 07:36:53 +03:00
Alexey Milovidov
0947c7808d
Avoid locking while reading config to check part_log #2281
2018-07-08 07:54:37 +03:00
Vitaliy Lyudvichenko
e13ba09004
Rewritten ThreadStatus via adding shared thread state. [#CLICKHOUSE-2910]
...
Fixed race condition in SystemLog.
2018-06-19 23:30:35 +03:00
Vitaliy Lyudvichenko
4cd230f85c
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910
2018-06-14 16:04:00 +03:00
Vitaliy Lyudvichenko
95b42afcb9
Add test for profile events logging. [#CLICKHOUSE-2910]
2018-06-14 14:56:12 +03:00
Alexey Milovidov
b9b89a5590
Less dependencies [#CLICKHOUSE-2]
2018-06-05 22:46:49 +03:00
Vitaliy Lyudvichenko
0355f81f20
[WIP] Introduced query_thread_log. [#CLICKHOUSE-2910]
2018-05-31 18:54:08 +03:00
Vitaliy Lyudvichenko
de6c48f4df
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910
2018-05-14 19:09:00 +03:00
Nikolai Kochetov
9e05052c2a
merged with master
2018-04-16 18:35:11 +03:00
Nikolai Kochetov
7b8a306e34
minor fixes
2018-04-16 18:11:13 +03:00
alexey-milovidov
30838f4d9f
Update SystemLog.h
2018-03-29 23:54:57 +03:00
Kirill Shvakov
b742908731
SystemLog: execute prepareTable() on each flush
...
Merge remote-tracking branch 'upstream/master' into system-log-prepare-table-on-each-flush
#2131 deleted excessive logging
Revert "#2131 deleted excessive logging"
This reverts commit d78a46d9587f60bb0a9b
2018-03-29 16:57:16 +03:00
Alexey Milovidov
afbbd780e3
Fixed error with initialization of PartLog [#CLICKHOUSE-3354]
2018-03-10 22:57:13 +03:00
Vitaliy Lyudvichenko
364f519eea
Threads and ProfileEvents in system.processes. [#CLICKHOUSE-2910]
2018-03-07 14:35:54 +03:00
Vitaliy Lyudvichenko
61233b886a
Better system.part_log. [#CLICKHOUSE-3342]
2018-01-25 21:40:02 +03:00
Alexey Milovidov
9f57a1f7a5
Fixed error: if default user had readonly accesss, the server could not start [#CLICKHOUSE-2]
2018-01-19 02:40:32 +03:00
Alexey Milovidov
fcdd5de47d
Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
...
This reverts commit fcabe8b888
2017-12-28 07:39:19 +03:00
Alexey Milovidov
c89041ce63
Removed questionable code (2) [#CLICKHOUSE-2].
2017-12-26 01:51:04 +03:00
Alexey Milovidov
ec71908b00
Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
...
This reverts commit fcabe8b888
2017-12-26 00:57:29 +03:00
Alexey Milovidov
fcabe8b888
Removed questionable code (2) [#CLICKHOUSE-2].
2017-12-26 00:32:33 +03:00
