Alexey Milovidov
a8bdb20fc4
Merge pull request #48787 from ClickHouse/background-memory-tracker
...
Add MemoryTracker for the background tasks [Resubmit]
2023-05-09 07:58:36 +03:00
Nikita Mikhaylov
954e3b724c
Speedup outdated parts loading ( #49317 )
2023-05-03 18:56:45 +02:00
Michael Kolupaev
e133633359
Parallel decoding with one row group per thread
2023-04-17 04:58:32 +00:00
Dmitry Novik
cf5d9a175a
Revert "Merge pull request #48760 from ClickHouse/revert-46089-background-memory-tracker"
...
This reverts commit a61ed332235f01b8a2b5
2023-04-14 16:34:19 +02:00
Alexander Tokmakov
af1bf08663
Revert "Add MemoryTracker for the background tasks"
2023-04-13 21:05:02 +03:00
Dmitry Novik
467ecf45e1
Merge pull request #46089 from ClickHouse/background-memory-tracker
...
Add MemoryTracker for the background tasks
2023-04-13 13:29:27 +02:00
Azat Khuzhin
37d430d68a
Use ThreadPool in PipelineExecutor
...
PipelineExecutor is one of the heavy user of the threads, by using pool
there number of used threads for query execution can be tracked in
system.metrics.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-04-12 20:00:51 +02:00
Dmitry Novik
06e6794fc0
Merge remote-tracking branch 'origin/master' into background-memory-tracker
2023-04-11 15:29:35 +00:00
Azat Khuzhin
8d0e516310
Use StrongTypedef for CurrentMetrics to avoid possible incorrect usage
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-04-01 16:01:33 +02:00
Azat Khuzhin
ba6ecd2d4e
Fix ThreadPool for DistributedSink
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-04-01 16:00:03 +02:00
Azat Khuzhin
edeeac84cf
Fix incorrect ThreadPool usage after ThreadPool introspection
...
```
$ gg 'ThreadPool[^()]([A-Za-z_]\+,' src/
src/Interpreters/Context.cpp: shared->load_marks_threadpool = std::make_unique<ThreadPool>(pool_size, pool_size, queue_size);
src/Interpreters/Context.cpp: shared->prefetch_threadpool = std::make_unique<ThreadPool>(pool_size, pool_size, queue_size);
src/Interpreters/Context.cpp: shared->threadpool_writer = std::make_unique<ThreadPool>(pool_size, pool_size, queue_size);
```
Fixes : #47880
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-30 20:08:38 +02:00
Azat Khuzhin
f38a7aeabe
ThreadPool metrics introspection
...
There are lots of thread pools and simple local-vs-global is not enough
already, it is good to know which one in particular uses threads.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-29 10:46:59 +02:00
serxa
3ad7194e31
add pool size metrics
2023-03-16 17:31:41 +00:00
Alexander Tokmakov
7b1b238d0b
Revert "Merge pull request #25674 from amosbird/distributedreturnconnection"
...
This reverts commit 5ffd99dfd42796aa333f
2023-03-11 19:09:47 +01:00
Dmitry Novik
e7a94a28ee
Merge branch 'master' into background-memory-tracker
2023-02-15 19:39:28 +01:00
Alexey Milovidov
2e57fab8e3
Instrumentation of callbacks for distributed queries
2023-02-12 10:04:05 +01:00
Dmitry Novik
d43d17f59a
Address the review
2023-02-07 16:05:02 +00:00
Dmitry Novik
1e065b32f3
Add MemoryTracker for the background tasks
2023-02-06 17:25:58 +00:00
taiyang-li
7b10ac8d5b
add new metric to record allocations times and bytes using mmap
2023-02-06 17:50:45 +08:00
Saulius Valatka
8fa9a99ba1
implement pending request queue to prevent CQ overflows
2023-01-28 21:54:44 +02:00
Saulius Valatka
ac2c921bdf
add initial io_uring support
2023-01-28 21:54:44 +02:00
kssenii
4ce8950712
Minor changes
2023-01-19 17:53:10 +01:00
Han Fei
8a74238fe0
improve
2023-01-17 15:47:52 +01:00
Dmitry Novik
1e5fdbdef0
Add ThreadsInOvercommitTracker metric
2022-12-14 16:56:19 +00:00
Sergei Trifonov
34b43f8b4b
Merge branch 'master' into storage-system-moves
2022-10-25 22:56:45 +02:00
serxa
55a86bc2de
Add active moves system table
2022-10-25 13:56:46 +00:00
vdimir
0178307c27
Followup for TemporaryDataOnDisk
2022-10-12 15:25:23 +02:00
vdimir
51c44424cc
More metrics for temp files
2022-08-24 16:14:09 +00:00
kssenii
3901778d49
Add more current metrics for cache
2022-08-16 11:32:23 +02:00
lingpeng0314
f06b19bdbf
Add keeper monitoring data
2022-06-20 11:32:18 +08:00
kssenii
5dd3ad08a1
Add S3Requests metric
2022-05-13 18:12:46 +02:00
kssenii
ab65e163fa
Add current metrics
2022-05-03 19:35:04 +02:00
Mikhail Filimonov
3412be9d4d
Change KafkaDirectReads to KafkaConsumersInUse
2022-04-05 20:25:05 +02:00
Mikhail Filimonov
53c7376e37
Add some metrics to engine Kafka
2022-04-04 20:25:53 +02:00
Anton Popov
5bb1b3ce77
support async inserts in clickhouse-client for queries with inlined data
2022-02-02 20:59:37 +03:00
Alexander Tokmakov
187c43eba8
rename Committed state to Active
2021-12-30 23:45:38 +03:00
Nikita Mikhaylov
9756b8dc33
Added an ability to execute more merges and mutations than threads, added new settings ( #29140 )
2021-10-01 00:26:24 +03:00
Alexey Milovidov
0316f1cc3e
Even more instrumentation
2021-08-27 03:08:10 +03:00
fuwhu
8515f3b3a2
Add metric MaxPushedDDLEntryID.
2021-08-11 11:40:06 +08:00
Amos Bird
dbfb699690
Asynchronously drain connections.
2021-07-19 21:53:29 +08:00
Alexey Milovidov
c762e2247d
More instrumentation for network interaction: add counters for recv/send bytes; add gauges for recvs/sends.
2021-07-04 00:00:50 +03:00
Azat Khuzhin
9c6e8e1462
Add BrokenDistributedFilesToInsert new metric
...
Number of files for asynchronous insertion into Distributed tables that
has been marked as broken. This metric will starts from 0 on start.
Number of files for every shard is summed.
2021-05-04 22:48:07 +03:00
Alexey Milovidov
2a8ac01cdb
Rename as suggested by Kita
2021-03-28 22:24:28 +03:00
Alexey Milovidov
50f712e198
Integrate mmap cache to the infrastructure
2021-03-28 04:10:30 +03:00
Alexey Milovidov
d8088190f9
Fix documentation for CurrentMetrics
2021-03-23 00:44:25 +03:00
Azat Khuzhin
cb951c2116
Add metrics for MergeTree parts types
...
- PartsWide
- PartsCompact
- PartsInMemory
2021-01-21 21:17:00 +03:00
Alexey Milovidov
e238fd64ac
Add part metrics
2021-01-15 15:28:53 +03:00
alexey-milovidov
a08db94343
Revert "Add metrics for part number in MergeTree in ClickHouse"
2021-01-07 16:40:52 +03:00
roverxu
8e72b6d31b
Merge remote-tracking branch 'origin' into dev/add_metrics_for_parts
2020-12-21 09:25:54 +08:00
Amos Bird
8d0e949462
ddlworker max entry metric
2020-12-12 14:20:49 +08:00
