Nikita Taranov
30f2a942c5
Predict size of hash table for GROUP BY ( #33439 )
...
* use AggregationMethod ctor with reserve
* add new settings
* add HashTablesStatistics
* support queries with limit
* support distributed and with external aggregation
* add new profile events
* add some tests
* add perf test
* export cache stats through AsynchronousMetrics
* rm redundant trace
* fix style
* fix 02122_parallel_formatting test
* review fixes
* fix 02122_parallel_formatting test
* apply also to two-level HTs
* try simpler strategy
* increase max_size_to_preallocate_for_aggregation for experiment
* fixes
* Revert "increase max_size_to_preallocate_for_aggregation for experiment"
This reverts commit 6cf6f75704
2022-03-30 22:47:51 +02:00
taiyang-li
834ac3a1b9
Merge remote-tracking branch 'ck/master' into rocksdb_metacache
2022-03-29 18:32:06 +08:00
Alexey Milovidov
6fbf5bd9ad
More correct
2022-03-28 02:11:27 +02:00
Alexey Milovidov
bb35184da1
Add metric about size of async INSERTs
2022-03-28 02:04:19 +02:00
taiyang-li
8dbf1c60e7
merge master and fix conflict
2022-03-23 11:36:50 +08:00
kssenii
47f94120da
Merge master
2022-02-16 14:43:28 +01:00
李扬
daa27d0bda
Merge branch 'master' into rocksdb_metacache
2022-02-12 07:50:12 -06:00
taiyang-li
b6132d490f
merge master and solve conflict
2022-02-08 15:24:59 +08:00
kssenii
2e58733750
Merge master
2022-02-07 15:23:10 +01:00
mergify[bot]
dd947f964c
Merge branch 'master' into mv_cacheable_scalars
2022-02-07 10:07:26 +00:00
Anton Popov
5bb1b3ce77
support async inserts in clickhouse-client for queries with inlined data
2022-02-02 20:59:37 +03:00
Raúl Marín
4b5ab80e3b
Better scalar cache handling
...
- Fixes global CTE scalar cache.
- Adds MVs back (views dependent on the source are cached locally and others globally
2022-01-26 17:36:45 +01:00
taiyang-li
73def8b483
merge master and solve conflict
2022-01-24 11:01:43 +08:00
Kseniia Sumarokova
2c43e4eb57
Merge branch 'master' into local-cache-for-remote-fs
2022-01-22 22:53:55 +03:00
kssenii
a566099759
Local cache for remote filesystem
2022-01-19 00:42:11 +03:00
taiyang-li
1e102bc1b2
merge master
2022-01-01 09:01:06 +08:00
taiyang-li
aa97634d9b
merge master
2021-12-28 18:38:50 +08:00
taiyang-li
2a1fe52b9f
rename symbols && fix uts && add setting use_metadata_cache
2021-12-28 18:06:13 +08:00
李扬
91334ecf50
Merge branch 'master' into rocksdb_metacache
2021-12-27 23:20:41 -06:00
Vitaly Baranov
f80a3e3247
Merge pull request #30549 from aiven/kmichel-server-reload
...
Start/stop servers when `listen_host`/`*_port` changes
2021-12-27 14:51:00 +03:00
taiyang-li
9036b18c2f
merge master
2021-12-27 15:12:48 +08:00
taiyang-li
e7401d2a5e
wrap rocksdb metacache related code with USE_ROCKSDB
2021-12-27 11:50:59 +08:00
taiyang-li
94a7a09598
Merge remote-tracking branch 'origin/master' into rocksdb_metacache
2021-12-27 10:14:24 +08:00
Kevin Michel
ffc1fca296
Start/stop servers when listen_host/*_port changes
...
This allows starting and stopping separately each protocol server
without restarting ClickHouse.
This also allows adding or removing `listen_host` entries, which
start and stops servers for all enabled ports.
When stopping a server, the listening socket is immediately closed
(and available for another server).
Protocols with persistent connections try to wait for any currently
running query to finish before closing the connection, but idle
connection are closed quickly (depending on how often the protocol
is polled).
An extra ProfileEvent is added, `MainConfigLoads`, it is
incremented every time the configuration is reloaded. This helps
when trying to assess whether the new configuration was applied.
2021-12-24 08:26:02 +01:00
liyang
37ba8004ff
Speep up mergetree starting up process
2021-12-18 16:39:59 +08:00
kssenii
ca283a4bb8
Fix optimization with lazy seek
2021-12-17 00:18:28 +03:00
lgbo-ustc
248e933fc4
Add test for local cache
2021-12-14 16:06:30 +08:00
alexey-milovidov
96ec92c7cd
Merge pull request #31155 from ClickHouse/incremental-profile-events
...
Send incremental profile events to client
2021-12-01 04:04:41 +03:00
kssenii
f18dcd2287
Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers
2021-11-13 14:38:57 +03:00
Azat Khuzhin
f9428450cd
Fix OpenedFileCacheHits/OpenedFileCacheMisses
2021-11-10 21:15:27 +03:00
Azat Khuzhin
baf14444e6
Cleanup ProfileEvents and CurrentMetrics
2021-11-10 21:15:27 +03:00
Dmitry Novik
f5a92c6f0b
cleanup code
2021-11-08 23:47:57 +03:00
Dmitry Novik
a093395b9b
Process incremental profile events on client
2021-11-08 16:38:31 +03:00
Dmitry Novik
8708e00b3a
Send incremental profile events to client
2021-11-08 12:40:31 +03:00
kssenii
45ea820297
Reduce memory usage for some formats
2021-11-03 14:30:03 +03:00
kssenii
9461e225bb
Merge branch 'master' of github.com:ClickHouse/ClickHouse into disk-async-read
2021-10-27 22:47:47 +03:00
Azat Khuzhin
f41cf281e4
Add QueryProfilerRuns profile event
...
This will help to investigate query latency spikes.
2021-10-25 21:14:16 +03:00
kssenii
31cd71c849
Clean up
2021-10-20 09:37:18 +03:00
kssenii
881ae8617e
Merge branch 'master' of github.com:ClickHouse/ClickHouse into disk-async-read
2021-10-15 15:09:56 +03:00
kssenii
edfb1a5521
Better performance for smaller number of threads
2021-10-15 15:07:39 +03:00
kssenii
3995506d37
Adjust range reader for remote fs reads
2021-10-15 11:36:26 +03:00
Dmitry Novik
abb74d2a5b
Make Counters::Snapshot immutable
2021-10-12 13:46:32 +03:00
Dmitry Novik
a33610aa32
Make read of Counters snapshot non-atomic
2021-10-12 13:46:32 +03:00
kssenii
eb5cb86271
More profile events
2021-10-10 23:20:00 +03:00
kssenii
0104cb1c8e
Better
2021-09-21 01:51:17 +03:00
Alexey Milovidov
0316f1cc3e
Even more instrumentation
2021-08-27 03:08:10 +03:00
Alexey Milovidov
91cef77edc
Instrumentation
2021-08-27 03:01:07 +03:00
alexey-milovidov
6f13eb49c1
Merge pull request #26320 from Algunenano/profile_sleep_calls
...
Add profile events for sleep function calls
2021-07-17 01:37:23 +03:00
Alexey Milovidov
d984fc4301
Fix flaky integration test
2021-07-15 13:35:37 +03:00
Raúl Marín
901e251d53
Add profile events to sleep function calls
2021-07-14 18:44:09 +02:00
