Commit Graph

4490 Commits

Author SHA1 Message Date
Azat Khuzhin
a8eaf3ecde Fix copy-paste typo for max_bytes_ratio_before_external_group_by doc
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Azat Khuzhin
bdb39a6fef Change logic of automatic ORDER/GROUP BY to be based on available memory
- remove max_bytes_ratio_before_external_{order,group_by}_for_server
- change the way max_bytes_ratio_before_external_{order,group_by} works

Note, that it is not enough to transform ratio to bytes in
executeQuery(), since in this case it will not work for merges and
internal queries, plus, you have to reset them for Distributed engine
and update it for Merge/View/...

This patch also introduce some helpers (see MemoryTrackerUtils) and
adjust Aggregator::Params constructor to accept Settings object instead
of tons of arguments.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Azat Khuzhin
909eef401a Implement max_bytes_ratio_before_external_sort_for_server
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Azat Khuzhin
d5a990346c Implement max_bytes_ratio_before_external_group_by_for_server
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Azat Khuzhin
378b6c80a6 Automatic ORDER BY to disk (max_bytes_ratio_before_external_sort)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Azat Khuzhin
a856c30c7c Automatic GROUP BY to disk (max_bytes_ratio_before_external_group_by)
Simpler then max_bytes_before_external_group_by, that allows you not to
think about memory consumption of the query, and can be set globally to
i.e. 0.5 so that the external aggregation will be enabled once the
memory usage reaches the 50%.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Robert Schulze
934ae95e39
Fix bad conflict resolution 2024-11-26 17:34:27 +00:00
Robert Schulze
6a899f97eb
Merge remote-tracking branch 'ClickHouse/master' into delete_old_mongodb_integration 2024-11-26 17:33:41 +00:00
Raúl Marín
b487f59496 Rename allowed_feature_tier to allow_feature_tier 2024-11-26 12:30:57 +01:00
Robert Schulze
17f27275ae
Merge remote-tracking branch 'ClickHouse/master' into delete_old_mongodb_integration 2024-11-25 17:23:15 +00:00
Raúl Marín
3ae055c74e
Merge pull request #71841 from Algunenano/experimental_tiers_switch
Implement `allowed_feature_tier` as a global switch to  disable all experimental / beta features
2024-11-20 12:39:06 +00:00
Nikita Mikhaylov
567270afa8
Merge pull request #72053 from ClickHouse/document_cache_populated_by_fetch
Documenting MergeTree's cache_populated_by_fetch setting.
2024-11-19 12:31:05 +00:00
kellytoole
c1ea3d4213 Documenting MergeTree's cache_populated_by_fetch setting. 2024-11-18 16:34:14 -08:00
kellytoole
cad22e7a2d Documenting MergeTree's ttl_only_drop_parts setting, and updating reference to it. 2024-11-18 15:06:08 -08:00
Vladimir Cherkasov
3e05ffe675
Merge pull request #71560 from xogoodnow/json-utc-formatted-log
Added UTC date format (RFC 3339) for json formatted logging
2024-11-18 09:10:52 +00:00
Alexey Milovidov
7705f9b009 Fix docs 2024-11-16 21:16:15 +01:00
Ali
59f2c44a52
Merge branch 'ClickHouse:master' into json-utc-formatted-log 2024-11-16 11:29:48 +03:30
Kirill Nikiforov
fcaa058c92
get rid of poco mongodb integration implementation 2024-11-16 00:28:54 +04:00
Raúl Marín
93403eb38e Merge remote-tracking branch 'blessed/master' into experimental_tiers_switch 2024-11-15 19:13:03 +01:00
Anton Popov
acd4f46d9c
Merge pull request #71179 from kirillgarbar/table-limit
Hard limits on number of replicated tables, dictionaries and views
2024-11-13 21:13:49 +00:00
Kirill
38f323ccdc
Add settings to docs 2024-11-13 12:49:58 +03:00
Raúl Marín
cd97103526 Allow changes in default profile 2024-11-12 20:24:48 +01:00
Derek Chia
0f945cadc7
Update settings.md
Remove duplicated `background_pool_size` description
2024-11-08 17:34:53 +08:00
Robert Schulze
f727a3931b
Clarify query cache docs and remove obsolete setting 2024-11-07 12:41:48 +00:00
Mikhail f. Shiryaev
6310d38bf6
Merge pull request #71505 from ClickHouse/upgrade-docker-srver
Upgrade clickhouse-server and keeper base images
2024-11-07 11:38:28 +00:00
xogoodnow
174550e1bf Added "date_time_utc"
Signed-off-by: xogoodnow <xo4ever9999@gmail.com>
2024-11-07 13:28:10 +03:30
Mikhail f. Shiryaev
157f745136
Write a simple troubleshooting for an old docker and clickhouse-server 2024-11-06 22:09:12 +01:00
Joe Lynch
7c6472a090
Fix documentation for system.grants.is_partial_revoke 2024-11-06 13:34:39 +01:00
Raúl Marín
f4a7f475dc
Merge pull request #71145 from Algunenano/setting_tiers
Introduce setting tiers
2024-10-31 15:18:29 +00:00
Sergei Trifonov
2760f283a1
Revert "Revert "SQL syntax for workload and resource management"" 2024-10-30 16:18:35 +01:00
Raúl Marín
50345cd254 Merge remote-tracking branch 'blessed/master' into setting_tiers 2024-10-30 14:39:56 +01:00
Alexander Tokmakov
4a821e81a1
Revert "SQL syntax for workload and resource management" 2024-10-30 12:48:13 +01:00
serxa
78c8b43479 Merge branch 'master' into sql-for-workload-management 2024-10-29 09:09:05 +00:00
Raúl Marín
49655e71f5 Update docs 2024-10-28 18:20:43 +01:00
Raúl Marín
5e9aa01f33 Introduce Setting tiers 2024-10-28 17:25:52 +01:00
Sergei Trifonov
f595b20d08
Merge branch 'master' into async_load_system_database 2024-10-28 16:15:58 +01:00
Yarik Briukhovetskyi
d1ac93ba17
Small doc improvement. 2024-10-25 14:30:18 +02:00
serxa
52091f4ff8 add docs and test 2024-10-24 15:57:14 +00:00
Pablo Marcos
611dbd59be Merge branch 'master' into system-query-metric-log 2024-10-24 12:02:51 +00:00
Alexey Milovidov
c737eabb9e
Merge pull request #70850 from ClickHouse/add-merge-start-and-mutate-start-events
Add merge start and mutate start events into `system.part_log`
2024-10-24 05:28:40 +08:00
Alexey Milovidov
85056de617
Merge pull request #70959 from rschu1ze/minor-fixups
Minor fixups of #70011 and #69918
2024-10-23 20:19:59 +00:00
Yarik Briukhovetskyi
4452928566
Merge pull request #70940 from marco-vb/update-documentation
Fix small documentation error for min_free_bytes_to_perform_insert and min_free_ratio_to_perform_insert settings.
2024-10-23 17:02:15 +00:00
János Benjamin Antal
f2ca21134f
Merge pull request #69657 from petern48/regexp_logger
Filter logging using regular expressions
2024-10-23 16:01:24 +00:00
serxa
4081ed87e9 support ANY DISK clause in RESOURCE definition 2024-10-23 13:23:48 +00:00
Robert Schulze
6a374cb418
Minor fixups of #70011 and #69918 2024-10-23 09:50:10 +00:00
marco-vb
da79733347 Fix small documentation error for min free bytes/ratio settings. 2024-10-22 18:33:04 +01:00
kssenii
794b7cff73 More documentation 2024-10-22 18:01:24 +02:00
Pablo Marcos
fd9262df76 Merge branch 'master' into system-query-metric-log 2024-10-22 12:07:15 +00:00
Alexey Milovidov
ffb692902c Merge branch 'master' into add-merge-start-and-mutate-start-events 2024-10-21 23:21:59 +02:00
Peter Nguyen
0fec305059
Update docs/en/operations/server-configuration-parameters/settings.md
Co-authored-by: János Benjamin Antal <antaljanosbenjamin@users.noreply.github.com>
2024-10-21 08:06:44 -07:00