Commit Graph

2770 Commits

Author SHA1 Message Date
filimonov
fbb22348ea
Refactor reading the pool setting & from server config. (#48055)
After #36425 there was a lot of confusions/problems with configuring pools - when the message was confusing, and settings need to be ajusted in several places.
See some examples in #44251, #43351, #47900, #46515.

The commit includes the following changes:
1) Introduced a unified mechanism for reading pool sizes from the configuration file(s). Previously, pool sizes were read from the Context.cpp with fallbacks to profiles, whereas main_config_reloader in Server.cpp read them directly without fallbacks.
2) Corrected the data type for background_merges_mutations_concurrency_ratio. It should be float instead of int.
3) Refactored the default values for settings. Previously, they were defined in multiple places throughout the codebase, but they are now defined in one place (or two, to be exact: Settings.h and ServerSettings.h).
4) Improved documentation, including the correct message in system.settings.

Additionally make the code more conform with #46550.
2023-03-30 16:44:11 +02:00
Nikolai Kochetov
a8a28bdf3d Merge branch 'master' into rename-setting-stop_reading_on_first_cancel 2023-03-30 16:07:14 +02:00
Nikolai Kochetov
f870e6f7a9 Rename setting stop_reading_on_first_cancel to partial_result_on_first_cancel. 2023-03-30 14:00:44 +00:00
Robert Schulze
b0473098c6
Merge branch 'master' into qc-compression 2023-03-30 10:55:42 +02:00
Denny Crane
2c231a6ac4
Update settings.md 2023-03-29 20:49:44 -03:00
Robert Schulze
b324d0ed5e
Merge branch 'master' into qc-compression 2023-03-29 15:09:22 +02:00
lzydmxy
3410082cb2 add columns perform_ttl_move_on_insert, load_balancing for table system.storage_policies 2023-03-29 19:58:25 +08:00
rfraposa
b8edcd90cc Update stack_trace.md 2023-03-28 15:49:58 -06:00
Smita Kulkarni
a26cfd523c Updated right bool for disallowing concurrent backups and restores 2023-03-28 15:42:21 +02:00
Smita Kulkarni
afe5982c4e Fixed typo - settings 2023-03-28 15:39:28 +02:00
Smita Kulkarni
c8ec900d90 Fixed comment for usage on cluster 2023-03-28 15:37:49 +02:00
Smita Kulkarni
e5994e873e Added documentation for new settings to disallow concurrent backup/restore 2023-03-28 14:03:50 +02:00
Dan Roscigno
c8f59194a3
Merge pull request #48070 from den-crane/patch-60
Doc. idle_connection_timeout
2023-03-27 15:17:08 -04:00
Dan Roscigno
07c3a0522b
Merge pull request #48072 from DanRoscigno/standardize-admonitions
standardize admonitions
2023-03-27 15:16:05 -04:00
DanRoscigno
6d8a2bbd48 standardize admonitions 2023-03-27 14:54:05 -04:00
Denny Crane
295d3b7510
Update settings.md 2023-03-27 14:45:43 -03:00
Denny Crane
98488f30ab
Update settings.md 2023-03-27 14:40:45 -03:00
Rich Raposa
feac46eac4
Update dropped_tables.md (#48067)
* Update dropped_tables.md

* Update dropped_tables.md

* Update docs/en/operations/system-tables/dropped_tables.md

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-03-27 20:16:28 +03:00
rfraposa
15039d3327 Rename file 2023-03-27 09:37:06 -06:00
Rich Raposa
01cccb08a5
Merge branch 'master' into add-marked-dropped-tables 2023-03-27 09:23:09 -06:00
rfraposa
eac71397c4 Create marked_dropped_tables.md 2023-03-27 09:19:50 -06:00
nellicus
f1258a932f fix typo 2023-03-27 16:58:20 +02:00
Kruglov Pavel
bc92e3184e
Merge branch 'master' into non-blocking-connect 2023-03-27 13:50:50 +02:00
Alexey Milovidov
b6892f53fc
Merge pull request #47724 from ClickHouse/rs/qc-better-cfg-name
Rename cfg parameter query_cache.size to query_cache.max_size
2023-03-27 00:36:24 +03:00
rfraposa
70912b15bc Update settings.md 2023-03-25 15:56:04 -06:00
Kruglov Pavel
f3f93dd06c
Merge branch 'master' into non-blocking-connect 2023-03-24 15:59:40 +01:00
Robert Schulze
0712627c05
Query cache: Fix config naming ambiguity
Add 'max_' prefix to 'size' setting to make it more clear that the cache
consumes no space if not used.
2023-03-24 12:52:09 +00:00
Rich Raposa
d1a0935a70
Merge branch 'master' into rfraposa-patch-2 2023-03-23 16:41:05 -06:00
rfraposa
747eaf3f72 Fix broken links 2023-03-23 14:40:45 -06:00
Rich Raposa
c8e7ca7c8c
Update backup.md 2023-03-23 14:34:29 -06:00
rfraposa
42725964d4 Remove links from nav categories 2023-03-23 14:20:26 -06:00
Kruglov Pavel
3ee12e21fb
Merge branch 'master' into non-blocking-connect 2023-03-23 20:53:44 +01:00
Nikolai Kochetov
0f01725d8b
Merge pull request #45689 from alexX512/master
Add an option to show the partial result on query cancellation
2023-03-23 17:34:15 +01:00
avogar
38e44861ae Fix possible race conditions 2023-03-21 16:01:54 +00:00
Tanya Bragin
d3515dd7ae
Update query profiler docs to remove self-managed only
Query profiler works in ClickHouse Cloud - update docs to reflect it and add an example. 

cc @alexey-milovidov
2023-03-20 22:05:10 -07:00
Robert Schulze
d8493780b2
Query cache: Enable compression and squashing of result blocks
ClickHouse reads table data in blocks of 'max_block_size' rows. Due to
filtering, aggregation, etc., result blocks are typically much smaller
than 'max_block_size' but there are also cases where they are much
bigger. Setting 'query_cache_squash_partial_results' (enabled by
default) now controls if result blocks are squashed (if they are tiny)
or split (if they are large) into blocks of 'max_block_size' size before
insertion into the query result cache. This reduces performance of
writes into the query cache but improves compressability of cache
entries and provides more natural block granularity when query results
are later served from the query cache.

Entries in the query cache are now also compressed by default. This
reduces the overall memory consumption at the cost of slower writes into
/ reads from the query cache. To disable compression, use setting
'query_cache_compress_entries'.
2023-03-20 20:11:41 +00:00
Sergei Trifonov
273770519b
Merge branch 'master' into master 2023-03-20 18:28:10 +01:00
rfraposa
ac5ed141d8 New nav - reverting the revert 2023-03-17 21:45:43 -05:00
Alexander Tokmakov
5187507e41
Update docs/en/operations/system-tables/marked_dropped_tables.md 2023-03-17 19:20:05 +03:00
xiedeyantu
fff32d5640 add marked_dropped_tables doc 2023-03-17 23:34:28 +08:00
Alexey Perevyshin
2c6534f5c8
Merge branch 'master' into master 2023-03-16 23:57:36 +04:00
Robert Schulze
e97ded263a
Docs: Apply better syntax highlighting for clickhouse-format examples 2023-03-16 18:34:58 +00:00
alexX512
29dd2e56f9 Fix pulling pipeline 2023-03-16 12:41:17 +00:00
Alexey Perevyshin
1e9ef12f51
Merge branch 'master' into master 2023-03-15 22:21:02 +04:00
alexX512
dc1a6884ca Add documentation for a setting stop_reading_on_first_cancel 2023-03-15 14:49:24 +00:00
Robert Schulze
3bcfe02312
Docs: Fix unit for setting "max_query_size" 2023-03-15 13:29:25 +00:00
Kruglov Pavel
8456e5721d
Merge pull request #47585 from den-crane/patch-68
Doc. Fix link
2023-03-15 12:25:42 +01:00
San
b6de44e0e3
Update storing-data.md
Just a small update I spotted when discussing encryption at rest with others
2023-03-15 11:37:42 +11:00
Denny Crane
97a42dbada
Update settings.md 2023-03-14 15:13:46 -03:00
Alexey Milovidov
b2510b9442
Merge pull request #47514 from tbragin/patch-6
Update clickhouse-local.md usage instructions
2023-03-13 21:39:37 +03:00
Rich Raposa
fa6fd10e1b
Merge pull request #47431 from nellicus/async_insert_max_query_number 2023-03-13 08:03:05 -06:00
Vladimir C
9cb018545c
Merge pull request #47499 from FrankChen021/span_kind 2023-03-13 11:35:03 +01:00
Alexey Milovidov
acdb0c5979
Update clickhouse-local.md 2023-03-13 03:19:37 +03:00
Tanya Bragin
2bfcd64841
Update clickhouse-local.md
Update usage instructions for clickhouse-local to include explicit command for Mac.
2023-03-12 13:18:42 -07:00
Frank Chen
4610ca1f20 Update doc 2023-03-12 21:41:42 +08:00
Ilya Yatsishin
542eb23561
Update docs/en/operations/settings/settings.md 2023-03-10 23:20:24 +01:00
Dmitry Novik
4f24a7bd11 Merge remote-tracking branch 'origin/master' into background-memory-tracker 2023-03-10 18:57:45 +00:00
Antonio Bonuccelli
75d91f633d
Merge branch 'master' into async_insert_max_query_number 2023-03-10 17:11:05 +01:00
Kruglov Pavel
f387e6013a
Merge pull request #46990 from Avogar/native-types-conversions
Allow types conversion in Native input format
2023-03-10 16:55:16 +01:00
Antonio Bonuccelli
8819860b14
Merge branch 'master' into async_insert_max_query_number 2023-03-10 16:45:55 +01:00
nellicus
6f4833f2c3 add async_insert_max_query_number 2023-03-10 16:10:31 +01:00
Rich Raposa
7aee4eeb8c
Merge pull request #47413 from ClickHouse/revert-47407-standardize-adminitions
Revert "standardize admonitions"
2023-03-09 14:59:34 -07:00
robot-clickhouse-ci-2
80c3e387c1
Merge pull request #47389 from DerekChia/patch-1
Update Prometheus port to 9363
2023-03-09 22:39:28 +01:00
Rich Raposa
de68dade71
Revert "standardize admonitions" 2023-03-09 14:30:40 -07:00
Dan Roscigno
636aff3715
Merge pull request #47407 from DanRoscigno/standardize-adminitions
standardize admonitions
2023-03-09 12:54:41 -05:00
DanRoscigno
95351bc2d3 standardize admonitions 2023-03-09 12:05:26 -05:00
Tyler Hannan
53277831cc
Remove dated warning
scary language is inappropriately scary.
2023-03-09 16:02:06 +01:00
Kruglov Pavel
fe973f3d6f
Merge branch 'master' into native-types-conversions 2023-03-09 13:03:25 +01:00
Kruglov Pavel
71b6d6c6ae
Merge pull request #47114 from Avogar/parquet-compression
Improve working with compression methods in Parquet/ORC/Arrow formats
2023-03-09 13:02:18 +01:00
Derek Chia
1728d6ed2c
Update settings.md
- Change Prometheus port to 9363 as listed in https://clickhouse.com/docs/en/guides/sre/network-ports/
2023-03-09 11:44:27 +08:00
Antonio Andelic
a04b38db90
Merge pull request #45108 from ClickHouse/custom-key-parallel-replicas
Add support for custom key in parallel replicas
2023-03-08 17:46:11 +01:00
Sergei Trifonov
880b34fded
Update docs/en/operations/server-configuration-parameters/settings.md
Co-authored-by: pufit <pufit@clickhouse.com>
2023-03-08 10:51:34 +01:00
Sergei Trifonov
20c0476d2f
Update docs/en/operations/server-configuration-parameters/settings.md
Co-authored-by: pufit <pufit@clickhouse.com>
2023-03-08 10:51:16 +01:00
Kruglov Pavel
69a1309ade
Merge branch 'master' into native-types-conversions 2023-03-07 20:06:17 +01:00
Sergei Trifonov
3dcdf4cd4e
Docs for BackupsIOThreadPool 2/2 2023-03-07 12:12:29 +01:00
Antonio Andelic
2ae0bceb2b Address PR comments 2023-03-07 10:56:11 +00:00
Antonio Andelic
35c15e6ef8 Merge branch 'master' into custom-key-parallel-replicas 2023-03-07 09:37:38 +00:00
Mike Kot
1fca58b694
Merge branch 'master' into feature/show-secrets-option 2023-03-06 15:46:54 +03:00
Mike Kot
00dfb27eb9 rm secrets test from fasttest, correct 02117 2023-03-06 15:45:48 +03:00
Kseniia Sumarokova
7997df5739
Update storing-data.md 2023-03-03 19:50:21 +01:00
Dave Lahn
6c929737eb
Add missing policy name element
The S3 cache example had a list of policies, but was missing the policy name. This caused this configuration to fail.
2023-03-03 18:42:10 +00:00
Kruglov Pavel
3b034e7c35
Merge branch 'master' into parquet-compression 2023-03-02 15:55:48 +01:00
Antonio Andelic
01cf9c94f4 Merge branch 'master' into custom-key-parallel-replicas 2023-03-02 14:28:42 +00:00
avogar
a6cf2cdab8 Fix style, add docs 2023-03-02 10:36:07 +00:00
Sergei Trifonov
20fbb09a46
Update constraints-on-settings.md 2023-03-01 17:44:25 +01:00
pufit
29296cb004
Merge pull request #46550 from ClickHouse/46231-systerm-server-settings
Implement `system.server_settings`
2023-02-28 11:23:15 -05:00
Kruglov Pavel
545e5c0f5b
Merge pull request #46617 from Avogar/use-parquet-2
Change default parquet format version to v2_latest, add a setting to controle the version
2023-02-28 14:30:59 +01:00
avogar
ab899bf2f3 Allow types conversion in Native input format 2023-02-27 19:28:19 +00:00
Kruglov Pavel
36e65f5f84
Use versions vith dots 2023-02-27 19:00:40 +01:00
robot-clickhouse-ci-1
fc1e0608c6
Merge pull request #46962 from melvynator/patch-11
Add a warning to the schema_inference_hints
2023-02-27 16:51:24 +01:00
Mike Kot
c799bd094b
Merge branch 'master' into feature/show-secrets-option 2023-02-27 18:43:14 +03:00
pufit
c94fbc45bf Update docs 2023-02-27 10:31:41 -05:00
Kruglov Pavel
443dedddca
Merge branch 'master' into use-parquet-2 2023-02-27 14:31:43 +01:00
Kruglov Pavel
e9078b402b
Merge pull request #46742 from Avogar/update-settings
Enable input_format_json_ignore_unknown_keys_in_named_tuple by default
2023-02-27 14:30:28 +01:00
Mike Kot
62acc7a6cf setting and some docs 2023-02-27 13:18:21 +00:00
Peignon Melvyn
8fe08bc458
Add a warning to the schema_inference_hints 2023-02-27 14:02:10 +01:00
Denny Crane
fd97f7ad0a
Update settings.md 2023-02-26 19:25:13 -04:00
Rich Raposa
bb51da7de1
Merge pull request #46805 from den-crane/patch-63
Doc. Final setting
2023-02-25 16:05:54 -07:00
pufit
61b859eeaa
Update server_settings.md 2023-02-24 10:18:06 -05:00
Ilya Yatsishin
9fb24341e2
Update settings.md 2023-02-24 12:12:45 +01:00
Denny Crane
55b3bffe59
Update settings.md 2023-02-23 21:15:31 -04:00
pufit
2fbe75957d Add default column for system.settings and system.server_settings 2023-02-23 18:24:57 -05:00
Alexander Tokmakov
7b15f469cf
Merge pull request #46782 from ClickHouse/add_docs_for_44543
Add docs for #44543
2023-02-23 19:37:34 +03:00
avogar
54622566df Add setting to change parquet version 2023-02-23 16:14:10 +00:00
Alexander Tokmakov
de04760bcd add docs for #44543 2023-02-23 15:57:11 +01:00
Kruglov Pavel
35887911e3
Merge pull request #46284 from Avogar/null-as-default-all-formats
Extend setting `input_format_null_as_default` for more formats
2023-02-23 14:48:22 +01:00
Nikolai Kochetov
dbfa641c47
Merge pull request #46621 from ClickHouse/resurrect-processors-profile-log-docs
Resurrect processors_profile_log docs.
2023-02-23 13:09:35 +01:00
pufit
b878ef9f01 en documentation 2023-02-22 18:28:30 -05:00
avogar
50caa3d66c Update docs 2023-02-22 16:41:49 +00:00
Nikolai Kochetov
ab94d6dc18
Update docs/en/operations/system-tables/processors_profile_log.md
Co-authored-by: Nikita Taranov <nikita.taranov@clickhouse.com>
2023-02-22 12:16:19 +01:00
Nikolai Kochetov
98c10ff6e5
Update docs/en/operations/system-tables/processors_profile_log.md
Co-authored-by: Nikita Taranov <nikita.taranov@clickhouse.com>
2023-02-22 12:16:09 +01:00
robot-clickhouse-ci-2
2df52af445
Merge pull request #46711 from ClickHouse/vdimir/tmp-data-in-fs-cache-doc
Add doc for temporary_data_in_cache
2023-02-22 11:41:03 +01:00
vdimir
a4919ce3a2
Add doc for temporary_data_in_cache 2023-02-22 10:19:28 +00:00
Dan Roscigno
efea3cbc5c
Update docs/en/operations/settings/settings.md 2023-02-21 12:19:56 -05:00
Han Fei
eeac1abaa5 add docs for setting async_insert_max_query_number 2023-02-21 17:49:52 +01:00
Kruglov Pavel
9866ecfe8b
Merge branch 'master' into null-as-default-all-formats 2023-02-20 20:49:30 +01:00
Nikolai Kochetov
186a29a2aa Resurrect processors_profile_log docs. 2023-02-20 19:46:39 +01:00
Alexey Milovidov
bb001078c9
Update sampling-query-profiler.md 2023-02-18 14:01:47 +03:00
Antonio Andelic
ab51c1d975
Merge branch 'master' into custom-key-parallel-replicas 2023-02-17 15:06:41 +01:00
Alexey Milovidov
a1cf3f78f6
Merge pull request #46497 from ClickHouse/alexey-milovidov-patch-6
Update monitoring.md
2023-02-17 16:03:22 +03:00
Dmitry Novik
0336f0d8cc
Merge branch 'master' into background-memory-tracker 2023-02-16 20:57:44 +01:00
Alexey Milovidov
2cd9fd5698
Update monitoring.md 2023-02-16 22:09:10 +03:00
robot-ch-test-poll1
300dfbbef6
Merge pull request #46460 from ClickHouse/group-by-use-nulls-docs
Add documentation for `group_by_use_nulls` setting
2023-02-16 18:41:34 +01:00
Dmitry Novik
c95df21324 Review fixes 2023-02-16 15:38:25 +00:00
Dmitry Novik
728434821a Merge remote-tracking branch 'origin/master' into background-memory-tracker 2023-02-16 12:35:07 +00:00
Dmitry Novik
b908fa32df Add documentation for group_by_use_nulls 2023-02-16 00:57:53 +00:00
Dmitry Novik
e7a94a28ee
Merge branch 'master' into background-memory-tracker 2023-02-15 19:39:28 +01:00
Dmitry Novik
1a968b83d1 Add documentation 2023-02-15 18:34:51 +00:00
Sergei Trifonov
b7a4fa8bd9
Merge branch 'master' into round-robin-merge-scheduler 2023-02-14 20:39:02 +01:00
Antonio Andelic
adde580756
Merge branch 'master' into custom-key-parallel-replicas 2023-02-14 14:09:12 +01:00
Sema Checherinda
9bef1bec28
Merge pull request #46274 from aiven-sal/aiven-sal/keeper
coordination: do not allow election_timeout_lower_bound_ms > election_timeout_upper_bound_ms
2023-02-14 12:44:04 +01:00
Salvatore Mesoraca
fff2c09b87
coordination: do not allow election_timeout_lower_bound_ms > election_timeout_upper_bound_ms 2023-02-13 10:09:45 +01:00
Antonio Andelic
8d16fe5793
Merge branch 'master' into add-support-for-settings-alias 2023-02-13 08:46:00 +01:00
Dan Roscigno
5dd6f25d5d
Merge pull request #46276 from ClickHouse/document-log-compression
docs for logger stream_compression
2023-02-12 21:55:33 -05:00
Ilya Golshtein
38ea27489c secure in named collections - small cleanup 2023-02-13 01:04:38 +03:00
Dan Roscigno
e86b83fbd1
Update docs/en/operations/server-configuration-parameters/settings.md
Co-authored-by: Nikolay Degterinsky <43110995+evillique@users.noreply.github.com>
2023-02-12 14:55:52 -05:00
serxa
c58b165b0f add config option to select scheduling policy 2023-02-11 16:18:42 +00:00
avogar
04cf144edc Fix TSKV, update docs 2023-02-10 17:20:51 +00:00
DanRoscigno
043c1b7d8d docs for logger stream_compression 2023-02-10 09:02:54 -05:00
Antonio Andelic
f96d480563
Merge branch 'master' into add-support-for-settings-alias 2023-02-09 16:07:45 +01:00
Kruglov Pavel
b5f90c608a
Merge branch 'master' into parquet-fixed-binary 2023-02-09 11:26:38 +01:00
Vladimir C
ecb5802c4b
Update docs/en/operations/settings/settings.md
Co-authored-by: Dmitry Novik <n0vik@clickhouse.com>
2023-02-09 10:59:14 +01:00
vdimir
88174fbaaa
Add doc for optimize_rewrite_aggregate_function_with_if 2023-02-08 14:27:25 +00:00
Kruglov Pavel
cf2587cd1b
Add docs 2023-02-08 12:32:26 +01:00
Antonio Andelic
f67e5505ab Merge branch 'master' into custom-key-parallel-replicas 2023-02-06 11:12:39 +00:00
Antonio Andelic
a58653820e Update docs 2023-02-03 18:19:12 +00:00
Robert Schulze
5d9687f5d9
Merge branch 'master' into qc-max_cache_size 2023-02-02 16:12:36 +01:00
Robert Schulze
cfcf957c75
Docs: Remove obsolete query result cache page 2023-02-02 11:33:35 +00:00
Robert Schulze
53e1c9cd08
Merge branch 'master' into qc-max_cache_size 2023-02-02 11:45:29 +01:00
Vladimir C
b389c1effb
Merge pull request #45589 from ClickHouse/optimize-constraints 2023-02-01 12:57:02 +01:00