The new setting should allow to control query complexity on leaf nodes
excluding the final merging stage on the root-node. For example, distributed
query that reads 1k rows from 5 shards will breach the `max_rows_to_read=5000`,
while effectively every shard reads only 1k rows. With setting `max_rows_to_read_leaf=1500`
this limit won't be reached and query will succeed since every shard reads
not more that ~1k rows.
Possible values:
- 1 - Do not merge aggregation states from different servers for distributed query processing - in case it is for certain that there are different keys on different shards.
- 2 - same as 1 but also apply ORDER BY and LIMIT stages
* Docs in English for the ttl_only_drop_parts setting.
* Docs in Russian.
* Update docs/ru/operations/settings/settings.md
Co-authored-by: BayoNet <da-daos@yandex.ru>
Co-authored-by: Olga Revyakina <revolg@yandex-team.ru>
Co-authored-by: BayoNet <da-daos@yandex.ru>
Before this patch there was:
- parallel_distributed_insert_select=1, that executes:
INSERT INTO dist_out SELECT ... FROM underlying_dist_in
After this patch there will be:
- parallel_distributed_insert_select=2, that executes:
INSERT INTO underlying_dist_out SELECT ... FROM underlying_dist_in
And cover the behaviour w/o integration test, by using the following
techincs:
- SYSTEM STOP DISTRIBUTED SENDS
- prefer_localhost_replica=0
* add EN description
* changes after review
* add RU version
* Update docs/en/operations/settings/settings.md
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
* DOCSUP-711: (en) In settings added description for output_format_json_quote_denormals.
* DOCSUP-711: Fix invalid anchor.
* DOCSUP-711: (ru) In settings added description for output_format_json_quote_denormals.
* DOCSUP-711: Change values styles.
* DOCSUP-711: Add a link from the setting description to the JSON format description. (by pr comment)
Add a link from the JSON format description to the setting description. (by pr comment)
* DOCSUP-711: Rewrite sentence.
* DOCSUP-711: (ru) Added link from settings.md to JSON format.
* DOCSUP-711: (en) Added example of output with the setting (by pr comment).
* DOCSUP-711: Add example of output with the setting.
* DOCSUP-711: Minor fix.
* DOCSUP-711: Update example of settings using.
* DOCSUP-711: Minor fix.
* Update docs/en/interfaces/formats.md by pr
Co-authored-by: BayoNet <da-daos@yandex.ru>
* [wip]Update docs/en/operations/settings/settings.md
Co-authored-by: BayoNet <da-daos@yandex.ru>
* DOCSUP-711: (en) Add sample table and fix pr comments.
* DOCSUP-711: (ru) Updated from en and by pr comments.
* DOCSUP-711: (ru) Updated from en and by pr comments.
* DOCSUP-711: Added name for sample table.
* Update docs/ru/operations/settings/settings.md by pr comment
Co-authored-by: BayoNet <da-daos@yandex.ru>
* Update docs/ru/interfaces/formats.md by pr comment
Co-authored-by: BayoNet <da-daos@yandex.ru>
* Update settings.md
* Update settings.md
Co-authored-by: romanzhukov <romanzhukov@yandex-team.ru>
Co-authored-by: BayoNet <da-daos@yandex.ru>
Without explicitly defined unit of measurement the description for
setting `max_insert_block_size` may result into confusion and mistakenly
interpret as bytes.
* Docs in English for optimize_read_in_order setting.
* Link misspelling fixed.
* Usage section moved to the ORDER BY topic.
* Link fixed.
* Update docs/en/sql-reference/statements/select/order-by.md
Co-authored-by: BayoNet <da-daos@yandex.ru>
* Update docs/en/sql-reference/statements/select/order-by.md
Co-authored-by: BayoNet <da-daos@yandex.ru>
* Apply suggestions from code review
Co-authored-by: BayoNet <da-daos@yandex.ru>
* Apply suggestions from code review
Co-authored-by: BayoNet <da-daos@yandex.ru>
* Update docs/en/sql-reference/statements/select/order-by.md
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
* Small fix in English and translation into Russian.
Co-authored-by: Olga Revyakina <revolg@yandex-team.ru>
Co-authored-by: BayoNet <da-daos@yandex.ru>
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
* Docs in English.
* Fixed links bug.
* Update docs/en/sql-reference/statements/alter/delete.md
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
* Translated into Russian. Anchors in links syncronized with English text. One minor change in English text to unify two similar descriptions.
Co-authored-by: Olga Revyakina <revolg@yandex-team.ru>
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
* DOCSUP-987: parallel_distributed_insert_select setting (#145)
* add EN version
* add EN version
* changes after review in EN version
* add RU version
* CLICKHOUSEDOCS-590: Updated text
Co-authored-by: Evgenia Sudarikova <56156889+otrazhenia@users.noreply.github.com>
Co-authored-by: Sergei Shtykov <bayonet@yandex-team.ru>
* Geo functions - en/ru sync.
* Fixed bug with levels.
* Apply suggestions from code review
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
Co-authored-by: BayoNet <da-daos@yandex.ru>
* Geo functions splitted into 3 files.
* Links fixed.
* Link fixed.
* Anchor fixed.
* Add into TOC.
* Temporarily removed anchors.
* Working on TOC.
* Links to original article.
* TOC and links in English and Russian.
* TOC in English, content in index.
* Link fixed.
* TOC in Russian, with content in index file.
* Added index file to geo functions
* fixed links in ru
Co-authored-by: Olga Revyakina <revolg@yandex-team.ru>
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
Co-authored-by: BayoNet <da-daos@yandex.ru>
Co-authored-by: Sergei Shtykov <bayonet@yandex-team.ru>
* DOCSUP-1350 (#128)
* edited EN version
* add EN and RU translation
* minor changes
* CLICKHOUSEDOCS-635: Updated the description.
Co-authored-by: Sergei Shtykov <bayonet@yandex-team.ru>
Co-authored-by: Evgenia Sudarikova <56156889+otrazhenia@users.noreply.github.com>
- optimize_skip_unused_shards_nesting (allows control nesting level for
shards skipping optimization)
- force_skip_optimize_shards_nesting (allows control nesting level for
checking was shards skipped or not)
- deprecates force_skip_optimize_shards_no_nested
P.S. Looks like settings can be converted between SettingUInt64 and
SettingBool without breaking binary protocol.
FWIW maybe it is a good idea to change the semantics of the settings as
follow (but I guess that changing semantic is not a good idea, better to
add new settings and deprecate old ones):
- optimize_skip_unused_shards -- accept nesting level on which the
optimization will work
- force_skip_optimize_shards_nesting -- accept nesting level on which
the optimization will work
* DOCSUP-1036: Describe settings for different pools (#118)
* describe settings for different pools
* minor changes
* add refs to and from distributed, server settings, kafka, replication, mergetree
* changes in links description
* add description and links to RU version
* add descrtiption and links to ru version
* minor changes
* CLICKHOUSEDOCS-620: Returned text lost by the last merge.
Co-authored-by: Evgenia Sudarikova <56156889+otrazhenia@users.noreply.github.com>
Co-authored-by: Sergei Shtykov <bayonet@yandex-team.ru>
* CLICKHOUSEDOCS-323: The first version of the description.
* CLICKHOUSEDOCS-323: Update.
* CLICKHOUSEDOCS-323: toLowCardinality, low_cardinality_max_dictionary_size
* CLICKHOUSEDOCS-323: Added descriptions of low_cardinality_use_single_dictionary_for_part, low_cardinality_allow_in_native_format, allow_suspicious_low_cardinality_types.
* Update docs/en/sql-reference/data-types/lowcardinality.md
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
* Update docs/en/sql-reference/data-types/lowcardinality.md
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
* Update docs/en/sql-reference/functions/type-conversion-functions.md
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
* CLICKHOUSEDOCS-323: Updated by comments.
* CLICKHOUSEDOCS-323: Updated by comments.
* CLICKHOUSEDOCS-323: Fixed some grammar.
Co-authored-by: Sergei Shtykov <bayonet@yandex-team.ru>
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
Can be used to write into query_log only failed queries (i.e. on memory
exceeded error), by using:
set log_queries_min_type='EXCEPTION_WHILE_PROCESSING'
* CLICKHOUSEDOCS-559: Started to describe GRANT
* CLICKHOUSEDOCS-559: Added headers for some other kinds of quries.
* CLICKHOUSEDOCS-559: Further edits.
* CLICKHOUSEDOCS-559: Updated grant description.
* CLICKHOUSEDOCS-559: The first version for the GRANT statement is finished.
* CLICKHOUSEDOCS-559: Almost finished CREATE USER
* CLICKHOUSEDOCS-559: Finished the first version of CREATE queries.
* CLICKHOUSEDOCS-559: Finished ALTER, DROP and SET.
* CLICKHOUSEDOCS-559: Finished the first version of statements.
* CLICKHOUSEDOCS-559: Update by review.
* CLICKHOUSEDOCS-559: Update by review.
* Update docs/en/query_language/alter.md
* Update docs/en/query_language/create.md
Co-Authored-By: Ilya Yatsishin <2159081+qoega@users.noreply.github.com>
* Update docs/en/query_language/grant.md
Co-Authored-By: Ilya Yatsishin <2159081+qoega@users.noreply.github.com>
* Update by comments. Also RBAC-7 aplied.
* moved new files to new structure
* Adopted added articles to a new structure.
* CLICKHOUSEDOCS-559: Fixed links.
* CLICKHOUSEDOCS-559: Links fix.
* CLICKHOUSEDOCS-559: Updated privileges by RBAC-8 changes
* CLICKHOUSEDOCS-559: Added CREATE, ALTER, DROP, and SHOW queries for QUOTAS and SETTINGS PROFILES.
* CLICKHOUSEDOCS-559: Added ON CLUSTER for CREATE, ALTER, DROP.
* CLICKHOUSEDOCS-559: Fixed code-blocks and the anchor.
* CLICKHOUSEDOCS-559: Edits after the last portion of commentaries.
* CLICKHOUSEDOCS-559: Changed example
Co-authored-by: Sergei Shtykov <bayonet@yandex-team.ru>
Co-authored-by: Ilya Yatsishin <2159081+qoega@users.noreply.github.com>
force_optimize_skip_unused_shards_no_nested will disable
force_optimize_skip_unused_shards for nested Distributed tables.
Can be useful for multi-layred/bi-level sharding.
* replace exit with assert in test_single_page
* improve save_raw_single_page docs option
* More grammar fixes
* "Built from" link in new tab
* fix mistype
* Example of include in docs
* add anchor to meeting form
* Draft of translation helper
* WIP on translation helper
* Replace some fa docs content with machine translation
* add normalize-en-markdown.sh
* normalize some en markdown
* normalize some en markdown
* admonition support
* normalize
* normalize
* normalize
* support wide tables
* normalize
* normalize
* normalize
* normalize
* normalize
* normalize
* normalize
* normalize
* normalize
* normalize
* normalize
* normalize
* normalize
* lightly edited machine translation of introdpection.md
* lightly edited machhine translation of lazy.md
* WIP on translation utils
* Normalize ru docs
* Normalize other languages
* some fixes
* WIP on normalize/translate tools
* add requirements.txt
* [experimental] add es docs language as machine translated draft
* remove duplicate script
* Back to wider tab-stop (narrow renders not so well)
