Commit Graph

1454 Commits

Author SHA1 Message Date
Kruglov Pavel
9749448eb0
Merge pull request #47229 from Avogar/non-blocking-connect
Improve async reading from socket
2023-04-21 10:38:50 +02:00
Andrey Zvonov
984e8fde41
Merge branch 'master' into zvonand-implicit-tz 2023-04-20 23:13:17 +02:00
Dan Roscigno
aec97033c9
Merge pull request #48940 from ClickHouse/DanRoscigno-patch-5
Update query-complexity.md
2023-04-20 10:56:31 -04:00
Robert Schulze
cdf28f9b71
Minor fixups 2023-04-19 16:16:51 +00:00
Robert Schulze
c406663442
Docs: Replace annoying three spaces in enumerations by a single space 2023-04-19 15:56:55 +00:00
Dan Roscigno
df70f6985c
Update query-complexity.md
The docs say that max_memory_usage is set to 10GB in the default config, but max_memory_usage does not appear in the default config, so the default is unlimited.
2023-04-19 09:16:22 -04:00
Andrey Zvonov
61f55930ce
Update docs/en/operations/settings/settings.md
Co-authored-by: Vasily Nemkov <V.Nemkov@gmail.com>
2023-04-19 15:46:17 +03:00
zvonand
daae5025e8 small updates due to review 2023-04-19 14:45:51 +02:00
Kruglov Pavel
2ad161d2b7
Merge branch 'master' into non-blocking-connect 2023-04-19 13:39:40 +02:00
Youenn Lebras
082c5b0224 Document the new feature of the ReplacingMergeTree engine of the PR #41005 2023-04-18 11:17:46 +02:00
zvonand
22be85d976 renamed setting 2023-04-18 02:42:30 +02:00
Alexander Tokmakov
75f18b1198
Revert "Check simple dictionary key is native unsigned integer" 2023-04-13 01:32:19 +03:00
Anton Popov
1520f3e924
Merge pull request #48335 from lzydmxy/check_sample_dict_key_is_correct
Check simple dictionary key is native unsigned integer
2023-04-12 14:27:39 +02:00
zvonand
2a9f28b73b resolve 2023-04-12 12:54:39 +02:00
Dmitry Novik
435a0ab9bb Fix a typo 2023-04-11 14:13:37 +00:00
Dmitry Novik
5488fb0fec Add documentation for additional_result_filter setting 2023-04-11 14:07:17 +00:00
Anton Popov
027f8a02c8
Merge branch 'master' into check_sample_dict_key_is_correct 2023-04-05 16:31:57 +02:00
lzydmxy
529e1466df use check_dictionary_primary_key instead of check_sample_dict_key_is_correct 2023-04-04 12:04:17 +08:00
Kruglov Pavel
9e595c82fa
Merge pull request #47494 from KevinyhZou/enable_return_null_element_not_exist
Enable return null and complext type for JSON_VALUE function
2023-04-03 14:05:18 +02:00
Robert Schulze
a50e741bea
Merge pull request #45912 from ClickHouse/qc-compression
Query cache: Enable compression of cache entries
2023-04-03 13:33:47 +02:00
Robert Schulze
3e124f09d0
Merge remote-tracking branch 'origin/master' into qc-compression 2023-04-03 11:28:17 +00:00
KevinyhZou
da4ff587af review fix 2023-04-02 12:38:17 +08:00
KevinyhZou
ce5f4cf4ab code review fix 2023-04-02 12:37:18 +08:00
Rich Raposa
4cb3c92607
Update merge-tree-settings.md
For some reason the links are broken - I'm attempting to fix them here
2023-03-31 12:38:45 -06:00
Rich Raposa
330508552e
Merge branch 'master' into docs/background_pool_size 2023-03-31 11:24:00 -06:00
kst-morozov
048ea93c09 upadte doc 2023-03-31 17:59:19 +02:00
Rich Raposa
3a3438ebf9
Update settings-formats.md
Default compression method for Parquet changed from snappy to lz4 in 23.3
2023-03-30 10:26:33 -06:00
Nikolai Kochetov
f06bdc85eb
Merge pull request #48226 from ClickHouse/rename-setting-stop_reading_on_first_cancel
Rename setting stop_reading_on_first_cancel
2023-03-30 18:03:23 +02:00
Nikolai Kochetov
06bf500c30
Update settings.md 2023-03-30 17:36:56 +02:00
filimonov
fbb22348ea
Refactor reading the pool setting & from server config. (#48055)
After #36425 there was a lot of confusions/problems with configuring pools - when the message was confusing, and settings need to be ajusted in several places.
See some examples in #44251, #43351, #47900, #46515.

The commit includes the following changes:
1) Introduced a unified mechanism for reading pool sizes from the configuration file(s). Previously, pool sizes were read from the Context.cpp with fallbacks to profiles, whereas main_config_reloader in Server.cpp read them directly without fallbacks.
2) Corrected the data type for background_merges_mutations_concurrency_ratio. It should be float instead of int.
3) Refactored the default values for settings. Previously, they were defined in multiple places throughout the codebase, but they are now defined in one place (or two, to be exact: Settings.h and ServerSettings.h).
4) Improved documentation, including the correct message in system.settings.

Additionally make the code more conform with #46550.
2023-03-30 16:44:11 +02:00
Nikolai Kochetov
a8a28bdf3d Merge branch 'master' into rename-setting-stop_reading_on_first_cancel 2023-03-30 16:07:14 +02:00
Nikolai Kochetov
f870e6f7a9 Rename setting stop_reading_on_first_cancel to partial_result_on_first_cancel. 2023-03-30 14:00:44 +00:00
Robert Schulze
b0473098c6
Merge branch 'master' into qc-compression 2023-03-30 10:55:42 +02:00
Denny Crane
2c231a6ac4
Update settings.md 2023-03-29 20:49:44 -03:00
Robert Schulze
b324d0ed5e
Merge branch 'master' into qc-compression 2023-03-29 15:09:22 +02:00
Dan Roscigno
c8f59194a3
Merge pull request #48070 from den-crane/patch-60
Doc. idle_connection_timeout
2023-03-27 15:17:08 -04:00
DanRoscigno
6d8a2bbd48 standardize admonitions 2023-03-27 14:54:05 -04:00
Denny Crane
295d3b7510
Update settings.md 2023-03-27 14:45:43 -03:00
Denny Crane
98488f30ab
Update settings.md 2023-03-27 14:40:45 -03:00
Kruglov Pavel
f3f93dd06c
Merge branch 'master' into non-blocking-connect 2023-03-24 15:59:40 +01:00
rfraposa
747eaf3f72 Fix broken links 2023-03-23 14:40:45 -06:00
Kruglov Pavel
3ee12e21fb
Merge branch 'master' into non-blocking-connect 2023-03-23 20:53:44 +01:00
avogar
38e44861ae Fix possible race conditions 2023-03-21 16:01:54 +00:00
Robert Schulze
d8493780b2
Query cache: Enable compression and squashing of result blocks
ClickHouse reads table data in blocks of 'max_block_size' rows. Due to
filtering, aggregation, etc., result blocks are typically much smaller
than 'max_block_size' but there are also cases where they are much
bigger. Setting 'query_cache_squash_partial_results' (enabled by
default) now controls if result blocks are squashed (if they are tiny)
or split (if they are large) into blocks of 'max_block_size' size before
insertion into the query result cache. This reduces performance of
writes into the query cache but improves compressability of cache
entries and provides more natural block granularity when query results
are later served from the query cache.

Entries in the query cache are now also compressed by default. This
reduces the overall memory consumption at the cost of slower writes into
/ reads from the query cache. To disable compression, use setting
'query_cache_compress_entries'.
2023-03-20 20:11:41 +00:00
Sergei Trifonov
273770519b
Merge branch 'master' into master 2023-03-20 18:28:10 +01:00
rfraposa
ac5ed141d8 New nav - reverting the revert 2023-03-17 21:45:43 -05:00
Alexander Tokmakov
ec44c8293a
Revert "New navigation" 2023-03-17 21:21:11 +03:00
rfraposa
60fb9973d7 trailing slash fixes 2023-03-16 16:43:01 -05:00
alexX512
29dd2e56f9 Fix pulling pipeline 2023-03-16 12:41:17 +00:00
Rich Raposa
81cd962773
Merge branch 'master' into new-nav 2023-03-15 22:23:44 -06:00
Andrey Zvonov
4327d707e0
Merge branch 'master' into zvonand-implicit-tz 2023-03-15 22:18:52 +01:00
Alexey Perevyshin
1e9ef12f51
Merge branch 'master' into master 2023-03-15 22:21:02 +04:00
alexX512
dc1a6884ca Add documentation for a setting stop_reading_on_first_cancel 2023-03-15 14:49:24 +00:00
Robert Schulze
3bcfe02312
Docs: Fix unit for setting "max_query_size" 2023-03-15 13:29:25 +00:00
Rich Raposa
8897893229
Merge branch 'master' into new-nav 2023-03-13 10:15:43 -06:00
Ilya Yatsishin
542eb23561
Update docs/en/operations/settings/settings.md 2023-03-10 23:20:24 +01:00
Rich Raposa
eb4961ac0c
Merge branch 'master' into new-nav 2023-03-10 10:35:30 -07:00
Antonio Bonuccelli
75d91f633d
Merge branch 'master' into async_insert_max_query_number 2023-03-10 17:11:05 +01:00
Antonio Bonuccelli
8819860b14
Merge branch 'master' into async_insert_max_query_number 2023-03-10 16:45:55 +01:00
nellicus
6f4833f2c3 add async_insert_max_query_number 2023-03-10 16:10:31 +01:00
Rich Raposa
de68dade71
Revert "standardize admonitions" 2023-03-09 14:30:40 -07:00
DanRoscigno
95351bc2d3 standardize admonitions 2023-03-09 12:05:26 -05:00
Rich Raposa
66dd5b3834
Merge branch 'master' into new-nav 2023-03-09 08:12:23 -07:00
Kruglov Pavel
fe973f3d6f
Merge branch 'master' into native-types-conversions 2023-03-09 13:03:25 +01:00
Kruglov Pavel
71b6d6c6ae
Merge pull request #47114 from Avogar/parquet-compression
Improve working with compression methods in Parquet/ORC/Arrow formats
2023-03-09 13:02:18 +01:00
Rich Raposa
f24fad9e26
Merge branch 'master' into new-nav 2023-03-08 14:31:10 -07:00
rfraposa
fa6f3dadba Link fixes 2023-03-07 22:52:43 -07:00
rfraposa
008845216d Fix broken links 2023-03-07 14:06:14 -07:00
Kruglov Pavel
69a1309ade
Merge branch 'master' into native-types-conversions 2023-03-07 20:06:17 +01:00
Antonio Andelic
2ae0bceb2b Address PR comments 2023-03-07 10:56:11 +00:00
Mike Kot
1fca58b694
Merge branch 'master' into feature/show-secrets-option 2023-03-06 15:46:54 +03:00
Mike Kot
00dfb27eb9 rm secrets test from fasttest, correct 02117 2023-03-06 15:45:48 +03:00
Kruglov Pavel
3b034e7c35
Merge branch 'master' into parquet-compression 2023-03-02 15:55:48 +01:00
Antonio Andelic
01cf9c94f4 Merge branch 'master' into custom-key-parallel-replicas 2023-03-02 14:28:42 +00:00
avogar
a6cf2cdab8 Fix style, add docs 2023-03-02 10:36:07 +00:00
Sergei Trifonov
20fbb09a46
Update constraints-on-settings.md 2023-03-01 17:44:25 +01:00
Kruglov Pavel
545e5c0f5b
Merge pull request #46617 from Avogar/use-parquet-2
Change default parquet format version to v2_latest, add a setting to controle the version
2023-02-28 14:30:59 +01:00
avogar
ab899bf2f3 Allow types conversion in Native input format 2023-02-27 19:28:19 +00:00
Kruglov Pavel
36e65f5f84
Use versions vith dots 2023-02-27 19:00:40 +01:00
robot-clickhouse-ci-1
fc1e0608c6
Merge pull request #46962 from melvynator/patch-11
Add a warning to the schema_inference_hints
2023-02-27 16:51:24 +01:00
Mike Kot
c799bd094b
Merge branch 'master' into feature/show-secrets-option 2023-02-27 18:43:14 +03:00
Kruglov Pavel
443dedddca
Merge branch 'master' into use-parquet-2 2023-02-27 14:31:43 +01:00
Kruglov Pavel
e9078b402b
Merge pull request #46742 from Avogar/update-settings
Enable input_format_json_ignore_unknown_keys_in_named_tuple by default
2023-02-27 14:30:28 +01:00
Mike Kot
62acc7a6cf setting and some docs 2023-02-27 13:18:21 +00:00
Peignon Melvyn
8fe08bc458
Add a warning to the schema_inference_hints 2023-02-27 14:02:10 +01:00
Denny Crane
fd97f7ad0a
Update settings.md 2023-02-26 19:25:13 -04:00
zvonand
49fb028498 Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-implicit-tz 2023-02-26 17:20:09 +01:00
Denny Crane
55b3bffe59
Update settings.md 2023-02-23 21:15:31 -04:00
zvonand
a9d0f7e7db Added docs for new serverTimeZone function
Updated tests and docs
2023-02-23 19:14:49 +01:00
avogar
54622566df Add setting to change parquet version 2023-02-23 16:14:10 +00:00
Kruglov Pavel
35887911e3
Merge pull request #46284 from Avogar/null-as-default-all-formats
Extend setting `input_format_null_as_default` for more formats
2023-02-23 14:48:22 +01:00
Nikolai Kochetov
dbfa641c47
Merge pull request #46621 from ClickHouse/resurrect-processors-profile-log-docs
Resurrect processors_profile_log docs.
2023-02-23 13:09:35 +01:00
avogar
50caa3d66c Update docs 2023-02-22 16:41:49 +00:00
zvonand
393830ecdc add docs + tiny cleanup 2023-02-22 16:30:46 +01:00
Dan Roscigno
efea3cbc5c
Update docs/en/operations/settings/settings.md 2023-02-21 12:19:56 -05:00
Han Fei
eeac1abaa5 add docs for setting async_insert_max_query_number 2023-02-21 17:49:52 +01:00
Kruglov Pavel
9866ecfe8b
Merge branch 'master' into null-as-default-all-formats 2023-02-20 20:49:30 +01:00
Nikolai Kochetov
186a29a2aa Resurrect processors_profile_log docs. 2023-02-20 19:46:39 +01:00
Antonio Andelic
ab51c1d975
Merge branch 'master' into custom-key-parallel-replicas 2023-02-17 15:06:41 +01:00
Dmitry Novik
c95df21324 Review fixes 2023-02-16 15:38:25 +00:00
Dmitry Novik
b908fa32df Add documentation for group_by_use_nulls 2023-02-16 00:57:53 +00:00
Antonio Andelic
adde580756
Merge branch 'master' into custom-key-parallel-replicas 2023-02-14 14:09:12 +01:00
Antonio Andelic
8d16fe5793
Merge branch 'master' into add-support-for-settings-alias 2023-02-13 08:46:00 +01:00
avogar
04cf144edc Fix TSKV, update docs 2023-02-10 17:20:51 +00:00
Antonio Andelic
f96d480563
Merge branch 'master' into add-support-for-settings-alias 2023-02-09 16:07:45 +01:00
Kruglov Pavel
b5f90c608a
Merge branch 'master' into parquet-fixed-binary 2023-02-09 11:26:38 +01:00
Vladimir C
ecb5802c4b
Update docs/en/operations/settings/settings.md
Co-authored-by: Dmitry Novik <n0vik@clickhouse.com>
2023-02-09 10:59:14 +01:00
vdimir
88174fbaaa
Add doc for optimize_rewrite_aggregate_function_with_if 2023-02-08 14:27:25 +00:00
Kruglov Pavel
cf2587cd1b
Add docs 2023-02-08 12:32:26 +01:00
Antonio Andelic
f67e5505ab Merge branch 'master' into custom-key-parallel-replicas 2023-02-06 11:12:39 +00:00
Antonio Andelic
a58653820e Update docs 2023-02-03 18:19:12 +00:00
Robert Schulze
cfcf957c75
Docs: Remove obsolete query result cache page 2023-02-02 11:33:35 +00:00
Vladimir C
b389c1effb
Merge pull request #45589 from ClickHouse/optimize-constraints 2023-02-01 12:57:02 +01:00
Robert Schulze
9a8af6a42e
Update docs/en/operations/settings/settings.md
Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
2023-01-31 12:44:20 +01:00
Antonio Andelic
c99efa75b7
Merge branch 'master' into custom-key-parallel-replicas 2023-01-31 11:58:30 +01:00
Robert Schulze
325c6bdf3d
Renaming: "Query Result Cache" --> "Query Cache"
Reasons:

- The cache will at some point store intermediate results as opposed to
  only query results. We should change the terminology now without
  having to worry about backward compat.

- Equivalent caches in MySQL (1) and Starrocks (2) are called "query
  cache".

- The new name is ca. 13.8% more catchy.

(1) https://dev.mysql.com/doc/refman/5.6/en/query-cache.html
(2) https://docs.starrocks.io/en-us/2.5/using_starrocks/query_cache
2023-01-31 09:54:34 +00:00
Robert Schulze
659a64a1d9
Merge pull request #45679 from ClickHouse/untangle-query-result-cache-settings
Untangle configuration of query result cache
2023-01-31 10:44:14 +01:00
Igor Nikonov
741c3ba23c Fix non-intentional change 2023-01-30 18:43:01 +01:00
Igor Nikonov
01b225f57e
Update docs/en/operations/settings/settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-30 18:30:59 +01:00
Igor Nikonov
211449d916
Update docs/en/operations/settings/settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-30 18:30:29 +01:00
Igor Nikonov
b095dab141
Update docs/en/operations/settings/settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-30 18:29:32 +01:00
Igor Nikonov
0c4bc489da
Update docs/en/operations/settings/settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-30 18:28:53 +01:00
Igor Nikonov
30c949ba27
Update docs/en/operations/settings/settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-30 18:28:34 +01:00
Igor Nikonov
c30a55b7ee Some polishing 2023-01-30 16:53:37 +01:00
Igor Nikonov
d8ba469b97
Fixes 2023-01-30 16:24:02 +01:00
Igor Nikonov
65caa77a0e
Update settings.md 2023-01-30 16:13:08 +01:00
Robert Schulze
27b978381b
Use more speaking setting names 2023-01-30 14:20:43 +00:00
Robert Schulze
e30c38cab3
Fix up some leftovers 2023-01-27 10:43:43 +00:00
Azat Khuzhin
1a8437f2c9 Add ability to ignore unknown keys in JSON object for named tuples
This can be useful in case your input JSON is complex, while you need
only few fields in it.

This behaviour is controlled by the
input_format_json_ignore_unknown_keys_in_named_tuple setting name, that
is turned OFF by default.

This will, almost, allow to parse gharchive dataset without jq. "almost"
because of two things:
- Tuple cannot be Nullable, so such keys with Tuple type in ClickHouse
  cannot be `null` in JSON
- You cannot use dot.dot notation to extract columns for file() engine,
  only tupleElement()

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-27 10:01:08 +01:00
Robert Schulze
7d97fab2dc
Untangle query result cache settings
This PR modularizes the configuration options of the query result cache
(QRC).

1. Add a feature toggle "allow_experimental_query_result_cache = false"
   which controls whether the experimental QRC can be used at all. This
   configuration option will be removed once the QRC becomes
   non-experimental.

2. Modularize the existing two configuration settings
   "enable_experimental_query_result_cache" and
   "enable_experimental_query_result_cache_passive_usage" into three
   orthogonal settings:

   - "use_query_result_cache = false" controls whether a query (or all
     queries of the session) utilize the query result cache

   - settings "use_query_result_cache_passive_usage = true" and
     "use_query_result_cache_active_usage = true" control the way a
     query (or all queries of the session) utilize the query result
     cache: "passive" use is reading, "active" use is writing.
2023-01-26 21:17:48 +00:00
Dan Roscigno
76d6e2edf9
Merge pull request #45569 from AVMusorin/docs_optimize_skip_merged_partitions
docs: added optimize_skip_merged_partitions setting
2023-01-26 16:04:27 -05:00
Igor Nikonov
ed01f76c6a
Merge pull request #45592 from ClickHouse/update-insert-delay-doc-2
Update INSERT delay doc with example
2023-01-26 12:55:35 +01:00
Antonio Andelic
07b2c5ce0f
Merge branch 'master' into custom-key-parallel-replicas 2023-01-26 12:42:04 +01:00
Dan Roscigno
b4ab361366
Merge branch 'master' into docs_optimize_skip_merged_partitions 2023-01-25 19:45:32 -05:00
Dan Roscigno
e520bd8052
Apply suggestions from code review 2023-01-24 19:10:30 -05:00
Igor Nikonov
29ef6b9574
Update INSERT delay doc properly 2023-01-25 00:26:32 +01:00
Dan Roscigno
dbb83dc9a4
Merge branch 'master' into docs-for-s3-settings 2023-01-24 17:55:31 -05:00
DanRoscigno
fe56967af7 fix note formatting 2023-01-24 17:44:10 -05:00
DanRoscigno
9775987ee9 add new settings for s3 and hdfs 2023-01-24 17:40:37 -05:00
DanRoscigno
f95bc55923 split Format settings out 2023-01-24 17:19:50 -05:00
rfraposa
6f7755ebcd Added optimize using constraints settings 2023-01-24 15:05:34 -07:00
Igor Nikonov
e585a1228f
Update docs/en/operations/settings/merge-tree-settings.md
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-01-24 16:52:32 +01:00
Igor Nikonov
21b009fdec
Update merge-tree-settings.md 2023-01-24 15:45:21 +01:00
AVMusorin
5f8658b2d6
docs: added optimize_skip_merged_partitions setting 2023-01-24 14:56:39 +01:00
DanRoscigno
72b1a65984 WIP 2023-01-24 07:45:59 -05:00
Antonio Andelic
95853af459 Merge branch 'master' into custom-key-parallel-replicas 2023-01-24 10:49:40 +00:00
Antonio Andelic
37b62b3a58 Use Map for custom_key 2023-01-24 10:46:47 +00:00
DanRoscigno
dedb4e4de2 add docs for PR 33302 2023-01-23 16:14:39 -05:00
Kruglov Pavel
478a552a0a
Merge branch 'master' into tsv-csv-detect-header 2023-01-23 21:47:17 +01:00
Robert Schulze
0ab7ae6c17
Merge pull request #43797 from ClickHouse/query-result-cache
Query result cache [experimental]
2023-01-23 19:54:35 +01:00
Antonio Andelic
c15128491b Update max_parallel_replicas docs 2023-01-23 17:24:48 +01:00
Robert Schulze
ed84021aa5
Formatting fixup 2023-01-22 16:45:26 +01:00
Robert Schulze
0ffffdd442
Docs: Fix weird formatting 2023-01-22 15:38:11 +00:00
Robert Schulze
340f406553
Merge branch 'master' into query-result-cache 2023-01-22 13:21:36 +01:00
Han Fei
18a397f8c9 address comments 2023-01-20 18:09:42 +01:00
Han Fei
449ace3373
Update docs/en/operations/settings/settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-20 18:07:19 +01:00
Han Fei
9d87bd10ee
Update docs/en/operations/settings/settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-20 18:07:08 +01:00
Han Fei
badfbcb3d8
Update docs/en/operations/settings/settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-20 18:06:58 +01:00
Han Fei
e9c4cf46cd
Update docs/en/operations/settings/merge-tree-settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-20 18:06:46 +01:00
Han Fei
9d254f7d87
Update docs/en/operations/settings/merge-tree-settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-20 18:06:32 +01:00
Han Fei
5fc4998f10 update docs for async insert deduplication 2023-01-20 14:42:11 +01:00
Robert Schulze
4f90824347
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-17 22:49:53 +00:00
Kruglov Pavel
96bb99f864
Merge branch 'master' into tsv-csv-detect-header 2023-01-17 15:33:02 +01:00
Vladimir C
b80ee8df50
Merge pull request #45256 from DanRoscigno/add-grace-hash-docs 2023-01-16 18:43:19 +01:00
Kruglov Pavel
e9d6590926
Merge branch 'master' into tsv-csv-detect-header 2023-01-16 17:50:24 +01:00
avogar
1c0941d72a Add docs and examples 2023-01-16 16:46:41 +00:00
Robert Schulze
099e30ef2a
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-16 08:04:49 +00:00
DanRoscigno
d0a55f6dc9 doc grace_hash algorithm for join 2023-01-13 13:17:03 -05:00
avogar
87b934c472 Insert default values in case of missing tuple elements in JSONEachRow 2023-01-12 16:36:44 +00:00
rfraposa
1ddc9c3bb6 Update merge-tree-settings.md 2023-01-11 05:44:51 -07:00
Dan Roscigno
37da8e206b
Merge pull request #45119 from ClickHouse/add-default-table-engine-setting
Added description of default_table_engine setting
2023-01-10 09:59:09 -05:00
Dan Roscigno
ee88814cac
formal to form 2023-01-10 09:42:04 -05:00
rfraposa
d61eae8554 Update settings.md
Added description of default_table_engine
2023-01-10 07:40:22 -07:00
Robert Schulze
0c3b034887
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-10 09:02:41 +00:00
rfraposa
62b9e2f063 Update settings.md
Add convert_query_to_cnf setting
2023-01-09 21:30:24 -07:00
Rich Raposa
528acecc5c
Merge pull request #45076 from ClickHouse/new-mergetree-settings
Add docs for 2 new MergeTree settings
2023-01-09 16:48:26 -07:00
Dan Roscigno
99b1609fd3
Update docs/en/operations/settings/index.md 2023-01-09 18:17:29 -05:00
rfraposa
db7342769b Update merge-tree-settings.md
Added two new settings
2023-01-09 15:56:19 -07:00
rfraposa
eb96884ebf Add new DEFAULT value of settings 2023-01-09 15:02:35 -07:00
Robert Schulze
ad4884b394
Fix review comments, pt. I 2023-01-09 21:42:51 +00:00
Ivan Blinkov
61c2f23713 Remove leftover empty lines at the end of markdown files 2023-01-09 15:15:18 +01:00
Ivan Blinkov
b7e082d033 Remove "Original article links" 2023-01-09 15:13:36 +01:00
DanRoscigno
e0b258b4a9 move persistence setting docs 2023-01-06 17:01:28 -05:00
Robert Schulze
45dbcf88e5
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-06 20:42:48 +00:00
DanRoscigno
273ad90d1d add additional table filters setting 2023-01-05 10:47:18 -05:00
Dmitry Novik
c646048af9
Merge pull request #44461 from ClickHouse/parts-removal-limit
Add part removal limit for one CleanupThread iteration
2023-01-02 20:04:19 +01:00
Kruglov Pavel
966f57ef68
Merge pull request #42777 from Avogar/improve-streaming-engines
Refactor and Improve streaming engines Kafka/RabbitMQ/NATS and data formats
2023-01-02 15:59:06 +01:00
Robert Schulze
8381d8b467
query_result_cache_keep_seconds_alive --> query_result_cache_ttl 2023-01-02 09:38:40 +00:00
Robert Schulze
ba55fd3ad2
Cosmetics 2023-01-02 09:30:44 +00:00
Robert Schulze
e9e04166d9
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-02 08:20:27 +00:00
Kruglov Pavel
894726bd8f
Merge branch 'master' into improve-streaming-engines 2022-12-29 22:59:45 +01:00
avogar
46b7ec4209 Add detailed documentation about schema inference 2022-12-29 13:42:56 +00:00
Dmitry Novik
6efd64a61c
Merge branch 'master' into parts-removal-limit 2022-12-28 17:34:48 +01:00
Dmitry Novik
c594ec3632 Add documentation 2022-12-21 14:56:32 +00:00
Sergei Trifonov
048525273f
Merge branch 'master' into Avogar-patch-1 2022-12-21 11:54:18 +01:00
Kruglov Pavel
5e01a3d74e
Merge branch 'master' into improve-streaming-engines 2022-12-21 10:51:50 +01:00
Kruglov Pavel
36a6ee4fdb
Add documentation for setting allow_settings_after_format_in_insert 2022-12-20 22:04:37 +01:00
DanRoscigno
c6513624c4 add support case note for compat setting 2022-12-20 15:03:42 -05:00
Robert Schulze
b93c56323c
Merge remote-tracking branch 'origin/master' into query-result-cache 2022-12-19 09:18:36 +00:00
Robert Schulze
d81e507952
Fix doc links 2022-12-18 12:23:38 +00:00
Robert Schulze
bc6bcdfd7b
Allow sharing of cache entries 2022-12-17 18:04:18 +00:00
Robert Schulze
aa50b9cf48
Invert config parameter name for more clarity 2022-12-17 15:10:04 +00:00
Kruglov Pavel
37df9b9990
Merge branch 'master' into refactor-schema-inference 2022-12-16 19:13:15 +01:00
Kruglov Pavel
3fad5c7f1f
Merge branch 'master' into refactor-schema-inference 2022-12-16 14:24:51 +01:00
Robert Schulze
3790952631
Move server-level settings into the appropriate document 2022-12-15 22:51:47 +00:00
Robert Schulze
4db33f16e3
Make DoS attack on cache less likely 2022-12-15 21:42:51 +00:00
Robert Schulze
bcc54ab9b4
Add cfg for min query duration for caching 2022-12-15 20:10:37 +00:00
Kruglov Pavel
c5b2e4cc23
Merge branch 'master' into improve-streaming-engines 2022-12-15 18:44:35 +01:00
Kruglov Pavel
00d80e44cc
Fix typos 2022-12-15 16:18:40 +01:00
Kruglov Pavel
7657f16e2a
Add missing documentation for some schema inference settings 2022-12-15 16:17:18 +01:00
Kruglov Pavel
0816626373
Update docs 2022-12-15 16:10:06 +01:00
Sergei Trifonov
f0de30de92
fix typos 2022-12-15 14:11:16 +01:00
Robert Schulze
537c64aad2
Merge remote-tracking branch 'origin/master' into query-result-cache
Conflicts:
- tests/queries/0_stateless/02117_show_create_table_system.reference
2022-12-15 12:17:58 +00:00
Robert Schulze
973d4f75de
More intuitive active/passive enablement of query result cache 2022-12-15 12:16:36 +00:00
Robert Schulze
f1e367179e
Make maximum record count per item configurable 2022-12-15 11:16:44 +00:00
Robert Schulze
e52dfaf45c
Make number of cached items configurable 2022-12-15 10:08:28 +00:00
avogar
f3e37c2c9b Merge branch 'refactor-schema-inference' of github.com:Avogar/ClickHouse into refactor-schema-inference 2022-12-12 14:47:04 +00:00
Kruglov Pavel
a03549df28
Apply suggestions from code review
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2022-12-12 15:46:03 +01:00
Robert Schulze
fc972d760f
Make it configurable if queries with non-deterministic functions are cached 2022-12-12 14:03:21 +00:00
Robert Schulze
b78652e138
Query result cache 2022-12-12 10:37:10 +00:00
avogar
cd4fa00d2c Merge branch 'master' of github.com:ClickHouse/ClickHouse into refactor-schema-inference 2022-12-09 14:45:10 +00:00
Kruglov Pavel
59201c71cb
Merge pull request #44052 from Avogar/object-as-string
Allow to parse JSON objects into Strings in JSON input formats
2022-12-09 15:12:25 +01:00
Sergei Trifonov
bae1519970
Merge branch 'master' into merge_tree_settings_constraints 2022-12-08 22:25:16 +01:00
Kruglov Pavel
0d17774440
Better example in docs 2022-12-08 20:57:28 +01:00
avogar
d0f9bb2ec2 Allow to parse JSON objects into Strings 2022-12-08 18:58:18 +00:00
avogar
7375a7d429 Refactor and improve schema inference for text formats 2022-12-07 21:19:27 +00:00
Kseniia Sumarokova
ec7649cd90
Merge pull request #43639 from CurtizJ/trace-profile-events
Allow to send profile events to `system.trace_log`
2022-12-04 15:50:07 +01:00
Sergei Trifonov
e27e79b45d
Merge branch 'master' into merge_tree_settings_constraints 2022-12-02 20:51:31 +01:00
serxa
006af1b6a4 constraints on merge tree settings 2022-12-02 19:30:14 +00:00
Kruglov Pavel
c35b2a6495
Add a limit for string size in RowBinary format (#43842) 2022-12-02 13:57:11 +01:00
Anton Popov
fd262cb56b update docs for trace_log 2022-11-30 14:48:46 +00:00
Kruglov Pavel
98d6b96c82
Merge pull request #42033 from mark-polokhov/BSONEachRow
Add BSONEachRow input/output format
2022-11-22 14:45:21 +01:00
Nikolay Degterinsky
81971acf35 Fix docs 2022-11-16 02:40:51 +00:00
DanRoscigno
5d6c622e40 apply suggestions and simplify 2022-11-14 14:20:55 -05:00
DanRoscigno
446c029810 make read only clearer 2022-11-14 11:53:44 -05:00
Dan Roscigno
4a90f8d3f5
Update permissions-for-queries.md
closes https://github.com/ClickHouse/ClickHouse/issues/43068
2022-11-14 11:34:06 -05:00
Kruglov Pavel
58b7f6ca04
Merge pull request #42320 from Avogar/improve-schema-inference-insert-select
Improve using structure from insertion table in table functions
2022-11-14 14:51:27 +01:00
avogar
9e89af28c6 Refactor BSONEachRow format, fix bugs, support more data types, support parallel parsing and schema inference 2022-11-10 20:15:14 +00:00
DanRoscigno
c822c8161f fix nav 2022-11-08 20:21:26 -05:00
DanRoscigno
45c9debeaf update links 2022-11-08 19:17:58 -05:00
Rich Raposa
0cadb8ac63
Update default value of allow_experimental_projection_optimization
The setting is actually obsolete, but I suppose we should keep it here for users of older versions of ClickHouse
2022-11-03 15:30:43 -06:00
avogar
8e13d1f1ec Improve and refactor Kafka/StorageMQ/NATS and data formats 2022-10-28 16:41:10 +00:00
Kruglov Pavel
9588653a6e
Merge branch 'master' into improve-schema-inference-insert-select 2022-10-18 15:17:27 +02:00
Kruglov Pavel
6fc12dd922
Merge pull request #41703 from Avogar/json-object-each-row
Add setting to obtain object name as column value in JSONObjectEachRow format
2022-10-14 20:11:04 +02:00
Kruglov Pavel
f1dd247181
Merge branch 'master' into improve-schema-inference-insert-select 2022-10-14 17:16:58 +02:00
avogar
2b150a575e Add docs 2022-10-14 15:15:03 +00:00
vdimir
0178307c27 Followup for TemporaryDataOnDisk 2022-10-12 15:25:23 +02:00
Alexey Milovidov
9bf5fe728b
Merge pull request #42173 from ClickHouse/remove-temporary-live-view
Remove TEMPORARY LIVE VIEW
2022-10-08 19:05:33 +03:00
Alexey Milovidov
b9159db82f Remove temporary live views 2022-10-08 00:16:36 +02:00
Robert Schulze
e759a64d38
Docs: Redirect links to misc.md
--> https://clickhouse.com/docs/en/sql-reference/statements/misc

This page indexes a bunch of SQL statements but they are easily
reachable by the sidebar already.
2022-10-07 13:22:40 +00:00
Nikolay Degterinsky
61ec576900
Merge branch 'master' into patch-1 2022-10-05 16:18:08 +02:00
Adam Rutkowski
3c4eae4276
Fix tag mismatch in sample users config 2022-10-05 09:55:28 +02:00
Denny Crane
5341bf445a
Update settings.md 2022-10-04 15:08:29 -03:00
Dan Roscigno
f4f85a069b
Go live with doc updates (#42053)
* QIP to add overview page

* wip

* New Tutorial and Datasets landing page

* give an example for Cloud

* Update UK Price Paid for Cloud

* Update nyc-taxi.md

* add option for Cloud Load Data button

* Removed the Import Raw Data section

* Update nyc-taxi.md

* update user management and replication docs

* mark self managed

* set doc ordering

* add redirects setting

* Simple fixes to index.md

Co-authored-by: rfraposa <richraposa@gmail.com>
2022-10-04 14:36:59 +03:00
Roman Vasin
45414b251d Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-583 2022-09-29 17:02:49 +00:00
Raúl Marín
7c38b3f60d Update MergeTree settings docs to match current defaults 2022-09-29 14:12:10 +02:00
Roman Vasin
109c5ee1a1 Update docs for DateTime64 return types. 2022-09-28 12:49:58 +00:00
avogar
4f32ef9bb7 Add docs 2022-09-22 17:04:42 +00:00
Kruglov Pavel
22e11aef2d
Merge pull request #40910 from Avogar/new-json-formats
Add new JSON formats, add improvements and refactoring
2022-09-21 14:19:08 +02:00
avogar
868ce8bc16 Fix comments, make better naming, add docs, add setting output_format_json_quote_64bit_floats 2022-09-20 13:49:17 +00:00
Sergei Trifonov
7902922ae4
Merge branch 'master' into readonly-settings-allow 2022-09-19 21:00:12 +02:00
Derek Chia
cb613b8675
Change input_format_skip_unknown_fields default to 1
As per PR https://github.com/ClickHouse/ClickHouse/pull/37192, `input_format_skip_unknown_fields` is enabled by default. Likewise, it is also set as `true` in the factory settings https://github.com/ClickHouse/ClickHouse/blob/master/src/Core/Settings.h#L696

Updating the docs to reflect the change.
2022-09-19 22:37:03 +08:00
Sergei Trifonov
f7a1ed3141
Merge branch 'master' into readonly-settings-allow 2022-09-19 12:52:36 +02:00
Roman Vasin
d82cd7b007 Add many cosmetic changes to C++ code and MD docs 2022-09-16 09:37:30 +00:00
avogar
ef7f7b30aa Fix tests 2022-09-15 18:20:17 +00:00
Roman Vasin
5c242de43a Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-528-B 2022-09-15 13:47:51 +00:00
Roman Vasin
3ce66eab83 Correct all needed MD files 2022-09-15 13:28:11 +00:00
Roman Vasin
563449779c Replace enable_date32_results by enable_extended_results_for_datetime_functions 2022-09-15 12:48:09 +00:00
Roman Vasin
bc2c2130fc Add documentation for enable_date32_results option 2022-09-12 09:09:01 +00:00
avogar
ae7f9abd32 Add documentation 2022-09-09 12:04:49 +00:00
Sergei Trifonov
f92b6a6176
Merge branch 'master' into readonly-settings-allow 2022-09-08 17:44:32 +02:00
vdimir
000ba8a60d
Use insert_qurum = auto instead of majority_insert_quorum 2022-09-07 11:19:27 +00:00
Sachin
ade4337978
Add majority_insert_quorum setting
majority_insert_quorum is defined as (number_of_replicas/2)+1. Insert
will be successful only if majority of quorum have applied it. If
insert_quorum and majority_insert_quorum both are specified, max of
both will be used.
2022-09-07 11:19:24 +00:00
Sergei Trifonov
005b2588d8
Merge branch 'master' into readonly-settings-allow 2022-09-02 16:37:43 +02:00
Sergei Trifonov
014d109175 fix build, fix docs, fix comments, logical fixes, test are still to be fixed and new test are to be added 2022-09-02 16:20:09 +02:00
DanRoscigno
c4b8137d31 replace symlinks 2022-08-29 12:19:50 -04:00
Sergei Trifonov
899bf99d44
Merge branch 'master' into readonly-settings-allow 2022-08-29 14:35:05 +02:00
alesapin
7ce0afc0df
Merge pull request #40670 from Avogar/kafka
Add setting to disable limit on kafka_num_consumers
2022-08-29 10:53:35 +02:00
DanRoscigno
5b5fcc56aa add slugs 2022-08-28 10:53:34 -04:00
DanRoscigno
db1a3b717c add slugs 2022-08-28 09:58:27 -04:00
DanRoscigno
c4caa35cfd add frontmatter dashes 2022-08-28 09:53:52 -04:00
Sergei Trifonov
c5d1bbf680 reimplement with <allow> tag 2022-08-26 21:20:00 +02:00
avogar
e31bba7731 Add docs 2022-08-26 12:52:15 +00:00
Peignon Melvyn
18c75d8ca9
Update settings.md
Fix according to: aaafb797c0/src/Core/Settings.h (L586)
2022-08-26 12:27:16 +02:00
Sergei Trifonov
856a2f5956 Allow to modify constrained settings in readonly mode 2022-08-25 17:24:24 +02:00
Alexey Milovidov
1a5e08fb65
Update settings.md 2022-08-22 02:19:18 +03:00
Denny Crane
6e329686b8
Update settings.md 2022-08-21 19:31:46 -03:00
Denny Crane
dc40e4b935
Update merge-tree-settings.md 2022-08-21 17:30:13 -03:00
Denny Crane
069e2cf4a0
Update settings.md 2022-08-21 17:27:47 -03:00
Denny Crane
244b7aa118
Update merge-tree-settings.md 2022-08-21 17:17:06 -03:00
DanRoscigno
23b054617e update for setting change 2022-08-18 16:05:44 -04:00
Jonathan-Ackerman
22bd572d78
Update docs for max_replica_delay_for_distributed_queries (#40174)
A replica is unusable if its lag is greater than or equal to the
value of max_replica_delay_for_distributed_queries. However, the
current documentation says that a replica is only unusable if it lags
more than the set value.

Also, when the value of max_replica_delay_for_distributed_queries
is read, if it is 0, then a replica is considered up to date
right away without checking its delay. This behavior should be
documented.
2022-08-18 19:09:46 +02:00
Nikolai Kochetov
5a85531ef7
Merge pull request #38286 from Avogar/schema-inference-cache
Add schema inference cache for s3/hdfs/file/url
2022-08-18 13:07:50 +02:00
Kruglov Pavel
d7056376eb
Merge pull request #40068 from Avogar/schema-inference-hints
Allow to specify structure hints in schema inference
2022-08-18 12:19:45 +02:00
Denny Crane
d5465d32e1
Update settings.md 2022-08-17 09:38:06 -03:00
avogar
8dd54c043d Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-cache 2022-08-17 11:47:40 +00:00
avogar
e1ff996ec3 Allow to specify structure hints in schema inference 2022-08-16 09:46:57 +00:00
avogar
c4ff3ffeea Rename settings 2022-08-15 12:45:18 +00:00
Igor Nikonov
5768e40ef7
Fix incorrect queries in example
Setting insert_deduplication_token: fix incorrect queries in example
2022-08-12 17:18:02 +02:00
avogar
9b1a267203 Refactor, remove TTL, add size limit, add system table and system query 2022-08-05 16:20:15 +00:00