thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-27 18:12:02 +00:00
Code Issues Packages Projects Releases Wiki Activity
127,444 Commits 9,188 Branches 1,782 Tags 2.1 GiB
a5fb7b0a1e
Commit Graph

1487 Commits

Author SHA1 Message Date
Alexey Milovidov
2323542e47
Merge pull request #50022 from ClickHouse/geo-types-production-ready 
Geo types are production ready
 2023-05-20 02:02:23 +03:00
zvonand
7dccb51bc0 fix conflict and update 2023-05-19 23:40:51 +02:00
Alexey Milovidov
f5506210d6 Geo types are production ready 2023-05-19 12:43:55 +02:00
Dan Roscigno
addc0c0ece
Merge branch 'master' into allow_experimental_parallel_reading_from_replicas 2023-05-17 13:20:14 -04:00
avogar
846804fed0 Add separate handshake_timeout for receiving Hello packet from replica 2023-05-17 11:39:04 +00:00
DanRoscigno
b8b4723aa6 add max_rows_in_set_to_optimize_join docs 2023-05-12 10:19:30 -04:00
DanRoscigno
0f7c0859b0 add allow_experimental_parallel_reading_from_replicas docs 2023-05-12 09:22:29 -04:00
zvonand
c3af36915f fixed docs 2 2023-05-12 01:29:34 +02:00
robot-clickhouse
6f19a374f2
Merge pull request #49791 from den-crane/patch-65 
Update settings.md
 2023-05-12 01:02:58 +02:00
zvonand
60b69601e9 update docs 2023-05-12 00:27:11 +02:00
Denny Crane
fcf1dd52bc
Update settings.md 2023-05-11 14:05:30 -03:00
Vitaly Baranov
ec011b9113
Merge branch 'master' into user-grants-from-config 2023-05-11 17:08:06 +02:00
Rich Raposa
2f8a530bf3
Merge pull request #49741 from ClickHouse/rfraposa-patch-2 
Update async_insert explanation in docs
 2023-05-11 08:36:53 -06:00
zvonand
ecd0b4cc06 update settings from master 2023-05-11 00:37:58 +02:00
Dan Roscigno
8f573aba2d
docs for connect_timeout_with_failover_secure_ms 
closes #47267
 2023-05-10 14:00:05 -04:00
Rich Raposa
4be0372eb4
Update settings.md 
Removed the mention that async_insert is  only useful for HTTP
 2023-05-10 09:48:33 -06:00
Alexey Milovidov
8a6e07f0ea Make projections production-ready 2023-05-10 03:35:13 +02:00
Andrey Zvonov
9237b904be
Merge branch 'master' into zvonand-implicit-tz 2023-05-10 01:25:33 +02:00
Duyet Le
4c7849a9c8
Fix incorrect docs for use_query_cache 2023-05-09 17:08:49 +07:00
Robert Schulze
883e0abea1
Query Cache: Safeguard against empty chunks 
Reading from the query cache is implemented using processor
"SourceFromChunks" which inherits from ISource. The latter has logic
which finishes processing (= calls .finish() on the output port +
returns Status::Finished) when the derived class returns an empty chunk.
If this empty chunk is not the last chunk, i.e. if it is followed by
non-empty chunks, the query result will be incorrect. This situation
should theoretically never occur in practice but who knows ... To be on
the safe side, writing into the query cache now rejects empty chunks and
thereby avoids this scenario.
 2023-05-06 14:22:23 +00:00
pufit
e1fa147e51 docs 2023-05-05 22:57:48 -04:00
zvonand
8338d54c34 Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-implicit-tz 2023-05-05 15:50:26 +02:00
Ivan Takarlikov
8873856ce5 Fix some grammar mistakes in documentation, code and tests 2023-05-04 13:35:18 -03:00
Mike Kot
2d20658885
Merge branch 'master' into feature/show-secrets-option 2023-04-28 20:19:35 +03:00
Mike Kot
f1d0ed367d separate name for format setting 2023-04-28 13:39:38 +00:00
Mike Kot
7bffa89e96 add all 3 settings 2023-04-28 13:22:36 +00:00
Mike Kot
e428af0b63 replace format settings with server setting 2023-04-27 21:27:18 +00:00
Mike Kot
357cde95e9 Merge branch 'master' into feature/show-secrets-option 2023-04-27 20:19:40 +00:00
Aram Peres
f65b526472
Fix an unclosed XML tag in documentation 2023-04-25 20:48:46 -04:00
Robert Schulze
3255f937f2
Remove anchor 2023-04-25 11:34:10 +00:00
Robert Schulze
d7f759ce38
Docs: Make caption of processors_profile_log page consistent with other pages 2023-04-25 11:31:53 +00:00
Robert Schulze
38d5f12a32
Query Cache: Implement per-user quotas 2023-04-23 16:13:51 +00:00
avogar
d68b8f46a4 Increase default value for connect_timeout_with_failover_ms 2023-04-21 11:38:36 +00:00
Kruglov Pavel
9749448eb0
Merge pull request #47229 from Avogar/non-blocking-connect 
Improve async reading from socket
 2023-04-21 10:38:50 +02:00
Andrey Zvonov
984e8fde41
Merge branch 'master' into zvonand-implicit-tz 2023-04-20 23:13:17 +02:00
Dan Roscigno
aec97033c9
Merge pull request #48940 from ClickHouse/DanRoscigno-patch-5 
Update query-complexity.md
 2023-04-20 10:56:31 -04:00
Robert Schulze
cdf28f9b71
Minor fixups 2023-04-19 16:16:51 +00:00
Robert Schulze
c406663442
Docs: Replace annoying three spaces in enumerations by a single space 2023-04-19 15:56:55 +00:00
Dan Roscigno
df70f6985c
Update query-complexity.md 
The docs say that max_memory_usage is set to 10GB in the default config, but max_memory_usage does not appear in the default config, so the default is unlimited.
 2023-04-19 09:16:22 -04:00
Andrey Zvonov
61f55930ce
Update docs/en/operations/settings/settings.md 
Co-authored-by: Vasily Nemkov <V.Nemkov@gmail.com>
 2023-04-19 15:46:17 +03:00
zvonand
daae5025e8 small updates due to review 2023-04-19 14:45:51 +02:00
Kruglov Pavel
2ad161d2b7
Merge branch 'master' into non-blocking-connect 2023-04-19 13:39:40 +02:00
Youenn Lebras
082c5b0224 Document the new feature of the ReplacingMergeTree engine of the PR #41005 2023-04-18 11:17:46 +02:00
zvonand
22be85d976 renamed setting 2023-04-18 02:42:30 +02:00
Alexander Tokmakov
75f18b1198
Revert "Check simple dictionary key is native unsigned integer" 2023-04-13 01:32:19 +03:00
Anton Popov
1520f3e924
Merge pull request #48335 from lzydmxy/check_sample_dict_key_is_correct 
Check simple dictionary key is native unsigned integer
 2023-04-12 14:27:39 +02:00
zvonand
2a9f28b73b resolve 2023-04-12 12:54:39 +02:00
Dmitry Novik
435a0ab9bb Fix a typo 2023-04-11 14:13:37 +00:00
Dmitry Novik
5488fb0fec Add documentation for additional_result_filter setting 2023-04-11 14:07:17 +00:00
Anton Popov
027f8a02c8
Merge branch 'master' into check_sample_dict_key_is_correct 2023-04-05 16:31:57 +02:00
lzydmxy
529e1466df use check_dictionary_primary_key instead of check_sample_dict_key_is_correct 2023-04-04 12:04:17 +08:00
Kruglov Pavel
9e595c82fa
Merge pull request #47494 from KevinyhZou/enable_return_null_element_not_exist 
Enable return null and complext type for JSON_VALUE function
 2023-04-03 14:05:18 +02:00
Robert Schulze
a50e741bea
Merge pull request #45912 from ClickHouse/qc-compression 
Query cache: Enable compression of cache entries
 2023-04-03 13:33:47 +02:00
Robert Schulze
3e124f09d0
Merge remote-tracking branch 'origin/master' into qc-compression 2023-04-03 11:28:17 +00:00
KevinyhZou
da4ff587af review fix 2023-04-02 12:38:17 +08:00
KevinyhZou
ce5f4cf4ab code review fix 2023-04-02 12:37:18 +08:00
Rich Raposa
4cb3c92607
Update merge-tree-settings.md 
For some reason the links are broken - I'm attempting to fix them here
 2023-03-31 12:38:45 -06:00
Rich Raposa
330508552e
Merge branch 'master' into docs/background_pool_size 2023-03-31 11:24:00 -06:00
kst-morozov
048ea93c09 upadte doc 2023-03-31 17:59:19 +02:00
Rich Raposa
3a3438ebf9
Update settings-formats.md 
Default compression method for Parquet changed from snappy to lz4 in 23.3
 2023-03-30 10:26:33 -06:00
Nikolai Kochetov
f06bdc85eb
Merge pull request #48226 from ClickHouse/rename-setting-stop_reading_on_first_cancel 
Rename setting stop_reading_on_first_cancel
 2023-03-30 18:03:23 +02:00
Nikolai Kochetov
06bf500c30
Update settings.md 2023-03-30 17:36:56 +02:00
filimonov
fbb22348ea
Refactor reading the pool setting & from server config. (#48055) 
After #36425 there was a lot of confusions/problems with configuring pools - when the message was confusing, and settings need to be ajusted in several places.
See some examples in #44251, #43351, #47900, #46515.

The commit includes the following changes:
1) Introduced a unified mechanism for reading pool sizes from the configuration file(s). Previously, pool sizes were read from the Context.cpp with fallbacks to profiles, whereas main_config_reloader in Server.cpp read them directly without fallbacks.
2) Corrected the data type for background_merges_mutations_concurrency_ratio. It should be float instead of int.
3) Refactored the default values for settings. Previously, they were defined in multiple places throughout the codebase, but they are now defined in one place (or two, to be exact: Settings.h and ServerSettings.h).
4) Improved documentation, including the correct message in system.settings.

Additionally make the code more conform with #46550.
 2023-03-30 16:44:11 +02:00
Nikolai Kochetov
a8a28bdf3d Merge branch 'master' into rename-setting-stop_reading_on_first_cancel 2023-03-30 16:07:14 +02:00
Nikolai Kochetov
f870e6f7a9 Rename setting stop_reading_on_first_cancel to partial_result_on_first_cancel. 2023-03-30 14:00:44 +00:00
Robert Schulze
b0473098c6
Merge branch 'master' into qc-compression 2023-03-30 10:55:42 +02:00
Denny Crane
2c231a6ac4
Update settings.md 2023-03-29 20:49:44 -03:00
Robert Schulze
b324d0ed5e
Merge branch 'master' into qc-compression 2023-03-29 15:09:22 +02:00
Dan Roscigno
c8f59194a3
Merge pull request #48070 from den-crane/patch-60 
Doc. idle_connection_timeout
 2023-03-27 15:17:08 -04:00
DanRoscigno
6d8a2bbd48 standardize admonitions 2023-03-27 14:54:05 -04:00
Denny Crane
295d3b7510
Update settings.md 2023-03-27 14:45:43 -03:00
Denny Crane
98488f30ab
Update settings.md 2023-03-27 14:40:45 -03:00
Kruglov Pavel
f3f93dd06c
Merge branch 'master' into non-blocking-connect 2023-03-24 15:59:40 +01:00
rfraposa
747eaf3f72 Fix broken links 2023-03-23 14:40:45 -06:00
Kruglov Pavel
3ee12e21fb
Merge branch 'master' into non-blocking-connect 2023-03-23 20:53:44 +01:00
avogar
38e44861ae Fix possible race conditions 2023-03-21 16:01:54 +00:00
Robert Schulze
d8493780b2
Query cache: Enable compression and squashing of result blocks 
ClickHouse reads table data in blocks of 'max_block_size' rows. Due to
filtering, aggregation, etc., result blocks are typically much smaller
than 'max_block_size' but there are also cases where they are much
bigger. Setting 'query_cache_squash_partial_results' (enabled by
default) now controls if result blocks are squashed (if they are tiny)
or split (if they are large) into blocks of 'max_block_size' size before
insertion into the query result cache. This reduces performance of
writes into the query cache but improves compressability of cache
entries and provides more natural block granularity when query results
are later served from the query cache.

Entries in the query cache are now also compressed by default. This
reduces the overall memory consumption at the cost of slower writes into
/ reads from the query cache. To disable compression, use setting
'query_cache_compress_entries'.
 2023-03-20 20:11:41 +00:00
Sergei Trifonov
273770519b
Merge branch 'master' into master 2023-03-20 18:28:10 +01:00
rfraposa
ac5ed141d8 New nav - reverting the revert 2023-03-17 21:45:43 -05:00
Alexander Tokmakov
ec44c8293a
Revert "New navigation" 2023-03-17 21:21:11 +03:00
rfraposa
60fb9973d7 trailing slash fixes 2023-03-16 16:43:01 -05:00
alexX512
29dd2e56f9 Fix pulling pipeline 2023-03-16 12:41:17 +00:00
Rich Raposa
81cd962773
Merge branch 'master' into new-nav 2023-03-15 22:23:44 -06:00
Andrey Zvonov
4327d707e0
Merge branch 'master' into zvonand-implicit-tz 2023-03-15 22:18:52 +01:00
Alexey Perevyshin
1e9ef12f51
Merge branch 'master' into master 2023-03-15 22:21:02 +04:00
alexX512
dc1a6884ca Add documentation for a setting stop_reading_on_first_cancel 2023-03-15 14:49:24 +00:00
Robert Schulze
3bcfe02312
Docs: Fix unit for setting "max_query_size" 2023-03-15 13:29:25 +00:00
Rich Raposa
8897893229
Merge branch 'master' into new-nav 2023-03-13 10:15:43 -06:00
Ilya Yatsishin
542eb23561
Update docs/en/operations/settings/settings.md 2023-03-10 23:20:24 +01:00
Rich Raposa
eb4961ac0c
Merge branch 'master' into new-nav 2023-03-10 10:35:30 -07:00
Antonio Bonuccelli
75d91f633d
Merge branch 'master' into async_insert_max_query_number 2023-03-10 17:11:05 +01:00
Antonio Bonuccelli
8819860b14
Merge branch 'master' into async_insert_max_query_number 2023-03-10 16:45:55 +01:00
nellicus
6f4833f2c3 add async_insert_max_query_number 2023-03-10 16:10:31 +01:00
Rich Raposa
de68dade71
Revert "standardize admonitions" 2023-03-09 14:30:40 -07:00
DanRoscigno
95351bc2d3 standardize admonitions 2023-03-09 12:05:26 -05:00
Rich Raposa
66dd5b3834
Merge branch 'master' into new-nav 2023-03-09 08:12:23 -07:00
Kruglov Pavel
fe973f3d6f
Merge branch 'master' into native-types-conversions 2023-03-09 13:03:25 +01:00
Kruglov Pavel
71b6d6c6ae
Merge pull request #47114 from Avogar/parquet-compression 
Improve working with compression methods in Parquet/ORC/Arrow formats
 2023-03-09 13:02:18 +01:00
Rich Raposa
f24fad9e26
Merge branch 'master' into new-nav 2023-03-08 14:31:10 -07:00
rfraposa
fa6f3dadba Link fixes 2023-03-07 22:52:43 -07:00
rfraposa
008845216d Fix broken links 2023-03-07 14:06:14 -07:00
Kruglov Pavel
69a1309ade
Merge branch 'master' into native-types-conversions 2023-03-07 20:06:17 +01:00
Antonio Andelic
2ae0bceb2b Address PR comments 2023-03-07 10:56:11 +00:00
Mike Kot
1fca58b694
Merge branch 'master' into feature/show-secrets-option 2023-03-06 15:46:54 +03:00
Mike Kot
00dfb27eb9 rm secrets test from fasttest, correct 02117 2023-03-06 15:45:48 +03:00
Kruglov Pavel
3b034e7c35
Merge branch 'master' into parquet-compression 2023-03-02 15:55:48 +01:00
Antonio Andelic
01cf9c94f4 Merge branch 'master' into custom-key-parallel-replicas 2023-03-02 14:28:42 +00:00
avogar
a6cf2cdab8 Fix style, add docs 2023-03-02 10:36:07 +00:00
Sergei Trifonov
20fbb09a46
Update constraints-on-settings.md 2023-03-01 17:44:25 +01:00
Kruglov Pavel
545e5c0f5b
Merge pull request #46617 from Avogar/use-parquet-2 
Change default parquet format version to v2_latest, add a setting to controle the version
 2023-02-28 14:30:59 +01:00
avogar
ab899bf2f3 Allow types conversion in Native input format 2023-02-27 19:28:19 +00:00
Kruglov Pavel
36e65f5f84
Use versions vith dots 2023-02-27 19:00:40 +01:00
robot-clickhouse-ci-1
fc1e0608c6
Merge pull request #46962 from melvynator/patch-11 
Add a warning to the schema_inference_hints
 2023-02-27 16:51:24 +01:00
Mike Kot
c799bd094b
Merge branch 'master' into feature/show-secrets-option 2023-02-27 18:43:14 +03:00
Kruglov Pavel
443dedddca
Merge branch 'master' into use-parquet-2 2023-02-27 14:31:43 +01:00
Kruglov Pavel
e9078b402b
Merge pull request #46742 from Avogar/update-settings 
Enable input_format_json_ignore_unknown_keys_in_named_tuple by default
 2023-02-27 14:30:28 +01:00
Mike Kot
62acc7a6cf setting and some docs 2023-02-27 13:18:21 +00:00
Peignon Melvyn
8fe08bc458
Add a warning to the schema_inference_hints 2023-02-27 14:02:10 +01:00
Denny Crane
fd97f7ad0a
Update settings.md 2023-02-26 19:25:13 -04:00
zvonand
49fb028498 Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-implicit-tz 2023-02-26 17:20:09 +01:00
Denny Crane
55b3bffe59
Update settings.md 2023-02-23 21:15:31 -04:00
zvonand
a9d0f7e7db Added docs for new serverTimeZone function 
Updated tests and docs
 2023-02-23 19:14:49 +01:00
avogar
54622566df Add setting to change parquet version 2023-02-23 16:14:10 +00:00
Kruglov Pavel
35887911e3
Merge pull request #46284 from Avogar/null-as-default-all-formats 
Extend setting `input_format_null_as_default` for more formats
 2023-02-23 14:48:22 +01:00
Nikolai Kochetov
dbfa641c47
Merge pull request #46621 from ClickHouse/resurrect-processors-profile-log-docs 
Resurrect processors_profile_log docs.
 2023-02-23 13:09:35 +01:00
avogar
50caa3d66c Update docs 2023-02-22 16:41:49 +00:00
zvonand
393830ecdc add docs + tiny cleanup 2023-02-22 16:30:46 +01:00
Dan Roscigno
efea3cbc5c
Update docs/en/operations/settings/settings.md 2023-02-21 12:19:56 -05:00
Han Fei
eeac1abaa5 add docs for setting async_insert_max_query_number 2023-02-21 17:49:52 +01:00
Kruglov Pavel
9866ecfe8b
Merge branch 'master' into null-as-default-all-formats 2023-02-20 20:49:30 +01:00
Nikolai Kochetov
186a29a2aa Resurrect processors_profile_log docs. 2023-02-20 19:46:39 +01:00
Antonio Andelic
ab51c1d975
Merge branch 'master' into custom-key-parallel-replicas 2023-02-17 15:06:41 +01:00
Dmitry Novik
c95df21324 Review fixes 2023-02-16 15:38:25 +00:00
Dmitry Novik
b908fa32df Add documentation for group_by_use_nulls 2023-02-16 00:57:53 +00:00
Antonio Andelic
adde580756
Merge branch 'master' into custom-key-parallel-replicas 2023-02-14 14:09:12 +01:00
Antonio Andelic
8d16fe5793
Merge branch 'master' into add-support-for-settings-alias 2023-02-13 08:46:00 +01:00
avogar
04cf144edc Fix TSKV, update docs 2023-02-10 17:20:51 +00:00
Antonio Andelic
f96d480563
Merge branch 'master' into add-support-for-settings-alias 2023-02-09 16:07:45 +01:00
Kruglov Pavel
b5f90c608a
Merge branch 'master' into parquet-fixed-binary 2023-02-09 11:26:38 +01:00
Vladimir C
ecb5802c4b
Update docs/en/operations/settings/settings.md 
Co-authored-by: Dmitry Novik <n0vik@clickhouse.com>
 2023-02-09 10:59:14 +01:00
vdimir
88174fbaaa
Add doc for optimize_rewrite_aggregate_function_with_if 2023-02-08 14:27:25 +00:00
Kruglov Pavel
cf2587cd1b
Add docs 2023-02-08 12:32:26 +01:00
Antonio Andelic
f67e5505ab Merge branch 'master' into custom-key-parallel-replicas 2023-02-06 11:12:39 +00:00
Antonio Andelic
a58653820e Update docs 2023-02-03 18:19:12 +00:00
Robert Schulze
cfcf957c75
Docs: Remove obsolete query result cache page 2023-02-02 11:33:35 +00:00
Vladimir C
b389c1effb
Merge pull request #45589 from ClickHouse/optimize-constraints 2023-02-01 12:57:02 +01:00
Robert Schulze
9a8af6a42e
Update docs/en/operations/settings/settings.md 
Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
 2023-01-31 12:44:20 +01:00
Antonio Andelic
c99efa75b7
Merge branch 'master' into custom-key-parallel-replicas 2023-01-31 11:58:30 +01:00
Robert Schulze
325c6bdf3d
Renaming: "Query Result Cache" --> "Query Cache" 
Reasons:

- The cache will at some point store intermediate results as opposed to
  only query results. We should change the terminology now without
  having to worry about backward compat.

- Equivalent caches in MySQL (1) and Starrocks (2) are called "query
  cache".

- The new name is ca. 13.8% more catchy.

(1) https://dev.mysql.com/doc/refman/5.6/en/query-cache.html
(2) https://docs.starrocks.io/en-us/2.5/using_starrocks/query_cache
 2023-01-31 09:54:34 +00:00
Robert Schulze
659a64a1d9
Merge pull request #45679 from ClickHouse/untangle-query-result-cache-settings 
Untangle configuration of query result cache
 2023-01-31 10:44:14 +01:00
Igor Nikonov
741c3ba23c Fix non-intentional change 2023-01-30 18:43:01 +01:00
Igor Nikonov
01b225f57e
Update docs/en/operations/settings/settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-30 18:30:59 +01:00
Igor Nikonov
211449d916
Update docs/en/operations/settings/settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-30 18:30:29 +01:00
Igor Nikonov
b095dab141
Update docs/en/operations/settings/settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-30 18:29:32 +01:00
Igor Nikonov
0c4bc489da
Update docs/en/operations/settings/settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-30 18:28:53 +01:00
Igor Nikonov
30c949ba27
Update docs/en/operations/settings/settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-30 18:28:34 +01:00
Igor Nikonov
c30a55b7ee Some polishing 2023-01-30 16:53:37 +01:00
Igor Nikonov
d8ba469b97
Fixes 2023-01-30 16:24:02 +01:00
Igor Nikonov
65caa77a0e
Update settings.md 2023-01-30 16:13:08 +01:00
Robert Schulze
27b978381b
Use more speaking setting names 2023-01-30 14:20:43 +00:00
Robert Schulze
e30c38cab3
Fix up some leftovers 2023-01-27 10:43:43 +00:00
Azat Khuzhin
1a8437f2c9 Add ability to ignore unknown keys in JSON object for named tuples 
This can be useful in case your input JSON is complex, while you need
only few fields in it.

This behaviour is controlled by the
input_format_json_ignore_unknown_keys_in_named_tuple setting name, that
is turned OFF by default.

This will, almost, allow to parse gharchive dataset without jq. "almost"
because of two things:
- Tuple cannot be Nullable, so such keys with Tuple type in ClickHouse
  cannot be `null` in JSON
- You cannot use dot.dot notation to extract columns for file() engine,
  only tupleElement()

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-27 10:01:08 +01:00
Robert Schulze
7d97fab2dc
Untangle query result cache settings 
This PR modularizes the configuration options of the query result cache
(QRC).

1. Add a feature toggle "allow_experimental_query_result_cache = false"
   which controls whether the experimental QRC can be used at all. This
   configuration option will be removed once the QRC becomes
   non-experimental.

2. Modularize the existing two configuration settings
   "enable_experimental_query_result_cache" and
   "enable_experimental_query_result_cache_passive_usage" into three
   orthogonal settings:

   - "use_query_result_cache = false" controls whether a query (or all
     queries of the session) utilize the query result cache

   - settings "use_query_result_cache_passive_usage = true" and
     "use_query_result_cache_active_usage = true" control the way a
     query (or all queries of the session) utilize the query result
     cache: "passive" use is reading, "active" use is writing.
 2023-01-26 21:17:48 +00:00
Dan Roscigno
76d6e2edf9
Merge pull request #45569 from AVMusorin/docs_optimize_skip_merged_partitions 
docs: added optimize_skip_merged_partitions setting
 2023-01-26 16:04:27 -05:00
Igor Nikonov
ed01f76c6a
Merge pull request #45592 from ClickHouse/update-insert-delay-doc-2 
Update INSERT delay doc with example
 2023-01-26 12:55:35 +01:00
Antonio Andelic
07b2c5ce0f
Merge branch 'master' into custom-key-parallel-replicas 2023-01-26 12:42:04 +01:00
Dan Roscigno
b4ab361366
Merge branch 'master' into docs_optimize_skip_merged_partitions 2023-01-25 19:45:32 -05:00
Dan Roscigno
e520bd8052
Apply suggestions from code review 2023-01-24 19:10:30 -05:00
Igor Nikonov
29ef6b9574
Update INSERT delay doc properly 2023-01-25 00:26:32 +01:00
Dan Roscigno
dbb83dc9a4
Merge branch 'master' into docs-for-s3-settings 2023-01-24 17:55:31 -05:00
DanRoscigno
fe56967af7 fix note formatting 2023-01-24 17:44:10 -05:00
DanRoscigno
9775987ee9 add new settings for s3 and hdfs 2023-01-24 17:40:37 -05:00
DanRoscigno
f95bc55923 split Format settings out 2023-01-24 17:19:50 -05:00
rfraposa
6f7755ebcd Added optimize using constraints settings 2023-01-24 15:05:34 -07:00
Igor Nikonov
e585a1228f
Update docs/en/operations/settings/merge-tree-settings.md 
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
 2023-01-24 16:52:32 +01:00
Igor Nikonov
21b009fdec
Update merge-tree-settings.md 2023-01-24 15:45:21 +01:00
AVMusorin
5f8658b2d6
docs: added optimize_skip_merged_partitions setting 2023-01-24 14:56:39 +01:00
DanRoscigno
72b1a65984 WIP 2023-01-24 07:45:59 -05:00
Antonio Andelic
95853af459 Merge branch 'master' into custom-key-parallel-replicas 2023-01-24 10:49:40 +00:00
Antonio Andelic
37b62b3a58 Use Map for custom_key 2023-01-24 10:46:47 +00:00
DanRoscigno
dedb4e4de2 add docs for PR 33302 2023-01-23 16:14:39 -05:00
Kruglov Pavel
478a552a0a
Merge branch 'master' into tsv-csv-detect-header 2023-01-23 21:47:17 +01:00
Robert Schulze
0ab7ae6c17
Merge pull request #43797 from ClickHouse/query-result-cache 
Query result cache [experimental]
 2023-01-23 19:54:35 +01:00
Antonio Andelic
c15128491b Update max_parallel_replicas docs 2023-01-23 17:24:48 +01:00
Robert Schulze
ed84021aa5
Formatting fixup 2023-01-22 16:45:26 +01:00
Robert Schulze
0ffffdd442
Docs: Fix weird formatting 2023-01-22 15:38:11 +00:00
Robert Schulze
340f406553
Merge branch 'master' into query-result-cache 2023-01-22 13:21:36 +01:00
Han Fei
18a397f8c9 address comments 2023-01-20 18:09:42 +01:00
Han Fei
449ace3373
Update docs/en/operations/settings/settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-20 18:07:19 +01:00
Han Fei
9d87bd10ee
Update docs/en/operations/settings/settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-20 18:07:08 +01:00
Han Fei
badfbcb3d8
Update docs/en/operations/settings/settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-20 18:06:58 +01:00
Han Fei
e9c4cf46cd
Update docs/en/operations/settings/merge-tree-settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-20 18:06:46 +01:00
Han Fei
9d254f7d87
Update docs/en/operations/settings/merge-tree-settings.md 
Co-authored-by: Dan Roscigno <dan@roscigno.com>
 2023-01-20 18:06:32 +01:00
Han Fei
5fc4998f10 update docs for async insert deduplication 2023-01-20 14:42:11 +01:00
Robert Schulze
4f90824347
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-17 22:49:53 +00:00
Kruglov Pavel
96bb99f864
Merge branch 'master' into tsv-csv-detect-header 2023-01-17 15:33:02 +01:00
Vladimir C
b80ee8df50
Merge pull request #45256 from DanRoscigno/add-grace-hash-docs 2023-01-16 18:43:19 +01:00
Kruglov Pavel
e9d6590926
Merge branch 'master' into tsv-csv-detect-header 2023-01-16 17:50:24 +01:00
avogar
1c0941d72a Add docs and examples 2023-01-16 16:46:41 +00:00
Robert Schulze
099e30ef2a
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-16 08:04:49 +00:00
DanRoscigno
d0a55f6dc9 doc grace_hash algorithm for join 2023-01-13 13:17:03 -05:00
avogar
87b934c472 Insert default values in case of missing tuple elements in JSONEachRow 2023-01-12 16:36:44 +00:00
rfraposa
1ddc9c3bb6 Update merge-tree-settings.md 2023-01-11 05:44:51 -07:00
Dan Roscigno
37da8e206b
Merge pull request #45119 from ClickHouse/add-default-table-engine-setting 
Added description of default_table_engine setting
 2023-01-10 09:59:09 -05:00
Dan Roscigno
ee88814cac
formal to form 2023-01-10 09:42:04 -05:00
rfraposa
d61eae8554 Update settings.md 
Added description of default_table_engine
 2023-01-10 07:40:22 -07:00
Robert Schulze
0c3b034887
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-10 09:02:41 +00:00
rfraposa
62b9e2f063 Update settings.md 
Add convert_query_to_cnf setting
 2023-01-09 21:30:24 -07:00
Rich Raposa
528acecc5c
Merge pull request #45076 from ClickHouse/new-mergetree-settings 
Add docs for 2 new MergeTree settings
 2023-01-09 16:48:26 -07:00
Dan Roscigno
99b1609fd3
Update docs/en/operations/settings/index.md 2023-01-09 18:17:29 -05:00
rfraposa
db7342769b Update merge-tree-settings.md 
Added two new settings
 2023-01-09 15:56:19 -07:00
rfraposa
eb96884ebf Add new DEFAULT value of settings 2023-01-09 15:02:35 -07:00
Robert Schulze
ad4884b394
Fix review comments, pt. I 2023-01-09 21:42:51 +00:00
Ivan Blinkov
61c2f23713 Remove leftover empty lines at the end of markdown files 2023-01-09 15:15:18 +01:00
Ivan Blinkov
b7e082d033 Remove "Original article links" 2023-01-09 15:13:36 +01:00
DanRoscigno
e0b258b4a9 move persistence setting docs 2023-01-06 17:01:28 -05:00
Robert Schulze
45dbcf88e5
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-06 20:42:48 +00:00
DanRoscigno
273ad90d1d add additional table filters setting 2023-01-05 10:47:18 -05:00
Dmitry Novik
c646048af9
Merge pull request #44461 from ClickHouse/parts-removal-limit 
Add part removal limit for one CleanupThread iteration
 2023-01-02 20:04:19 +01:00
Kruglov Pavel
966f57ef68
Merge pull request #42777 from Avogar/improve-streaming-engines 
Refactor and Improve streaming engines Kafka/RabbitMQ/NATS and data formats
 2023-01-02 15:59:06 +01:00
Robert Schulze
8381d8b467
query_result_cache_keep_seconds_alive --> query_result_cache_ttl 2023-01-02 09:38:40 +00:00
Robert Schulze
ba55fd3ad2
Cosmetics 2023-01-02 09:30:44 +00:00
Robert Schulze
e9e04166d9
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-02 08:20:27 +00:00
Kruglov Pavel
894726bd8f
Merge branch 'master' into improve-streaming-engines 2022-12-29 22:59:45 +01:00
avogar
46b7ec4209 Add detailed documentation about schema inference 2022-12-29 13:42:56 +00:00
Dmitry Novik
6efd64a61c
Merge branch 'master' into parts-removal-limit 2022-12-28 17:34:48 +01:00
Dmitry Novik
c594ec3632 Add documentation 2022-12-21 14:56:32 +00:00
Sergei Trifonov
048525273f
Merge branch 'master' into Avogar-patch-1 2022-12-21 11:54:18 +01:00
Kruglov Pavel
5e01a3d74e
Merge branch 'master' into improve-streaming-engines 2022-12-21 10:51:50 +01:00
Kruglov Pavel
36a6ee4fdb
Add documentation for setting allow_settings_after_format_in_insert 2022-12-20 22:04:37 +01:00
DanRoscigno
c6513624c4 add support case note for compat setting 2022-12-20 15:03:42 -05:00
Robert Schulze
b93c56323c
Merge remote-tracking branch 'origin/master' into query-result-cache 2022-12-19 09:18:36 +00:00
Robert Schulze
d81e507952
Fix doc links 2022-12-18 12:23:38 +00:00
Robert Schulze
bc6bcdfd7b
Allow sharing of cache entries 2022-12-17 18:04:18 +00:00
Robert Schulze
aa50b9cf48
Invert config parameter name for more clarity 2022-12-17 15:10:04 +00:00
Kruglov Pavel
37df9b9990
Merge branch 'master' into refactor-schema-inference 2022-12-16 19:13:15 +01:00
Kruglov Pavel
3fad5c7f1f
Merge branch 'master' into refactor-schema-inference 2022-12-16 14:24:51 +01:00
Robert Schulze
3790952631
Move server-level settings into the appropriate document 2022-12-15 22:51:47 +00:00
Robert Schulze
4db33f16e3
Make DoS attack on cache less likely 2022-12-15 21:42:51 +00:00
Robert Schulze
bcc54ab9b4
Add cfg for min query duration for caching 2022-12-15 20:10:37 +00:00
Kruglov Pavel
c5b2e4cc23
Merge branch 'master' into improve-streaming-engines 2022-12-15 18:44:35 +01:00
Kruglov Pavel
00d80e44cc
Fix typos 2022-12-15 16:18:40 +01:00
Kruglov Pavel
7657f16e2a
Add missing documentation for some schema inference settings 2022-12-15 16:17:18 +01:00
Kruglov Pavel
0816626373
Update docs 2022-12-15 16:10:06 +01:00
Sergei Trifonov
f0de30de92
fix typos 2022-12-15 14:11:16 +01:00
Robert Schulze
537c64aad2
Merge remote-tracking branch 'origin/master' into query-result-cache 
Conflicts:
- tests/queries/0_stateless/02117_show_create_table_system.reference
 2022-12-15 12:17:58 +00:00
Robert Schulze
973d4f75de
More intuitive active/passive enablement of query result cache 2022-12-15 12:16:36 +00:00
Robert Schulze
f1e367179e
Make maximum record count per item configurable 2022-12-15 11:16:44 +00:00
Robert Schulze
e52dfaf45c
Make number of cached items configurable 2022-12-15 10:08:28 +00:00
avogar
f3e37c2c9b Merge branch 'refactor-schema-inference' of github.com:Avogar/ClickHouse into refactor-schema-inference 2022-12-12 14:47:04 +00:00
Kruglov Pavel
a03549df28
Apply suggestions from code review 
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
 2022-12-12 15:46:03 +01:00
Robert Schulze
fc972d760f
Make it configurable if queries with non-deterministic functions are cached 2022-12-12 14:03:21 +00:00
Robert Schulze
b78652e138
Query result cache 2022-12-12 10:37:10 +00:00
avogar
cd4fa00d2c Merge branch 'master' of github.com:ClickHouse/ClickHouse into refactor-schema-inference 2022-12-09 14:45:10 +00:00
Kruglov Pavel
59201c71cb
Merge pull request #44052 from Avogar/object-as-string 
Allow to parse JSON objects into Strings in JSON input formats
 2022-12-09 15:12:25 +01:00
Sergei Trifonov
bae1519970
Merge branch 'master' into merge_tree_settings_constraints 2022-12-08 22:25:16 +01:00
Kruglov Pavel
0d17774440
Better example in docs 2022-12-08 20:57:28 +01:00
avogar
d0f9bb2ec2 Allow to parse JSON objects into Strings 2022-12-08 18:58:18 +00:00
avogar
7375a7d429 Refactor and improve schema inference for text formats 2022-12-07 21:19:27 +00:00
Kseniia Sumarokova
ec7649cd90
Merge pull request #43639 from CurtizJ/trace-profile-events 
Allow to send profile events to `system.trace_log`
 2022-12-04 15:50:07 +01:00
Sergei Trifonov
e27e79b45d
Merge branch 'master' into merge_tree_settings_constraints 2022-12-02 20:51:31 +01:00
serxa
006af1b6a4 constraints on merge tree settings 2022-12-02 19:30:14 +00:00
Kruglov Pavel
c35b2a6495
Add a limit for string size in RowBinary format (#43842) 2022-12-02 13:57:11 +01:00
Anton Popov
fd262cb56b update docs for trace_log 2022-11-30 14:48:46 +00:00
Kruglov Pavel
98d6b96c82
Merge pull request #42033 from mark-polokhov/BSONEachRow 
Add BSONEachRow input/output format
 2022-11-22 14:45:21 +01:00
Nikolay Degterinsky
81971acf35 Fix docs 2022-11-16 02:40:51 +00:00
DanRoscigno
5d6c622e40 apply suggestions and simplify 2022-11-14 14:20:55 -05:00
DanRoscigno
446c029810 make read only clearer 2022-11-14 11:53:44 -05:00
Dan Roscigno
4a90f8d3f5
Update permissions-for-queries.md 
closes https://github.com/ClickHouse/ClickHouse/issues/43068
 2022-11-14 11:34:06 -05:00
Kruglov Pavel
58b7f6ca04
Merge pull request #42320 from Avogar/improve-schema-inference-insert-select 
Improve using structure from insertion table in table functions
 2022-11-14 14:51:27 +01:00
avogar
9e89af28c6 Refactor BSONEachRow format, fix bugs, support more data types, support parallel parsing and schema inference 2022-11-10 20:15:14 +00:00
DanRoscigno
c822c8161f fix nav 2022-11-08 20:21:26 -05:00
DanRoscigno
45c9debeaf update links 2022-11-08 19:17:58 -05:00
Rich Raposa
0cadb8ac63
Update default value of allow_experimental_projection_optimization 
The setting is actually obsolete, but I suppose we should keep it here for users of older versions of ClickHouse
 2022-11-03 15:30:43 -06:00
avogar
8e13d1f1ec Improve and refactor Kafka/StorageMQ/NATS and data formats 2022-10-28 16:41:10 +00:00
Kruglov Pavel
9588653a6e
Merge branch 'master' into improve-schema-inference-insert-select 2022-10-18 15:17:27 +02:00
Kruglov Pavel
6fc12dd922
Merge pull request #41703 from Avogar/json-object-each-row 
Add setting to obtain object name as column value in JSONObjectEachRow format
 2022-10-14 20:11:04 +02:00
Kruglov Pavel
f1dd247181
Merge branch 'master' into improve-schema-inference-insert-select 2022-10-14 17:16:58 +02:00
avogar
2b150a575e Add docs 2022-10-14 15:15:03 +00:00
vdimir
0178307c27 Followup for TemporaryDataOnDisk 2022-10-12 15:25:23 +02:00
Alexey Milovidov
9bf5fe728b
Merge pull request #42173 from ClickHouse/remove-temporary-live-view 
Remove TEMPORARY LIVE VIEW
 2022-10-08 19:05:33 +03:00
Alexey Milovidov
b9159db82f Remove temporary live views 2022-10-08 00:16:36 +02:00
Robert Schulze
e759a64d38
Docs: Redirect links to misc.md 
--> https://clickhouse.com/docs/en/sql-reference/statements/misc

This page indexes a bunch of SQL statements but they are easily
reachable by the sidebar already.
 2022-10-07 13:22:40 +00:00
Nikolay Degterinsky
61ec576900
Merge branch 'master' into patch-1 2022-10-05 16:18:08 +02:00
Adam Rutkowski
3c4eae4276
Fix tag mismatch in sample users config 2022-10-05 09:55:28 +02:00
Denny Crane
5341bf445a
Update settings.md 2022-10-04 15:08:29 -03:00
Dan Roscigno
f4f85a069b
Go live with doc updates (#42053) 
* QIP to add overview page

* wip

* New Tutorial and Datasets landing page

* give an example for Cloud

* Update UK Price Paid for Cloud

* Update nyc-taxi.md

* add option for Cloud Load Data button

* Removed the Import Raw Data section

* Update nyc-taxi.md

* update user management and replication docs

* mark self managed

* set doc ordering

* add redirects setting

* Simple fixes to index.md

Co-authored-by: rfraposa <richraposa@gmail.com>
 2022-10-04 14:36:59 +03:00
Roman Vasin
45414b251d Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-583 2022-09-29 17:02:49 +00:00
Raúl Marín
7c38b3f60d Update MergeTree settings docs to match current defaults 2022-09-29 14:12:10 +02:00
Roman Vasin
109c5ee1a1 Update docs for DateTime64 return types. 2022-09-28 12:49:58 +00:00
avogar
4f32ef9bb7 Add docs 2022-09-22 17:04:42 +00:00
Kruglov Pavel
22e11aef2d
Merge pull request #40910 from Avogar/new-json-formats 
Add new JSON formats, add improvements and refactoring
 2022-09-21 14:19:08 +02:00
avogar
868ce8bc16 Fix comments, make better naming, add docs, add setting output_format_json_quote_64bit_floats 2022-09-20 13:49:17 +00:00
Sergei Trifonov
7902922ae4
Merge branch 'master' into readonly-settings-allow 2022-09-19 21:00:12 +02:00
Derek Chia
cb613b8675
Change input_format_skip_unknown_fields default to 1 
As per PR https://github.com/ClickHouse/ClickHouse/pull/37192, `input_format_skip_unknown_fields` is enabled by default. Likewise, it is also set as `true` in the factory settings https://github.com/ClickHouse/ClickHouse/blob/master/src/Core/Settings.h#L696

Updating the docs to reflect the change.
 2022-09-19 22:37:03 +08:00
Sergei Trifonov
f7a1ed3141
Merge branch 'master' into readonly-settings-allow 2022-09-19 12:52:36 +02:00
Roman Vasin
d82cd7b007 Add many cosmetic changes to C++ code and MD docs 2022-09-16 09:37:30 +00:00
avogar
ef7f7b30aa Fix tests 2022-09-15 18:20:17 +00:00
Roman Vasin
5c242de43a Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-528-B 2022-09-15 13:47:51 +00:00
Roman Vasin
3ce66eab83 Correct all needed MD files 2022-09-15 13:28:11 +00:00