Commit Graph

1365 Commits

Author SHA1 Message Date
Alexey Milovidov
7ec4b99e94 Revert partial result 2023-10-21 03:14:22 +02:00
avogar
9ec43d8cb9 Add basic docs, fix unrelated changes 2023-10-20 21:02:33 +00:00
vdimir
b4851cf2ef
Use AsyncPipelineExecutor for reading clickhouse dictionary source 2023-10-19 15:16:33 +00:00
Alexey Milovidov
f6db0a5261 Merge branch 'master' into morton-utils 2023-10-19 08:11:25 +02:00
Robert Schulze
945dcb865a
Merge pull request #55617 from slvrtrn/mysql-string-blob-vs-text-config
MySQL compatibility: allow to configure String/FixedString BLOB vs TEXT mapping
2023-10-18 10:57:18 +02:00
slvrtrn
c19ca5c4d5 Address PR feedback 2023-10-17 19:19:35 +02:00
Han Fei
4b23142775
Merge branch 'master' into hanfei/statistic 2023-10-17 16:40:31 +02:00
Alexey Milovidov
10d03f18e7 Add docs 2023-10-15 06:44:37 +02:00
slvrtrn
42fc670c22 Add new settings docs entries 2023-10-13 20:56:12 +02:00
Han Fei
42dc61abf5 Merge branch 'master' into hanfei/statistic 2023-10-12 16:19:45 +02:00
JackyWoo
1f553f3d65 Merge branch 'master' into lb_nearest_host_name 2023-10-12 10:19:17 +08:00
Han Fei
253b8efa58 do not modify column type when there is statistic 2023-10-11 16:57:40 +02:00
Robert Schulze
bb637fa9af
Update docs 2023-10-11 14:34:28 +00:00
Robert Schulze
2e8cac6e9c
Make use_mysql_types_in_show_columns independent from the connection
Fixes: #55273
2023-10-07 13:06:41 +00:00
JackyWoo
784fe880eb Merge branch 'master' into lb_nearest_host_name 2023-10-07 09:04:26 +08:00
vdimir
3a9abde35d
Merge pull request #54514 from ClickHouse/vdimir/allow_experimental_partial_result
Add setting allow_experimental_partial_result
2023-09-29 10:32:57 +02:00
avogar
0abf09d1b5 Fix example in docs 2023-09-28 22:17:44 +00:00
avogar
e8ea41e2d4 Add setting to print pretty deep nested Tuples 2023-09-28 22:17:44 +00:00
vdimir
9b001e5092
Add setting allow_experimental_partial_result to doc 2023-09-28 09:40:59 +00:00
JackyWoo
5da03e8ba5 Add load balancing test_hostname_levenshtein_distance 2023-09-27 10:46:39 +08:00
robot-ch-test-poll3
1334202af4
Merge pull request #54863 from zvonand/zvonand-refactor-globs
Refactor and simplify multi-directory globs
2023-09-22 23:09:05 +02:00
Robert Schulze
be1e92a2ac
Merge pull request #54518 from rschu1ze/split-better
Provide fallback to Python/Spark-like splitting in splitBy*() functions
2023-09-22 12:07:45 +02:00
zvonand
5f67788c03 update docs and comments 2023-09-21 00:16:17 +02:00
Robert Schulze
774c4b52da
Rework 2023-09-19 12:20:53 +00:00
Robert Schulze
1556cdd21a
Merge pull request #54789 from rschu1ze/docs-qc2
Docs: Update query cache docs about usage in view definitions
2023-09-19 13:32:02 +02:00
Robert Schulze
29e83fbe64
Docs: Update query cache docs about usage in view definitions
Cf. https://github.com/ClickHouse/support-escalation/issues/963
2023-09-19 10:26:19 +00:00
Robert Schulze
4ed5b903b4
Docs: remove anchor prefix 2023-09-18 18:35:59 +00:00
Robert Schulze
2a5aa289e8
Implement true Python/Spark split behavior 2023-09-18 07:42:57 +00:00
Robert Schulze
b5b2cc511b
Pythonic vs Spark splitting 2023-09-18 07:42:52 +00:00
Andrey Zvonov
ff4586e663
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-08 18:17:06 +02:00
Andrey Zvonov
4cfd46a0cc
Update settings.md 2023-09-08 17:29:09 +03:00
zvonand
c36a3fbd39 renamed setting 2023-09-07 12:00:25 +03:00
alexX512
36b8932b37 Merge branch 'master' of github.com:ClickHouse/ClickHouse 2023-08-31 21:40:50 +00:00
Andrey Zvonov
83405a8808
Merge branch 'master' into zvonand-globs-small-fix 2023-08-31 08:42:48 +02:00
vdimir
7618b2d112
Add partial_result_update_duration_ms to settings.md 2023-08-30 12:05:04 +02:00
Alexey Gerasimchuck
a1687e618b backward compatibility changes + fixes 2023-08-29 23:50:41 +00:00
Alexey Gerasimchuck
de1ed97876 disabled validate_tcp_client_information 2023-08-29 08:59:49 +00:00
Alexey Gerasimchuck
e9757abea6 Added validate_tcp_client_information setting 2023-08-29 00:15:55 +00:00
Andrey Zvonov
911bf94fbd
Merge branch 'master' into zvonand-globs-small-fix 2023-08-25 23:50:07 +05:00
Kruglov Pavel
f7e1abd774
Merge branch 'master' into cache-count 2023-08-23 22:31:49 +02:00
Kruglov Pavel
6e3f2fedbd
Apply suggestions from code review
Co-authored-by: Dmitry Novik <mrnovikd@gmail.com>
2023-08-22 19:05:06 +02:00
Kruglov Pavel
c0bdd0e00b
Merge branch 'master' into cache-count 2023-08-22 14:42:22 +02:00
avogar
b4145aeddc Cache number of rows in files for count in file/s3/url/hdfs/azure functions 2023-08-22 11:59:59 +00:00
Kruglov Pavel
88aee95122
Merge branch 'master' into fast-count-from-files 2023-08-21 14:46:33 +02:00
avogar
47304bf7aa Optimize count from files in most input formats 2023-08-21 12:30:52 +00:00
zvonand
a8cdc94720 update docs acc to review 2023-08-15 23:42:04 +05:00
Anton Popov
5a1265d16d add docs 2023-08-15 00:24:47 +00:00
zvonand
1983c7ce95 update docs 2023-08-11 16:53:17 +03:00
Alexey Milovidov
e101f2011b
Merge branch 'master' into count-distinct-if 2023-08-03 00:09:52 +03:00
Yakov Olkhovskiy
357fee99ff
Merge pull request #52791 from zvonand/zvonand-float-parsing
Add option to switch float parsing methods
2023-08-02 00:23:23 -04:00
Andrey Zvonov
99cd8f9ba9
Merge branch 'master' into zvonand-float-parsing 2023-07-31 23:43:24 +03:00
Andrey Zvonov
987dd6602a
Update docs/en/operations/settings/settings.md
Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>
2023-07-31 11:08:51 +03:00
zvonand
00a1a9f6bd added docs 2023-07-30 20:59:15 +02:00
flynn
6de5127c0d fix conflict 2023-07-28 07:11:52 +00:00
avogar
b5fc34b770 Rename setting disable_url_encoding to enable_url_encoding and add a test 2023-07-27 12:20:33 +00:00
Alexey Milovidov
168b84a592
Merge pull request #52337 from Avogar/no-decode-url
Allow to disable decoding/encoding path in uri in URL engine
2023-07-25 05:43:06 +03:00
flynn
2e61e92c86 update doc 2023-07-23 04:07:18 +00:00
avogar
fe934d3059 Make better 2023-07-20 12:38:41 +00:00
lgbo-ustc
0ba97eeea5 wip: grace hash join support full & right join 2023-07-20 18:22:01 +08:00
avogar
2b8e4ebd4c Allow to disable decoding/encoding path in uri in URL engine 2023-07-19 19:48:39 +00:00
Kruglov Pavel
d3d0f101f7
Merge branch 'master' into full-filename-placeholder 2023-07-17 19:14:10 +02:00
Alexey Milovidov
b1d1918607
Merge branch 'master' into retry 2023-07-08 03:08:48 +03:00
Slach
0bd16d47be fix documentation insconsistency about additional_tables_filter during reproduce https://github.com/ClickHouse/ClickHouse/issues/51948
Signed-off-by: Slach <bloodjazman@gmail.com>
2023-07-07 19:44:20 +05:00
Alexander Tokmakov
1e10bf5bdf Update docs/en/operations/settings/settings.md 2023-07-03 19:10:39 +03:00
velavokr
66227ce8d3 #51292 added default_temporary_table_engine setting 2023-07-03 19:10:39 +03:00
Kruglov Pavel
400e7313f0
Merge branch 'master' into full-filename-placeholder 2023-06-30 14:38:18 +02:00
Denny Crane
6ec85f9faa
Update settings.md 2023-06-29 11:06:28 -03:00
avogar
ebeef65920 Add placeholder for rull filename in rename_files_after_processing setting 2023-06-29 13:35:27 +00:00
Alexey Milovidov
cca3f9937c
Merge branch 'master' into retry 2023-06-24 22:29:17 +03:00
Michael Kolupaev
4a570a05c9 Decrease default timeouts for S3 and HTTP requests 2023-06-21 18:08:50 +00:00
Andrey Zvonov
b4f2e4020d
Merge branch 'master' into zvonand-implicit-tz 2023-06-21 13:41:35 +02:00
Denny Crane
d5946da5f8
Update settings.md 2023-06-20 13:31:11 -03:00
Andrey Zvonov
07191ce10d
Merge branch 'master' into zvonand-implicit-tz 2023-06-20 00:24:53 +02:00
Kruglov Pavel
1f47bb7716
Fix docs 2023-06-16 13:45:46 +02:00
Robert Schulze
0e6ec3e21f
Update settings.md 2023-06-16 11:44:47 +02:00
Robert Schulze
a622f1b16c
Update settings.md 2023-06-16 11:42:58 +02:00
Robert Schulze
2cca632e83
Update settings.md 2023-06-16 11:42:22 +02:00
Robert Schulze
d745180ef6
Update settings.md 2023-06-16 11:41:08 +02:00
zvonand
4155d13d69 merge master and resolve conflict 2023-06-16 02:20:32 +02:00
zvonand
e60506f41b changes requested in review 2023-06-16 02:16:04 +02:00
Kruglov Pavel
39ba925f8b
Merge branch 'master' into allow-skip-empty-files 2023-06-13 17:17:26 +02:00
avogar
2e1f56ae33 Address comments 2023-06-13 14:43:50 +00:00
Kruglov Pavel
e4838725e3
Merge branch 'master' into allow-skip-empty-files 2023-06-12 20:03:23 +02:00
Denny Crane
07eb7b7d66
Update settings.md 2023-06-12 11:03:50 -03:00
Kruglov Pavel
873cee9451
Merge pull request #49626 from alekseygolub/renamefile
Added option to rename files, loaded via TableFunctionFile, after successful processing
2023-06-12 15:01:22 +02:00
Nikolai Kochetov
e0277b071b
Merge pull request #50699 from ClickHouse/vdimir/revert_grace_join_changed
Revert recent grace hash join changes
2023-06-09 17:56:52 +02:00
robot-ch-test-poll
d0f031660b
Merge pull request #50646 from DerekChia/patch-2
Update settings.md
2023-06-08 17:47:09 +02:00
Andrey Zvonov
d95be4162f
Merge branch 'master' into zvonand-implicit-tz 2023-06-08 18:34:45 +03:00
zvonand
4d4e5c690e update docs spelling check failed 2023-06-08 17:10:51 +02:00
Kruglov Pavel
bf28074d32
Merge branch 'master' into allow-skip-empty-files 2023-06-08 12:36:18 +02:00
vdimir
f0a1c8afa2
Revert "Merge pull request #49483 from bigo-sg/grace_hash_full_join"
This reverts commit fa93c388b1, reversing
changes made to a2c0a65344.
2023-06-08 09:40:41 +00:00
Derek Chia
286f3b247b
Update settings.md 2023-06-08 11:28:44 +08:00
Derek Chia
f3959aa9e1
Update settings.md
`max_final_threads` is now set to the number of cores by default. See https://github.com/ClickHouse/ClickHouse/pull/47915
2023-06-07 11:07:16 +08:00
Boris Kuschel
f552b96451 Add docs for ignore index 2023-06-06 19:08:42 -04:00
Kruglov Pavel
b83b057045
Merge branch 'master' into renamefile 2023-06-06 19:38:05 +02:00
DanRoscigno
9b89751948 add docs for parallel view processing 2023-06-02 12:52:06 -04:00
Dan Roscigno
fb11f7eb6f
Merge pull request #50478 from DanRoscigno/user-settings-docs
move from server to user settings
2023-06-02 10:56:28 -04:00
Robert Schulze
54872f9e7e
Typos: Follow-up to #50476 2023-06-02 13:28:09 +00:00
DanRoscigno
079008058a move from server to user settings 2023-06-02 08:49:26 -04:00
Robert Schulze
a22bb07fbd
Merge remote-tracking branch 'rschu1ze/master' into fix-typo-check-on-nested-docs 2023-06-02 12:33:16 +00:00
Robert Schulze
65cc92a78d
CI: Fix aspell on nested docs 2023-06-02 12:24:41 +00:00
Kruglov Pavel
9922053419
Merge pull request #49948 from Avogar/handshake-timeout
Add separate handshake_timeout for receiving Hello packet from replica
2023-06-02 14:07:27 +02:00
Andrey Zvonov
2e427ee028
Merge branch 'master' into zvonand-implicit-tz 2023-06-02 01:15:56 +03:00
Robert Schulze
45b1fcdeda
Merge pull request #50315 from arenadata/ADQM-810
Add new function toLastDayOfWeek()
2023-06-01 16:19:14 +02:00
avogar
0b62be649f Add docs, fix style 2023-05-31 17:52:29 +00:00
Kruglov Pavel
f863dee8e7
Merge branch 'master' into renamefile 2023-05-30 12:26:40 +02:00
Andrey Zvonov
87fc780c14
Merge branch 'master' into zvonand-implicit-tz 2023-05-30 13:13:46 +03:00
Victor Krasnov
9a8086a377 Reorder toLastDayOf* functions in settings.md 2023-05-29 22:12:44 +00:00
alekseygolub
63225b37a2
Merge branch 'ClickHouse:master' into renamefile 2023-05-29 16:52:41 +03:00
Victor Krasnov
0ad5b9f598 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-810-dev 2023-05-29 08:26:26 +00:00
Nikolay Degterinsky
c57fa9d496
Docs: Add PostgreSQL and ODBC related settings 2023-05-26 16:50:43 +02:00
alekseygolub
36e8f13242 Added docs for feature 2023-05-25 20:10:02 +00:00
DanRoscigno
d4927e4fe5 add docs 2023-05-24 10:51:43 -04:00
Victor Krasnov
99a7967f11 Amend the dicumentation with regard to toLastDayOfWeek 2023-05-24 11:58:39 +00:00
Victor Krasnov
3bce2bbc37 Fix settings.md in regard to enable_extended_results_for_datetime_functions 2023-05-24 11:40:41 +00:00
avogar
3c1aeaaa79 Change default value of handshake_timeout to 10 sec, fix possible use-after-free 2023-05-23 11:39:40 +00:00
Kruglov Pavel
136c3caf03
Merge branch 'master' into handshake-timeout 2023-05-23 11:53:54 +02:00
lgbo-ustc
cc93f9ab52 update tests for flaky test 2023-05-22 10:17:41 +08:00
Yusuke Tanaka
2444e93ad7
Fix broken link to async_insert_deduplicate in doc 2023-05-21 14:42:17 +09:00
zvonand
f459ac5517 resolve ambiguity by adding a section to docs 2023-05-20 01:38:35 +02:00
Alexey Milovidov
2323542e47
Merge pull request #50022 from ClickHouse/geo-types-production-ready
Geo types are production ready
2023-05-20 02:02:23 +03:00
zvonand
7dccb51bc0 fix conflict and update 2023-05-19 23:40:51 +02:00
Alexey Milovidov
f5506210d6 Geo types are production ready 2023-05-19 12:43:55 +02:00
Dan Roscigno
addc0c0ece
Merge branch 'master' into allow_experimental_parallel_reading_from_replicas 2023-05-17 13:20:14 -04:00
avogar
846804fed0 Add separate handshake_timeout for receiving Hello packet from replica 2023-05-17 11:39:04 +00:00
DanRoscigno
b8b4723aa6 add max_rows_in_set_to_optimize_join docs 2023-05-12 10:19:30 -04:00
DanRoscigno
0f7c0859b0 add allow_experimental_parallel_reading_from_replicas docs 2023-05-12 09:22:29 -04:00
zvonand
c3af36915f fixed docs 2 2023-05-12 01:29:34 +02:00
zvonand
60b69601e9 update docs 2023-05-12 00:27:11 +02:00
Denny Crane
fcf1dd52bc
Update settings.md 2023-05-11 14:05:30 -03:00
Rich Raposa
2f8a530bf3
Merge pull request #49741 from ClickHouse/rfraposa-patch-2
Update async_insert explanation in docs
2023-05-11 08:36:53 -06:00
zvonand
ecd0b4cc06 update settings from master 2023-05-11 00:37:58 +02:00
Dan Roscigno
8f573aba2d
docs for connect_timeout_with_failover_secure_ms
closes #47267
2023-05-10 14:00:05 -04:00
Rich Raposa
4be0372eb4
Update settings.md
Removed the mention that async_insert is  only useful for HTTP
2023-05-10 09:48:33 -06:00
Alexey Milovidov
8a6e07f0ea Make projections production-ready 2023-05-10 03:35:13 +02:00
Andrey Zvonov
9237b904be
Merge branch 'master' into zvonand-implicit-tz 2023-05-10 01:25:33 +02:00
Duyet Le
4c7849a9c8
Fix incorrect docs for use_query_cache 2023-05-09 17:08:49 +07:00
Robert Schulze
883e0abea1
Query Cache: Safeguard against empty chunks
Reading from the query cache is implemented using processor
"SourceFromChunks" which inherits from ISource. The latter has logic
which finishes processing (= calls .finish() on the output port +
returns Status::Finished) when the derived class returns an empty chunk.
If this empty chunk is not the last chunk, i.e. if it is followed by
non-empty chunks, the query result will be incorrect. This situation
should theoretically never occur in practice but who knows ... To be on
the safe side, writing into the query cache now rejects empty chunks and
thereby avoids this scenario.
2023-05-06 14:22:23 +00:00
zvonand
8338d54c34 Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-implicit-tz 2023-05-05 15:50:26 +02:00
Ivan Takarlikov
8873856ce5 Fix some grammar mistakes in documentation, code and tests 2023-05-04 13:35:18 -03:00
Robert Schulze
3255f937f2
Remove anchor 2023-04-25 11:34:10 +00:00
Robert Schulze
d7f759ce38
Docs: Make caption of processors_profile_log page consistent with other pages 2023-04-25 11:31:53 +00:00
Robert Schulze
38d5f12a32
Query Cache: Implement per-user quotas 2023-04-23 16:13:51 +00:00
avogar
d68b8f46a4 Increase default value for connect_timeout_with_failover_ms 2023-04-21 11:38:36 +00:00
Kruglov Pavel
9749448eb0
Merge pull request #47229 from Avogar/non-blocking-connect
Improve async reading from socket
2023-04-21 10:38:50 +02:00
Andrey Zvonov
984e8fde41
Merge branch 'master' into zvonand-implicit-tz 2023-04-20 23:13:17 +02:00
Robert Schulze
cdf28f9b71
Minor fixups 2023-04-19 16:16:51 +00:00
Robert Schulze
c406663442
Docs: Replace annoying three spaces in enumerations by a single space 2023-04-19 15:56:55 +00:00
Andrey Zvonov
61f55930ce
Update docs/en/operations/settings/settings.md
Co-authored-by: Vasily Nemkov <V.Nemkov@gmail.com>
2023-04-19 15:46:17 +03:00
zvonand
daae5025e8 small updates due to review 2023-04-19 14:45:51 +02:00
Kruglov Pavel
2ad161d2b7
Merge branch 'master' into non-blocking-connect 2023-04-19 13:39:40 +02:00
zvonand
22be85d976 renamed setting 2023-04-18 02:42:30 +02:00
Alexander Tokmakov
75f18b1198
Revert "Check simple dictionary key is native unsigned integer" 2023-04-13 01:32:19 +03:00
Anton Popov
1520f3e924
Merge pull request #48335 from lzydmxy/check_sample_dict_key_is_correct
Check simple dictionary key is native unsigned integer
2023-04-12 14:27:39 +02:00
zvonand
2a9f28b73b resolve 2023-04-12 12:54:39 +02:00
Dmitry Novik
435a0ab9bb Fix a typo 2023-04-11 14:13:37 +00:00
Dmitry Novik
5488fb0fec Add documentation for additional_result_filter setting 2023-04-11 14:07:17 +00:00
Anton Popov
027f8a02c8
Merge branch 'master' into check_sample_dict_key_is_correct 2023-04-05 16:31:57 +02:00
lzydmxy
529e1466df use check_dictionary_primary_key instead of check_sample_dict_key_is_correct 2023-04-04 12:04:17 +08:00
Kruglov Pavel
9e595c82fa
Merge pull request #47494 from KevinyhZou/enable_return_null_element_not_exist
Enable return null and complext type for JSON_VALUE function
2023-04-03 14:05:18 +02:00
Robert Schulze
3e124f09d0
Merge remote-tracking branch 'origin/master' into qc-compression 2023-04-03 11:28:17 +00:00
KevinyhZou
da4ff587af review fix 2023-04-02 12:38:17 +08:00
KevinyhZou
ce5f4cf4ab code review fix 2023-04-02 12:37:18 +08:00
Nikolai Kochetov
f06bdc85eb
Merge pull request #48226 from ClickHouse/rename-setting-stop_reading_on_first_cancel
Rename setting stop_reading_on_first_cancel
2023-03-30 18:03:23 +02:00
Nikolai Kochetov
06bf500c30
Update settings.md 2023-03-30 17:36:56 +02:00
filimonov
fbb22348ea
Refactor reading the pool setting & from server config. (#48055)
After #36425 there was a lot of confusions/problems with configuring pools - when the message was confusing, and settings need to be ajusted in several places.
See some examples in #44251, #43351, #47900, #46515.

The commit includes the following changes:
1) Introduced a unified mechanism for reading pool sizes from the configuration file(s). Previously, pool sizes were read from the Context.cpp with fallbacks to profiles, whereas main_config_reloader in Server.cpp read them directly without fallbacks.
2) Corrected the data type for background_merges_mutations_concurrency_ratio. It should be float instead of int.
3) Refactored the default values for settings. Previously, they were defined in multiple places throughout the codebase, but they are now defined in one place (or two, to be exact: Settings.h and ServerSettings.h).
4) Improved documentation, including the correct message in system.settings.

Additionally make the code more conform with #46550.
2023-03-30 16:44:11 +02:00
Nikolai Kochetov
a8a28bdf3d Merge branch 'master' into rename-setting-stop_reading_on_first_cancel 2023-03-30 16:07:14 +02:00
Nikolai Kochetov
f870e6f7a9 Rename setting stop_reading_on_first_cancel to partial_result_on_first_cancel. 2023-03-30 14:00:44 +00:00
Robert Schulze
b0473098c6
Merge branch 'master' into qc-compression 2023-03-30 10:55:42 +02:00
Denny Crane
2c231a6ac4
Update settings.md 2023-03-29 20:49:44 -03:00
Robert Schulze
b324d0ed5e
Merge branch 'master' into qc-compression 2023-03-29 15:09:22 +02:00
Dan Roscigno
c8f59194a3
Merge pull request #48070 from den-crane/patch-60
Doc. idle_connection_timeout
2023-03-27 15:17:08 -04:00
DanRoscigno
6d8a2bbd48 standardize admonitions 2023-03-27 14:54:05 -04:00
Denny Crane
295d3b7510
Update settings.md 2023-03-27 14:45:43 -03:00
Denny Crane
98488f30ab
Update settings.md 2023-03-27 14:40:45 -03:00
Kruglov Pavel
f3f93dd06c
Merge branch 'master' into non-blocking-connect 2023-03-24 15:59:40 +01:00
rfraposa
747eaf3f72 Fix broken links 2023-03-23 14:40:45 -06:00
Kruglov Pavel
3ee12e21fb
Merge branch 'master' into non-blocking-connect 2023-03-23 20:53:44 +01:00
avogar
38e44861ae Fix possible race conditions 2023-03-21 16:01:54 +00:00
Robert Schulze
d8493780b2
Query cache: Enable compression and squashing of result blocks
ClickHouse reads table data in blocks of 'max_block_size' rows. Due to
filtering, aggregation, etc., result blocks are typically much smaller
than 'max_block_size' but there are also cases where they are much
bigger. Setting 'query_cache_squash_partial_results' (enabled by
default) now controls if result blocks are squashed (if they are tiny)
or split (if they are large) into blocks of 'max_block_size' size before
insertion into the query result cache. This reduces performance of
writes into the query cache but improves compressability of cache
entries and provides more natural block granularity when query results
are later served from the query cache.

Entries in the query cache are now also compressed by default. This
reduces the overall memory consumption at the cost of slower writes into
/ reads from the query cache. To disable compression, use setting
'query_cache_compress_entries'.
2023-03-20 20:11:41 +00:00
Sergei Trifonov
273770519b
Merge branch 'master' into master 2023-03-20 18:28:10 +01:00
rfraposa
ac5ed141d8 New nav - reverting the revert 2023-03-17 21:45:43 -05:00
Alexander Tokmakov
ec44c8293a
Revert "New navigation" 2023-03-17 21:21:11 +03:00
rfraposa
60fb9973d7 trailing slash fixes 2023-03-16 16:43:01 -05:00
alexX512
29dd2e56f9 Fix pulling pipeline 2023-03-16 12:41:17 +00:00
Andrey Zvonov
4327d707e0
Merge branch 'master' into zvonand-implicit-tz 2023-03-15 22:18:52 +01:00
Alexey Perevyshin
1e9ef12f51
Merge branch 'master' into master 2023-03-15 22:21:02 +04:00
alexX512
dc1a6884ca Add documentation for a setting stop_reading_on_first_cancel 2023-03-15 14:49:24 +00:00
Robert Schulze
3bcfe02312
Docs: Fix unit for setting "max_query_size" 2023-03-15 13:29:25 +00:00
Ilya Yatsishin
542eb23561
Update docs/en/operations/settings/settings.md 2023-03-10 23:20:24 +01:00
Antonio Bonuccelli
8819860b14
Merge branch 'master' into async_insert_max_query_number 2023-03-10 16:45:55 +01:00
nellicus
6f4833f2c3 add async_insert_max_query_number 2023-03-10 16:10:31 +01:00
Rich Raposa
de68dade71
Revert "standardize admonitions" 2023-03-09 14:30:40 -07:00
DanRoscigno
95351bc2d3 standardize admonitions 2023-03-09 12:05:26 -05:00
Antonio Andelic
2ae0bceb2b Address PR comments 2023-03-07 10:56:11 +00:00
Antonio Andelic
01cf9c94f4 Merge branch 'master' into custom-key-parallel-replicas 2023-03-02 14:28:42 +00:00
Denny Crane
fd97f7ad0a
Update settings.md 2023-02-26 19:25:13 -04:00
zvonand
49fb028498 Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-implicit-tz 2023-02-26 17:20:09 +01:00
Denny Crane
55b3bffe59
Update settings.md 2023-02-23 21:15:31 -04:00
zvonand
a9d0f7e7db Added docs for new serverTimeZone function
Updated tests and docs
2023-02-23 19:14:49 +01:00
Nikolai Kochetov
dbfa641c47
Merge pull request #46621 from ClickHouse/resurrect-processors-profile-log-docs
Resurrect processors_profile_log docs.
2023-02-23 13:09:35 +01:00
zvonand
393830ecdc add docs + tiny cleanup 2023-02-22 16:30:46 +01:00
Dan Roscigno
efea3cbc5c
Update docs/en/operations/settings/settings.md 2023-02-21 12:19:56 -05:00
Han Fei
eeac1abaa5 add docs for setting async_insert_max_query_number 2023-02-21 17:49:52 +01:00
Nikolai Kochetov
186a29a2aa Resurrect processors_profile_log docs. 2023-02-20 19:46:39 +01:00
Antonio Andelic
ab51c1d975
Merge branch 'master' into custom-key-parallel-replicas 2023-02-17 15:06:41 +01:00
Dmitry Novik
c95df21324 Review fixes 2023-02-16 15:38:25 +00:00
Dmitry Novik
b908fa32df Add documentation for group_by_use_nulls 2023-02-16 00:57:53 +00:00
Antonio Andelic
adde580756
Merge branch 'master' into custom-key-parallel-replicas 2023-02-14 14:09:12 +01:00
Antonio Andelic
f96d480563
Merge branch 'master' into add-support-for-settings-alias 2023-02-09 16:07:45 +01:00
Vladimir C
ecb5802c4b
Update docs/en/operations/settings/settings.md
Co-authored-by: Dmitry Novik <n0vik@clickhouse.com>
2023-02-09 10:59:14 +01:00
vdimir
88174fbaaa
Add doc for optimize_rewrite_aggregate_function_with_if 2023-02-08 14:27:25 +00:00
Antonio Andelic
f67e5505ab Merge branch 'master' into custom-key-parallel-replicas 2023-02-06 11:12:39 +00:00
Antonio Andelic
a58653820e Update docs 2023-02-03 18:19:12 +00:00
Robert Schulze
cfcf957c75
Docs: Remove obsolete query result cache page 2023-02-02 11:33:35 +00:00
Vladimir C
b389c1effb
Merge pull request #45589 from ClickHouse/optimize-constraints 2023-02-01 12:57:02 +01:00
Robert Schulze
9a8af6a42e
Update docs/en/operations/settings/settings.md
Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
2023-01-31 12:44:20 +01:00
Antonio Andelic
c99efa75b7
Merge branch 'master' into custom-key-parallel-replicas 2023-01-31 11:58:30 +01:00
Robert Schulze
325c6bdf3d
Renaming: "Query Result Cache" --> "Query Cache"
Reasons:

- The cache will at some point store intermediate results as opposed to
  only query results. We should change the terminology now without
  having to worry about backward compat.

- Equivalent caches in MySQL (1) and Starrocks (2) are called "query
  cache".

- The new name is ca. 13.8% more catchy.

(1) https://dev.mysql.com/doc/refman/5.6/en/query-cache.html
(2) https://docs.starrocks.io/en-us/2.5/using_starrocks/query_cache
2023-01-31 09:54:34 +00:00
Robert Schulze
659a64a1d9
Merge pull request #45679 from ClickHouse/untangle-query-result-cache-settings
Untangle configuration of query result cache
2023-01-31 10:44:14 +01:00
Igor Nikonov
741c3ba23c Fix non-intentional change 2023-01-30 18:43:01 +01:00
Igor Nikonov
01b225f57e
Update docs/en/operations/settings/settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-30 18:30:59 +01:00
Igor Nikonov
211449d916
Update docs/en/operations/settings/settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-30 18:30:29 +01:00
Igor Nikonov
b095dab141
Update docs/en/operations/settings/settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-30 18:29:32 +01:00
Igor Nikonov
0c4bc489da
Update docs/en/operations/settings/settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-30 18:28:53 +01:00
Igor Nikonov
30c949ba27
Update docs/en/operations/settings/settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-30 18:28:34 +01:00
Igor Nikonov
c30a55b7ee Some polishing 2023-01-30 16:53:37 +01:00
Igor Nikonov
d8ba469b97
Fixes 2023-01-30 16:24:02 +01:00
Igor Nikonov
65caa77a0e
Update settings.md 2023-01-30 16:13:08 +01:00
Robert Schulze
27b978381b
Use more speaking setting names 2023-01-30 14:20:43 +00:00
Robert Schulze
e30c38cab3
Fix up some leftovers 2023-01-27 10:43:43 +00:00
Robert Schulze
7d97fab2dc
Untangle query result cache settings
This PR modularizes the configuration options of the query result cache
(QRC).

1. Add a feature toggle "allow_experimental_query_result_cache = false"
   which controls whether the experimental QRC can be used at all. This
   configuration option will be removed once the QRC becomes
   non-experimental.

2. Modularize the existing two configuration settings
   "enable_experimental_query_result_cache" and
   "enable_experimental_query_result_cache_passive_usage" into three
   orthogonal settings:

   - "use_query_result_cache = false" controls whether a query (or all
     queries of the session) utilize the query result cache

   - settings "use_query_result_cache_passive_usage = true" and
     "use_query_result_cache_active_usage = true" control the way a
     query (or all queries of the session) utilize the query result
     cache: "passive" use is reading, "active" use is writing.
2023-01-26 21:17:48 +00:00
Antonio Andelic
07b2c5ce0f
Merge branch 'master' into custom-key-parallel-replicas 2023-01-26 12:42:04 +01:00
Dan Roscigno
b4ab361366
Merge branch 'master' into docs_optimize_skip_merged_partitions 2023-01-25 19:45:32 -05:00
Dan Roscigno
e520bd8052
Apply suggestions from code review 2023-01-24 19:10:30 -05:00
Dan Roscigno
dbb83dc9a4
Merge branch 'master' into docs-for-s3-settings 2023-01-24 17:55:31 -05:00
DanRoscigno
fe56967af7 fix note formatting 2023-01-24 17:44:10 -05:00
DanRoscigno
9775987ee9 add new settings for s3 and hdfs 2023-01-24 17:40:37 -05:00
DanRoscigno
f95bc55923 split Format settings out 2023-01-24 17:19:50 -05:00
rfraposa
6f7755ebcd Added optimize using constraints settings 2023-01-24 15:05:34 -07:00
AVMusorin
5f8658b2d6
docs: added optimize_skip_merged_partitions setting 2023-01-24 14:56:39 +01:00
DanRoscigno
72b1a65984 WIP 2023-01-24 07:45:59 -05:00
Antonio Andelic
95853af459 Merge branch 'master' into custom-key-parallel-replicas 2023-01-24 10:49:40 +00:00
Antonio Andelic
37b62b3a58 Use Map for custom_key 2023-01-24 10:46:47 +00:00
DanRoscigno
dedb4e4de2 add docs for PR 33302 2023-01-23 16:14:39 -05:00
Kruglov Pavel
478a552a0a
Merge branch 'master' into tsv-csv-detect-header 2023-01-23 21:47:17 +01:00
Robert Schulze
0ab7ae6c17
Merge pull request #43797 from ClickHouse/query-result-cache
Query result cache [experimental]
2023-01-23 19:54:35 +01:00
Antonio Andelic
c15128491b Update max_parallel_replicas docs 2023-01-23 17:24:48 +01:00
Robert Schulze
ed84021aa5
Formatting fixup 2023-01-22 16:45:26 +01:00
Robert Schulze
0ffffdd442
Docs: Fix weird formatting 2023-01-22 15:38:11 +00:00
Robert Schulze
340f406553
Merge branch 'master' into query-result-cache 2023-01-22 13:21:36 +01:00
Han Fei
449ace3373
Update docs/en/operations/settings/settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-20 18:07:19 +01:00
Han Fei
9d87bd10ee
Update docs/en/operations/settings/settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-20 18:07:08 +01:00
Han Fei
badfbcb3d8
Update docs/en/operations/settings/settings.md
Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-01-20 18:06:58 +01:00
Han Fei
5fc4998f10 update docs for async insert deduplication 2023-01-20 14:42:11 +01:00
Robert Schulze
4f90824347
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-17 22:49:53 +00:00
Kruglov Pavel
96bb99f864
Merge branch 'master' into tsv-csv-detect-header 2023-01-17 15:33:02 +01:00
Vladimir C
b80ee8df50
Merge pull request #45256 from DanRoscigno/add-grace-hash-docs 2023-01-16 18:43:19 +01:00
Kruglov Pavel
e9d6590926
Merge branch 'master' into tsv-csv-detect-header 2023-01-16 17:50:24 +01:00
avogar
1c0941d72a Add docs and examples 2023-01-16 16:46:41 +00:00
Robert Schulze
099e30ef2a
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-16 08:04:49 +00:00
DanRoscigno
d0a55f6dc9 doc grace_hash algorithm for join 2023-01-13 13:17:03 -05:00
avogar
87b934c472 Insert default values in case of missing tuple elements in JSONEachRow 2023-01-12 16:36:44 +00:00
Dan Roscigno
37da8e206b
Merge pull request #45119 from ClickHouse/add-default-table-engine-setting
Added description of default_table_engine setting
2023-01-10 09:59:09 -05:00
Dan Roscigno
ee88814cac
formal to form 2023-01-10 09:42:04 -05:00
rfraposa
d61eae8554 Update settings.md
Added description of default_table_engine
2023-01-10 07:40:22 -07:00
Robert Schulze
0c3b034887
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-10 09:02:41 +00:00
rfraposa
62b9e2f063 Update settings.md
Add convert_query_to_cnf setting
2023-01-09 21:30:24 -07:00
Robert Schulze
ad4884b394
Fix review comments, pt. I 2023-01-09 21:42:51 +00:00
DanRoscigno
e0b258b4a9 move persistence setting docs 2023-01-06 17:01:28 -05:00
Robert Schulze
45dbcf88e5
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-06 20:42:48 +00:00
DanRoscigno
273ad90d1d add additional table filters setting 2023-01-05 10:47:18 -05:00
Kruglov Pavel
966f57ef68
Merge pull request #42777 from Avogar/improve-streaming-engines
Refactor and Improve streaming engines Kafka/RabbitMQ/NATS and data formats
2023-01-02 15:59:06 +01:00
Robert Schulze
8381d8b467
query_result_cache_keep_seconds_alive --> query_result_cache_ttl 2023-01-02 09:38:40 +00:00
Robert Schulze
ba55fd3ad2
Cosmetics 2023-01-02 09:30:44 +00:00
Robert Schulze
e9e04166d9
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-02 08:20:27 +00:00
Kruglov Pavel
894726bd8f
Merge branch 'master' into improve-streaming-engines 2022-12-29 22:59:45 +01:00
avogar
46b7ec4209 Add detailed documentation about schema inference 2022-12-29 13:42:56 +00:00
Sergei Trifonov
048525273f
Merge branch 'master' into Avogar-patch-1 2022-12-21 11:54:18 +01:00
Kruglov Pavel
5e01a3d74e
Merge branch 'master' into improve-streaming-engines 2022-12-21 10:51:50 +01:00
Kruglov Pavel
36a6ee4fdb
Add documentation for setting allow_settings_after_format_in_insert 2022-12-20 22:04:37 +01:00
DanRoscigno
c6513624c4 add support case note for compat setting 2022-12-20 15:03:42 -05:00
Robert Schulze
b93c56323c
Merge remote-tracking branch 'origin/master' into query-result-cache 2022-12-19 09:18:36 +00:00
Robert Schulze
d81e507952
Fix doc links 2022-12-18 12:23:38 +00:00
Robert Schulze
bc6bcdfd7b
Allow sharing of cache entries 2022-12-17 18:04:18 +00:00
Robert Schulze
aa50b9cf48
Invert config parameter name for more clarity 2022-12-17 15:10:04 +00:00
Kruglov Pavel
37df9b9990
Merge branch 'master' into refactor-schema-inference 2022-12-16 19:13:15 +01:00
Robert Schulze
3790952631
Move server-level settings into the appropriate document 2022-12-15 22:51:47 +00:00
Robert Schulze
4db33f16e3
Make DoS attack on cache less likely 2022-12-15 21:42:51 +00:00
Robert Schulze
bcc54ab9b4
Add cfg for min query duration for caching 2022-12-15 20:10:37 +00:00
Kruglov Pavel
c5b2e4cc23
Merge branch 'master' into improve-streaming-engines 2022-12-15 18:44:35 +01:00
Kruglov Pavel
00d80e44cc
Fix typos 2022-12-15 16:18:40 +01:00
Kruglov Pavel
7657f16e2a
Add missing documentation for some schema inference settings 2022-12-15 16:17:18 +01:00
Kruglov Pavel
0816626373
Update docs 2022-12-15 16:10:06 +01:00
Robert Schulze
537c64aad2
Merge remote-tracking branch 'origin/master' into query-result-cache
Conflicts:
- tests/queries/0_stateless/02117_show_create_table_system.reference
2022-12-15 12:17:58 +00:00
Robert Schulze
973d4f75de
More intuitive active/passive enablement of query result cache 2022-12-15 12:16:36 +00:00
Robert Schulze
f1e367179e
Make maximum record count per item configurable 2022-12-15 11:16:44 +00:00
Robert Schulze
e52dfaf45c
Make number of cached items configurable 2022-12-15 10:08:28 +00:00
avogar
f3e37c2c9b Merge branch 'refactor-schema-inference' of github.com:Avogar/ClickHouse into refactor-schema-inference 2022-12-12 14:47:04 +00:00
Kruglov Pavel
a03549df28
Apply suggestions from code review
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2022-12-12 15:46:03 +01:00