Commit Graph

1393 Commits

Author SHA1 Message Date
Kruglov Pavel
cbed327077
Merge pull request #50635 from Avogar/skip-trailing-empty-lines
Allow to skip trailing empty lines in CSV/TSV/CustomSeparated formats
2023-06-13 12:43:43 +02:00
Kruglov Pavel
e4838725e3
Merge branch 'master' into allow-skip-empty-files 2023-06-12 20:03:23 +02:00
Denny Crane
07eb7b7d66
Update settings.md 2023-06-12 11:03:50 -03:00
Kruglov Pavel
873cee9451
Merge pull request #49626 from alekseygolub/renamefile
Added option to rename files, loaded via TableFunctionFile, after successful processing
2023-06-12 15:01:22 +02:00
Kruglov Pavel
edd47a2281
Merge branch 'master' into skip-trailing-empty-lines 2023-06-12 13:57:15 +02:00
Kruglov Pavel
da68980b8d
Merge branch 'master' into max-bytes-to-read-in-schema-inference 2023-06-12 13:45:31 +02:00
kevinyhzou
911f8ad8dc use whitespace or tab as field delimiter 2023-06-12 11:57:52 +08:00
Nikolai Kochetov
e0277b071b
Merge pull request #50699 from ClickHouse/vdimir/revert_grace_join_changed
Revert recent grace hash join changes
2023-06-09 17:56:52 +02:00
robot-ch-test-poll
d0f031660b
Merge pull request #50646 from DerekChia/patch-2
Update settings.md
2023-06-08 17:47:09 +02:00
Andrey Zvonov
d95be4162f
Merge branch 'master' into zvonand-implicit-tz 2023-06-08 18:34:45 +03:00
zvonand
4d4e5c690e update docs spelling check failed 2023-06-08 17:10:51 +02:00
Kruglov Pavel
a714c1662e
Merge branch 'master' into max-bytes-to-read-in-schema-inference 2023-06-08 12:55:31 +02:00
Kruglov Pavel
dc24599525
Merge branch 'master' into skip-trailing-empty-lines 2023-06-08 12:39:23 +02:00
Kruglov Pavel
bf28074d32
Merge branch 'master' into allow-skip-empty-files 2023-06-08 12:36:18 +02:00
vdimir
f0a1c8afa2
Revert "Merge pull request #49483 from bigo-sg/grace_hash_full_join"
This reverts commit fa93c388b1, reversing
changes made to a2c0a65344.
2023-06-08 09:40:41 +00:00
Derek Chia
286f3b247b
Update settings.md 2023-06-08 11:28:44 +08:00
Derek Chia
f3959aa9e1
Update settings.md
`max_final_threads` is now set to the number of cores by default. See https://github.com/ClickHouse/ClickHouse/pull/47915
2023-06-07 11:07:16 +08:00
Boris Kuschel
f552b96451 Add docs for ignore index 2023-06-06 19:08:42 -04:00
Kruglov Pavel
1baa6404e6
Merge branch 'master' into skip-trailing-empty-lines 2023-06-06 19:39:34 +02:00
Kruglov Pavel
b83b057045
Merge branch 'master' into renamefile 2023-06-06 19:38:05 +02:00
avogar
df50833b70 Allow to skip trailing empty lines in CSV/TSV/CustomeSeparated formats 2023-06-06 17:33:05 +00:00
Kruglov Pavel
af880a6f3b
Merge branch 'master' into max-bytes-to-read-in-schema-inference 2023-06-06 14:47:58 +02:00
avogar
33e51d4f3b Add setting to limit the number of bytes to read in schema inference 2023-06-05 15:22:04 +00:00
Alexey Milovidov
3617a14467
Merge pull request #50215 from arenadata/ADQM-830
Added --input_format_csv_trim_whitespaces option
2023-06-05 06:06:45 +03:00
Alexey Gerasimchuk
9958731c27
Merge branch 'master' into ADQM-830 2023-06-05 07:46:47 +10:00
DanRoscigno
9b89751948 add docs for parallel view processing 2023-06-02 12:52:06 -04:00
Dan Roscigno
fb11f7eb6f
Merge pull request #50478 from DanRoscigno/user-settings-docs
move from server to user settings
2023-06-02 10:56:28 -04:00
Robert Schulze
54872f9e7e
Typos: Follow-up to #50476 2023-06-02 13:28:09 +00:00
DanRoscigno
079008058a move from server to user settings 2023-06-02 08:49:26 -04:00
Robert Schulze
a22bb07fbd
Merge remote-tracking branch 'rschu1ze/master' into fix-typo-check-on-nested-docs 2023-06-02 12:33:16 +00:00
Robert Schulze
65cc92a78d
CI: Fix aspell on nested docs 2023-06-02 12:24:41 +00:00
Kruglov Pavel
9922053419
Merge pull request #49948 from Avogar/handshake-timeout
Add separate handshake_timeout for receiving Hello packet from replica
2023-06-02 14:07:27 +02:00
Andrey Zvonov
2e427ee028
Merge branch 'master' into zvonand-implicit-tz 2023-06-02 01:15:56 +03:00
Robert Schulze
45b1fcdeda
Merge pull request #50315 from arenadata/ADQM-810
Add new function toLastDayOfWeek()
2023-06-01 16:19:14 +02:00
avogar
0b62be649f Add docs, fix style 2023-05-31 17:52:29 +00:00
Kruglov Pavel
4d1b5cc89f
Merge branch 'master' into renamefile 2023-05-31 13:25:11 +02:00
Alexey Gerasimchuk
44ba35d2c1
Merge branch 'master' into ADQM-830 2023-05-31 15:07:37 +10:00
Dan Roscigno
cfa3fbf5b8
add .md extensions 2023-05-30 12:06:27 -04:00
Denny Crane
060d0118d7
Update merge-tree-settings.md 2023-05-30 12:08:24 -03:00
Kruglov Pavel
f863dee8e7
Merge branch 'master' into renamefile 2023-05-30 12:26:40 +02:00
Andrey Zvonov
87fc780c14
Merge branch 'master' into zvonand-implicit-tz 2023-05-30 13:13:46 +03:00
Victor Krasnov
9a8086a377 Reorder toLastDayOf* functions in settings.md 2023-05-29 22:12:44 +00:00
alekseygolub
63225b37a2
Merge branch 'ClickHouse:master' into renamefile 2023-05-29 16:52:41 +03:00
Victor Krasnov
0ad5b9f598 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-810-dev 2023-05-29 08:26:26 +00:00
Nikolay Degterinsky
c57fa9d496
Docs: Add PostgreSQL and ODBC related settings 2023-05-26 16:50:43 +02:00
alekseygolub
36e8f13242 Added docs for feature 2023-05-25 20:10:02 +00:00
Alexey Gerasimchuck
4eb944fef1 minor changes in documentation 2023-05-25 08:05:11 +00:00
Alexey Gerasimchuck
75791d7a63 Added input_format_csv_trim_whitespaces parameter 2023-05-25 07:51:32 +00:00
DanRoscigno
d4927e4fe5 add docs 2023-05-24 10:51:43 -04:00
Victor Krasnov
99a7967f11 Amend the dicumentation with regard to toLastDayOfWeek 2023-05-24 11:58:39 +00:00
Victor Krasnov
3bce2bbc37 Fix settings.md in regard to enable_extended_results_for_datetime_functions 2023-05-24 11:40:41 +00:00
avogar
3c1aeaaa79 Change default value of handshake_timeout to 10 sec, fix possible use-after-free 2023-05-23 11:39:40 +00:00
Kruglov Pavel
136c3caf03
Merge branch 'master' into handshake-timeout 2023-05-23 11:53:54 +02:00
lgbo-ustc
cc93f9ab52 update tests for flaky test 2023-05-22 10:17:41 +08:00
Yusuke Tanaka
2444e93ad7
Fix broken link to async_insert_deduplicate in doc 2023-05-21 14:42:17 +09:00
zvonand
f459ac5517 resolve ambiguity by adding a section to docs 2023-05-20 01:38:35 +02:00
Alexey Milovidov
2323542e47
Merge pull request #50022 from ClickHouse/geo-types-production-ready
Geo types are production ready
2023-05-20 02:02:23 +03:00
zvonand
7dccb51bc0 fix conflict and update 2023-05-19 23:40:51 +02:00
Alexey Milovidov
f5506210d6 Geo types are production ready 2023-05-19 12:43:55 +02:00
Dan Roscigno
addc0c0ece
Merge branch 'master' into allow_experimental_parallel_reading_from_replicas 2023-05-17 13:20:14 -04:00
avogar
846804fed0 Add separate handshake_timeout for receiving Hello packet from replica 2023-05-17 11:39:04 +00:00
DanRoscigno
b8b4723aa6 add max_rows_in_set_to_optimize_join docs 2023-05-12 10:19:30 -04:00
DanRoscigno
0f7c0859b0 add allow_experimental_parallel_reading_from_replicas docs 2023-05-12 09:22:29 -04:00
zvonand
c3af36915f fixed docs 2 2023-05-12 01:29:34 +02:00
robot-clickhouse
6f19a374f2
Merge pull request #49791 from den-crane/patch-65
Update settings.md
2023-05-12 01:02:58 +02:00
zvonand
60b69601e9 update docs 2023-05-12 00:27:11 +02:00
Denny Crane
fcf1dd52bc
Update settings.md 2023-05-11 14:05:30 -03:00
Vitaly Baranov
ec011b9113
Merge branch 'master' into user-grants-from-config 2023-05-11 17:08:06 +02:00
Rich Raposa
2f8a530bf3
Merge pull request #49741 from ClickHouse/rfraposa-patch-2
Update async_insert explanation in docs
2023-05-11 08:36:53 -06:00
zvonand
ecd0b4cc06 update settings from master 2023-05-11 00:37:58 +02:00
Dan Roscigno
8f573aba2d
docs for connect_timeout_with_failover_secure_ms
closes #47267
2023-05-10 14:00:05 -04:00
Rich Raposa
4be0372eb4
Update settings.md
Removed the mention that async_insert is  only useful for HTTP
2023-05-10 09:48:33 -06:00
Alexey Milovidov
8a6e07f0ea Make projections production-ready 2023-05-10 03:35:13 +02:00
Andrey Zvonov
9237b904be
Merge branch 'master' into zvonand-implicit-tz 2023-05-10 01:25:33 +02:00
Duyet Le
4c7849a9c8
Fix incorrect docs for use_query_cache 2023-05-09 17:08:49 +07:00
Robert Schulze
883e0abea1
Query Cache: Safeguard against empty chunks
Reading from the query cache is implemented using processor
"SourceFromChunks" which inherits from ISource. The latter has logic
which finishes processing (= calls .finish() on the output port +
returns Status::Finished) when the derived class returns an empty chunk.
If this empty chunk is not the last chunk, i.e. if it is followed by
non-empty chunks, the query result will be incorrect. This situation
should theoretically never occur in practice but who knows ... To be on
the safe side, writing into the query cache now rejects empty chunks and
thereby avoids this scenario.
2023-05-06 14:22:23 +00:00
pufit
e1fa147e51 docs 2023-05-05 22:57:48 -04:00
zvonand
8338d54c34 Merge branch 'master' of github.com:ClickHouse/ClickHouse into zvonand-implicit-tz 2023-05-05 15:50:26 +02:00
Ivan Takarlikov
8873856ce5 Fix some grammar mistakes in documentation, code and tests 2023-05-04 13:35:18 -03:00
Mike Kot
2d20658885
Merge branch 'master' into feature/show-secrets-option 2023-04-28 20:19:35 +03:00
Mike Kot
f1d0ed367d separate name for format setting 2023-04-28 13:39:38 +00:00
Mike Kot
7bffa89e96 add all 3 settings 2023-04-28 13:22:36 +00:00
Mike Kot
e428af0b63 replace format settings with server setting 2023-04-27 21:27:18 +00:00
Mike Kot
357cde95e9 Merge branch 'master' into feature/show-secrets-option 2023-04-27 20:19:40 +00:00
Aram Peres
f65b526472
Fix an unclosed XML tag in documentation 2023-04-25 20:48:46 -04:00
Robert Schulze
3255f937f2
Remove anchor 2023-04-25 11:34:10 +00:00
Robert Schulze
d7f759ce38
Docs: Make caption of processors_profile_log page consistent with other pages 2023-04-25 11:31:53 +00:00
Robert Schulze
38d5f12a32
Query Cache: Implement per-user quotas 2023-04-23 16:13:51 +00:00
avogar
d68b8f46a4 Increase default value for connect_timeout_with_failover_ms 2023-04-21 11:38:36 +00:00
Kruglov Pavel
9749448eb0
Merge pull request #47229 from Avogar/non-blocking-connect
Improve async reading from socket
2023-04-21 10:38:50 +02:00
Andrey Zvonov
984e8fde41
Merge branch 'master' into zvonand-implicit-tz 2023-04-20 23:13:17 +02:00
Dan Roscigno
aec97033c9
Merge pull request #48940 from ClickHouse/DanRoscigno-patch-5
Update query-complexity.md
2023-04-20 10:56:31 -04:00
Robert Schulze
cdf28f9b71
Minor fixups 2023-04-19 16:16:51 +00:00
Robert Schulze
c406663442
Docs: Replace annoying three spaces in enumerations by a single space 2023-04-19 15:56:55 +00:00
Dan Roscigno
df70f6985c
Update query-complexity.md
The docs say that max_memory_usage is set to 10GB in the default config, but max_memory_usage does not appear in the default config, so the default is unlimited.
2023-04-19 09:16:22 -04:00
Andrey Zvonov
61f55930ce
Update docs/en/operations/settings/settings.md
Co-authored-by: Vasily Nemkov <V.Nemkov@gmail.com>
2023-04-19 15:46:17 +03:00
zvonand
daae5025e8 small updates due to review 2023-04-19 14:45:51 +02:00
Kruglov Pavel
2ad161d2b7
Merge branch 'master' into non-blocking-connect 2023-04-19 13:39:40 +02:00
Youenn Lebras
082c5b0224 Document the new feature of the ReplacingMergeTree engine of the PR #41005 2023-04-18 11:17:46 +02:00
zvonand
22be85d976 renamed setting 2023-04-18 02:42:30 +02:00
Alexander Tokmakov
75f18b1198
Revert "Check simple dictionary key is native unsigned integer" 2023-04-13 01:32:19 +03:00
Anton Popov
1520f3e924
Merge pull request #48335 from lzydmxy/check_sample_dict_key_is_correct
Check simple dictionary key is native unsigned integer
2023-04-12 14:27:39 +02:00
zvonand
2a9f28b73b resolve 2023-04-12 12:54:39 +02:00
Dmitry Novik
435a0ab9bb Fix a typo 2023-04-11 14:13:37 +00:00
Dmitry Novik
5488fb0fec Add documentation for additional_result_filter setting 2023-04-11 14:07:17 +00:00
Anton Popov
027f8a02c8
Merge branch 'master' into check_sample_dict_key_is_correct 2023-04-05 16:31:57 +02:00
lzydmxy
529e1466df use check_dictionary_primary_key instead of check_sample_dict_key_is_correct 2023-04-04 12:04:17 +08:00
Kruglov Pavel
9e595c82fa
Merge pull request #47494 from KevinyhZou/enable_return_null_element_not_exist
Enable return null and complext type for JSON_VALUE function
2023-04-03 14:05:18 +02:00
Robert Schulze
a50e741bea
Merge pull request #45912 from ClickHouse/qc-compression
Query cache: Enable compression of cache entries
2023-04-03 13:33:47 +02:00
Robert Schulze
3e124f09d0
Merge remote-tracking branch 'origin/master' into qc-compression 2023-04-03 11:28:17 +00:00
KevinyhZou
da4ff587af review fix 2023-04-02 12:38:17 +08:00
KevinyhZou
ce5f4cf4ab code review fix 2023-04-02 12:37:18 +08:00
Rich Raposa
4cb3c92607
Update merge-tree-settings.md
For some reason the links are broken - I'm attempting to fix them here
2023-03-31 12:38:45 -06:00
Rich Raposa
330508552e
Merge branch 'master' into docs/background_pool_size 2023-03-31 11:24:00 -06:00
kst-morozov
048ea93c09 upadte doc 2023-03-31 17:59:19 +02:00
Rich Raposa
3a3438ebf9
Update settings-formats.md
Default compression method for Parquet changed from snappy to lz4 in 23.3
2023-03-30 10:26:33 -06:00
Nikolai Kochetov
f06bdc85eb
Merge pull request #48226 from ClickHouse/rename-setting-stop_reading_on_first_cancel
Rename setting stop_reading_on_first_cancel
2023-03-30 18:03:23 +02:00
Nikolai Kochetov
06bf500c30
Update settings.md 2023-03-30 17:36:56 +02:00
filimonov
fbb22348ea
Refactor reading the pool setting & from server config. (#48055)
After #36425 there was a lot of confusions/problems with configuring pools - when the message was confusing, and settings need to be ajusted in several places.
See some examples in #44251, #43351, #47900, #46515.

The commit includes the following changes:
1) Introduced a unified mechanism for reading pool sizes from the configuration file(s). Previously, pool sizes were read from the Context.cpp with fallbacks to profiles, whereas main_config_reloader in Server.cpp read them directly without fallbacks.
2) Corrected the data type for background_merges_mutations_concurrency_ratio. It should be float instead of int.
3) Refactored the default values for settings. Previously, they were defined in multiple places throughout the codebase, but they are now defined in one place (or two, to be exact: Settings.h and ServerSettings.h).
4) Improved documentation, including the correct message in system.settings.

Additionally make the code more conform with #46550.
2023-03-30 16:44:11 +02:00
Nikolai Kochetov
a8a28bdf3d Merge branch 'master' into rename-setting-stop_reading_on_first_cancel 2023-03-30 16:07:14 +02:00
Nikolai Kochetov
f870e6f7a9 Rename setting stop_reading_on_first_cancel to partial_result_on_first_cancel. 2023-03-30 14:00:44 +00:00
Robert Schulze
b0473098c6
Merge branch 'master' into qc-compression 2023-03-30 10:55:42 +02:00
Denny Crane
2c231a6ac4
Update settings.md 2023-03-29 20:49:44 -03:00
Robert Schulze
b324d0ed5e
Merge branch 'master' into qc-compression 2023-03-29 15:09:22 +02:00
Dan Roscigno
c8f59194a3
Merge pull request #48070 from den-crane/patch-60
Doc. idle_connection_timeout
2023-03-27 15:17:08 -04:00
DanRoscigno
6d8a2bbd48 standardize admonitions 2023-03-27 14:54:05 -04:00
Denny Crane
295d3b7510
Update settings.md 2023-03-27 14:45:43 -03:00
Denny Crane
98488f30ab
Update settings.md 2023-03-27 14:40:45 -03:00
Kruglov Pavel
f3f93dd06c
Merge branch 'master' into non-blocking-connect 2023-03-24 15:59:40 +01:00
rfraposa
747eaf3f72 Fix broken links 2023-03-23 14:40:45 -06:00
Kruglov Pavel
3ee12e21fb
Merge branch 'master' into non-blocking-connect 2023-03-23 20:53:44 +01:00
avogar
38e44861ae Fix possible race conditions 2023-03-21 16:01:54 +00:00
Robert Schulze
d8493780b2
Query cache: Enable compression and squashing of result blocks
ClickHouse reads table data in blocks of 'max_block_size' rows. Due to
filtering, aggregation, etc., result blocks are typically much smaller
than 'max_block_size' but there are also cases where they are much
bigger. Setting 'query_cache_squash_partial_results' (enabled by
default) now controls if result blocks are squashed (if they are tiny)
or split (if they are large) into blocks of 'max_block_size' size before
insertion into the query result cache. This reduces performance of
writes into the query cache but improves compressability of cache
entries and provides more natural block granularity when query results
are later served from the query cache.

Entries in the query cache are now also compressed by default. This
reduces the overall memory consumption at the cost of slower writes into
/ reads from the query cache. To disable compression, use setting
'query_cache_compress_entries'.
2023-03-20 20:11:41 +00:00
Sergei Trifonov
273770519b
Merge branch 'master' into master 2023-03-20 18:28:10 +01:00
rfraposa
ac5ed141d8 New nav - reverting the revert 2023-03-17 21:45:43 -05:00
Alexander Tokmakov
ec44c8293a
Revert "New navigation" 2023-03-17 21:21:11 +03:00
rfraposa
60fb9973d7 trailing slash fixes 2023-03-16 16:43:01 -05:00
alexX512
29dd2e56f9 Fix pulling pipeline 2023-03-16 12:41:17 +00:00
Rich Raposa
81cd962773
Merge branch 'master' into new-nav 2023-03-15 22:23:44 -06:00
Andrey Zvonov
4327d707e0
Merge branch 'master' into zvonand-implicit-tz 2023-03-15 22:18:52 +01:00
Alexey Perevyshin
1e9ef12f51
Merge branch 'master' into master 2023-03-15 22:21:02 +04:00
alexX512
dc1a6884ca Add documentation for a setting stop_reading_on_first_cancel 2023-03-15 14:49:24 +00:00
Robert Schulze
3bcfe02312
Docs: Fix unit for setting "max_query_size" 2023-03-15 13:29:25 +00:00
Rich Raposa
8897893229
Merge branch 'master' into new-nav 2023-03-13 10:15:43 -06:00
Ilya Yatsishin
542eb23561
Update docs/en/operations/settings/settings.md 2023-03-10 23:20:24 +01:00
Rich Raposa
eb4961ac0c
Merge branch 'master' into new-nav 2023-03-10 10:35:30 -07:00
Antonio Bonuccelli
75d91f633d
Merge branch 'master' into async_insert_max_query_number 2023-03-10 17:11:05 +01:00
Antonio Bonuccelli
8819860b14
Merge branch 'master' into async_insert_max_query_number 2023-03-10 16:45:55 +01:00
nellicus
6f4833f2c3 add async_insert_max_query_number 2023-03-10 16:10:31 +01:00
Rich Raposa
de68dade71
Revert "standardize admonitions" 2023-03-09 14:30:40 -07:00