Commit Graph

1788 Commits

Author SHA1 Message Date
Kruglov Pavel
6567fb2c08
Merge pull request #56859 from Avogar/csv-infer-numbers-from-strings
Allow to infer numbers from strings in CSV format
2023-12-12 17:09:02 +01:00
avogar
1db000dae5 Add docs 2023-12-11 18:02:05 +00:00
avogar
ee7af95bc0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-12-08 20:29:28 +00:00
hdhoang
fc8292182c
fix typo TKSV
correct name is TS-KV
2023-12-07 20:19:00 +07:00
Sema Checherinda
c61cd6aab2
Merge pull request #57335 from sichenzhao/increase_default_replicated_deduplication_window
increase default replicated_deduplication_window from 100 to 1k
2023-12-02 21:23:39 +01:00
Sichen Zhao
1b8b1c0a63 increase default replicated_deduplication_window from 100 to 1k 2023-11-28 14:24:06 -08:00
Han Fei
7bd2ea3add Merge branch 'master' into hanfei/statistic 2023-11-27 23:31:23 +01:00
Robert Schulze
ca63881357
Mention that the settings are dev settings 2023-11-24 14:46:02 +00:00
vdimir
1044e3366b
Update http_make_head_request doc 2023-11-24 09:32:20 +00:00
Tim Windelschmidt
51e3899f73
Add setting http_make_head_request
Clickhouse always does a HEAD request before actually executing the GET request,
this adds a settings to skip that request.
2023-11-24 09:32:16 +00:00
Robert Schulze
a8a3214185
+ documentation 2023-11-23 19:43:40 +00:00
avogar
f537bad469 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-11-20 14:32:50 +00:00
avogar
872556a5d4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-11-20 14:03:36 +00:00
Sema Checherinda
f999337dae
Revert "Revert "s3 adaptive timeouts"" 2023-11-20 14:53:22 +01:00
Alexander Tokmakov
5031f239c3
Revert "s3 adaptive timeouts" 2023-11-20 14:28:59 +01:00
Sema Checherinda
a950595c24
Merge pull request #56314 from CheSema/s3-aggressive-timeouts
s3 adaptive timeouts
2023-11-19 14:12:14 +01:00
Justin de Guzman
96e87322b5
[Docs] Add insert_distributed_sync to Core Settings docs 2023-11-18 18:10:43 -08:00
Alexey Milovidov
0158db3e07
Merge pull request #56092 from ClickHouse/docs-max-block-size
Set correct default `max_block_size` value in docs
2023-11-18 17:23:43 +01:00
Kruglov Pavel
8e88bf1348 Revert "Revert "Add a setting max_execution_time_leaf to limit the execution time on shard for distributed query"" 2023-11-14 11:40:48 +00:00
Sema Checherinda
76d11687a7 adjuct docs 2023-11-14 11:34:12 +01:00
Sema Checherinda
e0edd165da add doc 2023-11-14 11:34:12 +01:00
Robert Schulze
361a3ca11f
Merge pull request #56519 from rschu1ze/qc-ignore-nondeterministic-queries
Query cache: Allow to ignore non-deterministic queries
2023-11-13 21:32:44 +01:00
Alexander Tokmakov
0622379ec7
Revert "Add a setting max_execution_time_leaf to limit the execution time on shard for distributed query" 2023-11-13 21:11:07 +01:00
Robert Schulze
7864df4826
Update docs + Try to stabilize test results, pt. II 2023-11-13 10:57:33 +00:00
Robert Schulze
91f53514d9
Incorporate review feedback 2023-11-12 15:11:38 +00:00
Robert Schulze
52c825db44
Query cache: Allow to ignore non-deterministic queries
Fixes: #56504
2023-11-12 15:11:38 +00:00
Yarik Briukhovetskyi
b8ea31db43
Merge pull request #56309 from yariks5s/preferred_optimize_projection_name
New setting preferred_projection_name
2023-11-08 18:06:03 +01:00
Sema Checherinda
02df5ac59c
Merge pull request #54340 from KevinyhZou/bug_fix_csv_parse_crlf
Fix CSV read while the end of line is CR(\r)
2023-11-07 12:51:05 +01:00
Sema Checherinda
a5e17dc919
Merge pull request #55566 from CheSema/remote-blobs-naming
feature: storage_metadata_write_full_object_key
2023-11-06 16:41:49 +01:00
kevinyhzou
2a50daf5dd Allow cr at end of csv line 2023-11-06 12:21:42 +08:00
kevinyhzou
ef30e6723d bug fix csv read while end of line is not crlf 2023-11-06 12:21:42 +08:00
Robert Schulze
049c811a38
Make type names in SHOW COLUMNS dependent only on connection type 2023-11-05 21:20:20 +00:00
yariks5s
d95262622b init 2023-11-03 16:47:06 +00:00
Denny Crane
dbaebe18f1
Update settings.md 2023-11-03 13:14:56 -03:00
Denny Crane
9dbd229462
Update settings.md 2023-11-03 13:09:51 -03:00
Kruglov Pavel
81b1ca22bb
Merge pull request #51823 from canhld94/ch_add_max_execution_time_leaf
Add a setting max_execution_time_leaf to limit the execution time on shard for distributed query
2023-11-03 13:31:15 +01:00
Duc Canh Le
dd6b02a2fd add document
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-11-03 03:00:13 +00:00
Sema Checherinda
90b64bcdb9 backward compatibility and implementation feature storage_metadata_write_full_object_key 2023-11-02 15:20:55 +01:00
Alexey Milovidov
1267246785
Merge pull request #55642 from ClickHouse/morton-utils
Indexing by space-filling curves
2023-11-02 12:21:33 +01:00
robot-ch-test-poll1
a5fb7b0a1e
Merge pull request #56213 from ttanay/sort-spill-to-disk-docs
Add `max_bytes_before_external_sort` setting to query complexity doc
2023-11-02 00:50:30 +01:00
Tanay Tummalapalli
6a3b2a04d8 Add max_bytes_before_external_sort setting to query complexity doc
The setting should be mentioned here along with
`max_bytes_before_external_group_by` setting.

Note: The russian translation is courtesy of Google Translate.
2023-11-01 22:33:25 +05:30
Azat Khuzhin
c25d6cd624
Rename directory monitor concept into background INSERT (#55978)
* Limit log frequence for "Skipping send data over distributed table" message

After SYSTEM STOP DISTRIBUTED SENDS it will constantly print this
message.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename directory monitor concept into async INSERT

Rename the following query settings (with preserving backward
compatiblity, by keeping old name as an alias):
- distributed_directory_monitor_sleep_time_ms -> distributed_async_insert_sleep_time_ms
- distributed_directory_monitor_max_sleep_time_ms -> distributed_async_insert_max_sleep_time_ms
- distributed_directory_monitor_batch -> distributed_async_insert_batch_inserts
- distributed_directory_monitor_split_batch_on_failure -> distributed_async_insert_split_batch_on_failure

Rename the following table settings (with preserving backward
compatiblity, by keeping old name as an alias):
- monitor_batch_inserts -> async_insert_batch
- monitor_split_batch_on_failure -> async_insert_split_batch_on_failure
- directory_monitor_sleep_time_ms -> async_insert_sleep_time_ms
- directory_monitor_max_sleep_time_ms -> async_insert_max_sleep_time_ms

And also update all the references:

    $ gg -e directory_monitor_ -e monitor_ tests docs | cut -d: -f1 | sort -u | xargs sed -e 's/distributed_directory_monitor_sleep_time_ms/distributed_async_insert_sleep_time_ms/g' -e 's/distributed_directory_monitor_max_sleep_time_ms/distributed_async_insert_max_sleep_time_ms/g' -e 's/distributed_directory_monitor_batch_inserts/distributed_async_insert_batch/g' -e 's/distributed_directory_monitor_split_batch_on_failure/distributed_async_insert_split_batch_on_failure/g' -e 's/monitor_batch_inserts/async_insert_batch/g' -e 's/monitor_split_batch_on_failure/async_insert_split_batch_on_failure/g' -e 's/monitor_sleep_time_ms/async_insert_sleep_time_ms/g' -e 's/monitor_max_sleep_time_ms/async_insert_max_sleep_time_ms/g' -i

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename async_insert for Distributed into background_insert

This will avoid amigibuity between general async INSERT's and INSERT
into Distributed, which are indeed background, so new term express it
even better.

Mostly done with:

    $ git di HEAD^ --name-only | xargs sed -i -e 's/distributed_async_insert/distributed_background_insert/g' -e 's/async_insert_batch/background_insert_batch/g' -e 's/async_insert_split_batch_on_failure/background_insert_split_batch_on_failure/g' -e 's/async_insert_sleep_time_ms/background_insert_sleep_time_ms/g' -e 's/async_insert_max_sleep_time_ms/background_insert_max_sleep_time_ms/g'

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Mark 02417_opentelemetry_insert_on_distributed_table as long

CI: https://s3.amazonaws.com/clickhouse-test-reports/55978/7a6abb03a0b507e29e999cb7e04f246a119c6f28/stateless_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-01 15:09:39 +01:00
Alexey Milovidov
016285ea87
Merge branch 'master' into morton-utils 2023-10-31 01:47:16 +01:00
yariks5s
0846714052 added docs, changed tests 2023-10-30 17:17:53 +00:00
Han Fei
19cdc6dfe2 Merge branch 'master' into hanfei/statistic 2023-10-30 04:53:18 +01:00
Justin de Guzman
940d099e84
Set correct max_block_size value in docs 2023-10-27 16:50:34 -07:00
Kruglov Pavel
bb4b95e891
Merge branch 'master' into schema-inference-union 2023-10-27 14:53:58 +02:00
zvonand
35baf7792d cleanup after rebase, add [[unlikely]] 2023-10-26 23:56:45 +02:00
Kruglov Pavel
570b66f027
Merge branch 'master' into schema-inference-union 2023-10-26 19:26:00 +02:00
Andrey Zvonov
5737369d0b
Merge branch 'ClickHouse:master' into zvonand-datetime-ranges 2023-10-26 11:42:13 +02:00
vdimir
12890eb70c
Merge pull request #55806 from canhld94/rocksdb_trivial_count
Support trivial count for rocksdb and storage join
2023-10-26 11:22:38 +02:00
zvonand
0766c73aab Rename date_time_overflow_mode -> date_time_overflow_behavior, moved it to format settings 2023-10-25 23:11:13 +02:00
zvonand
5b86e8c714 updated after review 2023-10-25 23:10:58 +02:00
zvonand
2f3695add8 Introduce setting for dt overflow exception
Added tests and docs
2023-10-25 23:10:24 +02:00
Alexey Milovidov
bb5a60dc19
Merge pull request #55893 from ClickHouse/revert-partial-result-2
Revert "Revert "Revert "Add settings for real-time updates during query execution"""
2023-10-25 22:20:28 +02:00
vdimir
da6f3346fe
Merge pull request #55839 from ClickHouse/vdimir/async_executor_for_dictionary_load
Use AsyncPipelineExecutor all dictionaries
2023-10-24 11:31:36 +02:00
Duc Canh Le
5291cb7790 add document
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-10-24 07:07:47 +00:00
avogar
cfa510ea0a Add more documentation, fix build 2023-10-23 14:38:34 +00:00
Alexey Milovidov
7ec4b99e94 Revert partial result 2023-10-21 03:14:22 +02:00
avogar
9ec43d8cb9 Add basic docs, fix unrelated changes 2023-10-20 21:02:33 +00:00
vdimir
b4851cf2ef
Use AsyncPipelineExecutor for reading clickhouse dictionary source 2023-10-19 15:16:33 +00:00
Alexey Milovidov
f6db0a5261 Merge branch 'master' into morton-utils 2023-10-19 08:11:25 +02:00
Robert Schulze
945dcb865a
Merge pull request #55617 from slvrtrn/mysql-string-blob-vs-text-config
MySQL compatibility: allow to configure String/FixedString BLOB vs TEXT mapping
2023-10-18 10:57:18 +02:00
slvrtrn
c19ca5c4d5 Address PR feedback 2023-10-17 19:19:35 +02:00
Han Fei
4b23142775
Merge branch 'master' into hanfei/statistic 2023-10-17 16:40:31 +02:00
Alexey Milovidov
10d03f18e7 Add docs 2023-10-15 06:44:37 +02:00
slvrtrn
42fc670c22 Add new settings docs entries 2023-10-13 20:56:12 +02:00
Han Fei
42dc61abf5 Merge branch 'master' into hanfei/statistic 2023-10-12 16:19:45 +02:00
JackyWoo
1f553f3d65 Merge branch 'master' into lb_nearest_host_name 2023-10-12 10:19:17 +08:00
Han Fei
253b8efa58 do not modify column type when there is statistic 2023-10-11 16:57:40 +02:00
Robert Schulze
bb637fa9af
Update docs 2023-10-11 14:34:28 +00:00
Alexey Milovidov
186bd9c859
Merge pull request #55243 from den-crane/patch-62
Doc. fix a mistake about refcount
2023-10-07 23:43:16 +02:00
Robert Schulze
2e8cac6e9c
Make use_mysql_types_in_show_columns independent from the connection
Fixes: #55273
2023-10-07 13:06:41 +00:00
JackyWoo
784fe880eb Merge branch 'master' into lb_nearest_host_name 2023-10-07 09:04:26 +08:00
Denny Crane
7e0536e9f5
Update merge-tree-settings.md 2023-10-04 12:22:24 -03:00
Denny Crane
82bb1b1a43
Update merge-tree-settings.md 2023-09-29 15:14:22 -03:00
Denny Crane
55cd909c29
Update merge-tree-settings.md 2023-09-29 15:11:32 -03:00
vdimir
3a9abde35d
Merge pull request #54514 from ClickHouse/vdimir/allow_experimental_partial_result
Add setting allow_experimental_partial_result
2023-09-29 10:32:57 +02:00
Kruglov Pavel
e8d8c6dea5
Merge pull request #55095 from Avogar/print-pretty-type-names
Add setting to print pretty deep nested types like Tuple/Array/Map
2023-09-29 00:20:39 +02:00
avogar
0abf09d1b5 Fix example in docs 2023-09-28 22:17:44 +00:00
avogar
e8ea41e2d4 Add setting to print pretty deep nested Tuples 2023-09-28 22:17:44 +00:00
avogar
e2d7c543eb Don't try to infer numbers from strings in JSON formats by default to avoid parsing errors, add docs for setting input_format_json_try_infer_numbers_from_strings 2023-09-28 22:15:26 +00:00
vdimir
9b001e5092
Add setting allow_experimental_partial_result to doc 2023-09-28 09:40:59 +00:00
JackyWoo
5da03e8ba5 Add load balancing test_hostname_levenshtein_distance 2023-09-27 10:46:39 +08:00
Kruglov Pavel
bea80ab5b7
Merge branch 'master' into json-object-as-tuple-inference 2023-09-26 15:23:08 +02:00
avogar
9e75825515 Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-object-as-tuple-inference 2023-09-25 17:24:36 +00:00
avogar
42ca897f2d Better schema inference for JSON formats 2023-09-25 15:42:59 +00:00
Anton Popov
0ebc22e851
Merge branch 'master' into long-column-names 2023-09-25 16:55:14 +02:00
robot-ch-test-poll3
1334202af4
Merge pull request #54863 from zvonand/zvonand-refactor-globs
Refactor and simplify multi-directory globs
2023-09-22 23:09:05 +02:00
Robert Schulze
be1e92a2ac
Merge pull request #54518 from rschu1ze/split-better
Provide fallback to Python/Spark-like splitting in splitBy*() functions
2023-09-22 12:07:45 +02:00
zvonand
5f67788c03 update docs and comments 2023-09-21 00:16:17 +02:00
SmitaRKulkarni
d8adf05de2
Added a new column _block_number (#47532)
Added a new virtual column _block_number which is persisted on merges when allow_experimental_block_number_column is enabled
2023-09-20 11:31:12 +02:00
Sergei Trifonov
696ab745aa
Doc. Update query-complexity.md 2023-09-20 07:51:27 +02:00
Robert Schulze
774c4b52da
Rework 2023-09-19 12:20:53 +00:00
Kruglov Pavel
acadda1665
Merge branch 'master' into json-object-as-tuple-inference 2023-09-19 13:49:39 +02:00
Robert Schulze
1556cdd21a
Merge pull request #54789 from rschu1ze/docs-qc2
Docs: Update query cache docs about usage in view definitions
2023-09-19 13:32:02 +02:00
robot-clickhouse-ci-1
0be0f43390
Merge pull request #54451 from den-crane/patch-58
Doc. max_execution_time and the role of timeout_before_checking_execution_speed
2023-09-19 12:33:50 +02:00
Robert Schulze
29e83fbe64
Docs: Update query cache docs about usage in view definitions
Cf. https://github.com/ClickHouse/support-escalation/issues/963
2023-09-19 10:26:19 +00:00
Anton Popov
624782bd8f Merge remote-tracking branch 'upstream/master' into HEAD 2023-09-18 23:13:20 +00:00
Anton Popov
d94c1b1ec9 add check for collisions in filenames 2023-09-18 22:27:04 +00:00
Robert Schulze
baf1016e4b
More 2023-09-18 18:39:21 +00:00
Robert Schulze
4ed5b903b4
Docs: remove anchor prefix 2023-09-18 18:35:59 +00:00
Robert Schulze
2a5aa289e8
Implement true Python/Spark split behavior 2023-09-18 07:42:57 +00:00
Robert Schulze
b5b2cc511b
Pythonic vs Spark splitting 2023-09-18 07:42:52 +00:00
Kruglov Pavel
2c407ab3c0
Merge branch 'master' into json-object-as-tuple-inference 2023-09-15 16:29:48 +02:00
Andrey Zvonov
ff16ddbbb3
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-14 11:31:49 +03:00
Alexey Milovidov
df91a55d66
Merge pull request #54501 from alexvanolst/patch-1
Correct default value for parts_to_delay_insert
2023-09-11 21:03:34 +03:00
Alexander van Olst
f9351fdf7b
Correct default value for parts_to_delay_insert 2023-09-11 13:52:14 +02:00
Nikolai Kochetov
9b936c44db
Revert "Revert "Add settings for real-time updates during query execution"" 2023-09-09 12:29:39 +02:00
Alexey Milovidov
03a755732a
Revert "Add settings for real-time updates during query execution" 2023-09-09 03:10:23 +03:00
Denny Crane
9462b58616
Update query-complexity.md 2023-09-08 13:32:24 -03:00
Denny Crane
bb3c6ff682
Update query-complexity.md 2023-09-08 13:30:13 -03:00
Denny Crane
b239d409b1
Update query-complexity.md 2023-09-08 13:28:09 -03:00
Andrey Zvonov
ff4586e663
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-08 18:17:06 +02:00
Andrey Zvonov
4cfd46a0cc
Update settings.md 2023-09-08 17:29:09 +03:00
Nikolai Kochetov
0095124791
Merge pull request #48607 from alexX512/master
Add settings for real-time updates during query execution
2023-09-08 09:05:33 +02:00
avogar
ba307c7466 Allow to infer named Tuples from JSON objects under a setting in JSON formats 2023-09-07 19:41:19 +00:00
zvonand
c36a3fbd39 renamed setting 2023-09-07 12:00:25 +03:00
irenjj
b57e248aab Fix doc spell error. 2023-09-04 20:58:19 +08:00
alexX512
36b8932b37 Merge branch 'master' of github.com:ClickHouse/ClickHouse 2023-08-31 21:40:50 +00:00
Anton Popov
579ec699bf Merge remote-tracking branch 'upstream/master' into HEAD 2023-08-31 12:59:59 +00:00
Robert Schulze
aefb543734
Merge remote-tracking branch 'rschu1ze/master' into feat_markdown 2023-08-31 11:32:44 +00:00
Andrey Zvonov
83405a8808
Merge branch 'master' into zvonand-globs-small-fix 2023-08-31 08:42:48 +02:00
irenjj
277be44250 add test 2023-08-30 22:57:46 +08:00
vdimir
7618b2d112
Add partial_result_update_duration_ms to settings.md 2023-08-30 12:05:04 +02:00
Alexey Gerasimchuck
a1687e618b backward compatibility changes + fixes 2023-08-29 23:50:41 +00:00
irenjj
473ba91c21 Refactor writeAnyMarkdownEscapedString and Add more info into doc. 2023-08-29 23:54:40 +08:00
Alexey Gerasimchuck
de1ed97876 disabled validate_tcp_client_information 2023-08-29 08:59:49 +00:00
Alexey Gerasimchuck
e9757abea6 Added validate_tcp_client_information setting 2023-08-29 00:15:55 +00:00
irenjj
13322f1a90 Remove redundant functions. 2023-08-28 23:54:07 +08:00
irenjj
51aa89eed8 Add a setting to automatically escape special characters in Markdown. 2023-08-28 00:10:33 +08:00
Andrey Zvonov
911bf94fbd
Merge branch 'master' into zvonand-globs-small-fix 2023-08-25 23:50:07 +05:00
Kruglov Pavel
d80be4673b
Merge pull request #53692 from Avogar/cache-count
Cache number of rows in files for count in file/s3/url/hdfs/azure functions
2023-08-25 09:08:52 +02:00
Alexander Tokmakov
cbbb81f5cc
Merge pull request #53405 from canhld94/limit_concurent_background_optimize
Limit number of concurrent background partition optimize
2023-08-24 20:49:38 +03:00
Kruglov Pavel
f7e1abd774
Merge branch 'master' into cache-count 2023-08-23 22:31:49 +02:00
Kruglov Pavel
6e3f2fedbd
Apply suggestions from code review
Co-authored-by: Dmitry Novik <mrnovikd@gmail.com>
2023-08-22 19:05:06 +02:00
Kruglov Pavel
c0bdd0e00b
Merge branch 'master' into cache-count 2023-08-22 14:42:22 +02:00
avogar
b4145aeddc Cache number of rows in files for count in file/s3/url/hdfs/azure functions 2023-08-22 11:59:59 +00:00
Anton Popov
3e9a182555 better interfaces for getting of stream name in part 2023-08-21 13:52:25 +00:00
Kruglov Pavel
88aee95122
Merge branch 'master' into fast-count-from-files 2023-08-21 14:46:33 +02:00
avogar
47304bf7aa Optimize count from files in most input formats 2023-08-21 12:30:52 +00:00
Kruglov Pavel
c68456a20a
Merge pull request #52692 from Avogar/variable-number-of-volumns-more-formats
Allow variable number of columns in more formats, make it work with schema inference
2023-08-21 13:28:35 +02:00
Duc Canh Le
2c07065f81 increase the default value
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-08-21 11:04:24 +00:00
Michael Kolupaev
a1522e22ea
Merge pull request #53281 from Avogar/batch-small-parquet-row-groups
Optimize reading small row groups by batching them together in Parquet
2023-08-18 17:15:42 -07:00
Duc Canh Le
2d353f8c43 Merge branch 'master' into limit_concurent_background_optimize 2023-08-18 09:25:27 +00:00
Anton Popov
b9df41d5e3
Merge pull request #53129 from CurtizJ/non-deterministic-mutations
Allow to execute constant non-deterministic functions in mutations on initiator
2023-08-18 00:26:20 +02:00
Anton Popov
1805dec6ff Merge remote-tracking branch 'upstream/master' into HEAD 2023-08-17 14:09:43 +00:00
Ilya Yatsishin
7115110dad
Update merge-tree-settings.md
parts_to_throw_insert=3000
2023-08-17 15:59:22 +02:00
avogar
bca91548ad Add setting input_format_parquet_local_file_min_bytes_for_seek 2023-08-17 12:28:01 +00:00
zvonand
a8cdc94720 update docs acc to review 2023-08-15 23:42:04 +05:00
Anton Popov
2e22b17d57 add docs and settings randomizations 2023-08-15 00:38:07 +00:00
Anton Popov
5a1265d16d add docs 2023-08-15 00:24:47 +00:00
Duc Canh Le
cd535bea7d limit number of concurrent background partition optimize 2023-08-14 10:21:13 +00:00
zvonand
1983c7ce95 update docs 2023-08-11 16:53:17 +03:00
avogar
7e863a2726 Address comments 2023-08-11 13:17:49 +00:00
Kruglov Pavel
e67c6c2f0a Fix typo 2023-08-11 13:17:49 +00:00
avogar
3ad7e57059 Optimize reading small row groups by batching them together in Parquet 2023-08-11 13:17:45 +00:00
Kruglov Pavel
33a39900ad
Merge branch 'master' into variable-number-of-volumns-more-formats 2023-08-09 19:51:17 +02:00
Justin de Guzman
632e314c11
Add note on settings profiles with ClickHouse Cloud 2023-08-07 19:37:36 -07:00
Sean Haynes
77dd869414
Add ability to log when max_partitions_per_insert_block is reached (#50948)
* Add ability to log when max_partitions_per_insert_block is reached

There's plenty of reasons to drop max_partitions_per_insert_block
down from it's default of 100, with the main one being even touching
remotely close to this number of partitions will create a lot of
merge activity that can de-stabilise a cluster.

This commit adds the ability to log when the above limit is reached
rather than throw an exception, so that you can gauge the impact on
users when dropping this value down.

* Update docs/ru/operations/settings/query-complexity.md

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

* Update docs/ru/operations/settings/query-complexity.md

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

* Update docs/ru/operations/settings/query-complexity.md

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

---------

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>
2023-08-07 23:28:19 +02:00
Alexey Milovidov
6f88fc282b
Merge branch 'master' into count-distinct-if 2023-08-04 19:04:36 +03:00
Alexey Milovidov
e101f2011b
Merge branch 'master' into count-distinct-if 2023-08-03 00:09:52 +03:00
Anton Popov
ff137773e7
Merge branch 'master' into formats-with-subcolumns 2023-08-02 15:24:56 +02:00
Yakov Olkhovskiy
357fee99ff
Merge pull request #52791 from zvonand/zvonand-float-parsing
Add option to switch float parsing methods
2023-08-02 00:23:23 -04:00
Kruglov Pavel
8f6526a930
Merge branch 'master' into structure-to-schema 2023-08-01 16:22:14 +02:00
Alexey Milovidov
4578d43f79
Merge pull request #52656 from Avogar/rename-setting-for-url-encoding
Rename setting disable_url_encoding to enable_url_encoding and add a test
2023-08-01 16:09:01 +03:00
Andrey Zvonov
99cd8f9ba9
Merge branch 'master' into zvonand-float-parsing 2023-07-31 23:43:24 +03:00
flynn
c23893d7c1
Merge branch 'master' into count-distinct-if 2023-07-31 18:53:06 +08:00
Andrey Zvonov
987dd6602a
Update docs/en/operations/settings/settings.md
Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>
2023-07-31 11:08:51 +03:00
Alexey Gerasimchuck
e58b3cfd32 Implemented max sessions for user 2023-07-30 22:09:03 +00:00
zvonand
00a1a9f6bd added docs 2023-07-30 20:59:15 +02:00
Kruglov Pavel
3e1c409e60
Merge branch 'master' into structure-to-schema 2023-07-28 11:32:16 +02:00
flynn
6de5127c0d fix conflict 2023-07-28 07:11:52 +00:00
Jai Jhala
dba8b445bd
Update default output_format_arrow_compression.md
Updates the default parameter of output_format_arrow_compression_method from "none" to "lz4_frame".
2023-07-27 12:32:53 -07:00
avogar
67b0993bdf Add documentation 2023-07-27 18:54:41 +00:00
avogar
6d77d52dfe Allow variable number of columns in TSV/CuatomSeprarated/JSONCompactEachRow, make schema inference work with variable number of columns 2023-07-27 18:02:29 +00:00
avogar
b5fc34b770 Rename setting disable_url_encoding to enable_url_encoding and add a test 2023-07-27 12:20:33 +00:00
Kruglov Pavel
0d34e97dbe
Merge branch 'master' into formats-with-subcolumns 2023-07-26 13:30:35 +02:00
Alexey Milovidov
168b84a592
Merge pull request #52337 from Avogar/no-decode-url
Allow to disable decoding/encoding path in uri in URL engine
2023-07-25 05:43:06 +03:00
flynn
2e61e92c86 update doc 2023-07-23 04:07:18 +00:00
Igor Nikonov
8c8e097b72
Merge pull request #51013 from bigo-sg/grace_hash_join_full_right_202306
Grace hash join support full & right join
2023-07-21 22:22:06 +02:00
avogar
fe934d3059 Make better 2023-07-20 12:38:41 +00:00
Kruglov Pavel
342400d0b3
Merge branch 'master' into revert-52322-revert-51716-bug_fix_csv_field_type_not_match 2023-07-20 12:39:38 +02:00
lgbo-ustc
0ba97eeea5 wip: grace hash join support full & right join 2023-07-20 18:22:01 +08:00
Nikolay Degterinsky
209429d0e3
Merge pull request #49664 from ilejn/test_for_basic_auth_registry
Basic auth to fetch Avro schema in Kafka
2023-07-20 10:58:11 +02:00
avogar
2b8e4ebd4c Allow to disable decoding/encoding path in uri in URL engine 2023-07-19 19:48:39 +00:00
Kruglov Pavel
f0026af189
Revert "Revert "Improve CSVInputFormat to check and set default value to column if deserialize failed"" 2023-07-19 14:51:11 +02:00
Kruglov Pavel
7b3564f96a
Revert "Improve CSVInputFormat to check and set default value to column if deserialize failed" 2023-07-19 14:44:59 +02:00
robot-ch-test-poll4
63d0616a22
Merge pull request #51716 from KevinyhZou/bug_fix_csv_field_type_not_match
Improve CSVInputFormat to check and set default value to column if deserialize failed
2023-07-19 14:41:05 +02:00
kevinyhzou
dcf7ba2534 remove unuseful code 2023-07-19 19:36:19 +08:00
kevinyhzou
94796f28ad ci fix 2023-07-19 19:24:16 +08:00
kevinyhzou
95424177d5 review fix 2023-07-19 18:26:54 +08:00
Ilya Golshtein
c550a532e6 test_for_basic_auth_registry - black formatter happy + some doc 2023-07-19 08:32:45 +00:00
Kruglov Pavel
d3d0f101f7
Merge branch 'master' into full-filename-placeholder 2023-07-17 19:14:10 +02:00
Kruglov Pavel
1dd05319b5
Merge branch 'master' into formats-with-subcolumns 2023-07-17 19:13:42 +02:00
kevinyhzou
355faa4251 ci fix 2023-07-17 20:08:32 +08:00
robot-ch-test-poll4
036fb1fc9b
Merge pull request #52041 from ClickHouse/docs-organize-user-profiles
Docs organize user setting profiles
2023-07-17 12:03:06 +02:00
robot-clickhouse-ci-2
ac3cc1c2ff
Merge pull request #45671 from ClibMouse/feature/interval-kql-style-formatting
Implement KQL-style formatting for Interval
2023-07-16 04:06:54 +02:00
kevinyhzou
b2665031dc review fix 2023-07-13 20:27:14 +08:00
kevinyhzou
ba57c84db3 bug fix csv input field type mismatch 2023-07-13 20:24:10 +08:00
Dan Roscigno
7756620f15
Merge branch 'master' into docs-organize-user-profiles 2023-07-11 17:59:48 -04:00
DanRoscigno
46fd88dca4 add session setting 2023-07-11 17:50:52 -04:00
DanRoscigno
6086787957 add overview 2023-07-11 16:59:16 -04:00
DanRoscigno
bea58a2780 Docs: added two methods for user profile 2023-07-10 17:21:37 -04:00
Alexey Milovidov
c2514279e4 Update settings.md 2023-07-10 13:51:49 -04:00
ltrk2
2d2debe3ce Introduce a separate setting for interval output formatting 2023-07-10 13:51:49 -04:00
ltrk2
b673aa8e6b Use the dialect configuration 2023-07-10 13:51:49 -04:00
ltrk2
522b9ebf8c Implement KQL-style formatting for Interval 2023-07-10 13:51:49 -04:00
Dmitry Kardymon
385a210fee Merge remote-tracking branch 'origin/master' into ADQM-870 2023-07-10 13:19:21 +00:00
Alexey Milovidov
b1d1918607
Merge branch 'master' into retry 2023-07-08 03:08:48 +03:00
Slach
0bd16d47be fix documentation insconsistency about additional_tables_filter during reproduce https://github.com/ClickHouse/ClickHouse/issues/51948
Signed-off-by: Slach <bloodjazman@gmail.com>
2023-07-07 19:44:20 +05:00
Kruglov Pavel
06de25451a
Merge branch 'master' into formats-with-subcolumns 2023-07-06 16:21:52 +02:00
Dmitry Kardymon
32f5a78302 Fix setting name 2023-07-06 07:32:46 +00:00
Dmitry Kardymon
24b5c9c204 Use one setting input_format_csv_allow_variable_number_of_colums and code in RowInput 2023-07-06 06:05:43 +00:00
Kruglov Pavel
a2805f8f44
Merge branch 'master' into formats-with-subcolumns 2023-07-04 23:27:03 +02:00
avogar
3dc4ff1760 Remove obsolete settings 2023-07-04 21:21:22 +00:00
Dmitry Kardymon
ab4142eb8f Merge remote-tracking branch 'clickhouse/master' into ADQM-870 2023-07-04 08:23:31 +03:00
Alexander Tokmakov
1e10bf5bdf Update docs/en/operations/settings/settings.md 2023-07-03 19:10:39 +03:00
velavokr
66227ce8d3 #51292 added default_temporary_table_engine setting 2023-07-03 19:10:39 +03:00
Kruglov Pavel
400e7313f0
Merge branch 'master' into full-filename-placeholder 2023-06-30 14:38:18 +02:00
Denny Crane
6ec85f9faa
Update settings.md 2023-06-29 11:06:28 -03:00
avogar
ebeef65920 Add placeholder for rull filename in rename_files_after_processing setting 2023-06-29 13:35:27 +00:00
Alexey Milovidov
cca3f9937c
Merge branch 'master' into retry 2023-06-24 22:29:17 +03:00
Michael Kolupaev
4a570a05c9 Decrease default timeouts for S3 and HTTP requests 2023-06-21 18:08:50 +00:00
Andrey Zvonov
b4f2e4020d
Merge branch 'master' into zvonand-implicit-tz 2023-06-21 13:41:35 +02:00
Dmitry Kardymon
fff0c8da92 Merge remote-tracking branch 'origin/master' into ADQM-870 2023-06-21 10:56:50 +00:00
Denny Crane
d5946da5f8
Update settings.md 2023-06-20 13:31:11 -03:00
Andrey Zvonov
07191ce10d
Merge branch 'master' into zvonand-implicit-tz 2023-06-20 00:24:53 +02:00
Dmitry Kardymon
dd43a186ad Minor edit docs / add int256 test 2023-06-19 09:51:29 +00:00
Dmitry Kardymon
30bea857fd Merge remote-tracking branch 'origin/master' into ADQM-870 2023-06-19 07:19:07 +00:00
Kruglov Pavel
1f47bb7716
Fix docs 2023-06-16 13:45:46 +02:00
Kruglov Pavel
f8ddfb1fd8
Merge branch 'master' into allow-skip-empty-files 2023-06-16 13:23:41 +02:00
Robert Schulze
0e6ec3e21f
Update settings.md 2023-06-16 11:44:47 +02:00
Robert Schulze
a622f1b16c
Update settings.md 2023-06-16 11:42:58 +02:00
Robert Schulze
2cca632e83
Update settings.md 2023-06-16 11:42:22 +02:00
Robert Schulze
d745180ef6
Update settings.md 2023-06-16 11:41:08 +02:00
zvonand
4155d13d69 merge master and resolve conflict 2023-06-16 02:20:32 +02:00
zvonand
e60506f41b changes requested in review 2023-06-16 02:16:04 +02:00
Dmitry Kardymon
806176d88e Add input_format_csv_missing_as_default setting and tests 2023-06-15 11:23:08 +00:00
KevinyhZou
953f40aa3b
Merge branch 'master' into bug_fix_csv_parse_by_tab_delimiter 2023-06-15 10:25:19 +08:00
Dmitry Kardymon
a91fc3ddb3 Add docs/ add more cases in test 2023-06-14 16:44:31 +00:00
kevinyhzou
f3b99156ac review fix 2023-06-14 10:48:21 +08:00
Kruglov Pavel
39ba925f8b
Merge branch 'master' into allow-skip-empty-files 2023-06-13 17:17:26 +02:00
Kruglov Pavel
607f337d67
Merge pull request #50592 from Avogar/max-bytes-to-read-in-schema-inference
Add setting to limit the number of bytes to read in schema inference
2023-06-13 16:47:57 +02:00
avogar
2e1f56ae33 Address comments 2023-06-13 14:43:50 +00:00
Kruglov Pavel
cbed327077
Merge pull request #50635 from Avogar/skip-trailing-empty-lines
Allow to skip trailing empty lines in CSV/TSV/CustomSeparated formats
2023-06-13 12:43:43 +02:00
Kruglov Pavel
e4838725e3
Merge branch 'master' into allow-skip-empty-files 2023-06-12 20:03:23 +02:00
Denny Crane
07eb7b7d66
Update settings.md 2023-06-12 11:03:50 -03:00
Kruglov Pavel
873cee9451
Merge pull request #49626 from alekseygolub/renamefile
Added option to rename files, loaded via TableFunctionFile, after successful processing
2023-06-12 15:01:22 +02:00
Kruglov Pavel
edd47a2281
Merge branch 'master' into skip-trailing-empty-lines 2023-06-12 13:57:15 +02:00
Kruglov Pavel
da68980b8d
Merge branch 'master' into max-bytes-to-read-in-schema-inference 2023-06-12 13:45:31 +02:00
kevinyhzou
911f8ad8dc use whitespace or tab as field delimiter 2023-06-12 11:57:52 +08:00
Nikolai Kochetov
e0277b071b
Merge pull request #50699 from ClickHouse/vdimir/revert_grace_join_changed
Revert recent grace hash join changes
2023-06-09 17:56:52 +02:00
robot-ch-test-poll
d0f031660b
Merge pull request #50646 from DerekChia/patch-2
Update settings.md
2023-06-08 17:47:09 +02:00
Andrey Zvonov
d95be4162f
Merge branch 'master' into zvonand-implicit-tz 2023-06-08 18:34:45 +03:00
zvonand
4d4e5c690e update docs spelling check failed 2023-06-08 17:10:51 +02:00
Kruglov Pavel
a714c1662e
Merge branch 'master' into max-bytes-to-read-in-schema-inference 2023-06-08 12:55:31 +02:00
Kruglov Pavel
dc24599525
Merge branch 'master' into skip-trailing-empty-lines 2023-06-08 12:39:23 +02:00
Kruglov Pavel
bf28074d32
Merge branch 'master' into allow-skip-empty-files 2023-06-08 12:36:18 +02:00
vdimir
f0a1c8afa2
Revert "Merge pull request #49483 from bigo-sg/grace_hash_full_join"
This reverts commit fa93c388b1, reversing
changes made to a2c0a65344.
2023-06-08 09:40:41 +00:00
Derek Chia
286f3b247b
Update settings.md 2023-06-08 11:28:44 +08:00
Derek Chia
f3959aa9e1
Update settings.md
`max_final_threads` is now set to the number of cores by default. See https://github.com/ClickHouse/ClickHouse/pull/47915
2023-06-07 11:07:16 +08:00
Boris Kuschel
f552b96451 Add docs for ignore index 2023-06-06 19:08:42 -04:00
Kruglov Pavel
1baa6404e6
Merge branch 'master' into skip-trailing-empty-lines 2023-06-06 19:39:34 +02:00
Kruglov Pavel
b83b057045
Merge branch 'master' into renamefile 2023-06-06 19:38:05 +02:00
avogar
df50833b70 Allow to skip trailing empty lines in CSV/TSV/CustomeSeparated formats 2023-06-06 17:33:05 +00:00
Kruglov Pavel
af880a6f3b
Merge branch 'master' into max-bytes-to-read-in-schema-inference 2023-06-06 14:47:58 +02:00
avogar
33e51d4f3b Add setting to limit the number of bytes to read in schema inference 2023-06-05 15:22:04 +00:00
Alexey Milovidov
3617a14467
Merge pull request #50215 from arenadata/ADQM-830
Added --input_format_csv_trim_whitespaces option
2023-06-05 06:06:45 +03:00
Alexey Gerasimchuk
9958731c27
Merge branch 'master' into ADQM-830 2023-06-05 07:46:47 +10:00
DanRoscigno
9b89751948 add docs for parallel view processing 2023-06-02 12:52:06 -04:00
Dan Roscigno
fb11f7eb6f
Merge pull request #50478 from DanRoscigno/user-settings-docs
move from server to user settings
2023-06-02 10:56:28 -04:00
Robert Schulze
54872f9e7e
Typos: Follow-up to #50476 2023-06-02 13:28:09 +00:00
DanRoscigno
079008058a move from server to user settings 2023-06-02 08:49:26 -04:00
Robert Schulze
a22bb07fbd
Merge remote-tracking branch 'rschu1ze/master' into fix-typo-check-on-nested-docs 2023-06-02 12:33:16 +00:00
Robert Schulze
65cc92a78d
CI: Fix aspell on nested docs 2023-06-02 12:24:41 +00:00
Kruglov Pavel
9922053419
Merge pull request #49948 from Avogar/handshake-timeout
Add separate handshake_timeout for receiving Hello packet from replica
2023-06-02 14:07:27 +02:00
Andrey Zvonov
2e427ee028
Merge branch 'master' into zvonand-implicit-tz 2023-06-02 01:15:56 +03:00
Robert Schulze
45b1fcdeda
Merge pull request #50315 from arenadata/ADQM-810
Add new function toLastDayOfWeek()
2023-06-01 16:19:14 +02:00
avogar
0b62be649f Add docs, fix style 2023-05-31 17:52:29 +00:00
Kruglov Pavel
4d1b5cc89f
Merge branch 'master' into renamefile 2023-05-31 13:25:11 +02:00
Alexey Gerasimchuk
44ba35d2c1
Merge branch 'master' into ADQM-830 2023-05-31 15:07:37 +10:00
Dan Roscigno
cfa3fbf5b8
add .md extensions 2023-05-30 12:06:27 -04:00
Denny Crane
060d0118d7
Update merge-tree-settings.md 2023-05-30 12:08:24 -03:00
Kruglov Pavel
f863dee8e7
Merge branch 'master' into renamefile 2023-05-30 12:26:40 +02:00
Andrey Zvonov
87fc780c14
Merge branch 'master' into zvonand-implicit-tz 2023-05-30 13:13:46 +03:00
Victor Krasnov
9a8086a377 Reorder toLastDayOf* functions in settings.md 2023-05-29 22:12:44 +00:00
alekseygolub
63225b37a2
Merge branch 'ClickHouse:master' into renamefile 2023-05-29 16:52:41 +03:00
Victor Krasnov
0ad5b9f598 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-810-dev 2023-05-29 08:26:26 +00:00
Nikolay Degterinsky
c57fa9d496
Docs: Add PostgreSQL and ODBC related settings 2023-05-26 16:50:43 +02:00
alekseygolub
36e8f13242 Added docs for feature 2023-05-25 20:10:02 +00:00
Alexey Gerasimchuck
4eb944fef1 minor changes in documentation 2023-05-25 08:05:11 +00:00
Alexey Gerasimchuck
75791d7a63 Added input_format_csv_trim_whitespaces parameter 2023-05-25 07:51:32 +00:00
DanRoscigno
d4927e4fe5 add docs 2023-05-24 10:51:43 -04:00
Victor Krasnov
99a7967f11 Amend the dicumentation with regard to toLastDayOfWeek 2023-05-24 11:58:39 +00:00
Victor Krasnov
3bce2bbc37 Fix settings.md in regard to enable_extended_results_for_datetime_functions 2023-05-24 11:40:41 +00:00
avogar
3c1aeaaa79 Change default value of handshake_timeout to 10 sec, fix possible use-after-free 2023-05-23 11:39:40 +00:00
Kruglov Pavel
136c3caf03
Merge branch 'master' into handshake-timeout 2023-05-23 11:53:54 +02:00
lgbo-ustc
cc93f9ab52 update tests for flaky test 2023-05-22 10:17:41 +08:00
Yusuke Tanaka
2444e93ad7
Fix broken link to async_insert_deduplicate in doc 2023-05-21 14:42:17 +09:00