Commit Graph

1635 Commits

Author SHA1 Message Date
hdhoang
fc8292182c
fix typo TKSV
correct name is TS-KV
2023-12-07 20:19:00 +07:00
Sema Checherinda
c61cd6aab2
Merge pull request #57335 from sichenzhao/increase_default_replicated_deduplication_window
increase default replicated_deduplication_window from 100 to 1k
2023-12-02 21:23:39 +01:00
Sichen Zhao
1b8b1c0a63 increase default replicated_deduplication_window from 100 to 1k 2023-11-28 14:24:06 -08:00
Han Fei
7bd2ea3add Merge branch 'master' into hanfei/statistic 2023-11-27 23:31:23 +01:00
Robert Schulze
ca63881357
Mention that the settings are dev settings 2023-11-24 14:46:02 +00:00
vdimir
1044e3366b
Update http_make_head_request doc 2023-11-24 09:32:20 +00:00
Tim Windelschmidt
51e3899f73
Add setting http_make_head_request
Clickhouse always does a HEAD request before actually executing the GET request,
this adds a settings to skip that request.
2023-11-24 09:32:16 +00:00
Robert Schulze
a8a3214185
+ documentation 2023-11-23 19:43:40 +00:00
avogar
f537bad469 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-11-20 14:32:50 +00:00
avogar
872556a5d4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-11-20 14:03:36 +00:00
Sema Checherinda
f999337dae
Revert "Revert "s3 adaptive timeouts"" 2023-11-20 14:53:22 +01:00
Alexander Tokmakov
5031f239c3
Revert "s3 adaptive timeouts" 2023-11-20 14:28:59 +01:00
Sema Checherinda
a950595c24
Merge pull request #56314 from CheSema/s3-aggressive-timeouts
s3 adaptive timeouts
2023-11-19 14:12:14 +01:00
Justin de Guzman
96e87322b5
[Docs] Add insert_distributed_sync to Core Settings docs 2023-11-18 18:10:43 -08:00
Alexey Milovidov
0158db3e07
Merge pull request #56092 from ClickHouse/docs-max-block-size
Set correct default `max_block_size` value in docs
2023-11-18 17:23:43 +01:00
Kruglov Pavel
8e88bf1348 Revert "Revert "Add a setting max_execution_time_leaf to limit the execution time on shard for distributed query"" 2023-11-14 11:40:48 +00:00
Sema Checherinda
76d11687a7 adjuct docs 2023-11-14 11:34:12 +01:00
Sema Checherinda
e0edd165da add doc 2023-11-14 11:34:12 +01:00
Robert Schulze
361a3ca11f
Merge pull request #56519 from rschu1ze/qc-ignore-nondeterministic-queries
Query cache: Allow to ignore non-deterministic queries
2023-11-13 21:32:44 +01:00
Alexander Tokmakov
0622379ec7
Revert "Add a setting max_execution_time_leaf to limit the execution time on shard for distributed query" 2023-11-13 21:11:07 +01:00
Robert Schulze
7864df4826
Update docs + Try to stabilize test results, pt. II 2023-11-13 10:57:33 +00:00
Robert Schulze
91f53514d9
Incorporate review feedback 2023-11-12 15:11:38 +00:00
Robert Schulze
52c825db44
Query cache: Allow to ignore non-deterministic queries
Fixes: #56504
2023-11-12 15:11:38 +00:00
Yarik Briukhovetskyi
b8ea31db43
Merge pull request #56309 from yariks5s/preferred_optimize_projection_name
New setting preferred_projection_name
2023-11-08 18:06:03 +01:00
Sema Checherinda
02df5ac59c
Merge pull request #54340 from KevinyhZou/bug_fix_csv_parse_crlf
Fix CSV read while the end of line is CR(\r)
2023-11-07 12:51:05 +01:00
Sema Checherinda
a5e17dc919
Merge pull request #55566 from CheSema/remote-blobs-naming
feature: storage_metadata_write_full_object_key
2023-11-06 16:41:49 +01:00
kevinyhzou
2a50daf5dd Allow cr at end of csv line 2023-11-06 12:21:42 +08:00
kevinyhzou
ef30e6723d bug fix csv read while end of line is not crlf 2023-11-06 12:21:42 +08:00
Robert Schulze
049c811a38
Make type names in SHOW COLUMNS dependent only on connection type 2023-11-05 21:20:20 +00:00
yariks5s
d95262622b init 2023-11-03 16:47:06 +00:00
Denny Crane
dbaebe18f1
Update settings.md 2023-11-03 13:14:56 -03:00
Denny Crane
9dbd229462
Update settings.md 2023-11-03 13:09:51 -03:00
Kruglov Pavel
81b1ca22bb
Merge pull request #51823 from canhld94/ch_add_max_execution_time_leaf
Add a setting max_execution_time_leaf to limit the execution time on shard for distributed query
2023-11-03 13:31:15 +01:00
Duc Canh Le
dd6b02a2fd add document
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-11-03 03:00:13 +00:00
Sema Checherinda
90b64bcdb9 backward compatibility and implementation feature storage_metadata_write_full_object_key 2023-11-02 15:20:55 +01:00
Alexey Milovidov
1267246785
Merge pull request #55642 from ClickHouse/morton-utils
Indexing by space-filling curves
2023-11-02 12:21:33 +01:00
robot-ch-test-poll1
a5fb7b0a1e
Merge pull request #56213 from ttanay/sort-spill-to-disk-docs
Add `max_bytes_before_external_sort` setting to query complexity doc
2023-11-02 00:50:30 +01:00
Tanay Tummalapalli
6a3b2a04d8 Add max_bytes_before_external_sort setting to query complexity doc
The setting should be mentioned here along with
`max_bytes_before_external_group_by` setting.

Note: The russian translation is courtesy of Google Translate.
2023-11-01 22:33:25 +05:30
Azat Khuzhin
c25d6cd624
Rename directory monitor concept into background INSERT (#55978)
* Limit log frequence for "Skipping send data over distributed table" message

After SYSTEM STOP DISTRIBUTED SENDS it will constantly print this
message.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename directory monitor concept into async INSERT

Rename the following query settings (with preserving backward
compatiblity, by keeping old name as an alias):
- distributed_directory_monitor_sleep_time_ms -> distributed_async_insert_sleep_time_ms
- distributed_directory_monitor_max_sleep_time_ms -> distributed_async_insert_max_sleep_time_ms
- distributed_directory_monitor_batch -> distributed_async_insert_batch_inserts
- distributed_directory_monitor_split_batch_on_failure -> distributed_async_insert_split_batch_on_failure

Rename the following table settings (with preserving backward
compatiblity, by keeping old name as an alias):
- monitor_batch_inserts -> async_insert_batch
- monitor_split_batch_on_failure -> async_insert_split_batch_on_failure
- directory_monitor_sleep_time_ms -> async_insert_sleep_time_ms
- directory_monitor_max_sleep_time_ms -> async_insert_max_sleep_time_ms

And also update all the references:

    $ gg -e directory_monitor_ -e monitor_ tests docs | cut -d: -f1 | sort -u | xargs sed -e 's/distributed_directory_monitor_sleep_time_ms/distributed_async_insert_sleep_time_ms/g' -e 's/distributed_directory_monitor_max_sleep_time_ms/distributed_async_insert_max_sleep_time_ms/g' -e 's/distributed_directory_monitor_batch_inserts/distributed_async_insert_batch/g' -e 's/distributed_directory_monitor_split_batch_on_failure/distributed_async_insert_split_batch_on_failure/g' -e 's/monitor_batch_inserts/async_insert_batch/g' -e 's/monitor_split_batch_on_failure/async_insert_split_batch_on_failure/g' -e 's/monitor_sleep_time_ms/async_insert_sleep_time_ms/g' -e 's/monitor_max_sleep_time_ms/async_insert_max_sleep_time_ms/g' -i

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename async_insert for Distributed into background_insert

This will avoid amigibuity between general async INSERT's and INSERT
into Distributed, which are indeed background, so new term express it
even better.

Mostly done with:

    $ git di HEAD^ --name-only | xargs sed -i -e 's/distributed_async_insert/distributed_background_insert/g' -e 's/async_insert_batch/background_insert_batch/g' -e 's/async_insert_split_batch_on_failure/background_insert_split_batch_on_failure/g' -e 's/async_insert_sleep_time_ms/background_insert_sleep_time_ms/g' -e 's/async_insert_max_sleep_time_ms/background_insert_max_sleep_time_ms/g'

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Mark 02417_opentelemetry_insert_on_distributed_table as long

CI: https://s3.amazonaws.com/clickhouse-test-reports/55978/7a6abb03a0b507e29e999cb7e04f246a119c6f28/stateless_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-01 15:09:39 +01:00
Alexey Milovidov
016285ea87
Merge branch 'master' into morton-utils 2023-10-31 01:47:16 +01:00
yariks5s
0846714052 added docs, changed tests 2023-10-30 17:17:53 +00:00
Han Fei
19cdc6dfe2 Merge branch 'master' into hanfei/statistic 2023-10-30 04:53:18 +01:00
Justin de Guzman
940d099e84
Set correct max_block_size value in docs 2023-10-27 16:50:34 -07:00
Kruglov Pavel
bb4b95e891
Merge branch 'master' into schema-inference-union 2023-10-27 14:53:58 +02:00
zvonand
35baf7792d cleanup after rebase, add [[unlikely]] 2023-10-26 23:56:45 +02:00
Kruglov Pavel
570b66f027
Merge branch 'master' into schema-inference-union 2023-10-26 19:26:00 +02:00
Andrey Zvonov
5737369d0b
Merge branch 'ClickHouse:master' into zvonand-datetime-ranges 2023-10-26 11:42:13 +02:00
vdimir
12890eb70c
Merge pull request #55806 from canhld94/rocksdb_trivial_count
Support trivial count for rocksdb and storage join
2023-10-26 11:22:38 +02:00
zvonand
0766c73aab Rename date_time_overflow_mode -> date_time_overflow_behavior, moved it to format settings 2023-10-25 23:11:13 +02:00
zvonand
5b86e8c714 updated after review 2023-10-25 23:10:58 +02:00
zvonand
2f3695add8 Introduce setting for dt overflow exception
Added tests and docs
2023-10-25 23:10:24 +02:00
Alexey Milovidov
bb5a60dc19
Merge pull request #55893 from ClickHouse/revert-partial-result-2
Revert "Revert "Revert "Add settings for real-time updates during query execution"""
2023-10-25 22:20:28 +02:00
vdimir
da6f3346fe
Merge pull request #55839 from ClickHouse/vdimir/async_executor_for_dictionary_load
Use AsyncPipelineExecutor all dictionaries
2023-10-24 11:31:36 +02:00
Duc Canh Le
5291cb7790 add document
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-10-24 07:07:47 +00:00
avogar
cfa510ea0a Add more documentation, fix build 2023-10-23 14:38:34 +00:00
Alexey Milovidov
7ec4b99e94 Revert partial result 2023-10-21 03:14:22 +02:00
avogar
9ec43d8cb9 Add basic docs, fix unrelated changes 2023-10-20 21:02:33 +00:00
vdimir
b4851cf2ef
Use AsyncPipelineExecutor for reading clickhouse dictionary source 2023-10-19 15:16:33 +00:00
Alexey Milovidov
f6db0a5261 Merge branch 'master' into morton-utils 2023-10-19 08:11:25 +02:00
Robert Schulze
945dcb865a
Merge pull request #55617 from slvrtrn/mysql-string-blob-vs-text-config
MySQL compatibility: allow to configure String/FixedString BLOB vs TEXT mapping
2023-10-18 10:57:18 +02:00
slvrtrn
c19ca5c4d5 Address PR feedback 2023-10-17 19:19:35 +02:00
Han Fei
4b23142775
Merge branch 'master' into hanfei/statistic 2023-10-17 16:40:31 +02:00
Alexey Milovidov
10d03f18e7 Add docs 2023-10-15 06:44:37 +02:00
slvrtrn
42fc670c22 Add new settings docs entries 2023-10-13 20:56:12 +02:00
Han Fei
42dc61abf5 Merge branch 'master' into hanfei/statistic 2023-10-12 16:19:45 +02:00
JackyWoo
1f553f3d65 Merge branch 'master' into lb_nearest_host_name 2023-10-12 10:19:17 +08:00
Han Fei
253b8efa58 do not modify column type when there is statistic 2023-10-11 16:57:40 +02:00
Robert Schulze
bb637fa9af
Update docs 2023-10-11 14:34:28 +00:00
Alexey Milovidov
186bd9c859
Merge pull request #55243 from den-crane/patch-62
Doc. fix a mistake about refcount
2023-10-07 23:43:16 +02:00
Robert Schulze
2e8cac6e9c
Make use_mysql_types_in_show_columns independent from the connection
Fixes: #55273
2023-10-07 13:06:41 +00:00
JackyWoo
784fe880eb Merge branch 'master' into lb_nearest_host_name 2023-10-07 09:04:26 +08:00
Denny Crane
7e0536e9f5
Update merge-tree-settings.md 2023-10-04 12:22:24 -03:00
Denny Crane
82bb1b1a43
Update merge-tree-settings.md 2023-09-29 15:14:22 -03:00
Denny Crane
55cd909c29
Update merge-tree-settings.md 2023-09-29 15:11:32 -03:00
vdimir
3a9abde35d
Merge pull request #54514 from ClickHouse/vdimir/allow_experimental_partial_result
Add setting allow_experimental_partial_result
2023-09-29 10:32:57 +02:00
Kruglov Pavel
e8d8c6dea5
Merge pull request #55095 from Avogar/print-pretty-type-names
Add setting to print pretty deep nested types like Tuple/Array/Map
2023-09-29 00:20:39 +02:00
avogar
0abf09d1b5 Fix example in docs 2023-09-28 22:17:44 +00:00
avogar
e8ea41e2d4 Add setting to print pretty deep nested Tuples 2023-09-28 22:17:44 +00:00
avogar
e2d7c543eb Don't try to infer numbers from strings in JSON formats by default to avoid parsing errors, add docs for setting input_format_json_try_infer_numbers_from_strings 2023-09-28 22:15:26 +00:00
vdimir
9b001e5092
Add setting allow_experimental_partial_result to doc 2023-09-28 09:40:59 +00:00
JackyWoo
5da03e8ba5 Add load balancing test_hostname_levenshtein_distance 2023-09-27 10:46:39 +08:00
Kruglov Pavel
bea80ab5b7
Merge branch 'master' into json-object-as-tuple-inference 2023-09-26 15:23:08 +02:00
avogar
9e75825515 Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-object-as-tuple-inference 2023-09-25 17:24:36 +00:00
avogar
42ca897f2d Better schema inference for JSON formats 2023-09-25 15:42:59 +00:00
Anton Popov
0ebc22e851
Merge branch 'master' into long-column-names 2023-09-25 16:55:14 +02:00
robot-ch-test-poll3
1334202af4
Merge pull request #54863 from zvonand/zvonand-refactor-globs
Refactor and simplify multi-directory globs
2023-09-22 23:09:05 +02:00
Robert Schulze
be1e92a2ac
Merge pull request #54518 from rschu1ze/split-better
Provide fallback to Python/Spark-like splitting in splitBy*() functions
2023-09-22 12:07:45 +02:00
zvonand
5f67788c03 update docs and comments 2023-09-21 00:16:17 +02:00
SmitaRKulkarni
d8adf05de2
Added a new column _block_number (#47532)
Added a new virtual column _block_number which is persisted on merges when allow_experimental_block_number_column is enabled
2023-09-20 11:31:12 +02:00
Sergei Trifonov
696ab745aa
Doc. Update query-complexity.md 2023-09-20 07:51:27 +02:00
Robert Schulze
774c4b52da
Rework 2023-09-19 12:20:53 +00:00
Kruglov Pavel
acadda1665
Merge branch 'master' into json-object-as-tuple-inference 2023-09-19 13:49:39 +02:00
Robert Schulze
1556cdd21a
Merge pull request #54789 from rschu1ze/docs-qc2
Docs: Update query cache docs about usage in view definitions
2023-09-19 13:32:02 +02:00
robot-clickhouse-ci-1
0be0f43390
Merge pull request #54451 from den-crane/patch-58
Doc. max_execution_time and the role of timeout_before_checking_execution_speed
2023-09-19 12:33:50 +02:00
Robert Schulze
29e83fbe64
Docs: Update query cache docs about usage in view definitions
Cf. https://github.com/ClickHouse/support-escalation/issues/963
2023-09-19 10:26:19 +00:00
Anton Popov
624782bd8f Merge remote-tracking branch 'upstream/master' into HEAD 2023-09-18 23:13:20 +00:00
Anton Popov
d94c1b1ec9 add check for collisions in filenames 2023-09-18 22:27:04 +00:00
Robert Schulze
baf1016e4b
More 2023-09-18 18:39:21 +00:00
Robert Schulze
4ed5b903b4
Docs: remove anchor prefix 2023-09-18 18:35:59 +00:00
Robert Schulze
2a5aa289e8
Implement true Python/Spark split behavior 2023-09-18 07:42:57 +00:00
Robert Schulze
b5b2cc511b
Pythonic vs Spark splitting 2023-09-18 07:42:52 +00:00
Kruglov Pavel
2c407ab3c0
Merge branch 'master' into json-object-as-tuple-inference 2023-09-15 16:29:48 +02:00
Andrey Zvonov
ff16ddbbb3
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-14 11:31:49 +03:00
Alexey Milovidov
df91a55d66
Merge pull request #54501 from alexvanolst/patch-1
Correct default value for parts_to_delay_insert
2023-09-11 21:03:34 +03:00
Alexander van Olst
f9351fdf7b
Correct default value for parts_to_delay_insert 2023-09-11 13:52:14 +02:00
Nikolai Kochetov
9b936c44db
Revert "Revert "Add settings for real-time updates during query execution"" 2023-09-09 12:29:39 +02:00
Alexey Milovidov
03a755732a
Revert "Add settings for real-time updates during query execution" 2023-09-09 03:10:23 +03:00
Denny Crane
9462b58616
Update query-complexity.md 2023-09-08 13:32:24 -03:00
Denny Crane
bb3c6ff682
Update query-complexity.md 2023-09-08 13:30:13 -03:00
Denny Crane
b239d409b1
Update query-complexity.md 2023-09-08 13:28:09 -03:00
Andrey Zvonov
ff4586e663
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-08 18:17:06 +02:00
Andrey Zvonov
4cfd46a0cc
Update settings.md 2023-09-08 17:29:09 +03:00
Nikolai Kochetov
0095124791
Merge pull request #48607 from alexX512/master
Add settings for real-time updates during query execution
2023-09-08 09:05:33 +02:00
avogar
ba307c7466 Allow to infer named Tuples from JSON objects under a setting in JSON formats 2023-09-07 19:41:19 +00:00
zvonand
c36a3fbd39 renamed setting 2023-09-07 12:00:25 +03:00
irenjj
b57e248aab Fix doc spell error. 2023-09-04 20:58:19 +08:00
alexX512
36b8932b37 Merge branch 'master' of github.com:ClickHouse/ClickHouse 2023-08-31 21:40:50 +00:00
Anton Popov
579ec699bf Merge remote-tracking branch 'upstream/master' into HEAD 2023-08-31 12:59:59 +00:00
Robert Schulze
aefb543734
Merge remote-tracking branch 'rschu1ze/master' into feat_markdown 2023-08-31 11:32:44 +00:00
Andrey Zvonov
83405a8808
Merge branch 'master' into zvonand-globs-small-fix 2023-08-31 08:42:48 +02:00
irenjj
277be44250 add test 2023-08-30 22:57:46 +08:00
vdimir
7618b2d112
Add partial_result_update_duration_ms to settings.md 2023-08-30 12:05:04 +02:00
Alexey Gerasimchuck
a1687e618b backward compatibility changes + fixes 2023-08-29 23:50:41 +00:00
irenjj
473ba91c21 Refactor writeAnyMarkdownEscapedString and Add more info into doc. 2023-08-29 23:54:40 +08:00
Alexey Gerasimchuck
de1ed97876 disabled validate_tcp_client_information 2023-08-29 08:59:49 +00:00
Alexey Gerasimchuck
e9757abea6 Added validate_tcp_client_information setting 2023-08-29 00:15:55 +00:00
irenjj
13322f1a90 Remove redundant functions. 2023-08-28 23:54:07 +08:00
irenjj
51aa89eed8 Add a setting to automatically escape special characters in Markdown. 2023-08-28 00:10:33 +08:00
Andrey Zvonov
911bf94fbd
Merge branch 'master' into zvonand-globs-small-fix 2023-08-25 23:50:07 +05:00
Kruglov Pavel
d80be4673b
Merge pull request #53692 from Avogar/cache-count
Cache number of rows in files for count in file/s3/url/hdfs/azure functions
2023-08-25 09:08:52 +02:00
Alexander Tokmakov
cbbb81f5cc
Merge pull request #53405 from canhld94/limit_concurent_background_optimize
Limit number of concurrent background partition optimize
2023-08-24 20:49:38 +03:00
Kruglov Pavel
f7e1abd774
Merge branch 'master' into cache-count 2023-08-23 22:31:49 +02:00
Kruglov Pavel
6e3f2fedbd
Apply suggestions from code review
Co-authored-by: Dmitry Novik <mrnovikd@gmail.com>
2023-08-22 19:05:06 +02:00
Kruglov Pavel
c0bdd0e00b
Merge branch 'master' into cache-count 2023-08-22 14:42:22 +02:00
avogar
b4145aeddc Cache number of rows in files for count in file/s3/url/hdfs/azure functions 2023-08-22 11:59:59 +00:00
Anton Popov
3e9a182555 better interfaces for getting of stream name in part 2023-08-21 13:52:25 +00:00
Kruglov Pavel
88aee95122
Merge branch 'master' into fast-count-from-files 2023-08-21 14:46:33 +02:00
avogar
47304bf7aa Optimize count from files in most input formats 2023-08-21 12:30:52 +00:00
Kruglov Pavel
c68456a20a
Merge pull request #52692 from Avogar/variable-number-of-volumns-more-formats
Allow variable number of columns in more formats, make it work with schema inference
2023-08-21 13:28:35 +02:00
Duc Canh Le
2c07065f81 increase the default value
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-08-21 11:04:24 +00:00
Michael Kolupaev
a1522e22ea
Merge pull request #53281 from Avogar/batch-small-parquet-row-groups
Optimize reading small row groups by batching them together in Parquet
2023-08-18 17:15:42 -07:00
Duc Canh Le
2d353f8c43 Merge branch 'master' into limit_concurent_background_optimize 2023-08-18 09:25:27 +00:00
Anton Popov
b9df41d5e3
Merge pull request #53129 from CurtizJ/non-deterministic-mutations
Allow to execute constant non-deterministic functions in mutations on initiator
2023-08-18 00:26:20 +02:00
Anton Popov
1805dec6ff Merge remote-tracking branch 'upstream/master' into HEAD 2023-08-17 14:09:43 +00:00
Ilya Yatsishin
7115110dad
Update merge-tree-settings.md
parts_to_throw_insert=3000
2023-08-17 15:59:22 +02:00
avogar
bca91548ad Add setting input_format_parquet_local_file_min_bytes_for_seek 2023-08-17 12:28:01 +00:00
zvonand
a8cdc94720 update docs acc to review 2023-08-15 23:42:04 +05:00
Anton Popov
2e22b17d57 add docs and settings randomizations 2023-08-15 00:38:07 +00:00
Anton Popov
5a1265d16d add docs 2023-08-15 00:24:47 +00:00
Duc Canh Le
cd535bea7d limit number of concurrent background partition optimize 2023-08-14 10:21:13 +00:00