Commit Graph

1932 Commits

Author SHA1 Message Date
serxa
f05a657723 add docs 2024-06-06 12:56:34 +00:00
Joshua Hildred
e3e5f304b9 Update docs 2024-06-06 05:28:16 -07:00
josh-hildred
677b2de5ed Update docs/en/operations/settings/settings.md
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2024-06-06 05:28:15 -07:00
Joshua Hildred
d455116b7c fix style 2024-06-06 05:26:57 -07:00
Joshua Hildred
a7230e3c6c Add settings to allow parallel replicas custom key
with range filter to use a custom range
2024-06-06 05:26:57 -07:00
LiuNeng
0ca96559c2
Merge branch 'master' into adapting-parquet-block-size 2024-06-06 11:14:01 +08:00
Peignon Melvyn
33cd9c274c
Update settings.md 2024-06-06 03:03:19 +02:00
Han Fei
c04e7e64af Merge branch 'master' into hanfei/stats_uniq 2024-06-05 13:09:15 +02:00
Han Fei
f7ca33868b Merge branch 'master' into hanfei/stats_uniq 2024-06-05 01:21:49 +02:00
Robert Schulze
7b9d1086ae
Improve docs 2024-06-04 11:51:57 +00:00
Robert Schulze
e874a95c02
Docs: fix wording 2024-06-04 11:43:21 +00:00
Robert Schulze
9e440e1417
Add docs 2024-06-04 11:20:15 +00:00
LiuNeng
8d5067ade5 Merge branch 'master' into adapting-parquet-block-size 2024-06-04 14:32:15 +08:00
Kirill Nikiforov
eb6713dfc1
possibility to use the legacy impl, settings for ignore query build failure, fix ssl 2024-06-02 03:29:00 +03:00
Justin de Guzman
0961dea92d
Update default value of async_insert_max_data_size 2024-05-31 16:40:02 -07:00
liuneng
dea7f776cb add doc 2024-05-31 10:35:51 +08:00
serxa
c04d7bc2b7 Merge branch 'master' into workload-for-merges 2024-05-28 10:44:59 +00:00
Han Fei
ee7ad460fd Merge branch 'master' into hanfei/stats_uniq 2024-05-25 18:01:21 +02:00
Kseniia Sumarokova
31fd4f5eb4
Merge pull request #59767 from ClickHouse/use-iobject-storage-for-table-engines-1
Unite s3/hdfs/azure storage implementations into a single class working with IObjectStorage. Same for *Cluster, data lakes and Queue storages.
2024-05-25 09:35:55 +00:00
Nikita Fomichev
2cc1b27fb5 Update docs for settings cross_join_min_rows_to_compress and cross_join_min_bytes_to_compress 2024-05-24 14:41:04 +02:00
Kseniia Sumarokova
c10fc6d80e
Merge branch 'master' into use-iobject-storage-for-table-engines-1 2024-05-24 10:46:45 +02:00
Kruglov Pavel
5a0ee3854b
Merge branch 'master' into variant-new-serialization 2024-05-23 20:18:51 +02:00
kssenii
3004f0b63d Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-05-23 16:51:46 +02:00
Shaun Struwig
f8fc1fa338
Merge branch 'master' into document_revision 2024-05-23 16:00:38 +02:00
Blargian
ce26c4f657 Review changes and replace … with ... 2024-05-23 13:54:45 +02:00
serxa
580577d362 add docs for merge_workload nad mutation_workload settings 2024-05-17 17:11:42 +00:00
Han Fei
2e2d20717b refine docs 2024-05-17 17:37:16 +02:00
kssenii
a63e846724 Review fixes 2024-05-15 22:17:47 +02:00
kssenii
53f5b95803 Fix typo 2024-05-15 15:02:23 +02:00
kssenii
a7b135ea8b Fix style check 2024-05-15 12:42:38 +02:00
kssenii
65f404c153 Review fixes 2024-05-14 22:08:50 +02:00
kssenii
0abb2be5eb Review fixes 2024-05-14 18:40:09 +02:00
avogar
a7e87e22ad Merge branch 'master' of github.com:ClickHouse/ClickHouse into 56257_parse_crlf_with_TSV_files 2024-05-14 11:56:43 +00:00
Anton Popov
12ea2fc4bf Merge remote-tracking branch 'upstream/master' into HEAD 2024-05-13 16:24:34 +00:00
Raúl Marín
2c6d0c69ab
Merge pull request #63005 from ClickHouse/docs-wait_for_async_insert-details
[Docs] Add details for wait_for_async_insert
2024-05-06 08:28:15 +00:00
Justin de Guzman
6c415e9ec5
[Docs] wait_for_async_insert clarification
Co-authored-by: Raúl Marín <git@rmr.ninja>
2024-05-06 00:07:37 -07:00
Justin de Guzman
6e61d671c8
[Docs] Specify to use async_insert
Co-authored-by: Raúl Marín <git@rmr.ninja>
2024-05-06 00:07:04 -07:00
Shaun Struwig
2b4def9ebb
Merge branch 'ClickHouse:master' into 56257_parse_crlf_with_TSV_files 2024-05-05 05:30:26 +02:00
Konstantin Bogdanov
5a11d91053
Merge pull request #63258 from ClickHouse/fix-grant-links
Fix links in docs
2024-05-02 13:51:27 +00:00
János Benjamin Antal
7aab5855b6 Fix links 2024-05-02 07:00:40 +00:00
Ladislav Snizek
4ff7558e4f Correct the name of memory_usage_overcommit_max_wait_microseconds in documentation 2024-05-01 17:50:29 +02:00
Jordi Villar
8c3a9bc9c7 Revert "Merge pull request #60598 from jrdi/week-default-mode"
This reverts commit 61df8aa466, reversing
changes made to c6d21aebb5.
2024-04-30 09:23:25 +02:00
Alexey Milovidov
8cc67f7c95
Merge pull request #62973 from yariks5s/reduce_help_messages
Reduce verbosity of `clickhouse client --help`
2024-04-27 03:43:33 +00:00
Robert Schulze
0fd2d573ae
Move hint to system.settings up 2024-04-26 12:10:51 +00:00
Yarik Briukhovetskyi
e507bb274d
add link to system.tables for settings docs 2024-04-26 13:27:26 +02:00
Justin de Guzman
6a459fe581
[Docs] Add details for wait_for_async_insert 2024-04-25 13:44:03 -07:00
Nikita Mikhaylov
a8683a8bd5 Remove the setting from tests 2024-04-25 22:13:14 +02:00
Kruglov Pavel
52e3c3aa4e
Merge branch 'master' into 56257_parse_crlf_with_TSV_files 2024-04-24 16:20:19 +01:00
avogar
e524f38172 Add default value of new setting in docs 2024-04-18 22:40:30 +00:00
avogar
f70851f5f4 Add new MergeTree setting in docs 2024-04-18 22:39:26 +00:00
János Benjamin Antal
e4d13eb263
Merge pull request #62031 from ClickHouse/fix-docs-for-mysql-datatypes-support-level
Improve docs of `mysql_datatypes_support_level`
2024-04-17 14:18:48 +00:00
Jordi Villar
9ed1b9412f Merge remote-tracking branch 'upstream/master' into week-default-mode 2024-04-16 23:01:25 +02:00
Raúl Marín
b90eb1962f Remove mentions of clean_deleted_rows from the documentation 2024-04-11 19:56:30 +02:00
Jordi Villar
a4c3153453 Rollback date_diff changes 2024-04-11 15:55:12 +02:00
Robert Schulze
2cc801e74c Some fixups 2024-04-11 15:55:12 +02:00
Jordi Villar
368d01872f Apply feedback to toStartOfInterval 2024-04-11 15:55:12 +02:00
Jordi Villar
cf51d801ae Documentation 2024-04-11 15:55:12 +02:00
Yakov Olkhovskiy
057747ccd2
fix 2024-04-10 20:33:42 -04:00
Yakov Olkhovskiy
7344daec8f
add Composable Protocols 2024-04-10 20:25:08 -04:00
Robert Schulze
d1bd7e08e4
Merge remote-tracking branch 'rschu1ze/master' into qc-system-tables 2024-04-10 10:55:16 +00:00
loselarry
7774a2a313 chore: fix some comments
Signed-off-by: loselarry <bikangning@yeah.net>
2024-04-10 17:21:25 +08:00
Shaun Struwig
971263c4e6
Merge branch 'ClickHouse:master' into 56257_parse_crlf_with_TSV_files 2024-04-08 21:52:47 +02:00
Robert Schulze
12813be9b8
Ignore queries involving system tables by query cache
Fixes #59071
2024-04-07 11:24:32 +00:00
János Benjamin Antal
5d67793609 Fix docs about default value of output_format_pretty_row_numbers 2024-04-04 11:41:28 +00:00
Kruglov Pavel
05db73f518
Merge branch 'master' into 56257_parse_crlf_with_TSV_files 2024-04-03 17:17:44 +02:00
János Benjamin Antal
2b609d2a08 Fix typo 2024-04-02 11:26:35 +00:00
Kruglov Pavel
9b5b44dd5f
Merge pull request #61889 from Avogar/allow-to-save-bad-json-escape-sequences
Add a setting to allow saving bad escape sequences in JSON input formats
2024-03-28 14:34:02 +01:00
János Benjamin Antal
7b692b6073 Add docs and fix inline docs. 2024-03-28 10:13:31 +00:00
János Benjamin Antal
e288528ede
Merge pull request #61931 from ClickHouse/fix-aggregating-merge-tree-simple-aggregate-function-string
Fix performance test `aggregating_merge_tree_simple_aggregate_function_string`
2024-03-28 08:39:45 +01:00
Pablo Marcos
2daaa660c5
Update input_format_parquet_allow_missing_columns default value
Default value for input_format_parquet_allow_missing_columns was modified from 0 to 1, but the documentation was never updated.
2024-03-27 13:43:49 +01:00
Shaun Struwig
0e76731c6a
Merge branch 'ClickHouse:master' into 56257_parse_crlf_with_TSV_files 2024-03-27 03:06:51 +01:00
János Benjamin Antal
d0240e59ff Document the setting. 2024-03-26 11:13:08 +00:00
Azat Khuzhin
c7b919b19e Replace distributed_insert_replicas_preferences with distributed_insert_skip_read_only_replicas
v2: fix test
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-26 11:24:57 +01:00
Azat Khuzhin
63f92b2c16 Add documentation for distributed_insert_replicas_preferences
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-26 11:24:16 +01:00
avogar
dc87c483dd Add a setting to allow saving bad escape sequences in JSON input formats 2024-03-25 21:58:53 +00:00
Zhuo Qiu
6a95163a24
Merge branch 'ClickHouse:master' into existing-count 2024-03-22 09:51:27 +08:00
Anton Popov
fbd2273dd4 Merge remote-tracking branch 'upstream/master' into HEAD 2024-03-21 16:44:16 +00:00
Zhuo Qiu
62c91fdddc
revise docs
Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>
2024-03-18 22:33:07 +08:00
Zhuo Qiu
bf85f7f368 add docs & minor fix for lwd-aware merge settings 2024-03-18 11:02:02 +08:00
avogar
feda83a7c8 Merge branch 'master' of github.com:ClickHouse/ClickHouse into 56257_parse_crlf_with_TSV_files 2024-03-14 17:44:38 +00:00
Anton Popov
7a0b8e27af Merge remote-tracking branch 'upstream/master' into HEAD 2024-03-14 16:58:14 +00:00
Robert Schulze
e43ac49d4e
Merge remote-tracking branch 'rschu1ze/master' into locate-mysql 2024-03-11 12:23:15 +00:00
Robert Schulze
349894fc2b
Fixes #61051 2024-03-10 13:13:59 +00:00
Alexander Tokmakov
854abd64d8
Merge pull request #60340 from ClickHouse/ddl_none_only_active
Add none_only_active DDL output mode
2024-03-08 22:20:40 +01:00
Anton Popov
f740afe71e Merge remote-tracking branch 'upstream/master' into HEAD 2024-03-07 18:36:42 +00:00
Shaun Struwig
7aebd1e0a5
Merge branch 'ClickHouse:master' into 56257_parse_crlf_with_TSV_files 2024-03-06 14:50:32 +01:00
Joris Clement
b791ced86f
docs: typo
With https://github.com/ClickHouse/ClickHouse/pull/39423 allowing the
the usage of single quotes was disabled by default. Adapt the
documentation accordingly.
2024-03-05 14:50:24 +01:00
Joris Clement
0bedd98bb7
style: trailing whitespace 2024-03-05 14:50:23 +01:00
Anton Popov
c0dd9b13aa update docs 2024-03-04 15:39:39 +00:00
Alexey Milovidov
6771e99d9f Merge branch 'master' into ddl_none_only_active 2024-03-03 03:09:24 +01:00
Shaun Struwig
b54286bed4
Merge branch 'master' into 56257_parse_crlf_with_TSV_files 2024-03-01 18:21:05 +01:00
Alexey Milovidov
e6dffb1f2d
Merge pull request #60379 from rogeryk/improve-pretty-format
Improve pretty format if a block consists of a single numeric value and exceeds one million.
2024-02-29 02:20:42 +03:00
pufit
330a206470
Add definers for views (Attempt 2) (#60439) 2024-02-27 19:00:17 -05:00
Alexey Milovidov
7c6e28708b
Merge pull request #60370 from ClickHouse/remove-alter-live-view
Remove ALTER LIVE VIEW
2024-02-27 17:45:59 +03:00
Robert Schulze
de45c26262
Merge pull request #60365 from rschu1ze/mysql-friday-evening-fix
MySQL: Force-set `prefer_column_name_to_alias` in handler and set `mysql_map_(fixed)_string_to_text_in_show_columns` by default
2024-02-27 12:13:07 +01:00
Alexey Milovidov
9845b9ec4d
Merge pull request #60342 from DerekChia/patch-5
Update default value for async_insert_deduplicate
2024-02-27 03:46:44 +03:00
Robert Schulze
ac7a3cd18d
Merge remote-tracking branch 'rschu1ze/master' into mysql-friday-evening-fix 2024-02-26 22:00:45 +00:00
Alexander Tokmakov
07e22dbe50 Merge branch 'master' into ddl_none_only_active 2024-02-26 17:53:11 +01:00
Raúl Marín
dfbca34298
Merge pull request #60053 from ClickHouse/melvynator-patch-2
Update settings.md
2024-02-26 16:22:08 +01:00
Kruglov Pavel
d184ebff6a
Merge pull request #60343 from Alex-Cheng/master
Update settings.md to correct the description for setting `max_concur…
2024-02-26 14:21:10 +01:00
Raúl Marín
a8878bfdc5 Merge remote-tracking branch 'blessed/master' into melvynator-patch-2 2024-02-26 14:18:41 +01:00
rogeryk
7a92f542b4 Add setting output_format_pretty_single_large_number_tip_threshold 2024-02-26 20:19:53 +08:00
Alexey Milovidov
2eb4d25126 Remove ALTER LIVE VIEW 2024-02-23 22:56:18 +01:00
Robert Schulze
b9f5a2f620
Enable prefer_column_name_to_alias in MySQL Handler, default enable two MySQL settings 2024-02-23 17:42:54 +00:00
Alexander Tokmakov
011c694117 add none_only_active DDL output mode 2024-02-23 13:10:01 +01:00
Raúl Marín
464b5e0e15
Revert "Add definers for views (#54901)"
This reverts commit 57306706b3.
2024-02-23 12:44:31 +01:00
Justin de Guzman
e73d53fbc5
[Docs] Fix links 2024-02-23 01:23:36 -08:00
Alex Cheng
aca69a7b97
Update settings.md to correct the description for setting max_concurrent_queries_for_user 2024-02-23 13:49:15 +08:00
Derek Chia
455b492e05
Update settings.md 2024-02-23 11:25:22 +08:00
pufit
57306706b3
Add definers for views (#54901) 2024-02-22 17:47:50 +01:00
Robert Schulze
7930c2a993
Better! 2024-02-21 20:31:49 +00:00
Robert Schulze
52afa46e23
Revert "Replace ORDER BY ALL by ORDER BY *" 2024-02-21 19:05:20 +01:00
Shaun Struwig
4a5761ce1f
Merge branch 'ClickHouse:master' into 56257_parse_crlf_with_TSV_files 2024-02-20 22:18:01 +01:00
Robert Schulze
6f6e74ad8b
Merge remote-tracking branch 'rschu1ze/master' into order-by-all-ambiguities 2024-02-19 15:19:13 +00:00
Shaun Struwig
1d440f0399
Merge branch 'ClickHouse:master' into 56257_parse_crlf_with_TSV_files 2024-02-16 19:48:33 +01:00
Peignon Melvyn
afdb52a7db
Update settings.md 2024-02-16 04:46:18 +01:00
robot-clickhouse-ci-2
10d9ee3af4
Merge pull request #59607 from ClickHouse/docs-quorum-insert-settings
[Docs] Add Cloud details for quorum insert settings
2024-02-16 03:33:54 +01:00
Robert Schulze
058461e786
Merge remote-tracking branch 'rschu1ze/master' into order-by-all-ambiguities 2024-02-15 16:21:16 +00:00
Shaun Struwig
525a5188e4
Merge branch 'master' into 56257_parse_crlf_with_TSV_files 2024-02-14 17:40:08 +01:00
Kruglov Pavel
42628fdd38
Merge branch 'master' into #31363_format_template_configure_in_settings 2024-02-13 17:24:54 +01:00
Alexey Milovidov
93680caee4
Merge pull request #59784 from ClickHouse/docs-cloud-values-query-complexity
[Docs] Add cloud default values for query complexity
2024-02-09 18:06:39 +01:00
Alexey Milovidov
f3b2f27d95
Merge pull request #59783 from ClickHouse/docs-edit-default-cloud-core-settings
[Docs] Add default cloud core settings
2024-02-09 18:06:23 +01:00
Shaun Struwig
3476d4f753
Merge branch 'master' into 56257_parse_crlf_with_TSV_files 2024-02-09 11:50:18 +01:00
Justin de Guzman
aa05f07130
[Docs] Corrections for default cloud values for query complexity
Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2024-02-08 21:41:11 -08:00
Justin de Guzman
89d4b1e77b
[Docs] Specify that some query profiler settings are disabled in Cloud 2024-02-08 21:39:08 -08:00
Justin de Guzman
2a34bbb0e0
[Docs] Cloud core settings corrections
Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2024-02-08 21:36:45 -08:00
Justin de Guzman
af6ae28f3c
[Docs] Specify cloud default value for date_time_input_format 2024-02-08 18:16:44 -08:00
Justin de Guzman
32305adb08
[Docs] Remove accidental link on query complexity page 2024-02-08 18:10:01 -08:00
Justin de Guzman
2954cdf200
[Docs] Add cloud default values for query complexity 2024-02-08 18:06:34 -08:00
Justin de Guzman
d17a12fe64
[Docs] Fix for default cloud core settings 2024-02-08 17:46:37 -08:00
Justin de Guzman
fe6d8316a3
[Docs] Add default cloud core settings 2024-02-08 17:34:43 -08:00
Blargian
0ff4202452 fix up test and modify skipRowEndDelimiter so that crlf works with .tsv 2024-02-08 07:08:17 +01:00
Justin de Guzman
ce92f13389
[Docs] More details on quorum inserts on SMT 2024-02-07 20:02:21 -08:00
Shaun Struwig
913c23fa88
Merge branch 'ClickHouse:master' into #31363_format_template_configure_in_settings 2024-02-06 00:20:14 +01:00
Justin de Guzman
c9b8559b29
[Docs] Add Cloud details for quorum insert settings 2024-02-05 13:13:33 -08:00
Robert Schulze
e414384727
Merge remote-tracking branch 'rschu1ze/master' into order-by-all-ambiguities 2024-02-05 13:17:02 +00:00
Jordi Villar
9223f74c91 Fix corner case when passing update_insert_deduplication_token_in_dependent_materialized_views 2024-02-05 10:16:45 +01:00
Blargian
8e9344e962 Merge branch 'master' into #31363_format_template_configure_in_settings 2024-02-04 20:02:17 +01:00
Alex Cheng
5c3e119a4f
Merge branch 'ClickHouse:master' into master 2024-02-04 10:48:07 +08:00
Robert Schulze
dd484fc312
Simplify what happens in SELECT all, ... [...] ORDER BY ALL
Previously setting `enable_order_by_all` distinguished for ORDER BY ALL
whether we should sort by column 'all' (if given in the SELECT clause)
or by all columns. The actual behavior was not always intuitive.

Now, we throw unconditionally an exception which also simplifies the
handling a bit. Only an edge case is affected and if users really want
to run ORDER BY ALL on a column names 'all', they can alias it.
2024-02-02 09:53:35 +00:00
Julia Kartseva
5b07039ab2 Update settings.md 2024-02-01 22:45:10 +00:00
Blargian
7ae202376f missed place for documentation change 2024-01-31 21:03:06 +01:00
Shaun Struwig
e081a4f059
Merge branch 'master' into #31363_format_template_configure_in_settings 2024-01-29 21:29:22 +01:00
Blargian
4a8a7208f2 rename of settings, add setting for resultset, extend test, fix documentation and add to SettingsChanges log 2024-01-29 21:25:58 +01:00
Nikolai Kochetov
a51aa7b668
Merge pull request #59238 from kitaisreal/update-insert-deduplication-token-in-dependent-materialized-views
Added setting update_insert_deduplication_token_in_dependent_materialized_views
2024-01-29 12:52:06 +01:00
Maksim Kita
4a10b71252 Updated documentation 2024-01-27 15:57:49 +03:00
Maksim Kita
4ae425461f Added documentation 2024-01-27 15:57:49 +03:00
avogar
5833641fa5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into variant-data-type 2024-01-26 16:54:02 +00:00
avogar
ff15ab12b8 Remove bad implementation of DataTypeVariant::createColumnConst, support use_variant_as_common_type setting in functions array/map 2024-01-25 21:06:50 +00:00
avogar
4b26de9660 Rename setting to use it not only in if/multiIf in future 2024-01-25 13:26:13 +00:00
Mikhail f. Shiryaev
38898575e5
Merge branch 'master' into #31363_format_template_configure_in_settings 2024-01-24 20:49:38 +01:00
Alex Cheng
3e795ccb01
Merge branch 'ClickHouse:master' into master 2024-01-24 21:11:03 +08:00
Alex Cheng
10aaf2cbe4
fix the default number of async_insert_max_data_size 2024-01-24 21:10:48 +08:00
avogar
1fd4b26c3c Better docs 2024-01-23 17:48:50 +00:00
avogar
be3b5dc45f Allow to ignore schema evolution in Iceberg table engine under a setting 2024-01-23 17:45:41 +00:00
jsc0218
6f3124acdb
Merge pull request #58402 from zhangyifan27/add_max_estimated_execution_time
Seperate max_execution_time and max_estimated_execution_time
2024-01-21 19:57:06 -05:00
Blargian
f1749217ee added format_schema_rows_template setting 2024-01-18 21:53:56 +02:00
Kruglov Pavel
5444cde408
Merge branch 'master' into variant-data-type 2024-01-18 18:31:27 +01:00
Kruglov Pavel
6d064512e1
Merge pull request #58614 from Blargian/58363_disable_ansi_pretty_automatically
58363 Automatically disable ANSI escape sequences in Pretty formats if the output is not a terminal
2024-01-17 13:45:41 +01:00
Blargian
72b5cf5993 #58363 - removed switch from PrettyBlockOutputFormat and modified BlockOutputFormats to use color variable. Updated english and russian documentation. Updated test 00405 reference file. 2024-01-12 19:46:03 +02:00
Ilya Yatsishin
1b548d3597
Update query-complexity.md to rerun tests 2024-01-12 20:44:46 +04:00
avogar
bfd7db8cf4 Better docs 2024-01-12 13:06:51 +00:00
avogar
fbfdde60a7 Add settings for better control of indexes type in Arrow dictionary. Use signed integer type for indexes by default 2024-01-12 13:06:51 +00:00
johnnymatthews
ebd7f19670 Example to show settings changed from default. 2024-01-10 12:38:38 -04:00
Robert Schulze
4cacfa6b43
Merge pull request #57509 from jinjunzh/qatzstd_main
Add Intel-QAT-based `ZSTD_QAT` compression codec
2024-01-10 10:31:39 +01:00
Kseniia Sumarokova
1b517105db
Merge pull request #57323 from valbok/mysql-binlog-client
MaterializedMySQL: Introduce MySQL Binlog Client
2024-01-10 09:08:13 +01:00
Robert Schulze
ced9e93ac6
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main 2024-01-09 20:36:02 +00:00
pufit
6cf55b82f4
Merge pull request #58539 from canhld94/file_custom_compress_level
Allow explicitly set compression level in output format
2024-01-09 13:43:38 -05:00
Duc Canh Le
37a7ce2950
Apply suggestions from code review
Co-authored-by: pufit <pufit@yandex.ru>
2024-01-09 17:17:30 +08:00
Kruglov Pavel
b947609b8e
Merge branch 'master' into variant-data-type 2024-01-08 15:04:51 +01:00
Robert Schulze
0f51e32bb5
Rename from ZSTDQPL to ZSTD_QPL 2024-01-07 17:47:31 +00:00
zhangyifan27
730135f933 Seperate max_execution_time and max_estimated_execution_time 2024-01-07 12:32:42 +08:00
avogar
7e5ba62017 Allow to read Bool values into String in JSON input formats 2024-01-05 20:33:30 +00:00
Duc Canh Le
c3586b2e35 fix docs
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2024-01-05 07:23:22 +00:00
Duc Canh Le
934e006213 add document
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2024-01-05 07:13:46 +00:00
Alexander Tokmakov
b1688b1953 Merge branch 'master' into rdb_dont_wait_inactive 2024-01-03 17:03:01 +01:00
Val Doroshchuk
5c221d123d MaterializedMySQL: Introduce MySQL Binlog Client
One binlog connection for many databases.

Suggesting to disable this feature by default for now. It should be explicitly enabled by SETTINGS use_binlog_client=1.
But if you would permanently enable it in MaterializedMySQLSettings, it should keep old behavior and all tests should pass too.

1. Introduced `IBinlog` and its impl to read the binlog events from socket - `BinlogFromSocket`, or file - `BinlogFromFile`. Based on prev impl of `EventBase` and the same old binlog parsers. It fully keeps BC with old version. Fixed `./check-mysql-binlog` to test new impl.
2. Introduced `BinlogEventsDispatcher`, it reads the event from the source `IBinlog` and sends it to currently attached `IBinlog` instances.
3. Introduced `BinlogClient`, which is used to group a list of `BinlogEventsDispatcher` by MySQL binlog connection which is defined by `user:password@host:port`. All dispatchers with the same binlog position should be merged to one.
4. Introduced `BinlogClientFactory`, which is a singleton and it is used to track all binlogs created over the instance.
5. Introduced `use_binlog_client` setting to `MaterializedMySQL`, which forces to reuse a `BinlogClient` if it already exists in `BinlogClientCatalog` or create new one. By default, it is disabled.
6. Introduced `max_bytes_in_binlog_queue` setting to define the limit of bytes in binlog's queue of events. If bytes in the queue increases this limit, `BinlogEventsDispatcher` will stop reading new events from source `IBinlog` until the space for new events will be freed.
7. Introduced `max_milliseconds_to_wait_in_binlog_queue` setting to define max ms to wait when the max bytes exceeded.
7. Introduced `max_milliseconds_to_wait_in_binlog_queue` setting to define max ms to wait when the max bytes exceeded.
8. Introduced `max_bytes_in_binlog_dispatcher_buffer` setting to define max bytes in the binlog dispatcher's buffer before it is flushed to attached binlogs.
9. Introduced `max_flush_milliseconds_in_binlog_dispatcher` setting to define max milliseconds in the binlog dispatcher's buffer to wait before it is flushed to attached binlogs.
10. Introduced `system.mysql_binlogs` system table, which shows a list of active binlogs.
11. Introduced `UnparsedRowsEvent` and `MYSQL_UNPARSED_ROWS_EVENT`, which defines that an event is not parsed and should be explicitly parsed later.
12. Fixed bug when not possible to apply DDL since syntax error or unsupported SQL.

@larspars is the author of following:
`GTIDSets::contains()`
`ReplicationHelper`
`shouldReconnectOnException()`
2024-01-03 15:26:09 +01:00
Kruglov Pavel
4d8cf71ba7
Merge branch 'master' into variant-data-type 2024-01-03 15:21:23 +01:00
Alexey Milovidov
7bded0a5e7
Merge pull request #58316 from ClickHouse/reintroduce_is_deleted
Re-introduce `is_deleted` column for ReplacingMergeTree
2023-12-31 00:57:19 +01:00
robot-ch-test-poll4
09ffe8ffcc
Merge pull request #57837 from ClickHouse/pufit/docs-patch-roles
Added information about preconfigured roles in users.xml to the docs
2023-12-30 13:09:50 +01:00
Alexander Tokmakov
bfc10bd234 an option to avoid waiting for inactive Replicated db replicas 2023-12-29 15:19:16 +01:00
Alexander Tokmakov
bdada351c8 Revert "Merge pull request #58274 from ClickHouse/revert-58267"
This reverts commit 583b9637c2, reversing
changes made to 224e937620.
2023-12-28 14:07:59 +01:00
Alexey Milovidov
c7efd2afea Revert #58267 2023-12-28 04:09:33 +01:00
Alexander Tokmakov
01d042c490 Revert "Merge pull request #57932 from ClickHouse/remove-shit-cleanup"
This reverts commit 2d58dc512c, reversing
changes made to 41873dc4a3.
2023-12-27 13:46:06 +01:00
Christoph Wurm
9def89d416 Fix anchors to settings.md 2023-12-20 18:26:36 +00:00
Kruglov Pavel
087946f385
Merge branch 'master' into variant-data-type 2023-12-20 00:40:18 +01:00
Jordi Villar
7c281d9a6f
Allow max_size_to_drop settings in query time (#57452) 2023-12-19 23:16:03 +01:00
avogar
319ae440b6 Implement Variant data type 2023-12-19 16:45:15 +00:00
Robert Schulze
952175ce39
Merge pull request #57875 from zhongyuankai/order_by_all
Support `ORDER BY ALL`
2023-12-19 13:38:07 +01:00
vdimir
252cb8a507
Merge pull request #54602 from fionera/issue-49028
Add setting http_make_head_request
2023-12-19 13:33:59 +01:00
Christoph Wurm
e357c088a0 Update settings.md: allow_experimental_parallel_reading_from_replicas
Document all possible values for `allow_experimental_parallel_reading_from_replicas`.
2023-12-18 16:55:44 +00:00
Robert Schulze
9033c96e29
Some fixups 2023-12-17 09:11:16 +00:00
Alexey Milovidov
ee502ef6b9 Remove trash (OPTIMIZE CLEANUP) 2023-12-15 22:41:58 +01:00
pufit
f49894f644
Added information about preconfigured roles in users.xml to the docs 2023-12-13 23:28:21 -05:00
Kruglov Pavel
6567fb2c08
Merge pull request #56859 from Avogar/csv-infer-numbers-from-strings
Allow to infer numbers from strings in CSV format
2023-12-12 17:09:02 +01:00
avogar
1db000dae5 Add docs 2023-12-11 18:02:05 +00:00
avogar
ee7af95bc0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-12-08 20:29:28 +00:00
hdhoang
fc8292182c
fix typo TKSV
correct name is TS-KV
2023-12-07 20:19:00 +07:00
Sema Checherinda
c61cd6aab2
Merge pull request #57335 from sichenzhao/increase_default_replicated_deduplication_window
increase default replicated_deduplication_window from 100 to 1k
2023-12-02 21:23:39 +01:00
Sichen Zhao
1b8b1c0a63 increase default replicated_deduplication_window from 100 to 1k 2023-11-28 14:24:06 -08:00
Han Fei
7bd2ea3add Merge branch 'master' into hanfei/statistic 2023-11-27 23:31:23 +01:00
Robert Schulze
ca63881357
Mention that the settings are dev settings 2023-11-24 14:46:02 +00:00
vdimir
1044e3366b
Update http_make_head_request doc 2023-11-24 09:32:20 +00:00
Tim Windelschmidt
51e3899f73
Add setting http_make_head_request
Clickhouse always does a HEAD request before actually executing the GET request,
this adds a settings to skip that request.
2023-11-24 09:32:16 +00:00
Robert Schulze
a8a3214185
+ documentation 2023-11-23 19:43:40 +00:00
avogar
f537bad469 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-11-20 14:32:50 +00:00
avogar
872556a5d4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-11-20 14:03:36 +00:00
Sema Checherinda
f999337dae
Revert "Revert "s3 adaptive timeouts"" 2023-11-20 14:53:22 +01:00
Alexander Tokmakov
5031f239c3
Revert "s3 adaptive timeouts" 2023-11-20 14:28:59 +01:00
Sema Checherinda
a950595c24
Merge pull request #56314 from CheSema/s3-aggressive-timeouts
s3 adaptive timeouts
2023-11-19 14:12:14 +01:00
Justin de Guzman
96e87322b5
[Docs] Add insert_distributed_sync to Core Settings docs 2023-11-18 18:10:43 -08:00
Alexey Milovidov
0158db3e07
Merge pull request #56092 from ClickHouse/docs-max-block-size
Set correct default `max_block_size` value in docs
2023-11-18 17:23:43 +01:00
Kruglov Pavel
8e88bf1348 Revert "Revert "Add a setting max_execution_time_leaf to limit the execution time on shard for distributed query"" 2023-11-14 11:40:48 +00:00
Sema Checherinda
76d11687a7 adjuct docs 2023-11-14 11:34:12 +01:00
Sema Checherinda
e0edd165da add doc 2023-11-14 11:34:12 +01:00
Robert Schulze
361a3ca11f
Merge pull request #56519 from rschu1ze/qc-ignore-nondeterministic-queries
Query cache: Allow to ignore non-deterministic queries
2023-11-13 21:32:44 +01:00
Alexander Tokmakov
0622379ec7
Revert "Add a setting max_execution_time_leaf to limit the execution time on shard for distributed query" 2023-11-13 21:11:07 +01:00
Robert Schulze
7864df4826
Update docs + Try to stabilize test results, pt. II 2023-11-13 10:57:33 +00:00
Robert Schulze
91f53514d9
Incorporate review feedback 2023-11-12 15:11:38 +00:00
Robert Schulze
52c825db44
Query cache: Allow to ignore non-deterministic queries
Fixes: #56504
2023-11-12 15:11:38 +00:00
Yarik Briukhovetskyi
b8ea31db43
Merge pull request #56309 from yariks5s/preferred_optimize_projection_name
New setting preferred_projection_name
2023-11-08 18:06:03 +01:00
Sema Checherinda
02df5ac59c
Merge pull request #54340 from KevinyhZou/bug_fix_csv_parse_crlf
Fix CSV read while the end of line is CR(\r)
2023-11-07 12:51:05 +01:00
Sema Checherinda
a5e17dc919
Merge pull request #55566 from CheSema/remote-blobs-naming
feature: storage_metadata_write_full_object_key
2023-11-06 16:41:49 +01:00
kevinyhzou
2a50daf5dd Allow cr at end of csv line 2023-11-06 12:21:42 +08:00
kevinyhzou
ef30e6723d bug fix csv read while end of line is not crlf 2023-11-06 12:21:42 +08:00
Robert Schulze
049c811a38
Make type names in SHOW COLUMNS dependent only on connection type 2023-11-05 21:20:20 +00:00
yariks5s
d95262622b init 2023-11-03 16:47:06 +00:00
Denny Crane
dbaebe18f1
Update settings.md 2023-11-03 13:14:56 -03:00
Denny Crane
9dbd229462
Update settings.md 2023-11-03 13:09:51 -03:00
Kruglov Pavel
81b1ca22bb
Merge pull request #51823 from canhld94/ch_add_max_execution_time_leaf
Add a setting max_execution_time_leaf to limit the execution time on shard for distributed query
2023-11-03 13:31:15 +01:00
Duc Canh Le
dd6b02a2fd add document
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-11-03 03:00:13 +00:00
Sema Checherinda
90b64bcdb9 backward compatibility and implementation feature storage_metadata_write_full_object_key 2023-11-02 15:20:55 +01:00
Alexey Milovidov
1267246785
Merge pull request #55642 from ClickHouse/morton-utils
Indexing by space-filling curves
2023-11-02 12:21:33 +01:00
robot-ch-test-poll1
a5fb7b0a1e
Merge pull request #56213 from ttanay/sort-spill-to-disk-docs
Add `max_bytes_before_external_sort` setting to query complexity doc
2023-11-02 00:50:30 +01:00
Tanay Tummalapalli
6a3b2a04d8 Add max_bytes_before_external_sort setting to query complexity doc
The setting should be mentioned here along with
`max_bytes_before_external_group_by` setting.

Note: The russian translation is courtesy of Google Translate.
2023-11-01 22:33:25 +05:30
Azat Khuzhin
c25d6cd624
Rename directory monitor concept into background INSERT (#55978)
* Limit log frequence for "Skipping send data over distributed table" message

After SYSTEM STOP DISTRIBUTED SENDS it will constantly print this
message.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename directory monitor concept into async INSERT

Rename the following query settings (with preserving backward
compatiblity, by keeping old name as an alias):
- distributed_directory_monitor_sleep_time_ms -> distributed_async_insert_sleep_time_ms
- distributed_directory_monitor_max_sleep_time_ms -> distributed_async_insert_max_sleep_time_ms
- distributed_directory_monitor_batch -> distributed_async_insert_batch_inserts
- distributed_directory_monitor_split_batch_on_failure -> distributed_async_insert_split_batch_on_failure

Rename the following table settings (with preserving backward
compatiblity, by keeping old name as an alias):
- monitor_batch_inserts -> async_insert_batch
- monitor_split_batch_on_failure -> async_insert_split_batch_on_failure
- directory_monitor_sleep_time_ms -> async_insert_sleep_time_ms
- directory_monitor_max_sleep_time_ms -> async_insert_max_sleep_time_ms

And also update all the references:

    $ gg -e directory_monitor_ -e monitor_ tests docs | cut -d: -f1 | sort -u | xargs sed -e 's/distributed_directory_monitor_sleep_time_ms/distributed_async_insert_sleep_time_ms/g' -e 's/distributed_directory_monitor_max_sleep_time_ms/distributed_async_insert_max_sleep_time_ms/g' -e 's/distributed_directory_monitor_batch_inserts/distributed_async_insert_batch/g' -e 's/distributed_directory_monitor_split_batch_on_failure/distributed_async_insert_split_batch_on_failure/g' -e 's/monitor_batch_inserts/async_insert_batch/g' -e 's/monitor_split_batch_on_failure/async_insert_split_batch_on_failure/g' -e 's/monitor_sleep_time_ms/async_insert_sleep_time_ms/g' -e 's/monitor_max_sleep_time_ms/async_insert_max_sleep_time_ms/g' -i

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename async_insert for Distributed into background_insert

This will avoid amigibuity between general async INSERT's and INSERT
into Distributed, which are indeed background, so new term express it
even better.

Mostly done with:

    $ git di HEAD^ --name-only | xargs sed -i -e 's/distributed_async_insert/distributed_background_insert/g' -e 's/async_insert_batch/background_insert_batch/g' -e 's/async_insert_split_batch_on_failure/background_insert_split_batch_on_failure/g' -e 's/async_insert_sleep_time_ms/background_insert_sleep_time_ms/g' -e 's/async_insert_max_sleep_time_ms/background_insert_max_sleep_time_ms/g'

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Mark 02417_opentelemetry_insert_on_distributed_table as long

CI: https://s3.amazonaws.com/clickhouse-test-reports/55978/7a6abb03a0b507e29e999cb7e04f246a119c6f28/stateless_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-01 15:09:39 +01:00
Alexey Milovidov
016285ea87
Merge branch 'master' into morton-utils 2023-10-31 01:47:16 +01:00
yariks5s
0846714052 added docs, changed tests 2023-10-30 17:17:53 +00:00
Han Fei
19cdc6dfe2 Merge branch 'master' into hanfei/statistic 2023-10-30 04:53:18 +01:00
Justin de Guzman
940d099e84
Set correct max_block_size value in docs 2023-10-27 16:50:34 -07:00
Kruglov Pavel
bb4b95e891
Merge branch 'master' into schema-inference-union 2023-10-27 14:53:58 +02:00
zvonand
35baf7792d cleanup after rebase, add [[unlikely]] 2023-10-26 23:56:45 +02:00
Kruglov Pavel
570b66f027
Merge branch 'master' into schema-inference-union 2023-10-26 19:26:00 +02:00
Andrey Zvonov
5737369d0b
Merge branch 'ClickHouse:master' into zvonand-datetime-ranges 2023-10-26 11:42:13 +02:00
vdimir
12890eb70c
Merge pull request #55806 from canhld94/rocksdb_trivial_count
Support trivial count for rocksdb and storage join
2023-10-26 11:22:38 +02:00
zvonand
0766c73aab Rename date_time_overflow_mode -> date_time_overflow_behavior, moved it to format settings 2023-10-25 23:11:13 +02:00
zvonand
5b86e8c714 updated after review 2023-10-25 23:10:58 +02:00
zvonand
2f3695add8 Introduce setting for dt overflow exception
Added tests and docs
2023-10-25 23:10:24 +02:00
Alexey Milovidov
bb5a60dc19
Merge pull request #55893 from ClickHouse/revert-partial-result-2
Revert "Revert "Revert "Add settings for real-time updates during query execution"""
2023-10-25 22:20:28 +02:00
vdimir
da6f3346fe
Merge pull request #55839 from ClickHouse/vdimir/async_executor_for_dictionary_load
Use AsyncPipelineExecutor all dictionaries
2023-10-24 11:31:36 +02:00