Commit Graph

4299 Commits

Author SHA1 Message Date
Alexey Milovidov
2eb4d25126 Remove ALTER LIVE VIEW 2024-02-23 22:56:18 +01:00
Robert Schulze
b9f5a2f620
Enable prefer_column_name_to_alias in MySQL Handler, default enable two MySQL settings 2024-02-23 17:42:54 +00:00
Alexander Tokmakov
011c694117 add none_only_active DDL output mode 2024-02-23 13:10:01 +01:00
Raúl Marín
464b5e0e15
Revert "Add definers for views (#54901)"
This reverts commit 57306706b3.
2024-02-23 12:44:31 +01:00
Nikolai Kochetov
dfccd521f3
Merge pull request #60221 from kitaisreal/backups-docs-id-setting
Backups documentation added id setting
2024-02-23 12:09:29 +01:00
Justin de Guzman
e73d53fbc5
[Docs] Fix links 2024-02-23 01:23:36 -08:00
Alex Cheng
aca69a7b97
Update settings.md to correct the description for setting max_concurrent_queries_for_user 2024-02-23 13:49:15 +08:00
Derek Chia
455b492e05
Update settings.md 2024-02-23 11:25:22 +08:00
János Benjamin Antal
7cad0050c0
Disambiguate alter commands list (#59532)
* Add optional parentheses to TTL element and alter command

* Add some basic tests

* Extend tests with more test cases

* Add one more test case

* Add server setting to control new formatting behavior

* Automatic style fix

* Fix segfault in `clickhouse-format` related to new server setting

* Remove format_ttl_expressions_with_parentheses

* Fix unit test compilation failures

* Introduce global flag to control the new formatting behavior

* Revert "Fix segfault in `clickhouse-format` related to new server setting"

This reverts commit d7131a3145.

* Revert accidental changes

* Revert accidental include reorder

* Revert accidental changes

* Enable new format in client and local server

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2024-02-22 19:17:15 +01:00
pufit
57306706b3
Add definers for views (#54901) 2024-02-22 17:47:50 +01:00
Robert Schulze
d2cb434be9
Merge remote-tracking branch 'ClickHouse/master' into revert-59450-order-by-all-ambiguities 2024-02-22 10:12:14 +00:00
Robert Schulze
7930c2a993
Better! 2024-02-21 20:31:49 +00:00
Raúl Marín
453d4d30cf
Revert "Support resource request canceling" 2024-02-21 20:19:00 +01:00
Robert Schulze
52afa46e23
Revert "Replace ORDER BY ALL by ORDER BY *" 2024-02-21 19:05:20 +01:00
serxa
f92ec2cd5d Merge branch 'master' into cpu-scheduler-and-cc 2024-02-21 14:05:37 +00:00
serxa
bf90da7057 Merge branch 'master' into cpu-scheduler-and-cc 2024-02-21 14:05:01 +00:00
Maksim Kita
d0ad87348a Backups documentation added id setting 2024-02-21 15:01:27 +03:00
Robert Schulze
6a027b3528
Merge remote-tracking branch 'rschu1ze/master' into cgroup-observing-memory-tracker 2024-02-21 11:48:34 +00:00
Shaun Struwig
4a5761ce1f
Merge branch 'ClickHouse:master' into 56257_parse_crlf_with_TSV_files 2024-02-20 22:18:01 +01:00
Robert Schulze
914b19aade
Merge pull request #59450 from rschu1ze/order-by-all-ambiguities
Replace `ORDER BY ALL` by `ORDER BY *`
2024-02-20 18:16:22 +01:00
Robert Schulze
4412f71a12
Docs: Follow-up to #60157 2024-02-20 10:16:46 +00:00
Robert Schulze
5474f36e75
Merge remote-tracking branch 'rschu1ze/master' into order-by-all-ambiguities 2024-02-20 10:09:57 +00:00
Robert Schulze
474efd98a5
Docs: Add example how to use "replace" and "remove" attributes in configuration
Bug: 8394
2024-02-19 20:46:06 +00:00
Robert Schulze
6f6e74ad8b
Merge remote-tracking branch 'rschu1ze/master' into order-by-all-ambiguities 2024-02-19 15:19:13 +00:00
Kseniia Sumarokova
601b1dfaa1
Fix bad link 2024-02-19 12:21:52 +01:00
Kseniia Sumarokova
8c11f59ba8
Fix bad link, update disk web description 2024-02-19 11:01:37 +01:00
Robert Schulze
ba9661a5d4
Merge remote-tracking branch 'rschu1ze/master' into cgroup-observing-memory-tracker 2024-02-19 09:54:08 +00:00
Alexey Milovidov
731c484b3d
Revert "Implement system.dns_cache table (#59856)"
This reverts commit b5ef034697.
2024-02-17 01:46:41 +01:00
Kirill Nikiforov
b5ef034697
Implement system.dns_cache table (#59856)
* system.dns_cache table WIP

* system.dns_cache table

* rollback unexpected contrib changes

* rollback unexpected changes

* add docs

* code style fixes

* optimize dns cache exporting

* stateful test for system.dns_cache table

* stateful test for system.dns_cache table

* cr fixes

* stateful test for system.dns_cache table

* stateful test for system.dns_cache table

* Update 02981_system_dns_cache_table.sql

* Update 02981_system_dns_cache_table.reference

---------

Co-authored-by: pufit <pufit@clickhouse.com>
2024-02-16 14:31:22 -05:00
Shaun Struwig
1d440f0399
Merge branch 'ClickHouse:master' into 56257_parse_crlf_with_TSV_files 2024-02-16 19:48:33 +01:00
alesapin
0a189e830c
Merge pull request #59942 from kitaisreal/storage-system-tables-add-metadata-version
StorageSystemTables add metadata_version
2024-02-16 13:17:22 +01:00
Peignon Melvyn
afdb52a7db
Update settings.md 2024-02-16 04:46:18 +01:00
robot-clickhouse-ci-2
10d9ee3af4
Merge pull request #59607 from ClickHouse/docs-quorum-insert-settings
[Docs] Add Cloud details for quorum insert settings
2024-02-16 03:33:54 +01:00
Ronald Bradford
712df1b51e
Update configuration-files.md
Fixed typo in XML example
2024-02-15 16:45:19 -05:00
Igor Nikonov
062602d433 Merge remote-tracking branch 'origin/master' into docs_fix_typos 2024-02-15 18:22:00 +00:00
Kseniia Sumarokova
09e630e02b
Update storing-data.md 2024-02-15 19:00:08 +01:00
kssenii
5ae410e633 A bit more explanation 2024-02-15 18:33:38 +01:00
Robert Schulze
058461e786
Merge remote-tracking branch 'rschu1ze/master' into order-by-all-ambiguities 2024-02-15 16:21:16 +00:00
kssenii
9bcd4daabe Better 2024-02-15 16:35:50 +01:00
kssenii
750a82a4ff Update doc 2024-02-15 13:23:33 +01:00
Shaun Struwig
525a5188e4
Merge branch 'master' into 56257_parse_crlf_with_TSV_files 2024-02-14 17:40:08 +01:00
Maksim Kita
d4778d858d Fixed tests 2024-02-14 18:05:29 +03:00
Maksim Kita
0cce386207 Added documentation 2024-02-14 18:05:29 +03:00
Robert Schulze
7b7ea6d477
Merge remote-tracking branch 'rschu1ze/master' into cgroup-observing-memory-tracker 2024-02-14 08:56:22 +00:00
Kruglov Pavel
42628fdd38
Merge branch 'master' into #31363_format_template_configure_in_settings 2024-02-13 17:24:54 +01:00
Nikolai Fedorovskikh
a98af159b5 [Docs] fix some typos and missing commas 2024-02-13 02:10:41 +01:00
Robert Schulze
3a4b6a2379
Merge remote-tracking branch 'rschu1ze/master' into cgroup-observing-memory-tracker 2024-02-10 13:53:19 +00:00
Robert Schulze
a3487c9c47
Merge remote-tracking branch 'ClickHouse/master' into docs-editing-query-cache-settings 2024-02-10 13:34:43 +00:00
Alexey Milovidov
93680caee4
Merge pull request #59784 from ClickHouse/docs-cloud-values-query-complexity
[Docs] Add cloud default values for query complexity
2024-02-09 18:06:39 +01:00
Alexey Milovidov
f3b2f27d95
Merge pull request #59783 from ClickHouse/docs-edit-default-cloud-core-settings
[Docs] Add default cloud core settings
2024-02-09 18:06:23 +01:00
Vitaly Baranov
09e727d48b
Merge pull request #56988 from ClickHouse/Azure_backup
Backup & Restore support for AzureBlobStorage
2024-02-09 14:45:35 +01:00
Shaun Struwig
3476d4f753
Merge branch 'master' into 56257_parse_crlf_with_TSV_files 2024-02-09 11:50:18 +01:00
Justin de Guzman
aa05f07130
[Docs] Corrections for default cloud values for query complexity
Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2024-02-08 21:41:11 -08:00
Justin de Guzman
89d4b1e77b
[Docs] Specify that some query profiler settings are disabled in Cloud 2024-02-08 21:39:08 -08:00
Justin de Guzman
2a34bbb0e0
[Docs] Cloud core settings corrections
Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2024-02-08 21:36:45 -08:00
robot-ch-test-poll1
ac1d513754
Merge pull request #59785 from ClickHouse/docs-cloud-value-enable_filesystem_cache_on_write_operations
[Docs] Specify cloud default value for enable_filesystem_cache_on_writ…
2024-02-09 06:59:26 +04:00
Justin de Guzman
af6ae28f3c
[Docs] Specify cloud default value for date_time_input_format 2024-02-08 18:16:44 -08:00
Justin de Guzman
f2f8a63ba8
[Docs] Change cloud default value for enable_filesystem_cache_on_write_operations 2024-02-08 18:14:21 -08:00
Justin de Guzman
32305adb08
[Docs] Remove accidental link on query complexity page 2024-02-08 18:10:01 -08:00
Justin de Guzman
2954cdf200
[Docs] Add cloud default values for query complexity 2024-02-08 18:06:34 -08:00
Justin de Guzman
d17a12fe64
[Docs] Fix for default cloud core settings 2024-02-08 17:46:37 -08:00
Justin de Guzman
fe6d8316a3
[Docs] Add default cloud core settings 2024-02-08 17:34:43 -08:00
Robert Schulze
cf0378ea76
add docs 2024-02-08 16:17:25 +00:00
Blargian
0ff4202452 fix up test and modify skipRowEndDelimiter so that crlf works with .tsv 2024-02-08 07:08:17 +01:00
Justin de Guzman
ce92f13389
[Docs] More details on quorum inserts on SMT 2024-02-07 20:02:21 -08:00
Smita Kulkarni
e594608c42 Merge branch 'master' into Azure_backup 2024-02-07 13:48:46 +01:00
Shaun Struwig
913c23fa88
Merge branch 'ClickHouse:master' into #31363_format_template_configure_in_settings 2024-02-06 00:20:14 +01:00
Justin de Guzman
c9b8559b29
[Docs] Add Cloud details for quorum insert settings 2024-02-05 13:13:33 -08:00
Robert Schulze
e414384727
Merge remote-tracking branch 'rschu1ze/master' into order-by-all-ambiguities 2024-02-05 13:17:02 +00:00
Jordi Villar
9223f74c91 Fix corner case when passing update_insert_deduplication_token_in_dependent_materialized_views 2024-02-05 10:16:45 +01:00
Blargian
8e9344e962 Merge branch 'master' into #31363_format_template_configure_in_settings 2024-02-04 20:02:17 +01:00
Alex Cheng
5c3e119a4f
Merge branch 'ClickHouse:master' into master 2024-02-04 10:48:07 +08:00
Julia Kartseva
f41f4e4bd0
Merge pull request #58486 from jkartseva/adjustable-async-timeouts
Adjustable asynchronous insert timeouts
2024-02-02 08:53:58 -08:00
Robert Schulze
dd484fc312
Simplify what happens in SELECT all, ... [...] ORDER BY ALL
Previously setting `enable_order_by_all` distinguished for ORDER BY ALL
whether we should sort by column 'all' (if given in the SELECT clause)
or by all columns. The actual behavior was not always intuitive.

Now, we throw unconditionally an exception which also simplifies the
handling a bit. Only an edge case is affected and if users really want
to run ORDER BY ALL on a column names 'all', they can alias it.
2024-02-02 09:53:35 +00:00
Julia Kartseva
5b07039ab2 Update settings.md 2024-02-01 22:45:10 +00:00
Fille
25c87b7cb7
Update configuration-files.md
Fixed typo in XML example
2024-02-01 10:37:10 +01:00
Blargian
58ae4cf648 Merge branch 'master' into #31363_format_template_configure_in_settings 2024-02-01 05:39:22 +01:00
robot-clickhouse
b49ae582ce
Merge pull request #59449 from seandhaynes/bench-docs
Update bench docs to reflect removal of -p (port) short option
2024-01-31 23:28:11 +01:00
Alexey Milovidov
31e99ee61f
Update clickhouse-benchmark.md 2024-02-01 01:01:59 +03:00
Sean Haynes
ed3d5ce0a3 Update bench docs to reflect removal of -p (port) short option 2024-01-31 21:52:52 +00:00
Blargian
7ae202376f missed place for documentation change 2024-01-31 21:03:06 +01:00
Alexey Gerasimchuck
559de083a3 Implemented failed login attempt counting using quota 2024-01-29 23:20:38 +00:00
Shaun Struwig
e081a4f059
Merge branch 'master' into #31363_format_template_configure_in_settings 2024-01-29 21:29:22 +01:00
Blargian
4a8a7208f2 rename of settings, add setting for resultset, extend test, fix documentation and add to SettingsChanges log 2024-01-29 21:25:58 +01:00
Raúl Marín
468c7cf835
Merge pull request #59329 from Algunenano/prefertch
Fix typo
2024-01-29 17:02:01 +01:00
Nikolai Kochetov
a51aa7b668
Merge pull request #59238 from kitaisreal/update-insert-deduplication-token-in-dependent-materialized-views
Added setting update_insert_deduplication_token_in_dependent_materialized_views
2024-01-29 12:52:06 +01:00
Raúl Marín
ab2b12ba9f Fix typo 2024-01-29 11:40:12 +01:00
Smita Kulkarni
3183026521 Merge branch 'master' into Azure_backup 2024-01-29 11:08:13 +01:00
serxa
963e54cfd1 Merge branch 'master' into cpu-scheduler-and-cc 2024-01-28 13:09:58 +00:00
Maksim Kita
4a10b71252 Updated documentation 2024-01-27 15:57:49 +03:00
Maksim Kita
4ae425461f Added documentation 2024-01-27 15:57:49 +03:00
avogar
5833641fa5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into variant-data-type 2024-01-26 16:54:02 +00:00
avogar
ff15ab12b8 Remove bad implementation of DataTypeVariant::createColumnConst, support use_variant_as_common_type setting in functions array/map 2024-01-25 21:06:50 +00:00
avogar
4b26de9660 Rename setting to use it not only in if/multiIf in future 2024-01-25 13:26:13 +00:00
Mikhail f. Shiryaev
38898575e5
Merge branch 'master' into #31363_format_template_configure_in_settings 2024-01-24 20:49:38 +01:00
Alex Cheng
3e795ccb01
Merge branch 'ClickHouse:master' into master 2024-01-24 21:11:03 +08:00
Alex Cheng
10aaf2cbe4
fix the default number of async_insert_max_data_size 2024-01-24 21:10:48 +08:00
Smita Kulkarni
4d92eba316 Merge branch 'master' into Azure_backup 2024-01-24 11:13:57 +01:00
avogar
1fd4b26c3c Better docs 2024-01-23 17:48:50 +00:00
avogar
be3b5dc45f Allow to ignore schema evolution in Iceberg table engine under a setting 2024-01-23 17:45:41 +00:00
Robert Schulze
e23e7e6b73
Merge pull request #53710 from rschu1ze/system-reload-asynchronous-metrics
Add statement `SYSTEM RELOAD ASYNCHRONOUS METRICS`
2024-01-23 11:56:25 +01:00
Nikita Taranov
09e24ed6c5
Merge pull request #58068 from zhongyuankai/limit_materialized_view_size
A limit on the number of materialized views attached to a table.
2024-01-22 22:50:56 +01:00
Robert Schulze
90a0ea36b3
Add statement 'SYSTEM RELOAD ASYNCHRONOUS METRICS' 2024-01-22 17:14:58 +00:00
Kruglov Pavel
0829de8928
Merge pull request #57599 from Khatskevich/khatskevich/fix_docs
Improve named collections documentation
2024-01-22 12:54:57 +01:00
serxa
e6d1ba46df Merge branch 'master' into cpu-scheduler-and-cc 2024-01-22 11:18:42 +00:00
jsc0218
6f3124acdb
Merge pull request #58402 from zhangyifan27/add_max_estimated_execution_time
Seperate max_execution_time and max_estimated_execution_time
2024-01-21 19:57:06 -05:00
serxa
799b8d6356 support resource request canceling 2024-01-21 19:00:40 +00:00
zhongyuankai
cbb51659f6
Merge branch 'master' into limit_materialized_view_size 2024-01-19 22:00:12 +08:00
Blargian
f1749217ee added format_schema_rows_template setting 2024-01-18 21:53:56 +02:00
Kruglov Pavel
5444cde408
Merge branch 'master' into variant-data-type 2024-01-18 18:31:27 +01:00
Smita Kulkarni
e71977b724 Merge branch 'master' into Azure_backup 2024-01-18 08:29:01 +01:00
Kruglov Pavel
6d064512e1
Merge pull request #58614 from Blargian/58363_disable_ansi_pretty_automatically
58363 Automatically disable ANSI escape sequences in Pretty formats if the output is not a terminal
2024-01-17 13:45:41 +01:00
Antonio Andelic
5e020476d3
Merge pull request #58810 from ClickHouse/heap-profiler-docs
Add docs for allocation profiling
2024-01-17 12:26:55 +01:00
Antonio Andelic
f33f374ac5 Make Kovi happy 2024-01-16 15:09:49 +01:00
Antonio Andelic
76c9bf42d7 Add docs for allocation profiling 2024-01-15 13:57:16 +01:00
vdimir
8dc1756532
Support <secret> in cluster discovery 2024-01-15 11:22:53 +00:00
vdimir
012713fc31
ClusterDiscovery supports setting username and password 2024-01-15 11:22:48 +00:00
zhongyuankai
826b29ef4d Max materialized views size for table 2024-01-15 10:02:57 +08:00
Blargian
72b5cf5993 #58363 - removed switch from PrettyBlockOutputFormat and modified BlockOutputFormats to use color variable. Updated english and russian documentation. Updated test 00405 reference file. 2024-01-12 19:46:03 +02:00
Ilya Yatsishin
1b548d3597
Update query-complexity.md to rerun tests 2024-01-12 20:44:46 +04:00
avogar
bfd7db8cf4 Better docs 2024-01-12 13:06:51 +00:00
avogar
fbfdde60a7 Add settings for better control of indexes type in Arrow dictionary. Use signed integer type for indexes by default 2024-01-12 13:06:51 +00:00
Robert Schulze
790f5890a0
Merge pull request #58611 from rschu1ze/qc-isolation
Improve isolation of query cache entries under re-created users or role switches
2024-01-11 17:30:24 +01:00
robot-ch-test-poll4
aba256d9cf
Merge pull request #58669 from ClickHouse/docs/show-non-default-settings
Tells reader how to show which settings have been changed from default.
2024-01-11 09:59:07 +01:00
robot-clickhouse-ci-1
26bc1b5b5c
Merge pull request #58682 from rschu1ze/docs-log-type
Docs: Update type of two column in `system.query_log/text_log`
2024-01-10 21:58:18 +01:00
Robert Schulze
1b739a8f03
Docs: Update type of two column in system.query_log/text_log 2024-01-10 20:14:39 +00:00
johnnymatthews
ebd7f19670 Example to show settings changed from default. 2024-01-10 12:38:38 -04:00
Robert Schulze
36173bbb7b
Merge remote-tracking branch 'rschu1ze/master' into qc_isolation 2024-01-10 09:57:13 +00:00
Robert Schulze
4cacfa6b43
Merge pull request #57509 from jinjunzh/qatzstd_main
Add Intel-QAT-based `ZSTD_QAT` compression codec
2024-01-10 10:31:39 +01:00
Kseniia Sumarokova
1b517105db
Merge pull request #57323 from valbok/mysql-binlog-client
MaterializedMySQL: Introduce MySQL Binlog Client
2024-01-10 09:08:13 +01:00
Robert Schulze
ced9e93ac6
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main 2024-01-09 20:36:02 +00:00
pufit
6cf55b82f4
Merge pull request #58539 from canhld94/file_custom_compress_level
Allow explicitly set compression level in output format
2024-01-09 13:43:38 -05:00
jsc0218
6fa368d296
Merge pull request #58449 from cw5121/keeper_client_doc_modify
refine keeper connection in doc
2024-01-09 13:24:29 -05:00
Robert Schulze
c04e4eb162
Merge remote-tracking branch 'rschu1ze/master' into qc-isolation 2024-01-09 16:30:20 +00:00
vdimir
b4bfd01322
Merge pull request #58246 from ClickHouse/vdimir/util_format_values
clickhouse-format improvements: support VALUES, comments, max_line_length
2024-01-09 11:24:42 +01:00
Duc Canh Le
37a7ce2950
Apply suggestions from code review
Co-authored-by: pufit <pufit@yandex.ru>
2024-01-09 17:17:30 +08:00
Yakov Olkhovskiy
cfa41e7dc6
Merge pull request #58038 from ClickHouse/revert-58022-revert-57555-ft-dropped_tables_parts
Add system.dropped_tables_parts table - second attempt
2024-01-09 00:47:07 -05:00
Robert Schulze
fabc06995e
Improve isolation of query results in query cache
Fixes #58054
2024-01-08 20:52:30 +00:00
Kruglov Pavel
b947609b8e
Merge branch 'master' into variant-data-type 2024-01-08 15:04:51 +01:00
vdimir
621d17b16f
Better clickhouse-format: support VALUES, comments 2024-01-08 12:01:33 +00:00
Robert Schulze
6665d23243
Merge pull request #58029 from skyoct/feat/server_settings
Add `changeable_without_restart` column to `system.server_settings`
2024-01-08 10:09:51 +01:00
Robert Schulze
0f51e32bb5
Rename from ZSTDQPL to ZSTD_QPL 2024-01-07 17:47:31 +00:00
Robert Schulze
e947ed710b
Hijack and document 'update' map to represent reload status 2024-01-07 13:09:27 +00:00
zhangyifan27
730135f933 Seperate max_execution_time and max_estimated_execution_time 2024-01-07 12:32:42 +08:00
Alexey Milovidov
a899f0a9ed
Merge pull request #58561 from Avogar/json-bool-as-string
Allow to read Bool values into String in JSON input formats
2024-01-06 21:41:36 +01:00
avogar
7e5ba62017 Allow to read Bool values into String in JSON input formats 2024-01-05 20:33:30 +00:00
Duc Canh Le
c3586b2e35 fix docs
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2024-01-05 07:23:22 +00:00
Duc Canh Le
934e006213 add document
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2024-01-05 07:13:46 +00:00
chenwei
4b26a08318 keeper connection mode in doc file not work.
1. use "-h localhost:9181" followed doc is aborted.
root@c64618ba15d1:~/data/zk# clickhouse-keeper-client -h localhost:9181
getservbyname
Aborted
2. use "-h localhost -p 9181" is ok.
root@c64618ba15d1:~/data/zk# clickhouse-keeper-client -h localhost -p 9181
Connected to ZooKeeper at 127.0.0.1:9181 with session_id 20
Keeper feature flag FILTERED_LIST: enabled
Keeper feature flag MULTI_READ: enabled
Keeper feature flag CHECK_NOT_EXISTS: disabled
Keeper feature flag CREATE_IF_NOT_EXISTS: disabled
/ :)
2024-01-05 14:23:04 +08:00
Mathieu Rey
9c46596556
Fix example 3 and tweak formatting
* example 3 is about having several SQL queries in the same input, made an example illustrating that
* removed the sql marker for all results except example 2 to emphasize when you would get colorized output in the terminal
2024-01-05 14:07:51 +08:00
Robert Schulze
1a467cc9b0
Merge remote-tracking branch 'ClickHouse/master' into docs-editing-query-cache-settings 2024-01-04 17:01:18 +00:00
Aliaksei Khatskevich
02db6c6b2b
Fix postgresql table function arguments documentation 2024-01-04 09:22:39 +01:00
Aliaksei Khatskevich
531131bbd6
Fix replication_queue.num_postponed documentation 2024-01-04 09:22:39 +01:00
Alexander Tokmakov
b1688b1953 Merge branch 'master' into rdb_dont_wait_inactive 2024-01-03 17:03:01 +01:00
Val Doroshchuk
5c221d123d MaterializedMySQL: Introduce MySQL Binlog Client
One binlog connection for many databases.

Suggesting to disable this feature by default for now. It should be explicitly enabled by SETTINGS use_binlog_client=1.
But if you would permanently enable it in MaterializedMySQLSettings, it should keep old behavior and all tests should pass too.

1. Introduced `IBinlog` and its impl to read the binlog events from socket - `BinlogFromSocket`, or file - `BinlogFromFile`. Based on prev impl of `EventBase` and the same old binlog parsers. It fully keeps BC with old version. Fixed `./check-mysql-binlog` to test new impl.
2. Introduced `BinlogEventsDispatcher`, it reads the event from the source `IBinlog` and sends it to currently attached `IBinlog` instances.
3. Introduced `BinlogClient`, which is used to group a list of `BinlogEventsDispatcher` by MySQL binlog connection which is defined by `user:password@host:port`. All dispatchers with the same binlog position should be merged to one.
4. Introduced `BinlogClientFactory`, which is a singleton and it is used to track all binlogs created over the instance.
5. Introduced `use_binlog_client` setting to `MaterializedMySQL`, which forces to reuse a `BinlogClient` if it already exists in `BinlogClientCatalog` or create new one. By default, it is disabled.
6. Introduced `max_bytes_in_binlog_queue` setting to define the limit of bytes in binlog's queue of events. If bytes in the queue increases this limit, `BinlogEventsDispatcher` will stop reading new events from source `IBinlog` until the space for new events will be freed.
7. Introduced `max_milliseconds_to_wait_in_binlog_queue` setting to define max ms to wait when the max bytes exceeded.
7. Introduced `max_milliseconds_to_wait_in_binlog_queue` setting to define max ms to wait when the max bytes exceeded.
8. Introduced `max_bytes_in_binlog_dispatcher_buffer` setting to define max bytes in the binlog dispatcher's buffer before it is flushed to attached binlogs.
9. Introduced `max_flush_milliseconds_in_binlog_dispatcher` setting to define max milliseconds in the binlog dispatcher's buffer to wait before it is flushed to attached binlogs.
10. Introduced `system.mysql_binlogs` system table, which shows a list of active binlogs.
11. Introduced `UnparsedRowsEvent` and `MYSQL_UNPARSED_ROWS_EVENT`, which defines that an event is not parsed and should be explicitly parsed later.
12. Fixed bug when not possible to apply DDL since syntax error or unsupported SQL.

@larspars is the author of following:
`GTIDSets::contains()`
`ReplicationHelper`
`shouldReconnectOnException()`
2024-01-03 15:26:09 +01:00
Kruglov Pavel
4d8cf71ba7
Merge branch 'master' into variant-data-type 2024-01-03 15:21:23 +01:00
Alexey Milovidov
eb930efebb
Merge pull request #57732 from ClickHouse/load-metadata-threads
Increase `load_metadata_threads` to 16
2024-01-02 22:26:18 +01:00
Bharat Nallan Chakravarthy
00b5e28d6a Merge upstream/master into ncb/system-database-engines 2023-12-30 23:10:48 -08:00
Bharat Nallan Chakravarthy
2996c8167f add docs 2023-12-30 20:48:35 -08:00
Alexey Milovidov
7bded0a5e7
Merge pull request #58316 from ClickHouse/reintroduce_is_deleted
Re-introduce `is_deleted` column for ReplacingMergeTree
2023-12-31 00:57:19 +01:00
robot-ch-test-poll4
09ffe8ffcc
Merge pull request #57837 from ClickHouse/pufit/docs-patch-roles
Added information about preconfigured roles in users.xml to the docs
2023-12-30 13:09:50 +01:00
robot-ch-test-poll3
d5894aa286
Merge pull request #58311 from ClickHouse/system-errors-doc
Improve system.errors documentation
2023-12-30 12:58:12 +01:00
Dmitry Novik
46dfc37397
Fixup 2023-12-30 10:41:41 +01:00
Alexander Tokmakov
1013f6b23f
Merge branch 'master' into reintroduce_is_deleted 2023-12-29 15:46:24 +01:00
Alexander Tokmakov
bfc10bd234 an option to avoid waiting for inactive Replicated db replicas 2023-12-29 15:19:16 +01:00
Michael Kolupaev
96c68e5aae Remove pausing, enable multithreading, kick off refresh on table creation unless the query says EMPTY 2023-12-28 17:56:06 +00:00
Michael Kolupaev
f0417d0ec3 Things 2023-12-28 17:56:05 +00:00
Michael Kolupaev
8b8ef41407 Documentation 2023-12-28 17:56:05 +00:00
Dmitry Novik
50e531bf93 Improve system.errors documentation 2023-12-28 14:47:30 +00:00
Alexander Tokmakov
bdada351c8 Revert "Merge pull request #58274 from ClickHouse/revert-58267"
This reverts commit 583b9637c2, reversing
changes made to 224e937620.
2023-12-28 14:07:59 +01:00
Alexander Tokmakov
38fe70c68a
Revert "Refreshable materialized views (takeover)" 2023-12-28 13:12:20 +01:00
Smita Kulkarni
bf60a06a11 Merge branch 'master' into Azure_backup 2023-12-28 11:51:49 +01:00
Alexey Milovidov
524d53199d
Merge branch 'master' into mv 2023-12-28 04:11:48 +01:00
Alexey Milovidov
c7efd2afea Revert #58267 2023-12-28 04:09:33 +01:00
Alexey Milovidov
40a5dbdeba
Merge branch 'master' into mv 2023-12-28 03:16:27 +01:00
Alexey Milovidov
dcbd3b9c26
Merge pull request #58267 from ClickHouse/fix_is_deleted_compatibility
Re-introduce `is_deleted` column for ReplacingMergeTree
2023-12-28 00:13:01 +01:00
Michael Kolupaev
b9cbecb0df Remove pausing, enable multithreading, kick off refresh on table creation unless the query says EMPTY 2023-12-27 20:24:56 +00:00
Michael Kolupaev
538b23d862 Things 2023-12-27 20:24:55 +00:00
Michael Kolupaev
7786b12a89 Documentation 2023-12-27 20:24:55 +00:00
Sema Checherinda
617ee5abaf
Merge pull request #57551 from bharatnc/ncb/async-metrics-pri-key-size
add asynchronous metrics for total primary key size in memory and allocated
2023-12-27 20:24:20 +01:00
Alexander Tokmakov
01d042c490 Revert "Merge pull request #57932 from ClickHouse/remove-shit-cleanup"
This reverts commit 2d58dc512c, reversing
changes made to 41873dc4a3.
2023-12-27 13:46:06 +01:00
santrancisco
91835256aa
fix doc 2023-12-26 16:57:18 +11:00
Smita Kulkarni
3e22f29b45 Fixed parameters 2023-12-23 11:40:58 +01:00
Azat Khuzhin
74ea601dc2 Add documentation for MemoryResidentMax metric in system.asynchronous_metrics
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-22 18:38:44 +01:00
Bharat Nallan Chakravarthy
62b28d365c Merge with upstream/master 2023-12-21 17:04:25 -08:00
skyoct
342a4f7b96 add doc and opt some code 2023-12-21 14:25:18 +00:00
Christoph Wurm
9def89d416 Fix anchors to settings.md 2023-12-20 18:26:36 +00:00
San
e2fb159911
Merge pull request #58053 from ClickHouse/update_query_cache_doc
Updating query cache doc with security consideration
2023-12-20 13:50:08 +11:00
San
d2d0c970aa
Update query-cache.md
Fixing spelling and explain clearer.
2023-12-20 12:45:36 +11:00
Yakov Olkhovskiy
43fcea64b6
Merge pull request #57186 from chenlx0/bytes_uncompressed
Show uncompressed data size in system.tables
2023-12-19 19:04:47 -05:00
santrancisco
82ffb570b0
Remove newline 2023-12-20 10:44:46 +11:00
Kruglov Pavel
087946f385
Merge branch 'master' into variant-data-type 2023-12-20 00:40:18 +01:00
santrancisco
2dda0ccfb7
Updating query cache doc with security consideration 2023-12-20 10:39:07 +11:00
Jordi Villar
7c281d9a6f
Allow max_size_to_drop settings in query time (#57452) 2023-12-19 23:16:03 +01:00
avogar
319ae440b6 Implement Variant data type 2023-12-19 16:45:15 +00:00
Bharat Nallan Chakravarthy
ecd2843b47 add a clarification to docs 2023-12-19 08:35:14 -08:00
Yakov Olkhovskiy
3d8933f241
Revert "Revert "Add system.dropped_tables_parts table"" 2023-12-19 10:44:44 -05:00
Robert Schulze
952175ce39
Merge pull request #57875 from zhongyuankai/order_by_all
Support `ORDER BY ALL`
2023-12-19 13:38:07 +01:00
vdimir
252cb8a507
Merge pull request #54602 from fionera/issue-49028
Add setting http_make_head_request
2023-12-19 13:33:59 +01:00
Robert Schulze
91609a104c
Merge pull request #57547 from rschu1ze/docs-mv-table-engine
Docs: Remove mention of materialized view table engine
2023-12-19 13:29:56 +01:00
Robert Schulze
6053fa9d89
Merge remote-tracking branch 'rschu1ze/master' into docs-mv-table-engine 2023-12-19 11:52:26 +00:00
Justin de Guzman
a924b01a02
[Docs] Clarify to use query level settings in ClickHouse Cloud 2023-12-19 02:05:32 -08:00
Antonio Andelic
52b3caec90
Revert "Add system.dropped_tables_parts table" 2023-12-19 10:36:22 +01:00
Alexey Milovidov
eecacf528d
Merge pull request #57983 from cwurm/patch-2
Update settings.md: allow_experimental_parallel_reading_from_replicas
2023-12-18 21:30:10 +01:00
Bharat Nallan Chakravarthy
aef4e2e6ec Merge upstream/master into ncb/async-metrics-pri-key-size 2023-12-18 09:46:51 -08:00
Christoph Wurm
e357c088a0 Update settings.md: allow_experimental_parallel_reading_from_replicas
Document all possible values for `allow_experimental_parallel_reading_from_replicas`.
2023-12-18 16:55:44 +00:00
Yakov Olkhovskiy
8e39c61401 Merge remote-tracking branch 'origin/master' into ft-dropped_tables_parts 2023-12-18 15:40:07 +00:00
Robert Schulze
9033c96e29
Some fixups 2023-12-17 09:11:16 +00:00
Sergei Trifonov
3634b949a8
Merge pull request #57793 from ClickHouse/rename-system-table
Rename `system.async_loader` into `system.asynchronous_loader`
2023-12-16 17:33:04 +01:00
Sergei Trifonov
37a01bc109
Merge branch 'master' into ft-dropped_tables_parts 2023-12-16 11:53:37 +01:00
Alexey Milovidov
ee502ef6b9 Remove trash (OPTIMIZE CLEANUP) 2023-12-15 22:41:58 +01:00
Sema Checherinda
0dfe530a7f
Merge pull request #56744 from MikhailBurdukov/native_copy_for_s3_disks
Enabled s3 `copyObject` for copy between s3 disks.
2023-12-15 16:05:16 +01:00
Alexey Milovidov
23cee7ef37
Merge pull request #57851 from azat/revert-55271-local-lazy-database
Revert "Replace --no-system-tables with loading virtual tables of system database lazily"
2023-12-15 03:25:59 +01:00
Christoph Wurm
64a58ee445
Update clickhouse-benchmark.md: Remove json output
Suppport for `--json` was removed in https://github.com/ClickHouse/ClickHouse/pull/53293.
2023-12-14 14:15:41 +00:00
serxa
eff4196be1 review fix 2023-12-14 14:12:27 +00:00
Azat Khuzhin
0e86e16a01
Revert "Replace --no-system-tables with loading virtual tables of system database lazily" 2023-12-14 09:07:47 +01:00
pufit
f49894f644
Added information about preconfigured roles in users.xml to the docs 2023-12-13 23:28:21 -05:00
Yakov Olkhovskiy
de755202dd
Create dropped_tables_parts.md 2023-12-13 18:32:54 -05:00
Han Fei
6abe4b113a
Merge pull request #57375 from lingtaolf/feature/more_warnings
Feature/more warnings
2023-12-12 22:48:51 +01:00
serxa
57d7a58dbe Rename system.async_loader into system.asynchronous_loader 2023-12-12 16:55:27 +00:00
Kruglov Pavel
6567fb2c08
Merge pull request #56859 from Avogar/csv-infer-numbers-from-strings
Allow to infer numbers from strings in CSV format
2023-12-12 17:09:02 +01:00
Han Fei
a96593c8b1 Merge branch 'master' into feature/more_warnings 2023-12-12 15:25:01 +01:00
Chen Lixiang
68af81196d
Merge branch 'ClickHouse:master' into bytes_uncompressed 2023-12-12 22:06:45 +08:00
avogar
1db000dae5 Add docs 2023-12-11 18:02:05 +00:00
Kruglov Pavel
3b1ffbd77c
Merge branch 'master' into schema-inference-union 2023-12-11 18:59:15 +01:00
MikhailBurdukov
119e451967 Merge branch 'master' into native_copy_for_s3_disks 2023-12-11 07:25:20 +00:00
Alexey Milovidov
27f19635cd Increase load_metadata_threads to 16 2023-12-11 00:49:20 +01:00
Azat Khuzhin
cc9afe6f6e Replace --no-system-tables with loading virtual tables of system database lazily
First of all the problem is that that simple 'SELECT 1' cannot be runned
without system.one, which makes --no-system-tables almost useless:

    $ ./clickhouse-debug local --no-system-tables -q "select 1"
    Code: 81. DB::Exception: Database system does not exist. (UNKNOWN_DATABASE)

Secondly there are just too much flags, and this one
(--no-system-tables) is too damn specific.

This patch should improve startup time of the clickhouse-local almost
3x in debug builds.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-09 23:08:29 +01:00
Chen Lixiang
7cd770e9a7 fix doc and comments 2023-12-09 20:09:41 +08:00
avogar
ee7af95bc0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-12-08 20:29:28 +00:00
hdhoang
fc8292182c
fix typo TKSV
correct name is TS-KV
2023-12-07 20:19:00 +07:00
Chen Lixiang
9e95fe5d29 conflict fixed. 2023-12-07 18:10:45 +08:00
Alexey Milovidov
0b597eadf8 Clarify the usage of prefer_not_to_merge option 2023-12-06 12:11:03 +01:00
Robert Schulze
1276c3ab80
Try to fix broken links 2023-12-06 08:48:56 +00:00
Bharat Nallan Chakravarthy
41b2b63cee add docs 2023-12-05 18:50:36 -08:00
xleoken
f07599b7c0 fix tip doc 2023-12-05 17:52:33 +08:00
Alexey Milovidov
1f752b79db
Merge pull request #55894 from bharatnc/ncb/hostname-system-log-tables
add hostname column to system log tables
2023-12-05 06:42:43 +01:00
robot-clickhouse-ci-1
9321238515
Merge pull request #56647 from ClickHouse/docs-observability-dashboard
[Docs] Add built-in observability dashboard
2023-12-05 06:37:41 +01:00
凌涛
9e05e79d66
Merge branch 'master' into feature/more_warnings 2023-12-05 11:50:05 +08:00
凌涛
6794bbe196 rebase master 2023-12-05 11:42:25 +08:00
凌涛
8ea9403d0f modify docs 2023-12-05 11:39:54 +08:00
Alexey Milovidov
02439eee58
Merge pull request #49351 from ClickHouse/async-loader-integration
Asynchronous loading of tables
2023-12-04 17:16:12 +01:00
Bharat Nallan Chakravarthy
440dc66a5c Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables 2023-12-03 15:19:47 -08:00
Sema Checherinda
c61cd6aab2
Merge pull request #57335 from sichenzhao/increase_default_replicated_deduplication_window
increase default replicated_deduplication_window from 100 to 1k
2023-12-02 21:23:39 +01:00
Nikita Taranov
a32c5e976a
Don't print server revision in client on connect (#57435) 2023-12-02 16:32:34 +01:00
JackyWoo
8a68d51261
Add index to table system.numbers (#50909) 2023-12-01 19:59:25 +01:00
凌涛
31894bc9df
Update settings.md 2023-12-01 10:38:42 +08:00
Kruglov Pavel
575ee1e665
Merge pull request #56868 from zvonand/zvonand-fileCluster
Introduce `fileCluster` table function
2023-11-30 13:49:53 +01:00
Alexander Zaitsev
d001e25787
doc: update profile-guided-optimization.md
- update PGO recommendations according to the https://github.com/llvm/llvm-project/issues/45668
2023-11-30 06:41:59 +03:00
zvonand
c329e382ab resolve conflicts 2023-11-29 16:03:07 +01:00
Han Fei
4c0efb0262
Merge pull request #53240 from hanfei1991/hanfei/statistic
use statistic to order prewhere conditions better
2023-11-29 12:26:44 +01:00
robot-clickhouse-ci-1
1740ef80e5
Merge pull request #57209 from ClickHouse/errors-prometheus
Expose the number of errors occurred on server from the Prometheus endpoint.
2023-11-29 10:39:04 +01:00
Sichen Zhao
1b8b1c0a63 increase default replicated_deduplication_window from 100 to 1k 2023-11-28 14:24:06 -08:00
Dmitry Novik
e9faad77cb
Simplify docs 2023-11-28 17:41:51 +01:00
zvonand
c306d21b54 merge master + resolve conflicts 2023-11-28 15:51:21 +01:00
Han Fei
7bd2ea3add Merge branch 'master' into hanfei/statistic 2023-11-27 23:31:23 +01:00
Bharat Nallan Chakravarthy
1d788ac1c1 fix docs 2023-11-27 08:05:14 -08:00
MikhailBurdukov
6f19e8ebd1
Merge branch 'master' into native_copy_for_s3_disks 2023-11-27 14:25:36 +03:00
Justin de Guzman
cc57e67e83
Fix docs check erorr 2023-11-26 23:57:33 -08:00
Bharat Nallan Chakravarthy
6454687fa6 Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables 2023-11-26 16:24:18 -08:00
Alexey Milovidov
f636dea879
Merge pull request #54327 from den-crane/background_fetches_pool_size
increase background_fetches_pool_size to 16, background_schedule_pool_size to 512
2023-11-26 02:50:38 +01:00
Robert Schulze
e074629749
Docs: Mention alias 'database' for 'name' in system.databases 2023-11-25 22:04:49 +00:00
Robert Schulze
5b7d2a903d
Merge pull request #57152 from rschu1ze/fine-granular-plan-opt-settings
Fine-granular enablement/disabling of plan-level optimizations
2023-11-25 20:44:23 +01:00
Nikita Mikhaylov
1b623b0e48 Done 2023-11-24 20:03:02 +00:00
Vitaly Baranov
5769a88b92
Merge pull request #57133 from vitlibar/change-default-for-wait_dictionaries_load_at_startup
Change the default for wait_dictionaries_load_at_startup to true
2023-11-24 17:09:05 +01:00
Robert Schulze
ca63881357
Mention that the settings are dev settings 2023-11-24 14:46:02 +00:00
vdimir
1044e3366b
Update http_make_head_request doc 2023-11-24 09:32:20 +00:00
Tim Windelschmidt
51e3899f73
Add setting http_make_head_request
Clickhouse always does a HEAD request before actually executing the GET request,
this adds a settings to skip that request.
2023-11-24 09:32:16 +00:00
vdimir
e5284c125f
Update blob_storage_log.md 2023-11-24 10:02:47 +01:00
Chen Lixiang
2b35e98ef8 add comments and doc 2023-11-24 16:40:19 +08:00
Robert Schulze
a8a3214185
+ documentation 2023-11-23 19:43:40 +00:00
Vitaly Baranov
5f461ff780 Change the default for "wait_dictionaries_load_at_startup" to true,
and use this setting only if "dictionaries_lazy_load" is false.
2023-11-23 14:45:42 +01:00
serxa
663c8cd944 Merge branch 'master' into dashboards-table 2023-11-23 10:29:48 +00:00
serxa
0fc25fbda8 Merge branch 'master' into async-loader-integration 2023-11-23 09:32:43 +00:00
zvonand
5153798aeb Introduced fileCluster table function
Added fileCluster function
Added test and docs
2023-11-22 15:06:04 +01:00
vdimir
15234474d7
Implement system table blob_storage_log 2023-11-21 09:18:25 +00:00
avogar
f537bad469 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-11-20 14:32:50 +00:00
avogar
872556a5d4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-11-20 14:03:36 +00:00
Sema Checherinda
f999337dae
Revert "Revert "s3 adaptive timeouts"" 2023-11-20 14:53:22 +01:00
Alexander Tokmakov
5031f239c3
Revert "s3 adaptive timeouts" 2023-11-20 14:28:59 +01:00
Smita Kulkarni
6dfb1c25ec Added docs 2023-11-20 11:37:06 +01:00
Bharat Nallan Chakravarthy
d08512d8c0 Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables 2023-11-19 14:06:40 -08:00
Sema Checherinda
a950595c24
Merge pull request #56314 from CheSema/s3-aggressive-timeouts
s3 adaptive timeouts
2023-11-19 14:12:14 +01:00
serxa
9023f61349 Merge branch 'master' into async-loader-integration 2023-11-19 13:05:58 +00:00
Justin de Guzman
96e87322b5
[Docs] Add insert_distributed_sync to Core Settings docs 2023-11-18 18:10:43 -08:00
Alexey Milovidov
0158db3e07
Merge pull request #56092 from ClickHouse/docs-max-block-size
Set correct default `max_block_size` value in docs
2023-11-18 17:23:43 +01:00
Bharat Nallan Chakravarthy
7434dd9e0a Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables 2023-11-16 11:17:45 -08:00
Kruglov Pavel
2062bd2f1c
Merge pull request #56707 from ClickHouse/revert-56702-revert-51823-ch_add_max_execution_time_leaf
Revert "Revert "Add a setting max_execution_time_leaf to limit the execution time on shard for distributed query""
2023-11-16 14:49:05 +01:00
serxa
3920926cd6 add docs 2023-11-16 12:40:15 +00:00
Vitaly Baranov
342e6c7546
Merge pull request #56782 from vitlibar/add-config-setting-wait_dictionaries_load_at_startup
Add config setting "wait_dictionaries_load_at_startup"
2023-11-16 11:51:29 +01:00
Vitaly Baranov
946e02ecbc
Merge pull request #56268 from vitlibar/add-script-backup-view
Add an external utility to view backups and to extract information from them
2023-11-16 11:17:16 +01:00
Mikhail f. Shiryaev
993c3e6dba
Update outdated script in troubleshooting 2023-11-15 15:09:22 +01:00
Vitaly Baranov
d62048031f Add documentation. 2023-11-15 13:57:28 +01:00
Bharat Nallan Chakravarthy
e164c1d257 update docs 2023-11-14 18:22:36 -08:00
MikhailBurdukov
efce883133 Added docs 2023-11-14 14:22:15 +00:00
Kruglov Pavel
8e88bf1348 Revert "Revert "Add a setting max_execution_time_leaf to limit the execution time on shard for distributed query"" 2023-11-14 11:40:48 +00:00
Sema Checherinda
76d11687a7 adjuct docs 2023-11-14 11:34:12 +01:00
Sema Checherinda
e0edd165da add doc 2023-11-14 11:34:12 +01:00
Robert Schulze
361a3ca11f
Merge pull request #56519 from rschu1ze/qc-ignore-nondeterministic-queries
Query cache: Allow to ignore non-deterministic queries
2023-11-13 21:32:44 +01:00
Alexander Tokmakov
0622379ec7
Revert "Add a setting max_execution_time_leaf to limit the execution time on shard for distributed query" 2023-11-13 21:11:07 +01:00
Bharat Nallan Chakravarthy
d90b8b6fba Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables 2023-11-13 08:43:37 -08:00
Robert Schulze
7864df4826
Update docs + Try to stabilize test results, pt. II 2023-11-13 10:57:33 +00:00
Vitaly Baranov
a4d57fe108 Rename the name of the utility "backupview" -> "clickhouse_backupview". 2023-11-13 10:15:37 +01:00
Vitaly Baranov
f12b95df7d Add documentation. 2023-11-13 09:43:06 +01:00
Kseniia Sumarokova
b7915e6983
Merge pull request #55782 from aiven-sal/aiven-sal/namedcoll_pr
NamedCollections: prevent fields overriding in functions' calls
2023-11-13 09:07:09 +01:00
Justin de Guzman
747deb13e2
[Docs] Add built-in observability dashboard 2023-11-12 18:13:25 -08:00
Robert Schulze
91f53514d9
Incorporate review feedback 2023-11-12 15:11:38 +00:00
Robert Schulze
52c825db44
Query cache: Allow to ignore non-deterministic queries
Fixes: #56504
2023-11-12 15:11:38 +00:00
Antonio Andelic
f6d5ac485e
Merge pull request #56620 from chhetripradeep/pchhetri/demote-leader-before-stop-second-attempt
Add 4-letter command for yielding leadership
2023-11-12 11:38:40 +01:00
Alexey Milovidov
04630c3e5a Merge branch 'master' into better-settings 2023-11-11 09:26:59 +01:00
Pradeep Chhetri
d0922782ed Revert "Revert "Add 4-letter command for yielding/resigning leadership""
This reverts commit e1766b96d9.
2023-11-11 15:37:49 +08:00
Alexey Milovidov
e1766b96d9
Revert "Add 4-letter command for yielding/resigning leadership" 2023-11-11 05:45:02 +03:00
Alexey Milovidov
280658db3b
Merge pull request #56539 from ClickHouse/remove/unnecessary-slugs-in-docs
Removes duplicated slugs in docs.
2023-11-10 17:00:10 +01:00
Alexey Milovidov
1d51727aa5
Update symbols.md 2023-11-10 01:47:00 +03:00
Alexey Milovidov
d41d1a205e Add docs 2023-11-09 23:43:12 +01:00
johnnymatthews
ecc012cc4d Removes duplicated slugs in docs. 2023-11-09 12:41:39 -04:00
Salvatore Mesoraca
7d206cbc3c
NamedCollections: prevent fields overriding in functions call
Add syntax in SQL and XML to mark specific fields to allow
override or not.
Also add a new setting to control the default behaviour when
overriding support is not specified.
2023-11-09 17:25:16 +01:00
Antonio Andelic
e9542e4153
Merge pull request #54957 from ClickHouse/49507_Support_compression_for_keeper_protocol
Support compression for keeper protocol
2023-11-09 10:00:19 +01:00
Alexey Milovidov
d34809bc7c Revert a wrong change in server settings 2023-11-09 00:32:43 +01:00
Yarik Briukhovetskyi
b8ea31db43
Merge pull request #56309 from yariks5s/preferred_optimize_projection_name
New setting preferred_projection_name
2023-11-08 18:06:03 +01:00
Alexey Milovidov
565559b7f3
Update sampling-query-profiler.md 2023-11-08 19:07:34 +03:00
slvrtrn
1068478591 Update docs formatting 2023-11-07 19:18:59 +01:00
slvrtrn
94143ac002 Add information_schema.statistics docs 2023-11-07 19:14:44 +01:00
Sema Checherinda
02df5ac59c
Merge pull request #54340 from KevinyhZou/bug_fix_csv_parse_crlf
Fix CSV read while the end of line is CR(\r)
2023-11-07 12:51:05 +01:00
serxa
19aa1375fc Merge branch 'master' into async-loader-integration 2023-11-07 10:25:38 +00:00
Pradeep Chhetri
0aaaf320b6 Update document of keeper-client to let CI run 2023-11-07 13:58:45 +08:00
robot-clickhouse
25558fe0a6
Merge pull request #56390 from ClickHouse/vdimir/doc_architecture_upd_streams
Update development documentation about data streams
2023-11-07 00:54:31 +01:00
vdimir
c583b992ba
Update development documentation about data streams 2023-11-06 18:42:56 +00:00
Sema Checherinda
a5e17dc919
Merge pull request #55566 from CheSema/remote-blobs-naming
feature: storage_metadata_write_full_object_key
2023-11-06 16:41:49 +01:00
serxa
6babc8e934 rename metrics for new pools to match settings 2023-11-06 12:24:00 +00:00
kevinyhzou
2a50daf5dd Allow cr at end of csv line 2023-11-06 12:21:42 +08:00
kevinyhzou
ef30e6723d bug fix csv read while end of line is not crlf 2023-11-06 12:21:42 +08:00
Robert Schulze
049c811a38
Make type names in SHOW COLUMNS dependent only on connection type 2023-11-05 21:20:20 +00:00
Arthur Passos
b6e205dcdf
Add ClickHouse setting to disable tunneling for HTTPS requests over HTTP proxy (#55033)
* initial commit. integ tests passing, need to re-run unit & my own personal tests

* partial refactoring to remove Protocol::ANY

* improve naming

* remove all usages of ProxyConfiguration::Protocol::ANY

* fix ut

* blabla

* support url functions as well

* support for HTTPS requests over HTTP proxy with tunneling off

* remove gtestabc

* fix silly mistake

* ...

* remove usages of httpclientsession::proxyconfig in src/

* got you

* remove stale comment

* it seems like I need reasonable defaults

* fix ut

* add some comments

* remove no longer needed header

* matrix out

* add https over http proxy with no tunneling

* soem docs

* partial refactoring

* rename to use_tunneling_for_https_requests_over_http_proxy

* improve docs

* use shorter version

* remove useless test

* rename the setting

* update

* fix typo

* fix setting docs typo

* move ); up

* move ) up
2023-11-04 13:47:52 -04:00
yariks5s
d95262622b init 2023-11-03 16:47:06 +00:00
Denny Crane
dbaebe18f1
Update settings.md 2023-11-03 13:14:56 -03:00
Denny Crane
9dbd229462
Update settings.md 2023-11-03 13:09:51 -03:00
Kruglov Pavel
81b1ca22bb
Merge pull request #51823 from canhld94/ch_add_max_execution_time_leaf
Add a setting max_execution_time_leaf to limit the execution time on shard for distributed query
2023-11-03 13:31:15 +01:00
Duc Canh Le
dd6b02a2fd add document
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-11-03 03:00:13 +00:00
serxa
e97edf5285 Merge branch 'master' into async-loader-integration 2023-11-02 14:56:32 +00:00
Sema Checherinda
90b64bcdb9 backward compatibility and implementation feature storage_metadata_write_full_object_key 2023-11-02 15:20:55 +01:00
Alexey Milovidov
1267246785
Merge pull request #55642 from ClickHouse/morton-utils
Indexing by space-filling curves
2023-11-02 12:21:33 +01:00
robot-ch-test-poll1
a5fb7b0a1e
Merge pull request #56213 from ttanay/sort-spill-to-disk-docs
Add `max_bytes_before_external_sort` setting to query complexity doc
2023-11-02 00:50:30 +01:00
Denny Crane
d145ddb293 fix asell 2023-11-02 00:01:42 +01:00
Denny Crane
71322bde3f
Update index.md 2023-11-01 17:07:27 -03:00
Tanay Tummalapalli
6a3b2a04d8 Add max_bytes_before_external_sort setting to query complexity doc
The setting should be mentioned here along with
`max_bytes_before_external_group_by` setting.

Note: The russian translation is courtesy of Google Translate.
2023-11-01 22:33:25 +05:30
Azat Khuzhin
c25d6cd624
Rename directory monitor concept into background INSERT (#55978)
* Limit log frequence for "Skipping send data over distributed table" message

After SYSTEM STOP DISTRIBUTED SENDS it will constantly print this
message.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename directory monitor concept into async INSERT

Rename the following query settings (with preserving backward
compatiblity, by keeping old name as an alias):
- distributed_directory_monitor_sleep_time_ms -> distributed_async_insert_sleep_time_ms
- distributed_directory_monitor_max_sleep_time_ms -> distributed_async_insert_max_sleep_time_ms
- distributed_directory_monitor_batch -> distributed_async_insert_batch_inserts
- distributed_directory_monitor_split_batch_on_failure -> distributed_async_insert_split_batch_on_failure

Rename the following table settings (with preserving backward
compatiblity, by keeping old name as an alias):
- monitor_batch_inserts -> async_insert_batch
- monitor_split_batch_on_failure -> async_insert_split_batch_on_failure
- directory_monitor_sleep_time_ms -> async_insert_sleep_time_ms
- directory_monitor_max_sleep_time_ms -> async_insert_max_sleep_time_ms

And also update all the references:

    $ gg -e directory_monitor_ -e monitor_ tests docs | cut -d: -f1 | sort -u | xargs sed -e 's/distributed_directory_monitor_sleep_time_ms/distributed_async_insert_sleep_time_ms/g' -e 's/distributed_directory_monitor_max_sleep_time_ms/distributed_async_insert_max_sleep_time_ms/g' -e 's/distributed_directory_monitor_batch_inserts/distributed_async_insert_batch/g' -e 's/distributed_directory_monitor_split_batch_on_failure/distributed_async_insert_split_batch_on_failure/g' -e 's/monitor_batch_inserts/async_insert_batch/g' -e 's/monitor_split_batch_on_failure/async_insert_split_batch_on_failure/g' -e 's/monitor_sleep_time_ms/async_insert_sleep_time_ms/g' -e 's/monitor_max_sleep_time_ms/async_insert_max_sleep_time_ms/g' -i

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename async_insert for Distributed into background_insert

This will avoid amigibuity between general async INSERT's and INSERT
into Distributed, which are indeed background, so new term express it
even better.

Mostly done with:

    $ git di HEAD^ --name-only | xargs sed -i -e 's/distributed_async_insert/distributed_background_insert/g' -e 's/async_insert_batch/background_insert_batch/g' -e 's/async_insert_split_batch_on_failure/background_insert_split_batch_on_failure/g' -e 's/async_insert_sleep_time_ms/background_insert_sleep_time_ms/g' -e 's/async_insert_max_sleep_time_ms/background_insert_max_sleep_time_ms/g'

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Mark 02417_opentelemetry_insert_on_distributed_table as long

CI: https://s3.amazonaws.com/clickhouse-test-reports/55978/7a6abb03a0b507e29e999cb7e04f246a119c6f28/stateless_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-01 15:09:39 +01:00
Smita Kulkarni
3fdf0daf1b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-31 10:43:28 +01:00
Alexey Milovidov
016285ea87
Merge branch 'master' into morton-utils 2023-10-31 01:47:16 +01:00
avogar
7eefb72c53 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-10-30 19:44:26 +00:00
yariks5s
0846714052 added docs, changed tests 2023-10-30 17:17:53 +00:00
Justin de Guzman
e33dc02c8c
Add note clarifying Prometheus support in ClickHouse Cloud (#56069) 2023-10-30 13:35:02 +01:00
Han Fei
19cdc6dfe2 Merge branch 'master' into hanfei/statistic 2023-10-30 04:53:18 +01:00
Justin de Guzman
940d099e84
Set correct max_block_size value in docs 2023-10-27 16:50:34 -07:00
Bharat Nallan Chakravarthy
d86b751283 fix tests 2023-10-27 11:02:51 -07:00
Bharat Nallan Chakravarthy
429ddc8ed5 init docs 2023-10-27 11:02:51 -07:00
Kruglov Pavel
bb4b95e891
Merge branch 'master' into schema-inference-union 2023-10-27 14:53:58 +02:00
Smita Kulkarni
960927a323 Updated name to use_compression 2023-10-27 14:53:54 +02:00
Robert Schulze
a68e8be08f
Merge pull request #55696 from zvonand/zvonand-datetime-ranges
Introduce setting `date_time_overflow_behavior` to control the overflow behavior when converting to `Date` / `Date32` / `DateTime` / `DateTime64`
2023-10-27 10:40:20 +02:00
Sergei Trifonov
a5d7c2b6a2
Merge branch 'master' into async-loader-integration 2023-10-27 10:39:12 +02:00
zvonand
35baf7792d cleanup after rebase, add [[unlikely]] 2023-10-26 23:56:45 +02:00
Kruglov Pavel
570b66f027
Merge branch 'master' into schema-inference-union 2023-10-26 19:26:00 +02:00
Smita Kulkarni
d1d8f4b2e1 Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-26 16:56:03 +02:00
Alexander Tokmakov
fa963d60d0
Merge pull request #55641 from evillique/resubmit-cluster-groups
Resubmit #54421
2023-10-26 15:53:53 +02:00
Andrey Zvonov
5737369d0b
Merge branch 'ClickHouse:master' into zvonand-datetime-ranges 2023-10-26 11:42:13 +02:00
vdimir
12890eb70c
Merge pull request #55806 from canhld94/rocksdb_trivial_count
Support trivial count for rocksdb and storage join
2023-10-26 11:22:38 +02:00
zvonand
0766c73aab Rename date_time_overflow_mode -> date_time_overflow_behavior, moved it to format settings 2023-10-25 23:11:13 +02:00
zvonand
5b86e8c714 updated after review 2023-10-25 23:10:58 +02:00
zvonand
2f3695add8 Introduce setting for dt overflow exception
Added tests and docs
2023-10-25 23:10:24 +02:00
Alexey Milovidov
bb5a60dc19
Merge pull request #55893 from ClickHouse/revert-partial-result-2
Revert "Revert "Revert "Add settings for real-time updates during query execution"""
2023-10-25 22:20:28 +02:00
Nikolay Degterinsky
95f58777e9 Fix style 2023-10-25 19:04:30 +00:00
xuzifu666
010cc6918a
Add get_direct_children_number command to keeper-client (#55898) 2023-10-24 17:02:54 +02:00
serxa
749cdb9954 Merge branch 'master' into async-loader-integration 2023-10-24 10:09:49 +00:00
vdimir
da6f3346fe
Merge pull request #55839 from ClickHouse/vdimir/async_executor_for_dictionary_load
Use AsyncPipelineExecutor all dictionaries
2023-10-24 11:31:36 +02:00
Duc Canh Le
5291cb7790 add document
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-10-24 07:07:47 +00:00
Smita Kulkarni
ede91f42e6 Addressed review comments 2023-10-23 16:42:08 +02:00
avogar
cfa510ea0a Add more documentation, fix build 2023-10-23 14:38:34 +00:00
Alexey Milovidov
2972dbdc40 Merge branch 'master' into morton-utils 2023-10-22 03:52:30 +02:00
Alexey Milovidov
7ec4b99e94 Revert partial result 2023-10-21 03:14:22 +02:00
avogar
9ec43d8cb9 Add basic docs, fix unrelated changes 2023-10-20 21:02:33 +00:00
Alexander Tokmakov
f899254e2c
Merge pull request #55430 from arthurpassos/properly_split_remote_proxy_http_https
Properly split remote proxy http https
2023-10-20 21:15:34 +02:00
Aleksei Filatov
0a1f3f205c
Add external HTTP Basic authenticator (#55199) 2023-10-20 19:24:19 +02:00
Raúl Marín
07e3f10958
Merge pull request #55860 from jrdi/filesystem-cache-docs
Add load_metadata_threads to the documentation
2023-10-20 14:59:47 +02:00
Smita Kulkarni
c98782bd2b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-20 14:47:17 +02:00
helifu
57d60dc4f2
Add a new column xid for zookeeper_connection (#50702)
* Refactor the code

* Add a new column xid for zookeeper_connection

* Support hostnames in the configuration

* Fix a typo

* Fix a typo

* Fix a typo

* Fix a bug about connect_time

* Update test case

* Update test case

* Fix a special build check error

* Resolve conflicts caused by rebase.

* Update failed test case

* Refactor the code according to comment

* Fix two compilation errors
2023-10-20 11:38:44 +02:00
Jordi Villar
01093d4698 Remove deprecated setting do_not_evict_index_and_mark_files 2023-10-20 09:27:46 +02:00
Jordi Villar
fe1df969a7 Add load_metadata_threads to the documentation 2023-10-20 09:04:39 +02:00
vdimir
b4851cf2ef
Use AsyncPipelineExecutor for reading clickhouse dictionary source 2023-10-19 15:16:33 +00:00
Smita Kulkarni
af5349f76b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-19 12:03:40 +02:00
Alexey Milovidov
f6db0a5261 Merge branch 'master' into morton-utils 2023-10-19 08:11:25 +02:00
Robert Schulze
945dcb865a
Merge pull request #55617 from slvrtrn/mysql-string-blob-vs-text-config
MySQL compatibility: allow to configure String/FixedString BLOB vs TEXT mapping
2023-10-18 10:57:18 +02:00
slvrtrn
c19ca5c4d5 Address PR feedback 2023-10-17 19:19:35 +02:00
Han Fei
4b23142775
Merge branch 'master' into hanfei/statistic 2023-10-17 16:40:31 +02:00
Smita Kulkarni
01a85522d9 Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-17 11:39:20 +02:00
Alexey Milovidov
de8215f5dd Merge remote-tracking branch 'origin/master' into morton-utils 2023-10-17 04:55:45 +02:00
serxa
0e17da22eb Merge branch 'master' into async-loader-integration 2023-10-16 11:08:29 +00:00
Antonio Andelic
a3360cb3f5
Merge pull request #55485 from guoxiaolongzte/keeper_client_add_get_all_children_number_command
keeper_client add get_all_children_number command
2023-10-16 08:45:38 +02:00
Alexey Milovidov
10d03f18e7 Add docs 2023-10-15 06:44:37 +02:00
Nikolay Degterinsky
c1fba94d67 Resubmit #54421
This reverts commit 3e60451ac7.
2023-10-14 19:04:01 +00:00
Smita Kulkarni
13ffebf559 Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-14 20:08:49 +02:00
slvrtrn
42fc670c22 Add new settings docs entries 2023-10-13 20:56:12 +02:00
Alexander Tokmakov
3e60451ac7 Revert "Merge pull request #54421 from evillique/cluster-groups"
This reverts commit 211c80e1a0, reversing
changes made to b53a98217c.
2023-10-13 18:55:51 +02:00
Alexander Tokmakov
e40aa72883
Merge pull request #54826 from JackyWoo/lb_nearest_host_name
Add load balancing hostname_levenshtein_distance
2023-10-13 17:23:02 +02:00
Robert Schulze
2653ace122
Update docs 2023-10-13 13:53:39 +00:00
robot-clickhouse-ci-1
211c80e1a0
Merge pull request #54421 from evillique/cluster-groups
Add replica groups to Replicated database engine
2023-10-12 18:14:42 +02:00
Nikolay Degterinsky
20e16be27b Fixes & improvements 2023-10-12 15:02:08 +00:00
Han Fei
42dc61abf5 Merge branch 'master' into hanfei/statistic 2023-10-12 16:19:45 +02:00
Smita Kulkarni
8b54172983 Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-12 12:32:43 +02:00
JackyWoo
1f553f3d65 Merge branch 'master' into lb_nearest_host_name 2023-10-12 10:19:17 +08:00
Han Fei
253b8efa58 do not modify column type when there is statistic 2023-10-11 16:57:40 +02:00
Robert Schulze
bb637fa9af
Update docs 2023-10-11 14:34:28 +00:00
guoxiaolong
18a6e624c9 fix description 2023-10-11 17:24:08 +08:00
guoxiaolong
ed89451efc add get_all_children_number command docs in clickhouse-keeper-client.md 2023-10-11 10:41:43 +08:00
Robert Schulze
8b7d1021cd
Docs: Update field descriptions of system.part_log 2023-10-10 13:32:20 +00:00
Arthur Passos
63562cbb20 Merge branch 'master' into properly_split_remote_proxy_http_https 2023-10-09 17:58:29 -03:00
Alexey Milovidov
c9e0988bfc
Update backup.md 2023-10-09 17:58:31 +03:00
Mikhail f. Shiryaev
14182d8452
Merge branch 'master' into docs_disk_s3_doesnt_use_copy_object 2023-10-09 14:50:56 +02:00
Robert Schulze
f4bc58ea92
Merge remote-tracking branch 'rschu1ze/master' into more-mysql-compat 2023-10-08 07:49:37 +00:00
Alexey Milovidov
186bd9c859
Merge pull request #55243 from den-crane/patch-62
Doc. fix a mistake about refcount
2023-10-07 23:43:16 +02:00
Robert Schulze
0450da9bac
Naming fixes 2023-10-07 20:12:10 +00:00
Robert Schulze
312fe8e31d
Merge pull request #55298 from rschu1ze/use_mysql_types_in_show_columns
Make `use_mysql_types_in_show_columns` independent from the connection
2023-10-07 22:03:24 +02:00
Robert Schulze
2e8cac6e9c
Make use_mysql_types_in_show_columns independent from the connection
Fixes: #55273
2023-10-07 13:06:41 +00:00
JackyWoo
784fe880eb Merge branch 'master' into lb_nearest_host_name 2023-10-07 09:04:26 +08:00
Aleksa Cukovic
db0cf729f5
Fix query_log cache usage column name in docs
It is not called `query_log_usage` but `query_cache_usage`
2023-10-05 22:31:48 +02:00
Arthur Passos
d54186df30 tmp 2023-10-04 17:21:41 -03:00
Denny Crane
7e0536e9f5
Update merge-tree-settings.md 2023-10-04 12:22:24 -03:00
Robert Schulze
907e792a93
Add information_schema.columns.extras
Fixes: #55183
2023-10-03 13:11:03 +00:00
Robert Schulze
2aefa760c3
Add information_schema.tables.table_rows
Fixes: #55182
2023-10-03 12:24:10 +00:00
Denny Crane
82bb1b1a43
Update merge-tree-settings.md 2023-09-29 15:14:22 -03:00
Denny Crane
55cd909c29
Update merge-tree-settings.md 2023-09-29 15:11:32 -03:00
vdimir
3a9abde35d
Merge pull request #54514 from ClickHouse/vdimir/allow_experimental_partial_result
Add setting allow_experimental_partial_result
2023-09-29 10:32:57 +02:00
Kruglov Pavel
e8d8c6dea5
Merge pull request #55095 from Avogar/print-pretty-type-names
Add setting to print pretty deep nested types like Tuple/Array/Map
2023-09-29 00:20:39 +02:00
avogar
0abf09d1b5 Fix example in docs 2023-09-28 22:17:44 +00:00
avogar
e8ea41e2d4 Add setting to print pretty deep nested Tuples 2023-09-28 22:17:44 +00:00
avogar
e2d7c543eb Don't try to infer numbers from strings in JSON formats by default to avoid parsing errors, add docs for setting input_format_json_try_infer_numbers_from_strings 2023-09-28 22:15:26 +00:00
Denny Crane
0eeee950d7 Merge branch 'master' into background_fetches_pool_size 2023-09-28 15:34:17 -03:00
vdimir
9b001e5092
Add setting allow_experimental_partial_result to doc 2023-09-28 09:40:59 +00:00
robot-clickhouse-ci-1
7a825c1417
Merge pull request #54427 from Avogar/json-object-as-tuple-inference
Add new features to schema inference for JSON formats
2023-09-27 20:12:45 +02:00
Robert Schulze
e9c3032f83
Merge pull request #55037 from rschu1ze/inf_sch_tables
Implement information_schema.tables.data_length
2023-09-27 14:09:38 +02:00
Robert Schulze
886afd11b6
Fix expected results 2023-09-27 08:46:57 +00:00
JackyWoo
5da03e8ba5 Add load balancing test_hostname_levenshtein_distance 2023-09-27 10:46:39 +08:00
Robert Schulze
e22de584e9
information_schema.tables.data_length 2023-09-26 20:08:54 +00:00
Robert Schulze
dcdc8bf0e9
Added field "is_deterministic" to system.functions 2023-09-26 19:13:23 +00:00
Robert Schulze
6634043a9f
Merge pull request #54837 from rschu1ze/obsolete-mt-settings
Mark obsolete settings in system.merge_tree_settings as is_obsolete = 1
2023-09-26 19:55:05 +02:00
Kruglov Pavel
bea80ab5b7
Merge branch 'master' into json-object-as-tuple-inference 2023-09-26 15:23:08 +02:00
Alexander Tokmakov
f39cb17881
Revert "Added field "is_deterministic" to system.functions" 2023-09-26 15:01:05 +02:00
Anton Popov
6cd32eb7b5
Merge pull request #50612 from CurtizJ/long-column-names
Allow to replace long file names to hashes
2023-09-26 13:05:33 +02:00
Robert Schulze
978a0c9cab
+ test 2023-09-26 10:45:50 +00:00
avogar
9e75825515 Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-object-as-tuple-inference 2023-09-25 17:24:36 +00:00
Robert Schulze
5233adecb0
Merge remote-tracking branch 'rschu1ze/master' into is_deterministic 2023-09-25 16:27:50 +00:00
avogar
42ca897f2d Better schema inference for JSON formats 2023-09-25 15:42:59 +00:00
Anton Popov
0ebc22e851
Merge branch 'master' into long-column-names 2023-09-25 16:55:14 +02:00
Smita Kulkarni
060724b75e Added docs 2023-09-24 12:02:48 +02:00
serxa
44acb53ad3 Merge branch 'master' into io-scheduling-throttler 2023-09-23 10:51:18 +00:00
robot-ch-test-poll3
1334202af4
Merge pull request #54863 from zvonand/zvonand-refactor-globs
Refactor and simplify multi-directory globs
2023-09-22 23:09:05 +02:00
Robert Schulze
2ca0e2e07d
Merge pull request #54773 from slvrtrn/tableau-online-information-schema
Adjust information_schema to support Tableau Online via MySQL interface
2023-09-22 16:11:55 +02:00
robot-ch-test-poll
118a068a4d
Merge pull request #54899 from ClickHouse/serxa-patch-3
Docs. Fix column name and type
2023-09-22 13:10:35 +02:00
Robert Schulze
e9c0dbd33e
Merge remote-tracking branch 'rschu1ze/master' into tableau-online-information-schema 2023-09-22 11:03:06 +00:00
Robert Schulze
be1e92a2ac
Merge pull request #54518 from rschu1ze/split-better
Provide fallback to Python/Spark-like splitting in splitBy*() functions
2023-09-22 12:07:45 +02:00
Sergei Trifonov
5c674e553d
Docs. Fix column name and type 2023-09-21 18:52:05 +02:00
slvrtrn
e49ddbb678 Merge remote-tracking branch 'origin' into tableau-online-information-schema 2023-09-21 14:25:04 +02:00
zvonand
5f67788c03 update docs and comments 2023-09-21 00:16:17 +02:00
Robert Schulze
e95f9ee814
Merge remote-tracking branch 'rschu1ze/master' into is_deterministic 2023-09-20 21:17:57 +00:00
Robert Schulze
28ca5cad7d
Fix spelling 2023-09-20 21:15:52 +00:00
Robert Schulze
5729871605
Merge remote-tracking branch 'rschu1ze/master' into qc-throw 2023-09-20 13:25:51 +00:00
slvrtrn
fb0ba86489 Merge remote-tracking branch 'origin' into tableau-online-information-schema 2023-09-20 15:14:40 +02:00
Robert Schulze
f3bf8388b6
Incorporate feedback 2023-09-20 10:00:00 +00:00
SmitaRKulkarni
d8adf05de2
Added a new column _block_number (#47532)
Added a new virtual column _block_number which is persisted on merges when allow_experimental_block_number_column is enabled
2023-09-20 11:31:12 +02:00
Sergei Trifonov
696ab745aa
Doc. Update query-complexity.md 2023-09-20 07:51:27 +02:00
slvrtrn
636fc506aa Replace information_schema view columns aliases with uppercase 2023-09-19 23:42:40 +02:00
Robert Schulze
5111f1e090
Update docs/en/operations/query-cache.md
Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>
2023-09-19 18:59:00 +02:00
Robert Schulze
a15029ecb5
Query Cache: Reject queries with non-deterministic functions by default
https://github.com/ClickHouse/support-escalation/issues/963
2023-09-19 16:41:43 +00:00
Robert Schulze
774c4b52da
Rework 2023-09-19 12:20:53 +00:00
slvrtrn
e4e9727572 Update information_schema docs 2023-09-19 14:14:17 +02:00
Kruglov Pavel
acadda1665
Merge branch 'master' into json-object-as-tuple-inference 2023-09-19 13:49:39 +02:00
Robert Schulze
1556cdd21a
Merge pull request #54789 from rschu1ze/docs-qc2
Docs: Update query cache docs about usage in view definitions
2023-09-19 13:32:02 +02:00
robot-clickhouse-ci-1
0be0f43390
Merge pull request #54451 from den-crane/patch-58
Doc. max_execution_time and the role of timeout_before_checking_execution_speed
2023-09-19 12:33:50 +02:00
Robert Schulze
29e83fbe64
Docs: Update query cache docs about usage in view definitions
Cf. https://github.com/ClickHouse/support-escalation/issues/963
2023-09-19 10:26:19 +00:00
serxa
311db94640 default max_burst equals to max_speed as in Throttler 2023-09-19 10:10:21 +00:00
Anton Popov
624782bd8f Merge remote-tracking branch 'upstream/master' into HEAD 2023-09-18 23:13:20 +00:00
Anton Popov
d94c1b1ec9 add check for collisions in filenames 2023-09-18 22:27:04 +00:00
slvrtrn
ad7b707658 Update information_schema.tables sql and docs 2023-09-18 22:30:27 +02:00
slvrtrn
9a0d07c682 Update information_schema docs 2023-09-18 22:14:53 +02:00
Robert Schulze
baf1016e4b
More 2023-09-18 18:39:21 +00:00
serxa
04d0b881ea more docs 2023-09-18 18:38:05 +00:00
Robert Schulze
4ed5b903b4
Docs: remove anchor prefix 2023-09-18 18:35:59 +00:00
robot-ch-test-poll2
c3a5d7dbf0
Merge pull request #54758 from rschu1ze/docs-qc
Docs: Update query cache section on non-deterministic functions
2023-09-18 20:01:46 +02:00
Robert Schulze
6872e95fb2
Remove prefixes 2023-09-18 17:34:40 +00:00
Robert Schulze
6de45e355f
Fix spelling/style 2023-09-18 15:28:22 +00:00
Robert Schulze
b14e00f966
Docs: Update query cache section on non-deterministic functions
Cf. https://github.com/ClickHouse/support-escalation/issues/963
2023-09-18 14:36:16 +00:00
Robert Schulze
2a5aa289e8
Implement true Python/Spark split behavior 2023-09-18 07:42:57 +00:00
Robert Schulze
b5b2cc511b
Pythonic vs Spark splitting 2023-09-18 07:42:52 +00:00
Denny Crane
e78d09cc8e Merge branch 'master' into background_fetches_pool_size 2023-09-17 20:01:39 -03:00
robot-clickhouse-ci-1
a878d104d7
Merge pull request #52839 from zvonand/zvonand-globs-small-fix
Fix directory permissions for multi-directory globs. Follow-up #50559
2023-09-16 20:52:30 +02:00
János Benjamin Antal
afc753bb2d Fix typos 2023-09-16 00:11:59 +00:00
János Benjamin Antal
16e2f7f0b9 Add optional version argument to rm 2023-09-16 00:03:46 +00:00
Kruglov Pavel
2c407ab3c0
Merge branch 'master' into json-object-as-tuple-inference 2023-09-15 16:29:48 +02:00
Andrey Zvonov
ffbed02f14
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-15 14:18:07 +03:00
Sergei Trifonov
12c71be9ca
Merge branch 'master' into async-loader-integration 2023-09-14 15:29:07 +02:00
vdimir
10bcc028df
Add cluster discovery documentation 2023-09-14 11:16:09 +00:00
serxa
09d4bf6930 add IO scheduling node for bandwidth throttling 2023-09-14 08:51:47 +00:00
Andrey Zvonov
ff16ddbbb3
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-14 11:31:49 +03:00
serxa
28e65883aa rename settings 2023-09-13 12:22:46 +00:00
Robert Schulze
de201e6c42
Merge pull request #54552 from rschu1ze/informat_schema_docs
Docs: Update information_schema with case-insensitity
2023-09-12 21:20:47 +02:00
Robert Schulze
8eb12c33a8
Update information_schema.md 2023-09-12 20:33:13 +02:00
Robert Schulze
e587eae303
Docs: Update information_schema with case-insensitity 2023-09-12 18:09:54 +00:00
pufit
a54a7b726d
Merge pull request #54201 from ClickHouse/pufit/keeper-client-reconfig
Implementing `reconfig`, `sync`, `exists` commands for keeper-client
2023-09-12 10:58:02 -04:00
Dmitry Novik
7edc0a30a3
Merge pull request #54335 from arenadata/ADQM-1109
Added peak_threads_usage to query_log table
2023-09-12 16:03:27 +02:00
Alexey Milovidov
df91a55d66
Merge pull request #54501 from alexvanolst/patch-1
Correct default value for parts_to_delay_insert
2023-09-11 21:03:34 +03:00
Denny Crane
a632b57780 Merge branch 'master' into background_fetches_pool_size 2023-09-11 10:57:58 -03:00
Nikolai Kochetov
59108f3d96
Merge pull request #54476 from ClickHouse/revert-54470-revert-48607-master
Revert "Revert "Add settings for real-time updates during query execution""
2023-09-11 14:59:13 +02:00
Alexander van Olst
f9351fdf7b
Correct default value for parts_to_delay_insert 2023-09-11 13:52:14 +02:00
Sergei Trifonov
08bad4d440
Merge pull request #47009 from ClickHouse/disks-and-io-sheduler 2023-09-11 07:22:14 +02:00
Robert Schulze
4d2223defe
Merge pull request #54119 from mkmkme/mkmkme/aklomp-base64
Replace Turbo-Base64 with aklomp/base64
2023-09-09 16:24:26 +02:00
Nikolai Kochetov
9b936c44db
Revert "Revert "Add settings for real-time updates during query execution"" 2023-09-09 12:29:39 +02:00
Alexey Milovidov
03a755732a
Revert "Add settings for real-time updates during query execution" 2023-09-09 03:10:23 +03:00
Denny Crane
34aaa710fa Merge branch 'master' into background_fetches_pool_size 2023-09-08 16:34:41 -03:00
Denny Crane
9462b58616
Update query-complexity.md 2023-09-08 13:32:24 -03:00
Denny Crane
bb3c6ff682
Update query-complexity.md 2023-09-08 13:30:13 -03:00
Denny Crane
b239d409b1
Update query-complexity.md 2023-09-08 13:28:09 -03:00
Andrey Zvonov
ff4586e663
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-08 18:17:06 +02:00
Andrey Zvonov
4cfd46a0cc
Update settings.md 2023-09-08 17:29:09 +03:00
Nikolai Kochetov
0095124791
Merge pull request #48607 from alexX512/master
Add settings for real-time updates during query execution
2023-09-08 09:05:33 +02:00
Fern
1ae28c473e
Update settings_profile_elements.md
Updating the column name `readonly` for `writability` according to the current state of this table.
Reference: a0d25fdd54/tests/queries/0_stateless/02117_show_create_table_system.reference (L1021)
2023-09-07 21:24:45 +01:00
Justin de Guzman
439531cde9
Merge pull request #54394 from fermelone/patch-2
Update sampling-query-profiler.md
2023-09-07 13:04:18 -07:00
avogar
ba307c7466 Allow to infer named Tuples from JSON objects under a setting in JSON formats 2023-09-07 19:41:19 +00:00
Robert Schulze
bff06d18aa
Merge pull request #54249 from rschu1ze/multiple_query_arguments
Allow multiple `--query` parameters in clickhouse-client/local.
2023-09-07 21:20:07 +02:00
serxa
a94ae9a7ab review fixes 2023-09-07 14:02:58 +00:00
serxa
a2f8f6bf29 working on review comments 2023-09-07 13:21:43 +00:00
Robert Schulze
cd3c121a62
Various fixups 2023-09-07 10:32:49 +00:00
Fern
25c06c9764
Update sampling-query-profiler.md
Adding a note to clarify that the sample query provided, in CH Cloud, might return empty information as it cycles through nodes of the cluster. You need to add clusterAllReplicas.
2023-09-07 10:47:42 +01:00
zvonand
c36a3fbd39 renamed setting 2023-09-07 12:00:25 +03:00
pufit
fef80f176e Fix typo 2023-09-06 21:56:14 -04:00
Alexey Gerasimchuck
c2f4dc0f14 Implemented peak_threads_usage 2023-09-07 01:32:39 +00:00
pufit
ef2350cfc7 Implementing exists, sync commands. Better tests 2023-09-06 20:36:39 -04:00
serxa
77697211cd add docs for system.scheduler + small fix 2023-09-06 19:30:39 +00:00
Mikhail Koviazin
f98007a4ed
Replace Turbo-Base64 with aklomp/base64
Closes #31643
2023-09-06 13:01:38 +00:00
Denny Crane
e1bc6cb0a7 increase background_fetches_pool_size to 16, background_schedule_pool_size to 512 2023-09-05 15:24:21 -03:00
robot-ch-test-poll
2e7edf4413
Merge pull request #53638 from arenadata/ADQM-987
Add `backup_log` system table
2023-09-05 17:03:41 +02:00
Robert Schulze
f4c86fe34e
Merge pull request #53860 from irenjj/feat_markdown
Add a setting to escape special characters in Markdown.
2023-09-05 15:44:11 +02:00
János Benjamin Antal
3f7d8f1cae
Merge pull request #54099 from Tiakon/master
Add the default value of task-upload-force
2023-09-05 11:32:53 +02:00
Victor Krasnov
132ab6067b Merge branch 'master' into ADQM-987 2023-09-05 10:01:44 +03:00
Alexey Milovidov
b2821106fd
Merge pull request #53923 from myrrc/docs/ch-disks
Add docs for clickhouse-disks
2023-09-05 02:10:18 +03:00
Robert Schulze
d03fba52f0
Merge remote-tracking branch 'rschu1ze/master' into multiple_query_arguments 2023-09-04 16:10:00 +00:00
Alejandro
5d6a2609c8
Updated doc of distributed_ddl_queue (#54192)
* Updated doc of distributed_ddl_queue

* Update docs/en/operations/system-tables/distributed_ddl_queue.md

Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>

* Update docs/en/operations/system-tables/distributed_ddl_queue.md

Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>

* Update docs/en/operations/system-tables/distributed_ddl_queue.md

Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>

---------

Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
2023-09-04 17:25:06 +02:00
irenjj
c9261bbf18 Merge remote-tracking branch 'upstream/master' into feat_markdown 2023-09-04 22:35:53 +08:00
Sergei Trifonov
258da91b5f
Merge branch 'master' into disks-and-io-sheduler 2023-09-04 15:14:28 +02:00
irenjj
b57e248aab Fix doc spell error. 2023-09-04 20:58:19 +08:00
Robert Schulze
44994fe51b
Incorporate review feedback 2023-09-04 11:44:37 +00:00
Tiakon
1ceda6fbfa
Update docs/en/operations/utilities/clickhouse-copier.md
Co-authored-by: János Benjamin Antal <antaljanosbenjamin@users.noreply.github.com>
2023-09-04 18:26:59 +08:00
Tiakon
74dedf2a5d
Merge branch 'ClickHouse:master' into master 2023-09-04 17:42:16 +08:00
serxa
14e2032d92 add documentation 2023-09-01 16:28:03 +00:00
Victor Krasnov
52cce27e81 Merge branch 'master' into ADQM-987 2023-09-01 18:00:20 +03:00
alexX512
36b8932b37 Merge branch 'master' of github.com:ClickHouse/ClickHouse 2023-08-31 21:40:50 +00:00
Mike Kot
ebcc97ad1b change case for copy operation in clickhouse-disks 2023-08-31 13:39:32 +00:00
Anton Popov
579ec699bf Merge remote-tracking branch 'upstream/master' into HEAD 2023-08-31 12:59:59 +00:00
Robert Schulze
aefb543734
Merge remote-tracking branch 'rschu1ze/master' into feat_markdown 2023-08-31 11:32:44 +00:00
Robert Schulze
d8e6395eea
Docs: Follow-up to #53818 2023-08-31 11:15:50 +00:00
Robert Schulze
97d960ba1d
Merge pull request #53818 from arenadata/ADQM-1070
Add new hide_in_preprocessed attribute in configuration file
2023-08-31 13:00:16 +02:00
Andrey Zvonov
83405a8808
Merge branch 'master' into zvonand-globs-small-fix 2023-08-31 08:42:48 +02:00
Alexey Gerasimchuck
3a212217a3 Implemented globs to select * from '<file>' 2023-08-31 04:20:44 +00:00
Tiakon
0dcc0be377
Update clickhouse-copier.md
Shows that the type of task-upload-force is Boolean.
2023-08-31 10:38:19 +08:00
irenjj
277be44250 add test 2023-08-30 22:57:46 +08:00
vdimir
7618b2d112
Add partial_result_update_duration_ms to settings.md 2023-08-30 12:05:04 +02:00
Alexey Gerasimchuck
a1687e618b backward compatibility changes + fixes 2023-08-29 23:50:41 +00:00
irenjj
473ba91c21 Refactor writeAnyMarkdownEscapedString and Add more info into doc. 2023-08-29 23:54:40 +08:00
Mike Kot
061bbe13c0 add docs for clickhouse-disks 2023-08-29 12:25:04 +00:00
Alexey Gerasimchuck
de1ed97876 disabled validate_tcp_client_information 2023-08-29 08:59:49 +00:00
Alexey Gerasimchuck
e9757abea6 Added validate_tcp_client_information setting 2023-08-29 00:15:55 +00:00
Sergei Trifonov
c10e42ca05
Merge branch 'master' into async-loader-integration 2023-08-28 20:20:31 +02:00
irenjj
13322f1a90 Remove redundant functions. 2023-08-28 23:54:07 +08:00
Roman Vasin
87cf0e38fd Update MD docs 2023-08-28 13:11:44 +00:00
irenjj
51aa89eed8 Add a setting to automatically escape special characters in Markdown. 2023-08-28 00:10:33 +08:00
Andrey Zvonov
911bf94fbd
Merge branch 'master' into zvonand-globs-small-fix 2023-08-25 23:50:07 +05:00
Victor Krasnov
921f0c8b5d Merge branch 'master' into ADQM-987 2023-08-25 21:20:23 +03:00
Roman Vasin
8cfab6d53f Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-1070 2023-08-25 12:13:53 +00:00
Kruglov Pavel
d80be4673b
Merge pull request #53692 from Avogar/cache-count
Cache number of rows in files for count in file/s3/url/hdfs/azure functions
2023-08-25 09:08:52 +02:00
Roman Vasin
ed3ad4c943 Add documentation 2023-08-25 05:37:10 +00:00
Alexander Tokmakov
cbbb81f5cc
Merge pull request #53405 from canhld94/limit_concurent_background_optimize
Limit number of concurrent background partition optimize
2023-08-24 20:49:38 +03:00
Kruglov Pavel
f7e1abd774
Merge branch 'master' into cache-count 2023-08-23 22:31:49 +02:00
Kruglov Pavel
592fa77987
Merge branch 'master' into cache-count 2023-08-23 15:18:02 +02:00
Kruglov Pavel
7e362a2110
Merge branch 'master' into fast-count-from-files 2023-08-23 15:13:20 +02:00
Robert Schulze
bea651e828
Merge pull request #53657 from rschu1ze/cache-improvements
Expose more settings from caches
2023-08-23 14:58:45 +02:00
Kruglov Pavel
e193aec583
Merge branch 'master' into fast-count-from-files 2023-08-23 12:15:34 +02:00
Kruglov Pavel
6e3f2fedbd
Apply suggestions from code review
Co-authored-by: Dmitry Novik <mrnovikd@gmail.com>
2023-08-22 19:05:06 +02:00
Denny Crane
0713dc5ee4
Update storing-data.md 2023-08-22 14:04:35 -03:00
Victor Krasnov
258f9927b4 Merge branch 'master' into ADQM-987 2023-08-22 16:49:32 +03:00
Kruglov Pavel
67c5c0203b
Merge branch 'master' into fast-count-from-files 2023-08-22 15:03:48 +02:00
Kruglov Pavel
c0bdd0e00b
Merge branch 'master' into cache-count 2023-08-22 14:42:22 +02:00
avogar
b4145aeddc Cache number of rows in files for count in file/s3/url/hdfs/azure functions 2023-08-22 11:59:59 +00:00
Robert Schulze
f2fb7365e6
Add settings for 1. size_ratio (all caches) and 2. policy (index caches)
1. is an expert-level setting, default is 0.5, applies only to SLRU.

Also, I noticed that we expose cache policy settings for the mark and
the uncompresed cache but not for the index mark and the index
uncompressed cache. Changed that as well, it simplifies the code a bit.
2023-08-22 11:04:29 +00:00
alesapin
1a5a9fca87
Merge pull request #53605 from irenjj/feat_53538
Add column 'name' to system.clusters as an alias to cluster.
2023-08-22 11:34:21 +02:00
Robert Schulze
583d9b33f0
Merge pull request #51446 from rschu1ze/recfgable-caches
Runtime-reconfigurable cache sizes
2023-08-21 23:27:21 +02:00
Anton Popov
3e9a182555 better interfaces for getting of stream name in part 2023-08-21 13:52:25 +00:00
Robert Schulze
96c8b250ce
Allow to configure cache sizes at runtime 2023-08-21 13:51:10 +00:00
Kruglov Pavel
88aee95122
Merge branch 'master' into fast-count-from-files 2023-08-21 14:46:33 +02:00
avogar
47304bf7aa Optimize count from files in most input formats 2023-08-21 12:30:52 +00:00
Victor Krasnov
a7813260c0 Merge branch 'master' into ADQM-987 2023-08-21 14:45:13 +03:00
Kruglov Pavel
c68456a20a
Merge pull request #52692 from Avogar/variable-number-of-volumns-more-formats
Allow variable number of columns in more formats, make it work with schema inference
2023-08-21 13:28:35 +02:00
Duc Canh Le
2c07065f81 increase the default value
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-08-21 11:04:24 +00:00