Commit Graph

12195 Commits

Author SHA1 Message Date
Robert Schulze
4c236b34f0
Another small cleanup 2023-11-27 11:09:07 +00:00
vdimir
bbc202a891
Merge pull request #56816 from AVMusorin/improve-settings-rocksdb
Show total_bytes and total_rows in system tables for RocksDB storage
2023-11-27 11:42:15 +01:00
Kruglov Pavel
b10e46b2bc
Merge pull request #57126 from Avogar/size-virtual-column
Add _size virtual column to s3/file/hdfs/url/azureBlobStorage engines
2023-11-27 10:12:18 +01:00
Robert Schulze
a8671049e1
Various smaller fixups 2023-11-27 08:49:54 +00:00
Justin de Guzman
cc57e67e83
Fix docs check erorr 2023-11-26 23:57:33 -08:00
Bharat Nallan Chakravarthy
6454687fa6 Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables 2023-11-26 16:24:18 -08:00
Nikolay Degterinsky
de0876ed68
Merge pull request #57234 from evillique/fix-docs-anchors
Fix docs
2023-11-27 01:22:43 +01:00
Nikolay Degterinsky
faa3a43803 Fix docs 2023-11-26 19:21:39 +00:00
Azat Khuzhin
315906b380 Add ability to parse hours/months without leading zeros
Recently I was looking into one dataset, that has such format.

So I've changed the meaning of the following formatters for
formatDateTime()/parseDateTime(), like in other implementations [1]:

- %l/%k - to handle hours without leading zeros
- %c - handle months without leading zeros

  [1]: https://www.php.net/strftime

And since this is kind of behaviour change (even though it is unlikely
will break something), there is a new setting to control this new
behaviour:
- parsedatetime_enable_format_without_leading_zeros=1 (default ON)
- formatdatetime_enable_format_without_leading_zeros=0 (default OFF, since this could change users output)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-26 19:10:17 +01:00
Alexey Milovidov
f636dea879
Merge pull request #54327 from den-crane/background_fetches_pool_size
increase background_fetches_pool_size to 16, background_schedule_pool_size to 512
2023-11-26 02:50:38 +01:00
robot-ch-test-poll1
a956cec61f
Merge pull request #57228 from rschu1ze/docs-alias
Docs: Mention alias `database` for `name` in `system.databases`
2023-11-26 02:25:32 +01:00
Robert Schulze
e074629749
Docs: Mention alias 'database' for 'name' in system.databases 2023-11-25 22:04:49 +00:00
Robert Schulze
4088ec0eac
Merge pull request #57199 from rschu1ze/docs-math-funcs
Docs: Improve math function docs
2023-11-25 21:22:53 +01:00
Robert Schulze
2e7c16e138
Fix broken links 2023-11-25 19:47:32 +00:00
Robert Schulze
5b7d2a903d
Merge pull request #57152 from rschu1ze/fine-granular-plan-opt-settings
Fine-granular enablement/disabling of plan-level optimizations
2023-11-25 20:44:23 +01:00
Nikita Mikhaylov
1b623b0e48 Done 2023-11-24 20:03:02 +00:00
Vitaly Baranov
5769a88b92
Merge pull request #57133 from vitlibar/change-default-for-wait_dictionaries_load_at_startup
Change the default for wait_dictionaries_load_at_startup to true
2023-11-24 17:09:05 +01:00
Kseniia Sumarokova
ea7c68febe
Merge pull request #56705 from ClickHouse/docs-s3-gcs-improvements
[Docs] Add details to S3 and GCS table functions
2023-11-24 16:17:40 +01:00
Kseniia Sumarokova
13187bf4f1
Merge pull request #56959 from melvynator/master
Add experimental flag for MaterializedPostgreSQL table engine.
2023-11-24 16:16:42 +01:00
Robert Schulze
ca63881357
Mention that the settings are dev settings 2023-11-24 14:46:02 +00:00
Robert Schulze
75ceaf6200
Docs: Improve math function docs 2023-11-24 14:31:39 +00:00
vdimir
1044e3366b
Update http_make_head_request doc 2023-11-24 09:32:20 +00:00
Tim Windelschmidt
51e3899f73
Add setting http_make_head_request
Clickhouse always does a HEAD request before actually executing the GET request,
this adds a settings to skip that request.
2023-11-24 09:32:16 +00:00
vdimir
e5284c125f
Update blob_storage_log.md 2023-11-24 10:02:47 +01:00
Chen Lixiang
2b35e98ef8 add comments and doc 2023-11-24 16:40:19 +08:00
Robert Schulze
a8a3214185
+ documentation 2023-11-23 19:43:40 +00:00
Yarik Briukhovetskyi
69205769d0
Merge branch 'ClickHouse:master' into group_sorted_array_function 2023-11-23 20:23:47 +01:00
Sergei Trifonov
9436ae6d7d
Merge pull request #56771 from ClickHouse/dashboards-table
Load queries for dashboard page from new `system.dashboards` table
2023-11-23 19:07:52 +01:00
Tomáš Hromada
956a8add35
Update other-functions.md
Fix `initializeAgregation` typo
2023-11-23 15:57:19 +01:00
Vitaly Baranov
5f461ff780 Change the default for "wait_dictionaries_load_at_startup" to true,
and use this setting only if "dictionaries_lazy_load" is false.
2023-11-23 14:45:42 +01:00
serxa
663c8cd944 Merge branch 'master' into dashboards-table 2023-11-23 10:29:48 +00:00
serxa
0fc25fbda8 Merge branch 'master' into async-loader-integration 2023-11-23 09:32:43 +00:00
Kruglov Pavel
b84e3cf683
Merge branch 'master' into size-virtual-column 2023-11-22 19:25:00 +01:00
avogar
6b64efb55a Add docs 2023-11-22 18:21:30 +00:00
Julia Kartseva
753b22f64c
Merge pull request #56171 from ClibMouse/dev-seriesPeriodDetect
Implemented series period detect method using pocketfft lib
2023-11-22 09:49:58 -08:00
zvonand
5153798aeb Introduced fileCluster table function
Added fileCluster function
Added test and docs
2023-11-22 15:06:04 +01:00
vdimir
a139ae97eb
Merge pull request #52918 from ClickHouse/vdimir/s3_blob_log
Add system table with blob storage operations log
2023-11-21 17:40:42 +01:00
Bhavna Jindal
a324bd2780 added macro to enable/disable pocketfft lib 2023-11-21 06:52:47 -08:00
Bhavna Jindal
baaa15b5b0 added macro to enable/disable pocketfft lib 2023-11-21 06:52:47 -08:00
Bhavna Jindal
ad99cb902f changed method name, updated pocketfft repo reference 2023-11-21 06:52:47 -08:00
Bhavna Jindal
e3826786f1 Added testcases, documentation and addressed comments 2023-11-21 06:52:47 -08:00
凌涛
e86aa433c5
Merge branch 'master' into feature/getHTTPHeader 2023-11-21 19:48:47 +08:00
Aleksandr Musorin
ee0ae17ce2 Added optimize_trivial_approximate_count_query documentatiosn for RocksDB 2023-11-21 11:31:56 +01:00
vdimir
15234474d7
Implement system table blob_storage_log 2023-11-21 09:18:25 +00:00
凌涛
c5f16725ec add function getClientHTTPHeader 2023-11-21 11:12:01 +08:00
slvrtrn
9f96b58979 Update docs, add more tests. 2023-11-20 16:22:47 +01:00
avogar
f537bad469 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-11-20 14:32:50 +00:00
avogar
872556a5d4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-11-20 14:03:36 +00:00
Sema Checherinda
f999337dae
Revert "Revert "s3 adaptive timeouts"" 2023-11-20 14:53:22 +01:00
Alexander Tokmakov
5031f239c3
Revert "s3 adaptive timeouts" 2023-11-20 14:28:59 +01:00
robot-ch-test-poll
e71ca7dcef
Merge pull request #56985 from czlee/patch-1
[Docs] MaterializedPostgreSQL: Change DETACH to DETACH PERMANENTLY
2023-11-20 13:33:52 +01:00
Chuan-Zheng Lee
96c603ef97
[Docs] MaterializedPostgreSQL: Change DETACH to DETACH PERMANENTLY
If I'm not mistaken, ClickHouse/ClickHouse#35158 changed the syntax for dynamically removing tables from MaterializedPostgreSQL databases from `DETACH` to `DETACH PERMANENTLY`. Currently when just running `DETACH TABLE postgres_database.table_to_remove`, it shows an error:
```
DETACH TABLE not allowed, use DETACH PERMANENTLY. (NOT_IMPLEMENTED)
```

This adds the keyword `PERMANENTLY` to both places where `DETACH` occurs on the MaterializedPostgreSQL database engine page.
2023-11-20 18:15:14 +13:00
Peignon Melvyn
f6e4c29669
MaterializedMysql doc
Add experimental flag for materializedMysql
2023-11-20 01:49:17 +01:00
Bharat Nallan Chakravarthy
d08512d8c0 Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables 2023-11-19 14:06:40 -08:00
robot-clickhouse-ci-1
4bf3845fbf
Merge pull request #56962 from ClickHouse/docs-count-distinct-perf-tip
[Docs] Add perf tip for COUNT(DISTINCT expr)
2023-11-19 20:55:15 +01:00
Sema Checherinda
a950595c24
Merge pull request #56314 from CheSema/s3-aggressive-timeouts
s3 adaptive timeouts
2023-11-19 14:12:14 +01:00
serxa
9023f61349 Merge branch 'master' into async-loader-integration 2023-11-19 13:05:58 +00:00
robot-clickhouse-ci-1
2f76b1a641
Merge pull request #56966 from ClickHouse/docs-optimize-final
[Docs] Recommend against OPTIMIZE FINAL in OPTIMIZE page
2023-11-19 10:57:25 +01:00
robot-ch-test-poll
4fa085d7e2
Merge pull request #56965 from ClickHouse/docs-replacingmergetree-freq-updates
[Docs] Recommend ReplacingMergeTree for frequent updates
2023-11-19 10:56:47 +01:00
robot-ch-test-poll3
9c720c7354
Merge pull request #56963 from ClickHouse/docs-add-insert-distributed-sync
[Docs] Add insert_distributed_sync to Core Settings docs
2023-11-19 10:05:50 +01:00
Justin de Guzman
9d3c62ec41
[Docs] Recommend against OPTIMIZE FINAL in OPTIMIZE page 2023-11-18 18:51:35 -08:00
Justin de Guzman
f29777db2d
[Docs] More typos 2023-11-18 18:41:20 -08:00
Justin de Guzman
a398e3f51e
[Docs] Fix typo 2023-11-18 18:40:14 -08:00
Justin de Guzman
8062fb578c
[Docs] Recommend ReplacingMergeTree for frequent updates 2023-11-18 18:38:49 -08:00
Justin de Guzman
5e1da38720
[Docs] Add details on why partitions improve query perf 2023-11-18 18:28:29 -08:00
Justin de Guzman
96e87322b5
[Docs] Add insert_distributed_sync to Core Settings docs 2023-11-18 18:10:43 -08:00
Justin de Guzman
a894671e8a
[Docs] Add perf tip for COUNT(DISTINCT expr) 2023-11-18 17:53:32 -08:00
Ubuntu
16e7bd201b Add experimental flag for PostgresSQL table engine. Also add documentation on how to enable it 2023-11-18 18:22:33 +00:00
Alexey Milovidov
0158db3e07
Merge pull request #56092 from ClickHouse/docs-max-block-size
Set correct default `max_block_size` value in docs
2023-11-18 17:23:43 +01:00
Robert Schulze
4353507724
Merge pull request #56540 from slvrtrn/concat-arbitrary-types
Support arguments of arbitary type in function `concat()`
2023-11-18 17:21:03 +01:00
slvrtrn
d504ad6e99 Merge remote-tracking branch 'origin' into concat-arbitrary-types 2023-11-17 13:45:12 +01:00
Denny Crane
3765a1c77b
Update random-functions.md 2023-11-16 16:07:49 -04:00
Bharat Nallan Chakravarthy
7434dd9e0a Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables 2023-11-16 11:17:45 -08:00
Kruglov Pavel
1831ecc38f
Merge pull request #56424 from yariks5s/npy_float_16
Float16 support for npy format
2023-11-16 17:00:24 +01:00
Kruglov Pavel
066c900725
Merge pull request #56769 from Avogar/better-docs
Better docs for virtual columns in Kafka/RabbitMQ/NATS/FileLog
2023-11-16 14:50:18 +01:00
Kruglov Pavel
2062bd2f1c
Merge pull request #56707 from ClickHouse/revert-56702-revert-51823-ch_add_max_execution_time_leaf
Revert "Revert "Add a setting max_execution_time_leaf to limit the execution time on shard for distributed query""
2023-11-16 14:49:05 +01:00
Robert Schulze
ed052d76e6
Merge pull request #56141 from zvonand/zvonand-more-globs
Performance enhancement for File, HDFS globs
2023-11-16 14:09:22 +01:00
serxa
3920926cd6 add docs 2023-11-16 12:40:15 +00:00
Vitaly Baranov
342e6c7546
Merge pull request #56782 from vitlibar/add-config-setting-wait_dictionaries_load_at_startup
Add config setting "wait_dictionaries_load_at_startup"
2023-11-16 11:51:29 +01:00
Andrey Zvonov
fc15b0c1e7
Merge branch 'ClickHouse:master' into zvonand-more-globs 2023-11-16 11:19:12 +01:00
Vitaly Baranov
946e02ecbc
Merge pull request #56268 from vitlibar/add-script-backup-view
Add an external utility to view backups and to extract information from them
2023-11-16 11:17:16 +01:00
Robert Schulze
0b45e4bfee
Merge remote-tracking branch 'ClickHouse/master' into concat-arbitrary-types 2023-11-15 15:44:36 +00:00
Robert Schulze
f21dd37d18
Some fixups 2023-11-15 15:43:41 +00:00
Robert Schulze
eb08bba607 Update docs 2023-11-15 16:37:24 +01:00
Mikhail f. Shiryaev
993c3e6dba
Update outdated script in troubleshooting 2023-11-15 15:09:22 +01:00
slvrtrn
c7cd4fa972 Update concat docs 2023-11-15 14:57:34 +01:00
Vitaly Baranov
d62048031f Add documentation. 2023-11-15 13:57:28 +01:00
Bharat Nallan Chakravarthy
e164c1d257 update docs 2023-11-14 18:22:36 -08:00
avogar
58b9bde0fa Better docs for virtual columns in Kafka/RabbitMQ/NATS/FileLog 2023-11-14 21:15:30 +00:00
MikhailBurdukov
efce883133 Added docs 2023-11-14 14:22:15 +00:00
Kruglov Pavel
8e88bf1348 Revert "Revert "Add a setting max_execution_time_leaf to limit the execution time on shard for distributed query"" 2023-11-14 11:40:48 +00:00
Sema Checherinda
76d11687a7 adjuct docs 2023-11-14 11:34:12 +01:00
Sema Checherinda
e0edd165da add doc 2023-11-14 11:34:12 +01:00
Ethan Shea
37dc535d78
Remove tabs 2023-11-13 16:16:07 -05:00
Ethan Shea
207c4c50cb
Improve legibility of window functions list
Before, markdown was rendering these as one big paragraph.
2023-11-13 16:12:05 -05:00
justindeguzman
bdb624f20f [Docs] Add details on S3 table function memory usage/streaming 2023-11-13 13:03:25 -08:00
justindeguzman
de42b7f9e0 [Docs] Add details to S3 and GCS table functions 2023-11-13 12:57:05 -08:00
Robert Schulze
361a3ca11f
Merge pull request #56519 from rschu1ze/qc-ignore-nondeterministic-queries
Query cache: Allow to ignore non-deterministic queries
2023-11-13 21:32:44 +01:00
Alexander Tokmakov
0622379ec7
Revert "Add a setting max_execution_time_leaf to limit the execution time on shard for distributed query" 2023-11-13 21:11:07 +01:00
Bharat Nallan Chakravarthy
d90b8b6fba Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables 2023-11-13 08:43:37 -08:00
Denny Crane
c93efc929a fix typo in the doc 2023-11-13 16:54:21 +03:00
Robert Schulze
7864df4826
Update docs + Try to stabilize test results, pt. II 2023-11-13 10:57:33 +00:00
Vitaly Baranov
a4d57fe108 Rename the name of the utility "backupview" -> "clickhouse_backupview". 2023-11-13 10:15:37 +01:00
Vitaly Baranov
f12b95df7d Add documentation. 2023-11-13 09:43:06 +01:00
Kseniia Sumarokova
b7915e6983
Merge pull request #55782 from aiven-sal/aiven-sal/namedcoll_pr
NamedCollections: prevent fields overriding in functions' calls
2023-11-13 09:07:09 +01:00
robot-clickhouse
00b414f87d
Merge pull request #56652 from ClickHouse/docs-sharding-key
[Docs] Add details about sharding_key for distributed table engine
2023-11-13 05:26:00 +01:00
justindeguzman
f3b0550dd3 [Docs] Add details about sharding_key for distributed table engine 2023-11-12 19:43:43 -08:00
rondo_1895
04b75a3ac9
Update except.md
Symbol Error
2023-11-13 11:37:19 +08:00
Justin de Guzman
747deb13e2
[Docs] Add built-in observability dashboard 2023-11-12 18:13:25 -08:00
Robert Schulze
bea529c9a1
Try to stabilize test results 2023-11-12 15:11:38 +00:00
Robert Schulze
91f53514d9
Incorporate review feedback 2023-11-12 15:11:38 +00:00
Robert Schulze
52c825db44
Query cache: Allow to ignore non-deterministic queries
Fixes: #56504
2023-11-12 15:11:38 +00:00
Robert Schulze
a511f41438
Docs: Fix overly long quote which pushed the right pane out of view 2023-11-12 10:51:22 +00:00
Antonio Andelic
f6d5ac485e
Merge pull request #56620 from chhetripradeep/pchhetri/demote-leader-before-stop-second-attempt
Add 4-letter command for yielding leadership
2023-11-12 11:38:40 +01:00
Alexey Milovidov
ad03f1ee47
Merge pull request #56485 from ClickHouse/better-settings
Better settings
2023-11-12 00:01:38 +01:00
Alexey Milovidov
0dabdf43b8
Merge pull request #56622 from ruslandoga/patch-1
add ecto_ch to client-libraries.md
2023-11-11 22:12:24 +01:00
Shri Bodas
bc68fcf759 canonicalRand is replaced by randCanonical 2023-11-11 10:11:47 -08:00
ruslandoga
7b16e90b2a
add plausible/ecto_ch to client-libraries.md 2023-11-11 20:54:03 +09:00
Alexey Milovidov
f1ccee34cc Fix tests and docs 2023-11-11 09:28:30 +01:00
Alexey Milovidov
04630c3e5a Merge branch 'master' into better-settings 2023-11-11 09:26:59 +01:00
Pradeep Chhetri
d0922782ed Revert "Revert "Add 4-letter command for yielding/resigning leadership""
This reverts commit e1766b96d9.
2023-11-11 15:37:49 +08:00
James Seymour
43b921abe5 fix(docs): correct default value for output_format_parquet_compression_method to 'ltz4' 2023-11-11 14:56:16 +10:00
Alexey Milovidov
e1766b96d9
Revert "Add 4-letter command for yielding/resigning leadership" 2023-11-11 05:45:02 +03:00
Alexey Milovidov
280658db3b
Merge pull request #56539 from ClickHouse/remove/unnecessary-slugs-in-docs
Removes duplicated slugs in docs.
2023-11-10 17:00:10 +01:00
Robert Schulze
a5b1474b6a
Merge pull request #56586 from rschu1ze/toUnixTS-docs
Update docs of `fromUnixTimeStamp[InJodaSyntax]()`
2023-11-10 15:21:48 +01:00
Robert Schulze
82f5e92bf5
Update docs of fromUnixTimeStamp[InJodaSyntax]() 2023-11-10 11:11:42 +00:00
Alexey Milovidov
1d51727aa5
Update symbols.md 2023-11-10 01:47:00 +03:00
Alexey Milovidov
d41d1a205e Add docs 2023-11-09 23:43:12 +01:00
johnnymatthews
ecc012cc4d Removes duplicated slugs in docs. 2023-11-09 12:41:39 -04:00
Salvatore Mesoraca
7d206cbc3c
NamedCollections: prevent fields overriding in functions call
Add syntax in SQL and XML to mark specific fields to allow
override or not.
Also add a new setting to control the default behaviour when
overriding support is not specified.
2023-11-09 17:25:16 +01:00
Antonio Andelic
e9542e4153
Merge pull request #54957 from ClickHouse/49507_Support_compression_for_keeper_protocol
Support compression for keeper protocol
2023-11-09 10:00:19 +01:00
Alexey Milovidov
d34809bc7c Revert a wrong change in server settings 2023-11-09 00:32:43 +01:00
Robert Schulze
a5a7a16096
Merge pull request #56478 from rschu1ze/docs-fetch-repo
Docs: Update instructions to fetch the repo
2023-11-08 23:24:57 +01:00
Robert Schulze
9b2a65e10e
Docs: Update instructions to fetch the repo 2023-11-08 19:51:02 +00:00
Peignon Melvyn
ba87360114
Mark MaterializedPostreSQL as experimental in docs (#56462) 2023-11-08 20:26:19 +01:00
Yarik Briukhovetskyi
b8ea31db43
Merge pull request #56309 from yariks5s/preferred_optimize_projection_name
New setting preferred_projection_name
2023-11-08 18:06:03 +01:00
Alexey Milovidov
565559b7f3
Update sampling-query-profiler.md 2023-11-08 19:07:34 +03:00
pppeace
986154d6fb
Update wikistat.md
align the create sql and data load script about the column `size`.
2023-11-08 22:24:45 +08:00
Robert Schulze
2cf2c6bbd8
Merge pull request #56425 from slvrtrn/information-schema-statistics
Add `information_schema.statistics` system view
2023-11-08 10:29:18 +01:00
slvrtrn
1068478591 Update docs formatting 2023-11-07 19:18:59 +01:00
slvrtrn
94143ac002 Add information_schema.statistics docs 2023-11-07 19:14:44 +01:00
yariks5s
4da512d6a3 ehnanced docs 2023-11-07 17:57:39 +00:00
Robert Schulze
86b8ebf71c
Merge remote-tracking branch 'rschu1ze/master' into arrayRandomSample-improved 2023-11-07 15:25:29 +00:00
Robert Schulze
32a3b1b049
Merge remote-tracking branch 'rschu1ze/master' into idatatype-convenience-functions 2023-11-07 15:17:59 +00:00
Sema Checherinda
02df5ac59c
Merge pull request #54340 from KevinyhZou/bug_fix_csv_parse_crlf
Fix CSV read while the end of line is CR(\r)
2023-11-07 12:51:05 +01:00
serxa
19aa1375fc Merge branch 'master' into async-loader-integration 2023-11-07 10:25:38 +00:00
Robert Schulze
842cc36598
Update docs 2023-11-07 10:25:27 +00:00
Robert Schulze
54b5d573d7
Merge remote-tracking branch 'rschu1ze/master' into idatatype-convenience-functions 2023-11-07 10:18:30 +00:00
Robert Schulze
e22c673299
Revert "Revert "Add function arrayRandomSample()""
This reverts commit e47e50e30d.
2023-11-07 10:16:13 +00:00
Pradeep Chhetri
0aaaf320b6 Update document of keeper-client to let CI run 2023-11-07 13:58:45 +08:00
robot-ch-test-poll1
845a235ad8
Merge pull request #56237 from ClickHouse/justindeguzman-patch-1
[Docs] Specify IAM role necessary for GCS table function
2023-11-07 01:20:06 +01:00
robot-clickhouse
25558fe0a6
Merge pull request #56390 from ClickHouse/vdimir/doc_architecture_upd_streams
Update development documentation about data streams
2023-11-07 00:54:31 +01:00
Alexey Milovidov
e47e50e30d
Revert "Add function arrayRandomSample()" 2023-11-07 02:49:11 +03:00
Robert Schulze
8846cc6770
Merge pull request #56327 from rschu1ze/parseQueryOrNull
Improve `formatQuery()`
2023-11-06 22:48:16 +01:00
vdimir
c583b992ba
Update development documentation about data streams 2023-11-06 18:42:56 +00:00
Sema Checherinda
a5e17dc919
Merge pull request #55566 from CheSema/remote-blobs-naming
feature: storage_metadata_write_full_object_key
2023-11-06 16:41:49 +01:00
Robert Schulze
5cfcf98d4a
Merge pull request #56277 from rschu1ze/show-columns-connection-type
Make type names in `SHOW COLUMNS` dependent on connection type
2023-11-06 16:24:27 +01:00
Robert Schulze
8896134531
Cleanup IDataType convenience functions 2023-11-06 13:25:32 +00:00
Robert Schulze
ae1dcb5254
Move documentation of string similarity functions to better location 2023-11-06 13:25:08 +00:00
serxa
6babc8e934 rename metrics for new pools to match settings 2023-11-06 12:24:00 +00:00
vdimir
3b775dee53
Merge pull request #55126 from ClickHouse/vdimir/jaccard_index_perf
Add function jaccardIndex back with better performance
2023-11-06 10:39:02 +01:00
kevinyhzou
2a50daf5dd Allow cr at end of csv line 2023-11-06 12:21:42 +08:00
kevinyhzou
ef30e6723d bug fix csv read while end of line is not crlf 2023-11-06 12:21:42 +08:00
Robert Schulze
049c811a38
Make type names in SHOW COLUMNS dependent only on connection type 2023-11-05 21:20:20 +00:00
Robert Schulze
8a64066ee1
+ formatQueryOrNull() 2023-11-05 20:24:23 +00:00
Arthur Passos
b6e205dcdf
Add ClickHouse setting to disable tunneling for HTTPS requests over HTTP proxy (#55033)
* initial commit. integ tests passing, need to re-run unit & my own personal tests

* partial refactoring to remove Protocol::ANY

* improve naming

* remove all usages of ProxyConfiguration::Protocol::ANY

* fix ut

* blabla

* support url functions as well

* support for HTTPS requests over HTTP proxy with tunneling off

* remove gtestabc

* fix silly mistake

* ...

* remove usages of httpclientsession::proxyconfig in src/

* got you

* remove stale comment

* it seems like I need reasonable defaults

* fix ut

* add some comments

* remove no longer needed header

* matrix out

* add https over http proxy with no tunneling

* soem docs

* partial refactoring

* rename to use_tunneling_for_https_requests_over_http_proxy

* improve docs

* use shorter version

* remove useless test

* rename the setting

* update

* fix typo

* fix setting docs typo

* move ); up

* move ) up
2023-11-04 13:47:52 -04:00
Alexey Milovidov
b4982e90da
Update build-cross-riscv.md 2023-11-04 02:51:48 +03:00
Robert Schulze
480e284db1
Merge pull request #56088 from jh0x/feature-from-days-zero
Add function `fromDaysSinceYearZero()`
2023-11-04 00:17:04 +01:00
yariks5s
d95262622b init 2023-11-03 16:47:06 +00:00
Denny Crane
dbaebe18f1
Update settings.md 2023-11-03 13:14:56 -03:00
Denny Crane
9dbd229462
Update settings.md 2023-11-03 13:09:51 -03:00
Nikita Mikhaylov
9666549d15
Merge pull request #56280 from ClickHouse/melvynator-patch-2
Update detach.md
2023-11-03 14:45:04 +01:00
Kruglov Pavel
81b1ca22bb
Merge pull request #51823 from canhld94/ch_add_max_execution_time_leaf
Add a setting max_execution_time_leaf to limit the execution time on shard for distributed query
2023-11-03 13:31:15 +01:00
vdimir
55a1baf029
Merge pull request #56022 from ClickHouse/vdimir/check_all_tables
Add CHECK query for all the tables
2023-11-03 10:10:42 +01:00
Duc Canh Le
dd6b02a2fd add document
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-11-03 03:00:13 +00:00
Dmitry Novik
2db74997a8
Fix typo 2023-11-03 01:34:07 +01:00
Dmitry Novik
f6733ac7ab
Add documentation for ATTACH DATABASE 2023-11-03 01:21:11 +01:00
Dmitry Novik
49d553369e
Add info about DETACH DATABASE 2023-11-03 01:12:58 +01:00
Peignon Melvyn
5d939f6df0
Update detach.md
Added detach database
2023-11-03 00:23:56 +01:00
Robert Schulze
910477b1bd
Add FROM_DAYS() alias 2023-11-02 21:43:17 +00:00
Robert Schulze
0b587d3cea
Remove overflow setting
Reason 1:
- https://github.com/ClickHouse/ClickHouse/pull/55696#issuecomment-1774130793
  Basically: Setting `date_time_overflow_behavior` applies only to
  conversions between Date <-> Date32 <-> DateTime <-> DateTime64 but
  it does not control the behavior of functions.

Reason 2:
- It's overkill (even if well-intented overkill). ClickHouse generally
  has a garbage in - garbate out philosophy, so that should be the
  default behavior which corresponds to behavior "ignore". Moreover,
  function 'fromDaysSinceYearZero()' mostly exists for compatibility /
  parity with MySQL and MySQL takes the same stance.
2023-11-02 21:43:17 +00:00
Robert Schulze
492af27feb
Update docs 2023-11-02 20:56:01 +00:00
serxa
e97edf5285 Merge branch 'master' into async-loader-integration 2023-11-02 14:56:32 +00:00
Sema Checherinda
90b64bcdb9 backward compatibility and implementation feature storage_metadata_write_full_object_key 2023-11-02 15:20:55 +01:00
robot-clickhouse
13adae0e42
Merge pull request #56244 from ne1r0n/patch-4
[Docs] fix typo
2023-11-02 14:59:19 +01:00
Nikita Taranov
b078443826
Fix typo in largestTriangleThreeBuckets.md (#56263) 2023-11-02 14:45:13 +01:00
Robert Schulze
79cbaf406d
Merge pull request #56199 from yokofly/update-cross-compile-doc
[Docs] Update cross-compilation guide for OSX
2023-11-02 13:38:06 +01:00
Robert Schulze
6d08a441fa
Update build-cross-osx.md 2023-11-02 12:41:31 +01:00
vdimir
14ba4696f9
Rename jaccardIndex -> stringJaccardIndex, upd doc 2023-11-02 11:37:50 +00:00
vdimir
1f936d1966
upd byteHammingDistance doc 2023-11-02 11:37:50 +00:00
Alexey Milovidov
1267246785
Merge pull request #55642 from ClickHouse/morton-utils
Indexing by space-filling curves
2023-11-02 12:21:33 +01:00
yokofly
84fd2191c9 fix comment:
Simplify ARM build instructions with replacement note
2023-11-02 03:55:22 -07:00
Alexander Chashnikov
3d88614e6b
fix typo
asteriks -> asterisk
2023-11-02 10:56:17 +02:00
Justin de Guzman
782d67766d
[Docs] Specify IAM role necessary for GCS table function 2023-11-01 21:56:20 -07:00
yokofly
46703bf7b9 Merge remote-tracking branch 'origin/master' into update-cross-compile-doc 2023-11-01 18:48:29 -07:00
yokofly
d2f9107889 clean blank 2023-11-01 18:47:56 -07:00
robot-ch-test-poll1
a5fb7b0a1e
Merge pull request #56213 from ttanay/sort-spill-to-disk-docs
Add `max_bytes_before_external_sort` setting to query complexity doc
2023-11-02 00:50:30 +01:00
Denny Crane
d145ddb293 fix asell 2023-11-02 00:01:42 +01:00
Denny Crane
71322bde3f
Update index.md 2023-11-01 17:07:27 -03:00
Joanna Hulboj
757dc8b944 Fix typos, add to/fromDaysSinceYearZero to fuzz 2023-11-01 17:48:58 +00:00
Tanay Tummalapalli
6a3b2a04d8 Add max_bytes_before_external_sort setting to query complexity doc
The setting should be mentioned here along with
`max_bytes_before_external_group_by` setting.

Note: The russian translation is courtesy of Google Translate.
2023-11-01 22:33:25 +05:30
Azat Khuzhin
c25d6cd624
Rename directory monitor concept into background INSERT (#55978)
* Limit log frequence for "Skipping send data over distributed table" message

After SYSTEM STOP DISTRIBUTED SENDS it will constantly print this
message.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename directory monitor concept into async INSERT

Rename the following query settings (with preserving backward
compatiblity, by keeping old name as an alias):
- distributed_directory_monitor_sleep_time_ms -> distributed_async_insert_sleep_time_ms
- distributed_directory_monitor_max_sleep_time_ms -> distributed_async_insert_max_sleep_time_ms
- distributed_directory_monitor_batch -> distributed_async_insert_batch_inserts
- distributed_directory_monitor_split_batch_on_failure -> distributed_async_insert_split_batch_on_failure

Rename the following table settings (with preserving backward
compatiblity, by keeping old name as an alias):
- monitor_batch_inserts -> async_insert_batch
- monitor_split_batch_on_failure -> async_insert_split_batch_on_failure
- directory_monitor_sleep_time_ms -> async_insert_sleep_time_ms
- directory_monitor_max_sleep_time_ms -> async_insert_max_sleep_time_ms

And also update all the references:

    $ gg -e directory_monitor_ -e monitor_ tests docs | cut -d: -f1 | sort -u | xargs sed -e 's/distributed_directory_monitor_sleep_time_ms/distributed_async_insert_sleep_time_ms/g' -e 's/distributed_directory_monitor_max_sleep_time_ms/distributed_async_insert_max_sleep_time_ms/g' -e 's/distributed_directory_monitor_batch_inserts/distributed_async_insert_batch/g' -e 's/distributed_directory_monitor_split_batch_on_failure/distributed_async_insert_split_batch_on_failure/g' -e 's/monitor_batch_inserts/async_insert_batch/g' -e 's/monitor_split_batch_on_failure/async_insert_split_batch_on_failure/g' -e 's/monitor_sleep_time_ms/async_insert_sleep_time_ms/g' -e 's/monitor_max_sleep_time_ms/async_insert_max_sleep_time_ms/g' -i

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename async_insert for Distributed into background_insert

This will avoid amigibuity between general async INSERT's and INSERT
into Distributed, which are indeed background, so new term express it
even better.

Mostly done with:

    $ git di HEAD^ --name-only | xargs sed -i -e 's/distributed_async_insert/distributed_background_insert/g' -e 's/async_insert_batch/background_insert_batch/g' -e 's/async_insert_split_batch_on_failure/background_insert_split_batch_on_failure/g' -e 's/async_insert_sleep_time_ms/background_insert_sleep_time_ms/g' -e 's/async_insert_max_sleep_time_ms/background_insert_max_sleep_time_ms/g'

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Mark 02417_opentelemetry_insert_on_distributed_table as long

CI: https://s3.amazonaws.com/clickhouse-test-reports/55978/7a6abb03a0b507e29e999cb7e04f246a119c6f28/stateless_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-01 15:09:39 +01:00
Kruglov Pavel
5533258091
Merge pull request #55477 from Avogar/streaming-errors
Allow to save unparsed records and errors in RabbitMQ, NATS and FileLog engines
2023-11-01 14:35:35 +01:00
Kruglov Pavel
bf77ce691c
Merge pull request #55982 from yariks5s/npy_input_format
New input format Npy
2023-11-01 14:26:22 +01:00
yokofly
6927a2cadf [Docs] Update cross-compilation guide for OSX
This commit addresses two primary changes:
1. Sync the cross-compilation code for use in the CI action docker:
   - Use `--depth=1` during cloning to reduce clone times.
   - Update to a newer version of the macOS SDK.
see:
eb3a7caa74/docker/packager/binary/Dockerfile (L82)

2. Intro cross-compilation support for aarch64 OSX. The key change involves replacing the `x86_64` phase with `aarch64`, which is the current configuration we use.
2023-11-01 05:46:18 -07:00
Nikolai Kochetov
4deaf7cefb
Merge pull request #56134 from yariks5s/force_optimize_projection_name
Implementing force_optimize_projection_name
2023-11-01 13:12:10 +01:00
Nikolay Degterinsky
cd779d4f50
Merge pull request #55856 from ClickHouse/rewrite-delete-docs
Rewrite DELETE docs
2023-11-01 00:10:01 +01:00
Joanna Hulboj
e5b4d7fac7 Fix failing checks 2023-10-31 21:00:11 +00:00
Justin de Guzman
a011990fd7
Add clangd recommendation for VS Code (#56071)
* Add clangd recommendation for VS Code

* Edit docs for clarity and add links

* Adds new words to dictionary. Sorts dictionary.

---------

Co-authored-by: johnnymatthews <9611008+johnnymatthews@users.noreply.github.com>
2023-10-31 16:35:47 +01:00
Robert Schulze
13b2946ae2
Merge pull request #55960 from rschu1ze/adddate-stringargs
Support string-encoded date arguments in `addDate()`
2023-10-31 15:37:34 +01:00
Sergey Suvorov
37843b0c28 Add alias for minSampleSizeContinuous after typo fix in #56143 2023-10-31 13:05:41 +01:00
Raúl Marín
f3a3ec53f6
Merge pull request #56124 from den-crane/patch-64
Beautify `show merges`
2023-10-31 11:02:10 +01:00
Smita Kulkarni
3fdf0daf1b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-31 10:43:28 +01:00
Alexey Milovidov
016285ea87
Merge branch 'master' into morton-utils 2023-10-31 01:47:16 +01:00
Sergey Suvorov
c59d700392 Add documentation for minSampleSizeConversion and minSampleSizeContinous 2023-10-30 20:54:51 +01:00
avogar
7eefb72c53 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-10-30 19:44:26 +00:00
yariks5s
0846714052 added docs, changed tests 2023-10-30 17:17:53 +00:00
Denny Crane
3535adf2af
Update show.md 2023-10-30 09:53:23 -03:00
yariks5s
9a2d89e3e4 removed getSize() and enhanced docs 2023-10-30 12:42:19 +00:00
Justin de Guzman
e33dc02c8c
Add note clarifying Prometheus support in ClickHouse Cloud (#56069) 2023-10-30 13:35:02 +01:00
Sergei Trifonov
58824fb02b
Merge pull request #56030 from azat/disks/least_used-fix
Fix incorrect free space accounting for least_used JBOD policy
2023-10-30 09:04:38 +01:00
Han Fei
19cdc6dfe2 Merge branch 'master' into hanfei/statistic 2023-10-30 04:53:18 +01:00
Alexey Milovidov
3631e476eb
Merge pull request #54947 from amosbird/minmax-combinator
Introduce -ArgMin/-ArgMax combinators.
2023-10-30 03:35:28 +01:00
robot-ch-test-poll2
088a3ada7f
Merge pull request #56070 from ClickHouse/docs-dictionary-updates
Clarify query behavior dictionary updates
2023-10-30 01:20:21 +01:00
Han Fei
df1e019268 address comments 2023-10-30 00:39:16 +01:00
Alexey Milovidov
6eff22568f
Revert "Add function getHttpHeader" 2023-10-29 19:50:39 +03:00
Azat Khuzhin
c7f392500e Fix incorrect free space accounting for least_used JBOD policy
Before least_used fails to detect when the disk started to have more
space, it works only when the disk starts to have less space.

The reason for this is that it uses priority_queue, and once the disk
goes at the bottom of the queue, free space will not be updated for it
until it will be selected again.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-29 17:36:31 +01:00
justindeguzman
9fecf429b1 Docs: edit lightweight DELETE docs based on feedback 2023-10-28 20:23:26 -07:00
rfraposa
a993683a5b Update amazon-reviews.md 2023-10-28 19:34:04 -06:00
rfraposa
11f2dd1d10 Update amazon-reviews.md 2023-10-28 13:13:24 -06:00
rfraposa
7ab492edad Update amazon-reviews.md 2023-10-28 12:58:47 -06:00
yariks5s
894724bfb3 suggested changes 2023-10-28 01:17:25 +00:00
Justin de Guzman
940d099e84
Set correct max_block_size value in docs 2023-10-27 16:50:34 -07:00
Bharat Nallan Chakravarthy
d86b751283 fix tests 2023-10-27 11:02:51 -07:00
Bharat Nallan Chakravarthy
429ddc8ed5 init docs 2023-10-27 11:02:51 -07:00
yariks5s
23635352f1 fixed due to review 2023-10-27 15:43:03 +00:00
vdimir
36c1919d7f
Add CHECK ALL TABLES to docs 2023-10-27 15:22:11 +00:00
Kruglov Pavel
bb4b95e891
Merge branch 'master' into schema-inference-union 2023-10-27 14:53:58 +02:00
Smita Kulkarni
960927a323 Updated name to use_compression 2023-10-27 14:53:54 +02:00
Rory Crispin
b817ab45bd
Fix dead link to Virtual Columns 2023-10-27 12:03:15 +02:00
Robert Schulze
a68e8be08f
Merge pull request #55696 from zvonand/zvonand-datetime-ranges
Introduce setting `date_time_overflow_behavior` to control the overflow behavior when converting to `Date` / `Date32` / `DateTime` / `DateTime64`
2023-10-27 10:40:20 +02:00
Sergei Trifonov
a5d7c2b6a2
Merge branch 'master' into async-loader-integration 2023-10-27 10:39:12 +02:00
Robert Schulze
5801b06529
Merge pull request #55983 from rschu1ze/snowflake-scale
Fix dateTime64ToSnowflake64() with non-default scale
2023-10-27 10:22:35 +02:00
Justin de Guzman
b51f90362d
Clarify query behavior dictionary updates 2023-10-27 00:20:32 -07:00
zvonand
35baf7792d cleanup after rebase, add [[unlikely]] 2023-10-26 23:56:45 +02:00
Robert Schulze
325ff33c3a
Merge pull request #55239 from aiven-sal/aiven-sal/format_query
Add formatQuery function
2023-10-26 22:46:01 +02:00
vdimir
dbaf66b8f2
Fix function_json_value_return_type_allow_nullable setting name in doc 2023-10-26 19:26:18 +02:00
Kruglov Pavel
570b66f027
Merge branch 'master' into schema-inference-union 2023-10-26 19:26:00 +02:00
Smita Kulkarni
d1d8f4b2e1 Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-26 16:56:03 +02:00
Alexander Tokmakov
fa963d60d0
Merge pull request #55641 from evillique/resubmit-cluster-groups
Resubmit #54421
2023-10-26 15:53:53 +02:00