Commit Graph

1314 Commits

Author SHA1 Message Date
Smita Kulkarni
a168a84624 Merge branch 'master' into Fix_endpoint_for_azureblobstorage 2024-02-29 10:55:31 +01:00
Smita Kulkarni
5d68c9f046 Updated default value of endpoint_contains_account_name to true 2024-02-29 09:38:13 +01:00
Alexander Tokmakov
25c82a5949
Merge pull request #57798 from kirillgarbar/modify-engine
Convert MergeTree tables to replicated on server restart if flag is set
2024-02-28 21:55:15 +01:00
Smita Kulkarni
a46d7c9191 Updated docs and addressed comments 2024-02-28 11:25:35 +01:00
Robert Schulze
4794dc28f0
Merge remote-tracking branch 'ClickHouse/master' into dist/config-settings 2024-02-26 21:57:33 +00:00
Smita Kulkarni
6ec23a0879 Updated docs for endpoint 2024-02-26 14:36:06 +01:00
Robert Schulze
1751d76234
Minor doc fixups 2024-02-26 11:42:11 +00:00
Andrey Zvonov
b4e582f47b
Merge branch 'ClickHouse:master' into zvonand-volume-priority 2024-02-26 09:54:29 +01:00
Pablo Musa
1d335ca645
Fix typos on postgresql.md 2024-02-23 18:34:44 +01:00
Alexander Tokmakov
c5ab1893d7 Merge branch 'master' into modify-engine 2024-02-21 20:37:58 +01:00
zvonand
622f3ebbe1 update behavior to be more intuitive 2024-02-20 10:19:52 +01:00
zvonand
e0d8a77792 fix typos and docs 2024-02-20 10:19:51 +01:00
zvonand
811027aa00 sort -> stable_sort 2024-02-20 10:19:51 +01:00
zvonand
1701183ced add volume_priority description in docs 2024-02-20 10:19:51 +01:00
Alexander Tokmakov
03ff171922 Merge branch 'master' into modify-engine 2024-02-16 17:22:24 +01:00
Igor Nikonov
062602d433 Merge remote-tracking branch 'origin/master' into docs_fix_typos 2024-02-15 18:22:00 +00:00
kssenii
5ae410e633 A bit more explanation 2024-02-15 18:33:38 +01:00
kssenii
9bcd4daabe Better 2024-02-15 16:35:50 +01:00
kssenii
750a82a4ff Update doc 2024-02-15 13:23:33 +01:00
Nikolai Fedorovskikh
a98af159b5 [Docs] fix some typos and missing commas 2024-02-13 02:10:41 +01:00
Justin de Guzman
d7850db40c
[Docs] Remove incorrect statement about Memory table engine 2024-02-12 09:54:38 -08:00
Justin de Guzman
560e78cf41
[Docs] More details for Memory table engine in Cloud 2024-02-07 21:08:30 -08:00
Justin de Guzman
b9bb04ebf0
[Docs] Specify Memory table engine usage on cloud 2024-02-05 13:23:54 -08:00
Nickolaj Jepsen
e822ba3a47 Add support for NATS credentials file 2024-02-02 23:34:01 +01:00
Han Fei
95abcaf183 address comments 2024-01-30 10:30:30 +01:00
Han Fei
f46065ba88 Merge branch 'master' into hanfei/stats_uniq 2024-01-29 22:46:13 +01:00
Han Fei
552e1acf18 support uniq for statistics 2024-01-29 19:49:10 +01:00
Duc Canh Le
adad010345 Merge branch 'master' into rocksdb_bypass_memtable
Try fixing weird CI errors
2024-01-27 01:16:32 +00:00
vdimir
8218657cbc
Add optimize_for_bulk_insert to embedded-rocksdb.md 2024-01-25 10:14:43 +01:00
Robert Schulze
e67076ea2b
Merge pull request #55201 from canhld94/column_level_compress_block
Column-level compression block sizes
2024-01-23 11:22:03 +01:00
Kruglov Pavel
0829de8928
Merge pull request #57599 from Khatskevich/khatskevich/fix_docs
Improve named collections documentation
2024-01-22 12:54:57 +01:00
Robert Schulze
1bfeee1954
Some fixups 2024-01-18 20:49:50 +00:00
Robert Schulze
15700592f7
Merge remote-tracking branch 'ClickHouse/master' into column_level_compress_block 2024-01-18 19:12:57 +00:00
Duc Canh Le
b16a4cf361 add document
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2024-01-18 07:55:44 +00:00
Кирилл Гарбар
dfbc2b142c GetTableDataPath and new docs 2024-01-17 12:50:09 +03:00
Robert Schulze
3fbbeaa319
Update docs 2024-01-12 14:10:25 +00:00
Robert Schulze
27e809a4f5
Add match() to supported functions for token/ngrambf_v1 indexes 2024-01-10 13:39:19 +00:00
Robert Schulze
92692bc57c
Fix links 2024-01-10 13:36:54 +00:00
Robert Schulze
9323fe8ecd
Cosmetics 2024-01-10 12:50:05 +00:00
Sema Checherinda
7c7e72c4b7
Merge pull request #58573 from ClickHouse/chesema-s3-client-creation
fix and test that S3Clients are reused
2024-01-09 13:28:20 +01:00
Кирилл Гарбар
85163994dc Merge remote-tracking branch 'ClickHouse/master' 2024-01-09 04:51:51 +03:00
Кирилл Гарбар
c7b14d190e Remove flags directory 2024-01-08 07:09:38 +03:00
Sema Checherinda
d5f86f671d fix and test that S3Clients reused 2024-01-07 02:19:06 +01:00
Sema Checherinda
92ad027714 add docs 2024-01-05 13:42:30 +00:00
Aliaksei Khatskevich
b8f399b6ee
Add named collections to redis table engine docs 2024-01-04 09:22:41 +01:00
Aliaksei Khatskevich
9d61f03c43
Add named collections to mysql table engine docs 2024-01-04 09:22:41 +01:00
Aliaksei Khatskevich
394ac56a22
Fix postgres table engine docs 2024-01-04 09:22:41 +01:00
Alexander Tokmakov
bdada351c8 Revert "Merge pull request #58274 from ClickHouse/revert-58267"
This reverts commit 583b9637c2, reversing
changes made to 224e937620.
2023-12-28 14:07:59 +01:00
Alexey Milovidov
c7efd2afea Revert #58267 2023-12-28 04:09:33 +01:00
Alexander Tokmakov
01d042c490 Revert "Merge pull request #57932 from ClickHouse/remove-shit-cleanup"
This reverts commit 2d58dc512c, reversing
changes made to 41873dc4a3.
2023-12-27 13:46:06 +01:00
Christoph Wurm
9def89d416 Fix anchors to settings.md 2023-12-20 18:26:36 +00:00
Robert Schulze
6053fa9d89
Merge remote-tracking branch 'rschu1ze/master' into docs-mv-table-engine 2023-12-19 11:52:26 +00:00
Кирилл Гарбар
f2a1ab522e Merge remote-tracking branch 'ClickHouse/master' 2023-12-18 13:45:28 +03:00
Robert Schulze
7f675ddf80
Merge pull request #57878 from Jpnock/master
Apply full-text skipping index when using `hasAny()`
2023-12-17 11:06:29 +01:00
Alexey Milovidov
ee502ef6b9 Remove trash (OPTIMIZE CLEANUP) 2023-12-15 22:41:58 +01:00
James Nock
2c24e438aa Add docs for skip index support of hasXXX() funcs 2023-12-15 17:28:45 +00:00
Кирилл Гарбар
0f60259fc7 Docs for MT convertation 2023-12-15 15:57:25 +03:00
Johnny
23ba3b5fa5
Merge pull request #57488 from ClickHouse/add/no-cloud-distributed-table-engine
Adds callout that distributed table engine that it is not supported in Cloud.
2023-12-11 17:06:12 -04:00
Alexey Milovidov
05bc8ef1e0
Merge pull request #57548 from ClickHouse/s3queue_production_ready
`S3Queue` is production ready
2023-12-06 22:21:08 +01:00
Alexey Milovidov
b91e0f89ec Address review comments 2023-12-06 12:24:58 +01:00
Alexey Milovidov
0b597eadf8 Clarify the usage of prefer_not_to_merge option 2023-12-06 12:11:03 +01:00
Robert Schulze
1276c3ab80
Try to fix broken links 2023-12-06 08:48:56 +00:00
johnnymatthews
e9d9048903 Changes 'cannot run on cloud' message. 2023-12-05 17:14:10 -04:00
Alexey Milovidov
76bbeaa676 S3Queue is production ready 2023-12-05 21:10:19 +01:00
Robert Schulze
b9f281f672
Docs: Remove mention of MV table engine 2023-12-05 19:24:47 +00:00
johnnymatthews
c6ca43b341 Moves self-hosted-only box under page title. 2023-12-04 18:05:34 -04:00
johnnymatthews
06a52e1452 Merge branch 'master' into add/no-cloud-distributed-table-engine 2023-12-04 18:00:40 -04:00
johnnymatthews
40062405fb Adds 'not available on cloud' to Distributed Table Engine. 2023-12-04 17:59:11 -04:00
johnnymatthews
e2eb47b2ec Reverts last commit. 2023-12-04 17:58:19 -04:00
johnnymatthews
7ce33b0737 Adds 'not available on cloud' to Distributed Table Engine. 2023-12-04 17:57:33 -04:00
Han Fei
7bd2ea3add Merge branch 'master' into hanfei/statistic 2023-11-27 23:31:23 +01:00
vdimir
bbc202a891
Merge pull request #56816 from AVMusorin/improve-settings-rocksdb
Show total_bytes and total_rows in system tables for RocksDB storage
2023-11-27 11:42:15 +01:00
Kruglov Pavel
b10e46b2bc
Merge pull request #57126 from Avogar/size-virtual-column
Add _size virtual column to s3/file/hdfs/url/azureBlobStorage engines
2023-11-27 10:12:18 +01:00
Nikolay Degterinsky
de0876ed68
Merge pull request #57234 from evillique/fix-docs-anchors
Fix docs
2023-11-27 01:22:43 +01:00
Nikolay Degterinsky
faa3a43803 Fix docs 2023-11-26 19:21:39 +00:00
Kseniia Sumarokova
13187bf4f1
Merge pull request #56959 from melvynator/master
Add experimental flag for MaterializedPostgreSQL table engine.
2023-11-24 16:16:42 +01:00
avogar
6b64efb55a Add docs 2023-11-22 18:21:30 +00:00
Aleksandr Musorin
ee0ae17ce2 Added optimize_trivial_approximate_count_query documentatiosn for RocksDB 2023-11-21 11:31:56 +01:00
robot-ch-test-poll
e71ca7dcef
Merge pull request #56985 from czlee/patch-1
[Docs] MaterializedPostgreSQL: Change DETACH to DETACH PERMANENTLY
2023-11-20 13:33:52 +01:00
Chuan-Zheng Lee
96c603ef97
[Docs] MaterializedPostgreSQL: Change DETACH to DETACH PERMANENTLY
If I'm not mistaken, ClickHouse/ClickHouse#35158 changed the syntax for dynamically removing tables from MaterializedPostgreSQL databases from `DETACH` to `DETACH PERMANENTLY`. Currently when just running `DETACH TABLE postgres_database.table_to_remove`, it shows an error:
```
DETACH TABLE not allowed, use DETACH PERMANENTLY. (NOT_IMPLEMENTED)
```

This adds the keyword `PERMANENTLY` to both places where `DETACH` occurs on the MaterializedPostgreSQL database engine page.
2023-11-20 18:15:14 +13:00
Peignon Melvyn
f6e4c29669
MaterializedMysql doc
Add experimental flag for materializedMysql
2023-11-20 01:49:17 +01:00
robot-ch-test-poll
4fa085d7e2
Merge pull request #56965 from ClickHouse/docs-replacingmergetree-freq-updates
[Docs] Recommend ReplacingMergeTree for frequent updates
2023-11-19 10:56:47 +01:00
Justin de Guzman
f29777db2d
[Docs] More typos 2023-11-18 18:41:20 -08:00
Justin de Guzman
a398e3f51e
[Docs] Fix typo 2023-11-18 18:40:14 -08:00
Justin de Guzman
8062fb578c
[Docs] Recommend ReplacingMergeTree for frequent updates 2023-11-18 18:38:49 -08:00
Justin de Guzman
5e1da38720
[Docs] Add details on why partitions improve query perf 2023-11-18 18:28:29 -08:00
Ubuntu
16e7bd201b Add experimental flag for PostgresSQL table engine. Also add documentation on how to enable it 2023-11-18 18:22:33 +00:00
avogar
58b9bde0fa Better docs for virtual columns in Kafka/RabbitMQ/NATS/FileLog 2023-11-14 21:15:30 +00:00
justindeguzman
f3b0550dd3 [Docs] Add details about sharding_key for distributed table engine 2023-11-12 19:43:43 -08:00
Peignon Melvyn
ba87360114
Mark MaterializedPostreSQL as experimental in docs (#56462) 2023-11-08 20:26:19 +01:00
Azat Khuzhin
c25d6cd624
Rename directory monitor concept into background INSERT (#55978)
* Limit log frequence for "Skipping send data over distributed table" message

After SYSTEM STOP DISTRIBUTED SENDS it will constantly print this
message.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename directory monitor concept into async INSERT

Rename the following query settings (with preserving backward
compatiblity, by keeping old name as an alias):
- distributed_directory_monitor_sleep_time_ms -> distributed_async_insert_sleep_time_ms
- distributed_directory_monitor_max_sleep_time_ms -> distributed_async_insert_max_sleep_time_ms
- distributed_directory_monitor_batch -> distributed_async_insert_batch_inserts
- distributed_directory_monitor_split_batch_on_failure -> distributed_async_insert_split_batch_on_failure

Rename the following table settings (with preserving backward
compatiblity, by keeping old name as an alias):
- monitor_batch_inserts -> async_insert_batch
- monitor_split_batch_on_failure -> async_insert_split_batch_on_failure
- directory_monitor_sleep_time_ms -> async_insert_sleep_time_ms
- directory_monitor_max_sleep_time_ms -> async_insert_max_sleep_time_ms

And also update all the references:

    $ gg -e directory_monitor_ -e monitor_ tests docs | cut -d: -f1 | sort -u | xargs sed -e 's/distributed_directory_monitor_sleep_time_ms/distributed_async_insert_sleep_time_ms/g' -e 's/distributed_directory_monitor_max_sleep_time_ms/distributed_async_insert_max_sleep_time_ms/g' -e 's/distributed_directory_monitor_batch_inserts/distributed_async_insert_batch/g' -e 's/distributed_directory_monitor_split_batch_on_failure/distributed_async_insert_split_batch_on_failure/g' -e 's/monitor_batch_inserts/async_insert_batch/g' -e 's/monitor_split_batch_on_failure/async_insert_split_batch_on_failure/g' -e 's/monitor_sleep_time_ms/async_insert_sleep_time_ms/g' -e 's/monitor_max_sleep_time_ms/async_insert_max_sleep_time_ms/g' -i

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename async_insert for Distributed into background_insert

This will avoid amigibuity between general async INSERT's and INSERT
into Distributed, which are indeed background, so new term express it
even better.

Mostly done with:

    $ git di HEAD^ --name-only | xargs sed -i -e 's/distributed_async_insert/distributed_background_insert/g' -e 's/async_insert_batch/background_insert_batch/g' -e 's/async_insert_split_batch_on_failure/background_insert_split_batch_on_failure/g' -e 's/async_insert_sleep_time_ms/background_insert_sleep_time_ms/g' -e 's/async_insert_max_sleep_time_ms/background_insert_max_sleep_time_ms/g'

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Mark 02417_opentelemetry_insert_on_distributed_table as long

CI: https://s3.amazonaws.com/clickhouse-test-reports/55978/7a6abb03a0b507e29e999cb7e04f246a119c6f28/stateless_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-01 15:09:39 +01:00
Kruglov Pavel
5533258091
Merge pull request #55477 from Avogar/streaming-errors
Allow to save unparsed records and errors in RabbitMQ, NATS and FileLog engines
2023-11-01 14:35:35 +01:00
Han Fei
19cdc6dfe2 Merge branch 'master' into hanfei/statistic 2023-10-30 04:53:18 +01:00
Han Fei
df1e019268 address comments 2023-10-30 00:39:16 +01:00
Azat Khuzhin
c7f392500e Fix incorrect free space accounting for least_used JBOD policy
Before least_used fails to detect when the disk started to have more
space, it works only when the disk starts to have less space.

The reason for this is that it uses priority_queue, and once the disk
goes at the bottom of the queue, free space will not be updated for it
until it will be selected again.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-29 17:36:31 +01:00
Rory Crispin
b817ab45bd
Fix dead link to Virtual Columns 2023-10-27 12:03:15 +02:00
Kruglov Pavel
14c97fb426
Update docs/en/engines/table-engines/mergetree-family/mergetree.md 2023-10-23 12:48:05 +02:00
Srikanth Chekuri
327386a348 Merge remote-tracking branch 'upstream/master' into issue-55023 2023-10-22 10:22:14 +05:30
Srikanth Chekuri
0f2e0ade99 Update merge tree doc 2023-10-21 21:51:10 +05:30
Kseniia Sumarokova
4e0122a299
Merge pull request #54422 from kssenii/s3-queue-fixes
Fixes for storage `S3Queue`
2023-10-18 21:51:51 +02:00
Kseniia Sumarokova
7cedfeff12
Merge pull request #55145 from kssenii/materialized-pg-allow-unique-identifier
Allow to have several MaterializedPostgreSQL tables following the same Postgres table
2023-10-17 18:47:32 +02:00
Han Fei
4b23142775
Merge branch 'master' into hanfei/statistic 2023-10-17 16:40:31 +02:00
kssenii
fd37e25fbd Fix doc 2023-10-17 15:07:58 +02:00
kssenii
4d2cf5206f Update documentation 2023-10-17 14:12:15 +02:00
Robert Schulze
96a82df75a
Merge pull request #55616 from HarryLeeIBM/hlee-fts-max-rows
Inverted index: Replace setting density with `max_rows_in_postings_list`
2023-10-17 11:36:46 +02:00
HarryLeeIBM
fb8cd298d1 Code refactoring according to code review 2023-10-16 17:52:39 -07:00
Kseniia Sumarokova
310e922b40
Merge branch 'master' into materialized-pg-allow-unique-identifier 2023-10-13 19:14:50 +02:00
kssenii
a9c0c20cad Update documentation 2023-10-13 13:21:50 +02:00
kssenii
d64b990712 Merge remote-tracking branch 'origin/master' into s3-queue-fixes 2023-10-13 12:13:56 +02:00
Han Fei
42dc61abf5 Merge branch 'master' into hanfei/statistic 2023-10-12 16:19:45 +02:00
Alexander Tokmakov
eeacdbae9c
Update replacingmergetree.md 2023-10-11 19:46:58 +02:00
avogar
178c799697 Fix typos 2023-10-11 17:38:17 +00:00
avogar
6c91c2b860 Add documentation 2023-10-11 17:35:18 +00:00
Han Fei
253b8efa58 do not modify column type when there is statistic 2023-10-11 16:57:40 +02:00
Alexey Milovidov
76977a6a72
Merge pull request #55423 from hanfei1991/hanfei/refine-ttl-doc
change a docs example about creating table columns with ttl
2023-10-10 01:14:38 +02:00
Han Fei
8d5eb26185 address comments 2023-10-09 23:06:23 +02:00
Han Fei
3894c75af1 change a docs example about creating table columns with ttl 2023-10-09 18:34:36 +02:00
Han Fei
fcb19b4f77 Merge branch 'master' into hanfei/statistic 2023-10-09 14:24:58 +02:00
Derek Chia
f787186ba8
Update replacingmergetree.md
Added example for ReplacingMergeTree with is_deleted parameter
2023-10-09 15:16:24 +08:00
Denny Crane
3e80f66d38 update use_local_cache_for_remote_storage settings name 2023-10-03 21:09:35 -03:00
Justin de Guzman
f3c65eb118
Fix ordering of S3Queue in sidebar 2023-09-29 08:40:49 -07:00
kssenii
d1f6888119 Allow unique consumer identifier 2023-09-29 16:17:02 +02:00
kssenii
4a7922507b Minor changes 2023-09-28 16:18:00 +02:00
kssenii
7d91ba109a Update doc 2023-09-28 13:58:59 +02:00
Peignon Melvyn
cbf0535468
Update s3queue.md 2023-09-28 13:34:09 +02:00
Han Fei
76b9d43dc4 make code beautiful 2023-09-27 11:01:53 +02:00
Han Fei
4e7745f757 Merge branch 'master' into hanfei/statistic 2023-09-26 21:43:53 +02:00
kssenii
251b0165ca Better 2023-09-25 22:55:41 +02:00
kssenii
3b54b6be88 Add system tables 2023-09-25 20:04:15 +02:00
Robert Schulze
10cee14bce
Fix docs 2023-09-25 17:09:58 +00:00
Robert Schulze
3562204850
+ docs 2023-09-25 17:08:37 +00:00
Robert Schulze
c2a593baf9
Split tests 2023-09-21 09:17:38 +00:00
Robert Schulze
2c91e52da1
Merge pull request #54600 from rschu1ze/fix-annoy-crash
Annoy/Usearch index: Fix LOGICAL_ERROR during build-up with default values
2023-09-20 17:05:16 +02:00
SmitaRKulkarni
d8adf05de2
Added a new column _block_number (#47532)
Added a new virtual column _block_number which is persisted on merges when allow_experimental_block_number_column is enabled
2023-09-20 11:31:12 +02:00
Han Fei
17243b84ab Merge branch 'master' into hanfei/statistic 2023-09-19 17:09:17 +02:00
Robert Schulze
baf1016e4b
More 2023-09-18 18:39:21 +00:00
Robert Schulze
4ed5b903b4
Docs: remove anchor prefix 2023-09-18 18:35:59 +00:00
kssenii
10518a9c83 Merge remote-tracking branch 'upstream/master' into kssenii-patch-6 2023-09-18 13:00:26 +02:00
Robert Schulze
945179be46
Annoy: Fix LOGICAL_ERROR with default values #52258 2023-09-14 19:23:32 +00:00
Robert Schulze
f0eadd4b22
Merge pull request #54103 from ClickHouse/ustweaks
Small usearch index improvements: metrics and configurable internal data type
2023-09-14 19:58:53 +02:00
Robert Schulze
e018f1d913
Fix spelling 2023-09-14 12:42:22 +00:00
Michael Kolupaev
8997464867
Small usearch index improvements: metrics and f16 2023-09-14 11:24:47 +00:00
vdimir
10bcc028df
Add cluster discovery documentation 2023-09-14 11:16:09 +00:00
Sergei Trifonov
08bad4d440
Merge pull request #47009 from ClickHouse/disks-and-io-sheduler 2023-09-11 07:22:14 +02:00
Han Fei
ddcb64f39f update docs and refine statements 2023-09-08 02:27:17 +02:00
Kseniia Sumarokova
bf3dc24471
Update mergetree.md 2023-09-07 11:23:42 +02:00
Roman G
eb1812cc87
Update generate.md 2023-09-05 15:55:58 -04:00
robot-clickhouse
9cafdbd972
Merge pull request #54309 from evillique/better-docs
Make docs better
2023-09-05 15:58:59 +02:00
Nikolay Degterinsky
2db239d6ad Make docs better 2023-09-05 12:43:53 +00:00
serxa
14e2032d92 add documentation 2023-09-01 16:28:03 +00:00