Commit Graph

1114 Commits

Author SHA1 Message Date
Azat Khuzhin
c25d6cd624
Rename directory monitor concept into background INSERT (#55978)
* Limit log frequence for "Skipping send data over distributed table" message

After SYSTEM STOP DISTRIBUTED SENDS it will constantly print this
message.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename directory monitor concept into async INSERT

Rename the following query settings (with preserving backward
compatiblity, by keeping old name as an alias):
- distributed_directory_monitor_sleep_time_ms -> distributed_async_insert_sleep_time_ms
- distributed_directory_monitor_max_sleep_time_ms -> distributed_async_insert_max_sleep_time_ms
- distributed_directory_monitor_batch -> distributed_async_insert_batch_inserts
- distributed_directory_monitor_split_batch_on_failure -> distributed_async_insert_split_batch_on_failure

Rename the following table settings (with preserving backward
compatiblity, by keeping old name as an alias):
- monitor_batch_inserts -> async_insert_batch
- monitor_split_batch_on_failure -> async_insert_split_batch_on_failure
- directory_monitor_sleep_time_ms -> async_insert_sleep_time_ms
- directory_monitor_max_sleep_time_ms -> async_insert_max_sleep_time_ms

And also update all the references:

    $ gg -e directory_monitor_ -e monitor_ tests docs | cut -d: -f1 | sort -u | xargs sed -e 's/distributed_directory_monitor_sleep_time_ms/distributed_async_insert_sleep_time_ms/g' -e 's/distributed_directory_monitor_max_sleep_time_ms/distributed_async_insert_max_sleep_time_ms/g' -e 's/distributed_directory_monitor_batch_inserts/distributed_async_insert_batch/g' -e 's/distributed_directory_monitor_split_batch_on_failure/distributed_async_insert_split_batch_on_failure/g' -e 's/monitor_batch_inserts/async_insert_batch/g' -e 's/monitor_split_batch_on_failure/async_insert_split_batch_on_failure/g' -e 's/monitor_sleep_time_ms/async_insert_sleep_time_ms/g' -e 's/monitor_max_sleep_time_ms/async_insert_max_sleep_time_ms/g' -i

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename async_insert for Distributed into background_insert

This will avoid amigibuity between general async INSERT's and INSERT
into Distributed, which are indeed background, so new term express it
even better.

Mostly done with:

    $ git di HEAD^ --name-only | xargs sed -i -e 's/distributed_async_insert/distributed_background_insert/g' -e 's/async_insert_batch/background_insert_batch/g' -e 's/async_insert_split_batch_on_failure/background_insert_split_batch_on_failure/g' -e 's/async_insert_sleep_time_ms/background_insert_sleep_time_ms/g' -e 's/async_insert_max_sleep_time_ms/background_insert_max_sleep_time_ms/g'

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Mark 02417_opentelemetry_insert_on_distributed_table as long

CI: https://s3.amazonaws.com/clickhouse-test-reports/55978/7a6abb03a0b507e29e999cb7e04f246a119c6f28/stateless_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-01 15:09:39 +01:00
Kruglov Pavel
5533258091
Merge pull request #55477 from Avogar/streaming-errors
Allow to save unparsed records and errors in RabbitMQ, NATS and FileLog engines
2023-11-01 14:35:35 +01:00
Azat Khuzhin
c7f392500e Fix incorrect free space accounting for least_used JBOD policy
Before least_used fails to detect when the disk started to have more
space, it works only when the disk starts to have less space.

The reason for this is that it uses priority_queue, and once the disk
goes at the bottom of the queue, free space will not be updated for it
until it will be selected again.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-29 17:36:31 +01:00
Rory Crispin
b817ab45bd
Fix dead link to Virtual Columns 2023-10-27 12:03:15 +02:00
Kruglov Pavel
14c97fb426
Update docs/en/engines/table-engines/mergetree-family/mergetree.md 2023-10-23 12:48:05 +02:00
Srikanth Chekuri
327386a348 Merge remote-tracking branch 'upstream/master' into issue-55023 2023-10-22 10:22:14 +05:30
Srikanth Chekuri
0f2e0ade99 Update merge tree doc 2023-10-21 21:51:10 +05:30
Kseniia Sumarokova
4e0122a299
Merge pull request #54422 from kssenii/s3-queue-fixes
Fixes for storage `S3Queue`
2023-10-18 21:51:51 +02:00
Kseniia Sumarokova
7cedfeff12
Merge pull request #55145 from kssenii/materialized-pg-allow-unique-identifier
Allow to have several MaterializedPostgreSQL tables following the same Postgres table
2023-10-17 18:47:32 +02:00
kssenii
fd37e25fbd Fix doc 2023-10-17 15:07:58 +02:00
kssenii
4d2cf5206f Update documentation 2023-10-17 14:12:15 +02:00
Robert Schulze
96a82df75a
Merge pull request #55616 from HarryLeeIBM/hlee-fts-max-rows
Inverted index: Replace setting density with `max_rows_in_postings_list`
2023-10-17 11:36:46 +02:00
HarryLeeIBM
fb8cd298d1 Code refactoring according to code review 2023-10-16 17:52:39 -07:00
Kseniia Sumarokova
310e922b40
Merge branch 'master' into materialized-pg-allow-unique-identifier 2023-10-13 19:14:50 +02:00
kssenii
a9c0c20cad Update documentation 2023-10-13 13:21:50 +02:00
kssenii
d64b990712 Merge remote-tracking branch 'origin/master' into s3-queue-fixes 2023-10-13 12:13:56 +02:00
Alexander Tokmakov
eeacdbae9c
Update replacingmergetree.md 2023-10-11 19:46:58 +02:00
avogar
178c799697 Fix typos 2023-10-11 17:38:17 +00:00
avogar
6c91c2b860 Add documentation 2023-10-11 17:35:18 +00:00
Alexey Milovidov
76977a6a72
Merge pull request #55423 from hanfei1991/hanfei/refine-ttl-doc
change a docs example about creating table columns with ttl
2023-10-10 01:14:38 +02:00
Han Fei
8d5eb26185 address comments 2023-10-09 23:06:23 +02:00
Han Fei
3894c75af1 change a docs example about creating table columns with ttl 2023-10-09 18:34:36 +02:00
Derek Chia
f787186ba8
Update replacingmergetree.md
Added example for ReplacingMergeTree with is_deleted parameter
2023-10-09 15:16:24 +08:00
Denny Crane
3e80f66d38 update use_local_cache_for_remote_storage settings name 2023-10-03 21:09:35 -03:00
Justin de Guzman
f3c65eb118
Fix ordering of S3Queue in sidebar 2023-09-29 08:40:49 -07:00
kssenii
d1f6888119 Allow unique consumer identifier 2023-09-29 16:17:02 +02:00
kssenii
4a7922507b Minor changes 2023-09-28 16:18:00 +02:00
kssenii
7d91ba109a Update doc 2023-09-28 13:58:59 +02:00
Peignon Melvyn
cbf0535468
Update s3queue.md 2023-09-28 13:34:09 +02:00
kssenii
251b0165ca Better 2023-09-25 22:55:41 +02:00
kssenii
3b54b6be88 Add system tables 2023-09-25 20:04:15 +02:00
Robert Schulze
10cee14bce
Fix docs 2023-09-25 17:09:58 +00:00
Robert Schulze
3562204850
+ docs 2023-09-25 17:08:37 +00:00
Robert Schulze
c2a593baf9
Split tests 2023-09-21 09:17:38 +00:00
Robert Schulze
2c91e52da1
Merge pull request #54600 from rschu1ze/fix-annoy-crash
Annoy/Usearch index: Fix LOGICAL_ERROR during build-up with default values
2023-09-20 17:05:16 +02:00
SmitaRKulkarni
d8adf05de2
Added a new column _block_number (#47532)
Added a new virtual column _block_number which is persisted on merges when allow_experimental_block_number_column is enabled
2023-09-20 11:31:12 +02:00
Robert Schulze
baf1016e4b
More 2023-09-18 18:39:21 +00:00
Robert Schulze
4ed5b903b4
Docs: remove anchor prefix 2023-09-18 18:35:59 +00:00
kssenii
10518a9c83 Merge remote-tracking branch 'upstream/master' into kssenii-patch-6 2023-09-18 13:00:26 +02:00
Robert Schulze
945179be46
Annoy: Fix LOGICAL_ERROR with default values #52258 2023-09-14 19:23:32 +00:00
Robert Schulze
f0eadd4b22
Merge pull request #54103 from ClickHouse/ustweaks
Small usearch index improvements: metrics and configurable internal data type
2023-09-14 19:58:53 +02:00
Robert Schulze
e018f1d913
Fix spelling 2023-09-14 12:42:22 +00:00
Michael Kolupaev
8997464867
Small usearch index improvements: metrics and f16 2023-09-14 11:24:47 +00:00
vdimir
10bcc028df
Add cluster discovery documentation 2023-09-14 11:16:09 +00:00
Sergei Trifonov
08bad4d440
Merge pull request #47009 from ClickHouse/disks-and-io-sheduler 2023-09-11 07:22:14 +02:00
Kseniia Sumarokova
bf3dc24471
Update mergetree.md 2023-09-07 11:23:42 +02:00
Roman G
eb1812cc87
Update generate.md 2023-09-05 15:55:58 -04:00
robot-clickhouse
9cafdbd972
Merge pull request #54309 from evillique/better-docs
Make docs better
2023-09-05 15:58:59 +02:00
Nikolay Degterinsky
2db239d6ad Make docs better 2023-09-05 12:43:53 +00:00
serxa
14e2032d92 add documentation 2023-09-01 16:28:03 +00:00