Commit Graph

1231 Commits

Author SHA1 Message Date
Justin de Guzman
a398e3f51e
[Docs] Fix typo 2023-11-18 18:40:14 -08:00
Justin de Guzman
8062fb578c
[Docs] Recommend ReplacingMergeTree for frequent updates 2023-11-18 18:38:49 -08:00
Justin de Guzman
5e1da38720
[Docs] Add details on why partitions improve query perf 2023-11-18 18:28:29 -08:00
Ubuntu
16e7bd201b Add experimental flag for PostgresSQL table engine. Also add documentation on how to enable it 2023-11-18 18:22:33 +00:00
avogar
58b9bde0fa Better docs for virtual columns in Kafka/RabbitMQ/NATS/FileLog 2023-11-14 21:15:30 +00:00
justindeguzman
f3b0550dd3 [Docs] Add details about sharding_key for distributed table engine 2023-11-12 19:43:43 -08:00
Peignon Melvyn
ba87360114
Mark MaterializedPostreSQL as experimental in docs (#56462) 2023-11-08 20:26:19 +01:00
Azat Khuzhin
c25d6cd624
Rename directory monitor concept into background INSERT (#55978)
* Limit log frequence for "Skipping send data over distributed table" message

After SYSTEM STOP DISTRIBUTED SENDS it will constantly print this
message.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename directory monitor concept into async INSERT

Rename the following query settings (with preserving backward
compatiblity, by keeping old name as an alias):
- distributed_directory_monitor_sleep_time_ms -> distributed_async_insert_sleep_time_ms
- distributed_directory_monitor_max_sleep_time_ms -> distributed_async_insert_max_sleep_time_ms
- distributed_directory_monitor_batch -> distributed_async_insert_batch_inserts
- distributed_directory_monitor_split_batch_on_failure -> distributed_async_insert_split_batch_on_failure

Rename the following table settings (with preserving backward
compatiblity, by keeping old name as an alias):
- monitor_batch_inserts -> async_insert_batch
- monitor_split_batch_on_failure -> async_insert_split_batch_on_failure
- directory_monitor_sleep_time_ms -> async_insert_sleep_time_ms
- directory_monitor_max_sleep_time_ms -> async_insert_max_sleep_time_ms

And also update all the references:

    $ gg -e directory_monitor_ -e monitor_ tests docs | cut -d: -f1 | sort -u | xargs sed -e 's/distributed_directory_monitor_sleep_time_ms/distributed_async_insert_sleep_time_ms/g' -e 's/distributed_directory_monitor_max_sleep_time_ms/distributed_async_insert_max_sleep_time_ms/g' -e 's/distributed_directory_monitor_batch_inserts/distributed_async_insert_batch/g' -e 's/distributed_directory_monitor_split_batch_on_failure/distributed_async_insert_split_batch_on_failure/g' -e 's/monitor_batch_inserts/async_insert_batch/g' -e 's/monitor_split_batch_on_failure/async_insert_split_batch_on_failure/g' -e 's/monitor_sleep_time_ms/async_insert_sleep_time_ms/g' -e 's/monitor_max_sleep_time_ms/async_insert_max_sleep_time_ms/g' -i

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename async_insert for Distributed into background_insert

This will avoid amigibuity between general async INSERT's and INSERT
into Distributed, which are indeed background, so new term express it
even better.

Mostly done with:

    $ git di HEAD^ --name-only | xargs sed -i -e 's/distributed_async_insert/distributed_background_insert/g' -e 's/async_insert_batch/background_insert_batch/g' -e 's/async_insert_split_batch_on_failure/background_insert_split_batch_on_failure/g' -e 's/async_insert_sleep_time_ms/background_insert_sleep_time_ms/g' -e 's/async_insert_max_sleep_time_ms/background_insert_max_sleep_time_ms/g'

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Mark 02417_opentelemetry_insert_on_distributed_table as long

CI: https://s3.amazonaws.com/clickhouse-test-reports/55978/7a6abb03a0b507e29e999cb7e04f246a119c6f28/stateless_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-01 15:09:39 +01:00
Kruglov Pavel
5533258091
Merge pull request #55477 from Avogar/streaming-errors
Allow to save unparsed records and errors in RabbitMQ, NATS and FileLog engines
2023-11-01 14:35:35 +01:00
Han Fei
19cdc6dfe2 Merge branch 'master' into hanfei/statistic 2023-10-30 04:53:18 +01:00
Han Fei
df1e019268 address comments 2023-10-30 00:39:16 +01:00
Azat Khuzhin
c7f392500e Fix incorrect free space accounting for least_used JBOD policy
Before least_used fails to detect when the disk started to have more
space, it works only when the disk starts to have less space.

The reason for this is that it uses priority_queue, and once the disk
goes at the bottom of the queue, free space will not be updated for it
until it will be selected again.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-29 17:36:31 +01:00
Rory Crispin
b817ab45bd
Fix dead link to Virtual Columns 2023-10-27 12:03:15 +02:00
Kruglov Pavel
14c97fb426
Update docs/en/engines/table-engines/mergetree-family/mergetree.md 2023-10-23 12:48:05 +02:00
Srikanth Chekuri
327386a348 Merge remote-tracking branch 'upstream/master' into issue-55023 2023-10-22 10:22:14 +05:30
Srikanth Chekuri
0f2e0ade99 Update merge tree doc 2023-10-21 21:51:10 +05:30
Kseniia Sumarokova
4e0122a299
Merge pull request #54422 from kssenii/s3-queue-fixes
Fixes for storage `S3Queue`
2023-10-18 21:51:51 +02:00
Kseniia Sumarokova
7cedfeff12
Merge pull request #55145 from kssenii/materialized-pg-allow-unique-identifier
Allow to have several MaterializedPostgreSQL tables following the same Postgres table
2023-10-17 18:47:32 +02:00
Han Fei
4b23142775
Merge branch 'master' into hanfei/statistic 2023-10-17 16:40:31 +02:00
kssenii
fd37e25fbd Fix doc 2023-10-17 15:07:58 +02:00
kssenii
4d2cf5206f Update documentation 2023-10-17 14:12:15 +02:00
Robert Schulze
96a82df75a
Merge pull request #55616 from HarryLeeIBM/hlee-fts-max-rows
Inverted index: Replace setting density with `max_rows_in_postings_list`
2023-10-17 11:36:46 +02:00
HarryLeeIBM
fb8cd298d1 Code refactoring according to code review 2023-10-16 17:52:39 -07:00
Kseniia Sumarokova
310e922b40
Merge branch 'master' into materialized-pg-allow-unique-identifier 2023-10-13 19:14:50 +02:00
kssenii
a9c0c20cad Update documentation 2023-10-13 13:21:50 +02:00
kssenii
d64b990712 Merge remote-tracking branch 'origin/master' into s3-queue-fixes 2023-10-13 12:13:56 +02:00
Han Fei
42dc61abf5 Merge branch 'master' into hanfei/statistic 2023-10-12 16:19:45 +02:00
Alexander Tokmakov
eeacdbae9c
Update replacingmergetree.md 2023-10-11 19:46:58 +02:00
avogar
178c799697 Fix typos 2023-10-11 17:38:17 +00:00
avogar
6c91c2b860 Add documentation 2023-10-11 17:35:18 +00:00
Han Fei
253b8efa58 do not modify column type when there is statistic 2023-10-11 16:57:40 +02:00
Alexey Milovidov
76977a6a72
Merge pull request #55423 from hanfei1991/hanfei/refine-ttl-doc
change a docs example about creating table columns with ttl
2023-10-10 01:14:38 +02:00
Han Fei
8d5eb26185 address comments 2023-10-09 23:06:23 +02:00
Han Fei
3894c75af1 change a docs example about creating table columns with ttl 2023-10-09 18:34:36 +02:00
Han Fei
fcb19b4f77 Merge branch 'master' into hanfei/statistic 2023-10-09 14:24:58 +02:00
Derek Chia
f787186ba8
Update replacingmergetree.md
Added example for ReplacingMergeTree with is_deleted parameter
2023-10-09 15:16:24 +08:00
Denny Crane
3e80f66d38 update use_local_cache_for_remote_storage settings name 2023-10-03 21:09:35 -03:00
Justin de Guzman
f3c65eb118
Fix ordering of S3Queue in sidebar 2023-09-29 08:40:49 -07:00
kssenii
d1f6888119 Allow unique consumer identifier 2023-09-29 16:17:02 +02:00
kssenii
4a7922507b Minor changes 2023-09-28 16:18:00 +02:00
kssenii
7d91ba109a Update doc 2023-09-28 13:58:59 +02:00
Peignon Melvyn
cbf0535468
Update s3queue.md 2023-09-28 13:34:09 +02:00
Han Fei
76b9d43dc4 make code beautiful 2023-09-27 11:01:53 +02:00
Han Fei
4e7745f757 Merge branch 'master' into hanfei/statistic 2023-09-26 21:43:53 +02:00
kssenii
251b0165ca Better 2023-09-25 22:55:41 +02:00
kssenii
3b54b6be88 Add system tables 2023-09-25 20:04:15 +02:00
Robert Schulze
10cee14bce
Fix docs 2023-09-25 17:09:58 +00:00
Robert Schulze
3562204850
+ docs 2023-09-25 17:08:37 +00:00
Robert Schulze
c2a593baf9
Split tests 2023-09-21 09:17:38 +00:00
Robert Schulze
2c91e52da1
Merge pull request #54600 from rschu1ze/fix-annoy-crash
Annoy/Usearch index: Fix LOGICAL_ERROR during build-up with default values
2023-09-20 17:05:16 +02:00
SmitaRKulkarni
d8adf05de2
Added a new column _block_number (#47532)
Added a new virtual column _block_number which is persisted on merges when allow_experimental_block_number_column is enabled
2023-09-20 11:31:12 +02:00
Han Fei
17243b84ab Merge branch 'master' into hanfei/statistic 2023-09-19 17:09:17 +02:00
Robert Schulze
baf1016e4b
More 2023-09-18 18:39:21 +00:00
Robert Schulze
4ed5b903b4
Docs: remove anchor prefix 2023-09-18 18:35:59 +00:00
kssenii
10518a9c83 Merge remote-tracking branch 'upstream/master' into kssenii-patch-6 2023-09-18 13:00:26 +02:00
Robert Schulze
945179be46
Annoy: Fix LOGICAL_ERROR with default values #52258 2023-09-14 19:23:32 +00:00
Robert Schulze
f0eadd4b22
Merge pull request #54103 from ClickHouse/ustweaks
Small usearch index improvements: metrics and configurable internal data type
2023-09-14 19:58:53 +02:00
Robert Schulze
e018f1d913
Fix spelling 2023-09-14 12:42:22 +00:00
Michael Kolupaev
8997464867
Small usearch index improvements: metrics and f16 2023-09-14 11:24:47 +00:00
vdimir
10bcc028df
Add cluster discovery documentation 2023-09-14 11:16:09 +00:00
Sergei Trifonov
08bad4d440
Merge pull request #47009 from ClickHouse/disks-and-io-sheduler 2023-09-11 07:22:14 +02:00
Han Fei
ddcb64f39f update docs and refine statements 2023-09-08 02:27:17 +02:00
Kseniia Sumarokova
bf3dc24471
Update mergetree.md 2023-09-07 11:23:42 +02:00
Roman G
eb1812cc87
Update generate.md 2023-09-05 15:55:58 -04:00
robot-clickhouse
9cafdbd972
Merge pull request #54309 from evillique/better-docs
Make docs better
2023-09-05 15:58:59 +02:00
Nikolay Degterinsky
2db239d6ad Make docs better 2023-09-05 12:43:53 +00:00
serxa
14e2032d92 add documentation 2023-09-01 16:28:03 +00:00
Lucas Fernando Cardoso Nunes
6bb406fda9
fix typo on s3queue.md
Signed-off-by: Lucas Fernando Cardoso Nunes <lucasfc.nunes@gmail.com>
2023-08-30 04:30:34 -03:00
Tian Xinhui
76016d9593
Merge branch 'master' into fix-annoy-index-update 2023-08-22 16:58:29 +08:00
Robert Schulze
a20ceef398
Merge pull request #53447 from davvard/master
USearch HNSW index for ANN search
2023-08-21 23:34:26 +02:00
Robert Schulze
5783c07e4f
Docs: Correct parameter name in MaterializedPostgres example 2023-08-21 13:24:57 +00:00
Robert Schulze
066ec559ad
Do not reset Annoy index during build-up with > 1 mark 2023-08-21 10:05:43 +00:00
Kseniia Sumarokova
c0b8d7eddf
Merge pull request #50999 from ilejn/system_kafka_consumers
system.kafka_consumers table to monitor kafka consumers
2023-08-19 13:31:18 +04:00
Robert Schulze
e09098c5a1
Update annindexes.md 2023-08-18 15:01:13 +02:00
Ash Vardanian
9a4254616a
Docs: Extend USearch implementation details 2023-08-18 12:45:34 +01:00
Robert Schulze
ac7a27b7ff
Update docs 2023-08-17 10:03:58 +00:00
Robert Schulze
456a02da1b
Merge remote-tracking branch 'rschu1ze/master' 2023-08-17 09:30:27 +00:00
Davit Vardanyan
c685ac3df9 Docs: Update USearch docs 2023-08-16 17:31:46 +04:00
Alexander Tokmakov
b69ef75972 Merge branch 'master' into merging_53373 2023-08-16 13:16:43 +02:00
Davit Vardanyan
48c62fd75e Add: USearch 2023-08-15 16:00:27 +04:00
Robert Schulze
2d3bf55d45
Docs: Update table name in ANN docs 2023-08-14 08:50:20 +00:00
Robert Schulze
1c3f4d3719
+ , 2023-08-14 07:46:15 +00:00
Robert Schulze
f71ce2641c
Fix copyright issues in ANN docs 2023-08-14 07:36:27 +00:00
Robert Schulze
385332a554
Docs: Update anchors in ANN indexes docs 2023-08-14 07:10:50 +00:00
Filipp Ozinov
bd0e879288
Add note about skip indexes
Related to #53350
2023-08-13 22:48:35 +04:00
Ilya Golshtein
46be5e5782 system_kafka_consumers: cleanup, test should be more stable 2023-08-10 22:35:05 +00:00
Ilya Golshtein
dd6727be3e system_kafka_consumers: style check fixes 2023-08-10 22:35:05 +00:00
Ilya Golshtein
3f205f4997 system_kafka_consumers: tiny doc changes 2023-08-10 22:35:05 +00:00
Slach
a9580644eb add ** wildcard to docs, which available from 22.11
Signed-off-by: Slach <bloodjazman@gmail.com>
2023-08-09 16:30:33 +04:00
Elena Torró
f423b440d1 Add optional parameters to Engine definition 2023-08-07 09:55:16 +02:00
Elena Torró
58bea8d067 Format 's3_upload_part_size_multiply_parts_count_threshold' info 2023-08-04 11:23:41 +02:00
Anton Popov
92cb5e9ae3
Merge pull request #52687 from alkorgun/fix-named-collections-on-cluster-23.7
Fix named collections on cluster 23.7
2023-08-03 14:50:28 +02:00
robot-ch-test-poll2
3d15f6335b
Merge pull request #52848 from daviddhc20120601/patch-1
Update annindexes.md explain more about l2distance and cosine distance
2023-08-02 19:10:32 +02:00
Mike Kot
1335d06b8f
Do not replicate ALTER TABLE t FREEZE on Replicated engine (#52064)
* fix

* do not replicate alter freeze

* fix

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-08-02 14:39:54 +03:00
daviddhc20120601
a80ad58383
Merge branch 'master' into patch-1 2023-08-02 11:39:59 +08:00
Kseniia Sumarokova
8893670d98
Merge branch 'master' into s3queue 2023-08-01 18:42:32 +02:00
daviddhc20120601
10662b6425
Update annindexes.md explain more about l2distance and cosine distance
Update annindexes.md explain more about l2distance and cosine distance
2023-08-01 15:35:25 +08:00
kssenii
c13fdca23e Merge remote-tracking branch 'upstream/master' into s3queue 2023-07-31 15:32:56 +02:00
avogar
b5fc34b770 Rename setting disable_url_encoding to enable_url_encoding and add a test 2023-07-27 12:20:33 +00:00
Илья Коргун
e511072df1 Update named collections related docs 2023-07-27 09:42:38 +03:00
Rich Raposa
2ecfde96b6
Merge pull request #52119 from ClickHouse/DanRoscigno-patch-4
Update s3.md regarding partitioned data
2023-07-25 11:14:44 -06:00
avogar
fe934d3059 Make better 2023-07-20 12:38:41 +00:00
avogar
483ddb53eb Fixes 2023-07-19 19:51:58 +00:00
kssenii
fe53cd3d74 Minor changes 2023-07-17 16:11:58 +02:00
kssenii
7359dd518f Merge remote-tracking branch 'upstream/master' into s3queue 2023-07-17 14:23:12 +02:00
kssenii
a347408e20 Fix style check 2023-07-17 14:13:50 +02:00
Dan Roscigno
4e188a6379
Update s3.md regarding partitioned data 2023-07-14 08:39:37 -04:00
Alexey Milovidov
5d385f5f14
Merge pull request #51881 from qoega/per-column-pk-syntax
Add support for PRIMARY KEY syntax in column definition
2023-07-08 21:52:29 +03:00
DanRoscigno
05b7da7813 add doc note for MongoDB Atlas 2023-07-07 10:32:44 -04:00
Ilya Yatsishin
7aacc35829
Merge branch 'master' into per-column-pk-syntax 2023-07-07 14:52:15 +02:00
Yatsishin Ilya
c7ccf23a24 Update CREATE TABLE docs 2023-07-06 10:44:06 +00:00
Vitaliy Pashkov
a94498cf1f
Minor fixes to odbc.md 2023-07-05 20:59:28 +03:00
DanRoscigno
bf06e18c34 docs clickhouse-static-files-uploader and demo repo 2023-06-30 09:03:25 -04:00
kssenii
5de869760d Merge remote-tracking branch 'upstream/master' into s3queue 2023-06-30 13:56:43 +02:00
Dan Roscigno
4686eb22c1
Merge pull request #51539 from ClickHouse/list-disk-types
List disk types
2023-06-29 12:31:47 -04:00
DanRoscigno
4ee094cab1 review comments 2023-06-29 12:13:26 -04:00
JackyWoo
635ab9f9af move redis_table to right 2023-06-29 12:53:23 +08:00
JackyWoo
f8f0b7d086 fix typo 2023-06-29 10:09:27 +08:00
JackyWoo
f23bf9c5ac Update redis.md 2023-06-29 10:04:36 +08:00
DanRoscigno
dd3a744cef add HDFS example 2023-06-28 11:17:16 -04:00
DanRoscigno
b392127304 add example web config 2023-06-28 11:00:07 -04:00
DanRoscigno
bfcadabb92 add web disk type 2023-06-28 10:30:49 -04:00
DanRoscigno
c42bf37a14 list the disk types 2023-06-28 09:59:32 -04:00
Dan Roscigno
19d4a49254
Merge branch 'master' into docs-s3-engine-partition 2023-06-23 10:04:11 -04:00
DanRoscigno
6c7487bf55 document partitioned writes for s3 engine 2023-06-23 09:23:50 -04:00
rfraposa
b5d9ed5b0c Alphabetize table functions and engines 2023-06-23 07:16:22 -06:00
Ryadh DAHIMENE
815f4dc9a6
Added a note about MacOS builds 2023-06-19 12:34:36 +02:00
Rich Raposa
c08d11c97b
Merge pull request #51115 from ClickHouse/redis-fix
Fix Redis table engine slug
2023-06-16 15:53:05 -06:00
rfraposa
06ee2ca153 Update redis.md 2023-06-16 15:22:47 -06:00
Rich Raposa
3d928551c0
Merge branch 'master' into patch-52 2023-06-16 15:09:24 -06:00
Kruglov Pavel
7aea4a1f10
Merge branch 'master' into allow-skip-empty-files 2023-06-15 12:07:24 +02:00
Denny Crane
93e0e2c7cf
Update mergetree.md 2023-06-14 19:04:20 -03:00
Thom O'Connor
fb304c0b05
Update postgresql.md
Fix table definition by adding ORDER BY() statement
2023-06-14 10:39:55 -06:00
Thom O'Connor
c49bde8961
Update postgresql.md
Updated PostgreSQL documentation to better show example of using PostgreSQL() table engine for SELECT and INSERT, vs. copying data via postgresql() table function for copying data into ClickHouse
2023-06-14 07:11:28 -06:00
Robert Schulze
f4cfb9e370
Fix line break 2023-06-14 07:50:26 +00:00
Robert Schulze
b1f0a91b78
Docs: Fix embedded video link 2023-06-14 07:48:08 +00:00
pufit
91d794cf0a
Merge pull request #50150 from JackyWoo/support_redis
Add Redis table Engine/Function
2023-06-13 21:34:14 -04:00
JackyWoo
49082bfe89 fix typos in redis.md 2023-06-14 09:00:50 +08:00
Rich Raposa
86075dbae4
Update azureBlobStorage.md 2023-06-13 16:40:14 -06:00
Robert Schulze
22670aebf8
Merge pull request #50942 from ClickHouse/fix-ann-page
Fixes to ANN docs page
2023-06-13 17:57:00 +02:00
Dan Roscigno
5d1ea9aa18
Merge branch 'master' into fix-ann-page 2023-06-13 11:32:58 -04:00
Dan Roscigno
ecedceea1e
Merge branch 'master' into Fix_heading_sidebar_azureBlobStorage 2023-06-13 11:27:47 -04:00
DanRoscigno
b850f1b999 fix broken line 2023-06-13 11:26:12 -04:00
Dan Roscigno
20ea87e527
Update annindexes.md
Don't break code snippets across lines.
2023-06-13 11:17:33 -04:00
Kruglov Pavel
39ba925f8b
Merge branch 'master' into allow-skip-empty-files 2023-06-13 17:17:26 +02:00
rfraposa
57cdd3a25d Update annindexes.md 2023-06-13 09:13:13 -06:00
avogar
2e1f56ae33 Address comments 2023-06-13 14:43:50 +00:00
Smita Kulkarni
c253c70510 Fix for MDXContent 2023-06-13 16:33:36 +02:00
Robert Schulze
d8d352b2c5
Merge pull request #50912 from rschu1ze/annoy-docs
Update Annoy docs
2023-06-13 10:03:50 +02:00
JackyWoo
9d548315e8
Merge branch 'master' into support_redis 2023-06-13 09:34:32 +08:00