Kirill Nikiforov
5a25ba7de9
WIP
2024-04-20 21:26:06 +03:00
Aleksandr Musorin
d01a95fc9a
docs: added kafka_topic directly under kafka tag
2024-04-04 13:56:15 +02:00
kssenii
7fd8d84fb6
Fix style check
2024-04-03 12:25:29 +02:00
kssenii
2b34d5e4f7
Add doc
2024-04-02 21:00:11 +02:00
Aleksandr Musorin
f9d81bc774
refactore: improve reading several configurations for kafka
...
Simplify and do some refactoring for kafka client settings.
Allows to set up separate
settings for consumer and producer like:
```
<consumer>
...
</consumer>
<producer>
<kafka_topic>
<name>topic_name</name>
...
</kafka_topic>
</producer>
```
Moreover, this fixes warnings from kafka client like:
`Configuration property session.timeout.ms is a consumer property and
will be ignored by this producer instance`
2024-03-27 14:53:33 +01:00
Alexey Milovidov
92f57c1c1c
Merge branch 'master' into docs-mysql-table-engine
2024-03-22 03:34:56 +03:00
Alexey Milovidov
2bcc8dae4e
Merge pull request #60608 from natalyjazzviolin/nataly/postgres-11
...
Adds note on supported PostgreSQL versions.
2024-03-22 03:30:20 +03:00
San
0a8b7dd9cd
Update jdbc.md
2024-03-18 11:36:39 +11:00
justindeguzman
22e911dbe4
[Docs] Specify that MySQL database engine is not supported in Cloud
2024-03-14 18:56:28 -07:00
justindeguzman
25c56ac0a6
[Docs] Specify that MySQL table engine is not supported in Cloud
2024-03-14 18:30:18 -07:00
vdimir
b2e067b3da
Fix logical error in RabbitMQ storage with MATERIALIZED columns
2024-03-13 16:41:35 +00:00
Nataly Merezhuk
a6cebad52b
Adds note on supported PostgreSQL versions.
2024-02-29 16:32:29 -05:00
Smita Kulkarni
5d68c9f046
Updated default value of endpoint_contains_account_name to true
2024-02-29 09:38:13 +01:00
Smita Kulkarni
6ec23a0879
Updated docs for endpoint
2024-02-26 14:36:06 +01:00
Nickolaj Jepsen
e822ba3a47
Add support for NATS credentials file
2024-02-02 23:34:01 +01:00
Duc Canh Le
adad010345
Merge branch 'master' into rocksdb_bypass_memtable
...
Try fixing weird CI errors
2024-01-27 01:16:32 +00:00
vdimir
8218657cbc
Add optimize_for_bulk_insert to embedded-rocksdb.md
2024-01-25 10:14:43 +01:00
Kruglov Pavel
0829de8928
Merge pull request #57599 from Khatskevich/khatskevich/fix_docs
...
Improve named collections documentation
2024-01-22 12:54:57 +01:00
Sema Checherinda
d5f86f671d
fix and test that S3Clients reused
2024-01-07 02:19:06 +01:00
Aliaksei Khatskevich
b8f399b6ee
Add named collections to redis table engine docs
2024-01-04 09:22:41 +01:00
Aliaksei Khatskevich
9d61f03c43
Add named collections to mysql table engine docs
2024-01-04 09:22:41 +01:00
Aliaksei Khatskevich
394ac56a22
Fix postgres table engine docs
2024-01-04 09:22:41 +01:00
Christoph Wurm
9def89d416
Fix anchors to settings.md
2023-12-20 18:26:36 +00:00
Alexey Milovidov
b91e0f89ec
Address review comments
2023-12-06 12:24:58 +01:00
Alexey Milovidov
76bbeaa676
S3Queue is production ready
2023-12-05 21:10:19 +01:00
vdimir
bbc202a891
Merge pull request #56816 from AVMusorin/improve-settings-rocksdb
...
Show total_bytes and total_rows in system tables for RocksDB storage
2023-11-27 11:42:15 +01:00
Kruglov Pavel
b10e46b2bc
Merge pull request #57126 from Avogar/size-virtual-column
...
Add _size virtual column to s3/file/hdfs/url/azureBlobStorage engines
2023-11-27 10:12:18 +01:00
Kseniia Sumarokova
13187bf4f1
Merge pull request #56959 from melvynator/master
...
Add experimental flag for MaterializedPostgreSQL table engine.
2023-11-24 16:16:42 +01:00
avogar
6b64efb55a
Add docs
2023-11-22 18:21:30 +00:00
Aleksandr Musorin
ee0ae17ce2
Added optimize_trivial_approximate_count_query documentatiosn for RocksDB
2023-11-21 11:31:56 +01:00
Ubuntu
16e7bd201b
Add experimental flag for PostgresSQL table engine. Also add documentation on how to enable it
2023-11-18 18:22:33 +00:00
avogar
58b9bde0fa
Better docs for virtual columns in Kafka/RabbitMQ/NATS/FileLog
2023-11-14 21:15:30 +00:00
Peignon Melvyn
ba87360114
Mark MaterializedPostreSQL as experimental in docs ( #56462 )
2023-11-08 20:26:19 +01:00
Kruglov Pavel
5533258091
Merge pull request #55477 from Avogar/streaming-errors
...
Allow to save unparsed records and errors in RabbitMQ, NATS and FileLog engines
2023-11-01 14:35:35 +01:00
kssenii
fd37e25fbd
Fix doc
2023-10-17 15:07:58 +02:00
kssenii
4d2cf5206f
Update documentation
2023-10-17 14:12:15 +02:00
kssenii
a9c0c20cad
Update documentation
2023-10-13 13:21:50 +02:00
kssenii
d64b990712
Merge remote-tracking branch 'origin/master' into s3-queue-fixes
2023-10-13 12:13:56 +02:00
avogar
178c799697
Fix typos
2023-10-11 17:38:17 +00:00
avogar
6c91c2b860
Add documentation
2023-10-11 17:35:18 +00:00
Denny Crane
3e80f66d38
update use_local_cache_for_remote_storage settings name
2023-10-03 21:09:35 -03:00
Justin de Guzman
f3c65eb118
Fix ordering of S3Queue in sidebar
2023-09-29 08:40:49 -07:00
kssenii
4a7922507b
Minor changes
2023-09-28 16:18:00 +02:00
kssenii
7d91ba109a
Update doc
2023-09-28 13:58:59 +02:00
Peignon Melvyn
cbf0535468
Update s3queue.md
2023-09-28 13:34:09 +02:00
kssenii
251b0165ca
Better
2023-09-25 22:55:41 +02:00
kssenii
3b54b6be88
Add system tables
2023-09-25 20:04:15 +02:00
Robert Schulze
baf1016e4b
More
2023-09-18 18:39:21 +00:00
Robert Schulze
4ed5b903b4
Docs: remove anchor prefix
2023-09-18 18:35:59 +00:00
Lucas Fernando Cardoso Nunes
6bb406fda9
fix typo on s3queue.md
...
Signed-off-by: Lucas Fernando Cardoso Nunes <lucasfc.nunes@gmail.com>
2023-08-30 04:30:34 -03:00
Robert Schulze
5783c07e4f
Docs: Correct parameter name in MaterializedPostgres example
2023-08-21 13:24:57 +00:00
Ilya Golshtein
46be5e5782
system_kafka_consumers: cleanup, test should be more stable
2023-08-10 22:35:05 +00:00
Ilya Golshtein
dd6727be3e
system_kafka_consumers: style check fixes
2023-08-10 22:35:05 +00:00
Ilya Golshtein
3f205f4997
system_kafka_consumers: tiny doc changes
2023-08-10 22:35:05 +00:00
Slach
a9580644eb
add ** wildcard to docs, which available from 22.11
...
Signed-off-by: Slach <bloodjazman@gmail.com>
2023-08-09 16:30:33 +04:00
Elena Torró
58bea8d067
Format 's3_upload_part_size_multiply_parts_count_threshold' info
2023-08-04 11:23:41 +02:00
Anton Popov
92cb5e9ae3
Merge pull request #52687 from alkorgun/fix-named-collections-on-cluster-23.7
...
Fix named collections on cluster 23.7
2023-08-03 14:50:28 +02:00
kssenii
c13fdca23e
Merge remote-tracking branch 'upstream/master' into s3queue
2023-07-31 15:32:56 +02:00
Илья Коргун
e511072df1
Update named collections related docs
2023-07-27 09:42:38 +03:00
kssenii
fe53cd3d74
Minor changes
2023-07-17 16:11:58 +02:00
kssenii
7359dd518f
Merge remote-tracking branch 'upstream/master' into s3queue
2023-07-17 14:23:12 +02:00
kssenii
a347408e20
Fix style check
2023-07-17 14:13:50 +02:00
Dan Roscigno
4e188a6379
Update s3.md regarding partitioned data
2023-07-14 08:39:37 -04:00
DanRoscigno
05b7da7813
add doc note for MongoDB Atlas
2023-07-07 10:32:44 -04:00
Vitaliy Pashkov
a94498cf1f
Minor fixes to odbc.md
2023-07-05 20:59:28 +03:00
kssenii
5de869760d
Merge remote-tracking branch 'upstream/master' into s3queue
2023-06-30 13:56:43 +02:00
JackyWoo
635ab9f9af
move redis_table to right
2023-06-29 12:53:23 +08:00
JackyWoo
f8f0b7d086
fix typo
2023-06-29 10:09:27 +08:00
JackyWoo
f23bf9c5ac
Update redis.md
2023-06-29 10:04:36 +08:00
Dan Roscigno
19d4a49254
Merge branch 'master' into docs-s3-engine-partition
2023-06-23 10:04:11 -04:00
DanRoscigno
6c7487bf55
document partitioned writes for s3 engine
2023-06-23 09:23:50 -04:00
rfraposa
b5d9ed5b0c
Alphabetize table functions and engines
2023-06-23 07:16:22 -06:00
Ryadh DAHIMENE
815f4dc9a6
Added a note about MacOS builds
2023-06-19 12:34:36 +02:00
rfraposa
06ee2ca153
Update redis.md
2023-06-16 15:22:47 -06:00
Kruglov Pavel
7aea4a1f10
Merge branch 'master' into allow-skip-empty-files
2023-06-15 12:07:24 +02:00
Thom O'Connor
fb304c0b05
Update postgresql.md
...
Fix table definition by adding ORDER BY() statement
2023-06-14 10:39:55 -06:00
Thom O'Connor
c49bde8961
Update postgresql.md
...
Updated PostgreSQL documentation to better show example of using PostgreSQL() table engine for SELECT and INSERT, vs. copying data via postgresql() table function for copying data into ClickHouse
2023-06-14 07:11:28 -06:00
pufit
91d794cf0a
Merge pull request #50150 from JackyWoo/support_redis
...
Add Redis table Engine/Function
2023-06-13 21:34:14 -04:00
JackyWoo
49082bfe89
fix typos in redis.md
2023-06-14 09:00:50 +08:00
Rich Raposa
86075dbae4
Update azureBlobStorage.md
2023-06-13 16:40:14 -06:00
JackyWoo
959fde4491
add notifications in docs
2023-06-13 09:33:38 +08:00
Kruglov Pavel
e4838725e3
Merge branch 'master' into allow-skip-empty-files
2023-06-12 20:03:23 +02:00
JackyWoo
a1641aa25d
Merge branch 'master' into support_redis
2023-06-12 09:53:06 +08:00
Smita Kulkarni
e6c2a6d13d
Added example for table engine and fixed typos
2023-06-11 09:55:20 +02:00
DanRoscigno
05d4baf1e7
edits
2023-06-10 18:20:39 -04:00
Smita Kulkarni
78c32a204c
Updated docs for azureBlobStorage Table function & engine
2023-06-10 23:00:59 +02:00
pufit
55d228e78e
Merge branch 'master' into support_redis
2023-06-09 11:45:12 -04:00
Kruglov Pavel
bf28074d32
Merge branch 'master' into allow-skip-empty-files
2023-06-08 12:36:18 +02:00
ismailakpolat
3082029406
Update rabbitmq.md
...
Duplicate parameter name in definition
2023-06-05 13:03:17 +03:00
DanRoscigno
87eaaa0f7b
address review comments
2023-06-02 16:30:18 -04:00
DanRoscigno
17cca6ed75
add direct join docs
2023-06-02 10:08:48 -04:00
Robert Schulze
65cc92a78d
CI: Fix aspell on nested docs
2023-06-02 12:24:41 +00:00
JackyWoo
dc61023927
add sync mode to redis storage truncate
2023-06-02 10:05:54 +08:00
JackyWoo
7cc37ab4b8
add redis table engine/function docs
2023-06-02 10:05:54 +08:00
avogar
0b62be649f
Add docs, fix style
2023-05-31 17:52:29 +00:00
Sema Checherinda
7c9d2ab6d0
working with review comments
2023-05-26 19:00:13 +02:00
Sema Checherinda
b0eff95388
update doc, add profile event WriteBufferFromS3WaitInflightLimitMicroseconds
2023-05-26 18:59:21 +02:00
Sergey Katkovskiy
bc7c67e33f
code review fixes
2023-05-25 23:29:16 +03:00
Sergey Katkovskiy
0e55c7c365
Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-build
2023-05-18 07:30:20 +03:00
Thom O'Connor
15cb627688
Update postgresql.md
...
The type cannot be optional, so we need to be clear in the docs that [type1] [type2] cannot be in square brackets, so removed them
2023-05-16 16:35:41 -06:00
AVMusorin
418a61a68c
Allow using Alias column type for KafkaEngine
...
```
create table kafka
(
a UInt32,
a_str String Alias toString(a)
) engine = Kafka;
create table data
(
a UInt32;
a_str String
) engine = MergeTree
order by tuple();
create materialized view data_mv to data
(
a UInt32,
a_str String
) as
select a, a_str from kafka;
```
Alias type works as expected in comparison with MATERIALIZED/EPHEMERAL
or column with default expression.
Ref: https://github.com/ClickHouse/ClickHouse/pull/47138
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2023-05-15 15:39:58 +02:00
Sergey Katkovskiy
ba55c11d0a
add documentation
2023-05-15 15:26:44 +03:00
johanngan
731823b873
Add support for SSE-KMS configuration with S3
...
https://docs.aws.amazon.com/AmazonS3/latest/userguide/UsingKMSEncryption.html
Similar to the server_side_encryption_customer_key_base64 option for
configuring SSE-C with S3, add the following settings to configure
SSE-KMS on a per-endpoint/disk basis:
- server_side_encryption_kms_key_id
- server_side_encryption_kms_encryption_context
- server_side_encryption_kms_bucket_key_enabled
2023-05-03 21:35:38 -05:00
Robert Schulze
cdf28f9b71
Minor fixups
2023-04-19 16:16:51 +00:00
Robert Schulze
c406663442
Docs: Replace annoying three spaces in enumerations by a single space
2023-04-19 15:56:55 +00:00
Dan Roscigno
5704eea076
Update docs/en/engines/table-engines/integrations/postgresql.md
2023-04-18 12:55:27 -04:00
Dan Roscigno
8b05fb6f83
need full path to markdown file including the md
2023-04-18 12:54:54 -04:00
Thom O'Connor
b60169d258
Update postgresql.md
...
Added examples for INSERT INTO from SELECT * for initial load from PostgreSQL and incremental inserts
2023-04-18 09:48:32 -06:00
Rich Raposa
04a8b4bd17
Update materialized-postgresql.md
2023-04-15 08:24:27 -06:00
Dale Mcdiarmid
d50c6a9e1b
update blog references
2023-04-10 15:23:00 +01:00
Antonio Andelic
80cb121d2a
Merge pull request #48092 from ClickHouse/nosign-keyword-for-s3
...
Add support for `NOSIGN` keyword and `no_sign_request` config for S3
2023-03-30 18:10:56 +02:00
filimonov
fbb22348ea
Refactor reading the pool setting & from server config. ( #48055 )
...
After #36425 there was a lot of confusions/problems with configuring pools - when the message was confusing, and settings need to be ajusted in several places.
See some examples in #44251 , #43351 , #47900 , #46515 .
The commit includes the following changes:
1) Introduced a unified mechanism for reading pool sizes from the configuration file(s). Previously, pool sizes were read from the Context.cpp with fallbacks to profiles, whereas main_config_reloader in Server.cpp read them directly without fallbacks.
2) Corrected the data type for background_merges_mutations_concurrency_ratio. It should be float instead of int.
3) Refactored the default values for settings. Previously, they were defined in multiple places throughout the codebase, but they are now defined in one place (or two, to be exact: Settings.h and ServerSettings.h).
4) Improved documentation, including the correct message in system.settings.
Additionally make the code more conform with #46550 .
2023-03-30 16:44:11 +02:00
Antonio Andelic
44e95aa65f
Merge branch 'master' into nosign-keyword-for-s3
2023-03-29 11:10:03 +00:00
Antonio Andelic
7b1ad221b2
Address PR comments
2023-03-29 11:08:44 +00:00
Antonio Andelic
4c61ec2fad
update docs
2023-03-28 07:19:08 +00:00
DanRoscigno
6d8a2bbd48
standardize admonitions
2023-03-27 14:54:05 -04:00
Antonio Andelic
a0582a14b9
Merge pull request #47423 from ClickHouse/add-expiration-window-s3
...
Add expiration window for S3 credentials
2023-03-18 10:11:29 +01:00
rfraposa
ac5ed141d8
New nav - reverting the revert
2023-03-17 21:45:43 -05:00
Alexander Tokmakov
ec44c8293a
Revert "New navigation"
2023-03-17 21:21:11 +03:00
Antonio Andelic
55c07ea16e
Update docs
2023-03-10 10:12:01 +00:00
Rich Raposa
de68dade71
Revert "standardize admonitions"
2023-03-09 14:30:40 -07:00
DanRoscigno
95351bc2d3
standardize admonitions
2023-03-09 12:05:26 -05:00
Rich Raposa
f24fad9e26
Merge branch 'master' into new-nav
2023-03-08 14:31:10 -07:00
Rich Raposa
67c16195cc
Merge branch 'master' into new-nav
2023-03-07 14:06:37 -07:00
Robert Schulze
ff8fc0634a
Docs: Small cleanups after Kafka fix #47138
2023-03-07 19:50:42 +00:00
AVMusorin
0f2ae72141
prohibit DEFAULT/EPHEMERAL/ALIAS in KafkaEngine
2023-03-03 16:25:42 +01:00
rfraposa
17a2d7ed45
Fixing broken links
2023-03-01 16:53:17 -07:00
Robert Schulze
cca0bead44
Slighly improved example
2023-02-23 20:07:06 +00:00
Robert Schulze
b3eacf0894
Whitespace for the win
2023-02-23 20:06:24 +00:00
Robert Schulze
6906cafa99
Change to S3 cfg syntax
2023-02-23 20:04:41 +00:00
Robert Schulze
81bf43157f
Allow configuration of Kafka topics with periods
...
The Kafka table engine allows global configuration and per-Kafka-topic
configuration. The latter uses syntax <kafka_TOPIC>, e.g. for topic
"football":
<kafka_football>
<retry_backoff_ms>250</retry_backoff_ms>
<fetch_min_bytes>100000</fetch_min_bytes>
</kafka_football>
Some users had to find out the hard way that such configuration doesn't
take effect if the topic name contains a period, e.g. "sports.football".
The reason is that ClickHouse configuration framework already uses
periods as level separators to descend the configuration hierarchy.
(Besides that, per-topic configuration at the same level as global
configuration could be considered ugly.)
Note that Kafka topics may contain characters "a-zA-Z0-9._-" (*) and
a tree-like topic organization using periods is quite common in
practice.
This PR deprecates the existing per-topic configuration syntax (but
continues to support it for backward compat) and introduces a new
per-topic configuration syntax below the global Kafka configuration of
the form:
<kafka>
<topic name="football">
<retry_backoff_ms>250</retry_backoff_ms>
<fetch_min_bytes>100000</fetch_min_bytes>
</topic>
</kafka>
The period restriction doesn't apply to XML attributes, so <topic
name="sports.football"> will work. Also, everything Kafka-related is
below <kafka>.
Considered but rejected alternatives:
- Extending Poco ConfigurationView with custom separators (e.g."/"
instead of "."). Won't work easily because ConfigurationView only
builds a path but defers descending the configuration tree to the
normal configuration classes.
- Reloading the configuration file in StorageKafka (instead of reading
the loaded file) but with a custom separator. This mode is supported
by XML configuration. Too ugly and error-prone since the true
configuration is composed from multiple configuration files.
(*) https://stackoverflow.com/a/37067544
2023-02-22 20:35:09 +00:00
kssenii
bac464f89b
Fix
2023-02-22 14:25:08 +01:00
Kseniia Sumarokova
c242fe3e5e
Update docs/en/engines/table-engines/integrations/hudi.md
...
Co-authored-by: flynn <fenglv15@mails.ucas.ac.cn>
2023-02-22 12:11:42 +01:00
Kseniia Sumarokova
ef15d64895
Update docs/en/engines/table-engines/integrations/deltalake.md
...
Co-authored-by: flynn <fenglv15@mails.ucas.ac.cn>
2023-02-22 12:11:23 +01:00
kssenii
21fcc3b69c
Add iceberg doc
2023-02-22 12:04:24 +01:00
Dan Roscigno
10c8f31811
Update docs/en/engines/table-engines/integrations/embedded-rocksdb.md
2023-02-15 13:29:33 -05:00
Dan Roscigno
0496b55003
Update docs/en/engines/table-engines/integrations/embedded-rocksdb.md
2023-02-15 13:29:26 -05:00
Antonio Andelic
da4389a763
Add docs for KeeperMap
2023-02-15 15:29:11 +01:00
Ryadh DAHIMENE
82a36f50c9
Adding missing integrations to the list
2023-02-08 15:11:18 +01:00
kssenii
bbf060bf89
Fix test
2023-02-01 18:22:05 +01:00
DanRoscigno
917e3d4244
add PARTITION BY to s3 and hdfs docs
2023-01-25 09:09:28 -05:00
Tanya Bragin
b5773caeb2
Update postgresql.md
...
Adding related Postgres blog here.
cc @gingerwizard @DanRoscigno
2023-01-14 14:34:33 -08:00
Dan Roscigno
0ad969171e
Merge pull request #45127 from DanRoscigno/add-deltalake-docs
...
Add deltalake docs
2023-01-11 08:07:42 -05:00
Dan Roscigno
6e9669cfae
Apply suggestions from code review
2023-01-11 07:53:37 -05:00
Dan Roscigno
02261b0e2a
Update docs/en/engines/table-engines/integrations/hudi.md
2023-01-11 07:42:15 -05:00
Dan Roscigno
73ef2657dd
Update docs/en/engines/table-engines/integrations/hudi.md
2023-01-11 07:40:10 -05:00
Dan Roscigno
21573028ea
Update docs/en/engines/table-engines/integrations/deltalake.md
2023-01-11 07:38:41 -05:00
DanRoscigno
563e0e76f9
init
2023-01-10 16:59:34 -05:00
DanRoscigno
5cf1b1f61d
feedback
2023-01-10 16:09:59 -05:00
DanRoscigno
879ee05218
fix case of names
2023-01-10 11:18:33 -05:00
