Commit Graph

514 Commits

Author SHA1 Message Date
Alexey Milovidov
92f57c1c1c
Merge branch 'master' into docs-mysql-table-engine 2024-03-22 03:34:56 +03:00
Alexey Milovidov
2bcc8dae4e
Merge pull request #60608 from natalyjazzviolin/nataly/postgres-11
Adds note on supported PostgreSQL versions.
2024-03-22 03:30:20 +03:00
San
0a8b7dd9cd
Update jdbc.md 2024-03-18 11:36:39 +11:00
justindeguzman
22e911dbe4 [Docs] Specify that MySQL database engine is not supported in Cloud 2024-03-14 18:56:28 -07:00
justindeguzman
25c56ac0a6 [Docs] Specify that MySQL table engine is not supported in Cloud 2024-03-14 18:30:18 -07:00
vdimir
b2e067b3da
Fix logical error in RabbitMQ storage with MATERIALIZED columns 2024-03-13 16:41:35 +00:00
Nataly Merezhuk
a6cebad52b Adds note on supported PostgreSQL versions. 2024-02-29 16:32:29 -05:00
Smita Kulkarni
5d68c9f046 Updated default value of endpoint_contains_account_name to true 2024-02-29 09:38:13 +01:00
Smita Kulkarni
6ec23a0879 Updated docs for endpoint 2024-02-26 14:36:06 +01:00
Nickolaj Jepsen
e822ba3a47 Add support for NATS credentials file 2024-02-02 23:34:01 +01:00
Duc Canh Le
adad010345 Merge branch 'master' into rocksdb_bypass_memtable
Try fixing weird CI errors
2024-01-27 01:16:32 +00:00
vdimir
8218657cbc
Add optimize_for_bulk_insert to embedded-rocksdb.md 2024-01-25 10:14:43 +01:00
Kruglov Pavel
0829de8928
Merge pull request #57599 from Khatskevich/khatskevich/fix_docs
Improve named collections documentation
2024-01-22 12:54:57 +01:00
Sema Checherinda
d5f86f671d fix and test that S3Clients reused 2024-01-07 02:19:06 +01:00
Aliaksei Khatskevich
b8f399b6ee
Add named collections to redis table engine docs 2024-01-04 09:22:41 +01:00
Aliaksei Khatskevich
9d61f03c43
Add named collections to mysql table engine docs 2024-01-04 09:22:41 +01:00
Aliaksei Khatskevich
394ac56a22
Fix postgres table engine docs 2024-01-04 09:22:41 +01:00
Christoph Wurm
9def89d416 Fix anchors to settings.md 2023-12-20 18:26:36 +00:00
Alexey Milovidov
b91e0f89ec Address review comments 2023-12-06 12:24:58 +01:00
Alexey Milovidov
76bbeaa676 S3Queue is production ready 2023-12-05 21:10:19 +01:00
vdimir
bbc202a891
Merge pull request #56816 from AVMusorin/improve-settings-rocksdb
Show total_bytes and total_rows in system tables for RocksDB storage
2023-11-27 11:42:15 +01:00
Kruglov Pavel
b10e46b2bc
Merge pull request #57126 from Avogar/size-virtual-column
Add _size virtual column to s3/file/hdfs/url/azureBlobStorage engines
2023-11-27 10:12:18 +01:00
Kseniia Sumarokova
13187bf4f1
Merge pull request #56959 from melvynator/master
Add experimental flag for MaterializedPostgreSQL table engine.
2023-11-24 16:16:42 +01:00
avogar
6b64efb55a Add docs 2023-11-22 18:21:30 +00:00
Aleksandr Musorin
ee0ae17ce2 Added optimize_trivial_approximate_count_query documentatiosn for RocksDB 2023-11-21 11:31:56 +01:00
Ubuntu
16e7bd201b Add experimental flag for PostgresSQL table engine. Also add documentation on how to enable it 2023-11-18 18:22:33 +00:00
avogar
58b9bde0fa Better docs for virtual columns in Kafka/RabbitMQ/NATS/FileLog 2023-11-14 21:15:30 +00:00
Peignon Melvyn
ba87360114
Mark MaterializedPostreSQL as experimental in docs (#56462) 2023-11-08 20:26:19 +01:00
Kruglov Pavel
5533258091
Merge pull request #55477 from Avogar/streaming-errors
Allow to save unparsed records and errors in RabbitMQ, NATS and FileLog engines
2023-11-01 14:35:35 +01:00
kssenii
fd37e25fbd Fix doc 2023-10-17 15:07:58 +02:00
kssenii
4d2cf5206f Update documentation 2023-10-17 14:12:15 +02:00
kssenii
a9c0c20cad Update documentation 2023-10-13 13:21:50 +02:00
kssenii
d64b990712 Merge remote-tracking branch 'origin/master' into s3-queue-fixes 2023-10-13 12:13:56 +02:00
avogar
178c799697 Fix typos 2023-10-11 17:38:17 +00:00
avogar
6c91c2b860 Add documentation 2023-10-11 17:35:18 +00:00
Denny Crane
3e80f66d38 update use_local_cache_for_remote_storage settings name 2023-10-03 21:09:35 -03:00
Justin de Guzman
f3c65eb118
Fix ordering of S3Queue in sidebar 2023-09-29 08:40:49 -07:00
kssenii
4a7922507b Minor changes 2023-09-28 16:18:00 +02:00
kssenii
7d91ba109a Update doc 2023-09-28 13:58:59 +02:00
Peignon Melvyn
cbf0535468
Update s3queue.md 2023-09-28 13:34:09 +02:00
kssenii
251b0165ca Better 2023-09-25 22:55:41 +02:00
kssenii
3b54b6be88 Add system tables 2023-09-25 20:04:15 +02:00
Robert Schulze
baf1016e4b
More 2023-09-18 18:39:21 +00:00
Robert Schulze
4ed5b903b4
Docs: remove anchor prefix 2023-09-18 18:35:59 +00:00
Lucas Fernando Cardoso Nunes
6bb406fda9
fix typo on s3queue.md
Signed-off-by: Lucas Fernando Cardoso Nunes <lucasfc.nunes@gmail.com>
2023-08-30 04:30:34 -03:00
Robert Schulze
5783c07e4f
Docs: Correct parameter name in MaterializedPostgres example 2023-08-21 13:24:57 +00:00
Ilya Golshtein
46be5e5782 system_kafka_consumers: cleanup, test should be more stable 2023-08-10 22:35:05 +00:00
Ilya Golshtein
dd6727be3e system_kafka_consumers: style check fixes 2023-08-10 22:35:05 +00:00
Ilya Golshtein
3f205f4997 system_kafka_consumers: tiny doc changes 2023-08-10 22:35:05 +00:00
Slach
a9580644eb add ** wildcard to docs, which available from 22.11
Signed-off-by: Slach <bloodjazman@gmail.com>
2023-08-09 16:30:33 +04:00
Elena Torró
58bea8d067 Format 's3_upload_part_size_multiply_parts_count_threshold' info 2023-08-04 11:23:41 +02:00
Anton Popov
92cb5e9ae3
Merge pull request #52687 from alkorgun/fix-named-collections-on-cluster-23.7
Fix named collections on cluster 23.7
2023-08-03 14:50:28 +02:00
kssenii
c13fdca23e Merge remote-tracking branch 'upstream/master' into s3queue 2023-07-31 15:32:56 +02:00
Илья Коргун
e511072df1 Update named collections related docs 2023-07-27 09:42:38 +03:00
kssenii
fe53cd3d74 Minor changes 2023-07-17 16:11:58 +02:00
kssenii
7359dd518f Merge remote-tracking branch 'upstream/master' into s3queue 2023-07-17 14:23:12 +02:00
kssenii
a347408e20 Fix style check 2023-07-17 14:13:50 +02:00
Dan Roscigno
4e188a6379
Update s3.md regarding partitioned data 2023-07-14 08:39:37 -04:00
DanRoscigno
05b7da7813 add doc note for MongoDB Atlas 2023-07-07 10:32:44 -04:00
Vitaliy Pashkov
a94498cf1f
Minor fixes to odbc.md 2023-07-05 20:59:28 +03:00
kssenii
5de869760d Merge remote-tracking branch 'upstream/master' into s3queue 2023-06-30 13:56:43 +02:00
JackyWoo
635ab9f9af move redis_table to right 2023-06-29 12:53:23 +08:00
JackyWoo
f8f0b7d086 fix typo 2023-06-29 10:09:27 +08:00
JackyWoo
f23bf9c5ac Update redis.md 2023-06-29 10:04:36 +08:00
Dan Roscigno
19d4a49254
Merge branch 'master' into docs-s3-engine-partition 2023-06-23 10:04:11 -04:00
DanRoscigno
6c7487bf55 document partitioned writes for s3 engine 2023-06-23 09:23:50 -04:00
rfraposa
b5d9ed5b0c Alphabetize table functions and engines 2023-06-23 07:16:22 -06:00
Ryadh DAHIMENE
815f4dc9a6
Added a note about MacOS builds 2023-06-19 12:34:36 +02:00
rfraposa
06ee2ca153 Update redis.md 2023-06-16 15:22:47 -06:00
Kruglov Pavel
7aea4a1f10
Merge branch 'master' into allow-skip-empty-files 2023-06-15 12:07:24 +02:00
Thom O'Connor
fb304c0b05
Update postgresql.md
Fix table definition by adding ORDER BY() statement
2023-06-14 10:39:55 -06:00
Thom O'Connor
c49bde8961
Update postgresql.md
Updated PostgreSQL documentation to better show example of using PostgreSQL() table engine for SELECT and INSERT, vs. copying data via postgresql() table function for copying data into ClickHouse
2023-06-14 07:11:28 -06:00
pufit
91d794cf0a
Merge pull request #50150 from JackyWoo/support_redis
Add Redis table Engine/Function
2023-06-13 21:34:14 -04:00
JackyWoo
49082bfe89 fix typos in redis.md 2023-06-14 09:00:50 +08:00
Rich Raposa
86075dbae4
Update azureBlobStorage.md 2023-06-13 16:40:14 -06:00
JackyWoo
959fde4491 add notifications in docs 2023-06-13 09:33:38 +08:00
Kruglov Pavel
e4838725e3
Merge branch 'master' into allow-skip-empty-files 2023-06-12 20:03:23 +02:00
JackyWoo
a1641aa25d
Merge branch 'master' into support_redis 2023-06-12 09:53:06 +08:00
Smita Kulkarni
e6c2a6d13d Added example for table engine and fixed typos 2023-06-11 09:55:20 +02:00
DanRoscigno
05d4baf1e7 edits 2023-06-10 18:20:39 -04:00
Smita Kulkarni
78c32a204c Updated docs for azureBlobStorage Table function & engine 2023-06-10 23:00:59 +02:00
pufit
55d228e78e
Merge branch 'master' into support_redis 2023-06-09 11:45:12 -04:00
Kruglov Pavel
bf28074d32
Merge branch 'master' into allow-skip-empty-files 2023-06-08 12:36:18 +02:00
ismailakpolat
3082029406
Update rabbitmq.md
Duplicate parameter name in definition
2023-06-05 13:03:17 +03:00
DanRoscigno
87eaaa0f7b address review comments 2023-06-02 16:30:18 -04:00
DanRoscigno
17cca6ed75 add direct join docs 2023-06-02 10:08:48 -04:00
Robert Schulze
65cc92a78d
CI: Fix aspell on nested docs 2023-06-02 12:24:41 +00:00
JackyWoo
dc61023927 add sync mode to redis storage truncate 2023-06-02 10:05:54 +08:00
JackyWoo
7cc37ab4b8 add redis table engine/function docs 2023-06-02 10:05:54 +08:00
avogar
0b62be649f Add docs, fix style 2023-05-31 17:52:29 +00:00
Sema Checherinda
7c9d2ab6d0 working with review comments 2023-05-26 19:00:13 +02:00
Sema Checherinda
b0eff95388 update doc, add profile event WriteBufferFromS3WaitInflightLimitMicroseconds 2023-05-26 18:59:21 +02:00
Sergey Katkovskiy
bc7c67e33f code review fixes 2023-05-25 23:29:16 +03:00
Sergey Katkovskiy
0e55c7c365 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-build 2023-05-18 07:30:20 +03:00
Thom O'Connor
15cb627688
Update postgresql.md
The type cannot be optional, so we need to be clear in the docs that [type1] [type2] cannot be in square brackets, so removed them
2023-05-16 16:35:41 -06:00
AVMusorin
418a61a68c
Allow using Alias column type for KafkaEngine
```
create table kafka
(
 a UInt32,
 a_str String Alias toString(a)
) engine = Kafka;

create table data
(
  a UInt32;
  a_str String
) engine = MergeTree
order by tuple();

create materialized view data_mv to data
(
  a UInt32,
  a_str String
) as
select a, a_str from kafka;
```
Alias type works as expected in comparison with MATERIALIZED/EPHEMERAL
or column with default expression.

Ref: https://github.com/ClickHouse/ClickHouse/pull/47138

Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2023-05-15 15:39:58 +02:00
Sergey Katkovskiy
ba55c11d0a add documentation 2023-05-15 15:26:44 +03:00
johanngan
731823b873 Add support for SSE-KMS configuration with S3
https://docs.aws.amazon.com/AmazonS3/latest/userguide/UsingKMSEncryption.html

Similar to the server_side_encryption_customer_key_base64 option for
configuring SSE-C with S3, add the following settings to configure
SSE-KMS on a per-endpoint/disk basis:
  - server_side_encryption_kms_key_id
  - server_side_encryption_kms_encryption_context
  - server_side_encryption_kms_bucket_key_enabled
2023-05-03 21:35:38 -05:00
Robert Schulze
cdf28f9b71
Minor fixups 2023-04-19 16:16:51 +00:00
Robert Schulze
c406663442
Docs: Replace annoying three spaces in enumerations by a single space 2023-04-19 15:56:55 +00:00
Dan Roscigno
5704eea076
Update docs/en/engines/table-engines/integrations/postgresql.md 2023-04-18 12:55:27 -04:00
Dan Roscigno
8b05fb6f83
need full path to markdown file including the md 2023-04-18 12:54:54 -04:00
Thom O'Connor
b60169d258
Update postgresql.md
Added examples for INSERT INTO from SELECT * for initial load from PostgreSQL and incremental inserts
2023-04-18 09:48:32 -06:00
Rich Raposa
04a8b4bd17
Update materialized-postgresql.md 2023-04-15 08:24:27 -06:00
Dale Mcdiarmid
d50c6a9e1b update blog references 2023-04-10 15:23:00 +01:00
Antonio Andelic
80cb121d2a
Merge pull request #48092 from ClickHouse/nosign-keyword-for-s3
Add support for `NOSIGN` keyword and `no_sign_request` config for S3
2023-03-30 18:10:56 +02:00
filimonov
fbb22348ea
Refactor reading the pool setting & from server config. (#48055)
After #36425 there was a lot of confusions/problems with configuring pools - when the message was confusing, and settings need to be ajusted in several places.
See some examples in #44251, #43351, #47900, #46515.

The commit includes the following changes:
1) Introduced a unified mechanism for reading pool sizes from the configuration file(s). Previously, pool sizes were read from the Context.cpp with fallbacks to profiles, whereas main_config_reloader in Server.cpp read them directly without fallbacks.
2) Corrected the data type for background_merges_mutations_concurrency_ratio. It should be float instead of int.
3) Refactored the default values for settings. Previously, they were defined in multiple places throughout the codebase, but they are now defined in one place (or two, to be exact: Settings.h and ServerSettings.h).
4) Improved documentation, including the correct message in system.settings.

Additionally make the code more conform with #46550.
2023-03-30 16:44:11 +02:00
Antonio Andelic
44e95aa65f Merge branch 'master' into nosign-keyword-for-s3 2023-03-29 11:10:03 +00:00
Antonio Andelic
7b1ad221b2 Address PR comments 2023-03-29 11:08:44 +00:00
Antonio Andelic
4c61ec2fad update docs 2023-03-28 07:19:08 +00:00
DanRoscigno
6d8a2bbd48 standardize admonitions 2023-03-27 14:54:05 -04:00
Antonio Andelic
a0582a14b9
Merge pull request #47423 from ClickHouse/add-expiration-window-s3
Add expiration window for S3 credentials
2023-03-18 10:11:29 +01:00
rfraposa
ac5ed141d8 New nav - reverting the revert 2023-03-17 21:45:43 -05:00
Alexander Tokmakov
ec44c8293a
Revert "New navigation" 2023-03-17 21:21:11 +03:00
Antonio Andelic
55c07ea16e Update docs 2023-03-10 10:12:01 +00:00
Rich Raposa
de68dade71
Revert "standardize admonitions" 2023-03-09 14:30:40 -07:00
DanRoscigno
95351bc2d3 standardize admonitions 2023-03-09 12:05:26 -05:00
Rich Raposa
f24fad9e26
Merge branch 'master' into new-nav 2023-03-08 14:31:10 -07:00
Rich Raposa
67c16195cc
Merge branch 'master' into new-nav 2023-03-07 14:06:37 -07:00
Robert Schulze
ff8fc0634a
Docs: Small cleanups after Kafka fix #47138 2023-03-07 19:50:42 +00:00
AVMusorin
0f2ae72141
prohibit DEFAULT/EPHEMERAL/ALIAS in KafkaEngine 2023-03-03 16:25:42 +01:00
rfraposa
17a2d7ed45 Fixing broken links 2023-03-01 16:53:17 -07:00
Robert Schulze
cca0bead44
Slighly improved example 2023-02-23 20:07:06 +00:00
Robert Schulze
b3eacf0894
Whitespace for the win 2023-02-23 20:06:24 +00:00
Robert Schulze
6906cafa99
Change to S3 cfg syntax 2023-02-23 20:04:41 +00:00
Robert Schulze
81bf43157f
Allow configuration of Kafka topics with periods
The Kafka table engine allows global configuration and per-Kafka-topic
configuration. The latter uses syntax <kafka_TOPIC>, e.g. for topic
"football":

  <kafka_football>
      <retry_backoff_ms>250</retry_backoff_ms>
      <fetch_min_bytes>100000</fetch_min_bytes>
  </kafka_football>

Some users had to find out the hard way that such configuration doesn't
take effect if the topic name contains a period, e.g. "sports.football".
The reason is that ClickHouse configuration framework already uses
periods as level separators to descend the configuration hierarchy.
(Besides that, per-topic configuration at the same level as global
configuration could be considered ugly.)

Note that Kafka topics may contain characters "a-zA-Z0-9._-" (*) and
a tree-like topic organization using periods is quite common in
practice.

This PR deprecates the existing per-topic configuration syntax (but
continues to support it for backward compat) and introduces a new
per-topic configuration syntax below the global Kafka configuration of
the form:

<kafka>
   <topic name="football">
       <retry_backoff_ms>250</retry_backoff_ms>
       <fetch_min_bytes>100000</fetch_min_bytes>
   </topic>
</kafka>

The period restriction doesn't apply to XML attributes, so <topic
name="sports.football"> will work. Also, everything Kafka-related is
below <kafka>.

Considered but rejected alternatives:
- Extending Poco ConfigurationView with custom separators (e.g."/"
  instead of "."). Won't work easily because ConfigurationView only
  builds a path but defers descending the configuration tree to the
  normal configuration classes.
- Reloading the configuration file in StorageKafka (instead of reading
  the loaded file) but with a custom separator. This mode is supported
  by XML configuration. Too ugly and error-prone since the true
  configuration is composed from multiple configuration files.

(*) https://stackoverflow.com/a/37067544
2023-02-22 20:35:09 +00:00
kssenii
bac464f89b Fix 2023-02-22 14:25:08 +01:00
Kseniia Sumarokova
c242fe3e5e
Update docs/en/engines/table-engines/integrations/hudi.md
Co-authored-by: flynn <fenglv15@mails.ucas.ac.cn>
2023-02-22 12:11:42 +01:00
Kseniia Sumarokova
ef15d64895
Update docs/en/engines/table-engines/integrations/deltalake.md
Co-authored-by: flynn <fenglv15@mails.ucas.ac.cn>
2023-02-22 12:11:23 +01:00
kssenii
21fcc3b69c Add iceberg doc 2023-02-22 12:04:24 +01:00
Dan Roscigno
10c8f31811
Update docs/en/engines/table-engines/integrations/embedded-rocksdb.md 2023-02-15 13:29:33 -05:00
Dan Roscigno
0496b55003
Update docs/en/engines/table-engines/integrations/embedded-rocksdb.md 2023-02-15 13:29:26 -05:00
Antonio Andelic
da4389a763 Add docs for KeeperMap 2023-02-15 15:29:11 +01:00
Ryadh DAHIMENE
82a36f50c9
Adding missing integrations to the list 2023-02-08 15:11:18 +01:00
kssenii
bbf060bf89 Fix test 2023-02-01 18:22:05 +01:00
DanRoscigno
917e3d4244 add PARTITION BY to s3 and hdfs docs 2023-01-25 09:09:28 -05:00
Tanya Bragin
b5773caeb2
Update postgresql.md
Adding related Postgres blog here. 

cc @gingerwizard @DanRoscigno
2023-01-14 14:34:33 -08:00
Dan Roscigno
0ad969171e
Merge pull request #45127 from DanRoscigno/add-deltalake-docs
Add deltalake docs
2023-01-11 08:07:42 -05:00
Dan Roscigno
6e9669cfae
Apply suggestions from code review 2023-01-11 07:53:37 -05:00
Dan Roscigno
02261b0e2a
Update docs/en/engines/table-engines/integrations/hudi.md 2023-01-11 07:42:15 -05:00
Dan Roscigno
73ef2657dd
Update docs/en/engines/table-engines/integrations/hudi.md 2023-01-11 07:40:10 -05:00
Dan Roscigno
21573028ea
Update docs/en/engines/table-engines/integrations/deltalake.md 2023-01-11 07:38:41 -05:00
DanRoscigno
563e0e76f9 init 2023-01-10 16:59:34 -05:00
DanRoscigno
5cf1b1f61d feedback 2023-01-10 16:09:59 -05:00
DanRoscigno
879ee05218 fix case of names 2023-01-10 11:18:33 -05:00
Dan Roscigno
f8a5d5cb18
Merge branch 'ClickHouse:master' into add-deltalake-docs 2023-01-09 15:45:08 -05:00
Ivan Blinkov
61c2f23713 Remove leftover empty lines at the end of markdown files 2023-01-09 15:15:18 +01:00
Ivan Blinkov
b7e082d033 Remove "Original article links" 2023-01-09 15:13:36 +01:00
DanRoscigno
5cde7762ad WIP 2023-01-05 15:54:44 -05:00
Kruglov Pavel
c5b2e4cc23
Merge branch 'master' into improve-streaming-engines 2022-12-15 18:44:35 +01:00