Commit Graph

874 Commits

Author SHA1 Message Date
Robert Schulze
cca0bead44
Slighly improved example 2023-02-23 20:07:06 +00:00
Robert Schulze
b3eacf0894
Whitespace for the win 2023-02-23 20:06:24 +00:00
Robert Schulze
6906cafa99
Change to S3 cfg syntax 2023-02-23 20:04:41 +00:00
Robert Schulze
81bf43157f
Allow configuration of Kafka topics with periods
The Kafka table engine allows global configuration and per-Kafka-topic
configuration. The latter uses syntax <kafka_TOPIC>, e.g. for topic
"football":

  <kafka_football>
      <retry_backoff_ms>250</retry_backoff_ms>
      <fetch_min_bytes>100000</fetch_min_bytes>
  </kafka_football>

Some users had to find out the hard way that such configuration doesn't
take effect if the topic name contains a period, e.g. "sports.football".
The reason is that ClickHouse configuration framework already uses
periods as level separators to descend the configuration hierarchy.
(Besides that, per-topic configuration at the same level as global
configuration could be considered ugly.)

Note that Kafka topics may contain characters "a-zA-Z0-9._-" (*) and
a tree-like topic organization using periods is quite common in
practice.

This PR deprecates the existing per-topic configuration syntax (but
continues to support it for backward compat) and introduces a new
per-topic configuration syntax below the global Kafka configuration of
the form:

<kafka>
   <topic name="football">
       <retry_backoff_ms>250</retry_backoff_ms>
       <fetch_min_bytes>100000</fetch_min_bytes>
   </topic>
</kafka>

The period restriction doesn't apply to XML attributes, so <topic
name="sports.football"> will work. Also, everything Kafka-related is
below <kafka>.

Considered but rejected alternatives:
- Extending Poco ConfigurationView with custom separators (e.g."/"
  instead of "."). Won't work easily because ConfigurationView only
  builds a path but defers descending the configuration tree to the
  normal configuration classes.
- Reloading the configuration file in StorageKafka (instead of reading
  the loaded file) but with a custom separator. This mode is supported
  by XML configuration. Too ugly and error-prone since the true
  configuration is composed from multiple configuration files.

(*) https://stackoverflow.com/a/37067544
2023-02-22 20:35:09 +00:00
Kseniia Sumarokova
bec094cd79
Merge pull request #46712 from kssenii/add-iceberg-doc
Add iceberg engine doc
2023-02-22 14:49:03 +01:00
kssenii
bac464f89b Fix 2023-02-22 14:25:08 +01:00
Kseniia Sumarokova
c242fe3e5e
Update docs/en/engines/table-engines/integrations/hudi.md
Co-authored-by: flynn <fenglv15@mails.ucas.ac.cn>
2023-02-22 12:11:42 +01:00
Kseniia Sumarokova
ef15d64895
Update docs/en/engines/table-engines/integrations/deltalake.md
Co-authored-by: flynn <fenglv15@mails.ucas.ac.cn>
2023-02-22 12:11:23 +01:00
kssenii
21fcc3b69c Add iceberg doc 2023-02-22 12:04:24 +01:00
kssenii
80a0aa1327 Merge remote-tracking branch 'upstream/master' into return-materialized-postrgesql-tests-back 2023-02-20 14:37:39 +01:00
Alexey Milovidov
17992b178a
Merge pull request #45364 from nickitat/aggr_partitions_independently
Add option to aggregate partitions independently
2023-02-19 17:44:18 +03:00
Nikita Taranov
f70044f34b Merge branch 'master' into aggr_partitions_independently 2023-02-18 13:19:05 +00:00
Denny Crane
f78efe91f6
Update summingmergetree.md 2023-02-17 18:46:30 -04:00
kssenii
75d62ee24a Remove support of feature which does not work reliably 2023-02-16 16:41:31 +01:00
Dan Roscigno
10c8f31811
Update docs/en/engines/table-engines/integrations/embedded-rocksdb.md 2023-02-15 13:29:33 -05:00
Dan Roscigno
0496b55003
Update docs/en/engines/table-engines/integrations/embedded-rocksdb.md 2023-02-15 13:29:26 -05:00
Antonio Andelic
da4389a763 Add docs for KeeperMap 2023-02-15 15:29:11 +01:00
Anton Popov
ccf7b6f4c1
Merge pull request #45582 from mrcrypster/patch-4
DELETE + WHERE in TTL
2023-02-10 14:27:54 +01:00
Ryadh DAHIMENE
82a36f50c9
Adding missing integrations to the list 2023-02-08 15:11:18 +01:00
rfraposa
f3136e3f25 Resolve feedback 2023-02-06 10:48:54 -07:00
rfraposa
8a84a75ab8 Create executable.md 2023-02-05 01:08:52 -06:00
Nikita Taranov
b983b363f8 Merge branch 'master' into aggr_partitions_independently 2023-02-04 18:24:31 +00:00
Kseniia Sumarokova
ef7acb9b66
Merge pull request #44404 from kssenii/storage-rabbitmq-fix-flush
RabbitMQ - fix writing many small blocks by flushing data only exactly by flush_interval_ms or by max_block_size
2023-02-03 11:50:12 +01:00
Robert Schulze
b95ecfaec5
Minor doc fixes for inverted index 2023-02-03 10:01:53 +00:00
rfraposa
6011656008 Update invertedindexes.md 2023-02-01 20:55:58 -07:00
kssenii
bbf060bf89 Fix test 2023-02-01 18:22:05 +01:00
Ilya Yatsishin
8d6df7ed58
Merge pull request #45785 from Algunenano/generate_random_types 2023-01-30 23:03:12 +01:00
Nikita Taranov
581f31ad3d better 2023-01-30 17:11:56 +00:00
Nikita Taranov
d8c191f53b add docs 2023-01-30 17:11:56 +00:00
Raúl Marín
997fad4e8d GenerateRandom: Add support for maps 2023-01-30 15:23:22 +01:00
Roman Heinrich
bcc933098b
Fix broken examples for inverted indexes 2023-01-30 00:12:32 +01:00
Kseniia Sumarokova
7d178e5ee6
Merge pull request #45680 from DanRoscigno/docs-mergetree-s3-cache
doc updates related to s3 cache change
2023-01-27 17:54:31 +01:00
DanRoscigno
a88c222f44 add missing heading 2023-01-27 08:56:25 -05:00
DanRoscigno
80b3b882c3 review from ksenii 2023-01-27 08:48:29 -05:00
DanRoscigno
15b4c712df updates related to s3 cache change 2023-01-26 16:32:39 -05:00
Dan Roscigno
d1a81b2776
Update docs/en/engines/table-engines/mergetree-family/invertedindexes.md 2023-01-26 14:07:13 -05:00
Dan Roscigno
00b5354a93
Update invertedindexes.md 2023-01-26 14:05:26 -05:00
Dan Roscigno
8549af4853
Update docs/en/engines/table-engines/mergetree-family/invertedindexes.md 2023-01-26 10:51:08 -05:00
DanRoscigno
710384e69a remove sidebar position 2023-01-26 10:13:06 -05:00
DanRoscigno
88076b6db0 add keywords 2023-01-26 10:06:06 -05:00
DanRoscigno
c130050572 capitalize sidebar 2023-01-26 09:05:56 -05:00
DanRoscigno
310797d9f0 edits, add frontmatter 2023-01-26 08:58:10 -05:00
DanRoscigno
fe1d99a2d3 add PARTITION BY to file and url docs 2023-01-25 09:18:55 -05:00
DanRoscigno
917e3d4244 add PARTITION BY to s3 and hdfs docs 2023-01-25 09:09:28 -05:00
Robert Schulze
5edea1b461
Docs: mini semicolon fix 2023-01-24 19:25:37 +00:00
Denys Golotiuk
c1de756d8a
DELETE + WHERE in TTL
ClickHouse actually supports only `DELETE` action with `WHERE` clause of a `TTL` statement
2023-01-24 17:50:29 +02:00
Kseniia Sumarokova
dd18dd2953
Merge pull request #45341 from ClibMouse/feature/non-throwing-hastoken
Introduce non-throwing variants of hasToken
2023-01-24 15:37:36 +01:00
ltrk2
9710b8643c Refine the solution 2023-01-23 14:27:48 -08:00
robot-ch-test-poll4
2066581d8f
Merge pull request #45451 from evillique/default_granularity
Add default GRANULARITY argument for secondary indexes
2023-01-20 17:46:21 +01:00
Nikolay Degterinsky
02142596fb Add docs 2023-01-20 15:22:13 +00:00