thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-27 10:02:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
108,662 Commits 9,196 Branches 1,782 Tags 2.1 GiB
81bf43157f
Commit Graph

13362 Commits

Author SHA1 Message Date
Robert Schulze
81bf43157f
Allow configuration of Kafka topics with periods 
The Kafka table engine allows global configuration and per-Kafka-topic
configuration. The latter uses syntax <kafka_TOPIC>, e.g. for topic
"football":

  <kafka_football>
      <retry_backoff_ms>250</retry_backoff_ms>
      <fetch_min_bytes>100000</fetch_min_bytes>
  </kafka_football>

Some users had to find out the hard way that such configuration doesn't
take effect if the topic name contains a period, e.g. "sports.football".
The reason is that ClickHouse configuration framework already uses
periods as level separators to descend the configuration hierarchy.
(Besides that, per-topic configuration at the same level as global
configuration could be considered ugly.)

Note that Kafka topics may contain characters "a-zA-Z0-9._-" (*) and
a tree-like topic organization using periods is quite common in
practice.

This PR deprecates the existing per-topic configuration syntax (but
continues to support it for backward compat) and introduces a new
per-topic configuration syntax below the global Kafka configuration of
the form:

<kafka>
   <topic name="football">
       <retry_backoff_ms>250</retry_backoff_ms>
       <fetch_min_bytes>100000</fetch_min_bytes>
   </topic>
</kafka>

The period restriction doesn't apply to XML attributes, so <topic
name="sports.football"> will work. Also, everything Kafka-related is
below <kafka>.

Considered but rejected alternatives:
- Extending Poco ConfigurationView with custom separators (e.g."/"
  instead of "."). Won't work easily because ConfigurationView only
  builds a path but defers descending the configuration tree to the
  normal configuration classes.
- Reloading the configuration file in StorageKafka (instead of reading
  the loaded file) but with a custom separator. This mode is supported
  by XML configuration. Too ugly and error-prone since the true
  configuration is composed from multiple configuration files.

(*) https://stackoverflow.com/a/37067544
 2023-02-22 20:35:09 +00:00
Kseniia Sumarokova
bec094cd79
Merge pull request #46712 from kssenii/add-iceberg-doc 
Add iceberg engine doc
 2023-02-22 14:49:03 +01:00
kssenii
bac464f89b Fix 2023-02-22 14:25:08 +01:00
Kseniia Sumarokova
c242fe3e5e
Update docs/en/engines/table-engines/integrations/hudi.md 
Co-authored-by: flynn <fenglv15@mails.ucas.ac.cn>
 2023-02-22 12:11:42 +01:00
Kseniia Sumarokova
ef15d64895
Update docs/en/engines/table-engines/integrations/deltalake.md 
Co-authored-by: flynn <fenglv15@mails.ucas.ac.cn>
 2023-02-22 12:11:23 +01:00
kssenii
21fcc3b69c Add iceberg doc 2023-02-22 12:04:24 +01:00
robot-clickhouse-ci-2
2df52af445
Merge pull request #46711 from ClickHouse/vdimir/tmp-data-in-fs-cache-doc 
Add doc for temporary_data_in_cache
 2023-02-22 11:41:03 +01:00
vdimir
a4919ce3a2
Add doc for temporary_data_in_cache 2023-02-22 10:19:28 +00:00
robot-clickhouse
e010af8be8
Merge pull request #46649 from xiedeyantu/patch-2 
Update s3Cluster.md
 2023-02-21 22:48:38 +01:00
Alexey Milovidov
4adbcd4beb
Merge pull request #46665 from ClickHouse/clean-docs-release 
Get rid of legacy DocsReleaseChecks
 2023-02-22 00:31:17 +03:00
Han Fei
fa5d06c4da
Merge pull request #46666 from hanfei1991/hanfei/add-doc-async-insert-max-query-number 
add docs for setting async_insert_max_query_number
 2023-02-21 19:02:37 +01:00
Dan Roscigno
efea3cbc5c
Update docs/en/operations/settings/settings.md 2023-02-21 12:19:56 -05:00
Han Fei
eeac1abaa5 add docs for setting async_insert_max_query_number 2023-02-21 17:49:52 +01:00
Mikhail f. Shiryaev
cd2ab02f22
Get rid of legacy DocsReleaseChecks 2023-02-21 17:34:16 +01:00
Dan Roscigno
b6612d2c18
fix anchor link 2023-02-21 11:24:39 -05:00
chen
c1e611334a
Update s3Cluster.md 2023-02-21 21:53:44 +08:00
chen
254cb1119b
Update s3Cluster.md 2023-02-21 21:52:17 +08:00
Kruglov Pavel
2924e8e802
Merge pull request #46631 from bigo-sg/json_array_length 
Add new function JSONArrayLength
 2023-02-21 12:50:27 +01:00
Nikolay Degterinsky
51e9238950
Merge pull request #46577 from jus1096/master 
Add description function
 2023-02-21 12:31:35 +01:00
Jus
2945125a16
Update docs/ru/sql-reference/functions/other-functions.md 
Co-authored-by: Nikolay Degterinsky <43110995+evillique@users.noreply.github.com>
 2023-02-21 10:00:47 +04:00
taiyang-li
eafac0f9a3 add docs 2023-02-21 11:17:44 +08:00
Alexey Milovidov
b1d9ba9da1
Fix #46620 2023-02-21 01:46:10 +03:00
kssenii
80a0aa1327 Merge remote-tracking branch 'upstream/master' into return-materialized-postrgesql-tests-back 2023-02-20 14:37:39 +01:00
robot-clickhouse-ci-2
1d5cc9b387
Merge pull request #46579 from ClickHouse/rs/sparkbar-docs 
Small update of sparkbar docs
 2023-02-20 09:19:01 +01:00
Robert Schulze
5557e66766
Small update of sparkbar docs 
- parameter name "width" was misleading
 2023-02-20 08:03:40 +00:00
Jus
d48ec14cab
Add description function 
Add description function.
Fix bugs
 2023-02-20 10:59:57 +04:00
Alexey Milovidov
17992b178a
Merge pull request #45364 from nickitat/aggr_partitions_independently 
Add option to aggregate partitions independently
 2023-02-19 17:44:18 +03:00
Alexander Gololobov
1b8cae8ee5
Merge pull request #46529 from ClickHouse/regexp_extract 
Merge #46469
 2023-02-19 10:28:35 +01:00
robot-ch-test-poll2
ee063e75f2
Merge pull request #46489 from jus1096/master 
Add info for Kafka doc
 2023-02-18 15:43:28 +01:00
Alexey Milovidov
ed4bd2690c
Merge pull request #46545 from DanRoscigno/update-rpm-install-docs 
Update install docs with RPM and tgz methods
 2023-02-18 17:21:33 +03:00
Alexey Milovidov
d582cb0dcf
Merge pull request #46547 from den-crane/patch-62 
Doc. Better example of nested summing
 2023-02-18 17:20:57 +03:00
Alexey Milovidov
325b728bc9
Update wikistat.md 2023-02-18 16:50:14 +03:00
Alexey Milovidov
30921b211b
Update wikistat.md 2023-02-18 16:49:55 +03:00
Nikita Taranov
f70044f34b Merge branch 'master' into aggr_partitions_independently 2023-02-18 13:19:05 +00:00
Alexey Milovidov
bb001078c9
Update sampling-query-profiler.md 2023-02-18 14:01:47 +03:00
Denny Crane
f78efe91f6
Update summingmergetree.md 2023-02-17 18:46:30 -04:00
Dan Roscigno
16bd07067f
Update docs/en/getting-started/install.md 2023-02-17 16:08:12 -05:00
DanRoscigno
2b6c088eb0 add keeper to tgz list 2023-02-17 16:04:15 -05:00
DanRoscigno
502e240563 update RPM install 2023-02-17 15:55:55 -05:00
robot-clickhouse
9ec3bf92af
Merge pull request #46501 from DanRoscigno/docs-for-keeper-install 
Add docs for standalone ClickHouse Keeper install.
 2023-02-17 19:36:37 +01:00
Alexey Milovidov
a1cf3f78f6
Merge pull request #46497 from ClickHouse/alexey-milovidov-patch-6 
Update monitoring.md
 2023-02-17 16:03:22 +03:00
DanRoscigno
52d831cb87 add text about standalone Keeper 2023-02-16 16:32:12 -05:00
DanRoscigno
1370f9811a Add docs for standalone ClickHouse Keeper install. 2023-02-16 16:21:51 -05:00
Robert Schulze
b2fe7bf5c7
Merge pull request #46498 from ClickHouse/rs/docs-catboostevaluate 
Document that catboostEvaluate() is not available in ClickHouse Cloud
 2023-02-16 21:07:53 +01:00
Robert Schulze
18cbc7b511
Docs: catboostEvaluate() is unavailable in Cloud 2023-02-16 19:19:25 +00:00
Alexey Milovidov
2cd9fd5698
Update monitoring.md 2023-02-16 22:09:10 +03:00
Alexey Milovidov
4eda5d19b5
Merge pull request #46492 from myrrc/patch-2 
Add --shallow-submodules version for developer instruction
 2023-02-16 22:07:47 +03:00
Mike Kot
f4600bc805
Add --shallow-submodules version for developer instruction 
On modern git that can speed up clone time
 2023-02-16 20:46:59 +03:00
Mike Kot
444f3aa2ac
Add --shallow-submodules version 
For recent Git, this options changes checkout time drastically
 2023-02-16 20:44:01 +03:00
robot-ch-test-poll1
300dfbbef6
Merge pull request #46460 from ClickHouse/group-by-use-nulls-docs 
Add documentation for `group_by_use_nulls` setting
 2023-02-16 18:41:34 +01:00