Commit Graph

892 Commits

Author SHA1 Message Date
DanRoscigno
6c7487bf55 document partitioned writes for s3 engine 2023-06-23 09:23:50 -04:00
rfraposa
b5d9ed5b0c Alphabetize table functions and engines 2023-06-23 07:16:22 -06:00
Ryadh DAHIMENE
815f4dc9a6
Added a note about MacOS builds 2023-06-19 12:34:36 +02:00
Rich Raposa
c08d11c97b
Merge pull request #51115 from ClickHouse/redis-fix
Fix Redis table engine slug
2023-06-16 15:53:05 -06:00
rfraposa
06ee2ca153 Update redis.md 2023-06-16 15:22:47 -06:00
Rich Raposa
3d928551c0
Merge branch 'master' into patch-52 2023-06-16 15:09:24 -06:00
Kruglov Pavel
7aea4a1f10
Merge branch 'master' into allow-skip-empty-files 2023-06-15 12:07:24 +02:00
Denny Crane
93e0e2c7cf
Update mergetree.md 2023-06-14 19:04:20 -03:00
Thom O'Connor
fb304c0b05
Update postgresql.md
Fix table definition by adding ORDER BY() statement
2023-06-14 10:39:55 -06:00
Thom O'Connor
c49bde8961
Update postgresql.md
Updated PostgreSQL documentation to better show example of using PostgreSQL() table engine for SELECT and INSERT, vs. copying data via postgresql() table function for copying data into ClickHouse
2023-06-14 07:11:28 -06:00
Robert Schulze
f4cfb9e370
Fix line break 2023-06-14 07:50:26 +00:00
Robert Schulze
b1f0a91b78
Docs: Fix embedded video link 2023-06-14 07:48:08 +00:00
pufit
91d794cf0a
Merge pull request #50150 from JackyWoo/support_redis
Add Redis table Engine/Function
2023-06-13 21:34:14 -04:00
JackyWoo
49082bfe89 fix typos in redis.md 2023-06-14 09:00:50 +08:00
Rich Raposa
86075dbae4
Update azureBlobStorage.md 2023-06-13 16:40:14 -06:00
Robert Schulze
22670aebf8
Merge pull request #50942 from ClickHouse/fix-ann-page
Fixes to ANN docs page
2023-06-13 17:57:00 +02:00
Dan Roscigno
5d1ea9aa18
Merge branch 'master' into fix-ann-page 2023-06-13 11:32:58 -04:00
Dan Roscigno
ecedceea1e
Merge branch 'master' into Fix_heading_sidebar_azureBlobStorage 2023-06-13 11:27:47 -04:00
DanRoscigno
b850f1b999 fix broken line 2023-06-13 11:26:12 -04:00
Dan Roscigno
20ea87e527
Update annindexes.md
Don't break code snippets across lines.
2023-06-13 11:17:33 -04:00
Kruglov Pavel
39ba925f8b
Merge branch 'master' into allow-skip-empty-files 2023-06-13 17:17:26 +02:00
rfraposa
57cdd3a25d Update annindexes.md 2023-06-13 09:13:13 -06:00
avogar
2e1f56ae33 Address comments 2023-06-13 14:43:50 +00:00
Smita Kulkarni
c253c70510 Fix for MDXContent 2023-06-13 16:33:36 +02:00
Robert Schulze
d8d352b2c5
Merge pull request #50912 from rschu1ze/annoy-docs
Update Annoy docs
2023-06-13 10:03:50 +02:00
JackyWoo
9d548315e8
Merge branch 'master' into support_redis 2023-06-13 09:34:32 +08:00
JackyWoo
959fde4491 add notifications in docs 2023-06-13 09:33:38 +08:00
Robert Schulze
4f39ee51ae
Update Annoy docs 2023-06-12 20:06:57 +00:00
Denny Crane
e6e8576864
Update mergetree.md 2023-06-12 17:04:33 -03:00
Robert Schulze
7745f7da73
Merge branch 'master' into annoy-misc 2023-06-12 21:46:27 +02:00
Kruglov Pavel
e4838725e3
Merge branch 'master' into allow-skip-empty-files 2023-06-12 20:03:23 +02:00
JackyWoo
a1641aa25d
Merge branch 'master' into support_redis 2023-06-12 09:53:06 +08:00
Smita Kulkarni
e6c2a6d13d Added example for table engine and fixed typos 2023-06-11 09:55:20 +02:00
DanRoscigno
05d4baf1e7 edits 2023-06-10 18:20:39 -04:00
Smita Kulkarni
78c32a204c Updated docs for azureBlobStorage Table function & engine 2023-06-10 23:00:59 +02:00
pufit
55d228e78e
Merge branch 'master' into support_redis 2023-06-09 11:45:12 -04:00
Robert Schulze
b8178088d0
Misc Annoy fixes 2023-06-08 15:06:17 +00:00
Kruglov Pavel
bf28074d32
Merge branch 'master' into allow-skip-empty-files 2023-06-08 12:36:18 +02:00
Robert Schulze
52e265badd
Merge remote-tracking branch 'rschu1ze/master' into annoy_cleanup 2023-06-07 09:13:41 +00:00
Robert Schulze
ce8b39487e
Update docs/en/engines/table-engines/mergetree-family/annindexes.md
Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>
2023-06-06 09:55:50 +02:00
Misz606
3023eb73d0
Update aggregatingmergetree.md
Grammatical update in docs
2023-06-05 21:02:27 +01:00
DanRoscigno
654aee209f add video 2023-06-05 11:55:04 -04:00
Robert Schulze
4c88b7bbb7
Further improve ANN index docs 2023-06-05 13:13:49 +00:00
ismailakpolat
3082029406
Update rabbitmq.md
Duplicate parameter name in definition
2023-06-05 13:03:17 +03:00
Robert Schulze
660760782a
Rewrite ANN docs 2023-06-05 09:30:55 +00:00
Robert Schulze
a973ac5dbb
Replace weird generic ANN setting by Annoy-specific parameter 2023-06-05 09:30:35 +00:00
vdimir
2989cd1d35
Merge pull request #50484 from DanRoscigno/docs-direct-join 2023-06-05 10:16:07 +02:00
DanRoscigno
87eaaa0f7b address review comments 2023-06-02 16:30:18 -04:00
DanRoscigno
17cca6ed75 add direct join docs 2023-06-02 10:08:48 -04:00
Robert Schulze
54872f9e7e
Typos: Follow-up to #50476 2023-06-02 13:28:09 +00:00
Robert Schulze
65cc92a78d
CI: Fix aspell on nested docs 2023-06-02 12:24:41 +00:00
JackyWoo
dc61023927 add sync mode to redis storage truncate 2023-06-02 10:05:54 +08:00
JackyWoo
7cc37ab4b8 add redis table engine/function docs 2023-06-02 10:05:54 +08:00
avogar
0b62be649f Add docs, fix style 2023-05-31 17:52:29 +00:00
Sergey Katkovskiy
f09bdc0f19 Merge branch 'master' of github.com:ClickHouse/ClickHouse into s3queue 2023-05-27 20:09:44 +03:00
Sema Checherinda
7c9d2ab6d0 working with review comments 2023-05-26 19:00:13 +02:00
Sema Checherinda
b0eff95388 update doc, add profile event WriteBufferFromS3WaitInflightLimitMicroseconds 2023-05-26 18:59:21 +02:00
Mohammad Arab Anvari
0d0e53ecc0
Update distributed.md
Fix broken link in `**See Also**` section.
2023-05-26 13:07:37 +03:30
Sergey Katkovskiy
bc7c67e33f code review fixes 2023-05-25 23:29:16 +03:00
Sergey Katkovskiy
0e55c7c365 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-build 2023-05-18 07:30:20 +03:00
Thom O'Connor
15cb627688
Update postgresql.md
The type cannot be optional, so we need to be clear in the docs that [type1] [type2] cannot be in square brackets, so removed them
2023-05-16 16:35:41 -06:00
AVMusorin
418a61a68c
Allow using Alias column type for KafkaEngine
```
create table kafka
(
 a UInt32,
 a_str String Alias toString(a)
) engine = Kafka;

create table data
(
  a UInt32;
  a_str String
) engine = MergeTree
order by tuple();

create materialized view data_mv to data
(
  a UInt32,
  a_str String
) as
select a, a_str from kafka;
```
Alias type works as expected in comparison with MATERIALIZED/EPHEMERAL
or column with default expression.

Ref: https://github.com/ClickHouse/ClickHouse/pull/47138

Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2023-05-15 15:39:58 +02:00
Sergey Katkovskiy
d7b4d9b6c0 add new table engine to index 2023-05-15 15:27:44 +03:00
Sergey Katkovskiy
ba55c11d0a add documentation 2023-05-15 15:26:44 +03:00
DanRoscigno
0a83f2aee8 fix broken note rendering 2023-05-09 13:29:59 -04:00
Dan Roscigno
c75e056d98
Update docs/en/engines/table-engines/mergetree-family/replacingmergetree.md 2023-05-09 13:18:42 -04:00
Dan Roscigno
199838e7fb
Update docs/en/engines/table-engines/mergetree-family/replacingmergetree.md 2023-05-09 13:18:35 -04:00
Dan Roscigno
cd62df4887
Update docs/en/engines/table-engines/mergetree-family/replacingmergetree.md 2023-05-09 13:18:26 -04:00
Dan Roscigno
582767e9ab
Update docs/en/engines/table-engines/mergetree-family/replacingmergetree.md 2023-05-09 13:18:18 -04:00
Dan Roscigno
2e20603b01
Update docs/en/engines/table-engines/mergetree-family/replacingmergetree.md 2023-05-09 13:18:09 -04:00
Constantine Peresypkin
cef9862628 docs: fix the is_deleted option docs
- `is_deleted` type __must__ be `UInt8` and not `Int8`
- strange wording on how `clean_deleted_rows` works is fixed
2023-05-09 12:40:33 -04:00
Ivan Takarlikov
8873856ce5 Fix some grammar mistakes in documentation, code and tests 2023-05-04 13:35:18 -03:00
johanngan
731823b873 Add support for SSE-KMS configuration with S3
https://docs.aws.amazon.com/AmazonS3/latest/userguide/UsingKMSEncryption.html

Similar to the server_side_encryption_customer_key_base64 option for
configuring SSE-C with S3, add the following settings to configure
SSE-KMS on a per-endpoint/disk basis:
  - server_side_encryption_kms_key_id
  - server_side_encryption_kms_encryption_context
  - server_side_encryption_kms_bucket_key_enabled
2023-05-03 21:35:38 -05:00
johanngan
1bc52977a7 Support "header" setting in S3 disk config
The S3 table engine supports specifying extra HTTP headers in S3
requests to certain endpoints, via the "headers" setting. This commit
adds the same setting to S3 disk config.
2023-05-03 21:32:58 -05:00
vdimir
d3c7054bcf
Merge pull request #49169 from lingtaolf/doc/bloomfilter_compute_functions 2023-05-03 12:43:45 +02:00
DanRoscigno
4ae2a467f7 add note about other disk types 2023-05-01 14:50:08 -04:00
Dan Roscigno
2b141a195a
Apply suggestions from code review
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
2023-05-01 14:38:05 -04:00
DanRoscigno
fa4ab93f21 add dynamic and nested dynamic 2023-05-01 14:06:50 -04:00
DanRoscigno
30dd645b4f add docs for nested dynamic disks 2023-05-01 13:02:32 -04:00
凌涛
e4011aa9c5
Update mergetree.md 2023-04-26 19:41:13 +08:00
凌涛
935656c23a add docs for create bmEstimate functions 2023-04-26 17:55:40 +08:00
凌涛
58de2dae26 add docs for create bmEstimate functions 2023-04-26 17:51:39 +08:00
Robert Schulze
cdf28f9b71
Minor fixups 2023-04-19 16:16:51 +00:00
Robert Schulze
c406663442
Docs: Replace annoying three spaces in enumerations by a single space 2023-04-19 15:56:55 +00:00
Dan Roscigno
c58785aa67
Merge pull request #48884 from ContentSquare/replacingMergeTreeNewEngineDoc
Document the new feature of the ReplacingMergeTree engine of the PR #…
2023-04-19 09:06:56 -04:00
Dan Roscigno
5704eea076
Update docs/en/engines/table-engines/integrations/postgresql.md 2023-04-18 12:55:27 -04:00
Dan Roscigno
8b05fb6f83
need full path to markdown file including the md 2023-04-18 12:54:54 -04:00
Thom O'Connor
b60169d258
Update postgresql.md
Added examples for INSERT INTO from SELECT * for initial load from PostgreSQL and incremental inserts
2023-04-18 09:48:32 -06:00
Youenn Lebras
066f5ac8fd Renaming for clearer comprehension 2023-04-18 14:53:00 +02:00
Youenn Lebras
082c5b0224 Document the new feature of the ReplacingMergeTree engine of the PR #41005 2023-04-18 11:17:46 +02:00
Rich Raposa
0c58c75023
Merge pull request #48762 from et/patch-1
Fix docs for case insensitive searches with a token bloom filter
2023-04-15 10:57:21 -06:00
Rich Raposa
04a8b4bd17
Update materialized-postgresql.md 2023-04-15 08:24:27 -06:00
Eric Thomas
8d5e72cc26
Fix docs for case insensitive searches with a token bloom filter 2023-04-13 14:04:55 -06:00
Dale Mcdiarmid
d50c6a9e1b update blog references 2023-04-10 15:23:00 +01:00
rfraposa
a016e8fcd1 Update replication.md 2023-04-05 11:30:59 -06:00
Antonio Andelic
1e3abc9e84 Add strict mode for KeeperMap 2023-03-31 14:24:32 +00:00
Antonio Andelic
80cb121d2a
Merge pull request #48092 from ClickHouse/nosign-keyword-for-s3
Add support for `NOSIGN` keyword and `no_sign_request` config for S3
2023-03-30 18:10:56 +02:00
filimonov
fbb22348ea
Refactor reading the pool setting & from server config. (#48055)
After #36425 there was a lot of confusions/problems with configuring pools - when the message was confusing, and settings need to be ajusted in several places.
See some examples in #44251, #43351, #47900, #46515.

The commit includes the following changes:
1) Introduced a unified mechanism for reading pool sizes from the configuration file(s). Previously, pool sizes were read from the Context.cpp with fallbacks to profiles, whereas main_config_reloader in Server.cpp read them directly without fallbacks.
2) Corrected the data type for background_merges_mutations_concurrency_ratio. It should be float instead of int.
3) Refactored the default values for settings. Previously, they were defined in multiple places throughout the codebase, but they are now defined in one place (or two, to be exact: Settings.h and ServerSettings.h).
4) Improved documentation, including the correct message in system.settings.

Additionally make the code more conform with #46550.
2023-03-30 16:44:11 +02:00
Alexander Tokmakov
131395b00f
Merge pull request #48171 from aalexfvk/add_option_disable_on_cluster_queries
Add allow_distributed_ddl_queries option to the cluster config
2023-03-30 17:29:02 +03:00
Aleksei Filatov
0ac9dcd723 Add allow_distributed_ddl_queries option to the cluster config 2023-03-29 18:15:46 +03:00
Antonio Andelic
44e95aa65f Merge branch 'master' into nosign-keyword-for-s3 2023-03-29 11:10:03 +00:00
Antonio Andelic
7b1ad221b2 Address PR comments 2023-03-29 11:08:44 +00:00
Robert Schulze
44d0a8075d
Small follow-up to #46252 2023-03-28 21:06:58 +00:00
Robert Schulze
622d1dfadd
Merge pull request #46252 from ClibMouse/feature/hastokencaseinsensitive-index-utilization
Implement tokenbf_v1 index utilization for hasTokenCaseInsensitive
2023-03-28 22:38:21 +02:00
Antonio Andelic
4c61ec2fad update docs 2023-03-28 07:19:08 +00:00
DanRoscigno
6d8a2bbd48 standardize admonitions 2023-03-27 14:54:05 -04:00
Robert Schulze
8cf031ee2e
Docs: Update secondary index example
Fixes: #47923
2023-03-23 22:36:38 +00:00
ltrk2
f46970671d Implement tokenbf_v1 index utilization for hasTokenCaseInsensitive 2023-03-23 12:24:13 -07:00
Robert Schulze
3953d77059
+ on 2023-03-23 10:51:25 +00:00
Robert Schulze
451df6db07
More fixup 2023-03-23 10:50:40 +00:00
Robert Schulze
b3260f2201
Docs: Fixup docs on Map-data-type support in data skipping indexes 2023-03-23 10:24:26 +00:00
Robert Schulze
2b9a73baa8
Docs: Fix wrong bracket nesting for GenerateRandom 2023-03-22 13:58:10 +00:00
Antonio Andelic
a0582a14b9
Merge pull request #47423 from ClickHouse/add-expiration-window-s3
Add expiration window for S3 credentials
2023-03-18 10:11:29 +01:00
rfraposa
ac5ed141d8 New nav - reverting the revert 2023-03-17 21:45:43 -05:00
Alexander Tokmakov
ec44c8293a
Revert "New navigation" 2023-03-17 21:21:11 +03:00
Antonio Andelic
55c07ea16e Update docs 2023-03-10 10:12:01 +00:00
Rich Raposa
de68dade71
Revert "standardize admonitions" 2023-03-09 14:30:40 -07:00
DanRoscigno
95351bc2d3 standardize admonitions 2023-03-09 12:05:26 -05:00
Rich Raposa
f24fad9e26
Merge branch 'master' into new-nav 2023-03-08 14:31:10 -07:00
rfraposa
854cdae311 Link fixes 2023-03-07 17:58:36 -07:00
Rich Raposa
67c16195cc
Merge branch 'master' into new-nav 2023-03-07 14:06:37 -07:00
rfraposa
008845216d Fix broken links 2023-03-07 14:06:14 -07:00
Robert Schulze
ff8fc0634a
Docs: Small cleanups after Kafka fix #47138 2023-03-07 19:50:42 +00:00
Robert Schulze
5b91631722
Merge pull request #47138 from AVMusorin/disallow-default-columns-kafka-engine
Prohibit DEFAULT/EPHEMERAL/ALIAS/MATERIALIZED columns in KafkaEngine
2023-03-07 20:36:46 +01:00
Rich Raposa
cb4f8c85ba
Merge branch 'master' into new-nav 2023-03-04 18:09:56 -07:00
Robert Schulze
11930ad685
Docs: Update index support of has(), hasAny(), hasAll() 2023-03-04 17:27:47 +00:00
rfraposa
5ede8cc69a Broken links 2023-03-04 09:03:04 -07:00
AVMusorin
0f2ae72141
prohibit DEFAULT/EPHEMERAL/ALIAS in KafkaEngine 2023-03-03 16:25:42 +01:00
rfraposa
17a2d7ed45 Fixing broken links 2023-03-01 16:53:17 -07:00
Dan Roscigno
0286b43a73
Fix 404 on approx nearest neighbor page
closes https://github.com/ClickHouse/clickhouse-docs/issues/846
2023-02-28 09:32:06 -05:00
Robert Schulze
cca0bead44
Slighly improved example 2023-02-23 20:07:06 +00:00
Robert Schulze
b3eacf0894
Whitespace for the win 2023-02-23 20:06:24 +00:00
Robert Schulze
6906cafa99
Change to S3 cfg syntax 2023-02-23 20:04:41 +00:00
Robert Schulze
81bf43157f
Allow configuration of Kafka topics with periods
The Kafka table engine allows global configuration and per-Kafka-topic
configuration. The latter uses syntax <kafka_TOPIC>, e.g. for topic
"football":

  <kafka_football>
      <retry_backoff_ms>250</retry_backoff_ms>
      <fetch_min_bytes>100000</fetch_min_bytes>
  </kafka_football>

Some users had to find out the hard way that such configuration doesn't
take effect if the topic name contains a period, e.g. "sports.football".
The reason is that ClickHouse configuration framework already uses
periods as level separators to descend the configuration hierarchy.
(Besides that, per-topic configuration at the same level as global
configuration could be considered ugly.)

Note that Kafka topics may contain characters "a-zA-Z0-9._-" (*) and
a tree-like topic organization using periods is quite common in
practice.

This PR deprecates the existing per-topic configuration syntax (but
continues to support it for backward compat) and introduces a new
per-topic configuration syntax below the global Kafka configuration of
the form:

<kafka>
   <topic name="football">
       <retry_backoff_ms>250</retry_backoff_ms>
       <fetch_min_bytes>100000</fetch_min_bytes>
   </topic>
</kafka>

The period restriction doesn't apply to XML attributes, so <topic
name="sports.football"> will work. Also, everything Kafka-related is
below <kafka>.

Considered but rejected alternatives:
- Extending Poco ConfigurationView with custom separators (e.g."/"
  instead of "."). Won't work easily because ConfigurationView only
  builds a path but defers descending the configuration tree to the
  normal configuration classes.
- Reloading the configuration file in StorageKafka (instead of reading
  the loaded file) but with a custom separator. This mode is supported
  by XML configuration. Too ugly and error-prone since the true
  configuration is composed from multiple configuration files.

(*) https://stackoverflow.com/a/37067544
2023-02-22 20:35:09 +00:00
kssenii
bac464f89b Fix 2023-02-22 14:25:08 +01:00
Kseniia Sumarokova
c242fe3e5e
Update docs/en/engines/table-engines/integrations/hudi.md
Co-authored-by: flynn <fenglv15@mails.ucas.ac.cn>
2023-02-22 12:11:42 +01:00
Kseniia Sumarokova
ef15d64895
Update docs/en/engines/table-engines/integrations/deltalake.md
Co-authored-by: flynn <fenglv15@mails.ucas.ac.cn>
2023-02-22 12:11:23 +01:00
kssenii
21fcc3b69c Add iceberg doc 2023-02-22 12:04:24 +01:00
Alexey Milovidov
17992b178a
Merge pull request #45364 from nickitat/aggr_partitions_independently
Add option to aggregate partitions independently
2023-02-19 17:44:18 +03:00
Nikita Taranov
f70044f34b Merge branch 'master' into aggr_partitions_independently 2023-02-18 13:19:05 +00:00
Denny Crane
f78efe91f6
Update summingmergetree.md 2023-02-17 18:46:30 -04:00
Dan Roscigno
10c8f31811
Update docs/en/engines/table-engines/integrations/embedded-rocksdb.md 2023-02-15 13:29:33 -05:00
Dan Roscigno
0496b55003
Update docs/en/engines/table-engines/integrations/embedded-rocksdb.md 2023-02-15 13:29:26 -05:00
Antonio Andelic
da4389a763 Add docs for KeeperMap 2023-02-15 15:29:11 +01:00
Anton Popov
ccf7b6f4c1
Merge pull request #45582 from mrcrypster/patch-4
DELETE + WHERE in TTL
2023-02-10 14:27:54 +01:00
Ryadh DAHIMENE
82a36f50c9
Adding missing integrations to the list 2023-02-08 15:11:18 +01:00
rfraposa
f3136e3f25 Resolve feedback 2023-02-06 10:48:54 -07:00
rfraposa
8a84a75ab8 Create executable.md 2023-02-05 01:08:52 -06:00
Nikita Taranov
b983b363f8 Merge branch 'master' into aggr_partitions_independently 2023-02-04 18:24:31 +00:00
Kseniia Sumarokova
ef7acb9b66
Merge pull request #44404 from kssenii/storage-rabbitmq-fix-flush
RabbitMQ - fix writing many small blocks by flushing data only exactly by flush_interval_ms or by max_block_size
2023-02-03 11:50:12 +01:00