Commit Graph

848 Commits

Author SHA1 Message Date
Robert Schulze
660760782a
Rewrite ANN docs 2023-06-05 09:30:55 +00:00
Robert Schulze
a973ac5dbb
Replace weird generic ANN setting by Annoy-specific parameter 2023-06-05 09:30:35 +00:00
vdimir
2989cd1d35
Merge pull request #50484 from DanRoscigno/docs-direct-join 2023-06-05 10:16:07 +02:00
DanRoscigno
87eaaa0f7b address review comments 2023-06-02 16:30:18 -04:00
DanRoscigno
17cca6ed75 add direct join docs 2023-06-02 10:08:48 -04:00
Robert Schulze
54872f9e7e
Typos: Follow-up to #50476 2023-06-02 13:28:09 +00:00
Robert Schulze
65cc92a78d
CI: Fix aspell on nested docs 2023-06-02 12:24:41 +00:00
JackyWoo
dc61023927 add sync mode to redis storage truncate 2023-06-02 10:05:54 +08:00
JackyWoo
7cc37ab4b8 add redis table engine/function docs 2023-06-02 10:05:54 +08:00
avogar
0b62be649f Add docs, fix style 2023-05-31 17:52:29 +00:00
Sergey Katkovskiy
f09bdc0f19 Merge branch 'master' of github.com:ClickHouse/ClickHouse into s3queue 2023-05-27 20:09:44 +03:00
Sema Checherinda
7c9d2ab6d0 working with review comments 2023-05-26 19:00:13 +02:00
Sema Checherinda
b0eff95388 update doc, add profile event WriteBufferFromS3WaitInflightLimitMicroseconds 2023-05-26 18:59:21 +02:00
Mohammad Arab Anvari
0d0e53ecc0
Update distributed.md
Fix broken link in `**See Also**` section.
2023-05-26 13:07:37 +03:30
Sergey Katkovskiy
bc7c67e33f code review fixes 2023-05-25 23:29:16 +03:00
Sergey Katkovskiy
0e55c7c365 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-build 2023-05-18 07:30:20 +03:00
Thom O'Connor
15cb627688
Update postgresql.md
The type cannot be optional, so we need to be clear in the docs that [type1] [type2] cannot be in square brackets, so removed them
2023-05-16 16:35:41 -06:00
AVMusorin
418a61a68c
Allow using Alias column type for KafkaEngine
```
create table kafka
(
 a UInt32,
 a_str String Alias toString(a)
) engine = Kafka;

create table data
(
  a UInt32;
  a_str String
) engine = MergeTree
order by tuple();

create materialized view data_mv to data
(
  a UInt32,
  a_str String
) as
select a, a_str from kafka;
```
Alias type works as expected in comparison with MATERIALIZED/EPHEMERAL
or column with default expression.

Ref: https://github.com/ClickHouse/ClickHouse/pull/47138

Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2023-05-15 15:39:58 +02:00
Sergey Katkovskiy
d7b4d9b6c0 add new table engine to index 2023-05-15 15:27:44 +03:00
Sergey Katkovskiy
ba55c11d0a add documentation 2023-05-15 15:26:44 +03:00
DanRoscigno
0a83f2aee8 fix broken note rendering 2023-05-09 13:29:59 -04:00
Dan Roscigno
c75e056d98
Update docs/en/engines/table-engines/mergetree-family/replacingmergetree.md 2023-05-09 13:18:42 -04:00
Dan Roscigno
199838e7fb
Update docs/en/engines/table-engines/mergetree-family/replacingmergetree.md 2023-05-09 13:18:35 -04:00
Dan Roscigno
cd62df4887
Update docs/en/engines/table-engines/mergetree-family/replacingmergetree.md 2023-05-09 13:18:26 -04:00
Dan Roscigno
582767e9ab
Update docs/en/engines/table-engines/mergetree-family/replacingmergetree.md 2023-05-09 13:18:18 -04:00
Dan Roscigno
2e20603b01
Update docs/en/engines/table-engines/mergetree-family/replacingmergetree.md 2023-05-09 13:18:09 -04:00
Constantine Peresypkin
cef9862628 docs: fix the is_deleted option docs
- `is_deleted` type __must__ be `UInt8` and not `Int8`
- strange wording on how `clean_deleted_rows` works is fixed
2023-05-09 12:40:33 -04:00
Ivan Takarlikov
8873856ce5 Fix some grammar mistakes in documentation, code and tests 2023-05-04 13:35:18 -03:00
johanngan
731823b873 Add support for SSE-KMS configuration with S3
https://docs.aws.amazon.com/AmazonS3/latest/userguide/UsingKMSEncryption.html

Similar to the server_side_encryption_customer_key_base64 option for
configuring SSE-C with S3, add the following settings to configure
SSE-KMS on a per-endpoint/disk basis:
  - server_side_encryption_kms_key_id
  - server_side_encryption_kms_encryption_context
  - server_side_encryption_kms_bucket_key_enabled
2023-05-03 21:35:38 -05:00
johanngan
1bc52977a7 Support "header" setting in S3 disk config
The S3 table engine supports specifying extra HTTP headers in S3
requests to certain endpoints, via the "headers" setting. This commit
adds the same setting to S3 disk config.
2023-05-03 21:32:58 -05:00
vdimir
d3c7054bcf
Merge pull request #49169 from lingtaolf/doc/bloomfilter_compute_functions 2023-05-03 12:43:45 +02:00
DanRoscigno
4ae2a467f7 add note about other disk types 2023-05-01 14:50:08 -04:00
Dan Roscigno
2b141a195a
Apply suggestions from code review
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
2023-05-01 14:38:05 -04:00
DanRoscigno
fa4ab93f21 add dynamic and nested dynamic 2023-05-01 14:06:50 -04:00
DanRoscigno
30dd645b4f add docs for nested dynamic disks 2023-05-01 13:02:32 -04:00
凌涛
e4011aa9c5
Update mergetree.md 2023-04-26 19:41:13 +08:00
凌涛
935656c23a add docs for create bmEstimate functions 2023-04-26 17:55:40 +08:00
凌涛
58de2dae26 add docs for create bmEstimate functions 2023-04-26 17:51:39 +08:00
Robert Schulze
cdf28f9b71
Minor fixups 2023-04-19 16:16:51 +00:00
Robert Schulze
c406663442
Docs: Replace annoying three spaces in enumerations by a single space 2023-04-19 15:56:55 +00:00
Dan Roscigno
c58785aa67
Merge pull request #48884 from ContentSquare/replacingMergeTreeNewEngineDoc
Document the new feature of the ReplacingMergeTree engine of the PR #…
2023-04-19 09:06:56 -04:00
Dan Roscigno
5704eea076
Update docs/en/engines/table-engines/integrations/postgresql.md 2023-04-18 12:55:27 -04:00
Dan Roscigno
8b05fb6f83
need full path to markdown file including the md 2023-04-18 12:54:54 -04:00
Thom O'Connor
b60169d258
Update postgresql.md
Added examples for INSERT INTO from SELECT * for initial load from PostgreSQL and incremental inserts
2023-04-18 09:48:32 -06:00
Youenn Lebras
066f5ac8fd Renaming for clearer comprehension 2023-04-18 14:53:00 +02:00
Youenn Lebras
082c5b0224 Document the new feature of the ReplacingMergeTree engine of the PR #41005 2023-04-18 11:17:46 +02:00
Rich Raposa
0c58c75023
Merge pull request #48762 from et/patch-1
Fix docs for case insensitive searches with a token bloom filter
2023-04-15 10:57:21 -06:00
Rich Raposa
04a8b4bd17
Update materialized-postgresql.md 2023-04-15 08:24:27 -06:00
Eric Thomas
8d5e72cc26
Fix docs for case insensitive searches with a token bloom filter 2023-04-13 14:04:55 -06:00
Dale Mcdiarmid
d50c6a9e1b update blog references 2023-04-10 15:23:00 +01:00
rfraposa
a016e8fcd1 Update replication.md 2023-04-05 11:30:59 -06:00
Antonio Andelic
1e3abc9e84 Add strict mode for KeeperMap 2023-03-31 14:24:32 +00:00
Antonio Andelic
80cb121d2a
Merge pull request #48092 from ClickHouse/nosign-keyword-for-s3
Add support for `NOSIGN` keyword and `no_sign_request` config for S3
2023-03-30 18:10:56 +02:00
filimonov
fbb22348ea
Refactor reading the pool setting & from server config. (#48055)
After #36425 there was a lot of confusions/problems with configuring pools - when the message was confusing, and settings need to be ajusted in several places.
See some examples in #44251, #43351, #47900, #46515.

The commit includes the following changes:
1) Introduced a unified mechanism for reading pool sizes from the configuration file(s). Previously, pool sizes were read from the Context.cpp with fallbacks to profiles, whereas main_config_reloader in Server.cpp read them directly without fallbacks.
2) Corrected the data type for background_merges_mutations_concurrency_ratio. It should be float instead of int.
3) Refactored the default values for settings. Previously, they were defined in multiple places throughout the codebase, but they are now defined in one place (or two, to be exact: Settings.h and ServerSettings.h).
4) Improved documentation, including the correct message in system.settings.

Additionally make the code more conform with #46550.
2023-03-30 16:44:11 +02:00
Alexander Tokmakov
131395b00f
Merge pull request #48171 from aalexfvk/add_option_disable_on_cluster_queries
Add allow_distributed_ddl_queries option to the cluster config
2023-03-30 17:29:02 +03:00
Aleksei Filatov
0ac9dcd723 Add allow_distributed_ddl_queries option to the cluster config 2023-03-29 18:15:46 +03:00
Antonio Andelic
44e95aa65f Merge branch 'master' into nosign-keyword-for-s3 2023-03-29 11:10:03 +00:00
Antonio Andelic
7b1ad221b2 Address PR comments 2023-03-29 11:08:44 +00:00
Robert Schulze
44d0a8075d
Small follow-up to #46252 2023-03-28 21:06:58 +00:00
Robert Schulze
622d1dfadd
Merge pull request #46252 from ClibMouse/feature/hastokencaseinsensitive-index-utilization
Implement tokenbf_v1 index utilization for hasTokenCaseInsensitive
2023-03-28 22:38:21 +02:00
Antonio Andelic
4c61ec2fad update docs 2023-03-28 07:19:08 +00:00
DanRoscigno
6d8a2bbd48 standardize admonitions 2023-03-27 14:54:05 -04:00
Robert Schulze
8cf031ee2e
Docs: Update secondary index example
Fixes: #47923
2023-03-23 22:36:38 +00:00
ltrk2
f46970671d Implement tokenbf_v1 index utilization for hasTokenCaseInsensitive 2023-03-23 12:24:13 -07:00
Robert Schulze
3953d77059
+ on 2023-03-23 10:51:25 +00:00
Robert Schulze
451df6db07
More fixup 2023-03-23 10:50:40 +00:00
Robert Schulze
b3260f2201
Docs: Fixup docs on Map-data-type support in data skipping indexes 2023-03-23 10:24:26 +00:00
Robert Schulze
2b9a73baa8
Docs: Fix wrong bracket nesting for GenerateRandom 2023-03-22 13:58:10 +00:00
Antonio Andelic
a0582a14b9
Merge pull request #47423 from ClickHouse/add-expiration-window-s3
Add expiration window for S3 credentials
2023-03-18 10:11:29 +01:00
rfraposa
ac5ed141d8 New nav - reverting the revert 2023-03-17 21:45:43 -05:00
Alexander Tokmakov
ec44c8293a
Revert "New navigation" 2023-03-17 21:21:11 +03:00
Antonio Andelic
55c07ea16e Update docs 2023-03-10 10:12:01 +00:00
Rich Raposa
de68dade71
Revert "standardize admonitions" 2023-03-09 14:30:40 -07:00
DanRoscigno
95351bc2d3 standardize admonitions 2023-03-09 12:05:26 -05:00
Rich Raposa
f24fad9e26
Merge branch 'master' into new-nav 2023-03-08 14:31:10 -07:00
rfraposa
854cdae311 Link fixes 2023-03-07 17:58:36 -07:00
Rich Raposa
67c16195cc
Merge branch 'master' into new-nav 2023-03-07 14:06:37 -07:00
rfraposa
008845216d Fix broken links 2023-03-07 14:06:14 -07:00
Robert Schulze
ff8fc0634a
Docs: Small cleanups after Kafka fix #47138 2023-03-07 19:50:42 +00:00
Robert Schulze
5b91631722
Merge pull request #47138 from AVMusorin/disallow-default-columns-kafka-engine
Prohibit DEFAULT/EPHEMERAL/ALIAS/MATERIALIZED columns in KafkaEngine
2023-03-07 20:36:46 +01:00
Rich Raposa
cb4f8c85ba
Merge branch 'master' into new-nav 2023-03-04 18:09:56 -07:00
Robert Schulze
11930ad685
Docs: Update index support of has(), hasAny(), hasAll() 2023-03-04 17:27:47 +00:00
rfraposa
5ede8cc69a Broken links 2023-03-04 09:03:04 -07:00
AVMusorin
0f2ae72141
prohibit DEFAULT/EPHEMERAL/ALIAS in KafkaEngine 2023-03-03 16:25:42 +01:00
rfraposa
17a2d7ed45 Fixing broken links 2023-03-01 16:53:17 -07:00
Dan Roscigno
0286b43a73
Fix 404 on approx nearest neighbor page
closes https://github.com/ClickHouse/clickhouse-docs/issues/846
2023-02-28 09:32:06 -05:00
Robert Schulze
cca0bead44
Slighly improved example 2023-02-23 20:07:06 +00:00
Robert Schulze
b3eacf0894
Whitespace for the win 2023-02-23 20:06:24 +00:00
Robert Schulze
6906cafa99
Change to S3 cfg syntax 2023-02-23 20:04:41 +00:00
Robert Schulze
81bf43157f
Allow configuration of Kafka topics with periods
The Kafka table engine allows global configuration and per-Kafka-topic
configuration. The latter uses syntax <kafka_TOPIC>, e.g. for topic
"football":

  <kafka_football>
      <retry_backoff_ms>250</retry_backoff_ms>
      <fetch_min_bytes>100000</fetch_min_bytes>
  </kafka_football>

Some users had to find out the hard way that such configuration doesn't
take effect if the topic name contains a period, e.g. "sports.football".
The reason is that ClickHouse configuration framework already uses
periods as level separators to descend the configuration hierarchy.
(Besides that, per-topic configuration at the same level as global
configuration could be considered ugly.)

Note that Kafka topics may contain characters "a-zA-Z0-9._-" (*) and
a tree-like topic organization using periods is quite common in
practice.

This PR deprecates the existing per-topic configuration syntax (but
continues to support it for backward compat) and introduces a new
per-topic configuration syntax below the global Kafka configuration of
the form:

<kafka>
   <topic name="football">
       <retry_backoff_ms>250</retry_backoff_ms>
       <fetch_min_bytes>100000</fetch_min_bytes>
   </topic>
</kafka>

The period restriction doesn't apply to XML attributes, so <topic
name="sports.football"> will work. Also, everything Kafka-related is
below <kafka>.

Considered but rejected alternatives:
- Extending Poco ConfigurationView with custom separators (e.g."/"
  instead of "."). Won't work easily because ConfigurationView only
  builds a path but defers descending the configuration tree to the
  normal configuration classes.
- Reloading the configuration file in StorageKafka (instead of reading
  the loaded file) but with a custom separator. This mode is supported
  by XML configuration. Too ugly and error-prone since the true
  configuration is composed from multiple configuration files.

(*) https://stackoverflow.com/a/37067544
2023-02-22 20:35:09 +00:00
kssenii
bac464f89b Fix 2023-02-22 14:25:08 +01:00
Kseniia Sumarokova
c242fe3e5e
Update docs/en/engines/table-engines/integrations/hudi.md
Co-authored-by: flynn <fenglv15@mails.ucas.ac.cn>
2023-02-22 12:11:42 +01:00
Kseniia Sumarokova
ef15d64895
Update docs/en/engines/table-engines/integrations/deltalake.md
Co-authored-by: flynn <fenglv15@mails.ucas.ac.cn>
2023-02-22 12:11:23 +01:00
kssenii
21fcc3b69c Add iceberg doc 2023-02-22 12:04:24 +01:00
Alexey Milovidov
17992b178a
Merge pull request #45364 from nickitat/aggr_partitions_independently
Add option to aggregate partitions independently
2023-02-19 17:44:18 +03:00
Nikita Taranov
f70044f34b Merge branch 'master' into aggr_partitions_independently 2023-02-18 13:19:05 +00:00
Denny Crane
f78efe91f6
Update summingmergetree.md 2023-02-17 18:46:30 -04:00
Dan Roscigno
10c8f31811
Update docs/en/engines/table-engines/integrations/embedded-rocksdb.md 2023-02-15 13:29:33 -05:00
Dan Roscigno
0496b55003
Update docs/en/engines/table-engines/integrations/embedded-rocksdb.md 2023-02-15 13:29:26 -05:00
Antonio Andelic
da4389a763 Add docs for KeeperMap 2023-02-15 15:29:11 +01:00
Anton Popov
ccf7b6f4c1
Merge pull request #45582 from mrcrypster/patch-4
DELETE + WHERE in TTL
2023-02-10 14:27:54 +01:00
Ryadh DAHIMENE
82a36f50c9
Adding missing integrations to the list 2023-02-08 15:11:18 +01:00
rfraposa
f3136e3f25 Resolve feedback 2023-02-06 10:48:54 -07:00
rfraposa
8a84a75ab8 Create executable.md 2023-02-05 01:08:52 -06:00
Nikita Taranov
b983b363f8 Merge branch 'master' into aggr_partitions_independently 2023-02-04 18:24:31 +00:00
Kseniia Sumarokova
ef7acb9b66
Merge pull request #44404 from kssenii/storage-rabbitmq-fix-flush
RabbitMQ - fix writing many small blocks by flushing data only exactly by flush_interval_ms or by max_block_size
2023-02-03 11:50:12 +01:00
Robert Schulze
b95ecfaec5
Minor doc fixes for inverted index 2023-02-03 10:01:53 +00:00
rfraposa
6011656008 Update invertedindexes.md 2023-02-01 20:55:58 -07:00
kssenii
bbf060bf89 Fix test 2023-02-01 18:22:05 +01:00
Ilya Yatsishin
8d6df7ed58
Merge pull request #45785 from Algunenano/generate_random_types 2023-01-30 23:03:12 +01:00
Nikita Taranov
581f31ad3d better 2023-01-30 17:11:56 +00:00
Nikita Taranov
d8c191f53b add docs 2023-01-30 17:11:56 +00:00
Raúl Marín
997fad4e8d GenerateRandom: Add support for maps 2023-01-30 15:23:22 +01:00
Roman Heinrich
bcc933098b
Fix broken examples for inverted indexes 2023-01-30 00:12:32 +01:00
Kseniia Sumarokova
7d178e5ee6
Merge pull request #45680 from DanRoscigno/docs-mergetree-s3-cache
doc updates related to s3 cache change
2023-01-27 17:54:31 +01:00
DanRoscigno
a88c222f44 add missing heading 2023-01-27 08:56:25 -05:00
DanRoscigno
80b3b882c3 review from ksenii 2023-01-27 08:48:29 -05:00
DanRoscigno
15b4c712df updates related to s3 cache change 2023-01-26 16:32:39 -05:00
Dan Roscigno
d1a81b2776
Update docs/en/engines/table-engines/mergetree-family/invertedindexes.md 2023-01-26 14:07:13 -05:00
Dan Roscigno
00b5354a93
Update invertedindexes.md 2023-01-26 14:05:26 -05:00
Dan Roscigno
8549af4853
Update docs/en/engines/table-engines/mergetree-family/invertedindexes.md 2023-01-26 10:51:08 -05:00
DanRoscigno
710384e69a remove sidebar position 2023-01-26 10:13:06 -05:00
DanRoscigno
88076b6db0 add keywords 2023-01-26 10:06:06 -05:00
DanRoscigno
c130050572 capitalize sidebar 2023-01-26 09:05:56 -05:00
DanRoscigno
310797d9f0 edits, add frontmatter 2023-01-26 08:58:10 -05:00
DanRoscigno
fe1d99a2d3 add PARTITION BY to file and url docs 2023-01-25 09:18:55 -05:00
DanRoscigno
917e3d4244 add PARTITION BY to s3 and hdfs docs 2023-01-25 09:09:28 -05:00
Robert Schulze
5edea1b461
Docs: mini semicolon fix 2023-01-24 19:25:37 +00:00
Denys Golotiuk
c1de756d8a
DELETE + WHERE in TTL
ClickHouse actually supports only `DELETE` action with `WHERE` clause of a `TTL` statement
2023-01-24 17:50:29 +02:00
Kseniia Sumarokova
dd18dd2953
Merge pull request #45341 from ClibMouse/feature/non-throwing-hastoken
Introduce non-throwing variants of hasToken
2023-01-24 15:37:36 +01:00
ltrk2
9710b8643c Refine the solution 2023-01-23 14:27:48 -08:00
robot-ch-test-poll4
2066581d8f
Merge pull request #45451 from evillique/default_granularity
Add default GRANULARITY argument for secondary indexes
2023-01-20 17:46:21 +01:00
Nikolay Degterinsky
02142596fb Add docs 2023-01-20 15:22:13 +00:00
Robert Schulze
7e6d3163b1
Initial inverted index docs 2023-01-20 12:12:20 +00:00
Robert Schulze
099f50c0e3
Remove redundancy 2023-01-19 18:35:19 +00:00
Robert Schulze
c9988f4411
Mini fix 2023-01-19 17:04:17 +00:00
Robert Schulze
7355e3bc77
Docs: Beautify section on secondary index types 2023-01-19 17:00:31 +00:00
DanRoscigno
5d88a2b344 clarify autodetect 2023-01-18 15:51:31 -05:00
DanRoscigno
cd3ecb9091 add support_batch_delete to mergetree docs 2023-01-18 12:16:31 -05:00
Tanya Bragin
b5773caeb2
Update postgresql.md
Adding related Postgres blog here. 

cc @gingerwizard @DanRoscigno
2023-01-14 14:34:33 -08:00
Dan Roscigno
0ad969171e
Merge pull request #45127 from DanRoscigno/add-deltalake-docs
Add deltalake docs
2023-01-11 08:07:42 -05:00
Dan Roscigno
6e9669cfae
Apply suggestions from code review 2023-01-11 07:53:37 -05:00
Dan Roscigno
02261b0e2a
Update docs/en/engines/table-engines/integrations/hudi.md 2023-01-11 07:42:15 -05:00
Dan Roscigno
73ef2657dd
Update docs/en/engines/table-engines/integrations/hudi.md 2023-01-11 07:40:10 -05:00
Dan Roscigno
21573028ea
Update docs/en/engines/table-engines/integrations/deltalake.md 2023-01-11 07:38:41 -05:00
DanRoscigno
563e0e76f9 init 2023-01-10 16:59:34 -05:00
DanRoscigno
5cf1b1f61d feedback 2023-01-10 16:09:59 -05:00
DanRoscigno
879ee05218 fix case of names 2023-01-10 11:18:33 -05:00
Dan Roscigno
f8a5d5cb18
Merge branch 'ClickHouse:master' into add-deltalake-docs 2023-01-09 15:45:08 -05:00
Ivan Blinkov
61c2f23713 Remove leftover empty lines at the end of markdown files 2023-01-09 15:15:18 +01:00