Commit Graph

215 Commits

Author SHA1 Message Date
Slach
831135432f add PostgreSQL engine and table function documentation
Signed-off-by: Slach <bloodjazman@gmail.com>
2021-03-08 03:39:24 +03:00
romanzhukov
13b4e7dc38 DOCSUP-7086: Fix En version by PR comments. 2021-03-05 17:31:55 +03:00
Anna
62db68e3da fix link 2021-03-05 12:43:51 +03:00
Anna
6e6c0069e2 fixed links 2021-03-05 12:36:05 +03:00
Anna
bb2061dd8f revert some changes 2021-03-05 12:22:15 +03:00
Anna
c9cdde9983 Minor fixed 2021-03-05 12:10:35 +03:00
Anna
7ccbd63e25 minor fixed 2021-03-05 11:59:06 +03:00
Anna
1bceed4984 casting to template 2021-03-05 11:31:16 +03:00
Anna
178134ba23 edit en text 2021-03-05 11:00:49 +03:00
Azat Khuzhin
6965ac26c3 Distributed: Add ability to delay/throttle INSERT until pending data will be reduced
Add two new settings for the Distributed engine:
- bytes_to_delay_insert
- max_delay_to_insert

If at the beginning of INSERT there will be too much pending data, more
then bytes_to_delay_insert, then the INSERT will wait until it will be
shrinked, and not more then max_delay_to_insert seconds.

If after this there will be still too much pending, it will throw an
exception.

Also new profile events were added (by analogy to the MergeTree):
- DistributedDelayedInserts (although you can use system.errors instead
  of this, but still)
- DistributedRejectedInserts
- DistributedDelayedInsertsMilliseconds
2021-03-03 23:30:23 +03:00
Azat Khuzhin
b5a5778589 Distributed: Add ability to limit amount of pending bytes for async INSERT
Right now with distributed_directory_monitor_batch_inserts=1 and
insert_distributed_sync=0 INSERT into Distributed table will store
blocks that should be sent to remote (and in case of
prefer_localhost_replica=0 to the localhost too) on the local
filesystem, and sent it in background.

However there is no limit for this storage, and if the remote is
unavailable (or some other error), these pending blocks may take
significant space, and this is not always desired behaviour.

Add new Distributed setting - bytes_to_throw_insert, that will set the
limit for how much pending bytes is allowed, if the limit will be
reached an exception will be throw.

By default was set to 0, to avoid surprises.
2021-03-03 23:30:00 +03:00
Nikita Mikhaylov
cb2a26308f
Merge pull request #20347 from gyuton/gyuton-DOCSUP-6549-Edit_and_translate
DOCSUP-6549: Edited and translated to Russian
2021-03-01 16:49:06 +03:00
Chao Ma
c2b8612525 Fix error configuration for cluster secret 2021-03-01 16:30:42 +08:00
romanzhukov
77a3b103ad DOCSUP-7086: Add CH update translation. 2021-02-28 23:49:56 +03:00
romanzhukov
20da5e020a DOCSUP-7086: Add s3 translation. 2021-02-28 22:27:22 +03:00
Olga Revyakina
720bef8ae2 Links in index.md files 2021-02-27 04:14:56 +03:00
Olga Revyakina
c11824b156 Dictionary 2021-02-27 03:29:56 +03:00
Olga Revyakina
64322d2212 Table engine and function 2021-02-27 03:01:02 +03:00
Vladimir
9038fb3861
Merge pull request #20540 from lehasm/alexey-sm-DOCSUP-4328-document-xz-compression 2021-02-26 15:44:47 +03:00
lehasm
bb2ee9609f Compression mentioned in File engine 2021-02-23 16:43:40 +03:00
gyuton
0a58fd2eb2
Merge branch 'master' into gyuton-DOCSUP-6549-Edit_and_translate 2021-02-21 15:28:06 +03:00
Kseniia Sumarokova
20ff183549
Merge branch 'master' into rabbit-format-settings 2021-02-17 19:01:53 +03:00
kssenii
d79f7c04f6 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into rabbit-format-settings 2021-02-17 06:03:19 +00:00
kssenii
29362bb483 Support vhost 2021-02-16 22:05:14 +00:00
kssenii
d9f66d8d30 Better doc 2021-02-15 23:25:19 +00:00
kssenii
2a887b9772 Add missing format factory settings 2021-02-15 22:06:10 +00:00
alexey-milovidov
a299790522
Merge pull request #19748 from excitoon-favorites/s3ssec
Added Server Side Encryption Customer Keys support in S3 client
2021-02-15 15:23:14 +03:00
George
838dab7564 Edit and translated Kafka 2021-02-11 21:07:38 +03:00
Nikita Mikhaylov
39c73cb448
Merge pull request #19954 from gyuton/gyuton-DOCSUP-5978-document_max_partitions_to_read
DOCUP-5978: Documented max_partitions_to_read
2021-02-09 15:47:17 +03:00
alesapin
f34bec4be4
Update mongodb.md 2021-02-08 17:30:15 +03:00
alesapin
313d17bf96
Update mongodb.md 2021-02-08 10:10:07 +03:00
Olga Revyakina
f910f00285 Description and link (en, ru) 2021-02-07 17:29:54 +03:00
gyuton
29c01ed9d0
Update docs/en/engines/table-engines/mergetree-family/mergetree.md
Co-authored-by: Anna <42538400+adevyatova@users.noreply.github.com>
2021-02-05 11:41:57 +03:00
Anton Popov
fb02d56534
Merge pull request #19519 from olgarev/revolg-DOCSUP-4962-WHERE_and_GROUP_BY_in_TTL_expressions
DOCSUP-4962: Documented support of WHERE and GROUP BY in TTL expressions
2021-02-02 14:39:45 +03:00
George
e6367de2d9 Added documentation 2021-02-02 05:23:02 +03:00
Olga Revyakina
fb98aeeae1 Fixes 2021-02-02 02:44:40 +03:00
Kruglov Pavel
742b740753
Merge pull request #18490 from damozhaeva/dmozhaeva-DOCSUP-4705-edit-and-translate
DOCSUP-4705 edit and translate
2021-01-29 14:46:42 +03:00
Vladimir Chebotarev
579f8da573 Added SSE-C support in S3 client. 2021-01-28 09:32:41 +03:00
Daria Mozhaeva
f4448ef01e links 2021-01-26 22:24:06 +03:00
vdimir
fc8b8d23b2
Merge pull request #18812 from excitoon-favorites/betters3endpoints
Added prefix-based S3 endpoint settings
2021-01-26 20:47:57 +03:00
Vladimir Chebotarev
68a671f009 Fixed documentation. 2021-01-26 11:33:21 +03:00
Daria Mozhaeva
39c99edfe5 edit eng ver 2021-01-25 17:13:29 +03:00
Vladimir Chebotarev
7a675c996e Added documentation for S3 endpoints. 2021-01-25 09:33:53 +03:00
damozhaeva
9d91855099
Merge branch 'master' into dmozhaeva-DOCSUP-4705-edit-and-translate 2021-01-24 22:47:06 +03:00
Olga Revyakina
135426d3cb Syntax updated, examples added. 2021-01-23 21:16:59 +03:00
Daria Mozhaeva
f13a075797 Fixed notes. 2021-01-22 19:40:58 +03:00
Pavel Kovalenko
6db51965cd Add S3 disk documentation [EN] 2021-01-19 12:03:48 +03:00
sevirov
33cf7351b0
DOCSUP-5169: Document the min_compress_block_size and max_compress_block_size settings (#18248)
Co-authored-by: Alexander Kazakov <Akazz@users.noreply.github.com>
2021-01-10 23:21:32 +03:00
Azat Khuzhin
471deab63a Rename fsync_tmp_directory to fsync_directories for Distributed engine 2021-01-09 17:51:30 +03:00
Mikhail Filimonov
4cabfa356e Update documentation for Distributed fsync settings. 2021-01-09 11:31:32 +03:00
Azat Khuzhin
b5ace27014 Add fsync support for Distributed engine.
Two new settings (by analogy with MergeTree family) has been added:

- `fsync_after_insert` - Do fsync for every inserted. Will decreases
  performance of inserts.

- `fsync_tmp_directory` - Do fsync for temporary directory (that is used
  for async INSERT only) after all part operations (writes, renames,
  etc.).

Refs: #17380 (p1)
2021-01-09 11:31:32 +03:00
alexey-milovidov
e476dcdba7
Update replication.md 2021-01-04 20:58:26 +03:00
Alexander Kuzmenkov
fd08bf3132
Merge pull request #18074 from sevirov/sevirov-DOCSUP-4524-document_execute_merges_on_single_replica_time_threshold_setting
DOCSUP-4524: Document the execute_merges_on_single_replica_time_threshold setting
2020-12-28 15:21:11 +03:00
Daria Mozhaeva
ded199ce27 Edit and translate to Russia 2020-12-23 18:32:35 +03:00
alexey-milovidov
2dce0156f9
Update mergetree.md 2020-12-19 19:56:51 +03:00
Mark Andreev
62157bf92c
Add max_parts_in_total to docs 2020-12-19 17:09:59 +03:00
Dmitriy
5705fa5a34 Update settings.md
Внес поправки в английскую и русскую версии.
2020-12-19 00:08:13 +03:00
Dmitriy
32cbfabfaf Update settings.md
Выполнил перевод на русский язык и внес поправки в английскую версию.
2020-12-18 23:04:51 +03:00
alexey-milovidov
da1fc5d25e
Merge pull request #18218 from Jokser/s3-docs
Add S3 table function / engine documentation [EN]
2020-12-18 22:05:45 +03:00
Pavel Kovalenko
f80e872bbb Update globs in path usage for S3 table function / storage documentation [EN] 2020-12-18 21:45:21 +03:00
alexey-milovidov
49bcb167bc
Update s3.md 2020-12-18 21:02:07 +03:00
alexey-milovidov
d5361525d5
Update s3.md 2020-12-18 20:55:54 +03:00
alexey-milovidov
edba76ebc0
Update s3.md 2020-12-18 20:54:41 +03:00
alexey-milovidov
57d3d641f5
Update s3.md 2020-12-18 20:52:59 +03:00
Pavel Kovalenko
9d75093c28 Fix link in S3 table function / engine documentation [EN] 2020-12-18 15:12:06 +03:00
Pavel Kovalenko
601558c11b Add references to S3 table function / engine in documentation [EN] 2020-12-18 12:50:35 +03:00
Pavel Kovalenko
cd0a0e33bd Add S3 table function / engine documentation [EN] 2020-12-18 12:46:50 +03:00
Ilya Golshtein
9701d6a2d5 style fix per code review, doc improvement, params consistency check 2020-12-16 14:48:33 +03:00
Ilya Golshtein
fc0a1af214 doc minor changes, cleanup, krb5-user as a recommended package 2020-12-16 14:48:33 +03:00
Ilya Golshtein
7e97814859 cleanup, fixes, new submodules, ShellCommand, WriteBufferFromString 2020-12-16 14:48:33 +03:00
Ilya Golshtein
d9166a0645 HADOOP_SECURE_DN_USER way, kinit thread, docker capabilities 2020-12-16 14:48:33 +03:00
Dmitriy
90cc37ae56 Document execute_merges_on_single_replica_time_threshold setting
Задокументировал настройку execute_merges_on_single_replica_time_threshold.
2020-12-14 23:23:29 +03:00
sevirov
c23e376474
DOCSUP-4435: Allow nullable key in MergeTree (#17345)
* Update settings.md and mergetree.md

Задокументировал настройку allow_nullable_key. Добавил пару предложений в mergetree.md.

* Update mergetree.md

Исправляю битую ссылку.

* Update mergetree.md

Вставил ссылку на allow_nullable_key.

* Update mergetree.md

Правлю битую ссылку.

* Update mergetree.md

Исправляю битую ссылку.

* Update settings.md

Правлю битую ссылку.

* Update mergetree.md and settings.md

Выполнил перевод на русский язык и поправил немного английскую версию.

* Update mergetree.md

Убрал выражение 'для семейства mergetree'.

* Update settings.md

Внес поправки в русскую версию.

* Update mergetree.md and settings.md

Сделал поправки в английскую версию на основе комментарий в PR.

Co-authored-by: Dmitriy <sevirov@yandex-team.ru>
2020-12-04 21:17:58 +03:00
Anna Shakhova
4479cfbcb0
DOCSUP-3871: Document prefer_not_to_merge option (#17090)
* Init commit

* Translation

* Fixed

* Fixed

* Fixed

* Fixed
2020-12-02 22:03:24 +03:00
Denny Crane
534cec15b2
Update replacingmergetree.md 2020-11-30 23:06:36 -04:00
alexey-milovidov
13f0521ddd
Update replication.md 2020-11-27 10:40:25 +03:00
alexey-milovidov
dfae1efbbd
Merge pull request #17070 from fastio/master
Support multiple ZooKeeper clusters
2020-11-27 10:38:01 +03:00
alesapin
fe6a64b6f5
Merge pull request #16819 from invis87/patch-1
Update collapsingmergetree.md
2020-11-27 10:27:57 +03:00
Peng Jian
fd0705c93d add doc 2020-11-19 15:44:47 +08:00
yangshuai
e8492a54e0
Update replication.md
Correct spelling
2020-11-17 17:56:29 +08:00
Alexey Milovidov
630aa9b0c3 Rename Rocksdb to RocksDB 2020-11-11 09:08:53 +08:00
alexey-milovidov
75c994ad87 Update embedded-rocksdb.md 2020-11-11 09:08:53 +08:00
sundy-li
a5fc4d69a5 add docs 2020-11-11 09:08:52 +08:00
sundy-li
8cb3ec5aea add docs 2020-11-11 09:08:52 +08:00
Aleksandrov Vladimir
0568daf4fc
Update collapsingmergetree.md
formatting fix
2020-11-09 18:55:41 +03:00
gyuton
0d1fcd2f96
DOCSUP-3227: Documented the persistent setting (#16579)
* added description of disable_set_and_join_persistency setting.

* Changed setting name to persistent, added references about persistent to join table engine and set table engine

* Resolved conflict.

* Added reviewers suggestions

* Added translation for Russian.

* Fixed typos

* Update docs/en/operations/settings/settings.md

Fixed minor stuff.

Co-authored-by: BayoNet <da-daos@yandex.ru>

* Update settings.md

Updated translation.

* Fixed description and translation

* Fixed letter cases

Co-authored-by: George <gyuton@yandex-team.ru>
Co-authored-by: BayoNet <da-daos@yandex.ru>
2020-11-06 14:23:04 +03:00
Denny Crane
771814bb85
Update mergetree.md
bloom does not support like
2020-11-05 11:07:24 -04:00
damozhaeva
6db9ee4300
DOCSUP-3172: Edit and translate to Russian (#16153)
* Edit and traslate to Russian.

* Update docs/ru/engines/table-engines/integrations/kafka.md

Co-authored-by: BayoNet <da-daos@yandex.ru>

* Update docs/ru/interfaces/http.md

Co-authored-by: BayoNet <da-daos@yandex.ru>

* Update docs/ru/interfaces/http.md

Co-authored-by: BayoNet <da-daos@yandex.ru>

* Ticket.

* http.

* kafka ru

Co-authored-by: Daria Mozhaeva <dmozhaeva@yandex-team.ru>
Co-authored-by: BayoNet <da-daos@yandex.ru>
2020-11-02 19:54:23 +03:00
Anna Shakhova
90dcc135b4
DOCSUP-3199: Support default arguments for Replicated engine (#16282)
* Init commit

* Fixed

* Fixed

* Fixed
2020-10-31 23:26:14 +03:00
kssenii
4b59882c30 Remove redundant, add virt col 2020-10-27 20:34:31 +00:00
kssenii
db03cd7dd7 Much more optimal queues setup 2020-10-27 11:00:01 +00:00
Denny Crane
bb8e6af832
Update replication.md
database and table macros
2020-10-17 15:55:39 -03:00
Alexey Milovidov
db4db42b65 Fix broken links in docs 2020-10-13 20:23:29 +03:00
kssenii
5ee01f5575 update docs 2020-10-10 22:59:32 +03:00
Alexander Tokmakov
a7d3a024c7 Revert "Revert "Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka""
This reverts commit c298c633a7.
2020-09-29 11:56:37 +03:00
tavplubix
c298c633a7
Revert "Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka" 2020-09-24 16:10:24 +03:00
Ilya Yatsishin
7dad84ea6b
Merge pull request #14265 from arenadata/ADQM-160
Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka
2020-09-23 19:02:58 +03:00
Ilya Golshtein
2d5c31d588 test_storage_kerberized_kafka cleanup + negative test 2020-09-17 16:51:34 +03:00
Azat Khuzhin
0159c74f21 Secure inter-cluster query execution (with initial_user as current query user) [v3]
Add inter-server cluster secret, it is used for Distributed queries
inside cluster, you can configure in the configuration file:

  <remote_servers>
      <logs>
          <shard>
              <secret>foobar</secret> <!-- empty -- works as before -->
              ...
          </shard>
      </logs>
  </remote_servers>

And this will allow clickhouse to make sure that the query was not
faked, and was issued from the node that knows the secret. And since
trust appeared it can use initial_user for query execution, this will
apply correct *_for_user (since with inter-server secret enabled, the
query will be executed from the same user on the shards as on initator,
unlike "default" user w/o it).

v2: Change user to the initial_user for Distributed queries if secret match
v3: Add Protocol::Cluster package
v4: Drop Protocol::Cluster and use plain Protocol::Hello + user marker
v5: Do not use user from Hello for cluster-secure (superfluous)
2020-09-15 01:36:28 +03:00
alesapin
4364bff3bc
Merge pull request #12761 from kssenii/rabbitmq-improvements
RabbitMQ improvements
2020-09-08 09:38:25 +03:00