Commit Graph

32 Commits

Author SHA1 Message Date
Maksim Kita
db1c70975e Compile expressions updated documentation 2021-06-25 23:27:18 +03:00
Mike Kot
4c391f8e99
SYSTEM RESTORE REPLICA replica [ON CLUSTER cluster] (#13652)
* initial commit: add setting and stub

* typo

* added test stub

* fix

* wip merging new integration test and code proto

* adding steps interpreters

* adding firstly proposed solution (moving parts etc)

* added checking zookeeper path existence

* fixing the include

* fixing and sorting includes

* fixing outdated struct

* fix the name

* added ast ptr as level of indirection

* fix ref

* updating the changes

* working on test stub

* fix iterator -> reference

* revert rocksdb submodule update

* fixed show privileges test

* updated the test stub

* replaced rand() with thread_local_rng(), updated the tests

updated the test

fixed test config path

test fix

removed error messages

fixed the test

updated the test

fixed string literal

fixed literal

typo: =

* fixed the empty replica error message

* updated the test and the code with logs

* updated the possible test cases, updated

* added the code/test milestone comments

* updated the test (added more testcases)

* replaced native assert with CH one

* individual replicas recursive delete fix

* updated the AS db.name AST

* two small logging fixes

* manually generated AST fixes

* Updated the test, added the possible algo change

* Some thoughts about optimizing the solution:

ALTER MOVE PARTITION .. TO TABLE -> move to detached/ + ALTER ... ATTACH

* fix

* Removed the replica sync in test as it's invalid

* Some test tweaks

* tmp

* Rewrote the algo by using the executeQuery instead of

hand-crafting the ASTPtr.

Two questions still active.

* tr: logging active parts

* Extracted the parts moving algo into a separate helper function

* Fixed the test data and the queries slightly

* Replaced query to system.parts to direct invocation,

started building the test that breaks on various parts.

* Added the case for tables when at least one replica is alive

* Updated the test to test replicas restoration by detaching/attaching

* Altered the test to check restoration without replica restart

* Added the tables swap in the start if the server failed last time

* Hotfix when only /replicas/replica... path was deleted

* Restore ZK paths while creating a replicated MergeTree table

* Updated the docs, fixed the algo for individual replicas restoration case

* Initial parts table storage fix, tests sync fix

* Reverted individual replica restoration to general algo

* Slightly optimised getDataParts

* Trying another solution with parts detaching

* Rewrote algo without any steps, added ON CLUSTER support

* Attaching parts from other replica on restoration

* Getting part checksums from ZK

* Removed ON CLUSTER, finished working solution

* Multiple small changes after review

* Fixing parallel test

* Supporting rewritten form on cluster

* Test fix

* Moar logging

* Using source replica as checksum provider

* improve test, remove some code from parser

* Trying solution with move to detached + forget

* Moving all parts (not only Committed) to detached

* Edited docs for RESTORE REPLICA

* Re-merging

* minor fixes

Co-authored-by: Alexander Tokmakov <avtokmakov@yandex-team.ru>
2021-06-20 11:24:43 +03:00
Pavel Kruglov
0a70304085 Remove database before model name in docs 2021-06-07 13:10:51 +03:00
Dmitriy
d8271c0705 Translate to Russian
Перевел на русский язык.
2021-06-04 20:38:05 +03:00
Dmitriy
2dc39edc44 Fix the link
Поправил ссылку.
2021-06-03 00:48:14 +03:00
Dmitriy
d675510d7b Add RELOAD MODELS and RELOAD MODEL system queries
Добивал описание системных запросов.
2021-06-02 23:44:51 +03:00
Romain Neutron
7b515c7235
Avoid short syntax 2021-05-27 21:44:11 +02:00
Amir Vaza
24990449f5
Typo 2021-05-26 16:08:53 +03:00
Dmitriy
f1aef7e9a2 Edit and translate to Russian
Поправил английскую версию и выполнил перевод на русский язык.
2021-04-19 21:01:38 +03:00
Denis Krivak
ea563b193c Fix grammar in docs 2021-04-06 10:17:24 +03:00
Mike Kot
406d037ebb Merge remote-tracking branch 'upstream/master' into feature/attach-partition-local 2021-03-15 18:41:47 +03:00
Alexey Milovidov
8c9bd09e6c Remove broken "Original article" 2021-03-14 15:19:04 +03:00
Mike Kot
6ea574525c Small fixes regarding the review 2021-03-03 16:51:41 +03:00
Mike Kot
f088dd445d Extended the test to check both the ALTER PARTITION and PART
Added some notes about the SYSTEM SYNC REPLICA and ALTER ... DROP /
ATTACH.
2021-03-01 20:41:31 +03:00
Dmitriy
629f5f0797 Update replication_queue.md
Выполнил перевод на русский язык, внес изменения в английскую версию.
2020-12-13 18:42:34 +03:00
Anna Shakhova
4479cfbcb0
DOCSUP-3871: Document prefer_not_to_merge option (#17090)
* Init commit

* Translation

* Fixed

* Fixed

* Fixed

* Fixed
2020-12-02 22:03:24 +03:00
Anna
a1b1338281
DOCSUP-2869: Document section user_directories in the main config (#16340)
* DOCSUP-2869: Document section user_directories in the main config

* Update settings.md

* Update

* Commit for DOCSUP-3418

* Update

* Russian translation

* Fix typo
2020-11-13 16:08:38 +03:00
Roman Bug
9ec78855cd
DOCSUP-2806: Add meta header in RU (#15801)
* DOCSUP-2806: Add meta intro.

* DOCSUP-2806: Update meta intro.

* DOCSUP-2806: Fix meta.

* DOCSUP-2806: Add quotes for meta headers.

* DOCSUP-2806: Remove quotes from meta headers.

* DOCSUP-2806: Add meta headers.

* DOCSUP-2806: Fix quotes in meta headers.

* DOCSUP-2806: Update meta headers.

* DOCSUP-2806: Fix link to nowhere in EN.

* DOCSUP-2806: Fix link (settings to tune)

* DOCSUP-2806: Fix links.

* DOCSUP-2806:Fix links EN

* DOCSUP-2806: Fix build errors.

* DOCSUP-2806: Fix meta intro.

* DOCSUP-2806: Fix toc_priority in examples datasets TOC.

* DOCSUP-2806: Fix items order in toc.

* DOCSUP-2806: Fix order in toc.

* DOCSUP-2806: Fix toc order.

* DOCSUP-2806: Fix order in toc.

* DOCSUP-2806: Fix toc index in create

* DOCSUP-2806: Fix toc order in create.

Co-authored-by: romanzhukov <romanzhukov@yandex-team.ru>
Co-authored-by: alexey-milovidov <milovidov@yandex-team.ru>
2020-10-26 13:29:30 +03:00
Alexey Milovidov
db4db42b65 Fix broken links in docs 2020-10-13 20:23:29 +03:00
damozhaeva
e1fcbe749c
Edit and translate to Russian. (#15462)
Co-authored-by: Daria Mozhaeva <dmozhaeva@yandex-team.ru>
2020-10-13 18:29:28 +03:00
Alexander Millin
b7f08f447a
[docs] Fix system.md (#13332)
Co-authored-by: Alexander Millin <a.millin@city-mobil.ru>
2020-08-07 11:48:38 +03:00
Ivan Blinkov
720cd5ca69
Update system.md 2020-07-23 23:02:47 +03:00
BayoNet
52f95e53fb
DOCS-229: insert_distributed_sync (#12579)
* Revolg docsup 727 insert distributed sync setting (#130)

* Add insert_distributed_sync setting

* insert_distributed_sync en doc upd

* Translated to russian.

* Update docs/ru/operations/settings/settings.md

Co-authored-by: BayoNet <da-daos@yandex.ru>

* Added the link to the setting in the russian version.

Co-authored-by: Olga Revyakina <revolg@yandex-team.ru>
Co-authored-by: BayoNet <da-daos@yandex.ru>

* Update settings.md

* Update docs/ru/operations/settings/settings.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
Co-authored-by: Olga Revyakina <revolg@yandex-team.ru>
Co-authored-by: Sergei Shtykov <bayonet@yandex-team.ru>
Co-authored-by: alexey-milovidov <milovidov@yandex-team.ru>
2020-07-21 15:40:03 +03:00
Ivan Blinkov
ceac649c01
[docs] split misc statements (#12403) 2020-07-11 14:05:49 +03:00
Ivan Blinkov
258d2fd499
[docs] split various kinds of CREATE queries into separate articles (#12328)
* normalize

* split & adjust links

* re-normalize

* adjust ru links

* adjust ja/tr links

* partially apply e0d19d2aea

* reset contribs
2020-07-09 18:10:35 +03:00
Alexander Tokmakov
7b5de16da9 minor improvements 2020-06-23 22:15:01 +03:00
amudong
7723dc4935 add drop relica database and the whole replica
fix removeReplicaByZKPath

fix bug: add zkpath empty judge

fix: rewrite code

delete useless code.

fix:ast fromat

fix bug

add test_drop_replica

add drop_replica doc

add drop databse checkAccess

refactor dropReplica

update tests

add static method StorageReplicatedMergeTree::dropReplicaByZkPath

update doc and delete useless code

fix conflict

fix doc

fix doc

fix StorageReplicatedMergeTree::dropReplica

fix bug

delete useless code
2020-06-23 12:12:30 +08:00
amudong
2e6a3eff8e fix: can not drop local table and replace ALTER with SYSTEM
fix test_drop_replica

fix drop replica '/path/to/zk/' ending in '/' and update doc
2020-06-23 12:12:30 +08:00
Ivan Blinkov
7170f3c534
[docs] split aggregate function and system table references (#11742)
* prefer relative links from root

* wip

* split aggregate function reference

* split system tables
2020-06-18 11:24:31 +03:00
Azat Khuzhin
103eb17107 Force table creation on SYSTEM FLUSH LOGS (v2)
After this patch SYSTEM FLUSH LOGS will force system.*_log table
creatoins (only for enabled tables of course).

This will avoid such hacks like:

   set log_queries=1;
   select 1;
   system flush logs;

This is the second version of the patch, since first has a deadlock [1]
(reported by @alesapin). This version does not use separate lock and do
not issue CREATE TABLE from the query execution thread, instead it
activate flushing thread to do so, hence this should be the same as if
the table will be created during flush.

  [1]: https://gist.github.com/alesapin/d915d1deaa27d49aa31223daded02be2

Fixes: #11563
Cc: @alesapin
Cc: @nikitamikhaylov
2020-06-11 23:12:23 +03:00
Eugene Klimov
dfa60e01a0
add SYSTEM STOP/START FETCHES and SYNC REPLICA description (#11444)
* add SYSTEM STOP/START FETCHES and SYNC REPLICA description

Signed-off-by: Slach <bloodjazman@gmail.com>

* fix russian verion

Signed-off-by: Slach <bloodjazman@gmail.com>

* fix typo

Signed-off-by: Slach <bloodjazman@gmail.com>

* add START/STOP REPLICATED SENDS description

Signed-off-by: Slach <bloodjazman@gmail.com>

* Update docs/en/sql-reference/statements/system.md

Co-authored-by: Ivan Blinkov <github@blinkov.ru>

* sync russian and english version

Signed-off-by: Slach <bloodjazman@gmail.com>

* add SYSTEM START/STOP REPLICATION QUEUES

Signed-off-by: Slach <bloodjazman@gmail.com>

* add SYSTEM RESTART REPLICA

Signed-off-by: Slach <bloodjazman@gmail.com>

* add all missed SYSTEM statement descriptions

Signed-off-by: Slach <bloodjazman@gmail.com>

* fix missed link

Signed-off-by: Slach <bloodjazman@gmail.com>

Co-authored-by: Ivan Blinkov <github@blinkov.ru>
2020-06-08 18:23:13 +03:00
Ivan Blinkov
d91c97d15d
[docs] replace underscores with hyphens (#10606)
* Replace underscores with hyphens

* remove temporary code

* fix style check

* fix collapse
2020-04-30 21:19:18 +03:00