Commit Graph

65 Commits

Author SHA1 Message Date
Christoph Wurm
4cc9cecd7c
Document REPLACE PARTITION as atomic 2024-06-06 10:14:38 +01:00
Alexander Tokmakov
c1c7cf56bd
Revert "[feature]: allow to attach parts from a different disk" 2024-04-11 13:43:51 +02:00
Alexey Milovidov
9210712f4f
Merge pull request #60112 from Unalian/feat-59377
[feature]: allow to attach parts from a different disk
2024-03-24 23:12:43 +03:00
Kirill Nikiforov
ebaee8e5f6
Add support for ATTACH PARTITION ALL (#61107) 2024-03-18 15:00:27 -04:00
unashi
c78224c2ff Merge branch 'master' into feat-59377 2024-03-13 11:24:00 +08:00
serxa
69c5fae1bc review fixes 2024-02-21 15:11:50 +00:00
serxa
27371ae4c4 add docs 2024-02-20 19:16:47 +00:00
unashi
28282eee91 [fix] Add description in partition.md 2024-02-20 21:37:09 +08:00
Alexander Tokmakov
77e4b0c8d9 Revert "Merge pull request #59122 from arthurpassos/bring_back_attach_partition_pr"
This reverts commit ac90637170, reversing
changes made to fe2b5cde05.
2024-02-07 02:52:43 +01:00
Arthur Passos
799a94081b Revert "Revert "Allow to attach partition from table with different partition expression when destination partition expression doesn't re-partition""
This reverts commit a1c83e2f51.
2024-01-23 11:40:42 -03:00
Robert Schulze
a1c83e2f51
Revert "Allow to attach partition from table with different partition expression when destination partition expression doesn't re-partition" 2024-01-23 15:26:04 +01:00
Arthur Passos
24b8bbe9fa
Allow to attach partition from table with different partition expression when destination partition expression doesn't re-partition (#39507)
* temp commit

* temp commit

* draft impl for feedback

* fix weird style changes

* fix weird style changes

* fix weird style changes

* fix weird style changes

* fix weird style changes

* aa

* aa

* Add integ tests and remove partition key restriction

* fix small incosistency in partition id

* style fix

* style fix

* style fix

* use existing DataPartStorageBuilder instead of new one

* Refactor part clone to make it more readable and maintainable

* Add MergeTreeDataPartCloner docs

* define ErrorCodes::BAD_ARGUMENTS

* Rebase

* camel case methods

* address some comments

* yet another rebase?

* Move from integ tests to stateless tests

* address more comments

* add finalize on min_max_idx files

* Add sync option to DistinctPartitionExpCloner

* just a temp test

* revert temp change

* Use echoOn to distinguish test queries

* remove comment

* fix build issue during rebase

* atempt to fix build after rebase

* finally fix build

* clear minmaxidx hyperrectangle before loading it

* Fix error on min_max files deletion where it was being assumed that partition expression contained all columns

* get it to the state it was previously

* add missing include

* getting functional?

* refactoring and renaming

* some more refactoring

* extern bad arguments

* try to fix style

* improvements and docs

* remove duplicate includes

* fix crash

* make tests more stable by ordering

* rebase once again..

* fix

* make ci happy?

* fix rebase issues

* docs

* rebase, but prolly needs to be improved

* refactor out from nasty inheritance to static methods

* fix style

* work around optional

* refactor & integrate some changes

* update column_type

* add tests by dencrane

* set utc

* fix ref file

* fix tests

* use MergeTree instead of SummingMergeTree

* mark MergeTreeDataPart::getBlock as const

* address a few comments

* compute module function name size at compile time

* simplify branching in getPartitionAstFieldsCount

* remove column_indexes argument

* merge getBlock with buildBlock

* add some const specifiers

* small adjustments

* remove no longer needed isNull check

* use std::min and max to update global min max idx

* add some assertions

* forward declare some symbols

* fix grammar

* forward decl

* try to fix build..

* remove IFunction forward decl

* Revert "use std::min and max to update global min max idx"

This reverts commit b2fe79dda7.

* Revert "remove no longer needed isNull check"

This reverts commit 129db2610f.

* Revert "Revert "remove no longer needed isNull check""

This reverts commit 9416087dd8.

* Revert "Revert "use std::min and max to update global min max idx""

This reverts commit 20246d4416.

* remove some comments

* partial use of MonotonicityCheckMatcher

* ranges

* remove KeyDescriptionMonotonicityChecker

* remove duplication of applyfunction

* move functions to anonymous namespace

* move functions to cpp

* Relax partition compatibility requirements by accepting subset, add tests from partitioned to unpartitioned

* updte reference file

* Support for partition by a, b, c to partition by a, b

* refactoring part 1

* refactoring part 2, use hyperrectangle, still not complete

* refactoring part 3, build hyperrectangle with intersection of source & destination min max columns

* Support attaching to table with partition expression of multiple expressions

* add tests

* rename method

* remove some code duplication

* draft impl for replicatedmergetree, need to dive deeper

* ship ref file

* fix impl for replicatedmergetree..

* forbid attach empty partition replicatedmergetree

* Add replicated merge tree integration tests

* add test missing files

* fix black

* do not check for monotonicity of empty partition

* add empty tests & fix replicated

* remove no longer needed buildBlockWithMinMaxINdexes

* remove column logic in buildHyperrectangle

* simplify implementation by using existing methods

* further simplify implementation

* move all MergeTreeDataPartClone private methods to .cpp file

* decrease decomposition

* use different namespaces

* reduce code duplication

* fix style

* address a few comments

* add chassert to assert arguments size on MonotonicityCheckVisitor

* remove deleteMinMaxFiles method

* remove useless checks from sanitycheck

* add tests for attach partition (not id)

* Remove sanityCheckASTPartition and bring back conditional getPartitionIDFromQuery

* remove empty block comment

* small fixes

* fix formatting

* add missing include

* remove duplicate iuncludes

* trigger ci

* reduce some code duplication

* use updated partition id on replicatedmergetree

* fix build

* fix build

* small refactor

* do not use insert increment on fetch part

* remove duplicate includes

* add one more integ test

* black

* black

* rely on partition exp instead of partition id on replicated part fetch to decide if it is a different partition exp

* add one more integ test

* add order by clause

* fix black

---------

Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2024-01-22 21:00:04 +01:00
János Benjamin Antal
c911c8daf4
Prevent attaching parts from tables with different projections or indices (#55062)
* Prevent attaching parts from tables with different projections or indices

* Update docs

* Add tests
2023-09-27 15:02:53 -04:00
Denny Crane
94fe224935
Update partition.md 2023-05-18 10:06:59 -03:00
Roman Vasin
632c0eeefc
Add support of temporary tables in FROM part of ATTACH|REPLACE PARTITION FROM (#49436)
* Add temp tables after FROM

* Resolve works fine with temp and non-temp tables

* Add usage of temporary table in  00626_replace_partition_from_table test

* Update documentation

* Add tests for ReplicatedMergeTree

* Move tests into 02731_replace_partition_from_temporary_table
2023-05-10 15:25:12 +03:00
Dan Roscigno
5836f2e66d
Update partition.md
closes
2023-04-26 07:12:23 -04:00
Robert Schulze
c406663442
Docs: Replace annoying three spaces in enumerations by a single space 2023-04-19 15:56:55 +00:00
DanRoscigno
538d9cf598 update link 2022-12-05 08:26:59 -05:00
Nikolay Degterinsky
81971acf35 Fix docs 2022-11-16 02:40:51 +00:00
DanRoscigno
c822c8161f fix nav 2022-11-08 20:21:26 -05:00
DanRoscigno
45c9debeaf update links 2022-11-08 19:17:58 -05:00
Sergei Trifonov
acec447526
Fix anchor links 2022-10-28 12:35:18 +02:00
DanRoscigno
91c3744cfe add backup to S3 endpoint 2022-10-25 21:33:09 -04:00
Robert Schulze
e759a64d38
Docs: Redirect links to misc.md
--> https://clickhouse.com/docs/en/sql-reference/statements/misc

This page indexes a bunch of SQL statements but they are easily
reachable by the sidebar already.
2022-10-07 13:22:40 +00:00
DanRoscigno
c4b8137d31 replace symlinks 2022-08-29 12:19:50 -04:00
DanRoscigno
5b5fcc56aa add slugs 2022-08-28 10:53:34 -04:00
Denny Crane
577978026a
Update partition.md 2022-07-17 21:09:01 -03:00
Denny Crane
f96225cca4
Update partition.md 2022-07-06 20:50:13 -03:00
xinhuitian
ccb4802ab1 fix some wrong links in alter docs 2022-06-25 14:01:41 +08:00
Alexey Milovidov
ff8c52b087
Update partition.md 2022-06-25 06:11:37 +03:00
xinhuitian
3bb765ae1f fix some wrong titles and links in alter docs 2022-06-24 22:24:48 +08:00
rfraposa
869967de41 Remove H1 anchor tags from docs 2022-06-02 04:55:18 -06:00
rfraposa
8f01fe9c49 Revised /en folder 2022-04-09 07:34:21 -06:00
rfraposa
5250d9ad11 Removed /ja folder, cleaned up /ru markdown 2022-04-09 07:29:05 -06:00
Alexey Milovidov
9854b55835
Revert "Format changes for new docs" 2022-04-04 02:05:35 +03:00
rfraposa
560471f991 Update /sql-reference docs 2022-03-29 22:06:21 -06:00
Denny Crane
b391ca512a
Doc. freeze with name 2021-11-07 17:42:56 -04:00
Alexey Milovidov
d87d833691 Remove trailing whitespaces from docs 2021-07-29 18:20:55 +03:00
Slach
b64eb0ff07 add DELETE IN PARTITION and UPDATE IN PARTITION into ALTER syntax TOC
Signed-off-by: Slach <bloodjazman@gmail.com>
2021-06-28 19:21:53 +05:00
adevyatova
4ae1c95e54 minor fix 2021-06-03 12:27:17 +00:00
adevyatova
cdd8a1cc4b minor fix 2021-06-03 11:25:30 +00:00
Anna
b33b4afcba
Merge branch 'master' into annadevyatova-DOCSUP-7864-unfreeze 2021-06-03 14:15:47 +03:00
adevyatova
68b1084355 add en docs 2021-05-30 13:28:21 +00:00
Romain Neutron
7b515c7235
Avoid short syntax 2021-05-27 21:44:11 +02:00
tavplubix
b1081bcf54
Merge pull request #23316 from sevirov/sevirov-DOCSUP-8233-edit_and_translate_replication
DOCSUP-8233: Edit and translate to Russian
2021-04-21 22:47:20 +03:00
Dmitriy
f1aef7e9a2 Edit and translate to Russian
Поправил английскую версию и выполнил перевод на русский язык.
2021-04-19 21:01:38 +03:00
songenjie
f731739fab fix suggests 2021-04-14 10:05:41 +08:00
songenjie
3effb74d31 [clickhouse][server][ddl] add fetch part docs 2021-04-13 09:52:36 +08:00
Mike Kot
831b90f272 Replaced the iteration algorithm in part finder
Now, instead of iterating through the directories, we iterate though
directories of on of the table disks (which doesn't give us a
substantial boost but is a bit neater to read).

- Updated the system.replication_queue command types.
- Fixed the part ptr being empty (added the checksum loading and
initialization).
- Removed extra logging.
2021-03-17 16:55:26 +03:00
Mike Kot
2ccdb7ef5c Multiple small code and test updates
- Updated the docs to make everything clear.
- Multiple small logger fixes.
- Changed the attach_part command -- now it's after check for the
covering parts -- motivation is to do less work with the checksums
fetching.
- Better logging in the integration test.
2021-03-17 16:52:35 +03:00