Commit Graph

307 Commits

Author SHA1 Message Date
Arthur Passos
24b8bbe9fa
Allow to attach partition from table with different partition expression when destination partition expression doesn't re-partition (#39507)
* temp commit

* temp commit

* draft impl for feedback

* fix weird style changes

* fix weird style changes

* fix weird style changes

* fix weird style changes

* fix weird style changes

* aa

* aa

* Add integ tests and remove partition key restriction

* fix small incosistency in partition id

* style fix

* style fix

* style fix

* use existing DataPartStorageBuilder instead of new one

* Refactor part clone to make it more readable and maintainable

* Add MergeTreeDataPartCloner docs

* define ErrorCodes::BAD_ARGUMENTS

* Rebase

* camel case methods

* address some comments

* yet another rebase?

* Move from integ tests to stateless tests

* address more comments

* add finalize on min_max_idx files

* Add sync option to DistinctPartitionExpCloner

* just a temp test

* revert temp change

* Use echoOn to distinguish test queries

* remove comment

* fix build issue during rebase

* atempt to fix build after rebase

* finally fix build

* clear minmaxidx hyperrectangle before loading it

* Fix error on min_max files deletion where it was being assumed that partition expression contained all columns

* get it to the state it was previously

* add missing include

* getting functional?

* refactoring and renaming

* some more refactoring

* extern bad arguments

* try to fix style

* improvements and docs

* remove duplicate includes

* fix crash

* make tests more stable by ordering

* rebase once again..

* fix

* make ci happy?

* fix rebase issues

* docs

* rebase, but prolly needs to be improved

* refactor out from nasty inheritance to static methods

* fix style

* work around optional

* refactor & integrate some changes

* update column_type

* add tests by dencrane

* set utc

* fix ref file

* fix tests

* use MergeTree instead of SummingMergeTree

* mark MergeTreeDataPart::getBlock as const

* address a few comments

* compute module function name size at compile time

* simplify branching in getPartitionAstFieldsCount

* remove column_indexes argument

* merge getBlock with buildBlock

* add some const specifiers

* small adjustments

* remove no longer needed isNull check

* use std::min and max to update global min max idx

* add some assertions

* forward declare some symbols

* fix grammar

* forward decl

* try to fix build..

* remove IFunction forward decl

* Revert "use std::min and max to update global min max idx"

This reverts commit b2fe79dda7.

* Revert "remove no longer needed isNull check"

This reverts commit 129db2610f.

* Revert "Revert "remove no longer needed isNull check""

This reverts commit 9416087dd8.

* Revert "Revert "use std::min and max to update global min max idx""

This reverts commit 20246d4416.

* remove some comments

* partial use of MonotonicityCheckMatcher

* ranges

* remove KeyDescriptionMonotonicityChecker

* remove duplication of applyfunction

* move functions to anonymous namespace

* move functions to cpp

* Relax partition compatibility requirements by accepting subset, add tests from partitioned to unpartitioned

* updte reference file

* Support for partition by a, b, c to partition by a, b

* refactoring part 1

* refactoring part 2, use hyperrectangle, still not complete

* refactoring part 3, build hyperrectangle with intersection of source & destination min max columns

* Support attaching to table with partition expression of multiple expressions

* add tests

* rename method

* remove some code duplication

* draft impl for replicatedmergetree, need to dive deeper

* ship ref file

* fix impl for replicatedmergetree..

* forbid attach empty partition replicatedmergetree

* Add replicated merge tree integration tests

* add test missing files

* fix black

* do not check for monotonicity of empty partition

* add empty tests & fix replicated

* remove no longer needed buildBlockWithMinMaxINdexes

* remove column logic in buildHyperrectangle

* simplify implementation by using existing methods

* further simplify implementation

* move all MergeTreeDataPartClone private methods to .cpp file

* decrease decomposition

* use different namespaces

* reduce code duplication

* fix style

* address a few comments

* add chassert to assert arguments size on MonotonicityCheckVisitor

* remove deleteMinMaxFiles method

* remove useless checks from sanitycheck

* add tests for attach partition (not id)

* Remove sanityCheckASTPartition and bring back conditional getPartitionIDFromQuery

* remove empty block comment

* small fixes

* fix formatting

* add missing include

* remove duplicate iuncludes

* trigger ci

* reduce some code duplication

* use updated partition id on replicatedmergetree

* fix build

* fix build

* small refactor

* do not use insert increment on fetch part

* remove duplicate includes

* add one more integ test

* black

* black

* rely on partition exp instead of partition id on replicated part fetch to decide if it is a different partition exp

* add one more integ test

* add order by clause

* fix black

---------

Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2024-01-22 21:00:04 +01:00
Robert Schulze
1bfeee1954
Some fixups 2024-01-18 20:49:50 +00:00
Duc Canh Le
b16a4cf361 add document
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2024-01-18 07:55:44 +00:00
Michael Kolupaev
8b8ef41407 Documentation 2023-12-28 17:56:05 +00:00
Alexander Tokmakov
38fe70c68a
Revert "Refreshable materialized views (takeover)" 2023-12-28 13:12:20 +01:00
Michael Kolupaev
7786b12a89 Documentation 2023-12-27 20:24:55 +00:00
Anton Popov
1960713176 add docs 2023-12-13 17:29:34 +00:00
Sergey Kviatkevich
b76bedb53a update docs 2023-11-30 21:42:13 +03:00
Han Fei
7bd2ea3add Merge branch 'master' into hanfei/statistic 2023-11-27 23:31:23 +01:00
Salvatore Mesoraca
7d206cbc3c
NamedCollections: prevent fields overriding in functions call
Add syntax in SQL and XML to mark specific fields to allow
override or not.
Also add a new setting to control the default behaviour when
overriding support is not specified.
2023-11-09 17:25:16 +01:00
Han Fei
fcb19b4f77 Merge branch 'master' into hanfei/statistic 2023-10-09 14:24:58 +02:00
János Benjamin Antal
c911c8daf4
Prevent attaching parts from tables with different projections or indices (#55062)
* Prevent attaching parts from tables with different projections or indices

* Update docs

* Add tests
2023-09-27 15:02:53 -04:00
Han Fei
76b9d43dc4 make code beautiful 2023-09-27 11:01:53 +02:00
Han Fei
6c4474d3d1 refine code structure 2023-09-26 22:22:11 +02:00
Nikolay Degterinsky
0998b0bbc7 Fixes 2023-09-13 03:14:02 +00:00
Alexey Milovidov
ce8ab5c9dd
Update comment.md 2023-09-07 07:30:46 +03:00
Alexander Sapin
518d4b4357 Merge branch 'master' into alter-table-add-comment 2023-09-06 12:34:04 +02:00
pufit
2469cbbf67
Update projection.md 2023-09-05 08:28:58 -04:00
Илья Коргун
e511072df1 Update named collections related docs 2023-07-27 09:42:38 +03:00
Julian Maicher
b91852de3a fix(docs): Document correct MODIFY COLUMN REMOVE syntax 2023-07-25 16:07:29 +02:00
Konstantin Ilchenko
3b954a2952
[DOCS] Add REMOVE SAMPLE BY to docs 2023-07-09 14:38:16 +02:00
Alexey Milovidov
630e2e7907 Add documentation 2023-06-23 03:22:21 +02:00
Dan Roscigno
513b28b451
Update docs/en/sql-reference/statements/alter/skipping-index.md 2023-06-20 13:49:16 -04:00
Denny Crane
ef65367ff0
Update projection.md 2023-06-20 13:59:18 -03:00
Denny Crane
2cca74df68
Update skipping-index.md 2023-06-20 13:56:34 -03:00
Denny Crane
fe8fbde909
Update index.md 2023-06-20 13:46:55 -03:00
Denny Crane
9e324b4eba
Update skipping-index.md 2023-06-20 13:41:11 -03:00
Denny Crane
a39088c99a
Update column.md 2023-06-20 13:35:45 -03:00
YalalovSM
094d661701
Update projection.md
Document using keywords IF EXISTS/IF NOT EXISTS with projections
2023-06-09 09:26:00 +05:00
Robert Schulze
4050b637f1
ALTER TABLE ADD INDEX: Add default GRANULARITY argument for secondary indexes
- Related to #45451, which provides a default GRANULARITY when the
  skipping index is created in CREATE TABLE.
2023-06-07 09:04:24 +00:00
Robert Schulze
65cc92a78d
CI: Fix aspell on nested docs 2023-06-02 12:24:41 +00:00
Denny Crane
94fe224935
Update partition.md 2023-05-18 10:06:59 -03:00
Yakko Majuri
eb6cbe63ee
Minor correction to example in COMMENT COLUMN 2023-05-12 11:54:53 -03:00
Roman Vasin
632c0eeefc
Add support of temporary tables in FROM part of ATTACH|REPLACE PARTITION FROM (#49436)
* Add temp tables after FROM

* Resolve works fine with temp and non-temp tables

* Add usage of temporary table in  00626_replace_partition_from_table test

* Update documentation

* Add tests for ReplicatedMergeTree

* Move tests into 02731_replace_partition_from_temporary_table
2023-05-10 15:25:12 +03:00
Dan Roscigno
5836f2e66d
Update partition.md
closes
2023-04-26 07:12:23 -04:00
Robert Schulze
c406663442
Docs: Replace annoying three spaces in enumerations by a single space 2023-04-19 15:56:55 +00:00
Dale Mcdiarmid
d50c6a9e1b update blog references 2023-04-10 15:23:00 +01:00
DanRoscigno
6d8a2bbd48 standardize admonitions 2023-03-27 14:54:05 -04:00
Tyler Hannan
2981890ab4
Fix Sample... 2023-03-27 12:03:47 +02:00
Denny Crane
64e8d9d4d7
Update view.md 2023-03-19 14:10:18 -03:00
Denny Crane
35d2fb48de
Update view.md 2023-03-19 14:09:12 -03:00
Denny Crane
4629911e6e
Update view.md 2023-03-19 14:05:39 -03:00
Denny Crane
749daca64b
Update view.md 2023-03-19 14:01:47 -03:00
rfraposa
ac5ed141d8 New nav - reverting the revert 2023-03-17 21:45:43 -05:00
Alexander Tokmakov
ec44c8293a
Revert "New navigation" 2023-03-17 21:21:11 +03:00
Rich Raposa
ecf6f28c77
Merge branch 'master' into new-nav 2023-03-16 09:01:46 -06:00
Denny Crane
8a802b7fc9
Update comment.md 2023-03-16 11:04:15 -03:00
rfraposa
591b905fe0 Fix links 2023-03-09 23:32:25 -07:00
Rich Raposa
de68dade71
Revert "standardize admonitions" 2023-03-09 14:30:40 -07:00
DanRoscigno
95351bc2d3 standardize admonitions 2023-03-09 12:05:26 -05:00
Antonio Andelic
a58653820e Update docs 2023-02-03 18:19:12 +00:00
Dan Roscigno
2f64ba187f
Update docs/en/sql-reference/statements/alter/ttl.md 2023-01-31 14:55:13 -05:00
rfraposa
8d0908cb0f Update ttl.md 2023-01-31 11:43:09 -07:00
Diego Nieto
836e14e52b
Update skipping-index.md
Deleted the confusing comment and added implemented as a mutation, like MATERIALIZE INDEX.
2023-01-26 17:23:39 +01:00
Diego Nieto
c4266588c6
Merge branch 'master' into patch-1 2023-01-23 20:50:37 +01:00
Denny Crane
531ad1661e
Update column.md 2023-01-23 09:57:42 -04:00
Denny Crane
4d9be1ef4f
Update column.md 2023-01-23 09:57:04 -04:00
Denny Crane
2bf59fd48c
Update column.md 2023-01-23 09:55:30 -04:00
Diego Nieto
a2b342bcbe
Update skipping-index.md
ADD and DROP are not such lightweight command they generate mutations to deal with the changes and they will take time to complete depending on how much data the table has.
2023-01-20 12:32:50 +01:00
Ivan Blinkov
61c2f23713 Remove leftover empty lines at the end of markdown files 2023-01-09 15:15:18 +01:00
vahid-sohrabloo
8594274e99
fix docs 2022-12-07 22:50:27 +01:00
DanRoscigno
538d9cf598 update link 2022-12-05 08:26:59 -05:00
Dan Roscigno
02a0d4f2e5
Update docs/en/sql-reference/statements/alter/projection.md 2022-11-23 10:39:10 -05:00
Camilo Sierra
d527ca5d9d
adding one link and note about disk usage
I have found a great page that explain more in deep the Projections, and with images explain how they work behind the scenes.
I have also added a note as it's true we do not mention that creating projections will increase the disk usage.
2022-11-17 15:41:47 +01:00
Nikolay Degterinsky
81971acf35 Fix docs 2022-11-16 02:40:51 +00:00
DanRoscigno
7e08798fa8 edits 2022-11-15 13:47:50 -05:00
Camilo Sierra
2a48fb344d
Added examples and extra info to projections
I have added two examples about how we can use projections
2022-11-15 19:22:46 +01:00
DanRoscigno
c822c8161f fix nav 2022-11-08 20:21:26 -05:00
DanRoscigno
45c9debeaf update links 2022-11-08 19:17:58 -05:00
DanRoscigno
d225366335 update links 2022-11-08 18:04:22 -05:00
DanRoscigno
090b153b1e a dir named index with index.md broke nav 2022-11-08 17:37:20 -05:00
Vitaly Baranov
ab8feb5bff
Merge pull request #42782 from mdonkers/session-log-support-sslcertificate-auth
Add SSL_CERTIFICATE auth method to all places missing
2022-11-07 16:36:42 +01:00
Dan Roscigno
4c77987bf8
Update projection.md
Experiment with Algolia search
2022-11-02 10:41:55 -04:00
Vitaly Baranov
9d46547daa
Merge branch 'master' into session-log-support-sslcertificate-auth 2022-11-01 08:32:09 +01:00
Sergei Trifonov
b677e68c4e
Update column.md 2022-10-31 12:46:14 +01:00
Sergei Trifonov
9066e0c3da
Merge pull request #42760 from ClickHouse/serxa-patch-2
Fix anchor links
2022-10-31 12:38:48 +01:00
Miel Donkers
fb1623a5f8 Add SSL_CERTIFICATE auth method to all places missing 2022-10-28 21:17:59 +02:00
Denny Crane
7fa71d8c04
Update column.md 2022-10-28 16:04:00 -03:00
Denny Crane
e903efda0a
Update column.md 2022-10-28 16:00:37 -03:00
Sergei Trifonov
acec447526
Fix anchor links 2022-10-28 12:35:18 +02:00
DanRoscigno
91c3744cfe add backup to S3 endpoint 2022-10-25 21:33:09 -04:00
Robert Schulze
e759a64d38
Docs: Redirect links to misc.md
--> https://clickhouse.com/docs/en/sql-reference/statements/misc

This page indexes a bunch of SQL statements but they are easily
reachable by the sidebar already.
2022-10-07 13:22:40 +00:00
Sergei Trifonov
fe88a7991d
Merge branch 'master' into readonly-settings-allow 2022-09-12 16:20:40 +02:00
rfraposa
4af246a2e0 Feedback 2022-09-09 13:59:21 -06:00
Sergei Trifonov
76eb001e78 add test for changeable_in_readonly + fix SQL in docs 2022-09-09 14:01:29 +02:00
rfraposa
18f5b5e5b0 Add docs for lightweight deletes 2022-09-08 16:05:56 -06:00
Denny Crane
e3af5a7a11
Doc. Added ON CLUSTER cluster in couple places (#40874) 2022-09-01 13:31:22 +02:00
DanRoscigno
c4b8137d31 replace symlinks 2022-08-29 12:19:50 -04:00
DanRoscigno
5b5fcc56aa add slugs 2022-08-28 10:53:34 -04:00
Nityananda Gohain
0b82fb7816
Extra semicolon removed from the TTL example
This PR removes an extra semicolon from the TTL example.
2022-08-03 12:52:06 +05:30
Denny Crane
577978026a
Update partition.md 2022-07-17 21:09:01 -03:00
Denny Crane
db357f4a3c
Update index.md 2022-07-06 20:57:49 -03:00
Denny Crane
71c4e738d0
Update update.md 2022-07-06 20:55:06 -03:00
Denny Crane
f96225cca4
Update partition.md 2022-07-06 20:50:13 -03:00
xinhuitian
ccb4802ab1 fix some wrong links in alter docs 2022-06-25 14:01:41 +08:00
Alexey Milovidov
ff8c52b087
Update partition.md 2022-06-25 06:11:37 +03:00
xinhuitian
3bb765ae1f fix some wrong titles and links in alter docs 2022-06-24 22:24:48 +08:00
rfraposa
869967de41 Remove H1 anchor tags from docs 2022-06-02 04:55:18 -06:00
Ramazan Polat
72a2a1d8fe
update materialize index notation 2022-05-16 00:28:49 +03:00
rfraposa
8f01fe9c49 Revised /en folder 2022-04-09 07:34:21 -06:00