Commit Graph

4961 Commits

Author SHA1 Message Date
Arthur Passos
799a94081b Revert "Revert "Allow to attach partition from table with different partition expression when destination partition expression doesn't re-partition""
This reverts commit a1c83e2f51.
2024-01-23 11:40:42 -03:00
Robert Schulze
a1c83e2f51
Revert "Allow to attach partition from table with different partition expression when destination partition expression doesn't re-partition" 2024-01-23 15:26:04 +01:00
Robert Schulze
e67076ea2b
Merge pull request #55201 from canhld94/column_level_compress_block
Column-level compression block sizes
2024-01-23 11:22:03 +01:00
Robert Schulze
5a420cd9b1
Update docs 2024-01-23 06:18:07 +00:00
Bhavna Jindal
d9edd5a7f3 fix spell check 2024-01-22 13:32:57 -08:00
Bhavna Jindal
f935493f28 fix trailing whitespaces 2024-01-22 13:32:57 -08:00
Bhavna Jindal
c59f3e164f Return baseline component as fourth array 2024-01-22 13:32:57 -08:00
Arthur Passos
24b8bbe9fa
Allow to attach partition from table with different partition expression when destination partition expression doesn't re-partition (#39507)
* temp commit

* temp commit

* draft impl for feedback

* fix weird style changes

* fix weird style changes

* fix weird style changes

* fix weird style changes

* fix weird style changes

* aa

* aa

* Add integ tests and remove partition key restriction

* fix small incosistency in partition id

* style fix

* style fix

* style fix

* use existing DataPartStorageBuilder instead of new one

* Refactor part clone to make it more readable and maintainable

* Add MergeTreeDataPartCloner docs

* define ErrorCodes::BAD_ARGUMENTS

* Rebase

* camel case methods

* address some comments

* yet another rebase?

* Move from integ tests to stateless tests

* address more comments

* add finalize on min_max_idx files

* Add sync option to DistinctPartitionExpCloner

* just a temp test

* revert temp change

* Use echoOn to distinguish test queries

* remove comment

* fix build issue during rebase

* atempt to fix build after rebase

* finally fix build

* clear minmaxidx hyperrectangle before loading it

* Fix error on min_max files deletion where it was being assumed that partition expression contained all columns

* get it to the state it was previously

* add missing include

* getting functional?

* refactoring and renaming

* some more refactoring

* extern bad arguments

* try to fix style

* improvements and docs

* remove duplicate includes

* fix crash

* make tests more stable by ordering

* rebase once again..

* fix

* make ci happy?

* fix rebase issues

* docs

* rebase, but prolly needs to be improved

* refactor out from nasty inheritance to static methods

* fix style

* work around optional

* refactor & integrate some changes

* update column_type

* add tests by dencrane

* set utc

* fix ref file

* fix tests

* use MergeTree instead of SummingMergeTree

* mark MergeTreeDataPart::getBlock as const

* address a few comments

* compute module function name size at compile time

* simplify branching in getPartitionAstFieldsCount

* remove column_indexes argument

* merge getBlock with buildBlock

* add some const specifiers

* small adjustments

* remove no longer needed isNull check

* use std::min and max to update global min max idx

* add some assertions

* forward declare some symbols

* fix grammar

* forward decl

* try to fix build..

* remove IFunction forward decl

* Revert "use std::min and max to update global min max idx"

This reverts commit b2fe79dda7.

* Revert "remove no longer needed isNull check"

This reverts commit 129db2610f.

* Revert "Revert "remove no longer needed isNull check""

This reverts commit 9416087dd8.

* Revert "Revert "use std::min and max to update global min max idx""

This reverts commit 20246d4416.

* remove some comments

* partial use of MonotonicityCheckMatcher

* ranges

* remove KeyDescriptionMonotonicityChecker

* remove duplication of applyfunction

* move functions to anonymous namespace

* move functions to cpp

* Relax partition compatibility requirements by accepting subset, add tests from partitioned to unpartitioned

* updte reference file

* Support for partition by a, b, c to partition by a, b

* refactoring part 1

* refactoring part 2, use hyperrectangle, still not complete

* refactoring part 3, build hyperrectangle with intersection of source & destination min max columns

* Support attaching to table with partition expression of multiple expressions

* add tests

* rename method

* remove some code duplication

* draft impl for replicatedmergetree, need to dive deeper

* ship ref file

* fix impl for replicatedmergetree..

* forbid attach empty partition replicatedmergetree

* Add replicated merge tree integration tests

* add test missing files

* fix black

* do not check for monotonicity of empty partition

* add empty tests & fix replicated

* remove no longer needed buildBlockWithMinMaxINdexes

* remove column logic in buildHyperrectangle

* simplify implementation by using existing methods

* further simplify implementation

* move all MergeTreeDataPartClone private methods to .cpp file

* decrease decomposition

* use different namespaces

* reduce code duplication

* fix style

* address a few comments

* add chassert to assert arguments size on MonotonicityCheckVisitor

* remove deleteMinMaxFiles method

* remove useless checks from sanitycheck

* add tests for attach partition (not id)

* Remove sanityCheckASTPartition and bring back conditional getPartitionIDFromQuery

* remove empty block comment

* small fixes

* fix formatting

* add missing include

* remove duplicate iuncludes

* trigger ci

* reduce some code duplication

* use updated partition id on replicatedmergetree

* fix build

* fix build

* small refactor

* do not use insert increment on fetch part

* remove duplicate includes

* add one more integ test

* black

* black

* rely on partition exp instead of partition id on replicated part fetch to decide if it is a different partition exp

* add one more integ test

* add order by clause

* fix black

---------

Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2024-01-22 21:00:04 +01:00
Kruglov Pavel
0829de8928
Merge pull request #57599 from Khatskevich/khatskevich/fix_docs
Improve named collections documentation
2024-01-22 12:54:57 +01:00
Kruglov Pavel
20379d34d5
Merge branch 'master' into variant-data-type 2024-01-19 23:17:42 +01:00
filimonov
7635da91a8
Update rename.md
Remove wrong note. RENAME is supported by most of database engines (including old Ordinary).
2024-01-19 21:55:41 +01:00
Lino Uruñuela
4a6c2d21ff
Update executable.md - Fix script name in SQL example
It uses 'generate_random.py' in 'The following Python script is named generate_random.py and is saved in the user_scripts folder....'

However, in the SQL example, it uses 'my_script.py'.

'SELECT * FROM executable('generate_random.py', TabSeparated, 'id UInt32, random String', (SELECT 10))'
2024-01-19 12:17:22 +01:00
Robert Schulze
1bfeee1954
Some fixups 2024-01-18 20:49:50 +00:00
Robert Schulze
15700592f7
Merge remote-tracking branch 'ClickHouse/master' into column_level_compress_block 2024-01-18 19:12:57 +00:00
Kruglov Pavel
5444cde408
Merge branch 'master' into variant-data-type 2024-01-18 18:31:27 +01:00
Robert Schulze
316669b90f
Merge pull request #58396 from zenmiao7/u/zhengmiao/AddArrayFunctionShingles
Add function `arrayShingles()`
2024-01-18 11:38:56 +01:00
Duc Canh Le
b16a4cf361 add document
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2024-01-18 07:55:44 +00:00
Srikanth Chekuri
c23c7e0b6f
feat: add DDSketch quantile (#56342)
* feat: add DDSketch quantile

* Fix StyleCheck

* Move quantileddsketch.md under right dir

* Update stateless test number and add stateful test

* Throw exception when relative accuracy is too low

* Update test number

* Fix undefined behaviour for empty store

* Fix quantileGK test

* Update test numbers

* Update src/AggregateFunctions/

* Throw exception on out of range values

* Update relative accuracy docs and add encoding details

* Address review comments and suggestions

* Remove unused function

* Address alexey review comments

* Remove unused function isFloat64FieldType

* Throw error on invalid relative accuracy

* Simplify mapping

* Address remaining review comments

* Add effective memory usage suggestions

* Fix Stylecheck

* Fix fast test

* Incorporate bins capacity suggestion

* Fix fuzzer

* Remove inheritance in Mapping, Store and DDSketch

* Add checks for bin resizing

* Add note about the binary compatible implementation
2024-01-17 19:51:32 -08:00
Yarik Briukhovetskyi
8dce581ae7
update ci 2024-01-17 14:14:15 +01:00
Yarik Briukhovetskyi
9fbe2296db
Update docs/en/sql-reference/table-functions/executable.md 2024-01-17 13:04:17 +01:00
Robert Schulze
84ab20ff77
Some fixups 2024-01-17 12:01:52 +00:00
Robert Schulze
22534c69c4
Merge remote-tracking branch 'ClickHouse/master' into u/zhengmiao/AddArrayFunctionShingles 2024-01-17 10:49:11 +00:00
avinzhang
74f2864f20
Update executable.md
Adding the sentence on the requirement to run the script.
2024-01-17 17:42:59 +10:00
Alexander Tokmakov
5128607995
Merge pull request #58393 from jaymebrd/feat/add-from-modifier-sync-replica-lightweight
add `from srcreplicas` modifier  for `SYSTEM SYNC REPLICA LIGHTWEIGHT`
2024-01-14 20:53:16 +01:00
robot-ch-test-poll4
4c5884b1d9
Merge pull request #58701 from ClickHouse/docs/assume-contraint
Adds documentation for `ASSUME CONSTRAINT`
2024-01-11 17:04:48 +01:00
robot-clickhouse-ci-1
5c47a4fa91
Merge pull request #58666 from ClickHouse/docs/data-faster-than-datetime
Explains that date is generally faster than datetime.
2024-01-11 10:17:54 +01:00
Kseniia Sumarokova
e74f8e9095
Update docs/en/sql-reference/data-types/datetime.md 2024-01-11 09:50:48 +01:00
robot-ch-test-poll
498894a15c
Merge pull request #58700 from ClickHouse/docs/arrayjoin-short-circuit-function-eval-no-no
Adds info about not using `arrayJoin` with `short_circuit_function_evaluation`.
2024-01-11 02:22:11 +01:00
johnnymatthews
2bfe7a2cab Adds docs for ASSUME CONSTRAINT. 2024-01-10 21:13:21 -04:00
johnnymatthews
826a39b732 Adds arrayJoin exception. Prettifies file. Fixes spelling. 2024-01-10 20:43:19 -04:00
johnnymatthews
b276694ac2 Adds ALL qualifier to JOIN. 2024-01-10 13:17:04 -04:00
johnnymatthews
4723a9c082 Explains that date is generally faster than datetime. 2024-01-10 11:50:02 -04:00
Robert Schulze
582a9cc2a7
Merge pull request #58655 from rschu1ze/docs-match
Document that `match()` can use `ngrambf_v1` and `tokenbf_v1` indexes
2024-01-10 15:43:52 +01:00
vdimir
263c6e9c95
Merge pull request #58608 from yariks5s/remove_order_by_requirement_paste_join
Remove order by requierement in PASTE JOIN
2024-01-10 15:18:18 +01:00
Robert Schulze
27e809a4f5
Add match() to supported functions for token/ngrambf_v1 indexes 2024-01-10 13:39:19 +00:00
Robert Schulze
92692bc57c
Fix links 2024-01-10 13:36:54 +00:00
Robert Schulze
a0128e0f51
Merge pull request #58544 from rschu1ze/sqid-decode
Add `sqidDecode()` function
2024-01-10 13:47:13 +01:00
Robert Schulze
4cacfa6b43
Merge pull request #57509 from jinjunzh/qatzstd_main
Add Intel-QAT-based `ZSTD_QAT` compression codec
2024-01-10 10:31:39 +01:00
Robert Schulze
ced9e93ac6
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main 2024-01-09 20:36:02 +00:00
Yarik Briukhovetskyi
aef24c0621
Merge branch 'ClickHouse:master' into remove_order_by_requirement_paste_join 2024-01-09 17:03:54 +01:00
Robert Schulze
69ba1a706a
Merge remote-tracking branch 'rschu1ze/master' into string-similarity 2024-01-09 15:22:52 +00:00
Yarik Briukhovetskyi
c8f97e877f
fix typo 2024-01-09 13:31:15 +01:00
yariks5s
dc4cb2fa0e add docs 2024-01-09 11:46:54 +00:00
Robert Schulze
64ab30f446
Merge pull request #57078 from ClibMouse/seriesDecompose
Seasonal decompose of time series into seasonal, trend and residue components
2024-01-09 11:18:13 +01:00
Bhavna Jindal
b2434d0c10 minor refactoring and cosmetic changes 2024-01-08 10:49:09 -08:00
Kruglov Pavel
b947609b8e
Merge branch 'master' into variant-data-type 2024-01-08 15:04:51 +01:00
Jayme Bird
f7173004cc update docs 2024-01-08 12:40:05 +00:00
Robert Schulze
0f51e32bb5
Rename from ZSTDQPL to ZSTD_QPL 2024-01-07 17:47:31 +00:00
Robert Schulze
53965bb9f1
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main 2024-01-07 14:11:22 +00:00
Robert Schulze
ee0738e3df
Implement jaroSimilarity + jaroWinklerSimilarity 2024-01-07 08:34:41 +00:00
Robert Schulze
7d98fdede7
Implement Dramerau-Levenshtein distance 2024-01-07 08:34:41 +00:00
Robert Schulze
d54e500832
Merge remote-tracking branch 'rschu1ze/master' into punycode-revert-revert 2024-01-07 08:08:46 +00:00
Robert Schulze
adebc372d7
Improve wording in docs 2024-01-07 08:07:03 +00:00
Robert Schulze
44b9547fba
Rename decode/encodeSqid() to sqidDecode/Encode() 2024-01-05 21:40:35 +00:00
Bhavna Jindal
22474f6b38 changed 2nd argument type to UInt and other cosmetic changes 2024-01-05 11:39:52 -08:00
Robert Schulze
f6ecf2b617
Add decode function for sqids 2024-01-05 13:33:40 +00:00
Robert Schulze
8169b3e17f
Merge remote-tracking branch 'rschu1ze/master' into punycode-revert-revert 2024-01-05 12:19:46 +00:00
Robert Schulze
2cc2a9089c
Incorporate review feedback 2024-01-05 12:18:21 +00:00
Blacksmith
f213e880eb Add doc for shingles function. 2024-01-05 04:11:15 +08:00
Robert Schulze
76b7cddb18
Update docs 2024-01-04 16:29:43 +00:00
Kruglov Pavel
cc7d7e3811
Merge pull request #58456 from mneedham/patch-1
Add output_format_decimal_trailing_zeros setting for trailing zeros
2024-01-04 15:32:31 +01:00
Aliaksei Khatskevich
ad28d1a124
Add named collections to mysql table function docs 2024-01-04 09:22:41 +01:00
Aliaksei Khatskevich
172ec325e2
Add disclaimer that redis does not support named collections 2024-01-04 09:22:40 +01:00
Aliaksei Khatskevich
9060a1bbd2
Add named collections to s3Cluster table function docs 2024-01-04 09:22:40 +01:00
Aliaksei Khatskevich
e75cc5d50d
Add named collections to gcs table function docs 2024-01-04 09:22:40 +01:00
Aliaksei Khatskevich
e98d576fb8
Add named collections to s3 table function docs 2024-01-04 09:22:40 +01:00
Aliaksei Khatskevich
c3f1d0259a
Add named collections to remote table function docs 2024-01-04 09:22:40 +01:00
Aliaksei Khatskevich
741757634f
Improve redis table function documentation 2024-01-04 09:22:39 +01:00
Aliaksei Khatskevich
02db6c6b2b
Fix postgresql table function arguments documentation 2024-01-04 09:22:39 +01:00
Robert Schulze
f652c6050c
Implement idnaEn/Decode() 2024-01-03 18:08:32 +00:00
Bhavna Jindal
62521d30ce fix style-check 2024-01-03 09:34:58 -08:00
Bhavna Jindal
8a7eaed07e Added additional testcases 2024-01-03 09:16:32 -08:00
Mark Needham
3125482631
Add output_format_decimal_trailing_zeros setting for trailing spaces 2024-01-03 14:25:03 +00:00
Kruglov Pavel
4d8cf71ba7
Merge branch 'master' into variant-data-type 2024-01-03 15:21:23 +01:00
zvonand
89beb32e64 Edit docs for toWeek() 2024-01-03 13:10:14 +01:00
Robert Schulze
b5d7ea2b02
Introduce OrNull() overloads for punycodeEncode/Decode() 2024-01-03 10:50:00 +00:00
Robert Schulze
2186aa8f21
Revert "Revert "Implement punycode encoding/decoding""
This reverts commit 345d29a3c1.
2024-01-03 08:03:01 +00:00
Bhavna Jindal
c0cff7b4f3 handled edge cases and addresses review comments 2024-01-02 08:52:28 -08:00
Bhavna Jindal
5c34ddab09 implemneted seriesDecomposeSTL method 2024-01-02 08:52:23 -08:00
Alexey Milovidov
78523639e0 Remove function 2023-12-30 14:52:54 +01:00
Alexey Milovidov
ea03cc82aa
Merge pull request #58320 from ClickHouse/mv3
Refreshable materialized views again
2023-12-29 14:44:50 +01:00
Alexey Milovidov
09181b6c37
Merge pull request #58335 from lingtaolf/feature/sparkBar_alias_to_sparkbar
sparkBar as an alias to sparkbar
2023-12-29 13:02:55 +01:00
凌涛
57c57360db add doc 2023-12-29 10:43:11 +08:00
Michael Kolupaev
96c68e5aae Remove pausing, enable multithreading, kick off refresh on table creation unless the query says EMPTY 2023-12-28 17:56:06 +00:00
Michael Kolupaev
bda01ca9db Spelling 2023-12-28 17:56:05 +00:00
Michael Kolupaev
edd120e8be Make it experimental 2023-12-28 17:56:05 +00:00
Michael Kolupaev
f0417d0ec3 Things 2023-12-28 17:56:05 +00:00
Michael Kolupaev
0fc7535eba Fixes 2023-12-28 17:56:05 +00:00
Michael Kolupaev
609b2c216c Fix some of the CI 2023-12-28 17:56:05 +00:00
Michael Kolupaev
8b8ef41407 Documentation 2023-12-28 17:56:05 +00:00
Alexander Tokmakov
38fe70c68a
Revert "Refreshable materialized views (takeover)" 2023-12-28 13:12:20 +01:00
Alexey Milovidov
a2faa65b08
Merge pull request #56946 from ClickHouse/mv
Refreshable materialized views (takeover)
2023-12-28 09:29:44 +01:00
Alexey Milovidov
345d29a3c1
Revert "Implement punycode encoding/decoding" 2023-12-28 09:12:22 +03:00
Michael Kolupaev
b9cbecb0df Remove pausing, enable multithreading, kick off refresh on table creation unless the query says EMPTY 2023-12-27 20:24:56 +00:00
Michael Kolupaev
dbf8fa23df Spelling 2023-12-27 20:24:55 +00:00
Michael Kolupaev
18cc5d1b76 Make it experimental 2023-12-27 20:24:55 +00:00
Michael Kolupaev
538b23d862 Things 2023-12-27 20:24:55 +00:00
Michael Kolupaev
802961f0a2 Fixes 2023-12-27 20:24:55 +00:00
Michael Kolupaev
673743e2ac Fix some of the CI 2023-12-27 20:24:55 +00:00
Michael Kolupaev
7786b12a89 Documentation 2023-12-27 20:24:55 +00:00