Commit Graph

4909 Commits

Author SHA1 Message Date
Arthur Passos
0bbfef884c
Merge branch 'ClickHouse:master' into bring_back_attach_partition_pr 2024-01-28 17:43:38 -03:00
robot-ch-test-poll4
c0fc804797
Merge pull request #59289 from ClickHouse/melvynator-exp-rmv
Update view.md
2024-01-28 00:17:56 +01:00
Peignon Melvyn
cf1df96cc1
Update view.md
Improved documentation.
2024-01-27 17:27:00 +01:00
Peignon Melvyn
4273ae4f4f
Update view.md 2024-01-26 21:27:20 +01:00
Artur Beglaryan
1624ecd7e6
Fixed typo in documentation
Added missed parameter in xml dictionary config
2024-01-26 15:02:28 +00:00
Arthur Passos
ce6877cbb6
Merge branch 'ClickHouse:master' into bring_back_attach_partition_pr 2024-01-26 10:57:11 -03:00
jsc0218
03fc10d68a
Merge pull request #59017 from filimonov/patch-8
Update rename.md
2024-01-24 11:38:56 -05:00
Yarik Briukhovetskyi
d5ab31f8f0
Merge pull request #58895 from avinzhang/patch-1
Update executable.md
2024-01-23 23:33:35 +01:00
Arthur Passos
799a94081b Revert "Revert "Allow to attach partition from table with different partition expression when destination partition expression doesn't re-partition""
This reverts commit a1c83e2f51.
2024-01-23 11:40:42 -03:00
Robert Schulze
a1c83e2f51
Revert "Allow to attach partition from table with different partition expression when destination partition expression doesn't re-partition" 2024-01-23 15:26:04 +01:00
Robert Schulze
e67076ea2b
Merge pull request #55201 from canhld94/column_level_compress_block
Column-level compression block sizes
2024-01-23 11:22:03 +01:00
Robert Schulze
5a420cd9b1
Update docs 2024-01-23 06:18:07 +00:00
Arthur Passos
24b8bbe9fa
Allow to attach partition from table with different partition expression when destination partition expression doesn't re-partition (#39507)
* temp commit

* temp commit

* draft impl for feedback

* fix weird style changes

* fix weird style changes

* fix weird style changes

* fix weird style changes

* fix weird style changes

* aa

* aa

* Add integ tests and remove partition key restriction

* fix small incosistency in partition id

* style fix

* style fix

* style fix

* use existing DataPartStorageBuilder instead of new one

* Refactor part clone to make it more readable and maintainable

* Add MergeTreeDataPartCloner docs

* define ErrorCodes::BAD_ARGUMENTS

* Rebase

* camel case methods

* address some comments

* yet another rebase?

* Move from integ tests to stateless tests

* address more comments

* add finalize on min_max_idx files

* Add sync option to DistinctPartitionExpCloner

* just a temp test

* revert temp change

* Use echoOn to distinguish test queries

* remove comment

* fix build issue during rebase

* atempt to fix build after rebase

* finally fix build

* clear minmaxidx hyperrectangle before loading it

* Fix error on min_max files deletion where it was being assumed that partition expression contained all columns

* get it to the state it was previously

* add missing include

* getting functional?

* refactoring and renaming

* some more refactoring

* extern bad arguments

* try to fix style

* improvements and docs

* remove duplicate includes

* fix crash

* make tests more stable by ordering

* rebase once again..

* fix

* make ci happy?

* fix rebase issues

* docs

* rebase, but prolly needs to be improved

* refactor out from nasty inheritance to static methods

* fix style

* work around optional

* refactor & integrate some changes

* update column_type

* add tests by dencrane

* set utc

* fix ref file

* fix tests

* use MergeTree instead of SummingMergeTree

* mark MergeTreeDataPart::getBlock as const

* address a few comments

* compute module function name size at compile time

* simplify branching in getPartitionAstFieldsCount

* remove column_indexes argument

* merge getBlock with buildBlock

* add some const specifiers

* small adjustments

* remove no longer needed isNull check

* use std::min and max to update global min max idx

* add some assertions

* forward declare some symbols

* fix grammar

* forward decl

* try to fix build..

* remove IFunction forward decl

* Revert "use std::min and max to update global min max idx"

This reverts commit b2fe79dda7.

* Revert "remove no longer needed isNull check"

This reverts commit 129db2610f.

* Revert "Revert "remove no longer needed isNull check""

This reverts commit 9416087dd8.

* Revert "Revert "use std::min and max to update global min max idx""

This reverts commit 20246d4416.

* remove some comments

* partial use of MonotonicityCheckMatcher

* ranges

* remove KeyDescriptionMonotonicityChecker

* remove duplication of applyfunction

* move functions to anonymous namespace

* move functions to cpp

* Relax partition compatibility requirements by accepting subset, add tests from partitioned to unpartitioned

* updte reference file

* Support for partition by a, b, c to partition by a, b

* refactoring part 1

* refactoring part 2, use hyperrectangle, still not complete

* refactoring part 3, build hyperrectangle with intersection of source & destination min max columns

* Support attaching to table with partition expression of multiple expressions

* add tests

* rename method

* remove some code duplication

* draft impl for replicatedmergetree, need to dive deeper

* ship ref file

* fix impl for replicatedmergetree..

* forbid attach empty partition replicatedmergetree

* Add replicated merge tree integration tests

* add test missing files

* fix black

* do not check for monotonicity of empty partition

* add empty tests & fix replicated

* remove no longer needed buildBlockWithMinMaxINdexes

* remove column logic in buildHyperrectangle

* simplify implementation by using existing methods

* further simplify implementation

* move all MergeTreeDataPartClone private methods to .cpp file

* decrease decomposition

* use different namespaces

* reduce code duplication

* fix style

* address a few comments

* add chassert to assert arguments size on MonotonicityCheckVisitor

* remove deleteMinMaxFiles method

* remove useless checks from sanitycheck

* add tests for attach partition (not id)

* Remove sanityCheckASTPartition and bring back conditional getPartitionIDFromQuery

* remove empty block comment

* small fixes

* fix formatting

* add missing include

* remove duplicate iuncludes

* trigger ci

* reduce some code duplication

* use updated partition id on replicatedmergetree

* fix build

* fix build

* small refactor

* do not use insert increment on fetch part

* remove duplicate includes

* add one more integ test

* black

* black

* rely on partition exp instead of partition id on replicated part fetch to decide if it is a different partition exp

* add one more integ test

* add order by clause

* fix black

---------

Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2024-01-22 21:00:04 +01:00
Kruglov Pavel
0829de8928
Merge pull request #57599 from Khatskevich/khatskevich/fix_docs
Improve named collections documentation
2024-01-22 12:54:57 +01:00
filimonov
7635da91a8
Update rename.md
Remove wrong note. RENAME is supported by most of database engines (including old Ordinary).
2024-01-19 21:55:41 +01:00
Lino Uruñuela
4a6c2d21ff
Update executable.md - Fix script name in SQL example
It uses 'generate_random.py' in 'The following Python script is named generate_random.py and is saved in the user_scripts folder....'

However, in the SQL example, it uses 'my_script.py'.

'SELECT * FROM executable('generate_random.py', TabSeparated, 'id UInt32, random String', (SELECT 10))'
2024-01-19 12:17:22 +01:00
Robert Schulze
1bfeee1954
Some fixups 2024-01-18 20:49:50 +00:00
Robert Schulze
15700592f7
Merge remote-tracking branch 'ClickHouse/master' into column_level_compress_block 2024-01-18 19:12:57 +00:00
Robert Schulze
316669b90f
Merge pull request #58396 from zenmiao7/u/zhengmiao/AddArrayFunctionShingles
Add function `arrayShingles()`
2024-01-18 11:38:56 +01:00
Duc Canh Le
b16a4cf361 add document
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2024-01-18 07:55:44 +00:00
Srikanth Chekuri
c23c7e0b6f
feat: add DDSketch quantile (#56342)
* feat: add DDSketch quantile

* Fix StyleCheck

* Move quantileddsketch.md under right dir

* Update stateless test number and add stateful test

* Throw exception when relative accuracy is too low

* Update test number

* Fix undefined behaviour for empty store

* Fix quantileGK test

* Update test numbers

* Update src/AggregateFunctions/

* Throw exception on out of range values

* Update relative accuracy docs and add encoding details

* Address review comments and suggestions

* Remove unused function

* Address alexey review comments

* Remove unused function isFloat64FieldType

* Throw error on invalid relative accuracy

* Simplify mapping

* Address remaining review comments

* Add effective memory usage suggestions

* Fix Stylecheck

* Fix fast test

* Incorporate bins capacity suggestion

* Fix fuzzer

* Remove inheritance in Mapping, Store and DDSketch

* Add checks for bin resizing

* Add note about the binary compatible implementation
2024-01-17 19:51:32 -08:00
Yarik Briukhovetskyi
8dce581ae7
update ci 2024-01-17 14:14:15 +01:00
Yarik Briukhovetskyi
9fbe2296db
Update docs/en/sql-reference/table-functions/executable.md 2024-01-17 13:04:17 +01:00
Robert Schulze
84ab20ff77
Some fixups 2024-01-17 12:01:52 +00:00
Robert Schulze
22534c69c4
Merge remote-tracking branch 'ClickHouse/master' into u/zhengmiao/AddArrayFunctionShingles 2024-01-17 10:49:11 +00:00
avinzhang
74f2864f20
Update executable.md
Adding the sentence on the requirement to run the script.
2024-01-17 17:42:59 +10:00
Alexander Tokmakov
5128607995
Merge pull request #58393 from jaymebrd/feat/add-from-modifier-sync-replica-lightweight
add `from srcreplicas` modifier  for `SYSTEM SYNC REPLICA LIGHTWEIGHT`
2024-01-14 20:53:16 +01:00
robot-ch-test-poll4
4c5884b1d9
Merge pull request #58701 from ClickHouse/docs/assume-contraint
Adds documentation for `ASSUME CONSTRAINT`
2024-01-11 17:04:48 +01:00
robot-clickhouse-ci-1
5c47a4fa91
Merge pull request #58666 from ClickHouse/docs/data-faster-than-datetime
Explains that date is generally faster than datetime.
2024-01-11 10:17:54 +01:00
Kseniia Sumarokova
e74f8e9095
Update docs/en/sql-reference/data-types/datetime.md 2024-01-11 09:50:48 +01:00
robot-ch-test-poll
498894a15c
Merge pull request #58700 from ClickHouse/docs/arrayjoin-short-circuit-function-eval-no-no
Adds info about not using `arrayJoin` with `short_circuit_function_evaluation`.
2024-01-11 02:22:11 +01:00
johnnymatthews
2bfe7a2cab Adds docs for ASSUME CONSTRAINT. 2024-01-10 21:13:21 -04:00
johnnymatthews
826a39b732 Adds arrayJoin exception. Prettifies file. Fixes spelling. 2024-01-10 20:43:19 -04:00
johnnymatthews
b276694ac2 Adds ALL qualifier to JOIN. 2024-01-10 13:17:04 -04:00
johnnymatthews
4723a9c082 Explains that date is generally faster than datetime. 2024-01-10 11:50:02 -04:00
Robert Schulze
582a9cc2a7
Merge pull request #58655 from rschu1ze/docs-match
Document that `match()` can use `ngrambf_v1` and `tokenbf_v1` indexes
2024-01-10 15:43:52 +01:00
vdimir
263c6e9c95
Merge pull request #58608 from yariks5s/remove_order_by_requirement_paste_join
Remove order by requierement in PASTE JOIN
2024-01-10 15:18:18 +01:00
Robert Schulze
27e809a4f5
Add match() to supported functions for token/ngrambf_v1 indexes 2024-01-10 13:39:19 +00:00
Robert Schulze
92692bc57c
Fix links 2024-01-10 13:36:54 +00:00
Robert Schulze
a0128e0f51
Merge pull request #58544 from rschu1ze/sqid-decode
Add `sqidDecode()` function
2024-01-10 13:47:13 +01:00
Robert Schulze
4cacfa6b43
Merge pull request #57509 from jinjunzh/qatzstd_main
Add Intel-QAT-based `ZSTD_QAT` compression codec
2024-01-10 10:31:39 +01:00
Robert Schulze
ced9e93ac6
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main 2024-01-09 20:36:02 +00:00
Yarik Briukhovetskyi
aef24c0621
Merge branch 'ClickHouse:master' into remove_order_by_requirement_paste_join 2024-01-09 17:03:54 +01:00
Robert Schulze
69ba1a706a
Merge remote-tracking branch 'rschu1ze/master' into string-similarity 2024-01-09 15:22:52 +00:00
Yarik Briukhovetskyi
c8f97e877f
fix typo 2024-01-09 13:31:15 +01:00
yariks5s
dc4cb2fa0e add docs 2024-01-09 11:46:54 +00:00
Robert Schulze
64ab30f446
Merge pull request #57078 from ClibMouse/seriesDecompose
Seasonal decompose of time series into seasonal, trend and residue components
2024-01-09 11:18:13 +01:00
Bhavna Jindal
b2434d0c10 minor refactoring and cosmetic changes 2024-01-08 10:49:09 -08:00
Jayme Bird
f7173004cc update docs 2024-01-08 12:40:05 +00:00
Robert Schulze
0f51e32bb5
Rename from ZSTDQPL to ZSTD_QPL 2024-01-07 17:47:31 +00:00