Commit Graph

133163 Commits

Author SHA1 Message Date
taiyang-li
622a0f65b3 optimize for float 2024-01-24 18:46:06 +08:00
taiyang-li
aed8ffe3d8 optimize for decimal 2024-01-24 16:30:37 +08:00
Nikita Taranov
09e24ed6c5
Merge pull request #58068 from zhongyuankai/limit_materialized_view_size
A limit on the number of materialized views attached to a table.
2024-01-22 22:50:56 +01:00
Arthur Passos
24b8bbe9fa
Allow to attach partition from table with different partition expression when destination partition expression doesn't re-partition (#39507)
* temp commit

* temp commit

* draft impl for feedback

* fix weird style changes

* fix weird style changes

* fix weird style changes

* fix weird style changes

* fix weird style changes

* aa

* aa

* Add integ tests and remove partition key restriction

* fix small incosistency in partition id

* style fix

* style fix

* style fix

* use existing DataPartStorageBuilder instead of new one

* Refactor part clone to make it more readable and maintainable

* Add MergeTreeDataPartCloner docs

* define ErrorCodes::BAD_ARGUMENTS

* Rebase

* camel case methods

* address some comments

* yet another rebase?

* Move from integ tests to stateless tests

* address more comments

* add finalize on min_max_idx files

* Add sync option to DistinctPartitionExpCloner

* just a temp test

* revert temp change

* Use echoOn to distinguish test queries

* remove comment

* fix build issue during rebase

* atempt to fix build after rebase

* finally fix build

* clear minmaxidx hyperrectangle before loading it

* Fix error on min_max files deletion where it was being assumed that partition expression contained all columns

* get it to the state it was previously

* add missing include

* getting functional?

* refactoring and renaming

* some more refactoring

* extern bad arguments

* try to fix style

* improvements and docs

* remove duplicate includes

* fix crash

* make tests more stable by ordering

* rebase once again..

* fix

* make ci happy?

* fix rebase issues

* docs

* rebase, but prolly needs to be improved

* refactor out from nasty inheritance to static methods

* fix style

* work around optional

* refactor & integrate some changes

* update column_type

* add tests by dencrane

* set utc

* fix ref file

* fix tests

* use MergeTree instead of SummingMergeTree

* mark MergeTreeDataPart::getBlock as const

* address a few comments

* compute module function name size at compile time

* simplify branching in getPartitionAstFieldsCount

* remove column_indexes argument

* merge getBlock with buildBlock

* add some const specifiers

* small adjustments

* remove no longer needed isNull check

* use std::min and max to update global min max idx

* add some assertions

* forward declare some symbols

* fix grammar

* forward decl

* try to fix build..

* remove IFunction forward decl

* Revert "use std::min and max to update global min max idx"

This reverts commit b2fe79dda7.

* Revert "remove no longer needed isNull check"

This reverts commit 129db2610f.

* Revert "Revert "remove no longer needed isNull check""

This reverts commit 9416087dd8.

* Revert "Revert "use std::min and max to update global min max idx""

This reverts commit 20246d4416.

* remove some comments

* partial use of MonotonicityCheckMatcher

* ranges

* remove KeyDescriptionMonotonicityChecker

* remove duplication of applyfunction

* move functions to anonymous namespace

* move functions to cpp

* Relax partition compatibility requirements by accepting subset, add tests from partitioned to unpartitioned

* updte reference file

* Support for partition by a, b, c to partition by a, b

* refactoring part 1

* refactoring part 2, use hyperrectangle, still not complete

* refactoring part 3, build hyperrectangle with intersection of source & destination min max columns

* Support attaching to table with partition expression of multiple expressions

* add tests

* rename method

* remove some code duplication

* draft impl for replicatedmergetree, need to dive deeper

* ship ref file

* fix impl for replicatedmergetree..

* forbid attach empty partition replicatedmergetree

* Add replicated merge tree integration tests

* add test missing files

* fix black

* do not check for monotonicity of empty partition

* add empty tests & fix replicated

* remove no longer needed buildBlockWithMinMaxINdexes

* remove column logic in buildHyperrectangle

* simplify implementation by using existing methods

* further simplify implementation

* move all MergeTreeDataPartClone private methods to .cpp file

* decrease decomposition

* use different namespaces

* reduce code duplication

* fix style

* address a few comments

* add chassert to assert arguments size on MonotonicityCheckVisitor

* remove deleteMinMaxFiles method

* remove useless checks from sanitycheck

* add tests for attach partition (not id)

* Remove sanityCheckASTPartition and bring back conditional getPartitionIDFromQuery

* remove empty block comment

* small fixes

* fix formatting

* add missing include

* remove duplicate iuncludes

* trigger ci

* reduce some code duplication

* use updated partition id on replicatedmergetree

* fix build

* fix build

* small refactor

* do not use insert increment on fetch part

* remove duplicate includes

* add one more integ test

* black

* black

* rely on partition exp instead of partition id on replicated part fetch to decide if it is a different partition exp

* add one more integ test

* add order by clause

* fix black

---------

Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2024-01-22 21:00:04 +01:00
Max K
5804a65262
Merge pull request #59081 from ClickHouse/ci_hot_fix_reuse
CI: hot fix for reuse
2024-01-22 20:32:43 +01:00
Max Kainov
f1220c5637 CI: hot fix for reuse 2024-01-22 19:19:22 +00:00
Alexander Tokmakov
7cd53c8f0d
Merge pull request #59075 from ClickHouse/tavplubix-patch-10
Follow-up to #59027
2024-01-22 17:17:46 +01:00
Alexander Tokmakov
b8d69ecd5f
Update Client.cpp 2024-01-22 17:00:56 +01:00
Alexander Tokmakov
2f1d4f094b
Add a parameter for testing purposes (#59027)
* Update ConnectionParameters.cpp

* Update ConnectionParameters.cpp

* Update ConnectionParameters.cpp
2024-01-22 15:48:44 +01:00
Alexander Tokmakov
cddd41ccd5
Merge pull request #59070 from ClickHouse/revert-55575-no-octal-leading-zeroes
Revert "Consume leading zeroes when parsing a number in ConstantExpressionTemplate"
2024-01-22 15:35:16 +01:00
Alexander Tokmakov
c2202ff347
Skip unavailable replicas in parallel distributed insert select (#58931)
* Update StorageDistributed.cpp

* Update StorageDistributed.cpp

* Update StorageDistributed.cpp

* add a test

* Update 01099_parallel_distributed_insert_select.sql
2024-01-22 15:34:46 +01:00
Alexander Tokmakov
9b6455122c
Revert "Consume leading zeroes when parsing a number in ConstantExpressionTemplate" 2024-01-22 15:31:08 +01:00
vdimir
0791c75315
Merge pull request #58654 from yariks5s/paste_join_aliases_requirement
Avoid alias duplicates in PASTE JOIN and fix aliases requirement
2024-01-22 14:48:13 +01:00
Nikita Taranov
4d6ef8ed86
Merge pull request #56961 from nickitat/some_questionable_code
Bypass `Poco::BasicBufferedStreamBuf` in `ReadBufferFromIStream`
2024-01-22 14:08:09 +01:00
Alexander Tokmakov
0f0785cf20
Merge pull request #59059 from ClickHouse/revert-58838-allow-parallel-replicas-for-join-with-analyzer
Revert "Allow parallel replicas for JOIN with analyzer [part 1]."
2024-01-22 14:07:26 +01:00
Dmitry Novik
a18a8d8ea3
Merge pull request #59009 from nickitat/uniq_optimisation_for_distributed
`uniqExact` state parallel merging for distributed queries
2024-01-22 14:05:02 +01:00
Max K
08fcefbefd
Merge pull request #59046 from ClickHouse/job_names_refactoring
CI: add ci_config classes for job and build names
2024-01-22 13:46:32 +01:00
Alexander Tokmakov
4315d44517
Revert "Allow parallel replicas for JOIN with analyzer [part 1]." 2024-01-22 13:30:35 +01:00
alesapin
478b91cc37
Merge pull request #59010 from ClickHouse/alesapin-patch-1
Change log level for super imporant message in Keeper
2024-01-22 13:16:56 +01:00
Kruglov Pavel
0829de8928
Merge pull request #57599 from Khatskevich/khatskevich/fix_docs
Improve named collections documentation
2024-01-22 12:54:57 +01:00
Max Kainov
5379767684 Job Naming
#no_merge_commit #ci_set_reduced
2024-01-22 11:16:58 +00:00
Sema Checherinda
9adab57771
Correct initialization of ConnectionTimeouts (#59000) 2024-01-22 12:03:36 +01:00
Kseniia Sumarokova
aec76d6653
Merge pull request #58877 from ClickHouse/multiple-read-file-log-storage-in-mv
Multiple read file log storage in mv
2024-01-22 12:02:41 +01:00
Alexander Sapin
f7b21b6016 Fix build 2024-01-22 11:53:21 +01:00
Sergei Trifonov
04a040ee5c
Merge pull request #59013 from ClickHouse/remove-static-resource-manager 2024-01-22 10:59:58 +01:00
Raúl Marín
d9ab300300
Merge pull request #57853 from jiebinn/rewriteSumFunction
Rewrite the AST/Analyzer of sum(column +/- literal) function
2024-01-22 10:41:30 +01:00
Jiebin Sun
5e11da9cec set allow_experimental_analyzer=1 at the top of tests 2024-01-22 21:27:03 +08:00
Max K
ea6fdcda75
Merge pull request #59043 from ClickHouse/jepsen_cron_wf_fix
CI: Jepsen: fix sanity check in ci.py
2024-01-22 09:42:47 +01:00
Max Kainov
6362fc1d48 fix inputs check in ci.py 2024-01-22 08:26:46 +00:00
Antonio Andelic
ecaef80ea0
Merge pull request #58938 from ClickHouse/keeper-fetch-max-file-desc-once
Call `getMaxFileDescriptorCount` once in Keeper
2024-01-22 08:57:58 +01:00
jsc0218
6f3124acdb
Merge pull request #58402 from zhangyifan27/add_max_estimated_execution_time
Seperate max_execution_time and max_estimated_execution_time
2024-01-21 19:57:06 -05:00
Alexey Milovidov
37f70e07bd
Merge pull request #59022 from ClickHouse/better-visible-width
Better behavior of `visibleWidth`
2024-01-22 01:08:12 +01:00
robot-clickhouse-ci-1
be3e612f79
Merge pull request #58892 from Waterkin/doc-revise
Translate Eng docs to Chinese.
2024-01-22 00:58:07 +01:00
Han Fei
2c107e1925
Update docs/zh/faq/operations/delete-old-data.md 2024-01-22 00:29:06 +01:00
Han Fei
baf42d777f
Update docs/zh/faq/operations/delete-old-data.md 2024-01-22 00:29:01 +01:00
Han Fei
4938bf89de
Update docs/zh/faq/operations/delete-old-data.md 2024-01-22 00:28:55 +01:00
Han Fei
1244818350
Update docs/zh/faq/operations/delete-old-data.md 2024-01-22 00:28:47 +01:00
Han Fei
edccae1d62
Update docs/zh/faq/operations/delete-old-data.md 2024-01-22 00:28:40 +01:00
Han Fei
861e050963
Update docs/zh/faq/operations/delete-old-data.md 2024-01-22 00:28:33 +01:00
Han Fei
db93b72dcc
Update docs/zh/faq/operations/delete-old-data.md 2024-01-22 00:28:27 +01:00
Han Fei
30c6e1f151
Update docs/zh/faq/operations/delete-old-data.md 2024-01-22 00:28:20 +01:00
Han Fei
a1a5ae59d5
Update docs/zh/faq/general/ne-tormozit.md 2024-01-22 00:28:14 +01:00
Han Fei
bc5a6e8e63
Update docs/zh/faq/general/ne-tormozit.md 2024-01-22 00:28:06 +01:00
Han Fei
ab95031399
Update docs/zh/faq/integration/json-import.md 2024-01-22 00:27:59 +01:00
Han Fei
51524aadc5
Update docs/zh/faq/general/ne-tormozit.md 2024-01-22 00:27:52 +01:00
Han Fei
9b5c781932
Update docs/zh/faq/general/ne-tormozit.md 2024-01-22 00:27:44 +01:00
Han Fei
2c394155ad
Update docs/zh/faq/general/ne-tormozit.md 2024-01-22 00:27:35 +01:00
Max K
070a55e194
Merge pull request #58516 from ClickHouse/move_out_ci_specifics_to_ci_py
CI: move ci-specifics from job scripts to ci.py
2024-01-21 18:24:42 +01:00
Max Kainov
3247ae81e4 move out ci specific functions to ci.py
#no_merge_commit
2024-01-21 16:36:37 +00:00
Alexey Milovidov
eb4f61ba31
Update visibleWidth.cpp 2024-01-21 17:50:21 +03:00