Commit Graph

47315 Commits

Author SHA1 Message Date
Azat Khuzhin
fffeeeba06 Force WithMergeableStateAfterAggregation via distributed_group_by_no_merge (convert to UInt64)
Possible values:
- 1 - Do not merge aggregation states from different servers for distributed query processing - in case it is for certain that there are different keys on different shards.
- 2 - same as 1 but also apply ORDER BY and LIMIT stages
2020-09-03 00:52:51 +03:00
Azat Khuzhin
10b4f3b41f Optimize queries with LIMIT/LIMIT BY/ORDER BY for distributed with GROUP BY sharding_key
Previous set of QueryProcessingStage does not allow to do this.
But after WithMergeableStateAfterAggregation had been introduced the
following queries can be optimized too under
optimize_distributed_group_by_sharding_key:
- GROUP BY sharding_key LIMIT
- GROUP BY sharding_key LIMIT BY
- GROUP BY sharding_key ORDER BY

And right now it is still not supports:
- WITH TOTALS (looks like it can be supported)
- WITH ROLLUP (looks like it can be supported)
- WITH CUBE
- SETTINGS extremes=1 (looks like it can be supported)
But will be implemented separatelly.

vX: fixes
v2: fix WITH *
v3: fix extremes
v4: fix LIMIT OFFSET (and make a little bit cleaner)
v5: fix HAVING
v6: fix ORDER BY
v7: rebase against 20.7
v8: move out WithMergeableStateAfterAggregation
v9: add optimize_distributed_group_by_sharding_key into test names
2020-09-03 00:52:51 +03:00
Azat Khuzhin
4043be3121 Add new query processing stage WithMergeableStateAfterAggregation
Process query until the stage where the aggregate functions were
calculated and finalized.

It will be used for optimize_distributed_group_by_sharding_key.

v2: fix aliases
v3: Fix protocol ABI breakage due to WithMergeableStateAfterAggregation
    Conditions >= for QueryProcessingStage::Enum has been verified, and they
    are ok (in InterpreterSelectQuery).
2020-09-03 00:51:08 +03:00
alexey-milovidov
7bd31fb3d3
Merge pull request #14313 from ClickHouse/fix-fuzz-test6
Better check for tuple size in SSD cache complex key external dictionaries
2020-09-03 00:50:24 +03:00
alexey-milovidov
76aa1d15ad
Update CHANGELOG.md 2020-09-03 00:33:02 +03:00
alexey-milovidov
85cfebe47d
Update CHANGELOG.md 2020-09-03 00:32:32 +03:00
alexey-milovidov
6e004ac26f
Update CHANGELOG.md 2020-09-03 00:27:54 +03:00
alexey-milovidov
5b561cb53f
Merge pull request #14420 from ClickHouse/akz/changelog-20.7
Changelog.md updated with description for 20.7
2020-09-03 00:25:10 +03:00
alexey-milovidov
bda889e234
Update CHANGELOG.md 2020-09-03 00:24:58 +03:00
Matwey V. Kornilov
9b4da1e82f Add missed #include <atomic>
std::atomic<Data*> at line 199 requires including <atomic>
2020-09-02 23:40:27 +03:00
Alexander Kazakov
8e8d5fb89f Updated Changelog.md with description for 20.7 2020-09-02 23:25:50 +03:00
Alexander Kuzmenkov
3a7181cfcb
Merge pull request #14397 from zhang2014/fix/ISSUES-14114
ISSUES-14114 Implicitly convert primary key to not null in MaterializeMySQL
2020-09-02 23:12:33 +03:00
Ilya Yatsishin
a5e9449bc3
Merge branch 'master' into try-dns-fix 2020-09-02 19:01:30 +03:00
Yatsishin Ilya
3a661ba1b9 Merge remote-tracking branch 'qoega/try-dns-fix' into try-dns-fix 2020-09-02 17:38:28 +03:00
Yatsishin Ilya
c2ab85f214 Split tag part from image 2020-09-02 17:36:25 +03:00
Yatsishin Ilya
fda89095cc Split tag part from image 2020-09-02 17:22:54 +03:00
alexey-milovidov
8e2fba5be1
Merge pull request #12567 from amosbird/fmi
table function view
2020-09-02 17:07:57 +03:00
Alexey Milovidov
95493352fe Remove wrong checks 2020-09-02 17:07:25 +03:00
Yatsishin Ilya
84a3812506 Merge remote-tracking branch 'qoega/integration-explicit-configs' into integration-explicit-configs 2020-09-02 16:35:56 +03:00
Ilya Yatsishin
7c539cb974
Merge pull request #14348 from ka1bi4/romanzhukov-DOCSUP-2031-pr-translation
DOCSUP-2031: Edit and translate PR to Russian.
2020-09-02 16:13:16 +03:00
Ilya Yatsishin
e94a2f2489
Merge pull request #14349 from otrazhenia/evgsudarikova-DOCSUP-2003
DOCSUP-2003: Edit and translate to Russian RabbitMQ description
2020-09-02 16:07:18 +03:00
Ilya Yatsishin
136e7aa33d
Merge pull request #14362 from ClickHouse/less-number-of-threads-in-builder
Less number of threads in builder
2020-09-02 16:01:00 +03:00
alexey-milovidov
09850dbdbc
Update ASTColumnsTransformers.cpp 2020-09-02 15:39:34 +03:00
Yatsishin Ilya
8f50a6769d Fix bad merge 2020-09-02 15:28:47 +03:00
alesapin
12f76d9448
Merge pull request #14325 from azat/suppress-wget-output
Suppress superfluous wget (-nv) output
2020-09-02 14:59:28 +03:00
Yatsishin Ilya
5ab9f249e5 Merge branch 'try-dns-fix' into integration-explicit-configs 2020-09-02 12:53:10 +03:00
Yatsishin Ilya
6902bbce50 Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-09-02 12:48:07 +03:00
Nikolai Kochetov
811e44a937
Merge pull request #14315 from azat/EXPLAIN-SIGSEGV-fix
[RFC] Fix QueryPlan lifetime (for EXPLAIN PIPELINE graph=1) for queries with nested interpreter
2020-09-02 12:46:59 +03:00
Nikolai Kochetov
13e0464138 Stop query execution if exception happened in PipelineExecutor itself. 2020-09-02 12:39:49 +03:00
Ilya Yatsishin
2c7d7f9f49
Update Dockerfile 2020-09-02 11:40:31 +03:00
Yatsishin Ilya
5d39b8ce04 unnecessary change 2020-09-02 11:39:16 +03:00
Yatsishin Ilya
45e54f81c7 better resolv.conf, add DNSCacheUpdater logs 2020-09-02 11:07:46 +03:00
Amos Bird
6bd753d85d
TableFunction view. 2020-09-02 16:02:10 +08:00
BohuTANG
13fdcfada9 Try to fix query_event_with_empty_transaction failed 2020-09-02 15:41:09 +08:00
Amos Bird
be925f8d9c
Introduce columns transformers. 2020-09-02 15:36:34 +08:00
zhang2014
1f908af189 ISSUES-14114 fix create parse failure when mysql nullable primary key 2020-09-02 13:05:09 +08:00
alexey-milovidov
adf50fd774
Merge pull request #13761 from zhang2014/improvement/date_time
ISSUES-4006 add precision argument for DateTime type
2020-09-02 05:12:35 +03:00
alexey-milovidov
2d85213629
Merge pull request #13792 from azat/lambda-arrayJoin-fix
[RFC] Fix arrayJoin() capturing in lambda
2020-09-02 05:10:58 +03:00
alexey-milovidov
bfa5a9ef03
Merge pull request #13987 from vitlibar/fix-grant-all-on-table
Fix GRANT ALL statement when executed on a non-global level
2020-09-02 05:06:32 +03:00
alexey-milovidov
04c88ca9e4
Update AccessFlags.h 2020-09-02 05:06:21 +03:00
alexey-milovidov
5a529f171c
Merge pull request #13988 from vitlibar/user-directories-mixed-style
Add storages from <user_directories> after ones from <users_config> and <access_control_path>.
2020-09-02 05:03:34 +03:00
alexey-milovidov
b100d7a911
Merge pull request #14087 from 243f6a8885a308d313198a2e037/patch-1
fixed Japanese translation for data-types/date.md
2020-09-02 05:01:01 +03:00
alexey-milovidov
8a2b06af74
Merge pull request #14185 from dreamerfable/master
Update MergeTree.md
2020-09-02 04:59:41 +03:00
alexey-milovidov
8c394a9828
Merge pull request #14213 from BayoNet/docs/CLICKHOUSEDOCS-744-collapsing-merge-tree
DOCS-744: Fixed the CollapsingMerge description
2020-09-02 04:59:22 +03:00
alexey-milovidov
08ed74732e
Merge pull request #14320 from bharatnc/ncb/fix-alter-live-lock
fix ALTER LIVE VIEW  [REFRESH] lock issue
2020-09-02 04:52:35 +03:00
Alexey Milovidov
deb483eee5 Merge branch 'master' into fix-fuzz-test6 2020-09-02 04:40:42 +03:00
alexey-milovidov
951bce5911
Merge pull request #14324 from ClickHouse/revert-13498-replacingmergetree_ver_datetime64
Revert "Documentation about ReplacingMergeTree extended with type DateTime64 for column `ver`"
2020-09-02 04:30:28 +03:00
Alexey Milovidov
56bbac1569 Trigger CI 2020-09-02 04:28:52 +03:00
Alexey Milovidov
443ed33ab3 Less number of threads in builder 2020-09-02 04:26:35 +03:00
BohuTANG
6dfab88156 ISSUES-14235 change string.rfind to string starts_with and add some tests 2020-09-02 08:31:51 +08:00