Commit Graph

47158 Commits

Author SHA1 Message Date
Azat Khuzhin
10b4f3b41f Optimize queries with LIMIT/LIMIT BY/ORDER BY for distributed with GROUP BY sharding_key
Previous set of QueryProcessingStage does not allow to do this.
But after WithMergeableStateAfterAggregation had been introduced the
following queries can be optimized too under
optimize_distributed_group_by_sharding_key:
- GROUP BY sharding_key LIMIT
- GROUP BY sharding_key LIMIT BY
- GROUP BY sharding_key ORDER BY

And right now it is still not supports:
- WITH TOTALS (looks like it can be supported)
- WITH ROLLUP (looks like it can be supported)
- WITH CUBE
- SETTINGS extremes=1 (looks like it can be supported)
But will be implemented separatelly.

vX: fixes
v2: fix WITH *
v3: fix extremes
v4: fix LIMIT OFFSET (and make a little bit cleaner)
v5: fix HAVING
v6: fix ORDER BY
v7: rebase against 20.7
v8: move out WithMergeableStateAfterAggregation
v9: add optimize_distributed_group_by_sharding_key into test names
2020-09-03 00:52:51 +03:00
Azat Khuzhin
4043be3121 Add new query processing stage WithMergeableStateAfterAggregation
Process query until the stage where the aggregate functions were
calculated and finalized.

It will be used for optimize_distributed_group_by_sharding_key.

v2: fix aliases
v3: Fix protocol ABI breakage due to WithMergeableStateAfterAggregation
    Conditions >= for QueryProcessingStage::Enum has been verified, and they
    are ok (in InterpreterSelectQuery).
2020-09-03 00:51:08 +03:00
alexey-milovidov
8e2fba5be1
Merge pull request #12567 from amosbird/fmi
table function view
2020-09-02 17:07:57 +03:00
Ilya Yatsishin
7c539cb974
Merge pull request #14348 from ka1bi4/romanzhukov-DOCSUP-2031-pr-translation
DOCSUP-2031: Edit and translate PR to Russian.
2020-09-02 16:13:16 +03:00
Ilya Yatsishin
e94a2f2489
Merge pull request #14349 from otrazhenia/evgsudarikova-DOCSUP-2003
DOCSUP-2003: Edit and translate to Russian RabbitMQ description
2020-09-02 16:07:18 +03:00
Ilya Yatsishin
136e7aa33d
Merge pull request #14362 from ClickHouse/less-number-of-threads-in-builder
Less number of threads in builder
2020-09-02 16:01:00 +03:00
alesapin
12f76d9448
Merge pull request #14325 from azat/suppress-wget-output
Suppress superfluous wget (-nv) output
2020-09-02 14:59:28 +03:00
Nikolai Kochetov
811e44a937
Merge pull request #14315 from azat/EXPLAIN-SIGSEGV-fix
[RFC] Fix QueryPlan lifetime (for EXPLAIN PIPELINE graph=1) for queries with nested interpreter
2020-09-02 12:46:59 +03:00
Amos Bird
6bd753d85d
TableFunction view. 2020-09-02 16:02:10 +08:00
alexey-milovidov
adf50fd774
Merge pull request #13761 from zhang2014/improvement/date_time
ISSUES-4006 add precision argument for DateTime type
2020-09-02 05:12:35 +03:00
alexey-milovidov
2d85213629
Merge pull request #13792 from azat/lambda-arrayJoin-fix
[RFC] Fix arrayJoin() capturing in lambda
2020-09-02 05:10:58 +03:00
alexey-milovidov
bfa5a9ef03
Merge pull request #13987 from vitlibar/fix-grant-all-on-table
Fix GRANT ALL statement when executed on a non-global level
2020-09-02 05:06:32 +03:00
alexey-milovidov
04c88ca9e4
Update AccessFlags.h 2020-09-02 05:06:21 +03:00
alexey-milovidov
5a529f171c
Merge pull request #13988 from vitlibar/user-directories-mixed-style
Add storages from <user_directories> after ones from <users_config> and <access_control_path>.
2020-09-02 05:03:34 +03:00
alexey-milovidov
b100d7a911
Merge pull request #14087 from 243f6a8885a308d313198a2e037/patch-1
fixed Japanese translation for data-types/date.md
2020-09-02 05:01:01 +03:00
alexey-milovidov
8a2b06af74
Merge pull request #14185 from dreamerfable/master
Update MergeTree.md
2020-09-02 04:59:41 +03:00
alexey-milovidov
8c394a9828
Merge pull request #14213 from BayoNet/docs/CLICKHOUSEDOCS-744-collapsing-merge-tree
DOCS-744: Fixed the CollapsingMerge description
2020-09-02 04:59:22 +03:00
alexey-milovidov
08ed74732e
Merge pull request #14320 from bharatnc/ncb/fix-alter-live-lock
fix ALTER LIVE VIEW  [REFRESH] lock issue
2020-09-02 04:52:35 +03:00
alexey-milovidov
951bce5911
Merge pull request #14324 from ClickHouse/revert-13498-replacingmergetree_ver_datetime64
Revert "Documentation about ReplacingMergeTree extended with type DateTime64 for column `ver`"
2020-09-02 04:30:28 +03:00
Alexey Milovidov
56bbac1569 Trigger CI 2020-09-02 04:28:52 +03:00
Alexey Milovidov
443ed33ab3 Less number of threads in builder 2020-09-02 04:26:35 +03:00
alexey-milovidov
d58f6bd7c0
Merge pull request #14334 from ClickHouse/stop-threads-if-exception-in-pipeline-executor
Stop query execution if exception happened in PipelineExecutor itself.
2020-09-02 03:17:50 +03:00
Alexander Kuzmenkov
6c37fea17e
Merge pull request #14350 from ClickHouse/revert-14321-materialize_mysql_query_filter
Revert "Change query event filter and add integration test for empty GTID transaction"
2020-09-02 02:07:12 +03:00
Alexander Kuzmenkov
fa04b39d32
Revert "Change query event filter and add integration test for empty GTID transaction" 2020-09-02 02:06:53 +03:00
Alexander Kuzmenkov
f6cfb96748
Merge pull request #14346 from ClickHouse/aku/fuzzer
Don't let the fuzzer change max_execution_time
2020-09-02 01:59:50 +03:00
Anton Popov
7c3712c121
Merge pull request #13688 from it1804/master
Redis dictionary support for simple Redis requirepass authorization
2020-09-02 01:43:02 +03:00
Alexander Kuzmenkov
a6486490a2 performance comparison 2020-09-01 22:05:57 +03:00
Evgeniia Sudarikova
1259ded322 Add RU version 2020-09-01 22:02:11 +03:00
Evgeniia Sudarikova
f93edc5def Edit more text in EN version 2020-09-01 21:59:27 +03:00
romanzhukov
9591ae59cc DOCSUP-2031: Update by PR#11065 Disable ANY RIGHT and ANY FULL JOINs by default 2020-09-01 20:46:40 +03:00
romanzhukov
b67fde2b04 DOCSUP-2031: Update by PR#1130
Added description of the partial_merge_join_optimizations and partial_merge_join_rows_in_right_blocks settings.
2020-09-01 19:20:42 +03:00
bharatnc
f0d1c6c794 Merge remote-tracking branch 'upstream/master' into ncb/fix-alter-live-lock 2020-09-01 09:06:10 -07:00
bharatnc
120962b61a fix tests 2020-09-01 08:55:54 -07:00
Alexander Kuzmenkov
0b70abe542 Don't let the fuzzer change max_execution_time 2020-09-01 18:51:46 +03:00
Evgeniia Sudarikova
34a2beab7c Edited EN description 2020-09-01 18:03:43 +03:00
Alexander Kuzmenkov
949a41f8b5
Merge pull request #14321 from BohuTANG/materialize_mysql_query_filter
Change query event filter and add integration test for empty GTID transaction
2020-09-01 17:44:58 +03:00
Alexander Kuzmenkov
2f3bb5844a
Merge branch 'master' into suppress-wget-output 2020-09-01 16:59:04 +03:00
Alexander Kuzmenkov
4620ac4c0d
Update docker/test/fuzzer/run-fuzzer.sh 2020-09-01 16:57:20 +03:00
Alexander Kuzmenkov
4e58f00305
Update docker/test/fuzzer/run-fuzzer.sh 2020-09-01 16:57:13 +03:00
Alexander Kuzmenkov
73d433a7dd
Merge pull request #14316 from ClickHouse/aku/html-fuzzer
Add a HTML report for AST Fuzzer
2020-09-01 16:46:30 +03:00
tavplubix
cb4644ea6d
Merge pull request #14326 from ClickHouse/fix_crash_alter_table_function
Throw exception on alter for storages created from table functions
2020-09-01 15:03:09 +03:00
alesapin
dce57976c8
Merge pull request #14335 from qoega/fix-runner
Ignore unknown image names
2020-09-01 13:47:08 +03:00
Yatsishin Ilya
0af3f92bac Ignore unknown image names 2020-09-01 13:42:38 +03:00
Nikolai Kochetov
8fac595428 Stop query execution if exception happened in PipelineExecutor itself. 2020-09-01 13:29:10 +03:00
Artem Zuikov
d304d522cc
Refactoring: rename types to allow change bigint library (#14219) 2020-09-01 12:54:50 +03:00
BohuTANG
d604e84df3 ISSUES-14235 add mysql_5_7 and mysql_8_0 empty transaction tests 2020-09-01 16:37:58 +08:00
BohuTANG
453fb837d8 ISSUES-14235 change string.rfind to stringstarts_with 2020-09-01 16:25:15 +08:00
alesapin
a0b4cc78d6 Throw exception on alter for storages created from table functions 2020-09-01 10:26:31 +03:00
Azat Khuzhin
2d7cb03120 Suppress superfluous wget (-nv) output
Since for dowloading some of files wget logging may take 50% of overall
log [1].

  [1]: https://clickhouse-builds.s3.yandex.net/14315/c32ff4c98cb3b83a12f945eadd180415b7a3b269/clickhouse_build_check/build_log_761119955_1598923036.txt
2020-09-01 10:25:13 +03:00
Ivan Blinkov
679afe5ff2 Revert "Documentation about ReplacingMergeTree extended with type DateTime64 for column (#13498)"
This reverts commit 896b561523.
2020-09-01 10:06:23 +03:00