Azat Khuzhin
10b4f3b41f
Optimize queries with LIMIT/LIMIT BY/ORDER BY for distributed with GROUP BY sharding_key
...
Previous set of QueryProcessingStage does not allow to do this.
But after WithMergeableStateAfterAggregation had been introduced the
following queries can be optimized too under
optimize_distributed_group_by_sharding_key:
- GROUP BY sharding_key LIMIT
- GROUP BY sharding_key LIMIT BY
- GROUP BY sharding_key ORDER BY
And right now it is still not supports:
- WITH TOTALS (looks like it can be supported)
- WITH ROLLUP (looks like it can be supported)
- WITH CUBE
- SETTINGS extremes=1 (looks like it can be supported)
But will be implemented separatelly.
vX: fixes
v2: fix WITH *
v3: fix extremes
v4: fix LIMIT OFFSET (and make a little bit cleaner)
v5: fix HAVING
v6: fix ORDER BY
v7: rebase against 20.7
v8: move out WithMergeableStateAfterAggregation
v9: add optimize_distributed_group_by_sharding_key into test names
2020-09-03 00:52:51 +03:00
Azat Khuzhin
4043be3121
Add new query processing stage WithMergeableStateAfterAggregation
...
Process query until the stage where the aggregate functions were
calculated and finalized.
It will be used for optimize_distributed_group_by_sharding_key.
v2: fix aliases
v3: Fix protocol ABI breakage due to WithMergeableStateAfterAggregation
Conditions >= for QueryProcessingStage::Enum has been verified, and they
are ok (in InterpreterSelectQuery).
2020-09-03 00:51:08 +03:00
alexey-milovidov
8e2fba5be1
Merge pull request #12567 from amosbird/fmi
...
table function view
2020-09-02 17:07:57 +03:00
Ilya Yatsishin
7c539cb974
Merge pull request #14348 from ka1bi4/romanzhukov-DOCSUP-2031-pr-translation
...
DOCSUP-2031: Edit and translate PR to Russian.
2020-09-02 16:13:16 +03:00
Ilya Yatsishin
e94a2f2489
Merge pull request #14349 from otrazhenia/evgsudarikova-DOCSUP-2003
...
DOCSUP-2003: Edit and translate to Russian RabbitMQ description
2020-09-02 16:07:18 +03:00
Ilya Yatsishin
136e7aa33d
Merge pull request #14362 from ClickHouse/less-number-of-threads-in-builder
...
Less number of threads in builder
2020-09-02 16:01:00 +03:00
alesapin
12f76d9448
Merge pull request #14325 from azat/suppress-wget-output
...
Suppress superfluous wget (-nv) output
2020-09-02 14:59:28 +03:00
Nikolai Kochetov
811e44a937
Merge pull request #14315 from azat/EXPLAIN-SIGSEGV-fix
...
[RFC] Fix QueryPlan lifetime (for EXPLAIN PIPELINE graph=1) for queries with nested interpreter
2020-09-02 12:46:59 +03:00
Amos Bird
6bd753d85d
TableFunction view.
2020-09-02 16:02:10 +08:00
alexey-milovidov
adf50fd774
Merge pull request #13761 from zhang2014/improvement/date_time
...
ISSUES-4006 add precision argument for DateTime type
2020-09-02 05:12:35 +03:00
alexey-milovidov
2d85213629
Merge pull request #13792 from azat/lambda-arrayJoin-fix
...
[RFC] Fix arrayJoin() capturing in lambda
2020-09-02 05:10:58 +03:00
alexey-milovidov
bfa5a9ef03
Merge pull request #13987 from vitlibar/fix-grant-all-on-table
...
Fix GRANT ALL statement when executed on a non-global level
2020-09-02 05:06:32 +03:00
alexey-milovidov
04c88ca9e4
Update AccessFlags.h
2020-09-02 05:06:21 +03:00
alexey-milovidov
5a529f171c
Merge pull request #13988 from vitlibar/user-directories-mixed-style
...
Add storages from <user_directories> after ones from <users_config> and <access_control_path>.
2020-09-02 05:03:34 +03:00
alexey-milovidov
b100d7a911
Merge pull request #14087 from 243f6a8885a308d313198a2e037/patch-1
...
fixed Japanese translation for data-types/date.md
2020-09-02 05:01:01 +03:00
alexey-milovidov
8a2b06af74
Merge pull request #14185 from dreamerfable/master
...
Update MergeTree.md
2020-09-02 04:59:41 +03:00
alexey-milovidov
8c394a9828
Merge pull request #14213 from BayoNet/docs/CLICKHOUSEDOCS-744-collapsing-merge-tree
...
DOCS-744: Fixed the CollapsingMerge description
2020-09-02 04:59:22 +03:00
alexey-milovidov
08ed74732e
Merge pull request #14320 from bharatnc/ncb/fix-alter-live-lock
...
fix ALTER LIVE VIEW [REFRESH] lock issue
2020-09-02 04:52:35 +03:00
alexey-milovidov
951bce5911
Merge pull request #14324 from ClickHouse/revert-13498-replacingmergetree_ver_datetime64
...
Revert "Documentation about ReplacingMergeTree extended with type DateTime64 for column `ver`"
2020-09-02 04:30:28 +03:00
Alexey Milovidov
56bbac1569
Trigger CI
2020-09-02 04:28:52 +03:00
Alexey Milovidov
443ed33ab3
Less number of threads in builder
2020-09-02 04:26:35 +03:00
alexey-milovidov
d58f6bd7c0
Merge pull request #14334 from ClickHouse/stop-threads-if-exception-in-pipeline-executor
...
Stop query execution if exception happened in PipelineExecutor itself.
2020-09-02 03:17:50 +03:00
Alexander Kuzmenkov
6c37fea17e
Merge pull request #14350 from ClickHouse/revert-14321-materialize_mysql_query_filter
...
Revert "Change query event filter and add integration test for empty GTID transaction"
2020-09-02 02:07:12 +03:00
Alexander Kuzmenkov
fa04b39d32
Revert "Change query event filter and add integration test for empty GTID transaction"
2020-09-02 02:06:53 +03:00
Alexander Kuzmenkov
f6cfb96748
Merge pull request #14346 from ClickHouse/aku/fuzzer
...
Don't let the fuzzer change max_execution_time
2020-09-02 01:59:50 +03:00
Anton Popov
7c3712c121
Merge pull request #13688 from it1804/master
...
Redis dictionary support for simple Redis requirepass authorization
2020-09-02 01:43:02 +03:00
Alexander Kuzmenkov
a6486490a2
performance comparison
2020-09-01 22:05:57 +03:00
Evgeniia Sudarikova
1259ded322
Add RU version
2020-09-01 22:02:11 +03:00
Evgeniia Sudarikova
f93edc5def
Edit more text in EN version
2020-09-01 21:59:27 +03:00
romanzhukov
9591ae59cc
DOCSUP-2031: Update by PR#11065 Disable ANY RIGHT and ANY FULL JOINs by default
2020-09-01 20:46:40 +03:00
romanzhukov
b67fde2b04
DOCSUP-2031: Update by PR#1130
...
Added description of the partial_merge_join_optimizations and partial_merge_join_rows_in_right_blocks settings.
2020-09-01 19:20:42 +03:00
bharatnc
f0d1c6c794
Merge remote-tracking branch 'upstream/master' into ncb/fix-alter-live-lock
2020-09-01 09:06:10 -07:00
bharatnc
120962b61a
fix tests
2020-09-01 08:55:54 -07:00
Alexander Kuzmenkov
0b70abe542
Don't let the fuzzer change max_execution_time
2020-09-01 18:51:46 +03:00
Evgeniia Sudarikova
34a2beab7c
Edited EN description
2020-09-01 18:03:43 +03:00
Alexander Kuzmenkov
949a41f8b5
Merge pull request #14321 from BohuTANG/materialize_mysql_query_filter
...
Change query event filter and add integration test for empty GTID transaction
2020-09-01 17:44:58 +03:00
Alexander Kuzmenkov
2f3bb5844a
Merge branch 'master' into suppress-wget-output
2020-09-01 16:59:04 +03:00
Alexander Kuzmenkov
4620ac4c0d
Update docker/test/fuzzer/run-fuzzer.sh
2020-09-01 16:57:20 +03:00
Alexander Kuzmenkov
4e58f00305
Update docker/test/fuzzer/run-fuzzer.sh
2020-09-01 16:57:13 +03:00
Alexander Kuzmenkov
73d433a7dd
Merge pull request #14316 from ClickHouse/aku/html-fuzzer
...
Add a HTML report for AST Fuzzer
2020-09-01 16:46:30 +03:00
tavplubix
cb4644ea6d
Merge pull request #14326 from ClickHouse/fix_crash_alter_table_function
...
Throw exception on alter for storages created from table functions
2020-09-01 15:03:09 +03:00
alesapin
dce57976c8
Merge pull request #14335 from qoega/fix-runner
...
Ignore unknown image names
2020-09-01 13:47:08 +03:00
Yatsishin Ilya
0af3f92bac
Ignore unknown image names
2020-09-01 13:42:38 +03:00
Nikolai Kochetov
8fac595428
Stop query execution if exception happened in PipelineExecutor itself.
2020-09-01 13:29:10 +03:00
Artem Zuikov
d304d522cc
Refactoring: rename types to allow change bigint library ( #14219 )
2020-09-01 12:54:50 +03:00
BohuTANG
d604e84df3
ISSUES-14235 add mysql_5_7 and mysql_8_0 empty transaction tests
2020-09-01 16:37:58 +08:00
BohuTANG
453fb837d8
ISSUES-14235 change string.rfind to stringstarts_with
2020-09-01 16:25:15 +08:00
alesapin
a0b4cc78d6
Throw exception on alter for storages created from table functions
2020-09-01 10:26:31 +03:00
Azat Khuzhin
2d7cb03120
Suppress superfluous wget (-nv) output
...
Since for dowloading some of files wget logging may take 50% of overall
log [1].
[1]: https://clickhouse-builds.s3.yandex.net/14315/c32ff4c98cb3b83a12f945eadd180415b7a3b269/clickhouse_build_check/build_log_761119955_1598923036.txt
2020-09-01 10:25:13 +03:00
Ivan Blinkov
679afe5ff2
Revert "Documentation about ReplacingMergeTree extended with type DateTime64 for column ( #13498 )"
...
This reverts commit 896b561523
.
2020-09-01 10:06:23 +03:00