Commit Graph

47353 Commits

Author SHA1 Message Date
alexey-milovidov
06edd217db
Update 01247_optimize_distributed_group_by_sharding_key.sql 2020-09-03 04:46:12 +03:00
alexey-milovidov
722e1bb81f
Update 01247_optimize_distributed_group_by_sharding_key_dist_on_dist.sql 2020-09-03 04:45:36 +03:00
alexey-milovidov
edea940e17
Update StorageDistributed.cpp 2020-09-03 04:39:36 +03:00
Alexey Milovidov
96038e9d54 Fix for Lazy database 2020-09-03 04:06:12 +03:00
Alexander Kuzmenkov
8e8e195e45 geomean 2020-09-03 03:58:40 +03:00
alexey-milovidov
123c12e895
Merge pull request #14426 from ClickHouse/less-number-of-threads-in-builder
Less number of threads in builder
2020-09-03 02:24:57 +03:00
alexey-milovidov
c323115fb1
Merge branch 'master' into less-number-of-threads-in-builder 2020-09-03 02:24:50 +03:00
Alexey Milovidov
b3addcd5ca Fix error 2020-09-03 02:24:03 +03:00
alexey-milovidov
d7983f0c2a
Merge pull request #14256 from dmthuc/fix_build_for_AppleClang
Fix build for AppleClang
2020-09-03 01:38:25 +03:00
alexey-milovidov
1c2435d4f7
Merge pull request #14233 from amosbird/apply
Introduce columns transformers.
2020-09-03 01:37:40 +03:00
alexey-milovidov
72417d2716
Merge pull request #14368 from BohuTANG/materialize_mysql_query_filter_1
change string.rfind to string starts_with and add some tests
2020-09-03 01:09:53 +03:00
alexey-milovidov
fe2ad36590
Merge pull request #14421 from ClickHouse/revert-14362-less-number-of-threads-in-builder
Revert "Less number of threads in builder"
2020-09-03 01:00:53 +03:00
alexey-milovidov
4b1b744644
Revert "Less number of threads in builder" 2020-09-03 01:00:41 +03:00
Azat Khuzhin
776688acc2 Add documentation for optimize_distributed_group_by_sharding_key 2020-09-03 00:54:11 +03:00
Azat Khuzhin
5e71fe3f39 Add a test for distributed_group_by_no_merge=2 2020-09-03 00:54:11 +03:00
Azat Khuzhin
fffeeeba06 Force WithMergeableStateAfterAggregation via distributed_group_by_no_merge (convert to UInt64)
Possible values:
- 1 - Do not merge aggregation states from different servers for distributed query processing - in case it is for certain that there are different keys on different shards.
- 2 - same as 1 but also apply ORDER BY and LIMIT stages
2020-09-03 00:52:51 +03:00
Azat Khuzhin
10b4f3b41f Optimize queries with LIMIT/LIMIT BY/ORDER BY for distributed with GROUP BY sharding_key
Previous set of QueryProcessingStage does not allow to do this.
But after WithMergeableStateAfterAggregation had been introduced the
following queries can be optimized too under
optimize_distributed_group_by_sharding_key:
- GROUP BY sharding_key LIMIT
- GROUP BY sharding_key LIMIT BY
- GROUP BY sharding_key ORDER BY

And right now it is still not supports:
- WITH TOTALS (looks like it can be supported)
- WITH ROLLUP (looks like it can be supported)
- WITH CUBE
- SETTINGS extremes=1 (looks like it can be supported)
But will be implemented separatelly.

vX: fixes
v2: fix WITH *
v3: fix extremes
v4: fix LIMIT OFFSET (and make a little bit cleaner)
v5: fix HAVING
v6: fix ORDER BY
v7: rebase against 20.7
v8: move out WithMergeableStateAfterAggregation
v9: add optimize_distributed_group_by_sharding_key into test names
2020-09-03 00:52:51 +03:00
Azat Khuzhin
4043be3121 Add new query processing stage WithMergeableStateAfterAggregation
Process query until the stage where the aggregate functions were
calculated and finalized.

It will be used for optimize_distributed_group_by_sharding_key.

v2: fix aliases
v3: Fix protocol ABI breakage due to WithMergeableStateAfterAggregation
    Conditions >= for QueryProcessingStage::Enum has been verified, and they
    are ok (in InterpreterSelectQuery).
2020-09-03 00:51:08 +03:00
alexey-milovidov
7bd31fb3d3
Merge pull request #14313 from ClickHouse/fix-fuzz-test6
Better check for tuple size in SSD cache complex key external dictionaries
2020-09-03 00:50:24 +03:00
alexey-milovidov
76aa1d15ad
Update CHANGELOG.md 2020-09-03 00:33:02 +03:00
alexey-milovidov
85cfebe47d
Update CHANGELOG.md 2020-09-03 00:32:32 +03:00
alexey-milovidov
6e004ac26f
Update CHANGELOG.md 2020-09-03 00:27:54 +03:00
alexey-milovidov
5b561cb53f
Merge pull request #14420 from ClickHouse/akz/changelog-20.7
Changelog.md updated with description for 20.7
2020-09-03 00:25:10 +03:00
alexey-milovidov
bda889e234
Update CHANGELOG.md 2020-09-03 00:24:58 +03:00
Matwey V. Kornilov
9b4da1e82f Add missed #include <atomic>
std::atomic<Data*> at line 199 requires including <atomic>
2020-09-02 23:40:27 +03:00
Alexander Kazakov
8e8d5fb89f Updated Changelog.md with description for 20.7 2020-09-02 23:25:50 +03:00
Alexander Kuzmenkov
3a7181cfcb
Merge pull request #14397 from zhang2014/fix/ISSUES-14114
ISSUES-14114 Implicitly convert primary key to not null in MaterializeMySQL
2020-09-02 23:12:33 +03:00
alesapin
dcbddbb8d0 Add recompression ttls tests and fix bugs 2020-09-02 19:15:41 +03:00
Ilya Yatsishin
a5e9449bc3
Merge branch 'master' into try-dns-fix 2020-09-02 19:01:30 +03:00
Yatsishin Ilya
3a661ba1b9 Merge remote-tracking branch 'qoega/try-dns-fix' into try-dns-fix 2020-09-02 17:38:28 +03:00
Yatsishin Ilya
c2ab85f214 Split tag part from image 2020-09-02 17:36:25 +03:00
Yatsishin Ilya
fda89095cc Split tag part from image 2020-09-02 17:22:54 +03:00
alexey-milovidov
8e2fba5be1
Merge pull request #12567 from amosbird/fmi
table function view
2020-09-02 17:07:57 +03:00
Alexey Milovidov
95493352fe Remove wrong checks 2020-09-02 17:07:25 +03:00
Yatsishin Ilya
84a3812506 Merge remote-tracking branch 'qoega/integration-explicit-configs' into integration-explicit-configs 2020-09-02 16:35:56 +03:00
Ilya Yatsishin
7c539cb974
Merge pull request #14348 from ka1bi4/romanzhukov-DOCSUP-2031-pr-translation
DOCSUP-2031: Edit and translate PR to Russian.
2020-09-02 16:13:16 +03:00
Ilya Yatsishin
e94a2f2489
Merge pull request #14349 from otrazhenia/evgsudarikova-DOCSUP-2003
DOCSUP-2003: Edit and translate to Russian RabbitMQ description
2020-09-02 16:07:18 +03:00
Ilya Yatsishin
136e7aa33d
Merge pull request #14362 from ClickHouse/less-number-of-threads-in-builder
Less number of threads in builder
2020-09-02 16:01:00 +03:00
alexey-milovidov
09850dbdbc
Update ASTColumnsTransformers.cpp 2020-09-02 15:39:34 +03:00
Yatsishin Ilya
8f50a6769d Fix bad merge 2020-09-02 15:28:47 +03:00
alexey-milovidov
c009ace7a2
Update StorageSystemEvents.cpp 2020-09-02 15:28:29 +03:00
alexey-milovidov
4c039002f9
Update Obfuscator.cpp 2020-09-02 15:27:15 +03:00
alesapin
128cb7ce22 Don't select already selected parts 2020-09-02 15:16:12 +03:00
alesapin
12f76d9448
Merge pull request #14325 from azat/suppress-wget-output
Suppress superfluous wget (-nv) output
2020-09-02 14:59:28 +03:00
Dmitry
13ba8cd5a7 fixed spaces 2020-09-02 14:25:11 +03:00
Dmitry
c32c83f653 added include 2020-09-02 14:20:20 +03:00
Dmitry
a04c8bb095 fixes 2020-09-02 14:18:24 +03:00
Dmitry
0e4c9ff9a8 Added UUID to Obfuscator 2020-09-02 14:14:49 +03:00
alesapin
06b38a4d44 Remove cerr 2020-09-02 13:31:31 +03:00
alesapin
aac466ab1c Merge branch 'better_ttl_merges_selection' into recompression_in_background 2020-09-02 13:30:04 +03:00