Commit Graph

47610 Commits

Author SHA1 Message Date
alexey-milovidov
821add088e
Fix backport script; read the code (#14433) 2020-09-03 09:57:01 +03:00
kssenii
e1ef558a2d Fixes 2020-09-03 06:50:20 +00:00
Alexey Milovidov
cd812d94de Wait for clickhouse-server to start in stateful tests 2020-09-03 04:54:50 +03:00
alexey-milovidov
9e4aa5954e
Update 00184_shard_distributed_group_by_no_merge.sql 2020-09-03 04:46:45 +03:00
alexey-milovidov
06edd217db
Update 01247_optimize_distributed_group_by_sharding_key.sql 2020-09-03 04:46:12 +03:00
alexey-milovidov
722e1bb81f
Update 01247_optimize_distributed_group_by_sharding_key_dist_on_dist.sql 2020-09-03 04:45:36 +03:00
alexey-milovidov
edea940e17
Update StorageDistributed.cpp 2020-09-03 04:39:36 +03:00
Alexey Milovidov
96038e9d54 Fix for Lazy database 2020-09-03 04:06:12 +03:00
Alexander Kuzmenkov
8e8e195e45 geomean 2020-09-03 03:58:40 +03:00
alexey-milovidov
123c12e895
Merge pull request #14426 from ClickHouse/less-number-of-threads-in-builder
Less number of threads in builder
2020-09-03 02:24:57 +03:00
alexey-milovidov
c323115fb1
Merge branch 'master' into less-number-of-threads-in-builder 2020-09-03 02:24:50 +03:00
Alexey Milovidov
b3addcd5ca Fix error 2020-09-03 02:24:03 +03:00
alexey-milovidov
d7983f0c2a
Merge pull request #14256 from dmthuc/fix_build_for_AppleClang
Fix build for AppleClang
2020-09-03 01:38:25 +03:00
alexey-milovidov
1c2435d4f7
Merge pull request #14233 from amosbird/apply
Introduce columns transformers.
2020-09-03 01:37:40 +03:00
alexey-milovidov
72417d2716
Merge pull request #14368 from BohuTANG/materialize_mysql_query_filter_1
change string.rfind to string starts_with and add some tests
2020-09-03 01:09:53 +03:00
alexey-milovidov
fe2ad36590
Merge pull request #14421 from ClickHouse/revert-14362-less-number-of-threads-in-builder
Revert "Less number of threads in builder"
2020-09-03 01:00:53 +03:00
alexey-milovidov
4b1b744644
Revert "Less number of threads in builder" 2020-09-03 01:00:41 +03:00
Azat Khuzhin
776688acc2 Add documentation for optimize_distributed_group_by_sharding_key 2020-09-03 00:54:11 +03:00
Azat Khuzhin
5e71fe3f39 Add a test for distributed_group_by_no_merge=2 2020-09-03 00:54:11 +03:00
Azat Khuzhin
fffeeeba06 Force WithMergeableStateAfterAggregation via distributed_group_by_no_merge (convert to UInt64)
Possible values:
- 1 - Do not merge aggregation states from different servers for distributed query processing - in case it is for certain that there are different keys on different shards.
- 2 - same as 1 but also apply ORDER BY and LIMIT stages
2020-09-03 00:52:51 +03:00
Azat Khuzhin
10b4f3b41f Optimize queries with LIMIT/LIMIT BY/ORDER BY for distributed with GROUP BY sharding_key
Previous set of QueryProcessingStage does not allow to do this.
But after WithMergeableStateAfterAggregation had been introduced the
following queries can be optimized too under
optimize_distributed_group_by_sharding_key:
- GROUP BY sharding_key LIMIT
- GROUP BY sharding_key LIMIT BY
- GROUP BY sharding_key ORDER BY

And right now it is still not supports:
- WITH TOTALS (looks like it can be supported)
- WITH ROLLUP (looks like it can be supported)
- WITH CUBE
- SETTINGS extremes=1 (looks like it can be supported)
But will be implemented separatelly.

vX: fixes
v2: fix WITH *
v3: fix extremes
v4: fix LIMIT OFFSET (and make a little bit cleaner)
v5: fix HAVING
v6: fix ORDER BY
v7: rebase against 20.7
v8: move out WithMergeableStateAfterAggregation
v9: add optimize_distributed_group_by_sharding_key into test names
2020-09-03 00:52:51 +03:00
Azat Khuzhin
4043be3121 Add new query processing stage WithMergeableStateAfterAggregation
Process query until the stage where the aggregate functions were
calculated and finalized.

It will be used for optimize_distributed_group_by_sharding_key.

v2: fix aliases
v3: Fix protocol ABI breakage due to WithMergeableStateAfterAggregation
    Conditions >= for QueryProcessingStage::Enum has been verified, and they
    are ok (in InterpreterSelectQuery).
2020-09-03 00:51:08 +03:00
alexey-milovidov
7bd31fb3d3
Merge pull request #14313 from ClickHouse/fix-fuzz-test6
Better check for tuple size in SSD cache complex key external dictionaries
2020-09-03 00:50:24 +03:00
alexey-milovidov
76aa1d15ad
Update CHANGELOG.md 2020-09-03 00:33:02 +03:00
alexey-milovidov
85cfebe47d
Update CHANGELOG.md 2020-09-03 00:32:32 +03:00
alexey-milovidov
6e004ac26f
Update CHANGELOG.md 2020-09-03 00:27:54 +03:00
alexey-milovidov
5b561cb53f
Merge pull request #14420 from ClickHouse/akz/changelog-20.7
Changelog.md updated with description for 20.7
2020-09-03 00:25:10 +03:00
alexey-milovidov
bda889e234
Update CHANGELOG.md 2020-09-03 00:24:58 +03:00
Matwey V. Kornilov
9b4da1e82f Add missed #include <atomic>
std::atomic<Data*> at line 199 requires including <atomic>
2020-09-02 23:40:27 +03:00
Alexander Kazakov
8e8d5fb89f Updated Changelog.md with description for 20.7 2020-09-02 23:25:50 +03:00
Alexander Kuzmenkov
3a7181cfcb
Merge pull request #14397 from zhang2014/fix/ISSUES-14114
ISSUES-14114 Implicitly convert primary key to not null in MaterializeMySQL
2020-09-02 23:12:33 +03:00
alesapin
dcbddbb8d0 Add recompression ttls tests and fix bugs 2020-09-02 19:15:41 +03:00
Ilya Yatsishin
a5e9449bc3
Merge branch 'master' into try-dns-fix 2020-09-02 19:01:30 +03:00
Yatsishin Ilya
3a661ba1b9 Merge remote-tracking branch 'qoega/try-dns-fix' into try-dns-fix 2020-09-02 17:38:28 +03:00
Yatsishin Ilya
c2ab85f214 Split tag part from image 2020-09-02 17:36:25 +03:00
Yatsishin Ilya
fda89095cc Split tag part from image 2020-09-02 17:22:54 +03:00
alexey-milovidov
8e2fba5be1
Merge pull request #12567 from amosbird/fmi
table function view
2020-09-02 17:07:57 +03:00
Alexey Milovidov
95493352fe Remove wrong checks 2020-09-02 17:07:25 +03:00
Nikita Mikhaylov
cdb1f30630 style + fast test 2020-09-02 16:49:47 +03:00
Yatsishin Ilya
84a3812506 Merge remote-tracking branch 'qoega/integration-explicit-configs' into integration-explicit-configs 2020-09-02 16:35:56 +03:00
Ilya Yatsishin
7c539cb974
Merge pull request #14348 from ka1bi4/romanzhukov-DOCSUP-2031-pr-translation
DOCSUP-2031: Edit and translate PR to Russian.
2020-09-02 16:13:16 +03:00
Nikolai Kochetov
92c937db8b Remove CreatingSetsBlockInputStream 2020-09-02 16:13:13 +03:00
Ilya Yatsishin
e94a2f2489
Merge pull request #14349 from otrazhenia/evgsudarikova-DOCSUP-2003
DOCSUP-2003: Edit and translate to Russian RabbitMQ description
2020-09-02 16:07:18 +03:00
Nikolai Kochetov
acfd35a908 Update QueryPipeline::addCreatingSetsTransform 2020-09-02 16:04:54 +03:00
Ilya Yatsishin
136e7aa33d
Merge pull request #14362 from ClickHouse/less-number-of-threads-in-builder
Less number of threads in builder
2020-09-02 16:01:00 +03:00
Nikita Mikhaylov
7021f6edc1 better
(cherry picked from commit 81481f26b5)
2020-09-02 15:47:23 +03:00
Nikita Mikhaylov
e9a1f4a383 update ya.make
(cherry picked from commit e62043e83b)
(cherry picked from commit a850388e62)
2020-09-02 15:47:17 +03:00
Nikita Mikhaylov
eee19dada4 fixes + test
(cherry picked from commit 5daee1cae1)
(cherry picked from commit c3dfb8e838)
2020-09-02 15:47:09 +03:00
antikvist
a695344434 rank corr
(cherry picked from commit 649e4dd913)
(cherry picked from commit ae17810201)
2020-09-02 15:46:42 +03:00
antikvist
efc59d6686 rank corr
(cherry picked from commit 11c94bee69)
(cherry picked from commit 483409f2e1)
2020-09-02 15:46:29 +03:00