Commit Graph

343 Commits

Author SHA1 Message Date
Nikolai Kochetov
41a3fad1ea Allow many rows in totals. 2020-09-04 15:34:36 +03:00
Nikolai Kochetov
b7e53208d1 Fix tests. 2020-09-04 11:36:47 +03:00
Nikolai Kochetov
acfd35a908 Update QueryPipeline::addCreatingSetsTransform 2020-09-02 16:04:54 +03:00
Nikolai Kochetov
f82b799f12 Update CreatingSetsTransform. 2020-09-01 16:53:11 +03:00
Mark Papadakis
ff76790a59
Update AggregatingTransform.cpp
Replaced redundant call to chunk.getNumRows() with local var.
2020-08-28 16:08:06 +03:00
Nikolai Kochetov
7c0fcb2039
Merge pull request #13611 from ClickHouse/array-join-processor
Refactor ARRAY JOIN
2020-08-20 17:56:37 +03:00
Nikolai Kochetov
8e631a98ea Refactor ActionsChain. 2020-08-14 21:24:58 +03:00
Nikolai Kochetov
95bbda3667 Specify columns after ARRAY JOIN and JOIN.
Add ArrayJoinTransform and ArrayJoinStep.
2020-08-14 21:24:03 +03:00
Nikolai Kochetov
9b67cd9faf Merge branch 'master' into refactor-pipes-3 2020-08-10 10:50:17 +03:00
Alexey Milovidov
edd89a8610 Fix half of typos 2020-08-08 03:47:03 +03:00
Anton Popov
e7d3154d38 fix queries with order by prefix of primary key and constant columns 2020-08-06 02:37:39 +03:00
Nikolai Kochetov
9385f3de0e Refactor Pipe [part 4]. 2020-08-04 16:06:59 +03:00
alexey-milovidov
91156bef54
Merge pull request #13075 from ClickHouse/fix-11327
Fix 11327
2020-07-31 14:53:07 +03:00
Nikolai Kochetov
3306a24273
Update ConvertingTransform.h 2020-07-31 14:11:03 +03:00
Nikolai Kochetov
fdc49cadb7 Ignore constants for remote query from local replica. 2020-07-29 15:51:59 +03:00
Alexander Kuzmenkov
f6f2812f73 Block structure mismatch is a program error 2020-07-28 21:35:18 +03:00
Nikolai Kochetov
cc7ebfac78 Fix Pipeline stuck for external sort. 2020-07-21 12:23:54 +03:00
Alexey Milovidov
ef930df484 Avoid overflow in LIMIT #10470 #11372 2020-07-12 08:18:01 +03:00
Anton Popov
1122d99ba8 fix order of columns in WITH FILL modifier 2020-07-09 02:56:44 +03:00
Alexey Milovidov
9c53a90e3d Non-significant changes 2020-07-08 06:16:20 +03:00
Nikolai Kochetov
8587c2025d Merge branch 'master' into initial-explain 2020-06-29 23:35:56 +03:00
Nikolai Kochetov
40b398c8c4 Merge branch 'master' into better-distinct-for-query-plan 2020-06-29 11:14:05 +03:00
Nikolai Kochetov
893a75bcf7 Merge branch 'master' into initial-explain 2020-06-27 12:45:40 +03:00
Nikolai Kochetov
ca01094f4b More actions description. 2020-06-27 12:31:11 +03:00
Artem Zuikov
54fd9ce76b fix totals 2020-06-26 03:23:11 +03:00
Artem Zuikov
2d7d389b77 better ExpressionAction::execute() 2020-06-25 23:28:41 +03:00
Artem Zuikov
bfe30a9723 remove a trick with expression continuation 2020-06-25 22:26:03 +03:00
Nikolai Kochetov
d7d334bf6f Update query plan traits for DISTINCT. Add more comments. 2020-06-22 13:18:28 +03:00
alesapin
b9e74f4e82 Merge branch 'master' into atomic_metadata5 2020-06-22 12:03:53 +03:00
Nikolai Kochetov
4d70cc34c1 Merge branch 'master' into query-plan 2020-06-20 10:53:48 +03:00
alesapin
a462462610 Merge branch 'master' into atomic_metadata5 2020-06-19 18:58:42 +03:00
Nikolai Kochetov
690b88d331
Merge pull request #11291 from Provet/master
Partial sorting optimization fix
2020-06-19 12:58:44 +03:00
Nikolai Kochetov
cda4de40d7 Merge branch 'master' into query-plan 2020-06-19 11:29:15 +03:00
Nikolai Kochetov
c111836ada Update PartialSortingTransform. 2020-06-18 12:08:25 +03:00
alesapin
ebb36bec8a Merge branch 'master' into atomic_metadata5 2020-06-18 11:57:16 +03:00
alexey-milovidov
c9924b8aa1
Merge pull request #11697 from CurtizJ/fix-with-fill
Fix 'ORDER BY ... WITH FILL' over const columns.
2020-06-18 06:38:24 +03:00
Nikolai Kochetov
38bebfb20d Merge remote-tracking branch 'origin' into provert-master 2020-06-17 22:05:45 +03:00
Nikolai Kochetov
c5d9379df0 Add TotalsHavingStep. 2020-06-17 19:54:51 +03:00
Nikolai Kochetov
ce7c8782e2
Update PartialSortingTransform.cpp 2020-06-17 19:13:44 +03:00
Nikolai Kochetov
1ad4f2c0fd Add CreatingSets step. 2020-06-17 18:50:21 +03:00
Nikolai Kochetov
6c477d06ad Review fixes. 2020-06-17 14:43:55 +03:00
alesapin
2fac3290f0 Merge branch 'master' into atomic_metadata5 2020-06-17 11:14:03 +03:00
Artem Zuikov
857d84bf7c
Buffer left blocks optimisation for MergeJoin (#10601) 2020-06-16 23:13:18 +03:00
Anton Popov
03058c3c25 fix 'ORDER BY WITH FILL' over const columns 2020-06-16 05:56:16 +03:00
Nikolai Kochetov
03e0a5ddbc Merge branch 'master' into query-plan 2020-06-15 23:38:35 +03:00
alesapin
36ba0192df Metadata in read and write methods of IStorage 2020-06-15 22:08:58 +03:00
Nikolai Kochetov
b725df6366 Added ReadFromStorageStep. 2020-06-15 18:17:44 +03:00
Dmitry
e5897bbfb6 size_t -> ssize_t 2020-06-12 18:59:11 +03:00
Anton Popov
5c42408add
Merge pull request #9113 from dimarub2000/group_by_in_order_optimization
[WIP] Optimization of GROUP BY with respect to table sorting key.
2020-06-06 14:25:59 +03:00
Albert Kidrachev
60b86f524f add perf-test and fix 2020-06-04 20:10:52 +03:00
Albert Kidrachev
ae7bad368b run optimization for limit >= 1500 and hint for comparing ColumnString 2020-06-04 01:50:58 +03:00
Anton Popov
5348e5a746
Fix build 2020-06-04 00:58:51 +03:00
Alexander Kuzmenkov
8bf8b44510
Merge pull request #11366 from ClickHouse/fix-SortingTransform-bug
Fix sorting transform bug
2020-06-03 12:11:57 +03:00
Dmitry
5391d26703 better logging 2020-06-02 23:38:10 +03:00
Nikolai Kochetov
46493b9878 Fix PartialSortingTransform. 2020-06-02 14:56:58 +03:00
Nikolai Kochetov
ecdbd888cf Clase all inputs in SortingTransform. 2020-06-02 13:50:27 +03:00
Nikolai Kochetov
cc3abb12d3 Disable filtration for PartialSortingTransform 2020-06-02 11:28:57 +03:00
Nikolai Kochetov
fded020cdc Fix build. 2020-06-02 10:53:55 +03:00
Albert Kidrachev
d717919c0c some improvements of vectorization compare 2020-06-02 03:23:41 +03:00
Nikolai Kochetov
53d12f5ab8 Try fix build. 2020-06-01 20:06:21 +03:00
Nikolai Kochetov
3a0acb00c1 Remove some streams. 2020-06-01 19:31:06 +03:00
Albert Kidrachev
02611de051 merge 2020-06-01 15:11:36 +03:00
Albert Kidrachev
fe170508bd devirtualize compareAt calls 2020-06-01 15:10:32 +03:00
Alexey Milovidov
25f941020b Remove namespace pollution 2020-05-31 00:57:37 +03:00
Alexey Milovidov
5aff138956 Preparation for structured logging 2020-05-31 00:35:52 +03:00
Dmitry
4b0d32f026 Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-05-31 00:21:02 +03:00
Nikolai Kochetov
f7e0e87c7d Try fix tests. 2020-05-29 19:35:09 +03:00
Albert Kidrachev
c91ca6fd4b fix optimization, add comments and performance test 2020-05-29 04:50:02 +03:00
Albert Kidrachev
c38caafe93 fix tests 2020-05-28 11:55:20 +03:00
Albert Kidrachev
fedf1f5dd2 more relaxation 2020-05-28 11:55:20 +03:00
Albert Kidrachev
e24e6257c7 fix 2020-05-28 11:55:20 +03:00
Albert Kidrachev
e51e828d5c init 2020-05-28 11:55:20 +03:00
Albert Kidrachev
4c5324600b fix tests 2020-05-27 18:38:29 +03:00
Albert Kidrachev
a727e1fb1b more relaxation 2020-05-27 15:57:14 +03:00
Albert Kidrachev
d24286d5da fix 2020-05-27 14:52:45 +03:00
Dmitry
112e86b134 small fix 2020-05-26 22:20:02 +03:00
Dmitry
38c585f867 Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-05-26 21:27:50 +03:00
Albert Kidrachev
96260cf33a init 2020-05-25 02:56:24 +03:00
Alexey Milovidov
7e1813825b Return old names of macros 2020-05-24 01:24:01 +03:00
Alexey Milovidov
bab24879e9 Progress on task 2020-05-24 00:16:05 +03:00
Alexey Milovidov
d2621fee30 Progress on task 2020-05-23 23:57:48 +03:00
Alexey Milovidov
d5b7883451 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_[^\_(]+\([^,]+, "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+"\);' | xargs sed -i -r -e 's/(LOG_[^\_(]+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)"\);/\1_FORMATTED(\2, "\3{}\5{}\7{}\9", \4, \6, \8);/' 2020-05-23 22:41:08 +03:00
Alexey Milovidov
eacff92d0e Progress on task 2020-05-23 22:35:08 +03:00
Alexey Milovidov
9d2a0d2dd7 Apply all transformations again 2020-05-23 21:59:49 +03:00
Alexey Milovidov
a2ad11897f Remove duplicate whitespaces (preparation) 2020-05-23 21:53:58 +03:00
Alexey Milovidov
1f13515a65 Make all LOG in single line (preparation) 2020-05-23 21:31:37 +03:00
Alexey Milovidov
45b6abdfee Progress on task 2020-05-23 21:22:40 +03:00
Alexey Milovidov
9d24908e53 Progress on task 2020-05-23 20:52:11 +03:00
Alexey Milovidov
f69cbdcbfc find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" \+ [^+]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" \+ ([^+]+)\);/\1_FORMATTED(\2, "\3{}", \4);/' 2020-05-23 20:09:37 +03:00
Alexey Milovidov
e391b77d81 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+ << "[^"]+"\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)"\);/\1_FORMATTED(\2, "\3{}\5", \4);/' 2020-05-23 19:56:05 +03:00
Alexey Milovidov
8d2e80a5e2 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+"\)' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+, "[^"]+")\)/\1_FORMATTED(\2)/' 2020-05-23 19:42:39 +03:00
Dmitry
47778c0259 Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-05-21 23:45:12 +03:00
Dmitry
ee22a3ad30 Adding Info in FinalizingSimpleTransform 2020-05-21 23:34:53 +03:00
alexey-milovidov
7efd2a825f
Merge pull request #10463 from ClickHouse/parallel-final
Parallel final
2020-05-18 05:20:18 +03:00
alexey-milovidov
327a48bcf9
Update AddingSelectorTransform.h 2020-05-18 05:19:08 +03:00
Alexey Milovidov
c33373f7fb Minor modification 2020-05-17 10:43:23 +03:00
Alexey Milovidov
de8120d69a Improvement; added a test 2020-05-17 10:17:54 +03:00
Alexey Milovidov
c06995c03c Whitespaces 2020-05-17 09:47:53 +03:00
Dmitry
a597e62d3b nested_columns_holder is not destoyed 2020-05-15 22:27:18 +03:00
Dmitry
bef37517b8 fixes after reivew 2 2020-05-14 17:20:49 +03:00
Nikolai Kochetov
4d22374f24 Merged with master. 2020-05-14 12:06:15 +03:00
Nikolai Kochetov
4d0503f021 Make IColumn::mutate() static. 2020-05-14 11:30:18 +03:00
Nikolai Kochetov
f65305878b
Destructive IAggregateFunction::insertResultInto and ColumnAggregateFunction::convertToValues (#10890)
* Destructive IAggregateFunction::insertResultInto and ColumnAggregateFunction::convertToValues

* Try fix build.

* Try fix build.

* Fix build.

* Make convertToValues static.

* fix build.

* Remove const casts.

* Added comment.

* Fix build.

* Fix build.

* Add test.

* Fix test.
2020-05-14 10:59:14 +03:00
Dmitry
bbe0245b9d changes after review #1 2020-05-13 16:49:10 +03:00
Dmitry
c4295d97f9 Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-05-12 17:57:32 +03:00
Dmitry
3ec80b5531 now aggregates in parallel 2020-05-12 17:50:13 +03:00
alexey-milovidov
40ef113503
Merge branch 'master' into parallel-final 2020-05-11 06:47:44 +03:00
Dmitry
0286b60ed6 return multiple blocks 2020-05-08 22:46:52 +03:00
Dmitry
015a3555c6 small fixes 2020-05-08 16:28:18 +03:00
Dmitry
e7b747b0b7 limit fixes + func(primary_key) group by works 2020-05-08 16:13:50 +03:00
Dmitry
465dfe47fc fixed faults on LC 2020-05-07 23:13:51 +03:00
Dmitry
7bbb85dbe5 small fixes 2020-05-07 18:37:19 +03:00
Dmitry
0883dd67d3 removed some code duplication 2020-05-07 17:54:15 +03:00
Nikolai Kochetov
152923aaa4
Merge pull request #10667 from palasonic1/palasonic-fix-params-order
fix order of params in AggregatingTransform constructor
2020-05-06 21:47:41 +03:00
alexey-milovidov
e4b3234df9
Merge pull request #10664 from ClickHouse/fix-10655
Fix 10655
2020-05-06 21:34:10 +03:00
alexey-milovidov
f2705cf608
Merge pull request #10698 from ClickHouse/fix-10674
Do not filter totals
2020-05-06 21:30:11 +03:00
Nikolai Kochetov
c72b0a45bc Do not filter totals. 2020-05-06 14:30:17 +03:00
Dmitry
e98c23a8cf read in order enabled 2020-05-05 17:35:23 +03:00
Maxim Serebryakov
3691400a60 fix order of params in AggregatingTransform 2020-05-04 23:26:33 +03:00
Gleb Novikov
c637d99e07 Volumes and storages refactoring:
1. Moved Volume to separate file
  2. Created IVolume interface and implemented current behaviour in implementation of new interface — VolumeJBOD
  3. Replaced all old volume usages with new VolumeJBOD. Where it is unnecessary to have JBOD — left just IVolume.
  4. Removed old Volume completely
  5. Moved StoragePolicy to separated files
  6. Moved DiskSelector to separated files
  7. Removed DiskSpaceMonitor file
2020-05-04 23:15:38 +03:00
Nikolai Kochetov
b23b02094f Added comments. 2020-05-04 22:17:52 +03:00
Nikolai Kochetov
ee65f3eedc Init all input ports in GroupingAggregatedTransform. 2020-05-04 21:07:56 +03:00
Nikolai Kochetov
4e27c33451 Init all input ports in GroupingAggregatedTransform. 2020-05-04 20:59:07 +03:00
Nikolai Kochetov
19dadb8c2d Add parallel final. 2020-04-30 12:59:08 +03:00
Dmitry
d9ac0e8fef Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-04-26 14:44:06 +03:00
Alexey Milovidov
03e17405cd Checkpoint 2020-04-22 10:03:43 +03:00
Alexey Milovidov
603d132d45 Checkpoint 2020-04-22 09:34:20 +03:00
Dmitry
3a18982e2b removed debug cerr 2020-04-18 13:04:49 +03:00
Dmitry
25cd4ce132 Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-04-18 12:56:34 +03:00
Alexey Milovidov
b16ee538ab Merge branch 'master' into sorting-processors 2020-04-17 05:31:55 +03:00
Nikolai Kochetov
43e178abfb Revert "dded more comments to AggregatingTransform."
This reverts commit 01e495d783.
2020-04-15 14:04:38 +03:00
Nikolai Kochetov
95916e39cf Added more comments to AggregatingTransform. 2020-04-15 13:57:42 +03:00
Nikolai Kochetov
01e495d783 dded more comments to AggregatingTransform. 2020-04-15 13:55:34 +03:00
Nikolai Kochetov
0c2d3417e2 Fix pipeline stuck with max_rows_to_group_by. 2020-04-15 13:18:52 +03:00
Nikolai Kochetov
153f795ebe Merge branch 'master' into sorting-processors 2020-04-15 12:07:05 +03:00
Alexey Milovidov
8ad04d4fec Remove useless code 2020-04-15 00:05:45 +03:00
Nikolai Kochetov
1b6d80bfae Merge branch 'master' into sorting-processors 2020-04-10 12:07:21 +03:00
Nikolai Kochetov
d3acce8afa Fix build. 2020-04-10 12:04:28 +03:00
Artem Zuikov
8297683972
renames: AnalyzedJoin -> TableJoin, Join -> HashJoin (#10065) 2020-04-07 12:48:47 +03:00
Nikolai Kochetov
8986cf688b Added comment. 2020-04-06 16:28:46 +03:00
Nikolai Kochetov
0117c194c5 Fix GroupingAggregatedTransform for single-level aggregation. Add test. 2020-04-06 13:33:59 +03:00
Nikolai Kochetov
e23fda80aa Merge with master 2020-04-04 19:02:17 +03:00
Ivan Lezhankin
06446b4f08 dbms/ → src/ 2020-04-03 18:14:31 +03:00