Commit Graph

371 Commits

Author SHA1 Message Date
Nikolai Kochetov
90b5bb32ba Allow pass exceptions through ports. Pass exceptions for ISimpleTransform. 2019-04-26 19:21:24 +03:00
Nikolai Kochetov
080d573300 Fix port for totals. 2019-04-26 18:12:39 +03:00
Nikolai Kochetov
0aa9ee88db Even task consuming in ResizeProcessor. 2019-04-26 14:40:35 +03:00
Nikolai Kochetov
4a9c0a1e56 Even task consuming in ResizeProcessor. 2019-04-26 14:34:51 +03:00
Nikolai Kochetov
b475fb1d4c Even task consuming in ResizeProcessor. 2019-04-26 14:15:33 +03:00
Nikolai Kochetov
6d65f95283 Fix totals chunk in TotalsHavingTransform. 2019-04-25 18:35:13 +03:00
Nikolai Kochetov
e8e5164d9d Don't use same headers for main and totals streams in QueryPipeline. 2019-04-25 17:52:51 +03:00
Nikolai Kochetov
b3a90eeda0 Read prefix in SourceFromInputStream. 2019-04-25 16:34:59 +03:00
Nikolai Kochetov
b906e36eb6 Undo add thread_group to ThreadPool 2019-04-18 21:45:51 +03:00
Nikolai Kochetov
36392aab6b Fix Cube transform. 2019-04-18 20:32:01 +03:00
Nikolai Kochetov
2377298c0d Fix Cube transform. 2019-04-18 20:28:55 +03:00
Nikolai Kochetov
a7486a25cf Fix Cube transform. 2019-04-18 20:17:18 +03:00
Nikolai Kochetov
0694a61c05 Fix Cube transform. 2019-04-18 20:08:28 +03:00
Nikolai Kochetov
45ffec6c5c Fix Cube transform. 2019-04-18 19:27:18 +03:00
Nikolai Kochetov
8718b7bb40 Added thread_group argument to ThreadPool. 2019-04-18 17:55:43 +03:00
Nikolai Kochetov
745beb6080 Fix rollup and cube transforms. 2019-04-18 15:43:13 +03:00
Nikolai Kochetov
e72d6eef1b Fix rollup and cube transforms. 2019-04-18 15:09:03 +03:00
Nikolai Kochetov
197afe2eea Fix totals. 2019-04-17 19:14:52 +03:00
Nikolai Kochetov
0ad1c1a9a2 Fix totals. 2019-04-17 18:43:01 +03:00
Nikolai Kochetov
d5f878dba3 Fix totals. 2019-04-17 18:35:22 +03:00
Nikolai Kochetov
349254cbcf Fix totals. 2019-04-17 18:13:08 +03:00
Nikolai Kochetov
e8dbf94807 Fix totals. 2019-04-17 18:06:19 +03:00
Nikolai Kochetov
355c16eb79 Fix totals. 2019-04-17 17:58:34 +03:00
Nikolai Kochetov
647afb65e8 Fix totals. 2019-04-17 17:38:16 +03:00
Nikolai Kochetov
3f778e7aaf Don't require AggregatedChunkInfo in TotalsHavingTransform if no overflow_row. 2019-04-16 17:37:19 +03:00
Nikolai Kochetov
d9032764e0 Better pipeline expanding. MergeSortingTransform refactoring. 2019-04-16 16:54:41 +03:00
Nikolai Kochetov
6281075764 Better pipeline expanding. MergeSortingTransform refactoring. 2019-04-16 16:16:47 +03:00
Nikolai Kochetov
66d970e42d Better pipeline expanding. MergeSortingTransform refactoring. 2019-04-16 15:35:18 +03:00
Nikolai Kochetov
74639475dc Better pipeline expanding. MergeSortingTransform refactoring. 2019-04-16 15:30:57 +03:00
Nikolai Kochetov
f87c83a294 Better pipeline expanding. MergeSortingTransform refactoring. 2019-04-16 14:57:20 +03:00
Nikolai Kochetov
4cf8c6cfdd Better pipeline expanding. MergeSortingTransform refactoring. 2019-04-16 14:52:29 +03:00
Nikolai Kochetov
aac244a1ce Better pipeline expanding. MergeSortingTransform refactoring. 2019-04-16 14:45:02 +03:00
Nikolai Kochetov
43fdf4575c Better pipeline expanding. MergeSortingTransform refactoring. 2019-04-16 14:40:15 +03:00
Nikolai Kochetov
6bfae3c19a Refacto sorting (in process). 2019-04-15 14:28:20 +03:00
Nikolai Kochetov
3655d8da82 Restore constants in MergeSortingTransform. 2019-04-12 19:18:04 +03:00
Nikolai Kochetov
4bbbd297cc Fix JSONCompact field delimiter. 2019-04-12 19:06:38 +03:00
Nikolai Kochetov
df4a1e0c9a Fix JSONCompact field delimiter. 2019-04-12 19:03:32 +03:00
Nikolai Kochetov
616d9cd563 Fix JSONCompact field delimiter. 2019-04-12 18:59:51 +03:00
Nikolai Kochetov
083256a574 Fix JSONCompact field delimiter. 2019-04-12 18:52:33 +03:00
Nikolai Kochetov
3155c6ff90 Fix JSON totals. 2019-04-12 18:43:09 +03:00
Nikolai Kochetov
bcf3534e35 Fix get rows before limit at least. 2019-04-12 18:20:24 +03:00
Nikolai Kochetov
e7799aafcf Fix limit transfrom prepare. 2019-04-12 17:59:31 +03:00
Nikolai Kochetov
9c5d555e69 Fix limit transfrom prepare. 2019-04-12 17:49:34 +03:00
Nikolai Kochetov
5aa3d98ea2 Fix limit transfrom prepare. 2019-04-12 17:43:28 +03:00
Nikolai Kochetov
a8fdddfc88 Don't close output if limit transform was not finished. 2019-04-12 17:22:49 +03:00
Nikolai Kochetov
8298818036 Added force_add_agg_info to SourceFromInputStream/ 2019-04-12 16:14:03 +03:00
Nikolai Kochetov
1e5731496c Added force_add_agg_info to SourceFromInputStream. 2019-04-12 16:09:46 +03:00
Nikolai Kochetov
a6d0b2102e Don't shwallow exceptions at executeJob. 2019-04-12 14:27:25 +03:00
Nikolai Kochetov
a398afd25b Close input in limit transform if limit reached. 2019-04-12 14:21:41 +03:00
Nikolai Kochetov
750b5a1b07 Added more information to exception from processor. 2019-04-12 14:18:18 +03:00
Nikolai Kochetov
d66993e8f4 Close input in limit transform if limit reached. 2019-04-12 14:02:48 +03:00
Nikolai Kochetov
c92fb23317 Add pipeline to exception during query execution. 2019-04-12 12:57:13 +03:00
Nikolai Kochetov
a6c8ad6b3a Added MergeSortingTransform::enrichChunkWithConstants. 2019-04-11 20:26:03 +03:00
Nikolai Kochetov
7a3e0b5c46 Fix prepare for GroupingAggregatedTransform. 2019-04-11 19:56:05 +03:00
Nikolai Kochetov
405f416c01 Fix aggregated memory efficient transform headers. 2019-04-11 18:46:11 +03:00
Nikolai Kochetov
24b84d32c4 Better message for connect. 2019-04-11 18:31:23 +03:00
Nikolai Kochetov
86b9e03358 Fix aggregated memory efficient transform headers. 2019-04-11 18:16:18 +03:00
Nikolai Kochetov
e15f38885b Fix limit transform headers. 2019-04-11 17:51:25 +03:00
Nikolai Kochetov
b05a4b8af9 Check connect ports with same header. 2019-04-11 17:44:20 +03:00
Nikolai Kochetov
e1943b9aef Fix FilterTransform. 2019-04-11 16:54:27 +03:00
Nikolai Kochetov
a72f402468 Fix double readPrefix call. 2019-04-11 16:04:43 +03:00
Nikolai Kochetov
d7aa7412ae Fix totals fro single remote source. 2019-04-10 19:28:37 +03:00
Nikolai Kochetov
3d1be12b79 Fix AggregatingTransform. 2019-04-10 17:52:08 +03:00
Nikolai Kochetov
96ea3ed9b0 Fix clang build. 2019-04-10 16:29:27 +03:00
Nikolai Kochetov
b16bce0698 Fix clang build. 2019-04-10 16:27:51 +03:00
Nikolai Kochetov
7240c6f3df Fix clang build. 2019-04-10 15:57:43 +03:00
Nikolai Kochetov
539c06636f Fix limits for subqueries. 2019-04-10 15:38:57 +03:00
Nikolai Kochetov
6eb097fb54 Fix join for totals. 2019-04-10 14:18:37 +03:00
Nikolai Kochetov
24e432b38d Fix join for totals. 2019-04-10 14:15:30 +03:00
Nikolai Kochetov
94305c41e3 Fix join for totals. 2019-04-10 14:04:56 +03:00
Nikolai Kochetov
31ed0f0e38 Fix join for totals. 2019-04-10 13:52:20 +03:00
Nikolai Kochetov
59eae7b23d Fix join for totals. 2019-04-09 17:51:38 +03:00
Nikolai Kochetov
322b1ccd6b Fix join for totals. 2019-04-09 17:08:52 +03:00
Nikolai Kochetov
fe756f9444 Fix clang warnings. 2019-04-09 16:32:57 +03:00
Nikolai Kochetov
7e22373270 Don't create subquery for set without source in CreatingSetsTransform. 2019-04-09 16:29:33 +03:00
Nikolai Kochetov
68a8a5651b Don't create subquery for set without source in CreatingSetsTransform. 2019-04-09 16:20:52 +03:00
Nikolai Kochetov
695238147b Fix header for union. 2019-04-09 16:07:07 +03:00
Nikolai Kochetov
2ff8714759 Fix init creating sets transform. 2019-04-09 14:09:46 +03:00
Nikolai Kochetov
655baf68bf Fix clang warnings. 2019-04-09 13:42:24 +03:00
Nikolai Kochetov
54066fc312 Fix rows_before_limit_at_least. 2019-04-09 13:17:25 +03:00
Nikolai Kochetov
e0a214d081 Fix clang warnings. 2019-04-09 12:28:31 +03:00
Nikolai Kochetov
3b3a6a4583 Fix clang warnings. 2019-04-09 12:25:57 +03:00
Nikolai Kochetov
576ba513cc Fix PartialSortingTransform. 2019-04-08 20:10:00 +03:00
Nikolai Kochetov
4d1c3c63e9 Fix totals without having. 2019-04-08 20:02:18 +03:00
Nikolai Kochetov
61a9b9738a Fix totals without having. 2019-04-08 19:59:28 +03:00
Nikolai Kochetov
39a0a23fdb Fix totals without having. 2019-04-08 19:48:41 +03:00
Nikolai Kochetov
aa7cfc5c95 Fix totals without having. 2019-04-08 19:40:45 +03:00
Nikolai Kochetov
8400987fb5 Fix DistinctTransform keys. 2019-04-08 19:35:44 +03:00
Nikolai Kochetov
54b15385bd Calculate rows_before_limit_at_least. 2019-04-08 17:55:20 +03:00
Nikolai Kochetov
c34d0b137d Fix TotalsHavingTransform. 2019-04-08 16:38:02 +03:00
Nikolai Kochetov
c97e6a2cc1 Fix TotalsHavingTransform. 2019-04-08 16:29:24 +03:00
Nikolai Kochetov
6fa7386115 Fix TotalsHavingTransform. 2019-04-08 16:15:53 +03:00
Nikolai Kochetov
529c72bc77 Fix TotalsHavingTransform. 2019-04-08 16:13:36 +03:00
Nikolai Kochetov
ee2f5efdd9 Fix TotalsHavingTransform. 2019-04-08 16:02:19 +03:00
Nikolai Kochetov
be34dd5144 Fix TotalsHavingTransform. 2019-04-08 15:31:51 +03:00
Nikolai Kochetov
a9709f846e Fix TotalsHavingTransform. 2019-04-08 15:24:49 +03:00
Nikolai Kochetov
6ed86dfeb4 Fix TotalsHavingTransform. 2019-04-08 15:22:27 +03:00
Nikolai Kochetov
c2d060deb8 Fix build. 2019-04-08 15:05:38 +03:00
Nikolai Kochetov
ebbfd4994f Fix ISimpleTransform. 2019-04-08 14:28:38 +03:00
Nikolai Kochetov
fa5bc611ae Better exceptions safety in PipelineExecutor. 2019-04-08 14:06:11 +03:00
Nikolai Kochetov
83a2242e2d Check num columns in chunk while pushing to port. 2019-04-08 13:37:09 +03:00
Nikolai Kochetov
4d76bddddc Update QueryPipeline. 2019-04-08 12:31:49 +03:00
Nikolai Kochetov
dfd554db34 Fix build. 2019-04-08 12:20:23 +03:00
Nikolai Kochetov
a44e79151c Fix output formats headers. 2019-04-05 20:44:18 +03:00
Nikolai Kochetov
2a07ca2ac2 Fix output formats headers. 2019-04-05 20:27:34 +03:00
Nikolai Kochetov
4933dd3910 Fix AggregatedChunkInfo for chunks restored from blocks. 2019-04-05 18:50:26 +03:00
Nikolai Kochetov
22bcdcff22 Fix AggregatedChunkInfo for chunks restored from blocks. 2019-04-05 18:45:46 +03:00
Nikolai Kochetov
f2492849ba Fix clang build. 2019-04-05 17:32:12 +03:00
Nikolai Kochetov
587d3ef293 Fix clang build. 2019-04-05 17:28:27 +03:00
Nikolai Kochetov
a161e5951c Fix clang build. 2019-04-05 16:09:11 +03:00
Nikolai Kochetov
4552bc1a74 Fix clang build. 2019-04-05 16:07:04 +03:00
Nikolai Kochetov
ff53ee1b11 Fix clang build. 2019-04-05 15:46:00 +03:00
Nikolai Kochetov
f405f927c0 Fix clang build. 2019-04-05 15:44:25 +03:00
Nikolai Kochetov
cadc6decde Fix clang build. 2019-04-05 15:39:51 +03:00
Nikolai Kochetov
b76b0ebd05 Fix clang build. 2019-04-05 15:36:26 +03:00
Nikolai Kochetov
5e4dbf1226 Fix clang build. 2019-04-05 15:32:47 +03:00
Nikolai Kochetov
5e8fc30ce8 Fix clang build. 2019-04-05 15:29:17 +03:00
Nikolai Kochetov
f473c21b9d Fix clang build. 2019-04-05 14:43:28 +03:00
Nikolai Kochetov
ec65b4c229 Check num columns in Block::cloneWithColumns. 2019-04-05 14:39:07 +03:00
Nikolai Kochetov
33b176f2da Fix style. 2019-04-05 14:34:11 +03:00
Nikolai Kochetov
1470fe0a72 Fix clang build. 2019-04-05 14:27:08 +03:00
Nikolai Kochetov
7626b1b267 Multiple fixes. 2019-04-05 13:52:07 +03:00
Nikolai Kochetov
5e39ec610c Merged with master 2019-04-03 14:21:38 +03:00
Nikolai Kochetov
94ff7f694a QueryPipeline [in progress]. 2019-04-03 13:14:36 +03:00
Nikolai Kochetov
c88be5ce9c Added CreatingSetsTransform 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
4b068ebd9c Added ConvertingTransform. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
827511c96d Added MaterializingTransform. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
b2e7903992 Added DistinctTransform 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
88dbe52bbe Added TotalsHavingTransform. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
a4e83a85d0 Added Rollup and Cube transforms. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
1293e2d62c Added IInflatingTransform 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
18133a4948 Added processors_test_aggregation. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
f08a10542e Updated AggregatingTransform. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
6cedacb055 Added MergingAggregatedSimpleTransform. 2019-04-03 13:14:30 +03:00
Nikolai Kochetov
b85e554c49 Updated AggregatingTransform for multiple sources case. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
6976b65b2d Added MergingAggregatedTransform. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
dd74e82d47 Added AggregatingTransform. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
f17edfd98f Added test for MergeSortingTransform. 2019-04-03 13:14:08 +03:00
Nikolai Kochetov
c388e57a40 Fix MergingSortedTransform. Update PipelineExecutor. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
49d1899aed Added processors_test_merging_sorted_transform. 2019-04-03 13:14:02 +03:00
Nikolai Kochetov
fd25fab652 Updated MergeSortingTransform. 2019-04-03 13:13:57 +03:00
Nikolai Kochetov
19fa17fd84 Added ExpandPipeline to PipelineExecutor.
Added expanding pipeline test.
2019-04-03 13:13:37 +03:00
Nikolai Kochetov
1e3ca041a2 Added ExpandPipeline processor status. Changed types of InputPorts and OutputPorts from vector to list. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
2f98e779e1 Added MergingSortedTransform. 2019-02-26 21:40:08 +03:00
Nikolai Kochetov
c8c2e1fd82 Added NullSource, ExpressionTransform, FilterTransform, LimitByTransform processors. 2019-02-22 20:45:56 +03:00
Nikolai Kochetov
25f6b97486 Added processors for Parquet and Protobuf. 2019-02-21 21:36:46 +03:00
Nikolai Kochetov
99504f9f09 Fix build. 2019-02-21 19:15:18 +03:00
Nikolai Kochetov
aba56e171c Formats processorss. 2019-02-21 19:05:47 +03:00
Nikolai Kochetov
e658aff315 Added Chunkclass to move columns between ports. 2019-02-21 19:05:37 +03:00
Nikolai Kochetov
f65d8d9325 Added processor tests with chain and merge sort. 2019-02-15 19:18:12 +03:00
Nikolai Kochetov
6763b59ba9 Updated PipelineExecutor. 2019-02-15 19:18:25 +03:00
Nikolai Kochetov
7d4de44695 Refactor processors. 2019-02-15 19:18:19 +03:00
Nikolai Kochetov
f55f70d67b Added PipelineExecutor. 2019-02-15 19:18:12 +03:00
Nikolai Kochetov
f39ad1f79a Fix traverse. 2019-02-15 19:18:12 +03:00
Nikolai Kochetov
904647f02e Fix build. 2019-02-15 19:18:12 +03:00
Alexey Milovidov
1ff8be156c Processors: development [#CLICKHOUSE-2948] 2018-06-04 21:31:46 +03:00
Alexey Milovidov
62296fc763 Processors: experimental [#CLICKHOUSE-2948] 2018-05-24 05:52:21 +03:00
Alexey Milovidov
661197bf99 Processors: experimental [#CLICKHOUSE-2948] 2018-05-24 05:39:22 +03:00
Alexey Milovidov
a7a16c3c24 Processors: experimental [#CLICKHOUSE-2948] 2018-05-24 04:02:16 +03:00
Alexey Milovidov
526a73eb5d Processors: experimental [#CLICKHOUSE-2948] 2018-05-23 23:22:58 +03:00
Alexey Milovidov
cba6edce64 Processors: experimental [#CLICKHOUSE-2948] 2018-05-23 23:19:33 +03:00
Alexey Milovidov
dabc6c8105 Processors: experimental [#CLICKHOUSE-2948] 2018-05-22 07:44:56 +03:00
Alexey Milovidov
81177dc264 Processors: experimental [#CLICKHOUSE-2948] 2018-05-21 07:29:04 +03:00
Alexey Milovidov
c5c43926f8 Processors: experimental [#CLICKHOUSE-2948] 2018-05-21 07:24:28 +03:00
Alexey Milovidov
c179f0703f Processors: experimental [#CLICKHOUSE-2948] 2018-05-21 05:07:15 +03:00
Alexey Milovidov
969c0d9fc1 Processors: experimental [#CLICKHOUSE-2948] 2018-05-20 08:30:47 +03:00
Alexey Milovidov
7dfc0a4c6c Processors: experimental [#CLICKHOUSE-2948] 2018-05-20 08:28:48 +03:00
Alexey Milovidov
0ffbd7cb1f Processors: experimental [#CLICKHOUSE-2948] 2018-05-20 08:21:20 +03:00
Alexey Milovidov
b937decb5b Processors: experimental [#CLICKHOUSE-2948] 2018-05-20 07:56:31 +03:00
Alexey Milovidov
1203df737d Processors: experimental [#CLICKHOUSE-2948] 2018-05-20 07:51:45 +03:00
Alexey Milovidov
08ec4bf79f Processors: experimental [#CLICKHOUSE-2948] 2018-05-19 07:19:38 +03:00