Commit Graph

607 Commits

Author SHA1 Message Date
alexey-milovidov
7847de1947
Merge pull request #6629 from CurtizJ/read-in-order-2
Implement 'read in order' optimization with processors.
2019-09-03 14:21:19 +03:00
Nikolai Kochetov
99476d0039 Add task stilling to PipelineExecutor. 2019-09-03 14:15:37 +03:00
CurtizJ
22badef1a2 Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-09-03 13:47:18 +03:00
Nikolai Kochetov
e55647eee9 Force add resize befor aggregating transform. 2019-09-03 13:14:13 +03:00
CurtizJ
6d821c4877 fix build 2019-09-03 13:07:31 +03:00
Nikolai Kochetov
702c1b03da Revert to LFStack. 2019-09-03 11:42:26 +03:00
CurtizJ
973b533377 Merge remote-tracking branch 'upstream/master' into read-in-order-2 2019-09-03 00:59:51 +03:00
Nikolai Kochetov
52ca3f2b4c Add stream enumeration to Processors. 2019-09-02 20:01:03 +03:00
Nikolai Kochetov
cfbb3ce6f9 Add stream enumeration to Processors. 2019-09-02 19:58:24 +03:00
Nikolai Kochetov
5352ac9145 Add stream enumeration to Processors. 2019-09-02 19:57:06 +03:00
Nikolai Kochetov
1f70aee2e6 Add stream enumeration to Processors. 2019-09-02 19:55:01 +03:00
Alexander Tokmakov
b9eb992320 Merge branch 'master' into merging_values_with_expressions 2019-09-02 19:54:56 +03:00
Alexander Tokmakov
ec5fbf525d remove ValuesRowInputFormat 2019-09-02 19:33:58 +03:00
Alexander Tokmakov
d31358a280 change ValuesBlockInputStream to ValuesBlockInputFormat 2019-09-02 19:26:22 +03:00
Nikolai Kochetov
88044fdc16 Add stream enumeration to Processors. 2019-09-02 18:49:18 +03:00
CurtizJ
e122d54dcb update comments 2019-09-02 18:22:27 +03:00
Alexey Milovidov
402599a38c Merge branch 'master' into time-zone-configuration 2019-09-02 18:13:54 +03:00
Nikolai Kochetov
52eae3a242 Add stream enumeration to Processors. 2019-09-02 17:55:43 +03:00
alexey-milovidov
a71a1693f0
Merge pull request #6777 from yandex/fix-pvs-warning-in-pipeline-executor
Fix PVS warning in PipelineExecutor.
2019-09-02 17:53:28 +03:00
Nikolai Kochetov
0016d99f5e Add stream enumeration to Processors. 2019-09-02 17:49:05 +03:00
CurtizJ
de5e2b4d6b Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-09-02 17:34:49 +03:00
Alexander Tokmakov
8adf13047b fix build 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
804c911d3f ValuesRowInputStream changed to ValuesBlockInputStream 2019-09-02 17:33:09 +03:00
CurtizJ
da11fb86b7 implement 'with fill' modifier with processors 2019-09-02 17:29:51 +03:00
Nikolai Kochetov
2eecd35d27 Fix PVS warning in PipelineExecutor. 2019-09-02 16:30:51 +03:00
Nikolai Kochetov
bf0c0ed4f1 Merge branch 'master' into processors-2 2019-09-02 16:02:09 +03:00
Nikolai Kochetov
278e33cfa3 Try add LFStack. 2019-09-02 15:48:58 +03:00
Nikolai Kochetov
5005c0006c Try add LFStack. 2019-09-02 15:34:18 +03:00
Nikolai Kochetov
6221a42fcc Comment out all stopwatchs in PipelineExecutor. 2019-09-02 14:02:08 +03:00
Alexander Tokmakov
3da233ef42 fix build 2019-09-02 13:47:06 +03:00
Nikolai Kochetov
300dc80194 Update Aggregator interface. 2019-08-31 11:58:16 +03:00
Alexander Tokmakov
4c744af113 minor style fixes 2019-08-30 20:25:35 +03:00
Alexander Tokmakov
e3982704ea try to fix build 2019-08-30 00:46:36 +03:00
Alexander Tokmakov
d95d53b4e4 better error messages 2019-08-29 22:35:59 +03:00
CurtizJ
a6e43c4119 merging with master 2019-08-29 19:48:02 +03:00
Alexander Tokmakov
03c83169bd Merge branch 'master' into merging_template_format 2019-08-29 16:34:25 +03:00
Alexey Milovidov
eb15c9416a Fixed style 2019-08-28 21:00:40 +03:00
Alexey Milovidov
30cc569845 Avoid initializing DateLUT in static constructors 2019-08-28 20:11:40 +03:00
Alexander Tokmakov
c8096542bf more tests and fixes 2019-08-28 19:46:54 +03:00
Alexey Milovidov
b21fdff77e Merging #6678 2019-08-27 21:59:21 +03:00
Nikolai Kochetov
4cb52cebea Update max_threads for processors. 2019-08-27 21:37:28 +03:00
Alexander Tokmakov
93c672aa0b delete BlockInputStreamFromRowInputStream 2019-08-27 21:29:56 +03:00
CurtizJ
50d870705c limit with ties for processors 2019-08-27 20:48:42 +03:00
Alexander Tokmakov
cf3a8b993b allow skipping fields in TemplateRowInputFormat 2019-08-27 19:53:26 +03:00
Nikolai Kochetov
d958316e58 Enable processors by default. Do not check block srtucture in SourceFromInutStream if not debug. 2019-08-27 11:17:42 +03:00
Weiqing Xu
2fbcd607f3 check free space when use external sort/aggerator 2019-08-27 08:23:07 +08:00
CurtizJ
fa5aeb757f fix clang build 2019-08-26 20:37:40 +03:00
CurtizJ
4a7459f3b3 cleanup and update comments 2019-08-26 18:25:18 +03:00
CurtizJ
c63eeb8933 add FinishSortingTransform, refactor MergeSortingTransform 2019-08-26 17:54:29 +03:00
Alexander Tokmakov
f9445626d1 better parsing of format string 2019-08-26 16:02:15 +03:00
Alexey Milovidov
6d3250867c Fixed build of tests 2019-08-25 01:08:45 +03:00
Alexander Tokmakov
0136ef9a5f move formats to processors 2019-08-23 22:47:22 +03:00
Alexey Milovidov
b42f85e16b Added a check for double whitespaces 2019-08-23 21:30:04 +03:00
alexey-milovidov
5c99780b08
Merge pull request #6606 from yandex/processors-2
Enable processors by default.
2019-08-23 02:50:11 +03:00
Nikolai Kochetov
b3f91a717c Use ThreadFromGlobalPool in PipelineExecutor instead of ThreadPool. 2019-08-22 17:38:44 +03:00
Nikolai Kochetov
b93ffdd038 Fix MergingSortedTransform. 2019-08-22 13:16:56 +03:00
Nikolai Kochetov
11f8ec76df Fix CubeTransform. 2019-08-22 12:28:23 +03:00
Nikolai Kochetov
4f38b08481 Fix RollupTransform. 2019-08-22 11:53:34 +03:00
Nikolai Kochetov
8228871821 Fix RollupTransform. 2019-08-22 11:29:29 +03:00
Nikolai Kochetov
c3aaf583a0 Fix RollupTransform. 2019-08-22 11:26:50 +03:00
akonyaev
1683547b2d ADQM-34 fix style 2019-08-22 10:24:04 +03:00
akonyaev
01216e45b6 Merge branch 'master' of https://github.com/yandex/ClickHouse into ADQM-34
# Conflicts:
#	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp
2019-08-22 09:40:51 +03:00
akonyaev
321233ddaa ADQM-34 fix hardcode for,at name in ArrowColumnToCHColumn class 2019-08-21 19:39:20 +03:00
Nikolai Kochetov
2e03ac09ec Fix MergingSortedTransform. 2019-08-21 19:38:27 +03:00
Nikolai Kochetov
e68775e3d0 Fix TotalsHavingTransform. 2019-08-21 17:51:32 +03:00
akonyaev
caf0d30a5f ADQM-34 add orc input format 2019-08-21 17:19:47 +03:00
Nikolai Kochetov
fe3221d0e4 Fix SortingAggregatedTransform. 2019-08-21 17:19:18 +03:00
Nikolai Kochetov
c27cada229 Fix ExpressionTransform. 2019-08-21 16:14:23 +03:00
Alexey Milovidov
8966520801 Added "assert_cast" function as a replacement for static_cast for columns 2019-08-21 05:28:04 +03:00
Alexey Milovidov
a6b64d6ba0 Parquet: Fix reading boolean columns 2019-08-21 04:00:13 +03:00
Nikolai Kochetov
06bb0af386 Fix build. 2019-08-20 18:03:35 +03:00
Nikolai Kochetov
aef03fd9bf
Merge pull request #6425 from yandex/vzakaznikov-liveview
Merge LIVE VIEW
2019-08-20 17:13:42 +03:00
Ivan
a502424c33
Implement support for insertion into Kafka tables (#6012)
* Add write-callback on each row for RowOutputStream
* Fix build of new rdkafka library
* Poll messages if Kafka outgoing queue is full
* Add test
* Add test producer-consumer
* Truncate delimiter from last row in message
2019-08-20 14:17:57 +03:00
Nikolai Kochetov
cdf1ce3171 Merge branch 'master' into vzakaznikov-liveview 2019-08-20 10:41:31 +03:00
Alexander Tokmakov
bca580653d fix csv input 2019-08-20 02:09:02 +03:00
proller
d09c5c871b Build fixes (#6491)
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)
2019-08-18 01:53:46 +03:00
Nikolai Kochetov
18ad0e7e6b Merged with master. 2019-08-16 13:55:40 +03:00
Nikolai Kochetov
e51c48501b Fix arg type forPipelineExecutor::prepareProcessor 2019-08-14 18:28:33 +03:00
Nikolai Kochetov
631bbde420 Merged with master. 2019-08-12 13:19:13 +03:00
Alexey Milovidov
2570907f44 Removed useless parameter 2019-08-12 00:45:18 +03:00
alexey-milovidov
838c5e535f
Merge pull request #6433 from yandex/prevent-stack-overflow-in-parser
Fixed possible stack overflow in parser
2019-08-10 23:58:54 +03:00
Alexey Milovidov
0a9787c7f3 Fixed possible stack overflow in parser 2019-08-10 19:38:25 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Nikolai Kochetov
ed11432f68 Added JSONEachRowWithProgressRowOutputFormat. 2019-08-09 19:10:47 +03:00
Nikolai Kochetov
23e2d17d9d Added JSONEachRowWithProgressRowOutputFormat. 2019-08-09 18:58:07 +03:00
Nikolai Kochetov
bd8c9733e3 Update MySQLOutputFormat. 2019-08-05 12:35:46 +03:00
Nikolai Kochetov
abc63f8a06 Merged with master. 2019-08-04 15:43:11 +03:00
Nikolai Kochetov
511f3050a6 Update CSVRowInputFormat. 2019-08-04 13:19:51 +03:00
Nikolai Kochetov
1f6a16b03a Remove ValuesRowInputStream. 2019-08-02 20:16:58 +03:00
Nikolai Kochetov
e5d67cbe61 Remove ProtobufRowOutputStream. 2019-08-02 19:34:20 +03:00
Nikolai Kochetov
5fb548c994 Remove ProtobufRowOutputStream. 2019-08-02 19:31:17 +03:00
Nikolai Kochetov
8c66d106e4 Remove ProtobufRowInputStream. 2019-08-02 19:23:44 +03:00
Nikolai Kochetov
529e06e5cb Remove ParquetBlockOutputStream. 2019-08-02 19:09:52 +03:00
Nikolai Kochetov
fcecbbda73 Remove OParquetBlockInputStream 2019-08-02 19:00:24 +03:00
Nikolai Kochetov
ae50ab6907 Remove JSONEachRowRowInputStream. 2019-08-02 18:36:36 +03:00
Nikolai Kochetov
48818aef7f Update MySQLOutputFormat. 2019-08-02 15:41:21 +03:00
Nikolai Kochetov
0201cdf61a Merge branch 'master' into processors-and-output-formats 2019-08-02 15:29:19 +03:00
Nikolai Kochetov
c228f18130 Update IRowInputFormat and FormatFactory. 2019-08-01 17:25:41 +03:00
Nikolai Kochetov
a5bb2e2b3f Update Schema name in Protobuf and CapnProto formats. 2019-08-01 12:56:30 +03:00
Nikolai Kochetov
9811fdcdc7 Update CapnProtoRowInputFormat. 2019-08-01 11:31:08 +03:00
Nikolai Kochetov
9c4aefe2ae Update ODBCDriver2BlockOutputFormat. 2019-07-31 18:10:51 +03:00
Nikolai Kochetov
1347cf1359 Update ODBCDriver2BlockOutputFormat. 2019-07-31 17:58:56 +03:00
Nikolai Kochetov
3a8fefdda8 Update CSVRowInputStream. 2019-07-31 17:43:08 +03:00
Nikolai Kochetov
f0bf083efc Update CSVRowInputStream. 2019-07-31 17:16:28 +03:00
Nikolai Kochetov
2c638d577d Update VerticalRowOutputFormat. 2019-07-31 14:51:00 +03:00
Nikolai Kochetov
8bfd909f5b Update JSONEachRowRowOutputFormat. 2019-07-31 13:06:46 +03:00
Nikolai Kochetov
5bdb6aa9f3 Update TSKVRowInputFormat. 2019-07-31 12:43:20 +03:00
Nikolai Kochetov
b274545bb7 Update CSVRowInputFormat. 2019-07-30 21:48:40 +03:00
Nikolai Kochetov
e8b643e032 Update CSVRowInputFormat. 2019-07-30 21:22:01 +03:00
Nikolai Kochetov
ee3a93bab5 Update CSVRowInputFormat. 2019-07-30 21:21:12 +03:00
Nikolai Kochetov
d4da486b51 Update CSVRowInputFormat. 2019-07-30 17:55:59 +03:00
Yuriy
c1b57f9cf5 fixed heap buffer overflow in PacketPayloadWriteBuffer 2019-07-29 18:41:47 +03:00
Yuriy
383fa25c51 resolved conflict 2019-07-28 02:00:15 +03:00
Nikolai Kochetov
95dd6222fe Use IInputFormat and IOutputFormat by default. 2019-07-25 15:17:57 +03:00
Nikolai Kochetov
78f056d83f Use IInputFormat and IOutputFormat by default. 2019-07-25 12:35:16 +03:00
Nikolai Kochetov
36a0275ff1 Use IInputFormat and IOutputFormat by default. 2019-07-25 12:31:38 +03:00
Nikolai Kochetov
69f860a5ef Use IInputFormat and IOutputFormat by default. 2019-07-25 12:28:33 +03:00
Nikolai Kochetov
a22540d010 Use IInputFormat and IOutputFormat by default. 2019-07-25 12:20:00 +03:00
Nikolai Kochetov
4cc3bf7724 Use IInputFormat and IOutputFormat by default. 2019-07-25 12:15:33 +03:00
Nikolai Kochetov
58d579e7e2 Use IInputFormat and IOutputFormat by default. 2019-07-24 21:00:09 +03:00
Vitaly Baranov
d3ff30cb5b Use better approach to check offsets in protobuf messages. 2019-07-24 14:41:49 +03:00
Alexander Kuzmenkov
9df09f3506 Do not access shared arenas in aggregate function columns.
These arenas may be updated concurrently, so it is unsafe to
access them, as illustrated by issue #4402. Store them separately
and use a different arena for the updates. Change some callers
to accomodate for this.
2019-07-18 14:21:37 +03:00
Yuriy
a03114ede2 cast to proper type 2019-07-16 11:47:54 +03:00
Yuriy
d74be1dc9c fixed MySQLOutputFormat used by new query processing pipeline 2019-07-16 11:24:51 +03:00
Nikolai Kochetov
bfa114126a More comments for PipelineExecutor. 2019-07-11 09:50:44 +03:00
Nikolai Kochetov
d104f2d8ff Update PipelineExecutor 2019-07-10 14:59:30 +03:00
Nikolai Kochetov
282feb1fdb Update PipelineExecutor 2019-07-10 09:52:44 +03:00
Nikolai Kochetov
6974cc3c9f Update ResizePipeline 2019-07-09 20:47:13 +03:00
Nikolai Kochetov
911e4014ff Increase queue size in LazyOutputFormat in order to prevent potential lock. 2019-07-09 15:26:22 +03:00
Nikolai Kochetov
27acbb0412 Fix tests. 2019-07-08 21:08:44 +03:00
Nikolai Kochetov
de2221222e Don't skip empty chunks in Filter Transform. 2019-07-08 18:52:18 +03:00
Nikolai Kochetov
2128fb890b Don't skip empty chunks in Filter Transform. 2019-07-08 18:23:45 +03:00
Nikolai Kochetov
e0362c5216 Fix build. 2019-07-08 16:15:45 +03:00
Nikolai Kochetov
472f32f718 Remove ThreadGroupThreadPoolCallbacks 2019-07-08 15:49:52 +03:00
Nikolai Kochetov
e5103d741c Fix lock in case of query was cancelled. 2019-07-08 15:48:16 +03:00
Nikolai Kochetov
fc3b465d60 Fix race in doExpandPipeline. 2019-07-08 15:49:46 +03:00
Nikolai Kochetov
a27fbe6ea7 Removed lockfree stack. 2019-07-08 15:49:33 +03:00
Nikolai Kochetov
45b7d479aa Fix arguments in prepareProcessor call. 2019-07-08 15:49:23 +03:00
Nikolai Kochetov
02bded6f21 Added MySQLOutputFormat. 2019-07-08 15:49:15 +03:00
Nikolai Kochetov
acf382f9e5 Use boost::lockfree::stack instead of boost::lockfree::queue 2019-07-08 15:48:51 +03:00
Nikolai Kochetov
3ff5495fba Fix raise in PipelineExecutor::doExpandPipeline 2019-07-08 15:48:41 +03:00
Nikolai Kochetov
3df6d12216 More comments for PipelineExecutor. 2019-07-08 15:48:16 +03:00
Nikolai Kochetov
e8b4362ed2 Use ThreadPool in PipelineExecutor. 2019-07-08 15:48:32 +03:00
Nikolai Kochetov
f808d71aba Fix build. 2019-07-08 15:48:16 +03:00
Nikolai Kochetov
50aac7e982 Atomic Ports. [2] 2019-06-25 19:42:57 +03:00
Nikolai Kochetov
67b7080707 Atomic Ports. 2019-06-25 19:42:26 +03:00
Nikolai Kochetov
ab781f0988 Add task_queue to PipelineExecutor. 2019-06-25 19:42:05 +03:00
Nikolai Kochetov
d0cd3cc640 Update PipelineExecutor 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
1f6bbeee7d Update Port.h 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
94e087102d Use std::pair in port. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
6c2dd9b87d Remove copy constructor from Chunk. 2019-06-25 19:41:59 +03:00
Nikolai Kochetov
11e0752f6d Update PipelineExecutor. 2019-06-25 19:41:55 +03:00
Nikolai Kochetov
c6bbf6d91d Process pipeline in each thread in PipelineExecutor.
Exception safety in PipelineExecutor.
2019-06-25 19:41:38 +03:00
Nikolai Kochetov
d8f0c6c15a Added stream number to pipeline execution state. 2019-06-25 19:41:28 +03:00
Nikolai Kochetov
3bee30a215 Update PipelineExecutor. 2019-06-25 19:41:11 +03:00
Nikolai Kochetov
fc5f28faeb Remove ExceptionHandler from PipelineExecutor. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
8299680efe Update Port.h 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
76934cf801 Don't call cancell for RemoteBlockInputStream in SourceFromInputStream. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
f5e20027a7 Better exception safety for SourceFromInputStream. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
1ae23a6d9d Don't throw exception if query was cannelled. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
821d520a52 Fix limit by offset. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
cc09bb5557 Fix distinct. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
96174e90b0 Fix build. 2019-06-25 19:41:00 +03:00
Nikolai Kochetov
4ef3ff7270 Better exception safety for ISource and MergingAggregatedTransform. 2019-05-14 12:50:04 +03:00
Nikolai Kochetov
6a781cf2c8 Free chunks when merge sort is finished at MergeSorter. 2019-05-13 17:57:49 +03:00
Nikolai Kochetov
ba6768557e Fix rows_before_limit_at_least. 2019-05-13 16:04:52 +03:00
Nikolai Kochetov
fe9a45fee1 Fix rows_before_limit_at_least. 2019-05-13 15:08:02 +03:00
Nikolai Kochetov
18a7b0d7a2 Fix data race in PipelineExecutor. 2019-05-13 13:03:47 +03:00
Nikolai Kochetov
b8adb0937f Do not create processors for totals stream. 2019-04-30 20:37:30 +03:00
Nikolai Kochetov
ad8af5b5ba Do not create processors for totals stream. 2019-04-30 20:12:43 +03:00
Nikolai Kochetov
72c0530845 Do not create processors for totals stream. 2019-04-30 20:01:12 +03:00
Nikolai Kochetov
249a88784b Remove thread group from PipelineExecutor task. 2019-04-30 15:51:25 +03:00
Nikolai Kochetov
ced8e607f1 Wait for tasks from thread pool in case of exception in PipelineExecutor. 2019-04-30 15:28:11 +03:00
Nikolai Kochetov
e20f6a96af Disable pushing exceptions to ports from ISource. 2019-04-30 12:45:13 +03:00
Nikolai Kochetov
0faab7ff12 Disable pushing exceptions to ports from ISource. 2019-04-30 12:43:51 +03:00
Nikolai Kochetov
99ff2375ab Skip false constants in FilterTransform. 2019-04-30 12:38:37 +03:00
Nikolai Kochetov
65fb195fd7 Pass exception from ISource. 2019-04-29 21:43:50 +03:00
Nikolai Kochetov
062407cf14 Fix build. 2019-04-29 21:24:32 +03:00
Nikolai Kochetov
00bccfa232 Fix rows_before_limit_at_least. 2019-04-29 19:52:50 +03:00
Nikolai Kochetov
aacc0572e5 Attach to current thread in threadpool. 2019-04-29 16:57:29 +03:00
Nikolai Kochetov
36a9b5155b Attach to current thread in threadpool. 2019-04-29 15:23:20 +03:00
Nikolai Kochetov
caf9ed639b Attach tasks from PipelineExecutor to thread group. 2019-04-29 14:04:03 +03:00
Nikolai Kochetov
0b8107c497 Fix totals with rollup. 2019-04-29 13:00:17 +03:00
Nikolai Kochetov
4d87fd327f Don't add info about processors to TOO_MANY_ROWS_OR_BYTES exception. 2019-04-26 21:43:13 +03:00
Nikolai Kochetov
13800ac650 Don't add info about processors to TOO_MANY_ROWS_OR_BYTES exception. 2019-04-26 20:33:46 +03:00
Nikolai Kochetov
e2a41a031a Don't add info about processors to TOO_MANY_ROWS_OR_BYTES exception. 2019-04-26 20:21:14 +03:00
Nikolai Kochetov
90b5bb32ba Allow pass exceptions through ports. Pass exceptions for ISimpleTransform. 2019-04-26 19:21:24 +03:00
Nikolai Kochetov
080d573300 Fix port for totals. 2019-04-26 18:12:39 +03:00
Nikolai Kochetov
0aa9ee88db Even task consuming in ResizeProcessor. 2019-04-26 14:40:35 +03:00
Nikolai Kochetov
4a9c0a1e56 Even task consuming in ResizeProcessor. 2019-04-26 14:34:51 +03:00
Nikolai Kochetov
b475fb1d4c Even task consuming in ResizeProcessor. 2019-04-26 14:15:33 +03:00
Nikolai Kochetov
6d65f95283 Fix totals chunk in TotalsHavingTransform. 2019-04-25 18:35:13 +03:00
Nikolai Kochetov
e8e5164d9d Don't use same headers for main and totals streams in QueryPipeline. 2019-04-25 17:52:51 +03:00
Nikolai Kochetov
b3a90eeda0 Read prefix in SourceFromInputStream. 2019-04-25 16:34:59 +03:00
Nikolai Kochetov
b906e36eb6 Undo add thread_group to ThreadPool 2019-04-18 21:45:51 +03:00
Nikolai Kochetov
36392aab6b Fix Cube transform. 2019-04-18 20:32:01 +03:00
Nikolai Kochetov
2377298c0d Fix Cube transform. 2019-04-18 20:28:55 +03:00
Nikolai Kochetov
a7486a25cf Fix Cube transform. 2019-04-18 20:17:18 +03:00
Nikolai Kochetov
0694a61c05 Fix Cube transform. 2019-04-18 20:08:28 +03:00
Nikolai Kochetov
45ffec6c5c Fix Cube transform. 2019-04-18 19:27:18 +03:00
Nikolai Kochetov
8718b7bb40 Added thread_group argument to ThreadPool. 2019-04-18 17:55:43 +03:00
Nikolai Kochetov
745beb6080 Fix rollup and cube transforms. 2019-04-18 15:43:13 +03:00
Nikolai Kochetov
e72d6eef1b Fix rollup and cube transforms. 2019-04-18 15:09:03 +03:00
Nikolai Kochetov
197afe2eea Fix totals. 2019-04-17 19:14:52 +03:00
Nikolai Kochetov
0ad1c1a9a2 Fix totals. 2019-04-17 18:43:01 +03:00
Nikolai Kochetov
d5f878dba3 Fix totals. 2019-04-17 18:35:22 +03:00
Nikolai Kochetov
349254cbcf Fix totals. 2019-04-17 18:13:08 +03:00
Nikolai Kochetov
e8dbf94807 Fix totals. 2019-04-17 18:06:19 +03:00
Nikolai Kochetov
355c16eb79 Fix totals. 2019-04-17 17:58:34 +03:00
Nikolai Kochetov
647afb65e8 Fix totals. 2019-04-17 17:38:16 +03:00
Nikolai Kochetov
3f778e7aaf Don't require AggregatedChunkInfo in TotalsHavingTransform if no overflow_row. 2019-04-16 17:37:19 +03:00
Nikolai Kochetov
d9032764e0 Better pipeline expanding. MergeSortingTransform refactoring. 2019-04-16 16:54:41 +03:00
Nikolai Kochetov
6281075764 Better pipeline expanding. MergeSortingTransform refactoring. 2019-04-16 16:16:47 +03:00
Nikolai Kochetov
66d970e42d Better pipeline expanding. MergeSortingTransform refactoring. 2019-04-16 15:35:18 +03:00
Nikolai Kochetov
74639475dc Better pipeline expanding. MergeSortingTransform refactoring. 2019-04-16 15:30:57 +03:00
Nikolai Kochetov
f87c83a294 Better pipeline expanding. MergeSortingTransform refactoring. 2019-04-16 14:57:20 +03:00
Nikolai Kochetov
4cf8c6cfdd Better pipeline expanding. MergeSortingTransform refactoring. 2019-04-16 14:52:29 +03:00
Nikolai Kochetov
aac244a1ce Better pipeline expanding. MergeSortingTransform refactoring. 2019-04-16 14:45:02 +03:00
Nikolai Kochetov
43fdf4575c Better pipeline expanding. MergeSortingTransform refactoring. 2019-04-16 14:40:15 +03:00
Nikolai Kochetov
6bfae3c19a Refacto sorting (in process). 2019-04-15 14:28:20 +03:00
Nikolai Kochetov
3655d8da82 Restore constants in MergeSortingTransform. 2019-04-12 19:18:04 +03:00
Nikolai Kochetov
4bbbd297cc Fix JSONCompact field delimiter. 2019-04-12 19:06:38 +03:00
Nikolai Kochetov
df4a1e0c9a Fix JSONCompact field delimiter. 2019-04-12 19:03:32 +03:00
Nikolai Kochetov
616d9cd563 Fix JSONCompact field delimiter. 2019-04-12 18:59:51 +03:00
Nikolai Kochetov
083256a574 Fix JSONCompact field delimiter. 2019-04-12 18:52:33 +03:00
Nikolai Kochetov
3155c6ff90 Fix JSON totals. 2019-04-12 18:43:09 +03:00
Nikolai Kochetov
bcf3534e35 Fix get rows before limit at least. 2019-04-12 18:20:24 +03:00
Nikolai Kochetov
e7799aafcf Fix limit transfrom prepare. 2019-04-12 17:59:31 +03:00
Nikolai Kochetov
9c5d555e69 Fix limit transfrom prepare. 2019-04-12 17:49:34 +03:00
Nikolai Kochetov
5aa3d98ea2 Fix limit transfrom prepare. 2019-04-12 17:43:28 +03:00
Nikolai Kochetov
a8fdddfc88 Don't close output if limit transform was not finished. 2019-04-12 17:22:49 +03:00
Nikolai Kochetov
8298818036 Added force_add_agg_info to SourceFromInputStream/ 2019-04-12 16:14:03 +03:00
Nikolai Kochetov
1e5731496c Added force_add_agg_info to SourceFromInputStream. 2019-04-12 16:09:46 +03:00
Nikolai Kochetov
a6d0b2102e Don't shwallow exceptions at executeJob. 2019-04-12 14:27:25 +03:00
Nikolai Kochetov
a398afd25b Close input in limit transform if limit reached. 2019-04-12 14:21:41 +03:00
Nikolai Kochetov
750b5a1b07 Added more information to exception from processor. 2019-04-12 14:18:18 +03:00
Nikolai Kochetov
d66993e8f4 Close input in limit transform if limit reached. 2019-04-12 14:02:48 +03:00
Nikolai Kochetov
c92fb23317 Add pipeline to exception during query execution. 2019-04-12 12:57:13 +03:00
Nikolai Kochetov
a6c8ad6b3a Added MergeSortingTransform::enrichChunkWithConstants. 2019-04-11 20:26:03 +03:00
Nikolai Kochetov
7a3e0b5c46 Fix prepare for GroupingAggregatedTransform. 2019-04-11 19:56:05 +03:00
Nikolai Kochetov
405f416c01 Fix aggregated memory efficient transform headers. 2019-04-11 18:46:11 +03:00
Nikolai Kochetov
24b84d32c4 Better message for connect. 2019-04-11 18:31:23 +03:00
Nikolai Kochetov
86b9e03358 Fix aggregated memory efficient transform headers. 2019-04-11 18:16:18 +03:00
Nikolai Kochetov
e15f38885b Fix limit transform headers. 2019-04-11 17:51:25 +03:00
Nikolai Kochetov
b05a4b8af9 Check connect ports with same header. 2019-04-11 17:44:20 +03:00
Nikolai Kochetov
e1943b9aef Fix FilterTransform. 2019-04-11 16:54:27 +03:00
Nikolai Kochetov
a72f402468 Fix double readPrefix call. 2019-04-11 16:04:43 +03:00
Nikolai Kochetov
d7aa7412ae Fix totals fro single remote source. 2019-04-10 19:28:37 +03:00
Nikolai Kochetov
3d1be12b79 Fix AggregatingTransform. 2019-04-10 17:52:08 +03:00
Nikolai Kochetov
96ea3ed9b0 Fix clang build. 2019-04-10 16:29:27 +03:00
Nikolai Kochetov
b16bce0698 Fix clang build. 2019-04-10 16:27:51 +03:00
Nikolai Kochetov
7240c6f3df Fix clang build. 2019-04-10 15:57:43 +03:00
Nikolai Kochetov
539c06636f Fix limits for subqueries. 2019-04-10 15:38:57 +03:00
Nikolai Kochetov
6eb097fb54 Fix join for totals. 2019-04-10 14:18:37 +03:00
Nikolai Kochetov
24e432b38d Fix join for totals. 2019-04-10 14:15:30 +03:00
Nikolai Kochetov
94305c41e3 Fix join for totals. 2019-04-10 14:04:56 +03:00
Nikolai Kochetov
31ed0f0e38 Fix join for totals. 2019-04-10 13:52:20 +03:00
Nikolai Kochetov
59eae7b23d Fix join for totals. 2019-04-09 17:51:38 +03:00
Nikolai Kochetov
322b1ccd6b Fix join for totals. 2019-04-09 17:08:52 +03:00
Nikolai Kochetov
fe756f9444 Fix clang warnings. 2019-04-09 16:32:57 +03:00
Nikolai Kochetov
7e22373270 Don't create subquery for set without source in CreatingSetsTransform. 2019-04-09 16:29:33 +03:00
Nikolai Kochetov
68a8a5651b Don't create subquery for set without source in CreatingSetsTransform. 2019-04-09 16:20:52 +03:00
Nikolai Kochetov
695238147b Fix header for union. 2019-04-09 16:07:07 +03:00
Nikolai Kochetov
2ff8714759 Fix init creating sets transform. 2019-04-09 14:09:46 +03:00
Nikolai Kochetov
655baf68bf Fix clang warnings. 2019-04-09 13:42:24 +03:00
Nikolai Kochetov
54066fc312 Fix rows_before_limit_at_least. 2019-04-09 13:17:25 +03:00
Nikolai Kochetov
e0a214d081 Fix clang warnings. 2019-04-09 12:28:31 +03:00
Nikolai Kochetov
3b3a6a4583 Fix clang warnings. 2019-04-09 12:25:57 +03:00
Nikolai Kochetov
576ba513cc Fix PartialSortingTransform. 2019-04-08 20:10:00 +03:00
Nikolai Kochetov
4d1c3c63e9 Fix totals without having. 2019-04-08 20:02:18 +03:00
Nikolai Kochetov
61a9b9738a Fix totals without having. 2019-04-08 19:59:28 +03:00
Nikolai Kochetov
39a0a23fdb Fix totals without having. 2019-04-08 19:48:41 +03:00
Nikolai Kochetov
aa7cfc5c95 Fix totals without having. 2019-04-08 19:40:45 +03:00
Nikolai Kochetov
8400987fb5 Fix DistinctTransform keys. 2019-04-08 19:35:44 +03:00
Nikolai Kochetov
54b15385bd Calculate rows_before_limit_at_least. 2019-04-08 17:55:20 +03:00
Nikolai Kochetov
c34d0b137d Fix TotalsHavingTransform. 2019-04-08 16:38:02 +03:00
Nikolai Kochetov
c97e6a2cc1 Fix TotalsHavingTransform. 2019-04-08 16:29:24 +03:00
Nikolai Kochetov
6fa7386115 Fix TotalsHavingTransform. 2019-04-08 16:15:53 +03:00
Nikolai Kochetov
529c72bc77 Fix TotalsHavingTransform. 2019-04-08 16:13:36 +03:00
Nikolai Kochetov
ee2f5efdd9 Fix TotalsHavingTransform. 2019-04-08 16:02:19 +03:00
Nikolai Kochetov
be34dd5144 Fix TotalsHavingTransform. 2019-04-08 15:31:51 +03:00
Nikolai Kochetov
a9709f846e Fix TotalsHavingTransform. 2019-04-08 15:24:49 +03:00
Nikolai Kochetov
6ed86dfeb4 Fix TotalsHavingTransform. 2019-04-08 15:22:27 +03:00
Nikolai Kochetov
c2d060deb8 Fix build. 2019-04-08 15:05:38 +03:00
Nikolai Kochetov
ebbfd4994f Fix ISimpleTransform. 2019-04-08 14:28:38 +03:00
Nikolai Kochetov
fa5bc611ae Better exceptions safety in PipelineExecutor. 2019-04-08 14:06:11 +03:00
Nikolai Kochetov
83a2242e2d Check num columns in chunk while pushing to port. 2019-04-08 13:37:09 +03:00
Nikolai Kochetov
4d76bddddc Update QueryPipeline. 2019-04-08 12:31:49 +03:00
Nikolai Kochetov
dfd554db34 Fix build. 2019-04-08 12:20:23 +03:00
Nikolai Kochetov
a44e79151c Fix output formats headers. 2019-04-05 20:44:18 +03:00
Nikolai Kochetov
2a07ca2ac2 Fix output formats headers. 2019-04-05 20:27:34 +03:00
Nikolai Kochetov
4933dd3910 Fix AggregatedChunkInfo for chunks restored from blocks. 2019-04-05 18:50:26 +03:00
Nikolai Kochetov
22bcdcff22 Fix AggregatedChunkInfo for chunks restored from blocks. 2019-04-05 18:45:46 +03:00
Nikolai Kochetov
f2492849ba Fix clang build. 2019-04-05 17:32:12 +03:00
Nikolai Kochetov
587d3ef293 Fix clang build. 2019-04-05 17:28:27 +03:00
Nikolai Kochetov
a161e5951c Fix clang build. 2019-04-05 16:09:11 +03:00
Nikolai Kochetov
4552bc1a74 Fix clang build. 2019-04-05 16:07:04 +03:00
Nikolai Kochetov
ff53ee1b11 Fix clang build. 2019-04-05 15:46:00 +03:00
Nikolai Kochetov
f405f927c0 Fix clang build. 2019-04-05 15:44:25 +03:00
Nikolai Kochetov
cadc6decde Fix clang build. 2019-04-05 15:39:51 +03:00