thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-19 14:11:58 +00:00
Code Issues Packages Projects Releases Wiki Activity
33,551 Commits 9,138 Branches 1,778 Tags 2 GiB
c2a054ac70
Commit Graph

605 Commits

Author SHA1 Message Date
Nikolai Kochetov
1ff30b1621 Update PipelineExecutor. 2019-09-12 16:07:54 +03:00
Nikolai Kochetov
1b906bfeaf Remove LFStack. Added ThreadsQueue as separate data structure. 2019-09-12 14:22:58 +03:00
Nikolai Kochetov
4ba0ed731f Remove LFStack. Added ThreadsQueue as separate data structure. 2019-09-12 14:19:54 +03:00
Nikolai Kochetov
d0e84e630a Remove LFStack. Added ThreadsQueue as separate data structure. 2019-09-12 14:13:34 +03:00
Nikolai Kochetov
7d93d70e94 Remove LFStack. Added ThreadsQueue as separate data structure. 2019-09-12 14:07:36 +03:00
Alexander Tokmakov
f323476111 Merge branch 'master' into merging_values_with_expressions 2019-09-11 23:31:37 +03:00
Amos Bird
93c0880ca7 Fix non-ssl build. 2019-09-12 04:20:27 +08:00
Alexander Tokmakov
29fe481b06 optimize expression template deduction 2019-09-11 22:55:28 +03:00
Nikolai Kochetov
95abc1f910 Removed dynamic_cast from PipelineExecutor. 2019-09-11 20:06:06 +03:00
Nikolai Kochetov
9916be2800 Small refactor in PipelienExecutor. Added comment in AggregatingTransform. 2019-09-11 19:31:15 +03:00
Nikolai Kochetov
172e4d76d7 Added more comments. 2019-09-11 13:46:41 +03:00
Nikolai Kochetov
8734c8339e Fix race in PipelineExecutor. 2019-09-10 16:12:18 +03:00
Nikolai Kochetov
7b0a6aec05 Fix raice in PipelineExecutor. 2019-09-10 15:14:47 +03:00
Nikolai Kochetov
3646124873 Fix raice in PipelineExecutor. 2019-09-10 14:17:55 +03:00
Nikolai Kochetov
a9d41d580a Fix asan crash in PipelineExecutor. 2019-09-10 12:50:38 +03:00
Nikolai Kochetov
72fea5bf97 Added ThreadsQueue to PipelineExecutor. 2019-09-10 11:50:31 +03:00
Nikolai Kochetov
73bda85998 Added ThreadsQueue to PipelineExecutor. 2019-09-10 11:45:48 +03:00
Nikolai Kochetov
5165bbd88a Fix asan crash in PipelineExecutor. 2019-09-10 11:03:02 +03:00
proller
54a5b801b7 Build fixes (Orc, ...) (#6835) 
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)

* wip

* Fix build (orc, ...)

* Missing files

* Try fix

* fix hdfs

* Fix llvm 7.1 find
 2019-09-10 00:40:40 +03:00
chertus
1b313eedfa MergeJoin in progress 2019-09-09 22:43:37 +03:00
Nikolai Kochetov
eeba24b238 Try to fix race in PipelineExecutor. 2019-09-09 20:56:58 +03:00
Nikolai Kochetov
423a5c35e8 Try to fix race in PipelineExecutor. 2019-09-09 20:12:26 +03:00
Nikolai Kochetov
da798142a5 Try to fix race in PipelineExecutor. 2019-09-09 20:10:37 +03:00
Alexander Tokmakov
3643ecc9cd parse expressions near the end of buffer correctly 2019-09-09 20:06:22 +03:00
Nikolai Kochetov
9df1235046 Pin sources to streams in PipelineExecutor. 2019-09-09 19:53:02 +03:00
Nikolai Kochetov
818696a9a7 Pin sources to streams in PipelineExecutor. 2019-09-09 19:29:11 +03:00
Nikolai Kochetov
3a849c3c5f Pin sources to streams in PipelineExecutor. 2019-09-09 18:43:19 +03:00
Nikolai Kochetov
c9cca3ba8b Merged with master 2019-09-09 16:20:30 +03:00
Nikolai Kochetov
04d2f32e17 Check thread is joinable in PipelineExecutor. 2019-09-09 15:09:48 +03:00
Alexander Tokmakov
d78c82a8ae fixes 2019-09-06 22:01:44 +03:00
Nikolai Kochetov
3bd5d84ecc Update PipelineExecutor. 2019-09-06 19:04:18 +03:00
Nikolai Kochetov
32cc3a4bee Revert enumerate streams. 2019-09-06 16:28:49 +03:00
Nikolai Kochetov
52305cefbc Merge branch 'merging-aggregated-processors' into processors-2 2019-09-06 15:21:17 +03:00
Nikolai Kochetov
d10b7d7a2b Added ConvertingAggregatedToChunksTransform. 2019-09-06 15:19:59 +03:00
Olga Khvostikova
f90642ce23
Merge pull request #6610 from CurtizJ/merging_with_ties_and_with_fill 
WITH TIES modifier for LIMIT and WITH FILL modifier for ORDER BY. (continuation of #5069)
 2019-09-05 22:45:48 +03:00
Alexander Tokmakov
196e357250 revert parsing expression near the end of buffer 2019-09-05 16:55:51 +03:00
Alexander Tokmakov
20770a9745 check if some tests fail 2019-09-04 23:27:13 +03:00
Alexander Tokmakov
52fb9585d4 improvements 2019-09-04 22:59:08 +03:00
Alexander Tokmakov
8936f854be better checking of types of literals 2019-09-04 19:54:20 +03:00
Nikolai Kochetov
30155f92bf Try to enumerate streams again. 2019-09-04 17:16:32 +03:00
Nikolai Kochetov
b98676836e Try to enumerate streams again. 2019-09-04 17:06:41 +03:00
Nikolai Kochetov
b9e26d15de Try to enumerate streams again. 2019-09-04 16:17:50 +03:00
Nikolai Kochetov
3a7e7287c0 Update PipelineExecutor. 2019-09-04 15:34:15 +03:00
Nikolai Kochetov
5246be8a17 Update PipelineExecutor. 2019-09-04 12:37:56 +03:00
CurtizJ
9cfcbd6649 fix bug in FillingBlockInputStream 2019-09-04 01:01:09 +03:00
Nikolai Kochetov
73c052f576 Revert PipelineExecutor changes. 2019-09-03 21:05:44 +03:00
Nikolai Kochetov
5113bd3650 Add task stilling to PipelineExecutor. 2019-09-03 15:06:45 +03:00
Nikolai Kochetov
aa9481e76e Add task stilling to PipelineExecutor. 2019-09-03 14:22:34 +03:00
alexey-milovidov
7847de1947
Merge pull request #6629 from CurtizJ/read-in-order-2 
Implement 'read in order' optimization with processors.
 2019-09-03 14:21:19 +03:00
Nikolai Kochetov
99476d0039 Add task stilling to PipelineExecutor. 2019-09-03 14:15:37 +03:00
CurtizJ
22badef1a2 Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-09-03 13:47:18 +03:00
Nikolai Kochetov
e55647eee9 Force add resize befor aggregating transform. 2019-09-03 13:14:13 +03:00
CurtizJ
6d821c4877 fix build 2019-09-03 13:07:31 +03:00
Nikolai Kochetov
702c1b03da Revert to LFStack. 2019-09-03 11:42:26 +03:00
CurtizJ
973b533377 Merge remote-tracking branch 'upstream/master' into read-in-order-2 2019-09-03 00:59:51 +03:00
Nikolai Kochetov
52ca3f2b4c Add stream enumeration to Processors. 2019-09-02 20:01:03 +03:00
Nikolai Kochetov
cfbb3ce6f9 Add stream enumeration to Processors. 2019-09-02 19:58:24 +03:00
Nikolai Kochetov
5352ac9145 Add stream enumeration to Processors. 2019-09-02 19:57:06 +03:00
Nikolai Kochetov
1f70aee2e6 Add stream enumeration to Processors. 2019-09-02 19:55:01 +03:00
Alexander Tokmakov
b9eb992320 Merge branch 'master' into merging_values_with_expressions 2019-09-02 19:54:56 +03:00
Alexander Tokmakov
ec5fbf525d remove ValuesRowInputFormat 2019-09-02 19:33:58 +03:00
Alexander Tokmakov
d31358a280 change ValuesBlockInputStream to ValuesBlockInputFormat 2019-09-02 19:26:22 +03:00
Nikolai Kochetov
88044fdc16 Add stream enumeration to Processors. 2019-09-02 18:49:18 +03:00
CurtizJ
e122d54dcb update comments 2019-09-02 18:22:27 +03:00
Alexey Milovidov
402599a38c Merge branch 'master' into time-zone-configuration 2019-09-02 18:13:54 +03:00
Nikolai Kochetov
52eae3a242 Add stream enumeration to Processors. 2019-09-02 17:55:43 +03:00
alexey-milovidov
a71a1693f0
Merge pull request #6777 from yandex/fix-pvs-warning-in-pipeline-executor 
Fix PVS warning in PipelineExecutor.
 2019-09-02 17:53:28 +03:00
Nikolai Kochetov
0016d99f5e Add stream enumeration to Processors. 2019-09-02 17:49:05 +03:00
CurtizJ
de5e2b4d6b Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-09-02 17:34:49 +03:00
Alexander Tokmakov
8adf13047b fix build 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
804c911d3f ValuesRowInputStream changed to ValuesBlockInputStream 2019-09-02 17:33:09 +03:00
CurtizJ
da11fb86b7 implement 'with fill' modifier with processors 2019-09-02 17:29:51 +03:00
Nikolai Kochetov
2eecd35d27 Fix PVS warning in PipelineExecutor. 2019-09-02 16:30:51 +03:00
Nikolai Kochetov
bf0c0ed4f1 Merge branch 'master' into processors-2 2019-09-02 16:02:09 +03:00
Nikolai Kochetov
278e33cfa3 Try add LFStack. 2019-09-02 15:48:58 +03:00
Nikolai Kochetov
5005c0006c Try add LFStack. 2019-09-02 15:34:18 +03:00
Nikolai Kochetov
6221a42fcc Comment out all stopwatchs in PipelineExecutor. 2019-09-02 14:02:08 +03:00
Alexander Tokmakov
3da233ef42 fix build 2019-09-02 13:47:06 +03:00
Nikolai Kochetov
300dc80194 Update Aggregator interface. 2019-08-31 11:58:16 +03:00
Alexander Tokmakov
4c744af113 minor style fixes 2019-08-30 20:25:35 +03:00
Alexander Tokmakov
e3982704ea try to fix build 2019-08-30 00:46:36 +03:00
Alexander Tokmakov
d95d53b4e4 better error messages 2019-08-29 22:35:59 +03:00
CurtizJ
a6e43c4119 merging with master 2019-08-29 19:48:02 +03:00
Alexander Tokmakov
03c83169bd Merge branch 'master' into merging_template_format 2019-08-29 16:34:25 +03:00
Alexey Milovidov
eb15c9416a Fixed style 2019-08-28 21:00:40 +03:00
Alexey Milovidov
30cc569845 Avoid initializing DateLUT in static constructors 2019-08-28 20:11:40 +03:00
Alexander Tokmakov
c8096542bf more tests and fixes 2019-08-28 19:46:54 +03:00
Alexey Milovidov
b21fdff77e Merging #6678 2019-08-27 21:59:21 +03:00
Nikolai Kochetov
4cb52cebea Update max_threads for processors. 2019-08-27 21:37:28 +03:00
Alexander Tokmakov
93c672aa0b delete BlockInputStreamFromRowInputStream 2019-08-27 21:29:56 +03:00
CurtizJ
50d870705c limit with ties for processors 2019-08-27 20:48:42 +03:00
Alexander Tokmakov
cf3a8b993b allow skipping fields in TemplateRowInputFormat 2019-08-27 19:53:26 +03:00
Nikolai Kochetov
d958316e58 Enable processors by default. Do not check block srtucture in SourceFromInutStream if not debug. 2019-08-27 11:17:42 +03:00
Weiqing Xu
2fbcd607f3 check free space when use external sort/aggerator 2019-08-27 08:23:07 +08:00
CurtizJ
fa5aeb757f fix clang build 2019-08-26 20:37:40 +03:00
CurtizJ
4a7459f3b3 cleanup and update comments 2019-08-26 18:25:18 +03:00
CurtizJ
c63eeb8933 add FinishSortingTransform, refactor MergeSortingTransform 2019-08-26 17:54:29 +03:00
Alexander Tokmakov
f9445626d1 better parsing of format string 2019-08-26 16:02:15 +03:00
Alexey Milovidov
6d3250867c Fixed build of tests 2019-08-25 01:08:45 +03:00
Alexander Tokmakov
0136ef9a5f move formats to processors 2019-08-23 22:47:22 +03:00
Alexey Milovidov
b42f85e16b Added a check for double whitespaces 2019-08-23 21:30:04 +03:00
alexey-milovidov
5c99780b08
Merge pull request #6606 from yandex/processors-2 
Enable processors by default.
 2019-08-23 02:50:11 +03:00
Nikolai Kochetov
b3f91a717c Use ThreadFromGlobalPool in PipelineExecutor instead of ThreadPool. 2019-08-22 17:38:44 +03:00
Nikolai Kochetov
b93ffdd038 Fix MergingSortedTransform. 2019-08-22 13:16:56 +03:00
Nikolai Kochetov
11f8ec76df Fix CubeTransform. 2019-08-22 12:28:23 +03:00
Nikolai Kochetov
4f38b08481 Fix RollupTransform. 2019-08-22 11:53:34 +03:00
Nikolai Kochetov
8228871821 Fix RollupTransform. 2019-08-22 11:29:29 +03:00
Nikolai Kochetov
c3aaf583a0 Fix RollupTransform. 2019-08-22 11:26:50 +03:00
akonyaev
1683547b2d ADQM-34 fix style 2019-08-22 10:24:04 +03:00
akonyaev
01216e45b6 Merge branch 'master' of https://github.com/yandex/ClickHouse into ADQM-34 
# Conflicts:
#	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp
 2019-08-22 09:40:51 +03:00
akonyaev
321233ddaa ADQM-34 fix hardcode for,at name in ArrowColumnToCHColumn class 2019-08-21 19:39:20 +03:00
Nikolai Kochetov
2e03ac09ec Fix MergingSortedTransform. 2019-08-21 19:38:27 +03:00
Nikolai Kochetov
e68775e3d0 Fix TotalsHavingTransform. 2019-08-21 17:51:32 +03:00
akonyaev
caf0d30a5f ADQM-34 add orc input format 2019-08-21 17:19:47 +03:00
Nikolai Kochetov
fe3221d0e4 Fix SortingAggregatedTransform. 2019-08-21 17:19:18 +03:00
Nikolai Kochetov
c27cada229 Fix ExpressionTransform. 2019-08-21 16:14:23 +03:00
Alexey Milovidov
8966520801 Added "assert_cast" function as a replacement for static_cast for columns 2019-08-21 05:28:04 +03:00
Alexey Milovidov
a6b64d6ba0 Parquet: Fix reading boolean columns 2019-08-21 04:00:13 +03:00
Nikolai Kochetov
06bb0af386 Fix build. 2019-08-20 18:03:35 +03:00
Nikolai Kochetov
aef03fd9bf
Merge pull request #6425 from yandex/vzakaznikov-liveview 
Merge LIVE VIEW
 2019-08-20 17:13:42 +03:00
Ivan
a502424c33
Implement support for insertion into Kafka tables (#6012) 
* Add write-callback on each row for RowOutputStream
* Fix build of new rdkafka library
* Poll messages if Kafka outgoing queue is full
* Add test
* Add test producer-consumer
* Truncate delimiter from last row in message
 2019-08-20 14:17:57 +03:00
Nikolai Kochetov
cdf1ce3171 Merge branch 'master' into vzakaznikov-liveview 2019-08-20 10:41:31 +03:00
Alexander Tokmakov
bca580653d fix csv input 2019-08-20 02:09:02 +03:00
proller
d09c5c871b Build fixes (#6491) 
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)
 2019-08-18 01:53:46 +03:00
Nikolai Kochetov
18ad0e7e6b Merged with master. 2019-08-16 13:55:40 +03:00
Nikolai Kochetov
e51c48501b Fix arg type forPipelineExecutor::prepareProcessor 2019-08-14 18:28:33 +03:00
Nikolai Kochetov
631bbde420 Merged with master. 2019-08-12 13:19:13 +03:00
Alexey Milovidov
2570907f44 Removed useless parameter 2019-08-12 00:45:18 +03:00
alexey-milovidov
838c5e535f
Merge pull request #6433 from yandex/prevent-stack-overflow-in-parser 
Fixed possible stack overflow in parser
 2019-08-10 23:58:54 +03:00
Alexey Milovidov
0a9787c7f3 Fixed possible stack overflow in parser 2019-08-10 19:38:25 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Nikolai Kochetov
ed11432f68 Added JSONEachRowWithProgressRowOutputFormat. 2019-08-09 19:10:47 +03:00
Nikolai Kochetov
23e2d17d9d Added JSONEachRowWithProgressRowOutputFormat. 2019-08-09 18:58:07 +03:00
Nikolai Kochetov
bd8c9733e3 Update MySQLOutputFormat. 2019-08-05 12:35:46 +03:00
Nikolai Kochetov
abc63f8a06 Merged with master. 2019-08-04 15:43:11 +03:00
Nikolai Kochetov
511f3050a6 Update CSVRowInputFormat. 2019-08-04 13:19:51 +03:00
Nikolai Kochetov
1f6a16b03a Remove ValuesRowInputStream. 2019-08-02 20:16:58 +03:00
Nikolai Kochetov
e5d67cbe61 Remove ProtobufRowOutputStream. 2019-08-02 19:34:20 +03:00
Nikolai Kochetov
5fb548c994 Remove ProtobufRowOutputStream. 2019-08-02 19:31:17 +03:00
Nikolai Kochetov
8c66d106e4 Remove ProtobufRowInputStream. 2019-08-02 19:23:44 +03:00
Nikolai Kochetov
529e06e5cb Remove ParquetBlockOutputStream. 2019-08-02 19:09:52 +03:00
Nikolai Kochetov
fcecbbda73 Remove OParquetBlockInputStream 2019-08-02 19:00:24 +03:00
Nikolai Kochetov
ae50ab6907 Remove JSONEachRowRowInputStream. 2019-08-02 18:36:36 +03:00
Nikolai Kochetov
48818aef7f Update MySQLOutputFormat. 2019-08-02 15:41:21 +03:00
Nikolai Kochetov
0201cdf61a Merge branch 'master' into processors-and-output-formats 2019-08-02 15:29:19 +03:00
Nikolai Kochetov
c228f18130 Update IRowInputFormat and FormatFactory. 2019-08-01 17:25:41 +03:00
Nikolai Kochetov
a5bb2e2b3f Update Schema name in Protobuf and CapnProto formats. 2019-08-01 12:56:30 +03:00
Nikolai Kochetov
9811fdcdc7 Update CapnProtoRowInputFormat. 2019-08-01 11:31:08 +03:00
Nikolai Kochetov
9c4aefe2ae Update ODBCDriver2BlockOutputFormat. 2019-07-31 18:10:51 +03:00
Nikolai Kochetov
1347cf1359 Update ODBCDriver2BlockOutputFormat. 2019-07-31 17:58:56 +03:00
Nikolai Kochetov
3a8fefdda8 Update CSVRowInputStream. 2019-07-31 17:43:08 +03:00
Nikolai Kochetov
f0bf083efc Update CSVRowInputStream. 2019-07-31 17:16:28 +03:00
Nikolai Kochetov
2c638d577d Update VerticalRowOutputFormat. 2019-07-31 14:51:00 +03:00
Nikolai Kochetov
8bfd909f5b Update JSONEachRowRowOutputFormat. 2019-07-31 13:06:46 +03:00
Nikolai Kochetov
5bdb6aa9f3 Update TSKVRowInputFormat. 2019-07-31 12:43:20 +03:00
Nikolai Kochetov
b274545bb7 Update CSVRowInputFormat. 2019-07-30 21:48:40 +03:00
Nikolai Kochetov
e8b643e032 Update CSVRowInputFormat. 2019-07-30 21:22:01 +03:00
Nikolai Kochetov
ee3a93bab5 Update CSVRowInputFormat. 2019-07-30 21:21:12 +03:00
Nikolai Kochetov
d4da486b51 Update CSVRowInputFormat. 2019-07-30 17:55:59 +03:00
Yuriy
c1b57f9cf5 fixed heap buffer overflow in PacketPayloadWriteBuffer 2019-07-29 18:41:47 +03:00
Yuriy
383fa25c51 resolved conflict 2019-07-28 02:00:15 +03:00
Nikolai Kochetov
95dd6222fe Use IInputFormat and IOutputFormat by default. 2019-07-25 15:17:57 +03:00
Nikolai Kochetov
78f056d83f Use IInputFormat and IOutputFormat by default. 2019-07-25 12:35:16 +03:00
Nikolai Kochetov
36a0275ff1 Use IInputFormat and IOutputFormat by default. 2019-07-25 12:31:38 +03:00
Nikolai Kochetov
69f860a5ef Use IInputFormat and IOutputFormat by default. 2019-07-25 12:28:33 +03:00
Nikolai Kochetov
a22540d010 Use IInputFormat and IOutputFormat by default. 2019-07-25 12:20:00 +03:00
Nikolai Kochetov
4cc3bf7724 Use IInputFormat and IOutputFormat by default. 2019-07-25 12:15:33 +03:00
Nikolai Kochetov
58d579e7e2 Use IInputFormat and IOutputFormat by default. 2019-07-24 21:00:09 +03:00
Vitaly Baranov
d3ff30cb5b Use better approach to check offsets in protobuf messages. 2019-07-24 14:41:49 +03:00
Alexander Kuzmenkov
9df09f3506 Do not access shared arenas in aggregate function columns. 
These arenas may be updated concurrently, so it is unsafe to
access them, as illustrated by issue #4402. Store them separately
and use a different arena for the updates. Change some callers
to accomodate for this.
 2019-07-18 14:21:37 +03:00
Yuriy
a03114ede2 cast to proper type 2019-07-16 11:47:54 +03:00
Yuriy
d74be1dc9c fixed MySQLOutputFormat used by new query processing pipeline 2019-07-16 11:24:51 +03:00
Nikolai Kochetov
bfa114126a More comments for PipelineExecutor. 2019-07-11 09:50:44 +03:00
Nikolai Kochetov
d104f2d8ff Update PipelineExecutor 2019-07-10 14:59:30 +03:00
Nikolai Kochetov
282feb1fdb Update PipelineExecutor 2019-07-10 09:52:44 +03:00
Nikolai Kochetov
6974cc3c9f Update ResizePipeline 2019-07-09 20:47:13 +03:00
Nikolai Kochetov
911e4014ff Increase queue size in LazyOutputFormat in order to prevent potential lock. 2019-07-09 15:26:22 +03:00
Nikolai Kochetov
27acbb0412 Fix tests. 2019-07-08 21:08:44 +03:00
Nikolai Kochetov
de2221222e Don't skip empty chunks in Filter Transform. 2019-07-08 18:52:18 +03:00
Nikolai Kochetov
2128fb890b Don't skip empty chunks in Filter Transform. 2019-07-08 18:23:45 +03:00
Nikolai Kochetov
e0362c5216 Fix build. 2019-07-08 16:15:45 +03:00
Nikolai Kochetov
472f32f718 Remove ThreadGroupThreadPoolCallbacks 2019-07-08 15:49:52 +03:00
Nikolai Kochetov
e5103d741c Fix lock in case of query was cancelled. 2019-07-08 15:48:16 +03:00
Nikolai Kochetov
fc3b465d60 Fix race in doExpandPipeline. 2019-07-08 15:49:46 +03:00
Nikolai Kochetov
a27fbe6ea7 Removed lockfree stack. 2019-07-08 15:49:33 +03:00
Nikolai Kochetov
45b7d479aa Fix arguments in prepareProcessor call. 2019-07-08 15:49:23 +03:00
Nikolai Kochetov
02bded6f21 Added MySQLOutputFormat. 2019-07-08 15:49:15 +03:00
Nikolai Kochetov
acf382f9e5 Use boost::lockfree::stack instead of boost::lockfree::queue 2019-07-08 15:48:51 +03:00
Nikolai Kochetov
3ff5495fba Fix raise in PipelineExecutor::doExpandPipeline 2019-07-08 15:48:41 +03:00
Nikolai Kochetov
3df6d12216 More comments for PipelineExecutor. 2019-07-08 15:48:16 +03:00
Nikolai Kochetov
e8b4362ed2 Use ThreadPool in PipelineExecutor. 2019-07-08 15:48:32 +03:00
Nikolai Kochetov
f808d71aba Fix build. 2019-07-08 15:48:16 +03:00
Nikolai Kochetov
50aac7e982 Atomic Ports. [2] 2019-06-25 19:42:57 +03:00
Nikolai Kochetov
67b7080707 Atomic Ports. 2019-06-25 19:42:26 +03:00
Nikolai Kochetov
ab781f0988 Add task_queue to PipelineExecutor. 2019-06-25 19:42:05 +03:00
Nikolai Kochetov
d0cd3cc640 Update PipelineExecutor 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
1f6bbeee7d Update Port.h 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
94e087102d Use std::pair in port. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
6c2dd9b87d Remove copy constructor from Chunk. 2019-06-25 19:41:59 +03:00
Nikolai Kochetov
11e0752f6d Update PipelineExecutor. 2019-06-25 19:41:55 +03:00
Nikolai Kochetov
c6bbf6d91d Process pipeline in each thread in PipelineExecutor. 
Exception safety in PipelineExecutor.
 2019-06-25 19:41:38 +03:00
Nikolai Kochetov
d8f0c6c15a Added stream number to pipeline execution state. 2019-06-25 19:41:28 +03:00
Nikolai Kochetov
3bee30a215 Update PipelineExecutor. 2019-06-25 19:41:11 +03:00
Nikolai Kochetov
fc5f28faeb Remove ExceptionHandler from PipelineExecutor. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
8299680efe Update Port.h 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
76934cf801 Don't call cancell for RemoteBlockInputStream in SourceFromInputStream. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
f5e20027a7 Better exception safety for SourceFromInputStream. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
1ae23a6d9d Don't throw exception if query was cannelled. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
821d520a52 Fix limit by offset. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
cc09bb5557 Fix distinct. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
96174e90b0 Fix build. 2019-06-25 19:41:00 +03:00
Nikolai Kochetov
4ef3ff7270 Better exception safety for ISource and MergingAggregatedTransform. 2019-05-14 12:50:04 +03:00
Nikolai Kochetov
6a781cf2c8 Free chunks when merge sort is finished at MergeSorter. 2019-05-13 17:57:49 +03:00
Nikolai Kochetov
ba6768557e Fix rows_before_limit_at_least. 2019-05-13 16:04:52 +03:00
Nikolai Kochetov
fe9a45fee1 Fix rows_before_limit_at_least. 2019-05-13 15:08:02 +03:00
Nikolai Kochetov
18a7b0d7a2 Fix data race in PipelineExecutor. 2019-05-13 13:03:47 +03:00
Nikolai Kochetov
b8adb0937f Do not create processors for totals stream. 2019-04-30 20:37:30 +03:00
Nikolai Kochetov
ad8af5b5ba Do not create processors for totals stream. 2019-04-30 20:12:43 +03:00
Nikolai Kochetov
72c0530845 Do not create processors for totals stream. 2019-04-30 20:01:12 +03:00
Nikolai Kochetov
249a88784b Remove thread group from PipelineExecutor task. 2019-04-30 15:51:25 +03:00
Nikolai Kochetov
ced8e607f1 Wait for tasks from thread pool in case of exception in PipelineExecutor. 2019-04-30 15:28:11 +03:00
Nikolai Kochetov
e20f6a96af Disable pushing exceptions to ports from ISource. 2019-04-30 12:45:13 +03:00
Nikolai Kochetov
0faab7ff12 Disable pushing exceptions to ports from ISource. 2019-04-30 12:43:51 +03:00
Nikolai Kochetov
99ff2375ab Skip false constants in FilterTransform. 2019-04-30 12:38:37 +03:00
Nikolai Kochetov
65fb195fd7 Pass exception from ISource. 2019-04-29 21:43:50 +03:00
Nikolai Kochetov
062407cf14 Fix build. 2019-04-29 21:24:32 +03:00
Nikolai Kochetov
00bccfa232 Fix rows_before_limit_at_least. 2019-04-29 19:52:50 +03:00
Nikolai Kochetov
aacc0572e5 Attach to current thread in threadpool. 2019-04-29 16:57:29 +03:00
Nikolai Kochetov
36a9b5155b Attach to current thread in threadpool. 2019-04-29 15:23:20 +03:00
Nikolai Kochetov
caf9ed639b Attach tasks from PipelineExecutor to thread group. 2019-04-29 14:04:03 +03:00
Nikolai Kochetov
0b8107c497 Fix totals with rollup. 2019-04-29 13:00:17 +03:00
Nikolai Kochetov
4d87fd327f Don't add info about processors to TOO_MANY_ROWS_OR_BYTES exception. 2019-04-26 21:43:13 +03:00
Nikolai Kochetov
13800ac650 Don't add info about processors to TOO_MANY_ROWS_OR_BYTES exception. 2019-04-26 20:33:46 +03:00
Nikolai Kochetov
e2a41a031a Don't add info about processors to TOO_MANY_ROWS_OR_BYTES exception. 2019-04-26 20:21:14 +03:00
Nikolai Kochetov
90b5bb32ba Allow pass exceptions through ports. Pass exceptions for ISimpleTransform. 2019-04-26 19:21:24 +03:00
Nikolai Kochetov
080d573300 Fix port for totals. 2019-04-26 18:12:39 +03:00
Nikolai Kochetov
0aa9ee88db Even task consuming in ResizeProcessor. 2019-04-26 14:40:35 +03:00
Nikolai Kochetov
4a9c0a1e56 Even task consuming in ResizeProcessor. 2019-04-26 14:34:51 +03:00
Nikolai Kochetov
b475fb1d4c Even task consuming in ResizeProcessor. 2019-04-26 14:15:33 +03:00
Nikolai Kochetov
6d65f95283 Fix totals chunk in TotalsHavingTransform. 2019-04-25 18:35:13 +03:00
Nikolai Kochetov
e8e5164d9d Don't use same headers for main and totals streams in QueryPipeline. 2019-04-25 17:52:51 +03:00
Nikolai Kochetov
b3a90eeda0 Read prefix in SourceFromInputStream. 2019-04-25 16:34:59 +03:00
Nikolai Kochetov
b906e36eb6 Undo add thread_group to ThreadPool 2019-04-18 21:45:51 +03:00
Nikolai Kochetov
36392aab6b Fix Cube transform. 2019-04-18 20:32:01 +03:00
Nikolai Kochetov
2377298c0d Fix Cube transform. 2019-04-18 20:28:55 +03:00
Nikolai Kochetov
a7486a25cf Fix Cube transform. 2019-04-18 20:17:18 +03:00
Nikolai Kochetov
0694a61c05 Fix Cube transform. 2019-04-18 20:08:28 +03:00
Nikolai Kochetov
45ffec6c5c Fix Cube transform. 2019-04-18 19:27:18 +03:00
Nikolai Kochetov
8718b7bb40 Added thread_group argument to ThreadPool. 2019-04-18 17:55:43 +03:00
Nikolai Kochetov
745beb6080 Fix rollup and cube transforms. 2019-04-18 15:43:13 +03:00