thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-10-11 02:50:50 +00:00
Code Issues Packages Projects Releases Wiki Activity
30,422 Commits 8,991 Branches 1,770 Tags 2.1 GiB
f7d2e1b758
Commit Graph

464 Commits

Author SHA1 Message Date
Nikolai Kochetov
b9e26d15de Try to enumerate streams again. 2019-09-04 16:17:50 +03:00
Nikolai Kochetov
3a7e7287c0 Update PipelineExecutor. 2019-09-04 15:34:15 +03:00
Nikolai Kochetov
5246be8a17 Update PipelineExecutor. 2019-09-04 12:37:56 +03:00
CurtizJ
9cfcbd6649 fix bug in FillingBlockInputStream 2019-09-04 01:01:09 +03:00
Nikolai Kochetov
73c052f576 Revert PipelineExecutor changes. 2019-09-03 21:05:44 +03:00
Nikolai Kochetov
5113bd3650 Add task stilling to PipelineExecutor. 2019-09-03 15:06:45 +03:00
Nikolai Kochetov
aa9481e76e Add task stilling to PipelineExecutor. 2019-09-03 14:22:34 +03:00
alexey-milovidov
7847de1947
Merge pull request #6629 from CurtizJ/read-in-order-2 
Implement 'read in order' optimization with processors.
 2019-09-03 14:21:19 +03:00
Nikolai Kochetov
99476d0039 Add task stilling to PipelineExecutor. 2019-09-03 14:15:37 +03:00
CurtizJ
22badef1a2 Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-09-03 13:47:18 +03:00
Nikolai Kochetov
e55647eee9 Force add resize befor aggregating transform. 2019-09-03 13:14:13 +03:00
CurtizJ
6d821c4877 fix build 2019-09-03 13:07:31 +03:00
Nikolai Kochetov
702c1b03da Revert to LFStack. 2019-09-03 11:42:26 +03:00
CurtizJ
973b533377 Merge remote-tracking branch 'upstream/master' into read-in-order-2 2019-09-03 00:59:51 +03:00
Nikolai Kochetov
52ca3f2b4c Add stream enumeration to Processors. 2019-09-02 20:01:03 +03:00
Nikolai Kochetov
cfbb3ce6f9 Add stream enumeration to Processors. 2019-09-02 19:58:24 +03:00
Nikolai Kochetov
5352ac9145 Add stream enumeration to Processors. 2019-09-02 19:57:06 +03:00
Nikolai Kochetov
1f70aee2e6 Add stream enumeration to Processors. 2019-09-02 19:55:01 +03:00
Alexander Tokmakov
b9eb992320 Merge branch 'master' into merging_values_with_expressions 2019-09-02 19:54:56 +03:00
Alexander Tokmakov
ec5fbf525d remove ValuesRowInputFormat 2019-09-02 19:33:58 +03:00
Alexander Tokmakov
d31358a280 change ValuesBlockInputStream to ValuesBlockInputFormat 2019-09-02 19:26:22 +03:00
Nikolai Kochetov
88044fdc16 Add stream enumeration to Processors. 2019-09-02 18:49:18 +03:00
CurtizJ
e122d54dcb update comments 2019-09-02 18:22:27 +03:00
Alexey Milovidov
402599a38c Merge branch 'master' into time-zone-configuration 2019-09-02 18:13:54 +03:00
Nikolai Kochetov
52eae3a242 Add stream enumeration to Processors. 2019-09-02 17:55:43 +03:00
alexey-milovidov
a71a1693f0
Merge pull request #6777 from yandex/fix-pvs-warning-in-pipeline-executor 
Fix PVS warning in PipelineExecutor.
 2019-09-02 17:53:28 +03:00
Nikolai Kochetov
0016d99f5e Add stream enumeration to Processors. 2019-09-02 17:49:05 +03:00
CurtizJ
de5e2b4d6b Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-09-02 17:34:49 +03:00
Alexander Tokmakov
8adf13047b fix build 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
804c911d3f ValuesRowInputStream changed to ValuesBlockInputStream 2019-09-02 17:33:09 +03:00
CurtizJ
da11fb86b7 implement 'with fill' modifier with processors 2019-09-02 17:29:51 +03:00
Nikolai Kochetov
2eecd35d27 Fix PVS warning in PipelineExecutor. 2019-09-02 16:30:51 +03:00
Nikolai Kochetov
bf0c0ed4f1 Merge branch 'master' into processors-2 2019-09-02 16:02:09 +03:00
Nikolai Kochetov
278e33cfa3 Try add LFStack. 2019-09-02 15:48:58 +03:00
Nikolai Kochetov
5005c0006c Try add LFStack. 2019-09-02 15:34:18 +03:00
Nikolai Kochetov
6221a42fcc Comment out all stopwatchs in PipelineExecutor. 2019-09-02 14:02:08 +03:00
Alexander Tokmakov
3da233ef42 fix build 2019-09-02 13:47:06 +03:00
Nikolai Kochetov
300dc80194 Update Aggregator interface. 2019-08-31 11:58:16 +03:00
Alexander Tokmakov
4c744af113 minor style fixes 2019-08-30 20:25:35 +03:00
Alexander Tokmakov
e3982704ea try to fix build 2019-08-30 00:46:36 +03:00
Alexander Tokmakov
d95d53b4e4 better error messages 2019-08-29 22:35:59 +03:00
CurtizJ
a6e43c4119 merging with master 2019-08-29 19:48:02 +03:00
Alexander Tokmakov
03c83169bd Merge branch 'master' into merging_template_format 2019-08-29 16:34:25 +03:00
Alexey Milovidov
eb15c9416a Fixed style 2019-08-28 21:00:40 +03:00
Alexey Milovidov
30cc569845 Avoid initializing DateLUT in static constructors 2019-08-28 20:11:40 +03:00
Alexander Tokmakov
c8096542bf more tests and fixes 2019-08-28 19:46:54 +03:00
Alexey Milovidov
b21fdff77e Merging #6678 2019-08-27 21:59:21 +03:00
Nikolai Kochetov
4cb52cebea Update max_threads for processors. 2019-08-27 21:37:28 +03:00
Alexander Tokmakov
93c672aa0b delete BlockInputStreamFromRowInputStream 2019-08-27 21:29:56 +03:00
CurtizJ
50d870705c limit with ties for processors 2019-08-27 20:48:42 +03:00
Alexander Tokmakov
cf3a8b993b allow skipping fields in TemplateRowInputFormat 2019-08-27 19:53:26 +03:00
Nikolai Kochetov
d958316e58 Enable processors by default. Do not check block srtucture in SourceFromInutStream if not debug. 2019-08-27 11:17:42 +03:00
Weiqing Xu
2fbcd607f3 check free space when use external sort/aggerator 2019-08-27 08:23:07 +08:00
CurtizJ
fa5aeb757f fix clang build 2019-08-26 20:37:40 +03:00
CurtizJ
4a7459f3b3 cleanup and update comments 2019-08-26 18:25:18 +03:00
CurtizJ
c63eeb8933 add FinishSortingTransform, refactor MergeSortingTransform 2019-08-26 17:54:29 +03:00
Alexander Tokmakov
f9445626d1 better parsing of format string 2019-08-26 16:02:15 +03:00
Alexey Milovidov
6d3250867c Fixed build of tests 2019-08-25 01:08:45 +03:00
Alexander Tokmakov
0136ef9a5f move formats to processors 2019-08-23 22:47:22 +03:00
Alexey Milovidov
b42f85e16b Added a check for double whitespaces 2019-08-23 21:30:04 +03:00
alexey-milovidov
5c99780b08
Merge pull request #6606 from yandex/processors-2 
Enable processors by default.
 2019-08-23 02:50:11 +03:00
Nikolai Kochetov
b3f91a717c Use ThreadFromGlobalPool in PipelineExecutor instead of ThreadPool. 2019-08-22 17:38:44 +03:00
Nikolai Kochetov
b93ffdd038 Fix MergingSortedTransform. 2019-08-22 13:16:56 +03:00
Nikolai Kochetov
11f8ec76df Fix CubeTransform. 2019-08-22 12:28:23 +03:00
Nikolai Kochetov
4f38b08481 Fix RollupTransform. 2019-08-22 11:53:34 +03:00
Nikolai Kochetov
8228871821 Fix RollupTransform. 2019-08-22 11:29:29 +03:00
Nikolai Kochetov
c3aaf583a0 Fix RollupTransform. 2019-08-22 11:26:50 +03:00
akonyaev
1683547b2d ADQM-34 fix style 2019-08-22 10:24:04 +03:00
akonyaev
01216e45b6 Merge branch 'master' of https://github.com/yandex/ClickHouse into ADQM-34 
# Conflicts:
#	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp
 2019-08-22 09:40:51 +03:00
akonyaev
321233ddaa ADQM-34 fix hardcode for,at name in ArrowColumnToCHColumn class 2019-08-21 19:39:20 +03:00
Nikolai Kochetov
2e03ac09ec Fix MergingSortedTransform. 2019-08-21 19:38:27 +03:00
Nikolai Kochetov
e68775e3d0 Fix TotalsHavingTransform. 2019-08-21 17:51:32 +03:00
akonyaev
caf0d30a5f ADQM-34 add orc input format 2019-08-21 17:19:47 +03:00
Nikolai Kochetov
fe3221d0e4 Fix SortingAggregatedTransform. 2019-08-21 17:19:18 +03:00
Nikolai Kochetov
c27cada229 Fix ExpressionTransform. 2019-08-21 16:14:23 +03:00
Alexey Milovidov
8966520801 Added "assert_cast" function as a replacement for static_cast for columns 2019-08-21 05:28:04 +03:00
Alexey Milovidov
a6b64d6ba0 Parquet: Fix reading boolean columns 2019-08-21 04:00:13 +03:00
Nikolai Kochetov
06bb0af386 Fix build. 2019-08-20 18:03:35 +03:00
Nikolai Kochetov
aef03fd9bf
Merge pull request #6425 from yandex/vzakaznikov-liveview 
Merge LIVE VIEW
 2019-08-20 17:13:42 +03:00
Ivan
a502424c33
Implement support for insertion into Kafka tables (#6012) 
* Add write-callback on each row for RowOutputStream
* Fix build of new rdkafka library
* Poll messages if Kafka outgoing queue is full
* Add test
* Add test producer-consumer
* Truncate delimiter from last row in message
 2019-08-20 14:17:57 +03:00
Nikolai Kochetov
cdf1ce3171 Merge branch 'master' into vzakaznikov-liveview 2019-08-20 10:41:31 +03:00
Alexander Tokmakov
bca580653d fix csv input 2019-08-20 02:09:02 +03:00
proller
d09c5c871b Build fixes (#6491) 
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)
 2019-08-18 01:53:46 +03:00
Nikolai Kochetov
18ad0e7e6b Merged with master. 2019-08-16 13:55:40 +03:00
Nikolai Kochetov
e51c48501b Fix arg type forPipelineExecutor::prepareProcessor 2019-08-14 18:28:33 +03:00
Nikolai Kochetov
631bbde420 Merged with master. 2019-08-12 13:19:13 +03:00
Alexey Milovidov
2570907f44 Removed useless parameter 2019-08-12 00:45:18 +03:00
alexey-milovidov
838c5e535f
Merge pull request #6433 from yandex/prevent-stack-overflow-in-parser 
Fixed possible stack overflow in parser
 2019-08-10 23:58:54 +03:00
Alexey Milovidov
0a9787c7f3 Fixed possible stack overflow in parser 2019-08-10 19:38:25 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Nikolai Kochetov
ed11432f68 Added JSONEachRowWithProgressRowOutputFormat. 2019-08-09 19:10:47 +03:00
Nikolai Kochetov
23e2d17d9d Added JSONEachRowWithProgressRowOutputFormat. 2019-08-09 18:58:07 +03:00
Nikolai Kochetov
bd8c9733e3 Update MySQLOutputFormat. 2019-08-05 12:35:46 +03:00
Nikolai Kochetov
abc63f8a06 Merged with master. 2019-08-04 15:43:11 +03:00
Nikolai Kochetov
511f3050a6 Update CSVRowInputFormat. 2019-08-04 13:19:51 +03:00
Nikolai Kochetov
1f6a16b03a Remove ValuesRowInputStream. 2019-08-02 20:16:58 +03:00
Nikolai Kochetov
e5d67cbe61 Remove ProtobufRowOutputStream. 2019-08-02 19:34:20 +03:00
Nikolai Kochetov
5fb548c994 Remove ProtobufRowOutputStream. 2019-08-02 19:31:17 +03:00
Nikolai Kochetov
8c66d106e4 Remove ProtobufRowInputStream. 2019-08-02 19:23:44 +03:00
Nikolai Kochetov
529e06e5cb Remove ParquetBlockOutputStream. 2019-08-02 19:09:52 +03:00
Nikolai Kochetov
fcecbbda73 Remove OParquetBlockInputStream 2019-08-02 19:00:24 +03:00
Nikolai Kochetov
ae50ab6907 Remove JSONEachRowRowInputStream. 2019-08-02 18:36:36 +03:00
Nikolai Kochetov
48818aef7f Update MySQLOutputFormat. 2019-08-02 15:41:21 +03:00
Nikolai Kochetov
0201cdf61a Merge branch 'master' into processors-and-output-formats 2019-08-02 15:29:19 +03:00
Nikolai Kochetov
c228f18130 Update IRowInputFormat and FormatFactory. 2019-08-01 17:25:41 +03:00
Nikolai Kochetov
a5bb2e2b3f Update Schema name in Protobuf and CapnProto formats. 2019-08-01 12:56:30 +03:00
Nikolai Kochetov
9811fdcdc7 Update CapnProtoRowInputFormat. 2019-08-01 11:31:08 +03:00
Nikolai Kochetov
9c4aefe2ae Update ODBCDriver2BlockOutputFormat. 2019-07-31 18:10:51 +03:00
Nikolai Kochetov
1347cf1359 Update ODBCDriver2BlockOutputFormat. 2019-07-31 17:58:56 +03:00
Nikolai Kochetov
3a8fefdda8 Update CSVRowInputStream. 2019-07-31 17:43:08 +03:00
Nikolai Kochetov
f0bf083efc Update CSVRowInputStream. 2019-07-31 17:16:28 +03:00
Nikolai Kochetov
2c638d577d Update VerticalRowOutputFormat. 2019-07-31 14:51:00 +03:00
Nikolai Kochetov
8bfd909f5b Update JSONEachRowRowOutputFormat. 2019-07-31 13:06:46 +03:00
Nikolai Kochetov
5bdb6aa9f3 Update TSKVRowInputFormat. 2019-07-31 12:43:20 +03:00
Nikolai Kochetov
b274545bb7 Update CSVRowInputFormat. 2019-07-30 21:48:40 +03:00
Nikolai Kochetov
e8b643e032 Update CSVRowInputFormat. 2019-07-30 21:22:01 +03:00
Nikolai Kochetov
ee3a93bab5 Update CSVRowInputFormat. 2019-07-30 21:21:12 +03:00
Nikolai Kochetov
d4da486b51 Update CSVRowInputFormat. 2019-07-30 17:55:59 +03:00
Yuriy
c1b57f9cf5 fixed heap buffer overflow in PacketPayloadWriteBuffer 2019-07-29 18:41:47 +03:00
Yuriy
383fa25c51 resolved conflict 2019-07-28 02:00:15 +03:00
Nikolai Kochetov
95dd6222fe Use IInputFormat and IOutputFormat by default. 2019-07-25 15:17:57 +03:00
Nikolai Kochetov
78f056d83f Use IInputFormat and IOutputFormat by default. 2019-07-25 12:35:16 +03:00
Nikolai Kochetov
36a0275ff1 Use IInputFormat and IOutputFormat by default. 2019-07-25 12:31:38 +03:00
Nikolai Kochetov
69f860a5ef Use IInputFormat and IOutputFormat by default. 2019-07-25 12:28:33 +03:00
Nikolai Kochetov
a22540d010 Use IInputFormat and IOutputFormat by default. 2019-07-25 12:20:00 +03:00
Nikolai Kochetov
4cc3bf7724 Use IInputFormat and IOutputFormat by default. 2019-07-25 12:15:33 +03:00
Nikolai Kochetov
58d579e7e2 Use IInputFormat and IOutputFormat by default. 2019-07-24 21:00:09 +03:00
Vitaly Baranov
d3ff30cb5b Use better approach to check offsets in protobuf messages. 2019-07-24 14:41:49 +03:00
Alexander Kuzmenkov
9df09f3506 Do not access shared arenas in aggregate function columns. 
These arenas may be updated concurrently, so it is unsafe to
access them, as illustrated by issue #4402. Store them separately
and use a different arena for the updates. Change some callers
to accomodate for this.
 2019-07-18 14:21:37 +03:00
Yuriy
a03114ede2 cast to proper type 2019-07-16 11:47:54 +03:00
Yuriy
d74be1dc9c fixed MySQLOutputFormat used by new query processing pipeline 2019-07-16 11:24:51 +03:00
Nikolai Kochetov
bfa114126a More comments for PipelineExecutor. 2019-07-11 09:50:44 +03:00
Nikolai Kochetov
d104f2d8ff Update PipelineExecutor 2019-07-10 14:59:30 +03:00
Nikolai Kochetov
282feb1fdb Update PipelineExecutor 2019-07-10 09:52:44 +03:00
Nikolai Kochetov
6974cc3c9f Update ResizePipeline 2019-07-09 20:47:13 +03:00
Nikolai Kochetov
911e4014ff Increase queue size in LazyOutputFormat in order to prevent potential lock. 2019-07-09 15:26:22 +03:00
Nikolai Kochetov
27acbb0412 Fix tests. 2019-07-08 21:08:44 +03:00
Nikolai Kochetov
de2221222e Don't skip empty chunks in Filter Transform. 2019-07-08 18:52:18 +03:00
Nikolai Kochetov
2128fb890b Don't skip empty chunks in Filter Transform. 2019-07-08 18:23:45 +03:00
Nikolai Kochetov
e0362c5216 Fix build. 2019-07-08 16:15:45 +03:00
Nikolai Kochetov
472f32f718 Remove ThreadGroupThreadPoolCallbacks 2019-07-08 15:49:52 +03:00
Nikolai Kochetov
e5103d741c Fix lock in case of query was cancelled. 2019-07-08 15:48:16 +03:00
Nikolai Kochetov
fc3b465d60 Fix race in doExpandPipeline. 2019-07-08 15:49:46 +03:00
Nikolai Kochetov
a27fbe6ea7 Removed lockfree stack. 2019-07-08 15:49:33 +03:00
Nikolai Kochetov
45b7d479aa Fix arguments in prepareProcessor call. 2019-07-08 15:49:23 +03:00
Nikolai Kochetov
02bded6f21 Added MySQLOutputFormat. 2019-07-08 15:49:15 +03:00
Nikolai Kochetov
acf382f9e5 Use boost::lockfree::stack instead of boost::lockfree::queue 2019-07-08 15:48:51 +03:00
Nikolai Kochetov
3ff5495fba Fix raise in PipelineExecutor::doExpandPipeline 2019-07-08 15:48:41 +03:00
Nikolai Kochetov
3df6d12216 More comments for PipelineExecutor. 2019-07-08 15:48:16 +03:00
Nikolai Kochetov
e8b4362ed2 Use ThreadPool in PipelineExecutor. 2019-07-08 15:48:32 +03:00