Nikolai Kochetov
3a7e7287c0
Update PipelineExecutor.
2019-09-04 15:34:15 +03:00
Nikolai Kochetov
5246be8a17
Update PipelineExecutor.
2019-09-04 12:37:56 +03:00
CurtizJ
9cfcbd6649
fix bug in FillingBlockInputStream
2019-09-04 01:01:09 +03:00
Nikolai Kochetov
73c052f576
Revert PipelineExecutor changes.
2019-09-03 21:05:44 +03:00
Nikolai Kochetov
5113bd3650
Add task stilling to PipelineExecutor.
2019-09-03 15:06:45 +03:00
Nikolai Kochetov
aa9481e76e
Add task stilling to PipelineExecutor.
2019-09-03 14:22:34 +03:00
alexey-milovidov
7847de1947
Merge pull request #6629 from CurtizJ/read-in-order-2
...
Implement 'read in order' optimization with processors.
2019-09-03 14:21:19 +03:00
Nikolai Kochetov
99476d0039
Add task stilling to PipelineExecutor.
2019-09-03 14:15:37 +03:00
CurtizJ
22badef1a2
Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill
2019-09-03 13:47:18 +03:00
Nikolai Kochetov
e55647eee9
Force add resize befor aggregating transform.
2019-09-03 13:14:13 +03:00
CurtizJ
6d821c4877
fix build
2019-09-03 13:07:31 +03:00
Nikolai Kochetov
702c1b03da
Revert to LFStack.
2019-09-03 11:42:26 +03:00
CurtizJ
973b533377
Merge remote-tracking branch 'upstream/master' into read-in-order-2
2019-09-03 00:59:51 +03:00
Nikolai Kochetov
52ca3f2b4c
Add stream enumeration to Processors.
2019-09-02 20:01:03 +03:00
Nikolai Kochetov
cfbb3ce6f9
Add stream enumeration to Processors.
2019-09-02 19:58:24 +03:00
Nikolai Kochetov
5352ac9145
Add stream enumeration to Processors.
2019-09-02 19:57:06 +03:00
Nikolai Kochetov
1f70aee2e6
Add stream enumeration to Processors.
2019-09-02 19:55:01 +03:00
Nikolai Kochetov
88044fdc16
Add stream enumeration to Processors.
2019-09-02 18:49:18 +03:00
CurtizJ
e122d54dcb
update comments
2019-09-02 18:22:27 +03:00
Alexey Milovidov
402599a38c
Merge branch 'master' into time-zone-configuration
2019-09-02 18:13:54 +03:00
Nikolai Kochetov
52eae3a242
Add stream enumeration to Processors.
2019-09-02 17:55:43 +03:00
alexey-milovidov
a71a1693f0
Merge pull request #6777 from yandex/fix-pvs-warning-in-pipeline-executor
...
Fix PVS warning in PipelineExecutor.
2019-09-02 17:53:28 +03:00
Nikolai Kochetov
0016d99f5e
Add stream enumeration to Processors.
2019-09-02 17:49:05 +03:00
CurtizJ
de5e2b4d6b
Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill
2019-09-02 17:34:49 +03:00
CurtizJ
da11fb86b7
implement 'with fill' modifier with processors
2019-09-02 17:29:51 +03:00
Nikolai Kochetov
2eecd35d27
Fix PVS warning in PipelineExecutor.
2019-09-02 16:30:51 +03:00
Nikolai Kochetov
bf0c0ed4f1
Merge branch 'master' into processors-2
2019-09-02 16:02:09 +03:00
Nikolai Kochetov
278e33cfa3
Try add LFStack.
2019-09-02 15:48:58 +03:00
Nikolai Kochetov
5005c0006c
Try add LFStack.
2019-09-02 15:34:18 +03:00
Nikolai Kochetov
6221a42fcc
Comment out all stopwatchs in PipelineExecutor.
2019-09-02 14:02:08 +03:00
Alexander Tokmakov
3da233ef42
fix build
2019-09-02 13:47:06 +03:00
Nikolai Kochetov
300dc80194
Update Aggregator interface.
2019-08-31 11:58:16 +03:00
Alexander Tokmakov
4c744af113
minor style fixes
2019-08-30 20:25:35 +03:00
Alexander Tokmakov
e3982704ea
try to fix build
2019-08-30 00:46:36 +03:00
Alexander Tokmakov
d95d53b4e4
better error messages
2019-08-29 22:35:59 +03:00
CurtizJ
a6e43c4119
merging with master
2019-08-29 19:48:02 +03:00
Alexander Tokmakov
03c83169bd
Merge branch 'master' into merging_template_format
2019-08-29 16:34:25 +03:00
Alexey Milovidov
eb15c9416a
Fixed style
2019-08-28 21:00:40 +03:00
Alexey Milovidov
30cc569845
Avoid initializing DateLUT in static constructors
2019-08-28 20:11:40 +03:00
Alexander Tokmakov
c8096542bf
more tests and fixes
2019-08-28 19:46:54 +03:00
Alexey Milovidov
b21fdff77e
Merging #6678
2019-08-27 21:59:21 +03:00
Nikolai Kochetov
4cb52cebea
Update max_threads for processors.
2019-08-27 21:37:28 +03:00
Alexander Tokmakov
93c672aa0b
delete BlockInputStreamFromRowInputStream
2019-08-27 21:29:56 +03:00
CurtizJ
50d870705c
limit with ties for processors
2019-08-27 20:48:42 +03:00
Alexander Tokmakov
cf3a8b993b
allow skipping fields in TemplateRowInputFormat
2019-08-27 19:53:26 +03:00
Nikolai Kochetov
d958316e58
Enable processors by default. Do not check block srtucture in SourceFromInutStream if not debug.
2019-08-27 11:17:42 +03:00
Weiqing Xu
2fbcd607f3
check free space when use external sort/aggerator
2019-08-27 08:23:07 +08:00
CurtizJ
fa5aeb757f
fix clang build
2019-08-26 20:37:40 +03:00
CurtizJ
4a7459f3b3
cleanup and update comments
2019-08-26 18:25:18 +03:00
CurtizJ
c63eeb8933
add FinishSortingTransform, refactor MergeSortingTransform
2019-08-26 17:54:29 +03:00
Alexander Tokmakov
f9445626d1
better parsing of format string
2019-08-26 16:02:15 +03:00
Alexey Milovidov
6d3250867c
Fixed build of tests
2019-08-25 01:08:45 +03:00
Alexander Tokmakov
0136ef9a5f
move formats to processors
2019-08-23 22:47:22 +03:00
Alexey Milovidov
b42f85e16b
Added a check for double whitespaces
2019-08-23 21:30:04 +03:00
alexey-milovidov
5c99780b08
Merge pull request #6606 from yandex/processors-2
...
Enable processors by default.
2019-08-23 02:50:11 +03:00
Nikolai Kochetov
b3f91a717c
Use ThreadFromGlobalPool in PipelineExecutor instead of ThreadPool.
2019-08-22 17:38:44 +03:00
Nikolai Kochetov
b93ffdd038
Fix MergingSortedTransform.
2019-08-22 13:16:56 +03:00
Nikolai Kochetov
11f8ec76df
Fix CubeTransform.
2019-08-22 12:28:23 +03:00
Nikolai Kochetov
4f38b08481
Fix RollupTransform.
2019-08-22 11:53:34 +03:00
Nikolai Kochetov
8228871821
Fix RollupTransform.
2019-08-22 11:29:29 +03:00
Nikolai Kochetov
c3aaf583a0
Fix RollupTransform.
2019-08-22 11:26:50 +03:00
akonyaev
1683547b2d
ADQM-34 fix style
2019-08-22 10:24:04 +03:00
akonyaev
01216e45b6
Merge branch 'master' of https://github.com/yandex/ClickHouse into ADQM-34
...
# Conflicts:
# dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp
2019-08-22 09:40:51 +03:00
akonyaev
321233ddaa
ADQM-34 fix hardcode for,at name in ArrowColumnToCHColumn class
2019-08-21 19:39:20 +03:00
Nikolai Kochetov
2e03ac09ec
Fix MergingSortedTransform.
2019-08-21 19:38:27 +03:00
Nikolai Kochetov
e68775e3d0
Fix TotalsHavingTransform.
2019-08-21 17:51:32 +03:00
akonyaev
caf0d30a5f
ADQM-34 add orc input format
2019-08-21 17:19:47 +03:00
Nikolai Kochetov
fe3221d0e4
Fix SortingAggregatedTransform.
2019-08-21 17:19:18 +03:00
Nikolai Kochetov
c27cada229
Fix ExpressionTransform.
2019-08-21 16:14:23 +03:00
Alexey Milovidov
8966520801
Added "assert_cast" function as a replacement for static_cast for columns
2019-08-21 05:28:04 +03:00
Alexey Milovidov
a6b64d6ba0
Parquet: Fix reading boolean columns
2019-08-21 04:00:13 +03:00
Nikolai Kochetov
06bb0af386
Fix build.
2019-08-20 18:03:35 +03:00
Nikolai Kochetov
aef03fd9bf
Merge pull request #6425 from yandex/vzakaznikov-liveview
...
Merge LIVE VIEW
2019-08-20 17:13:42 +03:00
Ivan
a502424c33
Implement support for insertion into Kafka tables ( #6012 )
...
* Add write-callback on each row for RowOutputStream
* Fix build of new rdkafka library
* Poll messages if Kafka outgoing queue is full
* Add test
* Add test producer-consumer
* Truncate delimiter from last row in message
2019-08-20 14:17:57 +03:00
Nikolai Kochetov
cdf1ce3171
Merge branch 'master' into vzakaznikov-liveview
2019-08-20 10:41:31 +03:00
Alexander Tokmakov
bca580653d
fix csv input
2019-08-20 02:09:02 +03:00
proller
d09c5c871b
Build fixes ( #6491 )
...
* Fix build
* cmake: fix cpuinfo
* Fix includes after processors merge
Conflicts:
dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp
* Fix build in gcc8
* fix test link
* fix test link
* Fix test link
* link fix
* Fix includes after processors merge 2
Conflicts:
dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp
* Fix includes after processors merge 3
* link fix
* Fix likely/unlikely conflict with cython
* Fix conflict with protobuf/stubs/atomicops.h
* remove unlikely.h
* Fix macos build (do not use timer_t)
2019-08-18 01:53:46 +03:00
Nikolai Kochetov
18ad0e7e6b
Merged with master.
2019-08-16 13:55:40 +03:00
Nikolai Kochetov
e51c48501b
Fix arg type forPipelineExecutor::prepareProcessor
2019-08-14 18:28:33 +03:00
Nikolai Kochetov
631bbde420
Merged with master.
2019-08-12 13:19:13 +03:00
Alexey Milovidov
2570907f44
Removed useless parameter
2019-08-12 00:45:18 +03:00
alexey-milovidov
838c5e535f
Merge pull request #6433 from yandex/prevent-stack-overflow-in-parser
...
Fixed possible stack overflow in parser
2019-08-10 23:58:54 +03:00
Alexey Milovidov
0a9787c7f3
Fixed possible stack overflow in parser
2019-08-10 19:38:25 +03:00
kreuzerkrieg
112fc71276
adding -Wshadow for GCC
2019-08-09 23:58:16 +03:00
Nikolai Kochetov
ed11432f68
Added JSONEachRowWithProgressRowOutputFormat.
2019-08-09 19:10:47 +03:00
Nikolai Kochetov
23e2d17d9d
Added JSONEachRowWithProgressRowOutputFormat.
2019-08-09 18:58:07 +03:00
Nikolai Kochetov
bd8c9733e3
Update MySQLOutputFormat.
2019-08-05 12:35:46 +03:00
Nikolai Kochetov
abc63f8a06
Merged with master.
2019-08-04 15:43:11 +03:00
Nikolai Kochetov
511f3050a6
Update CSVRowInputFormat.
2019-08-04 13:19:51 +03:00
Nikolai Kochetov
1f6a16b03a
Remove ValuesRowInputStream.
2019-08-02 20:16:58 +03:00
Nikolai Kochetov
e5d67cbe61
Remove ProtobufRowOutputStream.
2019-08-02 19:34:20 +03:00
Nikolai Kochetov
5fb548c994
Remove ProtobufRowOutputStream.
2019-08-02 19:31:17 +03:00
Nikolai Kochetov
8c66d106e4
Remove ProtobufRowInputStream.
2019-08-02 19:23:44 +03:00
Nikolai Kochetov
529e06e5cb
Remove ParquetBlockOutputStream.
2019-08-02 19:09:52 +03:00
Nikolai Kochetov
fcecbbda73
Remove OParquetBlockInputStream
2019-08-02 19:00:24 +03:00
Nikolai Kochetov
ae50ab6907
Remove JSONEachRowRowInputStream.
2019-08-02 18:36:36 +03:00
Nikolai Kochetov
48818aef7f
Update MySQLOutputFormat.
2019-08-02 15:41:21 +03:00
Nikolai Kochetov
0201cdf61a
Merge branch 'master' into processors-and-output-formats
2019-08-02 15:29:19 +03:00
Nikolai Kochetov
c228f18130
Update IRowInputFormat and FormatFactory.
2019-08-01 17:25:41 +03:00
Nikolai Kochetov
a5bb2e2b3f
Update Schema name in Protobuf and CapnProto formats.
2019-08-01 12:56:30 +03:00