Alexey Milovidov
eb15c9416a
Fixed style
2019-08-28 21:00:40 +03:00
Alexey Milovidov
30cc569845
Avoid initializing DateLUT in static constructors
2019-08-28 20:11:40 +03:00
Alexander Tokmakov
c8096542bf
more tests and fixes
2019-08-28 19:46:54 +03:00
Alexey Milovidov
b21fdff77e
Merging #6678
2019-08-27 21:59:21 +03:00
Nikolai Kochetov
4cb52cebea
Update max_threads for processors.
2019-08-27 21:37:28 +03:00
Alexander Tokmakov
93c672aa0b
delete BlockInputStreamFromRowInputStream
2019-08-27 21:29:56 +03:00
CurtizJ
50d870705c
limit with ties for processors
2019-08-27 20:48:42 +03:00
Alexander Tokmakov
cf3a8b993b
allow skipping fields in TemplateRowInputFormat
2019-08-27 19:53:26 +03:00
Nikolai Kochetov
d958316e58
Enable processors by default. Do not check block srtucture in SourceFromInutStream if not debug.
2019-08-27 11:17:42 +03:00
Weiqing Xu
2fbcd607f3
check free space when use external sort/aggerator
2019-08-27 08:23:07 +08:00
CurtizJ
fa5aeb757f
fix clang build
2019-08-26 20:37:40 +03:00
CurtizJ
4a7459f3b3
cleanup and update comments
2019-08-26 18:25:18 +03:00
CurtizJ
c63eeb8933
add FinishSortingTransform, refactor MergeSortingTransform
2019-08-26 17:54:29 +03:00
Alexander Tokmakov
f9445626d1
better parsing of format string
2019-08-26 16:02:15 +03:00
Alexey Milovidov
6d3250867c
Fixed build of tests
2019-08-25 01:08:45 +03:00
Alexander Tokmakov
0136ef9a5f
move formats to processors
2019-08-23 22:47:22 +03:00
Alexey Milovidov
b42f85e16b
Added a check for double whitespaces
2019-08-23 21:30:04 +03:00
alexey-milovidov
5c99780b08
Merge pull request #6606 from yandex/processors-2
...
Enable processors by default.
2019-08-23 02:50:11 +03:00
Nikolai Kochetov
b3f91a717c
Use ThreadFromGlobalPool in PipelineExecutor instead of ThreadPool.
2019-08-22 17:38:44 +03:00
Nikolai Kochetov
b93ffdd038
Fix MergingSortedTransform.
2019-08-22 13:16:56 +03:00
Nikolai Kochetov
11f8ec76df
Fix CubeTransform.
2019-08-22 12:28:23 +03:00
Nikolai Kochetov
4f38b08481
Fix RollupTransform.
2019-08-22 11:53:34 +03:00
Nikolai Kochetov
8228871821
Fix RollupTransform.
2019-08-22 11:29:29 +03:00
Nikolai Kochetov
c3aaf583a0
Fix RollupTransform.
2019-08-22 11:26:50 +03:00
akonyaev
1683547b2d
ADQM-34 fix style
2019-08-22 10:24:04 +03:00
akonyaev
01216e45b6
Merge branch 'master' of https://github.com/yandex/ClickHouse into ADQM-34
...
# Conflicts:
# dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp
2019-08-22 09:40:51 +03:00
akonyaev
321233ddaa
ADQM-34 fix hardcode for,at name in ArrowColumnToCHColumn class
2019-08-21 19:39:20 +03:00
Nikolai Kochetov
2e03ac09ec
Fix MergingSortedTransform.
2019-08-21 19:38:27 +03:00
Nikolai Kochetov
e68775e3d0
Fix TotalsHavingTransform.
2019-08-21 17:51:32 +03:00
akonyaev
caf0d30a5f
ADQM-34 add orc input format
2019-08-21 17:19:47 +03:00
Nikolai Kochetov
fe3221d0e4
Fix SortingAggregatedTransform.
2019-08-21 17:19:18 +03:00
Nikolai Kochetov
c27cada229
Fix ExpressionTransform.
2019-08-21 16:14:23 +03:00
Alexey Milovidov
8966520801
Added "assert_cast" function as a replacement for static_cast for columns
2019-08-21 05:28:04 +03:00
Alexey Milovidov
a6b64d6ba0
Parquet: Fix reading boolean columns
2019-08-21 04:00:13 +03:00
Nikolai Kochetov
06bb0af386
Fix build.
2019-08-20 18:03:35 +03:00
Nikolai Kochetov
aef03fd9bf
Merge pull request #6425 from yandex/vzakaznikov-liveview
...
Merge LIVE VIEW
2019-08-20 17:13:42 +03:00
Ivan
a502424c33
Implement support for insertion into Kafka tables ( #6012 )
...
* Add write-callback on each row for RowOutputStream
* Fix build of new rdkafka library
* Poll messages if Kafka outgoing queue is full
* Add test
* Add test producer-consumer
* Truncate delimiter from last row in message
2019-08-20 14:17:57 +03:00
Nikolai Kochetov
cdf1ce3171
Merge branch 'master' into vzakaznikov-liveview
2019-08-20 10:41:31 +03:00
Alexander Tokmakov
bca580653d
fix csv input
2019-08-20 02:09:02 +03:00
proller
d09c5c871b
Build fixes ( #6491 )
...
* Fix build
* cmake: fix cpuinfo
* Fix includes after processors merge
Conflicts:
dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp
* Fix build in gcc8
* fix test link
* fix test link
* Fix test link
* link fix
* Fix includes after processors merge 2
Conflicts:
dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp
* Fix includes after processors merge 3
* link fix
* Fix likely/unlikely conflict with cython
* Fix conflict with protobuf/stubs/atomicops.h
* remove unlikely.h
* Fix macos build (do not use timer_t)
2019-08-18 01:53:46 +03:00
Nikolai Kochetov
18ad0e7e6b
Merged with master.
2019-08-16 13:55:40 +03:00
Nikolai Kochetov
e51c48501b
Fix arg type forPipelineExecutor::prepareProcessor
2019-08-14 18:28:33 +03:00
Nikolai Kochetov
631bbde420
Merged with master.
2019-08-12 13:19:13 +03:00
Alexey Milovidov
2570907f44
Removed useless parameter
2019-08-12 00:45:18 +03:00
alexey-milovidov
838c5e535f
Merge pull request #6433 from yandex/prevent-stack-overflow-in-parser
...
Fixed possible stack overflow in parser
2019-08-10 23:58:54 +03:00
Alexey Milovidov
0a9787c7f3
Fixed possible stack overflow in parser
2019-08-10 19:38:25 +03:00
kreuzerkrieg
112fc71276
adding -Wshadow for GCC
2019-08-09 23:58:16 +03:00
Nikolai Kochetov
ed11432f68
Added JSONEachRowWithProgressRowOutputFormat.
2019-08-09 19:10:47 +03:00
Nikolai Kochetov
23e2d17d9d
Added JSONEachRowWithProgressRowOutputFormat.
2019-08-09 18:58:07 +03:00
Nikolai Kochetov
bd8c9733e3
Update MySQLOutputFormat.
2019-08-05 12:35:46 +03:00
Nikolai Kochetov
abc63f8a06
Merged with master.
2019-08-04 15:43:11 +03:00
Nikolai Kochetov
511f3050a6
Update CSVRowInputFormat.
2019-08-04 13:19:51 +03:00
Nikolai Kochetov
1f6a16b03a
Remove ValuesRowInputStream.
2019-08-02 20:16:58 +03:00
Nikolai Kochetov
e5d67cbe61
Remove ProtobufRowOutputStream.
2019-08-02 19:34:20 +03:00
Nikolai Kochetov
5fb548c994
Remove ProtobufRowOutputStream.
2019-08-02 19:31:17 +03:00
Nikolai Kochetov
8c66d106e4
Remove ProtobufRowInputStream.
2019-08-02 19:23:44 +03:00
Nikolai Kochetov
529e06e5cb
Remove ParquetBlockOutputStream.
2019-08-02 19:09:52 +03:00
Nikolai Kochetov
fcecbbda73
Remove OParquetBlockInputStream
2019-08-02 19:00:24 +03:00
Nikolai Kochetov
ae50ab6907
Remove JSONEachRowRowInputStream.
2019-08-02 18:36:36 +03:00
Nikolai Kochetov
48818aef7f
Update MySQLOutputFormat.
2019-08-02 15:41:21 +03:00
Nikolai Kochetov
0201cdf61a
Merge branch 'master' into processors-and-output-formats
2019-08-02 15:29:19 +03:00
Nikolai Kochetov
c228f18130
Update IRowInputFormat and FormatFactory.
2019-08-01 17:25:41 +03:00
Nikolai Kochetov
a5bb2e2b3f
Update Schema name in Protobuf and CapnProto formats.
2019-08-01 12:56:30 +03:00
Nikolai Kochetov
9811fdcdc7
Update CapnProtoRowInputFormat.
2019-08-01 11:31:08 +03:00
Nikolai Kochetov
9c4aefe2ae
Update ODBCDriver2BlockOutputFormat.
2019-07-31 18:10:51 +03:00
Nikolai Kochetov
1347cf1359
Update ODBCDriver2BlockOutputFormat.
2019-07-31 17:58:56 +03:00
Nikolai Kochetov
3a8fefdda8
Update CSVRowInputStream.
2019-07-31 17:43:08 +03:00
Nikolai Kochetov
f0bf083efc
Update CSVRowInputStream.
2019-07-31 17:16:28 +03:00
Nikolai Kochetov
2c638d577d
Update VerticalRowOutputFormat.
2019-07-31 14:51:00 +03:00
Nikolai Kochetov
8bfd909f5b
Update JSONEachRowRowOutputFormat.
2019-07-31 13:06:46 +03:00
Nikolai Kochetov
5bdb6aa9f3
Update TSKVRowInputFormat.
2019-07-31 12:43:20 +03:00
Nikolai Kochetov
b274545bb7
Update CSVRowInputFormat.
2019-07-30 21:48:40 +03:00
Nikolai Kochetov
e8b643e032
Update CSVRowInputFormat.
2019-07-30 21:22:01 +03:00
Nikolai Kochetov
ee3a93bab5
Update CSVRowInputFormat.
2019-07-30 21:21:12 +03:00
Nikolai Kochetov
d4da486b51
Update CSVRowInputFormat.
2019-07-30 17:55:59 +03:00
Yuriy
c1b57f9cf5
fixed heap buffer overflow in PacketPayloadWriteBuffer
2019-07-29 18:41:47 +03:00
Yuriy
383fa25c51
resolved conflict
2019-07-28 02:00:15 +03:00
Nikolai Kochetov
95dd6222fe
Use IInputFormat and IOutputFormat by default.
2019-07-25 15:17:57 +03:00
Nikolai Kochetov
78f056d83f
Use IInputFormat and IOutputFormat by default.
2019-07-25 12:35:16 +03:00
Nikolai Kochetov
36a0275ff1
Use IInputFormat and IOutputFormat by default.
2019-07-25 12:31:38 +03:00
Nikolai Kochetov
69f860a5ef
Use IInputFormat and IOutputFormat by default.
2019-07-25 12:28:33 +03:00
Nikolai Kochetov
a22540d010
Use IInputFormat and IOutputFormat by default.
2019-07-25 12:20:00 +03:00
Nikolai Kochetov
4cc3bf7724
Use IInputFormat and IOutputFormat by default.
2019-07-25 12:15:33 +03:00
Nikolai Kochetov
58d579e7e2
Use IInputFormat and IOutputFormat by default.
2019-07-24 21:00:09 +03:00
Vitaly Baranov
d3ff30cb5b
Use better approach to check offsets in protobuf messages.
2019-07-24 14:41:49 +03:00
Alexander Kuzmenkov
9df09f3506
Do not access shared arenas in aggregate function columns.
...
These arenas may be updated concurrently, so it is unsafe to
access them, as illustrated by issue #4402 . Store them separately
and use a different arena for the updates. Change some callers
to accomodate for this.
2019-07-18 14:21:37 +03:00
Yuriy
a03114ede2
cast to proper type
2019-07-16 11:47:54 +03:00
Yuriy
d74be1dc9c
fixed MySQLOutputFormat used by new query processing pipeline
2019-07-16 11:24:51 +03:00
Nikolai Kochetov
bfa114126a
More comments for PipelineExecutor.
2019-07-11 09:50:44 +03:00
Nikolai Kochetov
d104f2d8ff
Update PipelineExecutor
2019-07-10 14:59:30 +03:00
Nikolai Kochetov
282feb1fdb
Update PipelineExecutor
2019-07-10 09:52:44 +03:00
Nikolai Kochetov
6974cc3c9f
Update ResizePipeline
2019-07-09 20:47:13 +03:00
Nikolai Kochetov
911e4014ff
Increase queue size in LazyOutputFormat in order to prevent potential lock.
2019-07-09 15:26:22 +03:00
Nikolai Kochetov
27acbb0412
Fix tests.
2019-07-08 21:08:44 +03:00
Nikolai Kochetov
de2221222e
Don't skip empty chunks in Filter Transform.
2019-07-08 18:52:18 +03:00
Nikolai Kochetov
2128fb890b
Don't skip empty chunks in Filter Transform.
2019-07-08 18:23:45 +03:00
Nikolai Kochetov
e0362c5216
Fix build.
2019-07-08 16:15:45 +03:00
Nikolai Kochetov
472f32f718
Remove ThreadGroupThreadPoolCallbacks
2019-07-08 15:49:52 +03:00
Nikolai Kochetov
e5103d741c
Fix lock in case of query was cancelled.
2019-07-08 15:48:16 +03:00
Nikolai Kochetov
fc3b465d60
Fix race in doExpandPipeline.
2019-07-08 15:49:46 +03:00