Commit Graph

280 Commits

Author SHA1 Message Date
Ivan
a502424c33
Implement support for insertion into Kafka tables (#6012)
* Add write-callback on each row for RowOutputStream
* Fix build of new rdkafka library
* Poll messages if Kafka outgoing queue is full
* Add test
* Add test producer-consumer
* Truncate delimiter from last row in message
2019-08-20 14:17:57 +03:00
Alexander Tokmakov
bca580653d fix csv input 2019-08-20 02:09:02 +03:00
proller
d09c5c871b Build fixes (#6491)
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)
2019-08-18 01:53:46 +03:00
Nikolai Kochetov
e51c48501b Fix arg type forPipelineExecutor::prepareProcessor 2019-08-14 18:28:33 +03:00
Alexey Milovidov
2570907f44 Removed useless parameter 2019-08-12 00:45:18 +03:00
alexey-milovidov
838c5e535f
Merge pull request #6433 from yandex/prevent-stack-overflow-in-parser
Fixed possible stack overflow in parser
2019-08-10 23:58:54 +03:00
Alexey Milovidov
0a9787c7f3 Fixed possible stack overflow in parser 2019-08-10 19:38:25 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Nikolai Kochetov
bd8c9733e3 Update MySQLOutputFormat. 2019-08-05 12:35:46 +03:00
Nikolai Kochetov
abc63f8a06 Merged with master. 2019-08-04 15:43:11 +03:00
Nikolai Kochetov
511f3050a6 Update CSVRowInputFormat. 2019-08-04 13:19:51 +03:00
Nikolai Kochetov
1f6a16b03a Remove ValuesRowInputStream. 2019-08-02 20:16:58 +03:00
Nikolai Kochetov
e5d67cbe61 Remove ProtobufRowOutputStream. 2019-08-02 19:34:20 +03:00
Nikolai Kochetov
5fb548c994 Remove ProtobufRowOutputStream. 2019-08-02 19:31:17 +03:00
Nikolai Kochetov
8c66d106e4 Remove ProtobufRowInputStream. 2019-08-02 19:23:44 +03:00
Nikolai Kochetov
529e06e5cb Remove ParquetBlockOutputStream. 2019-08-02 19:09:52 +03:00
Nikolai Kochetov
fcecbbda73 Remove OParquetBlockInputStream 2019-08-02 19:00:24 +03:00
Nikolai Kochetov
ae50ab6907 Remove JSONEachRowRowInputStream. 2019-08-02 18:36:36 +03:00
Nikolai Kochetov
48818aef7f Update MySQLOutputFormat. 2019-08-02 15:41:21 +03:00
Nikolai Kochetov
0201cdf61a Merge branch 'master' into processors-and-output-formats 2019-08-02 15:29:19 +03:00
Nikolai Kochetov
c228f18130 Update IRowInputFormat and FormatFactory. 2019-08-01 17:25:41 +03:00
Nikolai Kochetov
a5bb2e2b3f Update Schema name in Protobuf and CapnProto formats. 2019-08-01 12:56:30 +03:00
Nikolai Kochetov
9811fdcdc7 Update CapnProtoRowInputFormat. 2019-08-01 11:31:08 +03:00
Nikolai Kochetov
9c4aefe2ae Update ODBCDriver2BlockOutputFormat. 2019-07-31 18:10:51 +03:00
Nikolai Kochetov
1347cf1359 Update ODBCDriver2BlockOutputFormat. 2019-07-31 17:58:56 +03:00
Nikolai Kochetov
3a8fefdda8 Update CSVRowInputStream. 2019-07-31 17:43:08 +03:00
Nikolai Kochetov
f0bf083efc Update CSVRowInputStream. 2019-07-31 17:16:28 +03:00
Nikolai Kochetov
2c638d577d Update VerticalRowOutputFormat. 2019-07-31 14:51:00 +03:00
Nikolai Kochetov
8bfd909f5b Update JSONEachRowRowOutputFormat. 2019-07-31 13:06:46 +03:00
Nikolai Kochetov
5bdb6aa9f3 Update TSKVRowInputFormat. 2019-07-31 12:43:20 +03:00
Nikolai Kochetov
b274545bb7 Update CSVRowInputFormat. 2019-07-30 21:48:40 +03:00
Nikolai Kochetov
e8b643e032 Update CSVRowInputFormat. 2019-07-30 21:22:01 +03:00
Nikolai Kochetov
ee3a93bab5 Update CSVRowInputFormat. 2019-07-30 21:21:12 +03:00
Nikolai Kochetov
d4da486b51 Update CSVRowInputFormat. 2019-07-30 17:55:59 +03:00
Yuriy
c1b57f9cf5 fixed heap buffer overflow in PacketPayloadWriteBuffer 2019-07-29 18:41:47 +03:00
Yuriy
383fa25c51 resolved conflict 2019-07-28 02:00:15 +03:00
Nikolai Kochetov
95dd6222fe Use IInputFormat and IOutputFormat by default. 2019-07-25 15:17:57 +03:00
Nikolai Kochetov
78f056d83f Use IInputFormat and IOutputFormat by default. 2019-07-25 12:35:16 +03:00
Nikolai Kochetov
36a0275ff1 Use IInputFormat and IOutputFormat by default. 2019-07-25 12:31:38 +03:00
Nikolai Kochetov
69f860a5ef Use IInputFormat and IOutputFormat by default. 2019-07-25 12:28:33 +03:00
Nikolai Kochetov
a22540d010 Use IInputFormat and IOutputFormat by default. 2019-07-25 12:20:00 +03:00
Nikolai Kochetov
4cc3bf7724 Use IInputFormat and IOutputFormat by default. 2019-07-25 12:15:33 +03:00
Nikolai Kochetov
58d579e7e2 Use IInputFormat and IOutputFormat by default. 2019-07-24 21:00:09 +03:00
Vitaly Baranov
d3ff30cb5b Use better approach to check offsets in protobuf messages. 2019-07-24 14:41:49 +03:00
Alexander Kuzmenkov
9df09f3506 Do not access shared arenas in aggregate function columns.
These arenas may be updated concurrently, so it is unsafe to
access them, as illustrated by issue #4402. Store them separately
and use a different arena for the updates. Change some callers
to accomodate for this.
2019-07-18 14:21:37 +03:00
Yuriy
a03114ede2 cast to proper type 2019-07-16 11:47:54 +03:00
Yuriy
d74be1dc9c fixed MySQLOutputFormat used by new query processing pipeline 2019-07-16 11:24:51 +03:00
Nikolai Kochetov
bfa114126a More comments for PipelineExecutor. 2019-07-11 09:50:44 +03:00
Nikolai Kochetov
d104f2d8ff Update PipelineExecutor 2019-07-10 14:59:30 +03:00
Nikolai Kochetov
282feb1fdb Update PipelineExecutor 2019-07-10 09:52:44 +03:00