Commit Graph

27 Commits

Author SHA1 Message Date
Mikhail Filimonov
24ff635435 draft implementation, wip 2020-02-03 11:02:52 +01:00
Andrew Onyshchuk
7320447f92 Add Avro formats
Add Avro file input/output formats
Add AvroConfluent input format (for Kafka)
2020-01-08 03:18:00 -06:00
Nikolai Kochetov
438ea5bc22
Remove context from formats (#8388)
* Remove Context from formats.
2019-12-25 22:17:41 +03:00
kreuzerkrieg
9612bb0e79 More GCC warnings 2019-12-16 23:19:50 +02:00
Alexander Kuzmenkov
168e15b2ae chunk size -> chunk bytes 2019-11-18 22:45:26 +03:00
Alexander Kuzmenkov
83030b98a2 remove MemoryExt<> 2019-11-18 16:10:14 +03:00
Nikita Mikhaylov
682b9df17f remove SharedReadBuffer + remove lambdas 2019-10-25 15:28:24 +03:00
Nikita Mikhaylov
d47d4cd6c1 parallel parsing 2019-10-01 13:48:46 +03:00
Ivan
cffc254922
Always read and insert Kafka messages as a whole (#6950)
* Always read and insert Kafka messages as a whole.
2019-09-20 15:12:32 +03:00
Amos Bird
a1310ffbe6 Split libdbms.so using object library
Now the linking time of incremental builds are around 1-2 seconds
2019-09-11 01:56:01 +08:00
Ivan
a502424c33
Implement support for insertion into Kafka tables (#6012)
* Add write-callback on each row for RowOutputStream
* Fix build of new rdkafka library
* Poll messages if Kafka outgoing queue is full
* Add test
* Add test producer-consumer
* Truncate delimiter from last row in message
2019-08-20 14:17:57 +03:00
Nikolai Kochetov
49632a74b7 Update FormatFactory. 2019-08-02 17:41:19 +03:00
Nikolai Kochetov
58d579e7e2 Use IInputFormat and IOutputFormat by default. 2019-07-24 21:00:09 +03:00
Nikolai Kochetov
209793c981 Merged with master. 2019-07-08 16:00:54 +03:00
Nikolai Kochetov
f9b29bfdd2 Merged with master. 2019-06-25 20:00:54 +03:00
Ivan Lezhankin
facdd966cc Fixes due to review 2019-06-14 20:19:02 +03:00
Ivan Lezhankin
19a850ad75 Use read callback to populate virtual columns in Kafka Engine 2019-05-23 16:20:25 +03:00
Ivan Lezhankin
800854119e Add buffer callback to fill in virtual columns 2019-05-23 14:15:18 +03:00
Ivan Lezhankin
0821d62516 Merge ITableDeclaration into IStorage.
Also a couple of massive include-refactorings with better forwarding
2019-05-17 17:34:25 +03:00
Ivan
4a5832b18a
Check the time limit every (flush_interval / poll_timeout) number of rows from Kafka (#5249) 2019-05-14 18:52:03 +03:00
Nikolai Kochetov
ec65b4c229 Check num columns in Block::cloneWithColumns. 2019-04-05 14:39:07 +03:00
Nikolai Kochetov
94ff7f694a QueryPipeline [in progress]. 2019-04-03 13:14:36 +03:00
Nikolai Kochetov
aba56e171c Formats processorss. 2019-02-21 19:05:47 +03:00
Alexey Milovidov
58a6accee5 Updated test #4246 2019-02-10 19:55:12 +03:00
Alexey Milovidov
09d22da9b9 Miscellaneous #2687 2018-07-20 18:59:11 +03:00
alesapin
ec156e9f2b CLICKHOUSE-3772: Add system tables formats, data_type_families, table_functions, aggregate_function_combinators 2018-07-20 13:00:56 +03:00
alexey-milovidov
fafecb3c25
Better modularity of formats. (#2492)
* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development): removed very old tests #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447
2018-06-10 22:22:49 +03:00