Commit Graph

369 Commits

Author SHA1 Message Date
Alexander Tokmakov
52fb9585d4 improvements 2019-09-04 22:59:08 +03:00
Alexander Tokmakov
d31358a280 change ValuesBlockInputStream to ValuesBlockInputFormat 2019-09-02 19:26:22 +03:00
Alexander Tokmakov
8adf13047b fix build 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
d42a4323f6 Fixes 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
e32ed075c8 Force disable interpreting expressions without template to check if some tests fail 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
46effbd7f6 Template for functions with constant arguments 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
00fc04d852 Fix 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
1629f0a166 Simple heuristic to generate new template in case of failure 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
a5f194cae9 Add setting to enable/disable template deduction for Values 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
dd45f3c2bd Check types of numeric literals 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
c7e311bac8 Use AST to generate template 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
dfebedfb70 Fix expression with Array and ColumnConst 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
41166f0618 Fix 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
6e06658363 Improvements 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
6fd1319bba Fixes 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
3e214ced62 PeekableReadBuffer 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
d3ee3a693c Batch insert Values with expressions (draft) 2019-09-02 17:33:09 +03:00
Alexander Tokmakov
804c911d3f ValuesRowInputStream changed to ValuesBlockInputStream 2019-09-02 17:33:09 +03:00
Alexander Tokmakov
3da233ef42 fix build 2019-09-02 13:47:06 +03:00
Alexander Tokmakov
4c744af113 minor style fixes 2019-08-30 20:25:35 +03:00
Alexander Tokmakov
93c672aa0b delete BlockInputStreamFromRowInputStream 2019-08-27 21:29:56 +03:00
Alexander Tokmakov
0136ef9a5f move formats to processors 2019-08-23 22:47:22 +03:00
Alexander Tokmakov
734a0f23a9 Merge branch 'master' into merging_template_format 2019-08-23 15:32:35 +03:00
akonyaev
01216e45b6 Merge branch 'master' of https://github.com/yandex/ClickHouse into ADQM-34
# Conflicts:
#	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp
2019-08-22 09:40:51 +03:00
akonyaev
caf0d30a5f ADQM-34 add orc input format 2019-08-21 17:19:47 +03:00
Alexey Milovidov
8966520801 Added "assert_cast" function as a replacement for static_cast for columns 2019-08-21 05:28:04 +03:00
Nikolai Kochetov
aef03fd9bf
Merge pull request #6425 from yandex/vzakaznikov-liveview
Merge LIVE VIEW
2019-08-20 17:13:42 +03:00
Ivan
a502424c33
Implement support for insertion into Kafka tables (#6012)
* Add write-callback on each row for RowOutputStream
* Fix build of new rdkafka library
* Poll messages if Kafka outgoing queue is full
* Add test
* Add test producer-consumer
* Truncate delimiter from last row in message
2019-08-20 14:17:57 +03:00
Nikolai Kochetov
cdf1ce3171 Merge branch 'master' into vzakaznikov-liveview 2019-08-20 10:41:31 +03:00
Alexander Tokmakov
bca580653d fix csv input 2019-08-20 02:09:02 +03:00
Nikolai Kochetov
18ad0e7e6b Merged with master. 2019-08-16 13:55:40 +03:00
Nikolai Kochetov
be009d971d Fix FormatFactory default formats. 2019-08-14 18:54:51 +03:00
Nikolai Kochetov
631bbde420 Merged with master. 2019-08-12 13:19:13 +03:00
alexey-milovidov
30f8529e04
Merge pull request #6325 from kreuzerkrieg/Shadow4GCC
adding -Wshadow for GCC
2019-08-10 17:29:10 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Nikolai Kochetov
ed11432f68 Added JSONEachRowWithProgressRowOutputFormat. 2019-08-09 19:10:47 +03:00
proller
9a438d9f7d Fix build without protobuf 2019-08-09 19:09:24 +03:00
Nikolai Kochetov
f4aef770ff Added JSONEachRowWithProgressRowOutputFormat. 2019-08-09 19:01:29 +03:00
Nikolai Kochetov
23e2d17d9d Added JSONEachRowWithProgressRowOutputFormat. 2019-08-09 18:58:07 +03:00
Nikolai Kochetov
2ae3db7920 Merged with master. 2019-08-09 18:32:44 +03:00
Nikolai Kochetov
cddbd6db3c Merged with master. 2019-08-04 16:19:57 +03:00
Nikolai Kochetov
599f3ddf6e Merged with master. 2019-08-04 15:35:21 +03:00
Nikolai Kochetov
fa9b27eec2 Update FormatsFactory. 2019-08-04 13:06:42 +03:00
proller
77bd2624ea Build fixes (#6016)
* Fix building without submodules

* Fix more gcc9 warnings

* was wrong!
../dbms/src/IO/WriteBufferAIO.cpp:277:54: error: result of comparison 'ssize_t' (aka 'long') > 9223372036854775807 is always false [-Werror,-Wtautological-type-limit-compare]
    if ((static_cast<ssize_t>(flush_buffer.offset()) > std::numeric_limits<off_t>::max()) ||
         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

* mimalloc off MI_OVERRIDE

* Fix freebsd build

* Fix shared build

* Fix build in gcc9

* Fix split build

* fix

* fix

* fix

* fix

* clean

* zstd

* Update CMakeLists.txt

* Update Defines.h

* Try fix -Wsign-compare

* Freebsd fix

* Add missing libs

* Fix double-conversion include for copy-headers

* Fix zlib link

* Fix includes for arcadia

* Fix includes for arcadia

* Fix includes for arcadia

* Freebsd fix

* Arcadia fixes

* Update QueryProfiler.cpp

* Freebsd fix

* clean

* 19.11: Fixes for arcadia porting (#6223)

* fix glibc-compatibility

* M_LIBRARY fix

* wip

* Fix

* Fix arm build

* unwind fix

* Update CMakeLists.txt
2019-08-04 03:19:03 +03:00
Nikolai Kochetov
a92f086600 Remove XMLRowOutputStream. 2019-08-02 20:39:24 +03:00
Nikolai Kochetov
6e3274ef98 Remove VerticalRowOutputStream. 2019-08-02 20:37:24 +03:00
Nikolai Kochetov
6234cb865a Remove ValuesRowOutputStream. 2019-08-02 20:19:10 +03:00
Nikolai Kochetov
1f6a16b03a Remove ValuesRowInputStream. 2019-08-02 20:16:58 +03:00
Nikolai Kochetov
e6b3f3f03a Remove TSKVRowInputStream. 2019-08-02 20:00:38 +03:00
Nikolai Kochetov
f820fff794 Remove TSKVRowInputStream. 2019-08-02 19:59:50 +03:00
Nikolai Kochetov
c336c514fb Remove TSKVRowInputStream. 2019-08-02 19:58:52 +03:00
Nikolai Kochetov
422b593570 Remove TSKVRowInputStream. 2019-08-02 19:56:52 +03:00
Nikolai Kochetov
6ab2e19410 Remove TSKVRowInputStream. 2019-08-02 19:51:33 +03:00
Nikolai Kochetov
f809de0949 Remove TabSeparatedRowOutputStream and TSKVRowOutputStream. 2019-08-02 19:48:50 +03:00
Nikolai Kochetov
afb3c20778 Remove CSVRowOutputStream. 2019-08-02 19:37:33 +03:00
Nikolai Kochetov
5fb548c994 Remove ProtobufRowOutputStream. 2019-08-02 19:31:17 +03:00
Nikolai Kochetov
8c66d106e4 Remove ProtobufRowInputStream. 2019-08-02 19:23:44 +03:00
Nikolai Kochetov
bd4f0182e4 Remove PrettyBlockOutputStreams. 2019-08-02 19:20:25 +03:00
Nikolai Kochetov
529e06e5cb Remove ParquetBlockOutputStream. 2019-08-02 19:09:52 +03:00
Nikolai Kochetov
fcecbbda73 Remove OParquetBlockInputStream 2019-08-02 19:00:24 +03:00
Nikolai Kochetov
978bdc4bfc Remove ODBCDriverBlockOutputStream. 2019-08-02 18:51:43 +03:00
Nikolai Kochetov
51bd715781 Remove ODBCDriver2BlockOutputStream. 2019-08-02 18:49:46 +03:00
Nikolai Kochetov
d57d8a609f Remove MySQLWireBlockOutputStream. 2019-08-02 18:45:21 +03:00
Nikolai Kochetov
4019f5e102 Remove JSONRowOutputStream. 2019-08-02 18:42:52 +03:00
Nikolai Kochetov
ce712d881a Remove JSONEachRowRowOutputStream. 2019-08-02 18:39:12 +03:00
Nikolai Kochetov
ae50ab6907 Remove JSONEachRowRowInputStream. 2019-08-02 18:36:36 +03:00
Nikolai Kochetov
cd299bb162 Remove JSONCompactRowOutputStream. 2019-08-02 18:32:07 +03:00
Nikolai Kochetov
2833ca6d2f Remove CapnProtoRowInputStream. 2019-08-02 18:28:13 +03:00
Nikolai Kochetov
342f044241 Remove BinaryRowOutputStream. 2019-08-02 18:25:32 +03:00
Nikolai Kochetov
03ece9dc99 Remove BinaryRowInputStream. 2019-08-02 18:21:48 +03:00
Nikolai Kochetov
49632a74b7 Update FormatFactory. 2019-08-02 17:41:19 +03:00
Nikolai Kochetov
0201cdf61a Merge branch 'master' into processors-and-output-formats 2019-08-02 15:29:19 +03:00
Nikolai Kochetov
c228f18130 Update IRowInputFormat and FormatFactory. 2019-08-01 17:25:41 +03:00
tavplubix
6625536236
Merge pull request #6055 from yandex/csv_unquoted_nulls_and_default_values
CSV unquoted nulls and default values
2019-08-01 15:11:06 +03:00
Nikolai Kochetov
4e38a45922 Update FormatFactory. 2019-07-31 16:26:08 +03:00
Nikolai Kochetov
77d81687b3 Update FormatFactory. 2019-07-31 13:54:50 +03:00
Nikolai Kochetov
2d5b282a31 Update FormatFactory. 2019-07-31 13:37:28 +03:00
Nikolai Kochetov
cc74c5ec78 Update FormatFactory. 2019-07-31 13:31:14 +03:00
Nikolai Kochetov
4bea8541d1 Update FormatFactory. 2019-07-31 13:28:54 +03:00
Yuriy
c1b57f9cf5 fixed heap buffer overflow in PacketPayloadWriteBuffer 2019-07-29 18:41:47 +03:00
Alexey Milovidov
48a3c82f6f Removed useless code from MySQLWireBlockOutputStream 2019-07-29 02:57:49 +03:00
Yuriy
383fa25c51 resolved conflict 2019-07-28 02:00:15 +03:00
Alexey Milovidov
bc74013f98 Fixed UBSan report in ProtobufWriter 2019-07-25 23:10:33 +03:00
Nikolai Kochetov
7f1fd1a918 Use IInputFormat and IOutputFormat by default. 2019-07-25 11:37:21 +03:00
Nikolai Kochetov
58d579e7e2 Use IInputFormat and IOutputFormat by default. 2019-07-24 21:00:09 +03:00
Vitaly Baranov
d3ff30cb5b Use better approach to check offsets in protobuf messages. 2019-07-24 14:41:49 +03:00
Vitaly Baranov
746066be48 Remove excessive throw in a correct case. 2019-07-23 17:02:15 +03:00
Alexander Tokmakov
89a4462c4f Merge branch 'master' into csv_unquoted_nulls_and_default_values 2019-07-23 13:49:47 +03:00
Alexander Tokmakov
96d0a066d9 rename format_csv_unquoted_null_literal_as_null to input_format_csv_unquoted_null_literal_as_null 2019-07-22 23:13:27 +03:00
Alexander Tokmakov
d46a27ee01 Fixes 2019-07-22 03:28:55 +03:00
Alexander Tokmakov
89ae562e83 Fix 2019-07-22 03:17:03 +03:00
Alexander Tokmakov
6e4efb94f0 OPTIMIZE(1) 2019-07-22 03:02:31 +03:00
Alexander Tokmakov
f43f7c43a5 Fixes 2019-07-22 02:59:31 +03:00
Alexander Tokmakov
ab9ce18fc7 Added CSV (de)serialization 2019-07-22 02:58:55 +03:00
Alexander Tokmakov
c92a0f3ac5 Fixes 2019-07-22 02:58:39 +03:00
Alexander Tokmakov
4e97fd697a Diagnostic info for Template 2019-07-22 02:58:22 +03:00
Alexander Tokmakov
a931e16c6c Diagnostic info refactored 2019-07-22 02:57:27 +03:00
Alexander Tokmakov
892b67492d Checking for suffix, not for eof 2019-07-22 01:03:29 +03:00
Alexander Tokmakov
79015898cf TemplateRowInputStream 2019-07-22 01:02:54 +03:00
Alexander Tokmakov
05d6e23373 Customizable prefix, suffix and row delimiter 2019-07-22 01:00:34 +03:00