Commit Graph

386 Commits

Author SHA1 Message Date
alexey-milovidov
30f8529e04
Merge pull request #6325 from kreuzerkrieg/Shadow4GCC
adding -Wshadow for GCC
2019-08-10 17:29:10 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Nikolai Kochetov
ed11432f68 Added JSONEachRowWithProgressRowOutputFormat. 2019-08-09 19:10:47 +03:00
proller
9a438d9f7d Fix build without protobuf 2019-08-09 19:09:24 +03:00
Nikolai Kochetov
f4aef770ff Added JSONEachRowWithProgressRowOutputFormat. 2019-08-09 19:01:29 +03:00
Nikolai Kochetov
23e2d17d9d Added JSONEachRowWithProgressRowOutputFormat. 2019-08-09 18:58:07 +03:00
Nikolai Kochetov
2ae3db7920 Merged with master. 2019-08-09 18:32:44 +03:00
Nikolai Kochetov
cddbd6db3c Merged with master. 2019-08-04 16:19:57 +03:00
Nikolai Kochetov
599f3ddf6e Merged with master. 2019-08-04 15:35:21 +03:00
Nikolai Kochetov
fa9b27eec2 Update FormatsFactory. 2019-08-04 13:06:42 +03:00
proller
77bd2624ea Build fixes (#6016)
* Fix building without submodules

* Fix more gcc9 warnings

* was wrong!
../dbms/src/IO/WriteBufferAIO.cpp:277:54: error: result of comparison 'ssize_t' (aka 'long') > 9223372036854775807 is always false [-Werror,-Wtautological-type-limit-compare]
    if ((static_cast<ssize_t>(flush_buffer.offset()) > std::numeric_limits<off_t>::max()) ||
         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

* mimalloc off MI_OVERRIDE

* Fix freebsd build

* Fix shared build

* Fix build in gcc9

* Fix split build

* fix

* fix

* fix

* fix

* clean

* zstd

* Update CMakeLists.txt

* Update Defines.h

* Try fix -Wsign-compare

* Freebsd fix

* Add missing libs

* Fix double-conversion include for copy-headers

* Fix zlib link

* Fix includes for arcadia

* Fix includes for arcadia

* Fix includes for arcadia

* Freebsd fix

* Arcadia fixes

* Update QueryProfiler.cpp

* Freebsd fix

* clean

* 19.11: Fixes for arcadia porting (#6223)

* fix glibc-compatibility

* M_LIBRARY fix

* wip

* Fix

* Fix arm build

* unwind fix

* Update CMakeLists.txt
2019-08-04 03:19:03 +03:00
Nikolai Kochetov
a92f086600 Remove XMLRowOutputStream. 2019-08-02 20:39:24 +03:00
Nikolai Kochetov
6e3274ef98 Remove VerticalRowOutputStream. 2019-08-02 20:37:24 +03:00
Nikolai Kochetov
6234cb865a Remove ValuesRowOutputStream. 2019-08-02 20:19:10 +03:00
Nikolai Kochetov
1f6a16b03a Remove ValuesRowInputStream. 2019-08-02 20:16:58 +03:00
Nikolai Kochetov
e6b3f3f03a Remove TSKVRowInputStream. 2019-08-02 20:00:38 +03:00
Nikolai Kochetov
f820fff794 Remove TSKVRowInputStream. 2019-08-02 19:59:50 +03:00
Nikolai Kochetov
c336c514fb Remove TSKVRowInputStream. 2019-08-02 19:58:52 +03:00
Nikolai Kochetov
422b593570 Remove TSKVRowInputStream. 2019-08-02 19:56:52 +03:00
Nikolai Kochetov
6ab2e19410 Remove TSKVRowInputStream. 2019-08-02 19:51:33 +03:00
Nikolai Kochetov
f809de0949 Remove TabSeparatedRowOutputStream and TSKVRowOutputStream. 2019-08-02 19:48:50 +03:00
Nikolai Kochetov
afb3c20778 Remove CSVRowOutputStream. 2019-08-02 19:37:33 +03:00
Nikolai Kochetov
5fb548c994 Remove ProtobufRowOutputStream. 2019-08-02 19:31:17 +03:00
Nikolai Kochetov
8c66d106e4 Remove ProtobufRowInputStream. 2019-08-02 19:23:44 +03:00
Nikolai Kochetov
bd4f0182e4 Remove PrettyBlockOutputStreams. 2019-08-02 19:20:25 +03:00
Nikolai Kochetov
529e06e5cb Remove ParquetBlockOutputStream. 2019-08-02 19:09:52 +03:00
Nikolai Kochetov
fcecbbda73 Remove OParquetBlockInputStream 2019-08-02 19:00:24 +03:00
Nikolai Kochetov
978bdc4bfc Remove ODBCDriverBlockOutputStream. 2019-08-02 18:51:43 +03:00
Nikolai Kochetov
51bd715781 Remove ODBCDriver2BlockOutputStream. 2019-08-02 18:49:46 +03:00
Nikolai Kochetov
d57d8a609f Remove MySQLWireBlockOutputStream. 2019-08-02 18:45:21 +03:00
Nikolai Kochetov
4019f5e102 Remove JSONRowOutputStream. 2019-08-02 18:42:52 +03:00
Nikolai Kochetov
ce712d881a Remove JSONEachRowRowOutputStream. 2019-08-02 18:39:12 +03:00
Nikolai Kochetov
ae50ab6907 Remove JSONEachRowRowInputStream. 2019-08-02 18:36:36 +03:00
Nikolai Kochetov
cd299bb162 Remove JSONCompactRowOutputStream. 2019-08-02 18:32:07 +03:00
Nikolai Kochetov
2833ca6d2f Remove CapnProtoRowInputStream. 2019-08-02 18:28:13 +03:00
Nikolai Kochetov
342f044241 Remove BinaryRowOutputStream. 2019-08-02 18:25:32 +03:00
Nikolai Kochetov
03ece9dc99 Remove BinaryRowInputStream. 2019-08-02 18:21:48 +03:00
Nikolai Kochetov
49632a74b7 Update FormatFactory. 2019-08-02 17:41:19 +03:00
Nikolai Kochetov
0201cdf61a Merge branch 'master' into processors-and-output-formats 2019-08-02 15:29:19 +03:00
Nikolai Kochetov
c228f18130 Update IRowInputFormat and FormatFactory. 2019-08-01 17:25:41 +03:00
tavplubix
6625536236
Merge pull request #6055 from yandex/csv_unquoted_nulls_and_default_values
CSV unquoted nulls and default values
2019-08-01 15:11:06 +03:00
Nikolai Kochetov
4e38a45922 Update FormatFactory. 2019-07-31 16:26:08 +03:00
Nikolai Kochetov
77d81687b3 Update FormatFactory. 2019-07-31 13:54:50 +03:00
Nikolai Kochetov
2d5b282a31 Update FormatFactory. 2019-07-31 13:37:28 +03:00
Nikolai Kochetov
cc74c5ec78 Update FormatFactory. 2019-07-31 13:31:14 +03:00
Nikolai Kochetov
4bea8541d1 Update FormatFactory. 2019-07-31 13:28:54 +03:00
Yuriy
c1b57f9cf5 fixed heap buffer overflow in PacketPayloadWriteBuffer 2019-07-29 18:41:47 +03:00
Alexey Milovidov
48a3c82f6f Removed useless code from MySQLWireBlockOutputStream 2019-07-29 02:57:49 +03:00
Yuriy
383fa25c51 resolved conflict 2019-07-28 02:00:15 +03:00
Alexey Milovidov
bc74013f98 Fixed UBSan report in ProtobufWriter 2019-07-25 23:10:33 +03:00
Nikolai Kochetov
7f1fd1a918 Use IInputFormat and IOutputFormat by default. 2019-07-25 11:37:21 +03:00
Nikolai Kochetov
58d579e7e2 Use IInputFormat and IOutputFormat by default. 2019-07-24 21:00:09 +03:00
Vitaly Baranov
d3ff30cb5b Use better approach to check offsets in protobuf messages. 2019-07-24 14:41:49 +03:00
Vitaly Baranov
746066be48 Remove excessive throw in a correct case. 2019-07-23 17:02:15 +03:00
Alexander Tokmakov
89a4462c4f Merge branch 'master' into csv_unquoted_nulls_and_default_values 2019-07-23 13:49:47 +03:00
Alexander Tokmakov
96d0a066d9 rename format_csv_unquoted_null_literal_as_null to input_format_csv_unquoted_null_literal_as_null 2019-07-22 23:13:27 +03:00
Alexander Tokmakov
d46a27ee01 Fixes 2019-07-22 03:28:55 +03:00
Alexander Tokmakov
89ae562e83 Fix 2019-07-22 03:17:03 +03:00
Alexander Tokmakov
6e4efb94f0 OPTIMIZE(1) 2019-07-22 03:02:31 +03:00
Alexander Tokmakov
f43f7c43a5 Fixes 2019-07-22 02:59:31 +03:00
Alexander Tokmakov
ab9ce18fc7 Added CSV (de)serialization 2019-07-22 02:58:55 +03:00
Alexander Tokmakov
c92a0f3ac5 Fixes 2019-07-22 02:58:39 +03:00
Alexander Tokmakov
4e97fd697a Diagnostic info for Template 2019-07-22 02:58:22 +03:00
Alexander Tokmakov
a931e16c6c Diagnostic info refactored 2019-07-22 02:57:27 +03:00
Alexander Tokmakov
892b67492d Checking for suffix, not for eof 2019-07-22 01:03:29 +03:00
Alexander Tokmakov
79015898cf TemplateRowInputStream 2019-07-22 01:02:54 +03:00
Alexander Tokmakov
05d6e23373 Customizable prefix, suffix and row delimiter 2019-07-22 01:00:34 +03:00
Alexander Tokmakov
4f7720139a TemplateRowOutputStream changed to TemplateBlockOutputStream 2019-07-22 00:59:10 +03:00
Alexander Tokmakov
12e08417d6 Template format implementation 2019-07-22 00:57:57 +03:00
Alexey Milovidov
d0996c0b73 Minor modifications for #6070 2019-07-20 00:37:34 +03:00
alexey-milovidov
3a8bb58522
Update ProtobufReader.cpp 2019-07-20 00:30:22 +03:00
alexey-milovidov
f2b6adf15e
Update ProtobufReader.cpp 2019-07-20 00:27:20 +03:00
alexey-milovidov
6cb9e9f56f
Update ProtobufReader.h 2019-07-20 00:26:12 +03:00
alexey-milovidov
3ec2360afd
Update ProtobufReader.h 2019-07-20 00:25:49 +03:00
alexey-milovidov
93ddb7da89
Update ProtobufReader.cpp 2019-07-20 00:25:07 +03:00
Alexander Tokmakov
fb06a8518e optimization 2019-07-19 21:56:14 +03:00
Alexander Tokmakov
8146126dfd improvements 2019-07-19 16:57:20 +03:00
Alexander Tokmakov
6565d5c15f parse unquoted NULL 2019-07-18 18:20:45 +03:00
Alexander Tokmakov
668959b300 use default if not nullable 2019-07-18 16:43:20 +03:00
Nik
514851f0f8 Added verification of the length of the protobuff message 2019-07-18 15:58:03 +04:00
Yuriy
1d6e31be4d merged master 2019-07-16 10:33:25 +03:00
Yuriy
4df72f18ce writing packets in parts 2019-07-16 09:39:18 +03:00
Yuriy
f221fb0999 build fix 2019-07-15 23:37:01 +03:00
Nikolai Kochetov
e9f3d4d6b8
Merge pull request #4914 from yandex/processors
Processors
2019-07-11 19:22:02 +03:00
Nikolai Kochetov
209793c981 Merged with master. 2019-07-08 16:00:54 +03:00
Nikolai Kochetov
02bded6f21 Added MySQLOutputFormat. 2019-07-08 15:49:15 +03:00
Alexey Milovidov
03712aabec Add two more warnings from -Weverything 2019-07-08 03:16:39 +03:00
Vitaliy Zakaznikov
b5120931d5 Merge branch 'master' of https://github.com/yandex/ClickHouse into liveview 2019-07-01 18:12:31 -04:00
Vitaliy Zakaznikov
a363189dfc Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-07-01 18:05:14 -04:00
alexey-milovidov
c43dfce041
Merge pull request #5382 from abyss7/issue-5286
Add virtual columns to Kafka Engine tables
2019-07-01 21:30:09 +03:00
Yuriy
450b20ca89 max_memory_usage support in MySQL wire protocol 2019-07-01 08:58:31 +03:00
Alexey Milovidov
f6265d332a Fixed bad translation in comment 2019-06-27 14:13:32 +03:00
Nikolai Kochetov
f9b29bfdd2 Merged with master. 2019-06-25 20:00:54 +03:00
Ivan Lezhankin
0917573493 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-24 14:42:58 +03:00
proller
1ac09fa721
Split Common/config.h by libs (dbms) (#5715) 2019-06-24 14:17:15 +03:00
Ivan Lezhankin
ec78ec8365 Merge branch 'master' into issue-5286 2019-06-20 16:08:22 +03:00
akuzm
4cc9f632a0
Treat empty cells in CSV as default values. (#5625)
Treat empty cells in CSV as default values when input_format_defaults_for_omitted_fields = true.

Closes #5349.
2019-06-20 15:46:36 +03:00
proller
3d8c8ee83c
Build fixes. Split config.h (#5686) 2019-06-20 12:12:49 +03:00
Ivan Lezhankin
436052c67b Merge branch 'master' into issue-5286 2019-06-18 16:03:29 +03:00
Vitaliy Zakaznikov
51bf8a1baa Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-17 12:42:31 -04:00
Alexey Milovidov
413b780b65 Various fixes for PVS-Studio 2019-06-16 21:13:39 +03:00
Ivan Lezhankin
facdd966cc Fixes due to review 2019-06-14 20:19:02 +03:00
Vitaliy Zakaznikov
d50586d5a5 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-12 15:40:58 -04:00
Ivan Lezhankin
97558c1b41 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-10 14:15:14 +03:00
alexey-milovidov
4c7d71af1c
Merge pull request #5560 from yandex/perftests-file-formats
Fix #5439 bug PrettySpace format
2019-06-09 17:22:47 +03:00
alexey-milovidov
7324e5e8d4
Update PrettySpaceBlockOutputStream.cpp 2019-06-09 17:22:16 +03:00
stavrolia
6c487a253b Fix #5439 bug pretty space 2019-06-08 00:04:06 +03:00
Vitaliy Zakaznikov
aa3ef47aab * Adding JSONEachRowWithProgress format
that can be used with WATCH queries when HTTP connection is used
  in this case progress events are used as a heartbeat
* Adding new tests that use JSONEachRowWithProgress format
* Adding tests for WATCH query heartbeats when HTTP connection is used
* Small fixes to uexpect.py
2019-06-07 09:05:14 -04:00
Orivej Desh
5ec179377a DEVTOOLS-5170 Delete Y_IGNORE markers (#5533)
They have been superseded by a new include resolution configuration that lives
outside clickhouse source tree.
2019-06-05 14:52:39 +03:00
Ivan Lezhankin
b311984879 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-03 17:19:09 +03:00
Alexey Milovidov
05737678e2 Remove debug logging from MySQL protocol 2019-05-30 11:25:16 +03:00
Ivan Lezhankin
d2fd7a449f Fix build 2019-05-26 23:10:43 +03:00
Yuriy
96c2bb383f using logging level from config.xml 2019-05-26 22:30:23 +03:00
Yuriy
96e3574a06 Improvements of MySQL Wire Protocol 2019-05-26 09:52:29 +03:00
alexey-milovidov
461c4919d3
Merge pull request #5116 from PerformanceVision/send_header
Send a X-ClickHouse summary on the header for HTTP client with number of rows inserted
2019-05-25 20:20:35 +03:00
Alexey Milovidov
b94f2be154 Merge branch 'mysql' of https://github.com/yurriy/ClickHouse into yurriy-mysql 2019-05-25 17:14:57 +03:00
alexey-milovidov
b79582e15a
Merge pull request #5395 from clemrodriguez/master
Close MySQL connections opened by external MySQL dictionaries
2019-05-25 14:13:51 +03:00
Clément Rodriguez
8e8a563e30 Code style fixes 2019-05-24 14:30:12 +02:00
chertus
9eca696e82 actualize isNumber for Decimal 2019-05-24 15:11:03 +03:00
Ivan Lezhankin
19a850ad75 Use read callback to populate virtual columns in Kafka Engine 2019-05-23 16:20:25 +03:00
Clément Rodriguez
7b40d37212 Close MySQL connections after usage in MySQLDictionarySource 2019-05-23 15:09:07 +02:00
Ivan Lezhankin
800854119e Add buffer callback to fill in virtual columns 2019-05-23 14:15:18 +03:00
Guillaume Tassery
77b7158cd8 Progress rename for total_rows and write_[rows|bytes] 2019-05-20 18:37:41 +07:00
Ivan Lezhankin
0821d62516 Merge ITableDeclaration into IStorage.
Also a couple of massive include-refactorings with better forwarding
2019-05-17 17:34:25 +03:00
Yuriy
a51c293ec6 merged 'origin/master' into mysql 2019-05-16 14:19:05 +03:00
Yuriy
4ee84810b0 including information about query execution in response 2019-05-16 08:36:08 +03:00
Yuriy
ff4937859e added MySQL wire protocol presentational format 2019-05-16 06:34:04 +03:00
Ivan
1ea9e3019d
Freeze the Kafka buffer after first empty response (#5283)
* Check inside inferior streams for cancellation while reading.
* Stop reading from Kafka buffer after first empty read.
2019-05-15 19:11:50 +03:00
Ivan
4a5832b18a
Check the time limit every (flush_interval / poll_timeout) number of rows from Kafka (#5249) 2019-05-14 18:52:03 +03:00
Nikolai Kochetov
808d0f3b08 Merged with master. 2019-05-14 13:31:19 +03:00
Martijn Bakker
f76a2e2735 Merge branch 'master' into martijn-datetime64 2019-05-01 20:00:53 +01:00
Martijn Bakker
a602a6c79c add datetime64 definition 2019-04-23 14:05:45 +01:00
Alexander Kazakov
ecc6da1429 Fixed missing includes 2019-04-22 20:02:34 +03:00
Alexander Kazakov
c7a4b2ec75 Fixed style 2019-04-22 19:53:54 +03:00
Alexander Kazakov
bde1845bdc Better naming 2019-04-22 17:00:51 +03:00
Alexander Kazakov
d90bab5e33 In [T|C]SVWithNames formats start using column information from header 2019-04-22 16:31:17 +03:00
Alexey Milovidov
b0b369b30f Fixed typo #5010 2019-04-18 22:46:59 +03:00
Alexey Milovidov
642b09c8d6 Added clarifications #5010 2019-04-18 22:45:46 +03:00
Alexey Milovidov
f2cf2ffc80 Cleanups 2019-04-11 00:20:22 +03:00
Alexey Milovidov
36d016d331 Added [[noreturn]] attributes for functions that throw unconditionally 2019-04-10 23:27:14 +03:00
Nikolai Kochetov
ec65b4c229 Check num columns in Block::cloneWithColumns. 2019-04-05 14:39:07 +03:00
Nikolai Kochetov
7626b1b267 Multiple fixes. 2019-04-05 13:52:07 +03:00
Nikolai Kochetov
5e39ec610c Merged with master 2019-04-03 14:21:38 +03:00
Nikolai Kochetov
94ff7f694a QueryPipeline [in progress]. 2019-04-03 13:14:36 +03:00
Vitaly Baranov
37b904b8f5
Merge pull request #4808 from vitlibar/kafka-with-protobuf-format
Kafka with protobuf format
2019-03-30 19:00:57 +03:00
Vitaly Baranov
378c6f7a23 Improve the error message when format schema isn't set. 2019-03-29 22:36:10 +03:00
Vladislav Smirnov
7a02d320ff rewrite capnproto reading 2019-03-25 20:17:58 +03:00
Vladislav Smirnov
08b7c48286 Merge remote-tracking branch 'upstream/master' into fix-capnproto 2019-03-25 19:24:30 +03:00
proller
fce9db12b9 Move Interpreters/Settings* -> Core/Settings* 2019-03-22 15:08:30 +03:00
proller
faeca57d9a
Try fix Default timezone regression #4658 (#4718) 2019-03-20 16:29:20 +03:00