thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-02 12:32:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
32,371 Commits 9,194 Branches 1,782 Tags 2.2 GiB
9882c7c5ad
Commit Graph

369 Commits

Author SHA1 Message Date
Nikolai Kochetov
c336c514fb Remove TSKVRowInputStream. 2019-08-02 19:58:52 +03:00
Nikolai Kochetov
422b593570 Remove TSKVRowInputStream. 2019-08-02 19:56:52 +03:00
Nikolai Kochetov
6ab2e19410 Remove TSKVRowInputStream. 2019-08-02 19:51:33 +03:00
Nikolai Kochetov
f809de0949 Remove TabSeparatedRowOutputStream and TSKVRowOutputStream. 2019-08-02 19:48:50 +03:00
Nikolai Kochetov
afb3c20778 Remove CSVRowOutputStream. 2019-08-02 19:37:33 +03:00
Nikolai Kochetov
5fb548c994 Remove ProtobufRowOutputStream. 2019-08-02 19:31:17 +03:00
Nikolai Kochetov
8c66d106e4 Remove ProtobufRowInputStream. 2019-08-02 19:23:44 +03:00
Nikolai Kochetov
bd4f0182e4 Remove PrettyBlockOutputStreams. 2019-08-02 19:20:25 +03:00
Nikolai Kochetov
529e06e5cb Remove ParquetBlockOutputStream. 2019-08-02 19:09:52 +03:00
Nikolai Kochetov
fcecbbda73 Remove OParquetBlockInputStream 2019-08-02 19:00:24 +03:00
Nikolai Kochetov
978bdc4bfc Remove ODBCDriverBlockOutputStream. 2019-08-02 18:51:43 +03:00
Nikolai Kochetov
51bd715781 Remove ODBCDriver2BlockOutputStream. 2019-08-02 18:49:46 +03:00
Nikolai Kochetov
d57d8a609f Remove MySQLWireBlockOutputStream. 2019-08-02 18:45:21 +03:00
Nikolai Kochetov
4019f5e102 Remove JSONRowOutputStream. 2019-08-02 18:42:52 +03:00
Nikolai Kochetov
ce712d881a Remove JSONEachRowRowOutputStream. 2019-08-02 18:39:12 +03:00
Nikolai Kochetov
ae50ab6907 Remove JSONEachRowRowInputStream. 2019-08-02 18:36:36 +03:00
Nikolai Kochetov
cd299bb162 Remove JSONCompactRowOutputStream. 2019-08-02 18:32:07 +03:00
Nikolai Kochetov
2833ca6d2f Remove CapnProtoRowInputStream. 2019-08-02 18:28:13 +03:00
Nikolai Kochetov
342f044241 Remove BinaryRowOutputStream. 2019-08-02 18:25:32 +03:00
Nikolai Kochetov
03ece9dc99 Remove BinaryRowInputStream. 2019-08-02 18:21:48 +03:00
Nikolai Kochetov
49632a74b7 Update FormatFactory. 2019-08-02 17:41:19 +03:00
Nikolai Kochetov
0201cdf61a Merge branch 'master' into processors-and-output-formats 2019-08-02 15:29:19 +03:00
Nikolai Kochetov
c228f18130 Update IRowInputFormat and FormatFactory. 2019-08-01 17:25:41 +03:00
tavplubix
6625536236
Merge pull request #6055 from yandex/csv_unquoted_nulls_and_default_values 
CSV unquoted nulls and default values
 2019-08-01 15:11:06 +03:00
Nikolai Kochetov
4e38a45922 Update FormatFactory. 2019-07-31 16:26:08 +03:00
Nikolai Kochetov
77d81687b3 Update FormatFactory. 2019-07-31 13:54:50 +03:00
Nikolai Kochetov
2d5b282a31 Update FormatFactory. 2019-07-31 13:37:28 +03:00
Nikolai Kochetov
cc74c5ec78 Update FormatFactory. 2019-07-31 13:31:14 +03:00
Nikolai Kochetov
4bea8541d1 Update FormatFactory. 2019-07-31 13:28:54 +03:00
Yuriy
c1b57f9cf5 fixed heap buffer overflow in PacketPayloadWriteBuffer 2019-07-29 18:41:47 +03:00
Alexey Milovidov
48a3c82f6f Removed useless code from MySQLWireBlockOutputStream 2019-07-29 02:57:49 +03:00
Yuriy
383fa25c51 resolved conflict 2019-07-28 02:00:15 +03:00
Alexey Milovidov
bc74013f98 Fixed UBSan report in ProtobufWriter 2019-07-25 23:10:33 +03:00
Nikolai Kochetov
7f1fd1a918 Use IInputFormat and IOutputFormat by default. 2019-07-25 11:37:21 +03:00
Nikolai Kochetov
58d579e7e2 Use IInputFormat and IOutputFormat by default. 2019-07-24 21:00:09 +03:00
Vitaly Baranov
d3ff30cb5b Use better approach to check offsets in protobuf messages. 2019-07-24 14:41:49 +03:00
Vitaly Baranov
746066be48 Remove excessive throw in a correct case. 2019-07-23 17:02:15 +03:00
Alexander Tokmakov
89a4462c4f Merge branch 'master' into csv_unquoted_nulls_and_default_values 2019-07-23 13:49:47 +03:00
Alexander Tokmakov
96d0a066d9 rename format_csv_unquoted_null_literal_as_null to input_format_csv_unquoted_null_literal_as_null 2019-07-22 23:13:27 +03:00
Alexander Tokmakov
d46a27ee01 Fixes 2019-07-22 03:28:55 +03:00
Alexander Tokmakov
89ae562e83 Fix 2019-07-22 03:17:03 +03:00
Alexander Tokmakov
6e4efb94f0 OPTIMIZE(1) 2019-07-22 03:02:31 +03:00
Alexander Tokmakov
f43f7c43a5 Fixes 2019-07-22 02:59:31 +03:00
Alexander Tokmakov
ab9ce18fc7 Added CSV (de)serialization 2019-07-22 02:58:55 +03:00
Alexander Tokmakov
c92a0f3ac5 Fixes 2019-07-22 02:58:39 +03:00
Alexander Tokmakov
4e97fd697a Diagnostic info for Template 2019-07-22 02:58:22 +03:00
Alexander Tokmakov
a931e16c6c Diagnostic info refactored 2019-07-22 02:57:27 +03:00
Alexander Tokmakov
892b67492d Checking for suffix, not for eof 2019-07-22 01:03:29 +03:00
Alexander Tokmakov
79015898cf TemplateRowInputStream 2019-07-22 01:02:54 +03:00
Alexander Tokmakov
05d6e23373 Customizable prefix, suffix and row delimiter 2019-07-22 01:00:34 +03:00
Alexander Tokmakov
4f7720139a TemplateRowOutputStream changed to TemplateBlockOutputStream 2019-07-22 00:59:10 +03:00
Alexander Tokmakov
12e08417d6 Template format implementation 2019-07-22 00:57:57 +03:00
Alexey Milovidov
d0996c0b73 Minor modifications for #6070 2019-07-20 00:37:34 +03:00
alexey-milovidov
3a8bb58522
Update ProtobufReader.cpp 2019-07-20 00:30:22 +03:00
alexey-milovidov
f2b6adf15e
Update ProtobufReader.cpp 2019-07-20 00:27:20 +03:00
alexey-milovidov
6cb9e9f56f
Update ProtobufReader.h 2019-07-20 00:26:12 +03:00
alexey-milovidov
3ec2360afd
Update ProtobufReader.h 2019-07-20 00:25:49 +03:00
alexey-milovidov
93ddb7da89
Update ProtobufReader.cpp 2019-07-20 00:25:07 +03:00
Alexander Tokmakov
fb06a8518e optimization 2019-07-19 21:56:14 +03:00
Alexander Tokmakov
8146126dfd improvements 2019-07-19 16:57:20 +03:00
Alexander Tokmakov
6565d5c15f parse unquoted NULL 2019-07-18 18:20:45 +03:00
Alexander Tokmakov
668959b300 use default if not nullable 2019-07-18 16:43:20 +03:00
Nik
514851f0f8 Added verification of the length of the protobuff message 2019-07-18 15:58:03 +04:00
Yuriy
1d6e31be4d merged master 2019-07-16 10:33:25 +03:00
Yuriy
4df72f18ce writing packets in parts 2019-07-16 09:39:18 +03:00
Yuriy
f221fb0999 build fix 2019-07-15 23:37:01 +03:00
Nikolai Kochetov
e9f3d4d6b8
Merge pull request #4914 from yandex/processors 
Processors
 2019-07-11 19:22:02 +03:00
Nikolai Kochetov
209793c981 Merged with master. 2019-07-08 16:00:54 +03:00
Nikolai Kochetov
02bded6f21 Added MySQLOutputFormat. 2019-07-08 15:49:15 +03:00
Alexey Milovidov
03712aabec Add two more warnings from -Weverything 2019-07-08 03:16:39 +03:00
Vitaliy Zakaznikov
b5120931d5 Merge branch 'master' of https://github.com/yandex/ClickHouse into liveview 2019-07-01 18:12:31 -04:00
Vitaliy Zakaznikov
a363189dfc Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-07-01 18:05:14 -04:00
alexey-milovidov
c43dfce041
Merge pull request #5382 from abyss7/issue-5286 
Add virtual columns to Kafka Engine tables
 2019-07-01 21:30:09 +03:00
Yuriy
450b20ca89 max_memory_usage support in MySQL wire protocol 2019-07-01 08:58:31 +03:00
Alexey Milovidov
f6265d332a Fixed bad translation in comment 2019-06-27 14:13:32 +03:00
Nikolai Kochetov
f9b29bfdd2 Merged with master. 2019-06-25 20:00:54 +03:00
Ivan Lezhankin
0917573493 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-24 14:42:58 +03:00
proller
1ac09fa721
Split Common/config.h by libs (dbms) (#5715) 2019-06-24 14:17:15 +03:00
Ivan Lezhankin
ec78ec8365 Merge branch 'master' into issue-5286 2019-06-20 16:08:22 +03:00
akuzm
4cc9f632a0
Treat empty cells in CSV as default values. (#5625) 
Treat empty cells in CSV as default values when input_format_defaults_for_omitted_fields = true.

Closes #5349.
 2019-06-20 15:46:36 +03:00
proller
3d8c8ee83c
Build fixes. Split config.h (#5686) 2019-06-20 12:12:49 +03:00
Ivan Lezhankin
436052c67b Merge branch 'master' into issue-5286 2019-06-18 16:03:29 +03:00
Vitaliy Zakaznikov
51bf8a1baa Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-17 12:42:31 -04:00
Alexey Milovidov
413b780b65 Various fixes for PVS-Studio 2019-06-16 21:13:39 +03:00
Ivan Lezhankin
facdd966cc Fixes due to review 2019-06-14 20:19:02 +03:00
Vitaliy Zakaznikov
d50586d5a5 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-12 15:40:58 -04:00
Ivan Lezhankin
97558c1b41 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-10 14:15:14 +03:00
alexey-milovidov
4c7d71af1c
Merge pull request #5560 from yandex/perftests-file-formats 
Fix #5439 bug PrettySpace format
 2019-06-09 17:22:47 +03:00
alexey-milovidov
7324e5e8d4
Update PrettySpaceBlockOutputStream.cpp 2019-06-09 17:22:16 +03:00
stavrolia
6c487a253b Fix #5439 bug pretty space 2019-06-08 00:04:06 +03:00
Vitaliy Zakaznikov
aa3ef47aab * Adding JSONEachRowWithProgress format 
that can be used with WATCH queries when HTTP connection is used
  in this case progress events are used as a heartbeat
* Adding new tests that use JSONEachRowWithProgress format
* Adding tests for WATCH query heartbeats when HTTP connection is used
* Small fixes to uexpect.py
 2019-06-07 09:05:14 -04:00
Orivej Desh
5ec179377a DEVTOOLS-5170 Delete Y_IGNORE markers (#5533) 
They have been superseded by a new include resolution configuration that lives
outside clickhouse source tree.
 2019-06-05 14:52:39 +03:00
Ivan Lezhankin
b311984879 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-03 17:19:09 +03:00
Alexey Milovidov
05737678e2 Remove debug logging from MySQL protocol 2019-05-30 11:25:16 +03:00
Ivan Lezhankin
d2fd7a449f Fix build 2019-05-26 23:10:43 +03:00
Yuriy
96c2bb383f using logging level from config.xml 2019-05-26 22:30:23 +03:00
Yuriy
96e3574a06 Improvements of MySQL Wire Protocol 2019-05-26 09:52:29 +03:00
alexey-milovidov
461c4919d3
Merge pull request #5116 from PerformanceVision/send_header 
Send a X-ClickHouse summary on the header for HTTP client with number of rows inserted
 2019-05-25 20:20:35 +03:00
Alexey Milovidov
b94f2be154 Merge branch 'mysql' of https://github.com/yurriy/ClickHouse into yurriy-mysql 2019-05-25 17:14:57 +03:00
alexey-milovidov
b79582e15a
Merge pull request #5395 from clemrodriguez/master 
Close MySQL connections opened by external MySQL dictionaries
 2019-05-25 14:13:51 +03:00
Clément Rodriguez
8e8a563e30 Code style fixes 2019-05-24 14:30:12 +02:00
chertus
9eca696e82 actualize isNumber for Decimal 2019-05-24 15:11:03 +03:00
Ivan Lezhankin
19a850ad75 Use read callback to populate virtual columns in Kafka Engine 2019-05-23 16:20:25 +03:00
Clément Rodriguez
7b40d37212 Close MySQL connections after usage in MySQLDictionarySource 2019-05-23 15:09:07 +02:00
Ivan Lezhankin
800854119e Add buffer callback to fill in virtual columns 2019-05-23 14:15:18 +03:00
Guillaume Tassery
77b7158cd8 Progress rename for total_rows and write_[rows|bytes] 2019-05-20 18:37:41 +07:00
Ivan Lezhankin
0821d62516 Merge ITableDeclaration into IStorage. 
Also a couple of massive include-refactorings with better forwarding
 2019-05-17 17:34:25 +03:00
Yuriy
a51c293ec6 merged 'origin/master' into mysql 2019-05-16 14:19:05 +03:00
Yuriy
4ee84810b0 including information about query execution in response 2019-05-16 08:36:08 +03:00
Yuriy
ff4937859e added MySQL wire protocol presentational format 2019-05-16 06:34:04 +03:00
Ivan
1ea9e3019d
Freeze the Kafka buffer after first empty response (#5283) 
* Check inside inferior streams for cancellation while reading.
* Stop reading from Kafka buffer after first empty read.
 2019-05-15 19:11:50 +03:00
Ivan
4a5832b18a
Check the time limit every (flush_interval / poll_timeout) number of rows from Kafka (#5249) 2019-05-14 18:52:03 +03:00
Nikolai Kochetov
808d0f3b08 Merged with master. 2019-05-14 13:31:19 +03:00
Martijn Bakker
f76a2e2735 Merge branch 'master' into martijn-datetime64 2019-05-01 20:00:53 +01:00
Martijn Bakker
a602a6c79c add datetime64 definition 2019-04-23 14:05:45 +01:00
Alexander Kazakov
ecc6da1429 Fixed missing includes 2019-04-22 20:02:34 +03:00
Alexander Kazakov
c7a4b2ec75 Fixed style 2019-04-22 19:53:54 +03:00
Alexander Kazakov
bde1845bdc Better naming 2019-04-22 17:00:51 +03:00
Alexander Kazakov
d90bab5e33 In [T|C]SVWithNames formats start using column information from header 2019-04-22 16:31:17 +03:00
Alexey Milovidov
b0b369b30f Fixed typo #5010 2019-04-18 22:46:59 +03:00
Alexey Milovidov
642b09c8d6 Added clarifications #5010 2019-04-18 22:45:46 +03:00
Alexey Milovidov
f2cf2ffc80 Cleanups 2019-04-11 00:20:22 +03:00
Alexey Milovidov
36d016d331 Added [[noreturn]] attributes for functions that throw unconditionally 2019-04-10 23:27:14 +03:00
Nikolai Kochetov
ec65b4c229 Check num columns in Block::cloneWithColumns. 2019-04-05 14:39:07 +03:00
Nikolai Kochetov
7626b1b267 Multiple fixes. 2019-04-05 13:52:07 +03:00
Nikolai Kochetov
5e39ec610c Merged with master 2019-04-03 14:21:38 +03:00
Nikolai Kochetov
94ff7f694a QueryPipeline [in progress]. 2019-04-03 13:14:36 +03:00
Vitaly Baranov
37b904b8f5
Merge pull request #4808 from vitlibar/kafka-with-protobuf-format 
Kafka with protobuf format
 2019-03-30 19:00:57 +03:00
Vitaly Baranov
378c6f7a23 Improve the error message when format schema isn't set. 2019-03-29 22:36:10 +03:00
Vladislav Smirnov
7a02d320ff rewrite capnproto reading 2019-03-25 20:17:58 +03:00
Vladislav Smirnov
08b7c48286 Merge remote-tracking branch 'upstream/master' into fix-capnproto 2019-03-25 19:24:30 +03:00
proller
fce9db12b9 Move Interpreters/Settings* -> Core/Settings* 2019-03-22 15:08:30 +03:00
proller
faeca57d9a
Try fix Default timezone regression #4658 (#4718) 2019-03-20 16:29:20 +03:00
Vladislav Smirnov
59d473e215 style 2019-03-13 18:28:29 +03:00
Vladislav Smirnov
a916b62f33 ignore instead append 2019-03-13 14:18:18 +03:00
Vladislav Smirnov
7d822d8081 tabs -> spaces 2019-03-13 14:05:52 +03:00
Vladislav Smirnov
22f4852830 fix reading capnproto 2019-03-13 13:50:49 +03:00
Alexey Milovidov
9d89cc0fc1 Debugging PODArray 2019-03-08 06:23:02 +03:00
proller
482d153dcd clickhouse-odbc #157 : Remove LowCardinality from type (#4381) 
* clickhouse-odbc #157 : Remove LowCardinality from type

* Update ODBCDriver2BlockOutputStream.cpp

* fix
 2019-03-06 21:37:16 +03:00
proller
ffc9fbf769 Build fixes (#4600) 
* Add Y_IGNORE

* Build fixes
 2019-03-06 02:53:35 +03:00
Amos Bird
26ab5dd7a7 A Proper lookup table that uses HashTable's API 
This is the first step of allowing heterogeneous cells in hash tables.

performance test results are

```

1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>

ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124

ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998

ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130

ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191

ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279

ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441

ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564

ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378

ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157

ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041

```
 2019-03-01 16:47:13 +08:00
proller
23d70b2e04
Add Y_IGNORE (#4521) 2019-02-27 19:52:08 +03:00
Vitaly Baranov
6fbcc12674
Merge pull request #4493 from vitlibar/support-for-nested-messages-in-protobuf-output 
Added support for nested messages in protobuf output format
 2019-02-27 18:16:45 +03:00
proller
211ec436c5
Build fixes (#4516) 2019-02-27 15:52:24 +03:00
Vitaly Baranov
147a7a1458 Remove unused function ProtobufSchemas::getMessageTypeForColumns(). 2019-02-27 14:37:17 +03:00
Vitaly Baranov
e712a78cce Minor improvements of ProtobufReader. 2019-02-27 14:37:17 +03:00
Vitaly Baranov
85ab57f179 Implement support of nested messages in Protobuf output format. 2019-02-27 14:37:17 +03:00
Vitaly Baranov
4f46052f2e Optimize the class ProtobufWriter and prepare for implementing support of nested messages. 2019-02-27 14:37:14 +03:00
Vitaly Baranov
1cce1feac1 Move IConverter to header for allow inlining ProtobufWriter functions. 2019-02-27 00:54:25 +03:00
Vitaly Baranov
2f0276503a Move ProtobufSimpleWriter to the internals of ProtobufWriter. 2019-02-27 00:54:25 +03:00