thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-10-11 02:50:50 +00:00
Code Issues Packages Projects Releases Wiki Activity
29,718 Commits 8,991 Branches 1,770 Tags 2.1 GiB
cffc254922
Commit Graph

400 Commits

Author SHA1 Message Date
Nikolai Kochetov
4f38b08481 Fix RollupTransform. 2019-08-22 11:53:34 +03:00
Nikolai Kochetov
8228871821 Fix RollupTransform. 2019-08-22 11:29:29 +03:00
Nikolai Kochetov
c3aaf583a0 Fix RollupTransform. 2019-08-22 11:26:50 +03:00
akonyaev
1683547b2d ADQM-34 fix style 2019-08-22 10:24:04 +03:00
akonyaev
01216e45b6 Merge branch 'master' of https://github.com/yandex/ClickHouse into ADQM-34 
# Conflicts:
#	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp
 2019-08-22 09:40:51 +03:00
akonyaev
321233ddaa ADQM-34 fix hardcode for,at name in ArrowColumnToCHColumn class 2019-08-21 19:39:20 +03:00
Nikolai Kochetov
2e03ac09ec Fix MergingSortedTransform. 2019-08-21 19:38:27 +03:00
Nikolai Kochetov
e68775e3d0 Fix TotalsHavingTransform. 2019-08-21 17:51:32 +03:00
akonyaev
caf0d30a5f ADQM-34 add orc input format 2019-08-21 17:19:47 +03:00
Nikolai Kochetov
fe3221d0e4 Fix SortingAggregatedTransform. 2019-08-21 17:19:18 +03:00
Nikolai Kochetov
c27cada229 Fix ExpressionTransform. 2019-08-21 16:14:23 +03:00
Alexey Milovidov
8966520801 Added "assert_cast" function as a replacement for static_cast for columns 2019-08-21 05:28:04 +03:00
Alexey Milovidov
a6b64d6ba0 Parquet: Fix reading boolean columns 2019-08-21 04:00:13 +03:00
Nikolai Kochetov
06bb0af386 Fix build. 2019-08-20 18:03:35 +03:00
Nikolai Kochetov
aef03fd9bf
Merge pull request #6425 from yandex/vzakaznikov-liveview 
Merge LIVE VIEW
 2019-08-20 17:13:42 +03:00
Ivan
a502424c33
Implement support for insertion into Kafka tables (#6012) 
* Add write-callback on each row for RowOutputStream
* Fix build of new rdkafka library
* Poll messages if Kafka outgoing queue is full
* Add test
* Add test producer-consumer
* Truncate delimiter from last row in message
 2019-08-20 14:17:57 +03:00
Nikolai Kochetov
cdf1ce3171 Merge branch 'master' into vzakaznikov-liveview 2019-08-20 10:41:31 +03:00
Alexander Tokmakov
bca580653d fix csv input 2019-08-20 02:09:02 +03:00
proller
d09c5c871b Build fixes (#6491) 
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)
 2019-08-18 01:53:46 +03:00
Nikolai Kochetov
18ad0e7e6b Merged with master. 2019-08-16 13:55:40 +03:00
Nikolai Kochetov
e51c48501b Fix arg type forPipelineExecutor::prepareProcessor 2019-08-14 18:28:33 +03:00
Nikolai Kochetov
631bbde420 Merged with master. 2019-08-12 13:19:13 +03:00
Alexey Milovidov
2570907f44 Removed useless parameter 2019-08-12 00:45:18 +03:00
alexey-milovidov
838c5e535f
Merge pull request #6433 from yandex/prevent-stack-overflow-in-parser 
Fixed possible stack overflow in parser
 2019-08-10 23:58:54 +03:00
Alexey Milovidov
0a9787c7f3 Fixed possible stack overflow in parser 2019-08-10 19:38:25 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Nikolai Kochetov
ed11432f68 Added JSONEachRowWithProgressRowOutputFormat. 2019-08-09 19:10:47 +03:00
Nikolai Kochetov
23e2d17d9d Added JSONEachRowWithProgressRowOutputFormat. 2019-08-09 18:58:07 +03:00
Nikolai Kochetov
bd8c9733e3 Update MySQLOutputFormat. 2019-08-05 12:35:46 +03:00
Nikolai Kochetov
abc63f8a06 Merged with master. 2019-08-04 15:43:11 +03:00
Nikolai Kochetov
511f3050a6 Update CSVRowInputFormat. 2019-08-04 13:19:51 +03:00
Nikolai Kochetov
1f6a16b03a Remove ValuesRowInputStream. 2019-08-02 20:16:58 +03:00
Nikolai Kochetov
e5d67cbe61 Remove ProtobufRowOutputStream. 2019-08-02 19:34:20 +03:00
Nikolai Kochetov
5fb548c994 Remove ProtobufRowOutputStream. 2019-08-02 19:31:17 +03:00
Nikolai Kochetov
8c66d106e4 Remove ProtobufRowInputStream. 2019-08-02 19:23:44 +03:00
Nikolai Kochetov
529e06e5cb Remove ParquetBlockOutputStream. 2019-08-02 19:09:52 +03:00
Nikolai Kochetov
fcecbbda73 Remove OParquetBlockInputStream 2019-08-02 19:00:24 +03:00
Nikolai Kochetov
ae50ab6907 Remove JSONEachRowRowInputStream. 2019-08-02 18:36:36 +03:00
Nikolai Kochetov
48818aef7f Update MySQLOutputFormat. 2019-08-02 15:41:21 +03:00
Nikolai Kochetov
0201cdf61a Merge branch 'master' into processors-and-output-formats 2019-08-02 15:29:19 +03:00
Nikolai Kochetov
c228f18130 Update IRowInputFormat and FormatFactory. 2019-08-01 17:25:41 +03:00
Nikolai Kochetov
a5bb2e2b3f Update Schema name in Protobuf and CapnProto formats. 2019-08-01 12:56:30 +03:00
Nikolai Kochetov
9811fdcdc7 Update CapnProtoRowInputFormat. 2019-08-01 11:31:08 +03:00
Nikolai Kochetov
9c4aefe2ae Update ODBCDriver2BlockOutputFormat. 2019-07-31 18:10:51 +03:00
Nikolai Kochetov
1347cf1359 Update ODBCDriver2BlockOutputFormat. 2019-07-31 17:58:56 +03:00
Nikolai Kochetov
3a8fefdda8 Update CSVRowInputStream. 2019-07-31 17:43:08 +03:00
Nikolai Kochetov
f0bf083efc Update CSVRowInputStream. 2019-07-31 17:16:28 +03:00
Nikolai Kochetov
2c638d577d Update VerticalRowOutputFormat. 2019-07-31 14:51:00 +03:00
Nikolai Kochetov
8bfd909f5b Update JSONEachRowRowOutputFormat. 2019-07-31 13:06:46 +03:00
Nikolai Kochetov
5bdb6aa9f3 Update TSKVRowInputFormat. 2019-07-31 12:43:20 +03:00
Nikolai Kochetov
b274545bb7 Update CSVRowInputFormat. 2019-07-30 21:48:40 +03:00
Nikolai Kochetov
e8b643e032 Update CSVRowInputFormat. 2019-07-30 21:22:01 +03:00
Nikolai Kochetov
ee3a93bab5 Update CSVRowInputFormat. 2019-07-30 21:21:12 +03:00
Nikolai Kochetov
d4da486b51 Update CSVRowInputFormat. 2019-07-30 17:55:59 +03:00
Yuriy
c1b57f9cf5 fixed heap buffer overflow in PacketPayloadWriteBuffer 2019-07-29 18:41:47 +03:00
Yuriy
383fa25c51 resolved conflict 2019-07-28 02:00:15 +03:00
Nikolai Kochetov
95dd6222fe Use IInputFormat and IOutputFormat by default. 2019-07-25 15:17:57 +03:00
Nikolai Kochetov
78f056d83f Use IInputFormat and IOutputFormat by default. 2019-07-25 12:35:16 +03:00
Nikolai Kochetov
36a0275ff1 Use IInputFormat and IOutputFormat by default. 2019-07-25 12:31:38 +03:00
Nikolai Kochetov
69f860a5ef Use IInputFormat and IOutputFormat by default. 2019-07-25 12:28:33 +03:00
Nikolai Kochetov
a22540d010 Use IInputFormat and IOutputFormat by default. 2019-07-25 12:20:00 +03:00
Nikolai Kochetov
4cc3bf7724 Use IInputFormat and IOutputFormat by default. 2019-07-25 12:15:33 +03:00
Nikolai Kochetov
58d579e7e2 Use IInputFormat and IOutputFormat by default. 2019-07-24 21:00:09 +03:00
Vitaly Baranov
d3ff30cb5b Use better approach to check offsets in protobuf messages. 2019-07-24 14:41:49 +03:00
Alexander Kuzmenkov
9df09f3506 Do not access shared arenas in aggregate function columns. 
These arenas may be updated concurrently, so it is unsafe to
access them, as illustrated by issue #4402. Store them separately
and use a different arena for the updates. Change some callers
to accomodate for this.
 2019-07-18 14:21:37 +03:00
Yuriy
a03114ede2 cast to proper type 2019-07-16 11:47:54 +03:00
Yuriy
d74be1dc9c fixed MySQLOutputFormat used by new query processing pipeline 2019-07-16 11:24:51 +03:00
Nikolai Kochetov
bfa114126a More comments for PipelineExecutor. 2019-07-11 09:50:44 +03:00
Nikolai Kochetov
d104f2d8ff Update PipelineExecutor 2019-07-10 14:59:30 +03:00
Nikolai Kochetov
282feb1fdb Update PipelineExecutor 2019-07-10 09:52:44 +03:00
Nikolai Kochetov
6974cc3c9f Update ResizePipeline 2019-07-09 20:47:13 +03:00
Nikolai Kochetov
911e4014ff Increase queue size in LazyOutputFormat in order to prevent potential lock. 2019-07-09 15:26:22 +03:00
Nikolai Kochetov
27acbb0412 Fix tests. 2019-07-08 21:08:44 +03:00
Nikolai Kochetov
de2221222e Don't skip empty chunks in Filter Transform. 2019-07-08 18:52:18 +03:00
Nikolai Kochetov
2128fb890b Don't skip empty chunks in Filter Transform. 2019-07-08 18:23:45 +03:00
Nikolai Kochetov
e0362c5216 Fix build. 2019-07-08 16:15:45 +03:00
Nikolai Kochetov
472f32f718 Remove ThreadGroupThreadPoolCallbacks 2019-07-08 15:49:52 +03:00
Nikolai Kochetov
e5103d741c Fix lock in case of query was cancelled. 2019-07-08 15:48:16 +03:00
Nikolai Kochetov
fc3b465d60 Fix race in doExpandPipeline. 2019-07-08 15:49:46 +03:00
Nikolai Kochetov
a27fbe6ea7 Removed lockfree stack. 2019-07-08 15:49:33 +03:00
Nikolai Kochetov
45b7d479aa Fix arguments in prepareProcessor call. 2019-07-08 15:49:23 +03:00
Nikolai Kochetov
02bded6f21 Added MySQLOutputFormat. 2019-07-08 15:49:15 +03:00
Nikolai Kochetov
acf382f9e5 Use boost::lockfree::stack instead of boost::lockfree::queue 2019-07-08 15:48:51 +03:00
Nikolai Kochetov
3ff5495fba Fix raise in PipelineExecutor::doExpandPipeline 2019-07-08 15:48:41 +03:00
Nikolai Kochetov
3df6d12216 More comments for PipelineExecutor. 2019-07-08 15:48:16 +03:00
Nikolai Kochetov
e8b4362ed2 Use ThreadPool in PipelineExecutor. 2019-07-08 15:48:32 +03:00
Nikolai Kochetov
f808d71aba Fix build. 2019-07-08 15:48:16 +03:00
Nikolai Kochetov
50aac7e982 Atomic Ports. [2] 2019-06-25 19:42:57 +03:00
Nikolai Kochetov
67b7080707 Atomic Ports. 2019-06-25 19:42:26 +03:00
Nikolai Kochetov
ab781f0988 Add task_queue to PipelineExecutor. 2019-06-25 19:42:05 +03:00
Nikolai Kochetov
d0cd3cc640 Update PipelineExecutor 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
1f6bbeee7d Update Port.h 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
94e087102d Use std::pair in port. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
6c2dd9b87d Remove copy constructor from Chunk. 2019-06-25 19:41:59 +03:00
Nikolai Kochetov
11e0752f6d Update PipelineExecutor. 2019-06-25 19:41:55 +03:00
Nikolai Kochetov
c6bbf6d91d Process pipeline in each thread in PipelineExecutor. 
Exception safety in PipelineExecutor.
 2019-06-25 19:41:38 +03:00
Nikolai Kochetov
d8f0c6c15a Added stream number to pipeline execution state. 2019-06-25 19:41:28 +03:00
Nikolai Kochetov
3bee30a215 Update PipelineExecutor. 2019-06-25 19:41:11 +03:00
Nikolai Kochetov
fc5f28faeb Remove ExceptionHandler from PipelineExecutor. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
8299680efe Update Port.h 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
76934cf801 Don't call cancell for RemoteBlockInputStream in SourceFromInputStream. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
f5e20027a7 Better exception safety for SourceFromInputStream. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
1ae23a6d9d Don't throw exception if query was cannelled. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
821d520a52 Fix limit by offset. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
cc09bb5557 Fix distinct. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
96174e90b0 Fix build. 2019-06-25 19:41:00 +03:00
Nikolai Kochetov
4ef3ff7270 Better exception safety for ISource and MergingAggregatedTransform. 2019-05-14 12:50:04 +03:00
Nikolai Kochetov
6a781cf2c8 Free chunks when merge sort is finished at MergeSorter. 2019-05-13 17:57:49 +03:00
Nikolai Kochetov
ba6768557e Fix rows_before_limit_at_least. 2019-05-13 16:04:52 +03:00
Nikolai Kochetov
fe9a45fee1 Fix rows_before_limit_at_least. 2019-05-13 15:08:02 +03:00
Nikolai Kochetov
18a7b0d7a2 Fix data race in PipelineExecutor. 2019-05-13 13:03:47 +03:00
Nikolai Kochetov
b8adb0937f Do not create processors for totals stream. 2019-04-30 20:37:30 +03:00
Nikolai Kochetov
ad8af5b5ba Do not create processors for totals stream. 2019-04-30 20:12:43 +03:00
Nikolai Kochetov
72c0530845 Do not create processors for totals stream. 2019-04-30 20:01:12 +03:00
Nikolai Kochetov
249a88784b Remove thread group from PipelineExecutor task. 2019-04-30 15:51:25 +03:00
Nikolai Kochetov
ced8e607f1 Wait for tasks from thread pool in case of exception in PipelineExecutor. 2019-04-30 15:28:11 +03:00
Nikolai Kochetov
e20f6a96af Disable pushing exceptions to ports from ISource. 2019-04-30 12:45:13 +03:00
Nikolai Kochetov
0faab7ff12 Disable pushing exceptions to ports from ISource. 2019-04-30 12:43:51 +03:00
Nikolai Kochetov
99ff2375ab Skip false constants in FilterTransform. 2019-04-30 12:38:37 +03:00
Nikolai Kochetov
65fb195fd7 Pass exception from ISource. 2019-04-29 21:43:50 +03:00
Nikolai Kochetov
062407cf14 Fix build. 2019-04-29 21:24:32 +03:00
Nikolai Kochetov
00bccfa232 Fix rows_before_limit_at_least. 2019-04-29 19:52:50 +03:00
Nikolai Kochetov
aacc0572e5 Attach to current thread in threadpool. 2019-04-29 16:57:29 +03:00
Nikolai Kochetov
36a9b5155b Attach to current thread in threadpool. 2019-04-29 15:23:20 +03:00
Nikolai Kochetov
caf9ed639b Attach tasks from PipelineExecutor to thread group. 2019-04-29 14:04:03 +03:00
Nikolai Kochetov
0b8107c497 Fix totals with rollup. 2019-04-29 13:00:17 +03:00
Nikolai Kochetov
4d87fd327f Don't add info about processors to TOO_MANY_ROWS_OR_BYTES exception. 2019-04-26 21:43:13 +03:00
Nikolai Kochetov
13800ac650 Don't add info about processors to TOO_MANY_ROWS_OR_BYTES exception. 2019-04-26 20:33:46 +03:00
Nikolai Kochetov
e2a41a031a Don't add info about processors to TOO_MANY_ROWS_OR_BYTES exception. 2019-04-26 20:21:14 +03:00
Nikolai Kochetov
90b5bb32ba Allow pass exceptions through ports. Pass exceptions for ISimpleTransform. 2019-04-26 19:21:24 +03:00
Nikolai Kochetov
080d573300 Fix port for totals. 2019-04-26 18:12:39 +03:00
Nikolai Kochetov
0aa9ee88db Even task consuming in ResizeProcessor. 2019-04-26 14:40:35 +03:00
Nikolai Kochetov
4a9c0a1e56 Even task consuming in ResizeProcessor. 2019-04-26 14:34:51 +03:00
Nikolai Kochetov
b475fb1d4c Even task consuming in ResizeProcessor. 2019-04-26 14:15:33 +03:00
Nikolai Kochetov
6d65f95283 Fix totals chunk in TotalsHavingTransform. 2019-04-25 18:35:13 +03:00
Nikolai Kochetov
e8e5164d9d Don't use same headers for main and totals streams in QueryPipeline. 2019-04-25 17:52:51 +03:00
Nikolai Kochetov
b3a90eeda0 Read prefix in SourceFromInputStream. 2019-04-25 16:34:59 +03:00
Nikolai Kochetov
b906e36eb6 Undo add thread_group to ThreadPool 2019-04-18 21:45:51 +03:00
Nikolai Kochetov
36392aab6b Fix Cube transform. 2019-04-18 20:32:01 +03:00
Nikolai Kochetov
2377298c0d Fix Cube transform. 2019-04-18 20:28:55 +03:00
Nikolai Kochetov
a7486a25cf Fix Cube transform. 2019-04-18 20:17:18 +03:00
Nikolai Kochetov
0694a61c05 Fix Cube transform. 2019-04-18 20:08:28 +03:00
Nikolai Kochetov
45ffec6c5c Fix Cube transform. 2019-04-18 19:27:18 +03:00
Nikolai Kochetov
8718b7bb40 Added thread_group argument to ThreadPool. 2019-04-18 17:55:43 +03:00
Nikolai Kochetov
745beb6080 Fix rollup and cube transforms. 2019-04-18 15:43:13 +03:00
Nikolai Kochetov
e72d6eef1b Fix rollup and cube transforms. 2019-04-18 15:09:03 +03:00
Nikolai Kochetov
197afe2eea Fix totals. 2019-04-17 19:14:52 +03:00
Nikolai Kochetov
0ad1c1a9a2 Fix totals. 2019-04-17 18:43:01 +03:00
Nikolai Kochetov
d5f878dba3 Fix totals. 2019-04-17 18:35:22 +03:00
Nikolai Kochetov
349254cbcf Fix totals. 2019-04-17 18:13:08 +03:00