Commit Graph

721 Commits

Author SHA1 Message Date
Nikolai Kochetov
be0bf9e6f6 Added more comments. 2020-01-24 20:04:41 +03:00
chertus
dbb42e07d8 rename function 2020-01-24 14:19:34 +03:00
Nikolai Kochetov
d161799b57 Merge branch 'master' into fix-null-format-for-processors 2020-01-24 10:38:19 +03:00
Nikolai Kochetov
b55ae23bb9
Merge pull request #8797 from ClickHouse/fix-null-format-for-processors-2
Skip blocks for Null format with processors.
2020-01-24 10:34:13 +03:00
alexey-milovidov
528d231a6b
Merge pull request #8750 from azat/temporary_data_configuration
Multiple paths (disks/volumes) for storing temporary data support
2020-01-24 06:21:52 +03:00
Azat Khuzhin
88bfb788a9 Add ability to use multiple disks/volumes for temporary data
This patch adds <tmp_policy> config directive, that will define the
policy to use for storing temporary files, if it is not set (default)
the <tmp_path> will be used.

Also tmp_policy has some limitations:
- move_factor              is ignored
- keep_free_space_bytes    is ignored
- max_data_part_size_bytes is ignored
- must have exactly one volume
2020-01-23 20:31:01 +03:00
Nikolai Kochetov
405f9f0696 Fix LazyOutput. 2020-01-23 17:58:50 +03:00
Nikolai Kochetov
b6a819c5d8 Fix ConvertingAggregatedToChunksTransform. 2020-01-23 14:45:12 +03:00
Nikolai Kochetov
bceb084512 Fix ConvertingAggregatedToChunksTransform. 2020-01-23 14:44:43 +03:00
Nikolai Kochetov
8839defb63 Fix ConvertingAggregatedToChunksTransform. 2020-01-23 14:39:42 +03:00
Nikolai Kochetov
f431b10e38 Update TCPHandler. 2020-01-23 13:04:18 +03:00
Alexey Milovidov
d853cffe61 Returned back DateTime64 2020-01-23 05:44:22 +03:00
Alexey Milovidov
fb89ffdbb3 Added comments 2020-01-23 05:12:11 +03:00
Alexey Milovidov
35726ac2dd Fixed error in Avro format 2020-01-23 05:03:53 +03:00
Alexey Milovidov
a75ce4477b Fixed error in Avro format 2020-01-23 05:01:58 +03:00
Alexey Milovidov
9f0230d4ba Addition to prev. revision 2020-01-23 04:09:17 +03:00
Alexey Milovidov
fde33ddc47 Addition to prev. revision 2020-01-23 04:06:53 +03:00
Alexey Milovidov
39565eb0b0 Addition to prev. revision 2020-01-23 04:03:32 +03:00
Alexey Milovidov
0c18bcf415 Addition to prev. revision 2020-01-23 03:41:37 +03:00
Alexey Milovidov
b213f08f1c Added type conversions in AvroInputFormat 2020-01-23 03:04:50 +03:00
Alexey Milovidov
12bd78ecf8 Merge branch 'master' into oandrew-avro 2020-01-23 02:10:38 +03:00
chertus
d0b29b17fd minor change 2020-01-22 15:23:33 +03:00
chertus
d0a8faef5b better InflatingExpressionTransform 2020-01-22 10:46:14 +03:00
chertus
cc61fb9408 Merge branch 'master' into joins 2020-01-21 22:23:58 +03:00
chertus
97517075c2 fix pmj with processors 2020-01-21 22:20:15 +03:00
Nikolai Kochetov
c28e224e24
Merge pull request #8735 from ClickHouse/processors-5.12
Processors 5.12
2020-01-21 11:51:07 +03:00
Nikolai Kochetov
ccb124ebdf Update SortingTransform. 2020-01-20 19:48:15 +03:00
chertus
0669eff031 version with processors 2020-01-20 17:17:55 +03:00
Alexey Milovidov
40e35c36e7 Minor modifications 2020-01-19 20:02:29 +03:00
Nikolai Kochetov
4523f9b2f9
Update ResizeProcessor.cpp
remove comment
2020-01-19 10:11:21 +03:00
Alexey Milovidov
b5ff5341d5 Support more types for output 2020-01-19 04:22:27 +03:00
Alexey Milovidov
ae185a24d2 Disable AvroConfluent 2020-01-19 00:45:16 +03:00
Alexey Milovidov
d732f854b7 Added timeouts for schema request 2020-01-19 00:42:51 +03:00
Alexey Milovidov
3c7df7ca31 Minor modifications 2020-01-18 23:42:50 +03:00
Alexey Milovidov
216b39a30d Minor changes for consistency 2020-01-18 23:15:49 +03:00
Alexey Milovidov
ac46498f60 Minor modification 2020-01-18 23:12:58 +03:00
Alexey Milovidov
f0b4fcee1f Minor modifications 2020-01-18 23:10:32 +03:00
Alexey Milovidov
e6b407a961 Added TODO 2020-01-18 22:34:09 +03:00
Alexey Milovidov
997ea7ed53 Fixed error 2020-01-18 22:29:53 +03:00
Alexey Milovidov
76e04b9843 Merge branch 'avro' of https://github.com/oandrew/ClickHouse into oandrew-avro 2020-01-18 21:23:55 +03:00
Nikolai Kochetov
0fcb36ac7c Drop outputs in StrictResizeProcessor. 2020-01-18 14:39:48 +03:00
Nikolai Kochetov
61594edcee Fix StrictResize processor. 2020-01-17 20:04:37 +03:00
Nikolai Kochetov
61e69c06d2 Fix MergingSortedTransform 2020-01-16 18:52:52 +03:00
Nikolai Kochetov
f6b9d320a9 Updates in AggregatingTransform 2020-01-16 15:50:04 +03:00
Nikolai Kochetov
5aa503beb3 Updates in AggregatingTransform and MergingSortedTransform. 2020-01-16 13:45:34 +03:00
Nikolai Kochetov
4b86ef22b5 Fix PipelineExecutor. 2020-01-15 21:32:19 +03:00
Nikolai Kochetov
5f5753941c Fix ports updating in PipelineExecutor. 2020-01-15 21:30:08 +03:00
Nikolai Kochetov
ee3e7c1d5f Update PipelineExecutor. 2020-01-15 12:25:38 +03:00
Nikolai Kochetov
eadf388cb0 Update ISimpleTransform. 2020-01-14 22:14:10 +03:00
Nikolai Kochetov
77e04daaca Update ISimpleTransform. 2020-01-14 20:21:59 +03:00
Maxim Smirnov
ee463403d5 Initial commit to fix IParser::Pos.max_depth issue 2020-01-14 13:11:01 +02:00
Nikolai Kochetov
7dd1b5c5a2 Update Resize processor 2020-01-14 12:27:58 +03:00
Nikolai Kochetov
d22f792196 Update Resize processor 2020-01-14 12:15:34 +03:00
Nikolai Kochetov
edc28c3dd2 Update ResizeProcessor. 2020-01-13 15:04:02 +03:00
Nikolai Kochetov
5b4a9dc82c Update ResizeProcessor. 2020-01-13 13:47:07 +03:00
Nikolai Kochetov
b3c18638dc Update ResizeProcessor. 2020-01-13 13:32:55 +03:00
Nikolai Kochetov
dffbd21cba Add pull with not_needed flag to output port. 2020-01-13 12:56:42 +03:00
Nikolai Kochetov
880e999e83 Add pull with not_needed flag to output port. 2020-01-13 12:56:35 +03:00
Nikolai Kochetov
c2a054ac70 Add cancell flag to MergingAggrgated. 2020-01-13 12:56:21 +03:00
Andrew Onyshchuk
9da0df4f03 Add codec and sync interval settings 2020-01-11 01:01:57 -06:00
Andrew Onyshchuk
bfc610275d fix bad cast 2020-01-11 01:01:51 -06:00
Andrew Onyshchuk
4c13317fba refactor avro cmake 2020-01-10 16:47:41 -06:00
Alexander Burmak
26511b7978 Added DiskMemory and tests 2020-01-11 00:43:42 +03:00
Andrew Onyshchuk
7d9a6130b6 Default to deflate if snappy is not enabled 2020-01-10 03:29:53 -06:00
Andrew Onyshchuk
6e26211758 Fix code style 2020-01-10 00:03:38 -06:00
Nikolai Kochetov
0b2d238af9 Fix DelayedPortsProcessor. 2020-01-09 15:24:56 +03:00
Nikolai Kochetov
39b91584fd Simplifu delayed stream in QueryPipeline. 2020-01-09 14:52:34 +03:00
Nikolai Kochetov
c637396791 Added DelayedPortsProcessor. 2020-01-09 13:37:27 +03:00
Nikolai Kochetov
5ed2a93748 Allow multiple edges for processors pipeline. 2020-01-09 12:03:08 +03:00
Nikolai Kochetov
874d01e8b7
Merge pull request #8423 from ClickHouse/processors-5.7
Processors 5.7
2020-01-09 11:53:22 +03:00
oandrew
38ab600a08 Fix compilation errors 2020-01-08 22:22:49 -06:00
Andrew Onyshchuk
7320447f92 Add Avro formats
Add Avro file input/output formats
Add AvroConfluent input format (for Kafka)
2020-01-08 03:18:00 -06:00
Nikolai Kochetov
65901f03b8 Update ConvertingAggregatedToChunksTransform transform. 2020-01-06 19:34:51 +03:00
Nikolai Kochetov
7fc8b59d49 Update ConvertingAggregatedToChunksTransform transform. 2020-01-06 19:26:20 +03:00
Alexey Milovidov
9a7f9e846e Removed useless code from headers 2020-01-03 17:17:34 +03:00
Nikolai Kochetov
833499cfb6 Merged with master. 2020-01-03 15:34:17 +03:00
Nikolai Kochetov
92baec6488 Fix MergingSorted 2020-01-02 23:07:07 +03:00
Alexey Milovidov
218ab1b25b Merge branch 'master' into better-priority-queue 2020-01-02 13:40:33 +03:00
Nikolai Kochetov
85e1c88d12 Disable affinity. 2020-01-02 09:27:53 +03:00
Nikolai Kochetov
cc67ab1107 Enable affinity only for multiple threads. 2020-01-01 21:42:15 +03:00
Nikolai Kochetov
faf118fb15 Do not create extra thread in PipelineExecutor if num_threads is 1. 2020-01-01 14:18:24 +03:00
Nikolai Kochetov
65a00150b2 Update num threads in processors. 2020-01-01 13:42:46 +03:00
Nikolai Kochetov
04193460aa Try disable affinity. 2019-12-31 12:10:44 +03:00
Nikolai Kochetov
42f86fe4f5 Better exceptions handling in PipelineExecutor. 2019-12-30 23:09:37 +03:00
Nikolai Kochetov
96a732ac02 Better exceptions handling in PipelineExecutor. 2019-12-30 22:45:27 +03:00
Nikolai Kochetov
1138162dc8 Better exceptions handling in PipelineExecutor. 2019-12-30 21:29:24 +03:00
Nikolai Kochetov
1284d2eb4e Try enable affinity 2019-12-30 15:26:14 +03:00
Nikolai Kochetov
84072fe977 Try disable affinity. 2019-12-29 23:09:11 +03:00
Nikolai Kochetov
d3060f42e0 Remove commented code. 2019-12-29 10:30:26 +03:00
Nikolai Kochetov
755cd1bea2 Disable logging in processors pipeline. 2019-12-28 21:42:07 +03:00
Nikolai Kochetov
05fe9ef179 Add sort improvement to processors. 2019-12-27 21:59:50 +03:00
Nikolai Kochetov
2398dc954c Fix SortingAggregatedTransform. 2019-12-27 15:46:39 +03:00
Nikolai Kochetov
330676737a Disable quota . 2019-12-27 13:59:43 +03:00
Nikolai Kochetov
0034afdf10 Better task queue for PipelineExecutor. 2019-12-26 21:23:31 +03:00
Nikolai Kochetov
5a5d15c095 Enable quota for more processors. 2019-12-26 19:52:15 +03:00
Nikolai Kochetov
bb19e22bd7 Add threads quota for processors. 2019-12-26 19:34:08 +03:00
Nikolai Kochetov
9d9ab833b7 Add threads quota for processors. 2019-12-26 19:15:31 +03:00
Maxim Ulanovskiy
32995e3ad5 cosmetic doc fixes 2019-12-26 18:59:38 +03:00
Nikolai Kochetov
fbbab2486f Update pipelineExecutor 2019-12-26 17:47:48 +03:00
alexey-milovidov
af3c52d5fc
Merge pull request #8334 from maxulan/parquet_list_reading_fix
Parquet list reading fix
2019-12-26 17:33:30 +03:00