Commit Graph

579 Commits

Author SHA1 Message Date
Andrew Onyshchuk
7d9a6130b6 Default to deflate if snappy is not enabled 2020-01-10 03:29:53 -06:00
Andrew Onyshchuk
6e26211758 Fix code style 2020-01-10 00:03:38 -06:00
oandrew
38ab600a08 Fix compilation errors 2020-01-08 22:22:49 -06:00
Andrew Onyshchuk
7320447f92 Add Avro formats
Add Avro file input/output formats
Add AvroConfluent input format (for Kafka)
2020-01-08 03:18:00 -06:00
Alexey Milovidov
9a7f9e846e Removed useless code from headers 2020-01-03 17:17:34 +03:00
Nikolai Kochetov
92baec6488 Fix MergingSorted 2020-01-02 23:07:07 +03:00
Alexey Milovidov
218ab1b25b Merge branch 'master' into better-priority-queue 2020-01-02 13:40:33 +03:00
Nikolai Kochetov
2398dc954c Fix SortingAggregatedTransform. 2019-12-27 15:46:39 +03:00
Maxim Ulanovskiy
32995e3ad5 cosmetic doc fixes 2019-12-26 18:59:38 +03:00
alexey-milovidov
af3c52d5fc
Merge pull request #8334 from maxulan/parquet_list_reading_fix
Parquet list reading fix
2019-12-26 17:33:30 +03:00
Nikolai Kochetov
3ccd33eeb8
Merge pull request #8362 from ClickHouse/processors-4.5
Affinity for processors pipeline. Fix integration tests.
2019-12-26 12:14:32 +03:00
Nikolai Kochetov
438ea5bc22
Remove context from formats (#8388)
* Remove Context from formats.
2019-12-25 22:17:41 +03:00
Nikolai Kochetov
5b2847fb90 Fix mysql_protocol integration tests. 2019-12-25 21:46:37 +03:00
Maxim Ulanovskiy
b98e85851a cosmetics 2019-12-25 07:47:53 +03:00
Maxim Ulanovskiy
d3b827272f fixed excessive var copy 2019-12-25 04:37:40 +03:00
Maxim Ulanovskiy
b43ea04548 Merge branch 'master' into parquet_list_reading_fix 2019-12-25 04:09:39 +03:00
Nikolai Kochetov
2148f09220 Disable affinity for apple and FreeBSD. 2019-12-24 20:00:43 +03:00
Nikolai Kochetov
e53b68d00f Fix apple build. 2019-12-24 16:55:28 +03:00
Nikolai Kochetov
6fbc202bb3 Try fix tests with processors. 2019-12-24 16:30:28 +03:00
Nikolai Kochetov
a82079ccc2 Set affinity for PipelineExecutor threads. 2019-12-23 19:55:11 +03:00
Maxim Ulanovskiy
e9021f6377 flatbuffers lib downloading replaced with contrib/flatbuffers 2019-12-23 09:51:35 +03:00
Alexey Milovidov
8613b90d84 Using SortingHeap in MergingSortedTransform 2019-12-22 17:22:42 +03:00
Alexey Milovidov
53606c6e8f Using optimization of single column sort in Processors 2019-12-22 12:55:43 +03:00
maxim
558324e773 fixed reading of parquet files containing columns of type list 2019-12-22 10:15:51 +03:00
Alexey Milovidov
9f3afed5ff Optimization of priority queue 2019-12-22 03:19:07 +03:00
Alexey Milovidov
eb9d6983c8 Added optimization for Processors; added reserve. 2019-12-22 01:16:39 +03:00
kreuzerkrieg
9612bb0e79 More GCC warnings 2019-12-16 23:19:50 +02:00
Nikolai Kochetov
a73eb4292b Functions refactor part 1. 2019-12-09 00:06:37 +03:00
Vitaly Baranov
0e21673271 Rework Quota based on IAccessEntity. 2019-12-05 21:03:57 +03:00
Nikolai Kochetov
86ff01d3aa
Merge pull request #7988 from ClickHouse/processors-4.4
Better updated ports check in processors
2019-12-05 13:54:40 +03:00
Mikhail Korotov
88e37020e0 JSONCompactEachRow and JSONCompactEachRowWithNamesAndTypes (#7841)
* Research commit

* Created Output EachRow Format

* Fixed bugs

* Created output format JSONCompactEachRowWithNamesAndTypes without totals

* Fixed bugs

* Fixed bugs

* Totals for JSONCompactEachRowWithNamesAndTypes

* Deleted needless debug

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Tests added

* Input Format for JSONCompactEachRow

* Fixed bugs for JSONCompactEachRow Input format

* Fixed bugs for JSONCompactEachRowRowInputFormat.cpp

* JSONCompactEachRow and JSONCompactEachRowWithNamesAndTypes united

* Created input format for both formats

* fixed bugs

* fixed bugs

* Working commit

* Working commit

* Working commit

* Working commit

* tests

* Working commit

* Final tests

* Performance tests added
2019-12-05 13:13:40 +03:00
Nikolai Kochetov
3ac103f21c Fix the number of rows in MergingSortedTransform. 2019-12-04 16:45:42 +03:00
Nikolai Kochetov
901a6b4627 Style fix. 2019-12-04 12:56:08 +03:00
Nikolai Kochetov
efe1616fda Fix optimization for 'WHERE column in (empty set)' case. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
81b5b17828 Fix pvs studio varning. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
fa98587c19 Init update_info in port. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
8524a75580 Check once if filter column can be always false in filter transform. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
9465183408 Add info about affected ports after prepare. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
4f2f474fde Add info about affected ports to IProcessor::prepare 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
31d5c66867 Fix num rows in IRowInputFormat 2019-12-03 16:43:40 +03:00
Nikolai Kochetov
448d755a3b Add forgotten rows number check to chunk constructor. 2019-12-03 14:56:51 +03:00
alexey-milovidov
87adf355e8
Merge pull request #7935 from filimonov/kafka_perf
[wip] attempt to improve kafka parsing performance
2019-12-03 03:52:40 +03:00
alexey-milovidov
6fdfdcfd4e
Update ValuesBlockInputFormat.cpp 2019-12-03 03:51:10 +03:00
alexey-milovidov
4d65ad4034
Update ValuesBlockInputFormat.cpp 2019-12-03 03:50:50 +03:00
alexey-milovidov
4a69082fbb
Update ProtobufRowInputFormat.h 2019-12-03 03:49:50 +03:00
alexey-milovidov
a7521b97f9
Update IInputFormat.cpp 2019-12-03 03:49:05 +03:00
Yuriy
211e1364f6 fixed style 2019-12-02 06:12:27 +03:00
Yuriy
3677d1dcfa implemented ProtocolText 2019-12-01 15:17:49 +03:00
Mikhail Filimonov
07722dfa93 more progress - cleanup internal cycles 2019-11-29 00:06:03 +01:00
Mikhail Filimonov
6217cb51f6 Get rid of InputStream layer for Kafka, use InputStream directly. Reopening port during reset. 2019-11-28 17:43:06 +01:00