Kruglov Pavel
8bbf62508f
Merge branch 'master' into fix-kafka-protobuf
2023-02-10 18:32:25 +01:00
avogar
04cf144edc
Fix TSKV, update docs
2023-02-10 17:20:51 +00:00
avogar
d1efd02480
Extend setting input_format_null_as_default for more formats
2023-02-10 16:41:09 +00:00
avogar
deda940d87
Fix possible out of bounds error while reading LowCardinality(Nullable) in Arrow format
2023-02-10 12:57:47 +00:00
Geoff Genz
99c3ff53c5
Merge remote-tracking branch 'origin/master' into http_client_version
...
# Conflicts:
# src/Interpreters/Context.cpp
# src/Interpreters/Context.h
2023-02-10 04:35:53 -07:00
Geoff Genz
db982695fa
Simplify NativeOutputFormat constructors
2023-02-10 04:30:08 -07:00
Geoff Genz
7ed8ed0284
Add support for client_protocol_version sent with HTTP
2023-02-10 03:47:06 -07:00
flynn
db15634a01
fix conflict
2023-02-10 08:41:04 +00:00
Kruglov Pavel
c3c0356fdd
Merge branch 'master' into fix-kafka-protobuf
2023-02-09 13:04:55 +01:00
avogar
c3e8dd8984
Fix low cardinality case
2023-02-08 19:14:28 +00:00
Kruglov Pavel
4e2918cee3
Merge branch 'master' into parquet-fixed-binary
2023-02-08 12:31:13 +01:00
flynn
0dd8a61a8e
fix conflict
2023-02-06 03:25:12 +00:00
flynn
f89a6cf68d
Improve format JSONColumns when result is empty
2023-02-05 13:13:21 +00:00
Alexey Milovidov
97b6934ed6
Update ParquetBlockInputFormat.cpp
2023-02-02 02:42:21 +03:00
liuneng
17fc22a21e
add parquet max_block_size setting
2023-02-01 18:29:20 +08:00
liuneng
cda9b0beea
optimize parquet reader
2023-02-01 15:54:10 +08:00
Alexey Milovidov
075dfe9005
Merge pull request #45750 from ucasfl/arrow-duration
...
Arrow support duration type
2023-01-31 20:34:38 +03:00
flynn
ffddc0dcce
fix conflict
2023-01-31 10:28:58 +00:00
flynn
801d6db486
Arrow support duration type
2023-01-29 10:55:31 +00:00
flynn
9b517cdc76
fix conflict
2023-01-29 08:34:56 +00:00
Alexey Milovidov
9ad87f9917
Fix style and typo
2023-01-29 03:51:42 +01:00
Alexey Milovidov
54bb8b1ceb
Merge branch 'master' into fix-kafka-protobuf
2023-01-29 00:59:40 +03:00
avogar
0a99d421f5
Fix formats parser resetting, test processing bad messages in kafka
2023-01-27 13:22:50 +00:00
Alexander Tokmakov
d1baa7300c
reformat ParsingException
2023-01-24 23:21:29 +01:00
Alexander Tokmakov
dd57215934
Merge branch 'master' into exception_message_patterns4
2023-01-24 17:03:12 +01:00
Kruglov Pavel
23c12ac8ee
Merge branch 'master' into parquet-fixed-binary
2023-01-24 16:51:05 +01:00
Kruglov Pavel
689fbea759
Merge pull request #45478 from Avogar/fix-arrow-abort
...
Fix possible aborts in arrow lib
2023-01-24 16:37:44 +01:00
Alexander Tokmakov
c6910f39b9
fix
2023-01-24 01:11:58 +01:00
Kruglov Pavel
cd1cd904a7
Merge branch 'master' into tsv-csv-detect-header
2023-01-23 23:49:56 +01:00
Alexander Tokmakov
bb4c8e169f
check number of parameters in format string
2023-01-23 23:16:16 +01:00
Alexander Tokmakov
3f6594f4c6
forbid old ctor of Exception
2023-01-23 22:18:05 +01:00
Alexander Tokmakov
70d1adfe4b
Better formatting for exception messages ( #45449 )
...
* save format string for NetException
* format exceptions
* format exceptions 2
* format exceptions 3
* format exceptions 4
* format exceptions 5
* format exceptions 6
* fix
* format exceptions 7
* format exceptions 8
* Update MergeTreeIndexGin.cpp
* Update AggregateFunctionMap.cpp
* Update AggregateFunctionMap.cpp
* fix
2023-01-24 00:13:58 +03:00
Kruglov Pavel
478a552a0a
Merge branch 'master' into tsv-csv-detect-header
2023-01-23 21:47:17 +01:00
Kruglov Pavel
af2c1bac6a
Fix typo
2023-01-23 17:13:16 +01:00
Kruglov Pavel
01ddf326ac
Merge branch 'master' into parquet-fixed-binary
2023-01-23 15:31:45 +01:00
Kruglov Pavel
84200be7d2
Better comment
2023-01-23 15:31:07 +01:00
Anton Popov
f181254fb0
fix race in destructor of ParallelParsingInputFormat
2023-01-23 01:18:58 +00:00
avogar
86336940f8
Better comment
2023-01-20 16:41:59 +00:00
avogar
4432ee9927
Fix aborts in arrow lib
2023-01-20 16:40:33 +00:00
avogar
550a703fbc
Make a bit better
2023-01-20 14:58:39 +00:00
Kruglov Pavel
28ddcc2432
Merge branch 'master' into tsv-csv-detect-header
2023-01-20 15:08:38 +01:00
avogar
c34c0aa22e
Fix comments
2023-01-19 16:03:46 +00:00
Kruglov Pavel
9820beae68
Apply suggestions from code review
...
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2023-01-19 16:11:13 +01:00
Ilya Yatsishin
00962b7ad5
Merge pull request #45424 from Avogar/fix-json-import-nested
2023-01-19 10:31:40 +01:00
avogar
a8f20363f4
Fix JSON/BSONEachRow parsing with HTTP
2023-01-18 22:49:03 +00:00
flynn
4dcd3cc4f6
fix style
2023-01-18 08:46:06 +00:00
flynn
a8e1363151
implement storage iceberg
2023-01-18 03:43:56 +00:00
Kruglov Pavel
96bb99f864
Merge branch 'master' into tsv-csv-detect-header
2023-01-17 15:33:02 +01:00
Sema Checherinda
35431e91e3
Merge pull request #45276 from ucasfl/avro-fix
...
Fix some avro reading bugs
2023-01-17 12:48:44 +01:00
avogar
5bf4704e7a
Support FixedSizeBinary type in Parquet/Arrow
2023-01-16 21:01:31 +00:00
avogar
1c0941d72a
Add docs and examples
2023-01-16 16:46:41 +00:00
flynn
29eb30b49f
Fix some reading avro format bugs
...
fix
2023-01-14 18:05:26 +00:00
avogar
e2470dd670
Fix tests
2023-01-13 17:03:53 +00:00
avogar
b461935374
Better
2023-01-12 13:11:04 +00:00
Kruglov Pavel
05a11ff4a4
Merge branch 'master' into tsv-csv-detect-header
2023-01-12 12:35:18 +01:00
avogar
e4d774d906
Better naming
2023-01-11 22:57:14 +00:00
avogar
26cd56d113
Fix tests, make better
2023-01-11 22:52:15 +00:00
avogar
3b45863d15
Make better implementation, fix tests
2023-01-11 17:12:56 +00:00
avogar
6312b75f44
Fix style
2023-01-10 16:28:52 +00:00
avogar
615fe4cecb
Fix tests
2023-01-10 16:27:23 +00:00
Alexey Milovidov
1229a20fb3
Merge pull request #45047 from ClickHouse/fix-buffer-overflow
...
Fix buffer overflow in parser
2023-01-10 05:06:03 +03:00
Yakov Olkhovskiy
4f32f3b8cb
Merge pull request #44484 from bigo-sg/arrow_struct_field
...
Optimization for reading struct fields in parquet/orc files
2023-01-09 15:36:26 -05:00
Kseniia Sumarokova
119501f1d9
Merge pull request #44698 from Avogar/parquet-bool
...
Support Bool type in Arrow/Parquet/ORC
2023-01-09 12:56:28 +01:00
lgbo-ustc
b639bcabc0
some fixes
2023-01-09 18:13:00 +08:00
lgbo-ustc
f127b3a60a
update ArrowFieldIndexUtil
2023-01-09 18:13:00 +08:00
lgbo-ustc
a3bdfddc9d
support nested table
2023-01-09 18:13:00 +08:00
lgbo-ustc
4f3f781b85
fixed test case
2023-01-09 18:13:00 +08:00
lgbo-ustc
755f03db4e
fixed
2023-01-09 18:13:00 +08:00
lgbo-ustc
f6850d96cb
fixed missing columns
2023-01-09 18:13:00 +08:00
lgbo-ustc
4cf6beee27
fixed
2023-01-09 18:13:00 +08:00
lgbo-ustc
81e2832133
fixed
2023-01-09 18:13:00 +08:00
lgbo-ustc
77cea49cec
fixed including header failure
2023-01-09 18:13:00 +08:00
lgbo-ustc
8f8f6f966b
Optimization for reading struct fields in parquet/orc files
2023-01-09 18:13:00 +08:00
Alexey Milovidov
0d39d26a34
Don't fix parallel formatting
2023-01-09 06:15:20 +01:00
Alexey Milovidov
d331f0ce82
Fix buffer overflow in parser
2023-01-09 03:31:12 +01:00
avogar
ee72799121
Fix tests, make better
2023-01-06 20:46:43 +00:00
avogar
7fcdb08ec6
Detect header in CSV/TSV/CustomSeparated files automatically
2023-01-05 22:57:25 +00:00
Yakov Olkhovskiy
7a5a36cbed
Merge branch 'master' into refactoring-ip-types
2023-01-04 11:11:06 -05:00
Kruglov Pavel
b9bdf62bf3
Merge branch 'master' into parquet-bool
2023-01-04 14:49:41 +01:00
Kruglov Pavel
59263f3ae1
Merge pull request #44501 from Avogar/validate-types
...
Validate data types according to settings.
2023-01-04 14:48:09 +01:00
Kruglov Pavel
90ae405033
Merge pull request #44876 from Avogar/fix-perf-tests
...
Revert some changes from #42777 to fix performance tests
2023-01-04 14:27:17 +01:00
Kruglov Pavel
0c7d39ac7f
Merge pull request #44832 from ucasfl/row-number
...
Fix output_format_pretty_row_numbers does not preserve the counter across the blocks
2023-01-04 14:15:47 +01:00
Kruglov Pavel
4e261ab230
Fix JSONCompactEachRow
2023-01-03 21:16:38 +01:00
Kruglov Pavel
314d95fd71
Fix special build
2023-01-03 20:34:30 +01:00
avogar
28eb2dbd4c
Revert some changes from #42777
2023-01-03 18:53:03 +00:00
Alexey Milovidov
e855d3519a
Merge branch 'master' into refactoring-ip-types
2023-01-02 21:58:53 +03:00
Kruglov Pavel
4a7c399076
Merge branch 'master' into parquet-bool
2023-01-02 16:33:42 +01:00
Kruglov Pavel
0a43976977
Merge branch 'master' into validate-types
2023-01-02 16:10:14 +01:00
Kruglov Pavel
1c2dc05d6e
Merge pull request #44446 from Avogar/arrow-nullables
...
Respect setting settings.schema_inference_make_columns_nullable in Parquet/ORC/Arrow formats
2023-01-02 16:05:57 +01:00
Kruglov Pavel
966f57ef68
Merge pull request #42777 from Avogar/improve-streaming-engines
...
Refactor and Improve streaming engines Kafka/RabbitMQ/NATS and data formats
2023-01-02 15:59:06 +01:00
flynn
7780fae9db
fix
2023-01-02 12:38:51 +00:00
flynn
7b487dd923
fix
2023-01-02 12:37:43 +00:00
flynn
3a1dd045dd
Fix output_format_pretty_row_numbers does not preserve the counter across the blocks
2023-01-02 09:27:37 +00:00
Kruglov Pavel
8479615c48
Merge pull request #44684 from Avogar/avro-bool
...
Input/ouptut avro bool type as ClickHouse bool type
2022-12-30 17:56:36 +01:00
Kruglov Pavel
4982d132fb
Merge branch 'master' into validate-types
2022-12-30 17:52:13 +01:00
Nikolay Degterinsky
dfe93b5d82
Merge pull request #42284 from Algunenano/perf_experiment
...
Performance experiment
2022-12-30 03:14:22 +01:00
Kruglov Pavel
894726bd8f
Merge branch 'master' into improve-streaming-engines
2022-12-29 22:59:45 +01:00
avogar
a0db1dd1ea
Support Bool type in Arrow/Parquet/ORC
2022-12-28 22:58:28 +00:00
Raúl Marín
5de11979ce
Unify query elapsed time measurements ( #43455 )
...
* Unify query elapsed time reporting
* add-test: Make shell tests executable
* Add some tests around query elapsed time
* Style and ubsan
2022-12-28 21:01:41 +01:00
Raúl Marín
e915ce1e95
Merge remote-tracking branch 'blessed/master' into perf_experiment
2022-12-28 20:15:43 +01:00