taiyang-li
4aeadf3967
fix build error
2021-12-01 14:13:48 +08:00
taiyang-li
d213500a3e
remove blank at end of line
2021-11-30 18:23:24 +08:00
taiyang-li
c6abe60bcc
add new input format HiveTextRowInputFormat
2021-11-30 18:06:26 +08:00
taiyang-li
440fa9b69c
implement getMissingValues for ORC/Parquet/Arrow
2021-11-30 15:44:59 +08:00
taiyang-li
cacf516e3e
calculate column value by default expression & apply defaults_for_omitted_fields_ in ArrowColumnToCHColumn
2021-11-30 14:52:26 +08:00
taiyang-li
ad6ba24efd
fix ArrowColumnToCHColumn
2021-11-30 10:49:57 +08:00
taiyang-li
6922f09ea3
reuse seekable read buffer with size
2021-11-29 20:19:36 +08:00
taiyang-li
d35e2a1c83
Merge branch 'master' into hive_table
2021-11-26 11:44:50 +08:00
Kruglov Pavel
5d1520be72
Merge pull request #31736 from Avogar/fix-json-with-progress
...
Fix race in JSONEachRowWithProgress output format
2021-11-25 13:58:41 +03:00
taiyang-li
72f60cceb9
Merge branch 'master' into hive_table
2021-11-25 17:33:26 +08:00
alesapin
fe7f21acf9
Merge pull request #31697 from ClickHouse/fix_31686
...
Fix parsing of domain data types
2021-11-25 11:31:41 +03:00
Kseniia Sumarokova
93cf66df12
Merge pull request #30936 from kssenii/seekable-read-buffers
...
Reduce memory usage for some formats when reading with s3/url/hdfs
2021-11-25 11:19:24 +03:00
avogar
e4ba685d15
Fix race in JSONEachRowWithProgressRowOutputFormat
2021-11-24 22:29:43 +03:00
Alexander Tokmakov
e5972e6f71
fix
2021-11-24 15:44:04 +03:00
taiyang-li
89dcef69d5
merge master
2021-11-24 14:38:04 +08:00
lgbo
996d7125c0
Merge branch 'master' into hive_table
2021-11-23 10:19:02 +08:00
mergify[bot]
a7ba3e23a0
Merge branch 'master' into fix-write-buffers
2021-11-22 11:24:27 +00:00
Kruglov Pavel
814a36ba69
Merge pull request #31434 from Avogar/custom-with-names-and-types
...
Add formats CustomSeparatedWithNames/WithNamesAndTypes
2021-11-22 13:24:00 +03:00
alexey-milovidov
faae69f631
Merge pull request #31534 from aiven/kmichel-fix-json-colum-name-encoding
...
Fix invalid JSON in column names
2021-11-21 11:34:33 +03:00
Kruglov Pavel
d9c1a0c8ec
Merge branch 'master' into fix-write-buffers
2021-11-20 17:48:24 +03:00
Azat Khuzhin
6aa94ae032
Fix MySQLWire format (in case of multiple writes)
...
In case of multiple writes File() engine will set doNotWritePrefix(),
and this will avoid serializations initilization, move this to do this
always.
Fixes : #31004
2021-11-20 15:26:21 +03:00
kssenii
ff969b4605
Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers
2021-11-20 15:03:13 +03:00
Kevin Michel
edbeeaf6ec
Fix invalid JSON in column names
...
If the column name contains invalid UTF-8 sequences
and the output data types are all considered safe,
then the output will not be sanitized and the generated
JSON will be invalid.
A minimal reproduction case is :
`SELECT length('\x80') FORMAT JSONCompact`
where we auto-generate a non-UTF-8 column name with only
integer outputs, whereas :
`SELECT '\x80' FORMAT JSONCompact`
would be sanitized because the column type is String and
will trigger UTF-8 sanitization over the entire document.
2021-11-20 12:35:41 +01:00
Kruglov Pavel
fdd1f53d3a
Update CustomSeparatedRowOutputFormat.h
2021-11-19 16:52:48 +03:00
Kruglov Pavel
3070bf1e4d
Update CustomSeparatedRowOutputFormat.cpp
2021-11-19 16:52:31 +03:00
Kruglov Pavel
eb1cc834dc
Merge branch 'master' into custom-with-names-and-types
2021-11-19 16:51:25 +03:00
taiyang-li
e8644807fe
merge master and solve conflict
2021-11-19 15:01:58 +08:00
avogar
1ebcbf4748
Fix style
2021-11-16 17:10:30 +03:00
Kruglov Pavel
be7a358f17
Fix
2021-11-16 17:10:30 +03:00
Kruglov Pavel
4f5e731513
Try fix tests
2021-11-16 17:10:30 +03:00
avogar
8e9783388b
Add formats CustomSeparatedWithNames/WithNamesAndTypes
2021-11-16 17:10:30 +03:00
avogar
73d1918410
tmp
2021-11-16 17:10:30 +03:00
kssenii
f4ffedd5f3
Better
2021-11-15 10:23:35 +03:00
avogar
e5661b9b62
Minor change
2021-11-11 21:09:21 +03:00
avogar
c521a9131a
Small refactoring of WriteBiffer-s
2021-11-11 02:11:18 +03:00
taiyang-li
b6ac5442e2
fix duplicated header
2021-11-05 20:32:17 +08:00
taiyang-li
36ca0b296b
implement hive table engine
2021-11-05 19:55:30 +08:00
avogar
2dd4393ca1
Small refactoring in formats
2021-11-03 20:07:05 +03:00
kssenii
ec11179f91
Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers
2021-11-03 14:33:31 +03:00
kssenii
45ea820297
Reduce memory usage for some formats
2021-11-03 14:30:03 +03:00
Kruglov Pavel
901ebcede6
Merge pull request #30351 from arenadata/ADQM-335
...
output_format_avro_rows_in_file
2021-11-02 12:25:27 +03:00
Ilya Golshtein
8efa1743cf
output_format_avro_rows_in_file fix and test for _timestamp
2021-11-01 13:09:18 +03:00
Kruglov Pavel
7d4f211d5b
Merge branch 'master' into tsv-csv
2021-10-29 16:38:06 +03:00
Alexey Milovidov
8b4a6a2416
Remove cruft
2021-10-28 02:10:39 +03:00
avogar
b4aae86fff
Add comments, update docs
2021-10-27 22:16:48 +03:00
Kruglov Pavel
0715566cc0
Merge branch 'master' into tsv-csv
2021-10-27 17:52:49 +03:00
Ilya Golshtein
82f33151e7
output_format_avro_rows_in_file fixes per code review
2021-10-21 02:53:39 +03:00
Anton Popov
6b34398e9c
support VALUES format in async inserts
2021-10-20 17:20:58 +03:00
avogar
872cca550a
Make better
2021-10-20 15:47:20 +03:00
mergify[bot]
0a4360c43e
Merge branch 'master' into tsv-csv
2021-10-20 11:57:06 +00:00
