175 Commits

Author	SHA1	Message	Date
avogar	557edbd172	Add some improvements and fixes in schema inference	2022-03-24 12:54:12 +00:00
shuchaome	46cb4483a6	Optimise by lowering schema on the beginning. Add a functional test.	2022-03-11 14:34:46 +08:00
shuchaome	56795b831d	add setting to lower column case when reading parquet/orc file	2022-03-09 16:07:02 +08:00
Maksim Kita	b1a956c5f1	clang-tidy check performance-move-const-arg fix	2022-03-02 18:15:27 +00:00
avogar	77b42bb9ff	Support UUID in MsgPack format	2022-02-07 17:11:44 +03:00
Kruglov Pavel	7873b4475f	Merge branch 'master' into autodetect-format	2022-01-25 10:56:52 +03:00
avogar	a6740d2f9a	Detect format and schema for stdin in clickhouse-local	2022-01-25 10:25:37 +03:00
avogar	1f49acc164	Better naming	2022-01-24 16:28:36 +03:00
Kruglov Pavel	a7df9cd53a	Merge branch 'master' into formats-with-suffixes	2022-01-14 21:03:49 +03:00
avogar	253035a5df	Fix	2022-01-14 19:17:06 +03:00
Kruglov Pavel	d2e9f37bee	Merge branch 'master' into format-by-extention	2022-01-14 18:36:23 +03:00
avogar	89a181bd19	Make better	2022-01-14 18:16:18 +03:00
avogar	817a314263	Fix tests and style	2022-01-14 17:46:24 +03:00
Kruglov Pavel	5a908e8edd	Merge branch 'master' into formats-with-suffixes	2022-01-14 16:45:20 +03:00
Kseniia Sumarokova	5da673c3a5	Merge pull request #31104 from bigo-sg/hive_table ... Implement hive table engine	2022-01-14 09:39:17 +03:00
avogar	2d7b1bfa5e	Detect format in S3/HDFS/URL table engines	2022-01-13 16:14:18 +03:00
Kruglov Pavel	305d58a762	Merge pull request #33524 from Avogar/stacktrace-in-client ... Don't print exception twice in client in case of exception in parallel parsing	2022-01-13 15:50:42 +03:00
avogar	8390e9ad60	Detect format by file name in file/hdfs/s3/url table functions	2022-01-12 18:29:31 +03:00
taiyang-li	66813a3aa9	merge master	2022-01-12 16:56:29 +08:00
avogar	0ae0aa712b	Don't print exception twice in client in case of exception in parallel parsing	2022-01-11 18:37:07 +03:00
zhongyuankai	99279c1443	INTO OUTFILE / FROM INFILE: autodetect FORMAT by file extension	2022-01-11 21:26:14 +08:00
zhongyuankai	878e44eb97	auto format by file extension	2022-01-08 21:47:14 +08:00
taiyang-li	1e102bc1b2	merge master	2022-01-01 09:01:06 +08:00
alesapin	16c36d72b1	Merge pull request #33296 from ClickHouse/fix_clang_tidy_3 ... Fix clang tidy 3	2021-12-29 22:43:42 +03:00
avogar	97788b9c21	Allow to create new files on insert for File/S3/HDFS engines	2021-12-29 21:19:13 +03:00
Kruglov Pavel	489a30859f	Merge pull request #32455 from Avogar/schema-inference ... Automatic schema inference for input formats	2021-12-29 21:03:48 +03:00
alesapin	34145c47da	Fix clang tidy	2021-12-29 18:36:42 +03:00
avogar	8112a71233	Implement schema inference for most input formats	2021-12-29 12:18:56 +03:00
taiyang-li	9036b18c2f	merge master	2021-12-27 15:12:48 +08:00
Raúl Marín	cb22091b33	Merge remote-tracking branch 'blessed/master' into kill_scalar_github	2021-12-23 13:59:33 +01:00
Raúl Marín	9bb88c26d8	Add existing progress to the record of the output format progress	2021-12-22 23:14:23 +01:00
taiyang-li	2597925724	merge master	2021-12-21 15:55:39 +08:00
avogar	ba6a513db0	Fix tuple output in CSV format	2021-12-20 19:27:09 +03:00
kreuzerkrieg	f06c37d206	Stop reading incomplete stripes and skip rows.	2021-12-19 18:41:32 +02:00
李扬	8675086104	Merge branch 'master' into hive_table	2021-12-12 09:01:46 -06:00
Kseniia Sumarokova	926fd568c7	Merge pull request #32113 from FrankChen021/url_http_header ... Set Content-Type in HTTP packets issued from URL engine	2021-12-07 08:52:36 +03:00
Kseniia Sumarokova	eab6f0ba49	Update FormatFactory.cpp	2021-12-06 23:35:29 +03:00
frank chen	c319b6fa32	Fix style ... Signed-off-by: frank chen <frank.chen021@outlook.com>	2021-12-03 22:09:04 +08:00
frank chen	898db5b468	Resolve review comments ... Signed-off-by: frank chen <frank.chen021@outlook.com>	2021-12-03 19:47:05 +08:00
taiyang-li	9ec8272186	refactor hive text input format	2021-12-02 16:14:25 +08:00
mergify[bot]	8d5460b469	Merge branch 'master' into feature-support-bool-type	2021-11-29 11:50:18 +00:00
MaxWk	f17d5b02e4	use bool representation	2021-11-19 14:30:22 +08:00
MaxWk	d42a454837	support some bool format	2021-11-11 16:01:32 +08:00
kssenii	ec11179f91	Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers	2021-11-03 14:33:31 +03:00
kssenii	45ea820297	Reduce memory usage for some formats	2021-11-03 14:30:03 +03:00
Kruglov Pavel	327a34e9da	Merge pull request #30497 from Avogar/null-deserialization ... Add custom null representation support for TSV/CSV input formats, fix Nullable(String) deserializing in some formats	2021-11-03 11:30:25 +03:00
Kruglov Pavel	901ebcede6	Merge pull request #30351 from arenadata/ADQM-335 ... output_format_avro_rows_in_file	2021-11-02 12:25:27 +03:00
Kruglov Pavel	1f8535c02b	Merge branch 'master' into null-deserialization	2021-11-02 12:15:21 +03:00
avogar	d1ef96a5ef	Add test, avoid unnecessary allocations, use PeekableReadBuffer only in corner case	2021-10-27 17:29:15 +03:00
avogar	d5c5a3213b	Add custom null representation support for TSV/CSV input formats, fix bugs in deserializing NULLs in some cases	2021-10-21 16:52:27 +03:00