379 Commits

Author	SHA1	Message	Date
Dmitry Kardymon	ab4142eb8f	Merge remote-tracking branch 'clickhouse/master' into ADQM-870	2023-07-04 08:23:31 +03:00
avogar	34bf0284ad	Add RowBinaryWithDefaults format	2023-06-30 16:18:30 +00:00
Nikifor Seriakov	5a39960e03	Update docs/en/interfaces/formats.md ... Fixed RawBLOB comparison lists formatting.	2023-06-27 21:32:39 +04:00
Dmitry Kardymon	dbced8a30c	Merge remote-tracking branch 'origin/master' into ADQM-870	2023-06-22 19:49:06 +00:00
Dan Roscigno	c856c4a7df	Merge branch 'master' into Docs/ip_addresses	2023-06-21 17:26:27 -04:00
Dmitry Kardymon	dd43a186ad	Minor edit docs / add int256 test	2023-06-19 09:51:29 +00:00
Dmitry Kardymon	30bea857fd	Merge remote-tracking branch 'origin/master' into ADQM-870	2023-06-19 07:19:07 +00:00
Kruglov Pavel	38ed92c8f4	Update Avro format docs	2023-06-16 15:53:29 +02:00
Dmitry Kardymon	806176d88e	Add input_format_csv_missing_as_default setting and tests	2023-06-15 11:23:08 +00:00
KevinyhZou	953f40aa3b	Merge branch 'master' into bug_fix_csv_parse_by_tab_delimiter	2023-06-15 10:25:19 +08:00
Denny Crane	fd01cb7bec	Merge branch 'master' into Docs/ip_addresses	2023-06-14 17:38:48 -03:00
Dmitry Kardymon	a91fc3ddb3	Add docs/ add more cases in test	2023-06-14 16:44:31 +00:00
kevinyhzou	f3b99156ac	review fix	2023-06-14 10:48:21 +08:00
kevinyhzou	911f8ad8dc	use whitespace or tab as field delimiter	2023-06-12 11:57:52 +08:00
Kruglov Pavel	1baa6404e6	Merge branch 'master' into skip-trailing-empty-lines	2023-06-06 19:39:34 +02:00
avogar	df50833b70	Allow to skip trailing empty lines in CSV/TSV/CustomeSeparated formats	2023-06-06 17:33:05 +00:00
Dan Roscigno	f691fe787b	Merge branch 'master' into Docs/ip_addresses	2023-06-06 09:12:31 -04:00
Denny Crane	2cc457141e	clean documentation of ip4 ip6 from domains	2023-06-04 15:32:54 -03:00
Alexey Gerasimchuck	75791d7a63	Added input_format_csv_trim_whitespaces parameter	2023-05-25 07:51:32 +00:00
Alexey Milovidov	2370f46e70	Update formats.md	2023-04-22 21:36:58 +03:00
robot-ch-test-poll1	f466c89621	Merge pull request #48911 from Avogar/parquet-metadata-format ... Add ParquetMetadata input format to read Parquet file metadata	2023-04-21 03:46:26 +02:00
Robert Schulze	c406663442	Docs: Replace annoying three spaces in enumerations by a single space	2023-04-19 15:56:55 +00:00
avogar	7a67951f64	Add more fields, fix style	2023-04-18 17:59:01 +00:00
avogar	2518ee4988	Remove deleted line	2023-04-18 16:58:43 +00:00
avogar	f7f609dfb9	Better	2023-04-18 16:57:55 +00:00
avogar	b277a5c943	Add ParquetMetadata input format to read Parquet file metadata	2023-04-18 16:46:26 +00:00
Kruglov Pavel	e9784b9444	Bring back accidentally deleted line	2023-04-18 16:06:21 +02:00
Kruglov Pavel	8aade2d39e	Fix typo	2023-04-18 15:56:41 +02:00
avogar	e47bb5cc72	Add docs	2023-04-18 13:35:28 +00:00
Sergei Trifonov	cc5a4c3853	Merge pull request #48568 from ClickHouse/serxa-patch-3 ... Update formats.md	2023-04-10 19:07:08 +02:00
Thom O'Connor	8b0adf58e5	Update formats.md ... Including an Avro example with DESCRIBE url in S3	2023-04-10 10:17:43 -06:00
Sergei Trifonov	3bc5c6423b	Update formats.md	2023-04-09 16:54:21 +02:00
Kruglov Pavel	fb33d6bedb	Merge pull request #48126 from Avogar/orc-arrow-parquet-more-types ... Support more ClickHouse types in ORC/Arrow/Parquet formats	2023-04-06 13:32:46 +02:00
Kruglov Pavel	9331c6c260	Merge pull request #48122 from Avogar/bson-more-types ... Support Enum output/input in BSONEachRow, allow all map key types and avoid extra calculations	2023-04-05 18:26:19 +02:00
Kruglov Pavel	8bd997d680	Update docs/en/interfaces/formats.md ... Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>	2023-04-05 11:57:41 +02:00
Kruglov Pavel	8d6b709f1a	Merge pull request #48257 from Avogar/capnp-more-types ... Support more types in CapnProto format, allow integer conversions	2023-04-05 11:56:46 +02:00
Yakov Olkhovskiy	e1e508f8ec	Merge branch 'master' into bson-more-types	2023-04-03 17:21:50 -04:00
Kruglov Pavel	e2c3c3accc	Merge branch 'master' into orc-arrow-parquet-more-types	2023-04-03 18:33:20 +02:00
Kruglov Pavel	cef4a5b29c	Fix docs	2023-03-30 22:07:57 +02:00
Kruglov Pavel	a3908b54c1	Merge pull request #48124 from Avogar/msgpack-more-types ... Support more ClickHouse types in MsgPack format	2023-03-30 22:03:47 +02:00
Kruglov Pavel	d096da0cfd	Merge branch 'master' into bson-more-types	2023-03-30 21:18:10 +02:00
avogar	35937adcaa	Support more types in CapnProto format	2023-03-30 19:15:28 +00:00
robot-ch-test-poll	04d30a2afb	Merge pull request #48119 from Avogar/avro-more-types ... Support more ClickHouse types in Avro format	2023-03-29 13:07:35 +02:00
avogar	bc56c02858	Support more ClickHouse types in ORC/Arrow/Parquet formats	2023-03-28 20:02:42 +00:00
avogar	a0fcf81abf	Support more ClickHouse types in MsgPack format	2023-03-28 18:25:52 +00:00
avogar	e7ff6e85c2	Support Enum output/input in BSONEachRow, allow all map key types and avoid extra calculations	2023-03-28 17:57:23 +00:00
avogar	06a6f5cf76	Support more ClickHouse types in Avro format	2023-03-28 17:36:20 +00:00
DanRoscigno	6d8a2bbd48	standardize admonitions	2023-03-27 14:54:05 -04:00
rfraposa	747eaf3f72	Fix broken links	2023-03-23 14:40:45 -06:00
Alexey Milovidov	26c17b61fb	Merge pull request #47434 from Avogar/avro-improvements ... Support Decimals and Date32 in Avro format	2023-03-18 22:16:34 +03:00
rfraposa	ac5ed141d8	New nav - reverting the revert	2023-03-17 21:45:43 -05:00
Alexander Tokmakov	ec44c8293a	Revert "New navigation"	2023-03-17 21:21:11 +03:00
rfraposa	7cb53ebc21	Justin feedback	2023-03-16 12:06:17 -05:00
Kruglov Pavel	6544e7c3ee	Fix typos	2023-03-10 17:11:27 +01:00
avogar	b6c91d9ace	Support Decimals and Date32 in Avro format	2023-03-10 15:48:18 +00:00
Rich Raposa	66dd5b3834	Merge branch 'master' into new-nav	2023-03-09 08:12:23 -07:00
Kruglov Pavel	71b6d6c6ae	Merge pull request #47114 from Avogar/parquet-compression ... Improve working with compression methods in Parquet/ORC/Arrow formats	2023-03-09 13:02:18 +01:00
rfraposa	5be7e09382	Update formats.md	2023-03-06 22:00:45 -07:00
Kruglov Pavel	3de905bb7c	Merge pull request #46616 from Avogar/fix-ipv4-ipv6-formats ... Fix IPv4/IPv6 serialization/deserialization in binary formats	2023-03-06 19:40:29 +01:00
avogar	a6cf2cdab8	Fix style, add docs	2023-03-02 10:36:07 +00:00
Kruglov Pavel	36e65f5f84	Use versions vith dots	2023-02-27 19:00:40 +01:00
Kruglov Pavel	443dedddca	Merge branch 'master' into use-parquet-2	2023-02-27 14:31:43 +01:00
Kruglov Pavel	47f9ca2166	Merge branch 'master' into fix-ipv4-ipv6-formats	2023-02-23 20:32:43 +01:00
avogar	54622566df	Add setting to change parquet version	2023-02-23 16:14:10 +00:00
Dan Roscigno	b6612d2c18	fix anchor link	2023-02-21 11:24:39 -05:00
avogar	e37f6b5457	Update docs	2023-02-20 19:50:25 +00:00
Kruglov Pavel	2a3cb8b4ee	Merge pull request #45340 from Avogar/parquet-fixed-binary ... Support FixedSizeBinary type in Parquet/Arrow	2023-02-10 18:31:20 +01:00
Dan Roscigno	b33486d715	Update formats.md ... closes	2023-02-09 12:52:01 -05:00
Kruglov Pavel	4e2918cee3	Merge branch 'master' into parquet-fixed-binary	2023-02-08 12:31:13 +01:00
Azat Khuzhin	1a8437f2c9	Add ability to ignore unknown keys in JSON object for named tuples ... This can be useful in case your input JSON is complex, while you need only few fields in it. This behaviour is controlled by the input_format_json_ignore_unknown_keys_in_named_tuple setting name, that is turned OFF by default. This will, almost, allow to parse gharchive dataset without jq. "almost" because of two things: - Tuple cannot be Nullable, so such keys with Tuple type in ClickHouse cannot be `null` in JSON - You cannot use dot.dot notation to extract columns for file() engine, only tupleElement() Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>	2023-01-27 10:01:08 +01:00
Dan Roscigno	777ddf80ab	Update docs/en/interfaces/formats.md	2023-01-26 11:18:18 -05:00
Denys Golotiuk	0eadb7112d	Added markdown format docs	2023-01-26 13:33:14 +02:00
Dan Roscigno	1cc3708092	Merge branch 'master' into update-settings-url	2023-01-24 19:51:39 -05:00
DanRoscigno	77ae27f26c	update for split of format settings	2023-01-24 19:37:55 -05:00
Kruglov Pavel	23c12ac8ee	Merge branch 'master' into parquet-fixed-binary	2023-01-24 16:51:05 +01:00
Kruglov Pavel	4bd3f0e5ef	Merge pull request #44953 from Avogar/tsv-csv-detect-header ... Detect header in CSV/TSV/CustomSeparated files automatically	2023-01-24 15:13:52 +01:00
Rich Raposa	429e93965c	Update formats.md ... Google has a new website for Protocol Buffers. The old link expires on Jan 31, 2023	2023-01-23 15:42:35 -07:00
avogar	5bf4704e7a	Support FixedSizeBinary type in Parquet/Arrow	2023-01-16 21:01:31 +00:00
Kruglov Pavel	e9d6590926	Merge branch 'master' into tsv-csv-detect-header	2023-01-16 17:50:24 +01:00
avogar	1c0941d72a	Add docs and examples	2023-01-16 16:46:41 +00:00
avogar	87b934c472	Insert default values in case of missing tuple elements in JSONEachRow	2023-01-12 16:36:44 +00:00
DanRoscigno	7168c217b0	switch text to response for query blocks	2023-01-11 10:08:11 -05:00
serxa	8d099a4417	make more SQL queries copyable from docs in one click	2023-01-11 13:43:51 +00:00
Ivan Blinkov	61c2f23713	Remove leftover empty lines at the end of markdown files	2023-01-09 15:15:18 +01:00
Ivan Blinkov	b7e082d033	Remove "Original article links"	2023-01-09 15:13:36 +01:00
DanRoscigno	925ce4b96c	edits	2022-12-30 09:21:12 -05:00
DanRoscigno	0902db3fe0	edits	2022-12-29 22:34:25 -05:00
avogar	ae715b9d00	Finish docs	2022-12-29 20:42:03 +00:00
avogar	46b7ec4209	Add detailed documentation about schema inference	2022-12-29 13:42:56 +00:00
Yakov Olkhovskiy	9ce4e6b7e2	fix style	2022-12-16 17:30:40 -05:00
Yakov Olkhovskiy	bb5d7ff28b	Append requirement for FORMAT RowBinary with strict delimiter	2022-12-16 15:43:52 -05:00
avogar	d0f9bb2ec2	Allow to parse JSON objects into Strings	2022-12-08 18:58:18 +00:00
Kruglov Pavel	c35b2a6495	Add a limit for string size in RowBinary format (#43842)	2022-12-02 13:57:11 +01:00
Kruglov Pavel	98d6b96c82	Merge pull request #42033 from mark-polokhov/BSONEachRow ... Add BSONEachRow input/output format	2022-11-22 14:45:21 +01:00
avogar	2af60f34eb	Restrict document size in parallel parsing, allow to read ObjectId/JS code into String column	2022-11-15 13:35:17 +00:00
avogar	4d993e653a	Fix build and style	2022-11-15 13:06:24 +00:00
avogar	842d25c358	Minor improvements, better docs	2022-11-14 20:05:01 +00:00
avogar	564d83bbc7	Better handle uint64	2022-11-11 13:24:12 +00:00
avogar	94c6dc42eb	Use better types	2022-11-11 13:17:48 +00:00
avogar	9e89af28c6	Refactor BSONEachRow format, fix bugs, support more data types, support parallel parsing and schema inference	2022-11-10 20:15:14 +00:00