888 Commits

Author	SHA1	Message	Date
kevinyhzou	355faa4251	ci fix	2023-07-17 20:08:32 +08:00
kevinyhzou	b2665031dc	review fix	2023-07-13 20:27:14 +08:00
kevinyhzou	ba57c84db3	bug fix csv input field type mismatch	2023-07-13 20:24:10 +08:00
Alexander Gololobov	9757e272b9	Check number of rows in the reader instead	2023-07-11 12:24:16 +02:00
Dmitry Kardymon	32f5a78302	Fix setting name	2023-07-06 07:32:46 +00:00
Dmitry Kardymon	24b5c9c204	Use one setting input_format_csv_allow_variable_number_of_colums and code in RowInput	2023-07-06 06:05:43 +00:00
Dmitry Kardymon	ab4142eb8f	Merge remote-tracking branch 'clickhouse/master' into ADQM-870	2023-07-04 08:23:31 +03:00
Michael Kolupaev	2498170253	Fix use-after-free in StorageURL when switching URLs	2023-06-22 16:24:12 +00:00
Dmitry Kardymon	30bea857fd	Merge remote-tracking branch 'origin/master' into ADQM-870	2023-06-19 07:19:07 +00:00
Kruglov Pavel	11f176dd19	Merge pull request #50712 from KevinyhZou/bug_fix_csv_parse_by_tab_delimiter ... Support CSVInputFormat to read csv file by whitespace & tab delimiter	2023-06-16 13:16:22 +02:00
Dmitry Kardymon	806176d88e	Add input_format_csv_missing_as_default setting and tests	2023-06-15 11:23:08 +00:00
KevinyhZou	953f40aa3b	Merge branch 'master' into bug_fix_csv_parse_by_tab_delimiter	2023-06-15 10:25:19 +08:00
Dmitry Kardymon	a91fc3ddb3	Add docs/ add more cases in test	2023-06-14 16:44:31 +00:00
Dmitry Kardymon	ed318d1035	Add input_format_csv_ignore_extra_columns setting (prototype)	2023-06-14 10:35:36 +00:00
Chang Chen	86694847c6	using Reader instead of typename CapnpType::Reader	2023-06-14 15:22:32 +08:00
Chang Chen	e281026e00	fix build issue on clang 15	2023-06-14 12:29:55 +08:00
kevinyhzou	f3b99156ac	review fix	2023-06-14 10:48:21 +08:00
Kruglov Pavel	607f337d67	Merge pull request #50592 from Avogar/max-bytes-to-read-in-schema-inference ... Add setting to limit the number of bytes to read in schema inference	2023-06-13 16:47:57 +02:00
Kruglov Pavel	8fdcd91c38	Merge pull request #49752 from Avogar/better-capnproto-3 ... Refactor CapnProto format to improve input/output performance	2023-06-13 16:20:38 +02:00
Kruglov Pavel	24d70a2afd	Fix	2023-06-12 13:37:59 +02:00
kevinyhzou	911f8ad8dc	use whitespace or tab as field delimiter	2023-06-12 11:57:52 +08:00
avogar	47b0c2a862	Make better	2023-06-09 13:01:36 +00:00
kevinyhzou	48e1b21aab	Add feature to support read csv by space & tab delimiter	2023-06-08 20:34:30 +08:00
avogar	cc036528fe	Merge branch 'master' of github.com:ClickHouse/ClickHouse into better-capnproto-3	2023-06-08 11:16:13 +00:00
Kruglov Pavel	1baa6404e6	Merge branch 'master' into skip-trailing-empty-lines	2023-06-06 19:39:34 +02:00
avogar	df50833b70	Allow to skip trailing empty lines in CSV/TSV/CustomeSeparated formats	2023-06-06 17:33:05 +00:00
Kruglov Pavel	af880a6f3b	Merge branch 'master' into max-bytes-to-read-in-schema-inference	2023-06-06 14:47:58 +02:00
Nikita Mikhaylov	e87348010d	Rework loading and removing of data parts for MergeTree tables. (#49474) ... Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>	2023-06-06 14:42:56 +02:00
avogar	33e51d4f3b	Add setting to limit the number of bytes to read in schema inference	2023-06-05 15:22:04 +00:00
Kruglov Pavel	59f27014f7	Merge pull request #50474 from valentinalexeev/patch-1 ... Additional error information when JSON is too large	2023-06-05 13:31:21 +02:00
Alexey Gerasimchuk	9958731c27	Merge branch 'master' into ADQM-830	2023-06-05 07:46:47 +10:00
Valentin Alexeev	516cda94ee	Use in.count() instead of pos	2023-06-02 18:42:35 +02:00
Valentin Alexeev	da4d55cdaf	Additional error information when JSON is too large ... If a parser fails on a large JSON, then output the last position processed to allow review.	2023-06-02 18:42:35 +02:00
Michael Kolupaev	b51064a508	Get rid of SeekableReadBufferFactory, add SeekableReadBuffer::readBigAt() instead	2023-06-01 18:48:30 -07:00
avogar	883350d5c2	Fix tests	2023-06-01 14:51:14 +00:00
Kruglov Pavel	8b34a30455	Fix style	2023-05-31 22:14:57 +02:00
Kruglov Pavel	898d1f34db	Merge branch 'master' into better-capnproto-3	2023-05-31 21:44:00 +02:00
avogar	c9626314f7	Better	2023-05-31 19:22:44 +00:00
Kruglov Pavel	2dd4701115	Merge branch 'master' into allow_empty	2023-05-30 16:04:12 +02:00
avogar	ea395e9554	Make better	2023-05-25 15:24:02 +00:00
Alexey Gerasimchuck	75791d7a63	Added input_format_csv_trim_whitespaces parameter	2023-05-25 07:51:32 +00:00
Kruglov Pavel	f76fc5e066	Fix special build	2023-05-24 17:19:04 +00:00
Kruglov Pavel	94ef08977a	Fix special build	2023-05-24 17:19:04 +00:00
Kruglov Pavel	5f1ca61d09	Fix special builds	2023-05-24 17:19:04 +00:00
avogar	a89a8b8d50	Fix build	2023-05-24 17:19:04 +00:00
Kruglov Pavel	c2eada7ba7	Fix style	2023-05-24 17:19:04 +00:00
avogar	e66f6272d1	Refactor CapnProto format to improve input/output performance	2023-05-24 17:19:04 +00:00
Michael Kolupaev	6fd5d8e8ba	Add setting output_format_parquet_compliant_nested_types to produce more compatible Parquet files	2023-05-19 18:39:50 +00:00
Yakov Olkhovskiy	0a44a69dc8	remove unnecessary header	2023-05-17 00:22:13 +00:00
Yakov Olkhovskiy	282297b677	binary encoding of IPv6 in protobuf	2023-05-16 23:46:01 +00:00