Commit Graph

1051 Commits

Author SHA1 Message Date
Blargian
8421f23975 #56257 - add failing test and new setting for parsing TSV files with crlf 2024-01-28 22:56:47 +01:00
Maksim Kita
2a327107b6 Updated implementation 2024-01-25 14:31:49 +03:00
Kruglov Pavel
6d064512e1
Merge pull request #58614 from Blargian/58363_disable_ansi_pretty_automatically
58363 Automatically disable ANSI escape sequences in Pretty formats if the output is not a terminal
2024-01-17 13:45:41 +01:00
Blargian
5f500522a4 #58363 - added setting is_writing_to_terminal to FormatSettings.h, modified PrettyBlockOutputFormat to use this, which is set in FormatFactory.cpp getOutputFormat and getOutputFormatParallelIfPossible 2024-01-15 16:32:51 +02:00
Alexey Milovidov
afb50f03d9
Merge pull request #58519 from Avogar/control-arrow-dict-indexes-type
Add settings for better control of indexes type in Arrow dictionary
2024-01-13 20:00:40 +01:00
Blargian
ce012d217f #58363 - fix style check failing attempt no.2 2024-01-13 13:21:36 +02:00
Blargian
0fdba3b83d #58363 - fix failing style check 2024-01-13 12:14:54 +02:00
Alexey Milovidov
d112492c56 Remove some code 2024-01-13 03:48:04 +01:00
Blargian
72b5cf5993 #58363 - removed switch from PrettyBlockOutputFormat and modified BlockOutputFormats to use color variable. Updated english and russian documentation. Updated test 00405 reference file. 2024-01-12 19:46:03 +02:00
avogar
fbfdde60a7 Add settings for better control of indexes type in Arrow dictionary. Use signed integer type for indexes by default 2024-01-12 13:06:51 +00:00
Blargian
aa8876a611 #58363 - Changes based on review of draft PR - changed output_format_pretty_color to use UInt64Auto. Added isWritingToTerminal function to IO/WriteHelpers.h and updated test 2024-01-12 12:31:57 +02:00
Blargian
b65adbecc1 minor fixes. Doesnt seem to be using ANSI escapes anymore 2024-01-08 23:52:25 +02:00
Blargian
a15b573315 #58363 - fix formatting issues and change ON, OFF, AUTO to 0, 1, auto 2024-01-08 15:25:14 +02:00
avogar
7e5ba62017 Allow to read Bool values into String in JSON input formats 2024-01-05 20:33:30 +00:00
Blargian
459946035c #58363 🚧 modified Pretty in FormatSettings.h to have PrettyColor which can be 0,1 or auto. modified output_format_pretty_color in FormatFactory.cpp to make use of this, added the default to Settings.h. Implemented the logic for enabling/disabling based on output_format_pretty_color in PrettyBlockOutputFormat.h 2024-01-04 16:10:36 +02:00
Kruglov Pavel
c03e36e012
Merge branch 'master' into better-parsing-exceptions 2023-12-29 18:07:32 +01:00
avogar
fee2eadaf0 Fix parallel parsing for JSONCompactEachRow 2023-12-27 16:16:41 +00:00
Alexey Milovidov
ef66714bf2
Merge pull request #58196 from ClickHouse/strange-code
Looking at strange code
2023-12-24 03:36:41 +01:00
Alexey Milovidov
6bb181ce55 Looking at strange code 2023-12-23 13:06:34 +01:00
Alexey Milovidov
ff6419361a
Merge pull request #58181 from ClickHouse/remove-parallel-parsing-json-compact-each-row
Remove parallel parsing for JSONCompactEachRow
2023-12-23 10:16:40 +01:00
Alexey Milovidov
468b5e2813 Fix use-after-move 2023-12-23 08:23:15 +01:00
Alexey Milovidov
6a23fe034f Remove parallel parsing for JSONCompactEachRow 2023-12-23 06:17:47 +01:00
Nikita Mikhaylov
a0af0392cd
Random changes in random files (#57642) 2023-12-14 12:47:11 +01:00
Kruglov Pavel
ee39dca8c7
Merge branch 'master' into better-parsing-exceptions 2023-12-12 17:10:38 +01:00
Kruglov Pavel
6567fb2c08
Merge pull request #56859 from Avogar/csv-infer-numbers-from-strings
Allow to infer numbers from strings in CSV format
2023-12-12 17:09:02 +01:00
Kruglov Pavel
fd08c6f06a
Merge pull request #57751 from Avogar/better-json-inference-unnamed-tuples
Slightly better inference of unnamed tupes in JSON formats
2023-12-12 17:08:34 +01:00
Kruglov Pavel
8a447bf57c
Merge pull request #55892 from Avogar/schema-inference-union
Add 'union' mode for schema inference
2023-12-12 15:02:06 +01:00
Kruglov Pavel
9dba7aa13d
Merge pull request #57364 from Avogar/better-json-fallback
Better JSON -> JSONEachRow fallback without catching exceptions
2023-12-11 19:03:50 +01:00
Kruglov Pavel
20510cde34
Merge pull request #57006 from Avogar/save-errors-better
Fix early stop while parsing file with skipping lots of errors
2023-12-11 19:03:14 +01:00
avogar
c3a76fcc08 Allow to infer numbers from strings in CSV format 2023-12-11 18:02:05 +00:00
avogar
a87a8e91cf Slightly better inference of unnamed tupes in JSON formats 2023-12-11 14:46:12 +00:00
avogar
ee7af95bc0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-12-08 20:29:28 +00:00
Kruglov Pavel
c6fecfb1af
Merge pull request #56901 from KevinyhZou/Fix_allow_cr_end_of_csv_line
Fix allow cr end of line for csv
2023-11-29 20:57:58 +01:00
avogar
b493ce2385 Better JSON -> JSONEachRow fallback without catching exceptions 2023-11-29 14:19:38 +00:00
János Benjamin Antal
ab935e3dd7 Use the google proto files when importing protobuf schemas 2023-11-22 12:39:41 +00:00
avogar
7e392eec50 Better exception messages in input formats 2023-11-21 13:13:42 +00:00
kevinyhzou
3adc8fdf78 Fix ci 2023-11-21 11:22:12 +08:00
avogar
ffa90628f0 Make input format errors logger a bit better 2023-11-20 17:22:49 +00:00
avogar
081fa9f3de Address comments 2023-11-20 15:53:28 +00:00
avogar
872556a5d4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-11-20 14:03:36 +00:00
avogar
6366819f12 Fix generating deep nested columns in CapnProto/Protobuf schemas 2023-11-17 16:52:20 +00:00
yariks5s
181231d500 init 2023-11-07 17:56:02 +00:00
kevinyhzou
2a50daf5dd Allow cr at end of csv line 2023-11-06 12:21:42 +08:00
kevinyhzou
ef30e6723d bug fix csv read while end of line is not crlf 2023-11-06 12:21:42 +08:00
Kruglov Pavel
754ab9fa6c
Merge pull request #55974 from Avogar/fix-protobuf-auto-schema
Fix autogenerated Protobuf schema with fields with underscore
2023-11-01 18:17:09 +01:00
Kruglov Pavel
bf77ce691c
Merge pull request #55982 from yariks5s/npy_input_format
New input format Npy
2023-11-01 14:26:22 +01:00
yariks5s
6c4bf59021 fix suggestions and enhance tests 2023-10-31 18:10:55 +00:00
yariks5s
9a2d89e3e4 removed getSize() and enhanced docs 2023-10-30 12:42:19 +00:00
yariks5s
e14a7f066a fix typos 2023-10-28 01:46:59 +00:00
yariks5s
894724bfb3 suggested changes 2023-10-28 01:17:25 +00:00