Commit Graph

1475 Commits

Author SHA1 Message Date
李扬
0de3b1dacb
Merge branch 'ClickHouse:master' into orc_dict_encode 2024-09-11 12:08:06 +08:00
taiyang-li
fd9513ed2a Merge branch 'master' into poc_orc_lc_read 2024-09-11 10:46:40 +08:00
Alexey Korepanov
1eb7cdbd42 Merge branch 'master' into output-format-json-compact-with-progress 2024-09-08 17:12:51 +02:00
Alexey Korepanov
33512a0d6e Merge branch 'master' into output-format-json-compact-with-progress 2024-09-02 13:32:52 +02:00
avogar
cf87893758 Don't infer Bool type from String in CSV when input_format_csv_try_infer_numbers_from_strings=1 2024-08-30 15:28:53 +00:00
Arthur Passos
1fee8a7721 Merge branch 'master' into add_parquet_bloom_filters_support 2024-08-29 13:12:34 -03:00
Arthur Passos
a6eb0c5b85 Merge branch 'master' into add_parquet_bloom_filters_support 2024-08-28 10:41:26 -03:00
李扬
553c309477
Merge branch 'master' into orc_dict_encode 2024-08-28 21:00:18 +08:00
Kruglov Pavel
b1e7c067c9
Merge pull request #68955 from Avogar/fix-json-type-parsing-null-as-default
Fix JSON type parsing with nulls as defaults
2024-08-28 11:38:49 +00:00
avogar
88b72238c8 Fix JSON type parsing with nulls as defaults 2024-08-27 13:09:19 +00:00
Kruglov Pavel
e361417ff6
Merge pull request #68298 from Avogar/fix-nullable-schema-inference
Fix using schema_inference_make_columns_nullable=0
2024-08-26 11:52:34 +00:00
Kruglov Pavel
bf4b53390b
Merge branch 'master' into input_format_json_empty_as_default 2024-08-26 13:40:48 +02:00
Alexey Korepanov
c42815a139
Merge branch 'master' into output-format-json-compact-with-progress 2024-08-25 11:43:06 +02:00
Alexey Korepanov
af3f600b5c Fix commas in the statistics section 2024-08-25 11:35:35 +02:00
Arthur Passos
58016988d0
Merge branch 'master' into add_parquet_bloom_filters_support 2024-08-22 10:38:05 -03:00
Kruglov Pavel
34d02304d3
Merge branch 'master' into input_format_json_empty_as_default 2024-08-21 14:50:36 +02:00
taiyang-li
03ab625265 enable string dict encoding in orc output format 2024-08-20 15:47:26 +08:00
Shaun Struwig
ae389d14ee
Fix stylecheck 2024-08-17 20:42:00 +02:00
Shaun Struwig
4a7fe42001
Merge branch 'master' into variant_inference 2024-08-17 20:20:37 +02:00
Arthur Passos
96175f3e90
Merge branch 'master' into add_parquet_bloom_filters_support 2024-08-17 10:09:44 -03:00
scanhex12
56c0e5f85a
Merge branch 'master' into enum_json 2024-08-17 13:39:33 +03:00
Kruglov Pavel
6f7e4ce3aa
Merge branch 'master' into fix-nullable-schema-inference 2024-08-16 15:39:34 +02:00
Kruglov Pavel
182c00eba7
Fix style 2024-08-15 23:17:10 +02:00
avogar
bf44d17eb8 Fix comment 2024-08-15 20:55:55 +00:00
avogar
9f477bb1e7 Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-data-type 2024-08-15 20:44:01 +00:00
Arthur Passos
15e0cbaf4a Merge branch 'master' into add_parquet_bloom_filters_support 2024-08-15 17:08:26 -03:00
Kruglov Pavel
5445669d4e
Don't create new dynamic path for null values 2024-08-15 20:55:36 +02:00
Kruglov Pavel
f539507592
Merge branch 'master' into variant_inference 2024-08-15 14:23:20 +02:00
avogar
8db2c65595 Merge branch 'master' of github.com:ClickHouse/ClickHouse into better-datetime-inference 2024-08-15 11:24:14 +00:00
avogar
0bb076a4d3 Improve schema inference of date times 2024-08-15 08:08:00 +00:00
Kruglov Pavel
ccb7ecb9a2
Update src/Formats/FormatSettings.h
Co-authored-by: Alexey Katsman <alex.katsman@clickhouse.com>
2024-08-14 15:13:57 +02:00
avogar
fc23f1c1ff Fix tests 2024-08-14 12:20:33 +00:00
Alexis Arnaud
29bc7cf5d5 post-review changes 2024-08-14 12:03:29 +02:00
avogar
55ede2dab6 Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-data-type 2024-08-13 21:19:17 +00:00
Kruglov Pavel
6c8ad63104
Merge pull request #68132 from Avogar/better-dynamic
Reimplement Dynamic type
2024-08-13 19:21:52 +00:00
avogar
3cfb921bef Fix using schema_inference_make_columns_nullable=0 2024-08-13 18:41:53 +00:00
avogar
f82822c993 Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-data-type 2024-08-13 17:14:30 +00:00
Alexis Arnaud
a39a4b1080 better 2024-08-13 18:30:43 +02:00
Alexis Arnaud
229fffcd56 post-review changes 2024-08-13 18:30:43 +02:00
Alexis Arnaud
0ff90e4a5c post-review changes 2024-08-13 18:30:43 +02:00
Alexis Arnaud
d36176ad85 Support for the input_format_json_empty_as_default setting 2024-08-13 18:30:43 +02:00
Yakov Olkhovskiy
3e8a177622
Merge pull request #61908 from ClickHouse/ci-fuzzer-enable
CI: enable libfuzzer (fixing build and docker)
2024-08-13 14:22:09 +00:00
avogar
a329456146 Fix review comments 2024-08-12 13:47:10 +00:00
Robert Schulze
037a1006fd
Merge remote-tracking branch 'ClickHouse/master' into ci-fuzzer-enable 2024-08-12 12:28:32 +00:00
avogar
9296d4ecfb Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-data-type 2024-08-12 11:55:39 +00:00
Alexey Milovidov
3e43cbe791
Merge branch 'master' into variant_inference 2024-08-09 23:37:27 +02:00
avogar
c61eef4a76 Reimplement Dynamic type 2024-08-09 21:17:49 +00:00
Yarik Briukhovetskyi
701c787eea
Merge branch 'ClickHouse:master' into hive_style_partitioning 2024-08-09 17:53:49 +02:00
morning-color
211999fde6
Merge branch 'master' into rows_before_group_by_counter 2024-08-08 15:49:24 +08:00
Yarik Briukhovetskyi
9e3a2931d2
Merge branch 'master' into hive_style_partitioning 2024-08-07 23:59:34 +02:00
Yakov Olkhovskiy
b246f7c17c merge master 2024-08-07 16:25:31 +00:00
Shaun Struwig
b58960309b
Merge branch 'master' into variant_inference 2024-08-06 12:09:30 +02:00
Michael Kolupaev
5b91865f58 Merge remote-tracking branch 'origin/master' into nojs 2024-08-05 19:53:53 +00:00
Yarik Briukhovetskyi
9b06753bb7
Merge branch 'master' into hive_style_partitioning 2024-08-05 17:02:27 +02:00
Arthur Passos
eb91f474df
Merge branch 'master' into add_parquet_bloom_filters_support 2024-08-03 00:04:43 -03:00
Yarik Briukhovetskyi
cdf8e5572c
Merge branch 'master' into hive_style_partitioning 2024-08-01 20:12:40 +02:00
Alexey Milovidov
df5e71636d Merge branch 'master' into fix-json-recursion 2024-08-01 18:18:30 +02:00
Nikita Taranov
453ee52f86
Merge pull request #67235 from ClickHouse/fix_oss_fuzz_build
Fix oss-fuzz build
2024-08-01 10:50:12 +00:00
Yarik Briukhovetskyi
fac73a0944
Merge branch 'master' into hive_style_partitioning 2024-07-31 18:25:08 +02:00
Kruglov Pavel
416870d093
Merge pull request #67175 from KevinyhZou/support_set_orc_read_timezone
Support set orc reader time zone name
2024-07-31 13:08:29 +00:00
Michael Kolupaev
07291cb708 Revert "Merge pull request #61750 from KevinyhZou/improve_json_each_row_ignore_key_case"
This reverts commit 3229cb5874, reversing
changes made to f838c25d20.
2024-07-30 21:14:22 +00:00
Michael Kolupaev
51212a414f Revert "Rename bad setting"
This reverts commit eb4ec0912a.
2024-07-30 21:13:20 +00:00
Arthur Passos
43d52694a4 Merge branch 'master' into add_parquet_bloom_filters_support 2024-07-30 12:47:34 -03:00
Kruglov Pavel
b143ce5481
Merge pull request #67157 from ClickHouse/Avogar-patch-5
Fix wrong usage of input_format_max_bytes_to_read_for_schema_inference in schema cache
2024-07-30 10:45:36 +00:00
Yarik Briukhovetskyi
f0da5c528f
Merge branch 'master' into hive_style_partitioning 2024-07-30 11:49:14 +02:00
Nikita Taranov
59c517dd91 fix format_fuzzer 2024-07-29 16:08:38 +01:00
Konstantin Vedernikov
c32d4d428f fixes 2024-07-29 13:22:06 +00:00
Kruglov Pavel
813f4015db
Merge branch 'master' into json-data-type 2024-07-29 13:08:51 +02:00
wxybear
906d709d84
clickhouse-client/local: make multi-query mode the default 2024-07-29 09:44:59 +00:00
Alexey Milovidov
60acbe7720 Fix stack overflow in too deep JSON 2024-07-29 01:40:05 +02:00
Shaun Struwig
ee1013eba6
Merge branch 'master' into variant_inference 2024-07-27 11:16:14 +02:00
Nikita Taranov
109bd52296 impl 2024-07-26 23:05:56 +01:00
kevinyhzou
10b36c09e9 support set orc reader time zone name 2024-07-26 15:38:26 +08:00
Kruglov Pavel
f0faa111d7
Fix wrong usage of input_format_max_bytes_to_read_for_schema_inference 2024-07-25 23:19:58 +02:00
Raúl Marín
eb4ec0912a Rename bad setting 2024-07-25 20:21:37 +02:00
avogar
701d99a9ad Small clean up 2024-07-25 13:56:17 +00:00
avogar
3cb35efb31 Try to improve insert speed 2024-07-23 13:31:59 +00:00
avogar
d13bbdf5e1 Fix style 2024-07-22 15:49:46 +00:00
avogar
2626880f6e Fix special builds and tests 2024-07-22 14:28:07 +00:00
avogar
99026efcdc Improve JSON parsing by different type inference logic 2024-07-22 10:51:15 +00:00
avogar
a296717e14 Fix tests, add docs for setting type_json_skip_duplicated_paths 2024-07-20 22:57:42 +00:00
avogar
519494a9d0 Add tests, docs, implement new syntax sugar for Array(JSON), fix small ugs 2024-07-20 18:51:20 +00:00
avogar
0ef65fbd13 Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-data-type 2024-07-16 10:09:27 +00:00
avogar
47e3e99924 Avoid calling type->getName 2024-07-16 10:06:21 +00:00
Kruglov Pavel
b03ff34c1d
Merge branch 'master' into variant_inference 2024-07-16 12:00:10 +02:00
morning-color
564429cb85
Merge branch 'master' into rows_before_group_by_counter 2024-07-16 16:26:56 +08:00
morning-color
8aaf9c1d98 Fix tests 2024-07-16 11:00:55 +08:00
Yakov Olkhovskiy
7de367d692 Merge branch 'master' into ci-fuzzer-enable 2024-07-15 20:58:42 +00:00
Arthur Passos
a3a6f40626 Merge branch 'master' into add_parquet_bloom_filters_support 2024-07-15 17:03:23 -03:00
Yarik Briukhovetskyi
4a7c52900a
Merge branch 'master' into hive_style_partitioning 2024-07-15 19:05:21 +02:00
avogar
43d86f9066 Unify SKIP and SKIP PREFIX hints, improve JSON parsing 2024-07-15 14:46:08 +00:00
Yakov Olkhovskiy
698b5ce7fa Merge branch 'master' into ci-fuzzer-enable 2024-07-14 05:31:56 +00:00
avogar
83037f534e Fix style 2024-07-12 16:07:38 +00:00
avogar
fb4317f12c Small clean up 2024-07-12 14:46:33 +00:00
avogar
dfc3db23b1 Implement new JSON data type 2024-07-12 14:38:14 +00:00
Raúl Marín
3c00119467 Merge remote-tracking branch 'blessed/master' into mergetree_private 2024-07-12 16:34:52 +02:00
Yarik Briukhovetskyi
17d2f8ed20
Merge branch 'ClickHouse:master' into hive_style_partitioning 2024-07-12 16:33:48 +02:00
Raúl Marín
1b75b8f4eb Merge remote-tracking branch 'blessed/master' into mergetree_private 2024-07-11 19:58:54 +02:00
Raúl Marín
9e599576ab Hide Settings object from Context.h 2024-07-11 14:00:05 +02:00
Yarik Briukhovetskyi
052520fa03
Merge branch 'master' into hive_style_partitioning 2024-07-10 19:46:07 +02:00
yariks5s
a751719a33 fixes due to review 2024-07-10 17:44:06 +00:00
Raúl Marín
b08be12252 Remove dependency on SettingsFields from FormatSettings 2024-07-10 19:19:10 +02:00
Kruglov Pavel
3c4e5df3a9
Merge branch 'master' into refactor-json-extract 2024-07-10 14:20:25 +02:00
Kruglov Pavel
6a9e2d9e82
Merge pull request #65980 from Avogar/add-missing-settings-in-schema-cache
Add missing settings in schema inference cache
2024-07-10 10:15:22 +00:00
Kruglov Pavel
abf25c7c5c
Merge branch 'master' into variant_inference 2024-07-10 12:09:48 +02:00
avogar
a32795d116 Fix review comments 2024-07-10 10:07:02 +00:00
Kruglov Pavel
6baa52d101
Fix null insertion into dynamic column 2024-07-09 14:01:28 +02:00
Kruglov Pavel
f3bfe8d881
Merge branch 'master' into data-types-binary-encoding 2024-07-09 12:27:06 +02:00
Alexey Korepanov
2469647609 Fix statistics section 2024-07-07 21:30:36 +02:00
Alexey Korepanov
88736a0d74 Update JSONCompactWithProgressRowOutputFormat to print JSON on each row 2024-07-07 21:12:26 +02:00
Yakov Olkhovskiy
6e5e680797 bump libprotobuf-mutator, fix build 2024-07-06 05:42:21 +00:00
Yakov Olkhovskiy
a9aaa2ab78 Merge remote-tracking branch 'origin/master' into ci-fuzzer-enable 2024-07-06 00:48:09 +00:00
yariks5s
942f7d7532 fixes after review 2024-07-05 12:44:31 +00:00
avogar
f556f2cd95 Try to fix special build 2024-07-04 18:28:22 +00:00
morning-color
a99c803ddf Rename rows_before_group_by_at_least to rows_before_aggregation_at_least 2024-07-04 17:26:06 +08:00
Kruglov Pavel
41b9216dd1
Fix build 2024-07-04 00:22:41 +02:00
Kruglov Pavel
a5adf31b9e
Fix special build 2024-07-03 19:30:36 +02:00
avogar
6530ae104d Fix tests 2024-07-03 15:23:01 +00:00
avogar
d03fcb5ff1 Fix 2024-07-03 14:23:38 +00:00
avogar
63303dd798 Fix style 2024-07-03 14:03:04 +00:00
avogar
ea3b0e735d Refactor JSONExtract functions and support more types and reuse its code in new JSON type 2024-07-03 13:40:41 +00:00
kevinyhzou
9341bbe197 ORC read use writer time zone 2024-07-03 16:36:08 +08:00
Kruglov Pavel
a120ad64e9
Merge branch 'master' into variant_inference 2024-07-03 09:33:25 +02:00
Arthur Passos
49a95067e2 Merge branch 'master' into add_parquet_bloom_filters_support 2024-07-02 14:35:44 -03:00
avogar
02de441246 Remove unrelated files 2024-07-02 15:55:26 +00:00
avogar
a2f7d8e13f Add missing settings in schema inference cache 2024-07-02 10:42:12 +00:00
avogar
6573b5436e Add docs about dynamic binary format 2024-07-01 14:21:11 +00:00
avogar
22eb2fe006 Merge branch 'master' of github.com:ClickHouse/ClickHouse into data-types-binary-encoding 2024-07-01 10:19:31 +00:00
Michael Kolupaev
3229cb5874
Merge pull request #61750 from KevinyhZou/improve_json_each_row_ignore_key_case
Improve JSONEachRow reading by ignoring the keys case
2024-06-27 23:38:50 +00:00
Kruglov Pavel
6436bd9cf3
Merge branch 'master' into data-types-binary-encoding 2024-06-27 17:19:36 +02:00
Alexey Milovidov
0990a82089
Merge branch 'master' into improve_json_each_row_ignore_key_case 2024-06-26 03:28:32 +02:00
lgbo-ustc
d7b56e112e support writting page index into parquet file 2024-06-24 09:22:38 +08:00
Alexey Korepanov
f9b70ea77a Add JSONCompactWithProgressRowOutputFormat 2024-06-22 09:30:16 +02:00
avogar
785f3ac5c9 Revert unrelated changes 2024-06-21 18:40:49 +00:00
avogar
7e7dd78844 Revert unrelated changes 2024-06-21 18:31:41 +00:00
avogar
b9fbbbb284 Update settings changes history 2024-06-21 18:23:52 +00:00
avogar
3dfab50408 Merge branch 'master' of github.com:ClickHouse/ClickHouse into data-types-binary-encoding 2024-06-21 18:21:19 +00:00
avogar
b1f45da3eb Implement binary encoding for ClickHouse data types 2024-06-21 18:20:35 +00:00
avogar
8c59217988 Merge branch 'master' of github.com:ClickHouse/ClickHouse into variant_inference 2024-06-18 17:59:31 +00:00
Alexey Milovidov
d46e8fc84b Merge branch 'master' into fp16 2024-06-16 14:44:53 +02:00
Shaun Struwig
d8c8aebc1f
Merge branch 'master' into footer_column__names 2024-06-15 08:39:02 +02:00
Shaun Struwig
b6fe4f6438
Merge branch 'master' into variant_inference 2024-06-15 08:36:24 +02:00
Nikita Mikhaylov
e48ebf5529 Fixed build and tests 2024-06-14 01:43:47 +02:00
Nikita Mikhaylov
a98ec2e0e9 Update src/Formats/EscapingRuleUtils.cpp
Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>
2024-06-14 01:43:47 +02:00
Nikita Mikhaylov
04897eb0fa Done 2024-06-14 01:43:47 +02:00
Kruglov Pavel
085c406f1f
Merge pull request #64641 from azat/fix-float-inference
Fix type inference for float (in case of small buffer)
2024-06-12 11:38:54 +00:00
Blargian
09e59765c5 Add setting output_format_pretty_display_footer_column_names_min_rows 2024-06-12 09:45:36 +02:00
Blargian
37e03ef320 Modify pretty formats to display column names in the footer when row count is large 2024-06-12 07:52:50 +02:00
Blargian
5aa9389f85 Add failing test, setting and docuumentation 2024-06-11 15:13:36 +02:00
Shaun Struwig
bad5e27bbf
Update src/Formats/SchemaInferenceUtils.cpp
Co-authored-by: Kruglov Pavel <48961922+Avogar@users.noreply.github.com>
2024-06-11 13:32:34 +02:00