Commit Graph

4098 Commits

Author SHA1 Message Date
Vitaly Baranov
1c138a7037 Minor changes 2024-10-21 15:39:57 +02:00
Vitaly Baranov
a5cbac555c Corrections after review and some improvements. 2024-10-21 13:45:04 +02:00
ortyomka
d9b3a2732b add user content-type overriding 2024-10-19 22:20:31 +02:00
Vitaly Baranov
727b70f032 Improve checking capability for batch delete from S3. 2024-10-18 13:36:04 +02:00
kssenii
66bbf11e07 Allow to disable background cache download for reading metadata files 2024-10-17 20:39:08 +02:00
Alexey Milovidov
d8ae693772
Merge pull request #70601 from ClickHouse/less-log-messages
Limit too frequent log messages
2024-10-18 01:35:32 +08:00
Raúl Marín
76b081c718
Merge pull request #70739 from Algunenano/settings3
Move more setting structs to pImpl
2024-10-17 15:44:59 +00:00
Alexey Milovidov
bde677ff21 Merge branch 'master' into less-log-messages 2024-10-16 23:55:24 +02:00
Raúl Marín
99924ba2bc Move ServerSettings to pImpl 2024-10-16 21:13:26 +02:00
Daniil Ivanik
877e27245e
Merge branch 'master' into master 2024-10-16 11:23:39 +02:00
Vladimir Cherkasov
5227fe0934
Merge pull request #70487 from ClickHouse/vdimir/safe_http_exception_log
Avoid spamming the logs with large HTTP response bodies
2024-10-16 08:34:48 +00:00
Alexey Milovidov
6e9f7dbd5b Less log messages 2024-10-13 11:23:12 +02:00
lwz9103
31dd409d28 Improve compatibility of cast(timestamp as string) with spark
remove trailing zeros with the configuration date_time_64_output_format_cut_trailing_zeros_align_to_groups_of_thousands, which defaults to false to maintain consistency with previous behavior.
If config is true, output scale will be dynamic set in (0, 3, 6) according to tailing zeros. See changes in following examples.

- 2012-01-01 00:11:22.000000 -> 2012-01-01 00:11:22
- 2012-01-01 00:11:22.120000 -> 2012-01-01 00:11:22.120
- 2012-01-01 00:11:22.123400 -> 2012-01-01 00:11:22.123400
2024-10-11 14:11:16 +08:00
vdimir
38d8a9a956
Do not log HTTP body 2024-10-09 08:51:09 +00:00
vdimir
5b2f1bbf27
Revert "Truncate and escape HTTP body in logs"
This reverts commit 024851b0f0.
2024-10-09 08:42:28 +00:00
vdimir
024851b0f0
Truncate and escape HTTP body in logs 2024-10-08 15:41:57 +00:00
Konstantin Bogdanov
67c1e89d90
Apply linter changes 2024-10-06 12:29:20 +02:00
Alexey Milovidov
164158af78 Sync with private 2024-10-03 16:34:25 +02:00
Kseniia Sumarokova
752a1ec466
Merge pull request #70141 from ClickHouse/refactor-object-storage-read
Refactor reading from object storage
2024-10-03 10:14:28 +00:00
Yakov Olkhovskiy
6eee7a1c83 increment profile event in WriteBufferFromPocoSocket::nextImpl() 2024-10-01 02:48:50 +00:00
kssenii
7da133aeeb Refactor reading from object storage mess 2024-09-30 21:02:08 +02:00
Konstantin Bogdanov
aa5e76ae87
Merge pull request #69765 from ClickHouse/fix-tidy-maybe-unused
Make `clang-tidy` happy
2024-09-30 06:35:57 +00:00
Kseniia Sumarokova
ec8cf035c1
Merge branch 'master' into fix-read-settings-in-index-loading 2024-09-26 17:47:15 +01:00
Alexey Milovidov
23529b5945
Merge pull request #69743 from iskakaushik/s3-allows-dots
Add test parsing s3 URL with a bucket name including a dot
2024-09-25 22:58:15 +00:00
kssenii
a02f222326 Merge remote-tracking branch 'origin' into fix-read-settings-in-index-loading 2024-09-25 17:53:08 +02:00
Raúl Marín
a90790ce5b Remove dbms dependency on clickhouse_functions 2024-09-24 19:48:23 +02:00
Raúl Marín
49ec96ff36 Merge remote-tracking branch 'blessed/master' into s3-allows-dots 2024-09-24 16:56:37 +02:00
Alexey Milovidov
71dcc7ef69 Revert "Merge pull request #69032 from alexon1234/include_real_time_execution_in_http_header"
This reverts commit b6ea3442b4, reversing
changes made to 0076084f9a.
2024-09-24 02:57:30 +02:00
Raúl Marín
f2e27a0aa8 Merge remote-tracking branch 'blessed/master' into s3-allows-dots 2024-09-23 14:55:07 +02:00
Raúl Marín
d7b4127d43
Revert "Support more oss endpoints" 2024-09-19 17:41:38 +02:00
Konstantin Bogdanov
c35c20a481
Make clang-tidy happy 2024-09-19 12:51:42 +02:00
Kaushik Iska
55602057db Demonstrate a regression in parsing S3 URLs
S3 bucket names are allowed to contain dots
https://docs.aws.amazon.com/AmazonS3/latest/userguide/bucketnamingrules.html
2024-09-18 23:15:27 +00:00
Raúl Marín
a500a7ff50 Link issues and clang tidy 2024-09-18 20:35:52 +02:00
Raúl Marín
f3df7bd171 Hide Settings implementation 2024-09-18 15:48:02 +02:00
kssenii
8a14e99643 Fix style check 2024-09-17 15:34:45 +02:00
kssenii
1d0aed0d43 Move settings init back to context 2024-09-17 15:22:57 +02:00
Kseniia Sumarokova
50e923caec
Merge branch 'master' into fix-read-settings-in-index-loading 2024-09-12 14:15:51 +02:00
Nikita Taranov
8534aa07fc
Merge pull request #69400 from ClickHouse/support_more_oss_endpoints
Support more oss endpoints
2024-09-10 17:01:02 +00:00
Kruglov Pavel
d226b13fd4
Merge pull request #69272 from Avogar/json-memory-usage
Reduce memory usage of inserts to JSON by using adaptive write buffer size
2024-09-10 15:23:18 +00:00
Pablo Marcos
a34a544f4a
Merge pull request #67938 from mwoenker/incomplete-utf8-sequence
Handle incomplete sequences at end of input
2024-09-10 14:04:58 +00:00
Nikita Taranov
47589d4898 impl 2024-09-09 19:53:58 +01:00
avogar
72dbc8205b Fix unit tests 2024-09-09 15:12:17 +00:00
avogar
b4ef10ad1c Make better 2024-09-05 08:52:22 +00:00
avogar
0dad8b088a Fix typo 2024-09-04 18:35:10 +00:00
avogar
4b322ee3c5 Reduce memory usage of inserts to JSON by using adaptive write buffer size 2024-09-04 17:12:17 +00:00
Sergei Trifonov
1f5082ee8a
Merge pull request #65182 from ClickHouse/s3-streams-scheduler
IO scheduling on HTTP session level
2024-09-02 14:17:58 +00:00
serxa
c6aa12feae Merge branch 'master' into s3-streams-scheduler 2024-08-31 12:13:38 +00:00
Alejandro
644cfb27d6 Add RealTimeMicroseconds to HTTP Header X-ClickHouse-Summary 2024-08-28 15:34:34 +01:00
vdimir
bb22736bc3
Merge pull request #68867 from ucasfl/url-engine
Add virtual column _headers for url table engine
2024-08-27 13:27:19 +00:00
Kruglov Pavel
76493b31b6
Merge pull request #68653 from ClickHouse/Avogar-patch-6
Increase connectTimeoutMs IMDS connection timeout to 50ms to avoid failures in CI
2024-08-26 11:50:41 +00:00
flynn
590cf84a83 Fix conflict 2024-08-25 07:54:11 +00:00
flynn
e4aceed36a Add virtual column _headers for url table engine 2024-08-25 07:49:30 +00:00
Yarik Briukhovetskyi
b8027e5566
Merge pull request #68105 from JackyWoo/fix_msan_caused_by_incorrect_datetime_str
Fix MSAN issue caused by incorrect date format.
2024-08-21 18:06:20 +00:00
Kruglov Pavel
6db7b99543
Increase connectTimeoutMs IMDS connection timeout to 50ms to avoid failures in CI 2024-08-21 15:42:46 +02:00
Kseniia Sumarokova
dddf7d3c86
Merge branch 'master' into fix-read-settings-in-index-loading 2024-08-19 20:40:50 +02:00
JackyWoo
38c196a834 Merge branch 'master' into fix_msan_caused_by_incorrect_datetime_str 2024-08-19 18:41:19 +08:00
Alexey Milovidov
4e91c663a6 Fix error 2024-08-18 08:28:16 +02:00
Alexey Milovidov
03ab872f5c Fix error 2024-08-18 07:34:44 +02:00
Alexey Milovidov
487c6a097e Merge branch 'master' into revert-65361-revert-65164-ecs 2024-08-18 06:19:27 +02:00
avogar
4975264c9d More strict parsing 2024-08-16 14:08:07 +00:00
avogar
b1c18e2dd4 Fix check for allowed date symbols in date time best effort schema infernece 2024-08-16 13:29:25 +00:00
Kruglov Pavel
39bc050e5f
Merge pull request #66444 from Avogar/json-data-type
Implement new JSON data type.
2024-08-16 10:29:29 +00:00
Alexey Milovidov
3508667e6c
Merge pull request #52503 from ClickHouse/more-strict-tryparse
Stricter `tryParse`
2024-08-15 21:58:22 +00:00
avogar
9f477bb1e7 Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-data-type 2024-08-15 20:44:01 +00:00
Kruglov Pavel
c4d9944a90
Merge pull request #68382 from Avogar/better-datetime-inference
Improve schema inference of date times
2024-08-15 19:33:37 +00:00
Alexey Milovidov
e5665c9f59
Merge pull request #68082 from ClickHouse/fix-trash-in-aws-s3
Fix trash (low-quality code) in AWS S3
2024-08-15 17:41:21 +00:00
avogar
8db2c65595 Merge branch 'master' of github.com:ClickHouse/ClickHouse into better-datetime-inference 2024-08-15 11:24:14 +00:00
avogar
bea8e65f4f Fix tests 2024-08-15 09:48:28 +00:00
avogar
0bb076a4d3 Improve schema inference of date times 2024-08-15 08:08:00 +00:00
avogar
fed37d24f0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-data-type 2024-08-15 08:02:15 +00:00
Michael Stetsyuk
2e5f45a7ad rename: S3DiskNoKeyErrors -> DiskS3NoSuchKeyErrors 2024-08-14 17:53:33 +00:00
Alexey Milovidov
9786f07f11 Merge branch 'master' into fix-trash-in-aws-s3 2024-08-14 19:48:31 +02:00
avogar
fc23f1c1ff Fix tests 2024-08-14 12:20:33 +00:00
Yakov Olkhovskiy
f4280203a0
Merge pull request #63781 from ClickHouse/ft-chunked-protocol
Add chunked wrapper to native protocol
2024-08-14 10:35:20 +00:00
Alexey Milovidov
393b16bd8e Merge branch 'master' into fix-trash-in-aws-s3 2024-08-14 04:55:05 +02:00
avogar
f82822c993 Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-data-type 2024-08-13 17:14:30 +00:00
Nikita Taranov
dd3fa7c3b6
Merge pull request #61793 from nickitat/keep_alive_max_reqs
Implement `max_keep_alive_requests` setting for server
2024-08-13 15:06:43 +00:00
Yakov Olkhovskiy
93a922f169 merge master 2024-08-13 03:28:25 +00:00
Alexey Milovidov
b80dd738b0 Fix error 2024-08-13 02:41:00 +02:00
Alexey Milovidov
995b29cb07 Merge branch 'master' of github.com:ClickHouse/ClickHouse into more-strict-tryparse 2024-08-13 02:38:40 +02:00
Alexey Milovidov
aa38315673 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-trash-in-aws-s3 2024-08-12 23:54:45 +02:00
avogar
cfd854882b Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-data-type 2024-08-12 15:57:57 +00:00
kssenii
ecee8721df Merge remote-tracking branch 'origin' into fix-read-settings-in-index-loading 2024-08-12 14:39:05 +02:00
avogar
9296d4ecfb Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-data-type 2024-08-12 11:55:39 +00:00
kssenii
09c9ca62e8 Revert "Remove default constructor of ReadSettings"
This reverts commit ba1a23d0ea.
2024-08-12 13:06:03 +02:00
Alexey Milovidov
ee3eec0a2a
Update Credentials.cpp 2024-08-11 04:47:26 +02:00
Yakov Olkhovskiy
9a45c136b8 merge master 2024-08-10 13:53:32 +00:00
Yakov Olkhovskiy
c1b5b908ba hide Field::get in private, only use Field::safeGet 2024-08-10 13:01:55 +00:00
Alexey Milovidov
cebcc88b31 Fix build 2024-08-10 00:18:54 +02:00
Alexey Milovidov
f4173546a9 Remove obsolete test 2024-08-09 21:47:01 +02:00
Alexey Milovidov
c65c3768ba Fix .NET 2024-08-09 21:15:18 +02:00
Alexey Milovidov
0ccac1e7ff Merge branch 'master' into more-strict-tryparse 2024-08-09 20:22:37 +02:00
JackyWoo
6ded5e1c8b Some fixups 2024-08-09 23:50:03 +08:00
Alexey Milovidov
a74cc601cd A catch-all URL style for S3 2024-08-09 16:04:27 +02:00
Nikita Taranov
ffa1371dde Merge branch 'master' into keep_alive_max_reqs 2024-08-09 12:24:45 +01:00
JackyWoo
ca4041847e Add tests 2024-08-09 19:15:41 +08:00
JackyWoo
3357275fa8 Fix MSAN issue caused by incorrect date format. 2024-08-09 18:33:45 +08:00
Alexey Milovidov
9470ceb34d Minor changes 2024-08-09 05:41:10 +02:00
Alexey Milovidov
8bfe4ee23f Speed up requests when IMDS is not available 2024-08-09 04:57:18 +02:00
Alexey Milovidov
dbd4a6d551 Speed up from 4 sec to 2 sec #52771 2024-08-09 04:41:06 +02:00