Commit Graph

73 Commits

Author SHA1 Message Date
Vladimir Chebotarev
3b344a3d26
Got rid of S3AuthSigner () 2022-06-09 14:44:50 +02:00
Vladimir Chebotarev
d5022a0c01 Moved ClientConfigurationPerRequest from and to ClickHouse. 2022-06-02 06:07:01 +03:00
alesapin
6d6779f17a
Merge pull request from ClickHouse/i_object_storage
Separate object storage operations from disks
2022-05-27 13:59:50 +02:00
Alexey Milovidov
8ba865bb60
Merge pull request from excitoon-favorites/fixs3colonandequalssign
Fixed error with symbols in key name in S3
2022-05-27 00:58:35 +03:00
Vladimir Chebotarev
cdbe6672cb Added one more symbol and proper comment. 2022-05-20 11:35:18 +03:00
Vladimir Chebotarev
1ad19051e5 Fixed error with symbols in key name in S3. 2022-05-19 11:01:05 +03:00
alesapin
ceb7249916 Fix stupid buge 2022-05-16 19:57:48 +02:00
alesapin
ce6d5f7dcc Merge branch 'master' into i_object_storage 2022-05-16 17:42:22 +02:00
alesapin
4f1d4dde22 Disable s3 logging by default 2022-05-16 00:16:00 +02:00
kssenii
5dd3ad08a1 Add S3Requests metric 2022-05-13 18:12:46 +02:00
Amos Bird
4a5e4274f0
base should not depend on Common 2022-04-29 10:26:35 +08:00
Maksim Kita
e30117a3d6 Fix clang-tidy warnings in Interpreters, IO folders 2022-03-14 18:17:35 +00:00
Nikolai Kochetov
7dea7b7f76 Decrease log level for some s3 messages. 2021-12-20 18:18:54 +03:00
Alexey Milovidov
8b4a6a2416 Remove cruft 2021-10-28 02:10:39 +03:00
alesapin
5a0f22fbce Fix resolve host 2021-10-12 11:27:18 +03:00
alesapin
d301e40651 Cache DNS in Poco handler for S3 if no proxy specified 2021-10-11 18:31:09 +03:00
Alexey Milovidov
fe6b7c77c7 Rename "common" to "base" 2021-10-02 10:13:14 +03:00
Vladimir C
b280e1418a
Check if error_report is initialized in PocoHTTPClient.cpp 2021-08-06 11:37:07 +03:00
Anton Ivashkin
0e040ca40c Add 10 seconds cache for S3 proxy resolver 2021-08-05 18:52:04 +03:00
Maksim Kita
30c78c0a23 Fix arcadia 2021-06-11 14:26:33 +03:00
Vladimir Chebotarev
a3f7992442 Fixed typo. 2021-05-13 08:46:16 +03:00
Vladimir Chebotarev
b738e25f5b Better handling of HTTP errors in PocoHTTPClient. 2021-05-13 08:46:16 +03:00
Alexey Milovidov
94592f0d54 Whitespaces 2021-05-10 21:16:06 +03:00
alexey-milovidov
0400070924
Merge pull request from excitoon-favorites/equalsignins3path
Better handling of URI's in `PocoHTTPClient`
2021-05-10 20:25:18 +03:00
alexey-milovidov
5397b1d0c3
Update PocoHTTPClient.cpp 2021-05-10 20:22:09 +03:00
alexey-milovidov
5685738d08
Update PocoHTTPClient.cpp 2021-05-10 20:20:05 +03:00
Vladimir Chebotarev
524113f497 Fixed bug with S3 URLs containing + symbol, data with such keys could not be read previously. 2021-05-06 11:28:55 +03:00
Vladimir Chebotarev
a6ab040b07 Added region parameter for S3 storage and disk. 2021-05-01 20:45:35 +03:00
Maksim Kita
d381e59791
Merge pull request from kitaisreal/fix-arcadia-build-s3
Fix arcadia build S3
2021-04-16 23:35:10 +03:00
Nikita Mikhaylov
0ddb396338 add Y_IGNORE 2021-04-16 15:52:48 +03:00
Maksim Kita
94b228acc9
Update PocoHTTPClient.h 2021-04-15 21:51:15 +03:00
Nikita Mikhaylov
a6b43f6765
Merge pull request from excitoon-favorites/betters3timeouts
Consistent AWS timeouts
2021-04-15 14:29:21 +03:00
Maksim Kita
eceed68d62 Fix arcadia build S3 2021-04-15 12:31:09 +03:00
kreuzerkrieg
228a0a0647 Fix an error handling in Poco HTTP Client for AWS. 2021-04-11 17:22:19 +03:00
Vladimir Chebotarev
0eb051961c Consistent AWS timeouts. 2021-04-04 14:06:10 +03:00
Vladimir Chebotarev
35e0d0f672 Reverted S3 connection pools. 2021-03-15 14:17:16 +03:00
Alexander Kuzmenkov
f42aefc4a4
Merge pull request from excitoon-favorites/s3betterglobs
Used global region for accessing S3 if can't determine exactly
2021-01-29 23:44:14 +03:00
Vladimir Chebotarev
afdea5eff0 Changed handling of PocoHTTPClientConfiguration in order to ensure AWS SDK is initialized. 2021-01-27 09:38:35 +03:00
Vladimir Chebotarev
3322cc812d Updated AWS C++ SDK. 2021-01-26 20:58:02 +03:00
Vladimir Chebotarev
59fb76e8bc Fix. 2021-01-05 13:34:55 +03:00
Vladimir Chebotarev
5cbc25c647 Added global setting s3_max_connections. 2021-01-05 13:34:55 +03:00
Vladimir Chebotarev
a5e3d89649 Attempt to use IOStream in AWS SDK. 2020-12-04 13:37:08 +03:00
tavplubix
db3918d88d
Merge pull request from Jokser/disk-s3-proxy-tunnel-mode
Support HTTP proxy and HTTPS S3 endpoint configuration
2020-11-30 16:05:12 +03:00
Anton Ivashkin
aa208a9d9f Use only 's3_max_redirect' in params instead of all settings 2020-11-23 14:02:17 +03:00
Vladimir Chebotarev
b3e2ebbaa5 Used global region for accessing S3 if can't determine exactly. 2020-11-23 08:19:38 +03:00
Anton Ivashkin
a7d4f4be65 Add 's3_max_redirects' test 2020-11-20 11:18:44 +03:00
Anton Ivashkin
15b5d3a55a Merge master 2020-11-13 19:32:35 +03:00
Anton Ivashkin
026f7e0a27 Add 's3_max_redirects' setting 2020-11-13 19:31:51 +03:00
Pavel Kovalenko
adfe966c46 Support HTTP proxy and HTTPS S3 endpoint configuration. 2020-11-11 12:30:32 +03:00
Alexander Tokmakov
b94cc5c4e5 remove more stringstreams 2020-11-10 21:22:26 +03:00