Raúl Marín
f3df7bd171
Hide Settings implementation
2024-09-18 15:48:02 +02:00
Yakov Olkhovskiy
c1b5b908ba
hide Field::get in private, only use Field::safeGet
2024-08-10 13:01:55 +00:00
Raúl Marín
9a8e4f2993
No libraries
2024-07-11 22:33:41 +02:00
Raúl Marín
9e599576ab
Hide Settings object from Context.h
2024-07-11 14:00:05 +02:00
kssenii
a035e4ed69
Fix tests
2024-06-03 11:59:48 +02:00
kssenii
779eaa01ec
Fix tests
2024-05-31 17:53:09 +02:00
kssenii
f85030f481
Better
2024-05-29 12:35:37 +02:00
kssenii
9e1cd7e898
Unify part of the code
2024-05-28 14:03:51 +02:00
kssenii
9d961d1936
Better
2024-05-28 13:54:34 +02:00
kssenii
73e9719768
Fix build
2024-05-28 12:51:58 +02:00
kssenii
56c7301d46
Use BaseSettings for auth settings
2024-05-27 18:28:37 +02:00
kssenii
5abebeca63
Use BaseSettings
2024-05-27 16:08:55 +02:00
kssenii
80f195d2b9
Refactor s3 settings
2024-05-27 12:11:04 +02:00
kssenii
7b225ab59c
Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1
2024-05-21 16:58:25 +02:00
Robert Schulze
2909e6451b
Move StringUtils.h/cpp back to Common/
2024-05-19 09:39:36 +00:00
kssenii
bdd5eeb2eb
Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1
2024-02-20 16:59:33 +01:00
kssenii
0552f44f70
Fixes after merge with master, move some part of code to object storage
2024-02-19 16:43:49 +01:00
Antonio Andelic
175a1db787
Support specifying users for s3 settings
2024-02-19 16:43:27 +01:00
Sema Checherinda
6f626d8294
fix auth_settings.hasUpdates function
2024-01-07 23:00:26 +01:00
Sema Checherinda
d5f86f671d
fix and test that S3Clients reused
2024-01-07 02:19:06 +01:00
Shani Elharrar
c696c0bfe7
S3Common.AuthSettings: Allow passing SESSION_TOKEN to AWSCredentials
...
This sets the infrastructure of loading session_token and passing it directly
to all AWSCredentials instances that are created using the AuthSettings.
The default SESSION_TOKEN is set to an empty string as documented in AWS SDK
reference: https://sdk.amazonaws.com/cpp/api/0.12.9/d4/d27/class_aws_1_1_auth_1_1_a_w_s_credentials.html
2023-12-17 10:29:15 +02:00
johanngan
731823b873
Add support for SSE-KMS configuration with S3
...
https://docs.aws.amazon.com/AmazonS3/latest/userguide/UsingKMSEncryption.html
Similar to the server_side_encryption_customer_key_base64 option for
configuring SSE-C with S3, add the following settings to configure
SSE-KMS on a per-endpoint/disk basis:
- server_side_encryption_kms_key_id
- server_side_encryption_kms_encryption_context
- server_side_encryption_kms_bucket_key_enabled
2023-05-03 21:35:38 -05:00
johanngan
1bc52977a7
Support "header" setting in S3 disk config
...
The S3 table engine supports specifying extra HTTP headers in S3
requests to certain endpoints, via the "headers" setting. This commit
adds the same setting to S3 disk config.
2023-05-03 21:32:58 -05:00
Antonio Andelic
80f0251ff2
better
2023-03-29 12:54:57 +00:00
Antonio Andelic
7b1ad221b2
Address PR comments
2023-03-29 11:08:44 +00:00
Antonio Andelic
160aa186bb
Add support for NOSIGN keyword and no_sign_request config
2023-03-28 07:05:35 +00:00
Antonio Andelic
a170a909a4
Add expiration window for S3 credentials
2023-03-10 10:06:32 +00:00
Antonio Andelic
ae905b5762
Split S3Common into multiple files
2023-02-13 12:28:04 +00:00
Antonio Andelic
c02adec4b8
Early return
2023-02-10 07:47:48 +00:00
Antonio Andelic
ae731b739a
Prefer explicitly defined creds for S3
2023-02-09 08:13:16 +00:00
Antonio Andelic
d5117f2aa6
Define S3 client with bucket and endpoint resolution ( #45783 )
...
* Update aws
* Define S3 client with bucket and endpoint resolution
* Add defines for ErrorCodes
* Use S3Client everywhere
* Remove unused errorcode
* Add DROP S3 CLIENT CACHE query
* Add a comment
* Fix style
* Update aws
* Update reference files
* Add missing include
* Fix unit test
* Remove unneeded declarations
* Correctly use RetryStrategy
* Rename S3Client to Client
* Fix retry count
* fix clang-tidy warnings
2023-02-03 14:30:52 +01:00
Vitaly Baranov
a8304525ed
Move getObjectInfo() to a separate header.
2023-01-27 15:09:38 +01:00
Alexander Tokmakov
70d1adfe4b
Better formatting for exception messages ( #45449 )
...
* save format string for NetException
* format exceptions
* format exceptions 2
* format exceptions 3
* format exceptions 4
* format exceptions 5
* format exceptions 6
* fix
* format exceptions 7
* format exceptions 8
* Update MergeTreeIndexGin.cpp
* Update AggregateFunctionMap.cpp
* Update AggregateFunctionMap.cpp
* fix
2023-01-24 00:13:58 +03:00
Alexander Tokmakov
5cd90c1a3e
Merge branch 'master' into exception_message_patterns
2023-01-17 20:04:04 +01:00
Alexander Tokmakov
522686f78b
less empty patterns
2023-01-17 01:19:44 +01:00
Vitaly Baranov
9a52087989
More complex logic: GetObjectAttributes requests will be used
...
only if the endpoint is "*.amazonaws.com", otherwise HeadObject requests will be used.
2023-01-16 20:14:39 +01:00
Vitaly Baranov
7030b64096
Fix build.
2023-01-16 10:46:58 +01:00
Vitaly Baranov
16a20cd06e
Use std::string_view instead of const std::string_view &
2023-01-16 10:18:04 +01:00
Vitaly Baranov
e435edb4ab
Make checkObjectExists() easier.
2023-01-16 10:06:20 +01:00
Vitaly Baranov
a955504043
Move throw_on_error parameter to the end.
2023-01-15 20:28:16 +01:00
Vitaly Baranov
21b8aaeb8b
Stop using HeadObject requests in S3
...
because they don't work well with endpoints without explicit region.
2023-01-15 20:28:11 +01:00
Kseniia Sumarokova
573d3283b0
Merge pull request #44327 from kssenii/use-new-named-collections-code-2
...
Replace old named collections code with new (from #43147 ) part 2
2023-01-06 13:06:26 +01:00
Vitaly Baranov
4753ac937f
Enabling override of endpoint used to connect for EC2 Metadata Service.
...
This commit applies changes https://github.com/aws/aws-sdk-cpp/commit/742b371 and
https://github.com/aws/aws-sdk-cpp/commit/34e73e9 to our fork of Aws::Internal::EC2MetadataClient.
2022-12-31 18:56:35 +01:00
Vitaly Baranov
9014be8968
Fix disable loading EC2 metadata by aws-sdk-core.
2022-12-29 12:26:43 +01:00
Vitaly Baranov
1eb0d5db16
Disable loading EC2-metadata.
2022-12-25 18:24:35 +01:00
kssenii
6bd4f8c029
Merge remote-tracking branch 'upstream/master' into use-new-named-collections-code-2
2022-12-20 21:17:28 +01:00
kssenii
30547d2dcd
Replace old named collections code for url
2022-12-17 00:24:05 +01:00
Anton Popov
0c87031e80
Merge remote-tracking branch 'upstream/master' into HEAD
2022-12-13 16:33:21 +00:00
kssenii
c7429d19e7
Merge remote-tracking branch 'upstream/master' into fix-progress-from-s3
2022-12-05 18:32:47 +01:00
Anton Popov
c2e92fd274
better code in StorageS3
2022-12-05 14:43:41 +00:00
