Smita Kulkarni
37c618289b
Merge branch 'master' into add_azure_workload_identity_support_blob
2024-05-02 14:58:56 +02:00
Sema Checherinda
083bcfc1ce
distinct message for s3 error 'no key' for cases disk and storage
2024-05-02 13:08:25 +02:00
Julia Kartseva
dc95558962
method rename
2024-04-29 19:48:17 +00:00
Julia Kartseva
3c1207ed4d
remove path normalization
2024-04-29 18:01:21 +00:00
Julia Kartseva
508a42bc8f
use ordered map for path map
2024-04-29 18:01:21 +00:00
Julia Kartseva
24d5abba10
extract plain_rewritable metadata type
...
Make PlainRewritableObjectStorage generic;
Support config type
```
<s3_plain_rewritable>
<type>object_storage</type>
<object_storage_type>s3</object_storage_type>
<metadata_type>plain_rewritable</metadata_type>
<endpoint>https://s3.eu-west-1.amazonaws.com/clickhouse-eu-west-1.clickhouse.com/data/ </endpoint>
<use_environment_credentials>1</use_environment_credentials>
</s3_plain_rewritable>
```
2024-04-29 18:01:21 +00:00
Julia Kartseva
d1217af389
address feedback - pt.4
2024-04-29 18:01:21 +00:00
Julia Kartseva
802ee27b1b
address feedback - pt.3
...
non-functional changes
2024-04-29 18:01:21 +00:00
Julia Kartseva
4a7f28f6bd
address feedback - pt.2
2024-04-29 18:01:21 +00:00
Julia Kartseva
36a1cae910
address feedback - pt.1
2024-04-29 18:01:21 +00:00
Julia Kartseva
4f6a3e27b7
Update src/Disks/ObjectStorages/MetadataStorageFromPlainObjectStorageOperations.cpp
...
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
2024-04-29 18:01:21 +00:00
Julia Kartseva
70d55aa618
Update src/Disks/ObjectStorages/CommonPathPrefixKeyGenerator.h
...
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
2024-04-29 18:01:21 +00:00
Julia Kartseva
89f28f3c18
explicitly disallow ALTERs and mutations for plain
2024-04-29 18:01:21 +00:00
Julia Kartseva
01ee500b06
improvements, cleanups, comments
2024-04-29 18:01:21 +00:00
Julia Kartseva
a67a8299ce
Do not list prefix.path in listDirectory
2024-04-29 18:01:21 +00:00
Julia Kartseva
d1e5a09b18
better transaction rollback
2024-04-29 18:01:21 +00:00
Julia Kartseva
b4375131cb
concurrency control
2024-04-29 18:01:21 +00:00
Julia Kartseva
7916792baa
Do not create directory metadata recursively
2024-04-29 18:01:21 +00:00
Julia Kartseva
75147f3ac7
S3-plain based disk supporting directory rename
...
Fixes: https://github.com/ClickHouse/ClickHouse/issues/58347
2024-04-29 18:01:21 +00:00
Smita Kulkarni
f474c29b4d
Fix build with new master
2024-04-26 15:33:27 +02:00
Smita Kulkarni
3ace11f92d
Merge branch 'master' into Azure_write_buffer_parallel_upload
2024-04-26 10:27:41 +02:00
liuneng
76b989ebbc
fix missing-field-initializers
2024-04-24 17:13:08 +08:00
Raúl Marín
3df253cb0a
Merge pull request #62850 from danipozo/fix-building-endpoint-from-storage-account-url
...
Azure: fix building final url from endpoint object
2024-04-23 17:26:22 +00:00
Dani Pozo
771219a118
Apply suggestion to use pop_back
2024-04-23 12:34:26 +02:00
Dani Pozo
c75574a1d6
Azure: fix building final url from endpoint object
2024-04-22 18:49:46 +02:00
Smita Kulkarni
065eceecbf
Merge branch 'master' into Azure_write_buffer_parallel_upload
2024-04-19 17:37:15 +02:00
Smita Kulkarni
613dd1a6c0
Updated to use workload identity for backups & disk
2024-04-18 18:26:07 +02:00
Smita Kulkarni
5846e2c8ab
Merge branch 'master' into add_azure_workload_identity_support_blob
2024-04-18 18:11:16 +02:00
Anton Popov
98d47e4ef5
Update src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageAuth.cpp
...
Co-authored-by: SmitaRKulkarni <Smita.Kulkarni@clickhouse.com>
2024-04-18 12:12:14 +02:00
Anton Popov
b50117780c
Merge remote-tracking branch 'upstream/master' into HEAD
2024-04-17 13:05:46 +00:00
Anton Popov
03916cc13f
fix build and update submodule
2024-04-12 18:26:30 +00:00
Alexander Gololobov
85cd0291a5
Remove getRemotePathsRecursive() from IDisk
2024-04-12 18:34:51 +02:00
Anton Popov
47c653f87c
better retries in azure sdk
2024-04-12 15:39:14 +00:00
Alexander Tokmakov
d510c3ac55
Merge pull request #62266 from ClickHouse/cannot_allocate_thread
...
Add fault injection for "Cannot allocate thread"
2024-04-12 14:40:42 +00:00
Anton Popov
523ee302cb
more profile events
2024-04-11 16:37:54 +00:00
Smita Kulkarni
b8c77a4453
Support parallel write buffer for AzureBlobStorage
2024-04-11 10:13:41 +02:00
Alexander Tokmakov
d8e97b51bf
Merge branch 'master' into cannot_allocate_thread
2024-04-10 21:21:42 +02:00
Anton Popov
8d813b6594
Merge remote-tracking branch 'upstream/master' into azure-profile-events
2024-04-10 14:40:54 +00:00
Anton Popov
4a8c1bf6a3
Merge pull request #62306 from CurtizJ/azure-retryable-errors
...
Better handling of errors from azure storage
2024-04-10 13:38:33 +00:00
Anton Popov
52635d2b8f
add profile events for azure disk
2024-04-10 01:29:09 +00:00
Robert Schulze
4035334634
Merge remote-tracking branch 'rschu1ze/master' into static-instance2
2024-04-09 11:45:27 +00:00
Robert Schulze
97281203b8
Don't access static members through instance, pt. II
...
clang-tidy rightfully complains
(-readability-static-accessed-through-instance) that static member
functions are accessed through non-static members
2024-04-07 11:09:35 +00:00
Anton Popov
fa01f26def
add test
2024-04-05 17:39:12 +00:00
Sema Checherinda
8b75b6ae77
Merge branch 'master' into chesema-keep-alive-send-and-receive
2024-04-05 01:04:22 +02:00
Sema Checherinda
ae3a199939
support max requests for keep alive
2024-04-05 00:37:29 +02:00
Sema Checherinda
dd852da339
add more debug logs
2024-04-05 00:30:03 +02:00
Alexander Tokmakov
5db9fbed52
cancel tasks on exception
2024-04-04 22:32:57 +02:00
Anton Popov
d7fb851d17
better handling of errors from azure storage
2024-04-04 19:53:58 +00:00
Robert Schulze
de2a0be025
Don't access static members through instance
...
- clang-tidy rightfully complains (-readability-static-accessed-through-instance)
- not going to enable the warning for now to avoid breaking the build
2024-04-03 18:50:33 +00:00
SmitaRKulkarni
9bb185593e
Merge pull request #61988 from ClickHouse/Azure_fix_exception_in_finalize
...
Fix WriteBufferAzureBlobStorage destructor uncaught exception
2024-04-03 18:22:27 +02:00
