alexey-milovidov
7b53a0ef33
Revert "Added allow_merges option for volumes in multi-disk configuration ( #13402 )"
...
This reverts commit 1e2616542a
2020-08-21 18:44:29 +03:00
Vladimir Chebotarev
1e2616542a
Added allow_merges option for volumes in multi-disk configuration ( #13402 )
2020-08-21 12:04:13 +03:00
Alexander Kuzmenkov
ef5882639b
Merge pull request #13459 from Jokser/s3-multithreaded-disk-copy
...
Move parts from DiskLocal to DiskS3 in parallel
2020-08-12 07:36:03 +03:00
Pavel Kovalenko
ea46ee74ae
Don't allocate Executor instance on each disk->getExecutor() call.
2020-08-11 22:08:32 +03:00
Vladimir Chebotarev
7371cf6bd1
Proper remote host checking in S3 redirects ( #13404 )
...
* Proper remote host checking in S3 redirects.
Co-authored-by: Alexander Kazakov <Akazz@users.noreply.github.com>
2020-08-11 09:09:08 +03:00
Pavel Kovalenko
bece61b1cc
Fix codestyle.
2020-08-10 14:40:31 +03:00
Pavel Kovalenko
f503273d41
Merge remote-tracking branch 'origin/master' into s3-multithreaded-disk-copy
...
# Conflicts:
# src/Disks/S3/DiskS3.cpp
2020-08-10 14:35:26 +03:00
Alexey Milovidov
b4ac900462
Fix "Arcadia" build
2020-08-09 02:38:53 +03:00
Alexander Kuzmenkov
6a596d5c40
Merge pull request #13076 from Jokser/s3-file-cache
...
Ability to cache mark and index files for S3 disk
2020-08-08 01:04:53 +03:00
Pavel Kovalenko
562102161b
Missed override.
2020-08-07 18:53:40 +03:00
Pavel Kovalenko
53ecd95302
Remove unused dependencies.
2020-08-07 14:44:35 +03:00
Pavel Kovalenko
a6ee09f696
Move parts to DiskS3 in parallel refactoring.
2020-08-07 14:40:19 +03:00
Pavel Kovalenko
7856852010
Move parts to DiskS3 in parallel.
2020-08-05 19:36:10 +03:00
Pavel Kovalenko
1703e5a1ca
Download through tmp file in DiskCacheWrapper.cpp
2020-08-03 15:37:53 +03:00
Alexey Milovidov
6f690b7c0d
Normalize ya.make files, fix "Arcadia" build
2020-08-02 16:57:38 +03:00
Pavel Kovalenko
a6d162961f
Fix directories creation in DiskCacheWrapper.cpp
2020-08-01 22:09:05 +03:00
Pavel Kovalenko
d7785f8c2d
Fix checkstyle.
2020-07-30 18:48:32 +03:00
Pavel Kovalenko
7a41fc1b9b
DiskS3 with cache tests.
2020-07-30 17:49:56 +03:00
alesapin
df0dcf4a31
Fix error codes
2020-07-30 17:27:11 +03:00
Pavel Kovalenko
00181d34fd
DiskS3 caching improvements.
2020-07-30 16:42:05 +03:00
alesapin
1c8aa4b6c1
Fix get disk interface
2020-07-30 14:08:56 +03:00
alesapin
d3ea1d914b
Tiny fixes and avoid dynamic casts
2020-07-30 13:04:49 +03:00
Pavel Kovalenko
ba8d770a76
Change comment in DiskCacheWrapper.cpp
2020-07-29 22:54:00 +03:00
Pavel Kovalenko
644d4c7aaa
Cache mark and index files for DiskS3.
2020-07-29 21:15:20 +03:00
Pavel Kovalenko
2b962e699b
Cache mark and index files for DiskS3.
2020-07-29 18:05:02 +03:00
Vladimir Chebotarev
faedb04722
Minor fixes.
2020-07-28 19:45:46 +03:00
Vladimir Chebotarev
6d22069f55
Review fixes.
2020-07-27 18:59:09 +03:00
Vladimir Chebotarev
ee21fde3fe
Review fixes.
2020-07-26 21:27:36 +03:00
Gleb Novikov
aac97957ce
Fixed integration test_tmp_policy
2020-07-26 21:27:36 +03:00
Gleb Novikov
99d52552e1
Small fixes for tests
2020-07-26 21:27:36 +03:00
Gleb Novikov
f4080ed6cc
removed unused error code
2020-07-26 21:27:36 +03:00
Gleb Novikov
e4699e297e
removed default clause in switch for VolumeType enum
2020-07-26 21:27:36 +03:00
Gleb Novikov
2c39584a44
Braces style fix
2020-07-26 21:27:36 +03:00
Gleb Novikov
adef249c34
Small fix of VolumeRAID1Ptr
2020-07-26 21:27:36 +03:00
Gleb Novikov
7f5b6fba78
Generic volume is coming...
...
1. SingleDiskVolume for temporary volumes
2. Generic VolumePtr in StoragePolicies
3. Removed max_data_part_size in system.storage_policies, added volume_type
2020-07-26 21:27:36 +03:00
Gleb Novikov
96c7cc8724
Small clang-10 warning fixes + ya.make
2020-07-26 21:27:36 +03:00
Gleb Novikov
db56820fab
Style fixes and added UNKNOWN_RAID_TYPE exception to createVolumeFromConfig
2020-07-26 21:27:36 +03:00
Gleb Novikov
3585b24f16
MultiDiskReservation, VolumeRAID1 and createVolumeFromConfig
...
1. Implemented MultiDiskReservation to maintain multiple reservations under one
2. Implemented VolumeRAID1 as child of VolumeJBOD (since RAID1 is quite similar)
3. Implemented createVolumeFromConfig
2020-07-26 21:27:36 +03:00
Alexey Milovidov
6df282e813
Fixup
2020-07-16 11:33:51 +03:00
Alexey Milovidov
a6016b95ce
Fix clang-tidy
2020-07-16 05:34:43 +03:00
Alexey Milovidov
3408b7e259
Merge branch 'master' into log-engine-rollback-on-insert-error
2020-07-16 05:34:02 +03:00
Vladimir Chebotarev
a479a20ba4
Review fixes.
2020-07-13 03:24:49 +03:00
Vladimir Chebotarev
d3ade3492e
Update DiskS3.h
2020-07-13 03:09:37 +03:00
alexey-milovidov
c6a5b77843
Update registerDiskS3.cpp
2020-07-13 03:04:46 +03:00
Vladimir Chebotarev
4802a785b5
Added read_seek_threshold setting to DiskS3.
2020-07-13 02:51:25 +03:00
Vladimir Chebotarev
718523b0ee
Working wrapper.
2020-07-13 02:47:22 +03:00
Alexey Milovidov
204a4af394
Rollback insertion error in Log engines #12402
2020-07-12 05:32:18 +03:00
alexey-milovidov
26d32f2ce5
Merge pull request #12412 from Jokser/s3-https
...
S3 HTTPS integration tests
2020-07-12 03:36:37 +03:00
Pavel Kovalenko
f43428a4d5
S3 HTTPS integration test.
2020-07-10 22:42:18 +03:00
Vladimir Chebotarev
faf6be6576
Implemented single part uploads for DiskS3 ( #12026 )
...
* Implemented single part uploads for DiskS3.
* Added `min_multi_part_upload_size` to disk configuration.
2020-07-09 17:09:17 +03:00
