Commit Graph

409 Commits

Author SHA1 Message Date
kssenii
0a3589524e File movement 2021-05-29 00:57:53 +03:00
kssenii
2a631aaf08 Final fixes 2021-05-29 00:34:44 +03:00
kssenii
f66c67a979 Fixes 2021-05-27 15:42:46 +03:00
kssenii
f9088b98de Some disks update 2021-05-27 00:02:24 +03:00
kssenii
b28157a0df Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-27 00:01:25 +03:00
kssenii
73f16ee9ee Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-26 23:08:08 +03:00
kssenii
940eab6924 Review fixes 2021-05-26 09:26:19 +03:00
kssenii
379e26bcbc Fix checks 2021-05-25 17:37:35 +00:00
kssenii
e01abf807e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-05-25 17:32:43 +00:00
mergify[bot]
400b74d186
Merge branch 'master' into merging-s3-backoff 2021-05-25 14:02:38 +00:00
kssenii
75a6b21f19 Better 2021-05-25 11:29:46 +00:00
kssenii
31107816bb fs::absolute to fs::canonical 2021-05-24 20:37:54 +03:00
Anton Ivashkin
4b9488be40 Add log record for removed from AWS S3 keys 2021-05-24 12:34:32 +03:00
kssenii
ecd82213d1 Some clean up, more tests 2021-05-23 20:19:04 +00:00
kssenii
0f98731c1f More integration tests 2021-05-23 07:33:31 +00:00
Alexandra
2bb25f356d createDir->createDirs in DiskEncrypted initialization 2021-05-23 06:49:02 +00:00
kssenii
6931573f69 Fix checks 2021-05-21 09:22:20 +00:00
kssenii
06ff4ab9da Fix build 2021-05-20 13:43:08 +00:00
kssenii
2f6770c9a0 Unite writeBuffers 2021-05-20 10:46:26 +00:00
kssenii
550a4e33f9 Unite readBuffers 2021-05-20 09:57:59 +00:00
Alexandra
11e40ad000 style fixes 2021-05-19 22:06:25 +00:00
Nikita Mikhaylov
f33b70c54a better 2021-05-20 00:42:25 +03:00
kssenii
9a5a6f39b7 Simplify writeFile 2021-05-19 20:31:43 +00:00
kssenii
5196075fd9 Better 2021-05-19 12:34:01 +00:00
Alexandra
f71e97511b set use_ssl flag 2021-05-18 20:48:16 +00:00
Alexandra
b7a0f2db57 refactoring 2021-05-18 20:20:51 +00:00
Alexandra
e3a91f568e fix encryption (very small files encryption bug) and replace 64-iv to 128-iv 2021-05-18 20:02:19 +00:00
kssenii
5f083b779d A little better, fix checks 2021-05-18 14:25:19 +03:00
Alexandra
721ea4f251 remove unnecessary includes 2021-05-17 16:58:51 +00:00
Alexandra
af420569f8 remove debug information, fix seek issue and encryption issue 2021-05-17 16:15:21 +00:00
Vladimir Chebotarev
bdf03387ab Better S3 read retries. Renamed s3_max_single_read_retries -> s3_single_read_retry_attempts, added sleeps before next attempts. 2021-05-17 10:38:32 +03:00
Alexandra
10a5b734ee encryption initialization (without any flags like use_ssl for now) 2021-05-16 22:35:20 +00:00
kssenii
018d52d71f Directory path 2021-05-15 09:20:26 +03:00
Alexandra
24573794ce inherit DiskEncrypted from DiskDecorator; override copy (use IDisk::copy instead of LocalDisk::copy), applyNewSettings, onFreeze and removeShared* 2021-05-14 21:52:51 +00:00
Alexandra
730b9792bc add parameters DiskEncrypted IDisk::applyNewSettings usage 2021-05-14 21:48:34 +00:00
kssenii
db849eb3e5 Remaining poco 2021-05-14 11:02:17 +03:00
kssenii
b123ec1354 Poco::FileException, Poco::parentPath 2021-05-14 00:20:28 +03:00
Alexandra
5374ac5c11 resolve alter table issue and add relative path to DiskEncrypted that can be declared in config as a <path> 2021-05-13 16:21:45 +00:00
Alexandra
7c34083441 mutex loop resolved 2021-05-13 06:46:11 +00:00
Alexandra
628bf9b345 disk encryption init 2021-05-13 06:37:05 +00:00
kssenii
e466924898 fs::premissions 2021-05-13 02:01:35 +03:00
kssenii
17432b1a41 Poco::moveTo to fs version 2021-05-12 17:32:22 +03:00
kssenii
047f8a4e3c Correct merge 2021-05-12 13:10:06 +00:00
kssenii
850b6f02cb Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-05-11 14:22:30 +00:00
kssenii
393b026f2e Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-11 16:49:23 +03:00
Vladimir
d02d14fa00
Merge pull request #23846 from excitoon-favorites/s3regions 2021-05-10 12:14:08 +03:00
kssenii
ab1a05a1f4 Poco::Path to fs::path, less concatination 2021-05-09 14:59:49 +03:00
kssenii
2d4c8b394c Return Poco::moveTo 2021-05-08 14:34:50 +03:00
kssenii
dc38da5e32 Fix fs::copy to be like Poco::copyTo 2021-05-08 14:00:31 +03:00
kssenii
35f999bf04 Poco::createFile to fs::createFile 2021-05-08 02:41:47 +03:00
kssenii
a2cfbd74ec Fix fs::copy to work the same as Poco::copy 2021-05-07 22:20:16 +03:00
kssenii
140bf7e2ea Less Poco 2021-05-07 15:29:26 +03:00
kssenii
5068b163b8 Fix 2021-05-05 19:55:02 +03:00
kssenii
2dabdd0f73 Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-05 18:42:40 +03:00
kssenii
9ec92ec514 Fix tests, less manual concatination of paths 2021-05-05 18:39:30 +03:00
kssenii
2b67341f28 Finish s3 2021-05-04 15:55:21 +03:00
vdimir
465341eafd
Add DiskRestartProxy.cpp to ya.make 2021-05-03 20:50:17 +03:00
kssenii
ad69fceea5 Restore copyFile 2021-05-02 19:59:18 +03:00
Vladimir Chebotarev
89242d4adc Fix. 2021-05-01 23:34:06 +03:00
Vladimir Chebotarev
a6ab040b07 Added region parameter for S3 storage and disk. 2021-05-01 20:45:35 +03:00
kssenii
32b2917141 Update s3/* 2021-05-01 18:10:04 +03:00
kssenii
ee06936596 Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-01 17:24:31 +03:00
Vladimir
3b7c68196b
Merge pull request #23429 from Jokser/disk-s3-restart-possibility 2021-05-01 15:28:14 +03:00
kssenii
2887ce1f69 Temporary rollback 2021-05-01 14:23:13 +03:00
kssenii
6867ea2c73 Temporary fix 2021-04-30 19:14:04 +03:00
kssenii
c609119daf Update Disks/* 2021-04-30 18:13:19 +03:00
kssenii
7f2f138d56 Update DiskLocal and DiskMemory 2021-04-30 11:32:34 +03:00
Maksim Kita
318c4bb80d Add examples folder filter to ya.make.in 2021-04-30 11:25:52 +03:00
Pavel Kovalenko
0050dbb75b Apply disk settings on config reload. 2021-04-29 23:32:19 +03:00
kssenii
984d82c3f2 Update DiskLocal 2021-04-29 02:00:04 +03:00
Pavel Kovalenko
838ede6c62 Rename delegate -> impl. 2021-04-27 15:11:38 +03:00
Pavel Kovalenko
5cedd90bed WriteBufferFromFileDecorator destructor fixes. 2021-04-27 13:19:22 +03:00
Pavel Kovalenko
63e5f5d3ab DiskS3 and WriteBufferFromFileDecorator small refactoring. 2021-04-27 11:37:59 +03:00
Nikita Mikhaylov
9f55424250 move to examples everywhere 2021-04-27 01:51:42 +03:00
kssenii
814e727d0e Better 2021-04-22 08:21:37 +00:00
Pavel Kovalenko
37c637cc34 Minor fixes. 2021-04-21 13:34:07 +03:00
Pavel Kovalenko
2ab8013455 DiskRestartProxy improvements and tests. 2021-04-21 12:53:46 +03:00
kssenii
87b4843134 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-20 21:40:01 +00:00
kssenii
8689a24ca0 Slightly better, add integration test with hdfs disk as default 2021-04-20 20:51:00 +00:00
Pavel Kovalenko
9272237c7e Update DiskRestartProxy.cpp 2021-04-20 23:47:21 +03:00
Pavel Kovalenko
10cf881a08 Add SYSTEM RESTART DISK command. 2021-04-20 22:23:54 +03:00
Pavel Kovalenko
016a9c674b DiskRestartProxy refactoring. 2021-04-20 21:58:34 +03:00
Pavel Kovalenko
98f8cbbdb2 DiskRestartProxy refactoring. 2021-04-20 21:58:34 +03:00
Pavel Kovalenko
e8b4dd1e4b Introduce DiskRestartProxy. 2021-04-20 21:55:57 +03:00
kssenii
d5fb7ba094 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-20 13:38:29 +00:00
kssenii
22c6e37590 Better 2021-04-20 13:12:42 +00:00
Nikita Mikhaylov
f55eacee7d
Merge pull request #22988 from excitoon-favorites/s3connectionresetretries
Retries on HTTP connection drops during reads from S3
2021-04-20 14:59:21 +03:00
kssenii
a07d44e438 More common 2021-04-20 11:41:32 +00:00
kssenii
7d357baa40 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-20 08:08:50 +00:00
alexey-milovidov
4cef8c68f7
Merge pull request #23258 from azat/wundef
Add -Wundef for gcc builds
2021-04-19 22:45:22 +03:00
kssenii
e89594f376 Better 2021-04-19 15:50:46 +00:00
kssenii
9a91575990 One more test 2021-04-19 15:41:27 +00:00
kssenii
5df0fcc114 Fixes and tests 2021-04-19 15:33:33 +00:00
Nikita Mikhaylov
adc103e338
Merge pull request #21852 from excitoon-favorites/s3stscredentials
Added insecure IMDS credentials provider for S3
2021-04-19 14:47:44 +03:00
kssenii
ce16f4bb3f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-19 08:49:58 +00:00
kssenii
b37fb73468 Continued 2021-04-19 08:14:48 +00:00
Vladimir Chebotarev
9d4295f261 Removed infinite retries. 2021-04-19 11:02:36 +03:00
Vladimir
e4e2b04c53
Merge pull request #23112 from Jokser/disk-s3-restore-to-detached 2021-04-19 10:29:00 +03:00
Azat Khuzhin
2561a67fd8 Replace !__clang__ with !defined(__clang) to fix gcc builds
$ gg 'if !__clang__' | cut -d: -f1 | sort -u | xargs sed -i 's/#if !__clang__/#if !defined(__clang__)/g'
2021-04-18 23:37:50 +03:00
kssenii
d4db8671ed Better 2021-04-18 14:39:05 +00:00