51 Commits

Author	SHA1	Message	Date
kssenii	e51313b6b3	Get rid of static threadpools	2022-09-07 17:48:11 +02:00
kssenii	239847ad16	Fix races	2022-09-02 18:27:07 +02:00
kssenii	c9b512e33e	Fix	2022-09-02 16:15:54 +02:00
kssenii	8ad26b3111	Merge master	2022-07-16 22:50:03 +02:00
Sergei Trifonov	43779ec280	add max_remote_{read,write}_network_bandwidth_for_server settings	2022-07-11 14:59:39 +02:00
kssenii	aaf9a46f07	Merge master	2022-06-11 15:56:05 +02:00
Azat Khuzhin	62d78d8f20	Fix WriteBufferFromS3 is_finalized check in case of exception ... WriteBufferFromS3::is_finalized is not set if finalizeImpl() throws, while WriteBuffer::finalized correctly set even in case of exception, so it should be used instead. Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>	2022-06-01 21:50:30 +03:00
kssenii	25b1ed526d	Merge master	2022-05-27 16:50:45 +02:00
kssenii	646cf4cc95	Better	2022-05-14 14:26:04 +02:00
kssenii	58faaf0ea3	Merge master	2022-05-13 18:51:07 +02:00
alesapin	5dcd25be23	Initial implementation	2022-05-12 00:04:54 +02:00
alesapin	991f78b485	Get rid of atomic	2022-05-03 12:17:50 +02:00
alesapin	98e3b16560	Terminate if S3 buffer is not finalized	2022-05-02 22:14:18 +02:00
Amos Bird	4a5e4274f0	base should not depend on Common	2022-04-29 10:26:35 +08:00
kssenii	24e376337d	Merge with master	2022-04-21 12:33:56 +02:00
Kseniia Sumarokova	f37812f89a	Merge pull request #36079 from kssenii/change-hashed-path ... Change hashed path for cache	2022-04-20 10:27:44 +02:00
kssenii	9804c39de7	Composable cache	2022-04-12 14:33:13 +02:00
kssenii	138588be29	Change hashed path	2022-04-08 17:14:13 +02:00
kssenii	87855c4ae7	Merge master	2022-04-08 12:32:48 +02:00
kssenii	5dce2f18b5	Better	2022-04-07 18:48:35 +02:00
kssenii	79627798c4	Fix race	2022-04-04 20:44:39 +02:00
kssenii	4e50da722b	Better s3 settings	2022-04-04 16:14:56 +02:00
kssenii	36c583d0de	Better version of cache on insert	2022-04-04 10:58:59 +02:00
kssenii	34c0690a69	Better	2022-03-23 15:43:14 +01:00
kssenii	eabbce69a7	Add system drop remote filesystem cache query, allow to write cache on insert	2022-03-21 12:32:44 +01:00
kssenii	1d80262a2a	Add write settings, file cache settings	2022-03-21 09:50:50 +01:00
Azat Khuzhin	9f7fae56b0	WriteBufferFromS3: remove unused headers ... Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>	2022-03-14 12:07:47 +03:00
alesapin	f6e7cea1f8	Add settings for S3 multipart upload parts size	2022-02-08 19:38:04 +03:00
Nikolai Kochetov	2003a96b58	Probably fix something	2022-02-02 17:48:41 +00:00
Amos Bird	e29c77f793	Fix link order issue of WriteBufferFromS3 ... (cherry picked from commit f22b09f4fc)	2022-02-01 10:42:06 +00:00
Nikolai Kochetov	2a6eb593be	Revert "Revert "Add pool to WriteBufferFromS3""	2022-02-01 13:36:51 +03:00
alexey-milovidov	095d9bfa43	Revert "Add pool to WriteBufferFromS3"	2022-02-01 05:49:40 +03:00
Nikolai Kochetov	2e88319b72	Fix integration tests.	2022-01-25 18:48:28 +00:00
Nikolai Kochetov	6c65915241	Fix style	2022-01-24 16:12:23 +00:00
Nikolai Kochetov	506ee8c024	Refactor some code.	2022-01-24 15:55:29 +00:00
Nikolai Kochetov	4afa75e80b	Fix deduplication.	2022-01-24 14:43:36 +00:00
Nikolai Kochetov	68bf38133a	Add pool to WriteBufferFromS3	2021-12-29 14:04:21 +00:00
avogar	c521a9131a	Small refactoring of WriteBiffer-s	2021-11-11 02:11:18 +03:00
Alexey Milovidov	8b4a6a2416	Remove cruft	2021-10-28 02:10:39 +03:00
Alexey Milovidov	fe6b7c77c7	Rename "common" to "base"	2021-10-02 10:13:14 +03:00
Maksim Kita	30c78c0a23	Fix arcadia	2021-06-11 14:26:33 +03:00
Azat Khuzhin	6ebe4e7dbb	Do not silently catch errors for writing to S3	2021-04-25 12:47:30 +03:00
Pavel Kovalenko	71b36a7029	Better error handling and logging in WriteBufferFromS3	2021-03-17 17:20:55 +03:00
Pavel Kovalenko	59a5e63417	Merge remote-tracking branch 'origin/master' into s3-adaptive-single-part-upload ... # Conflicts: # src/Disks/S3/DiskS3.cpp # src/Disks/S3/DiskS3.h # src/Disks/S3/registerDiskS3.cpp # src/IO/WriteBufferFromS3.cpp # src/IO/WriteBufferFromS3.h	2020-12-11 18:28:41 +03:00
Pavel Kovalenko	db7a87089b	Adaptive choose of single/multi part upload in WriteBufferFromS3.	2020-12-09 17:09:04 +03:00
Pavel Kovalenko	dfbb31174e	Ability to set metadata when put S3 object	2020-12-08 21:31:57 +03:00
Vladimir Chebotarev	0497ce4f9c	Possibly better fix.	2020-09-30 18:29:10 +03:00
Artem Zuikov	51ba12c2c3	Try speedup build (#14809)	2020-09-15 12:55:57 +03:00
Vladimir Chebotarev	faf6be6576	Implemented single part uploads for DiskS3 (#12026) ... * Implemented single part uploads for DiskS3. * Added `min_multi_part_upload_size` to disk configuration.	2020-07-09 17:09:17 +03:00
Alexey Milovidov	25f941020b	Remove namespace pollution	2020-05-31 00:57:37 +03:00