Pavel Kovalenko
346c241c20
Merge remote-tracking branch 'origin/master' into s3-adaptive-single-part-upload
...
# Conflicts:
# src/Disks/S3/DiskS3.cpp
2020-12-14 11:00:30 +03:00
alexey-milovidov
04e222f6f3
Merge pull request #17986 from azat/fwd-decl
...
More forward declaration for generic headers
2020-12-13 01:12:05 +03:00
Azat Khuzhin
5b3ab48861
More forward declaration for generic headers
...
The following headers are pretty generic, so use forward declaration as
much as possible:
- Context.h
- Settings.h
- ConnectionTimeouts.h
(Also this shows that some missing some includes -- this has been fixed)
And split ConnectionTimeouts.h into ConnectionTimeoutsContext.h (since
module part cannot be added for it, due to recursive build dependencies
that will be introduced)
Also remove Settings from the RemoteBlockInputStream/RemoteQueryExecutor
and just pass the context, since settings was passed only in speicifc
places, that can allow making a copy of Context (i.e. Copier).
Approx results (How much units will be recompiled after changing file X?):
- ConnectionTimeouts.h
- mainline: 100
- Context.h:
- mainline: ~800
- patched: 415
- Settings.h:
- mainline: 900-1K
- patched: 440 (most of them because of the Context.h)
2020-12-12 17:43:10 +03:00
Pavel Kovalenko
25df6bae78
Add nested exception when handle Disk S3 metadata file read error.
2020-12-12 17:11:47 +03:00
Pavel Kovalenko
59a5e63417
Merge remote-tracking branch 'origin/master' into s3-adaptive-single-part-upload
...
# Conflicts:
# src/Disks/S3/DiskS3.cpp
# src/Disks/S3/DiskS3.h
# src/Disks/S3/registerDiskS3.cpp
# src/IO/WriteBufferFromS3.cpp
# src/IO/WriteBufferFromS3.h
2020-12-11 18:28:41 +03:00
Pavel Kovalenko
72a55c192e
Fix master branch merge artifact.
2020-12-11 18:23:59 +03:00
Pavel Kovalenko
75bdb813ea
Merge remote-tracking branch 'origin/master' into disk-s3-remove-empty-metadata-files
...
# Conflicts:
# src/Disks/S3/DiskS3.cpp
2020-12-11 18:22:31 +03:00
Pavel Kovalenko
de4a7a8865
Correct handling S3 disk metadata file read exceptions.
2020-12-11 14:27:58 +03:00
Pavel Kovalenko
5bf388683c
Correct handling S3 disk metadata file read exceptions.
2020-12-11 14:21:54 +03:00
Kruglov Pavel
9a785dbbf5
Merge branch 'master' into disk-s3-send-metadata
2020-12-10 20:17:41 +03:00
Vladimir Chebotarev
39d867e56d
Added proper authentication for S3 client ( #16856 )
2020-12-10 12:19:42 +03:00
Pavel Kovalenko
5802633f95
Fix parameter name in constructor of DiskS3
2020-12-09 18:38:02 +03:00
Pavel Kovalenko
818cdd353a
Remove empty or bad metadata files from FS for DiskS3.
2020-12-09 18:01:30 +03:00
Pavel Kovalenko
db7a87089b
Adaptive choose of single/multi part upload in WriteBufferFromS3.
2020-12-09 17:09:04 +03:00
Pavel Kovalenko
dfbb31174e
Ability to set metadata when put S3 object
2020-12-08 21:31:57 +03:00
Alexey Milovidov
4ecfe8fef4
Remove unused headers
2020-12-08 02:10:22 +03:00
Alexander Tokmakov
bfbf150c67
fix segfault when 'not enough space'
2020-12-02 17:49:43 +03:00
alesapin
45f09fe293
Merge pull request #17220 from ianton-ru/s3_max_redirects
...
S3 max redirects
2020-11-24 12:13:10 +03:00
Anton Ivashkin
aa208a9d9f
Use only 's3_max_redirect' in params instead of all settings
2020-11-23 14:02:17 +03:00
Pavel Kovalenko
f6041c2280
Use default value for read-only flag in metadata for Disk3.
2020-11-23 00:14:52 +03:00
Pavel Kovalenko
9cbb251be6
Store read-only flag into metadata file for DiskS3.
2020-11-20 14:08:43 +03:00
Alexey Milovidov
24f4fa6edf
Follow Arcadia ya.make rules
2020-11-17 00:16:50 +03:00
Alexey Milovidov
3df04ce0c2
Follow Arcadia ya.make rules
2020-11-16 21:24:58 +03:00
Anton Ivashkin
026f7e0a27
Add 's3_max_redirects' setting
2020-11-13 19:31:51 +03:00
Alexey Milovidov
b56486510f
Improve Arcadia
2020-11-05 12:55:01 +03:00
Maxim Akhmedov
3627fabfb9
Remove -g0 form Arcadia build settings.
2020-10-29 17:37:23 +03:00
alesapin
4b65d5469f
Fix some unrelated performance issues in select parts for merge
2020-10-22 15:41:01 +03:00
Vladimir Chebotarev
aa5f207fd4
Added disable_merges option for volumes in multi-disk configuration ( #13956 )
...
Co-authored-by: Alexander Kazakov <Akazz@users.noreply.github.com>
2020-10-20 18:10:24 +03:00
Alexey Milovidov
94592819ad
Add comment
2020-10-20 04:29:13 +03:00
Pavel Kovalenko
a474bdcabf
Merge remote-tracking branch 'origin/master' into idempotent-part-move
2020-10-16 13:02:40 +03:00
Alexey Milovidov
269b6383f5
Check for #pragma once in headers
2020-10-10 21:37:02 +03:00
Pavel Kovalenko
69c126f1f1
Possibility to move part to another disk/volume if first attempt was failed.
2020-10-07 14:35:28 +03:00
Pavel Kovalenko
69b4bc6f33
Proper error handling during insert into MergeTree with S3.
2020-10-06 12:38:00 +03:00
alexey-milovidov
5e37ba4335
Update DiskS3.cpp
2020-10-03 03:47:45 +03:00
alexey-milovidov
3ca7fca48a
Update DiskS3.cpp
2020-10-03 03:42:33 +03:00
Anton Ivashkin
c18cdec77c
Use S3 multi object delete
...
Some strange with s3_with_proxy test
2020-09-28 11:47:04 +03:00
alexey-milovidov
1474b80ecc
Merge pull request #15008 from ClickHouse/clang-tidy-11-without-enabling
...
Fix terribly wrong code
2020-09-20 02:00:54 +03:00
Alexey Milovidov
ef5363b87f
Fix terribly wrong code
2020-09-19 02:05:13 +03:00
Pavel Kovalenko
da04a130ed
Add option to disable ttl move on data part insert - minor fixes.
2020-09-18 20:45:30 +03:00
Pavel Kovalenko
0da19ab46d
Add option to disable ttl move on data part insert
2020-09-18 18:30:00 +03:00
Artem Zuikov
51ba12c2c3
Try speedup build ( #14809 )
2020-09-15 12:55:57 +03:00
Anton Popov
af4089c606
Merge remote-tracking branch 'upstream/master' into HEAD
2020-09-11 00:39:21 +03:00
Pavel Kovalenko
3632b0bdb3
Add option to DiskS3 that allows it's usage if S3 unavailable ( #14497 )
2020-09-09 02:35:57 +03:00
alesapin
bea15175d6
Merge pull request #14496 from Jokser/disk-s3-shutdown
...
Disable S3 requests processing during context shutdown to speed up termination process
2020-09-08 15:21:54 +03:00
Pavel Kovalenko
5e39f8b32b
Add comment explaining DiskS3::shutdown
2020-09-08 15:20:35 +03:00
Alexey Milovidov
e3924b8057
Fix "Arcadia"
2020-09-08 01:14:13 +03:00
Pavel Kovalenko
c933f72adb
Disable S3 requests processing during context shutdown to speed up termination process.
2020-09-04 17:17:27 +03:00
Anton Popov
4331158d30
merge with master
2020-08-24 16:09:23 +03:00
Anton Popov
4df5c72878
Merge remote-tracking branch 'upstream/master' into HEAD
2020-08-24 12:57:27 +03:00
alexey-milovidov
7b53a0ef33
Revert "Added allow_merges option for volumes in multi-disk configuration ( #13402 )"
...
This reverts commit 1e2616542a
2020-08-21 18:44:29 +03:00
