Vitaly Baranov
d02b255b55
Add new setting "allow_head_object_request" to S3::RequestSettings.
2023-01-27 15:10:34 +01:00
Vitaly Baranov
f9282cfcac
Make version_id an optional parameter again.
2023-01-27 15:10:19 +01:00
Vitaly Baranov
aea9ccdb60
Pass request settings to S3::getObjectInfo().
2023-01-27 15:10:09 +01:00
Vitaly Baranov
a8304525ed
Move getObjectInfo() to a separate header.
2023-01-27 15:09:38 +01:00
Alexey Milovidov
f401449bd9
Merge pull request #45661 from ClickHouse/generate-random-lowcardinality
...
Allow LowCardinality in GenerateRandom
2023-01-27 02:14:38 +03:00
Robert Schulze
032cdb986e
Merge pull request #45615 from ClickHouse/fix-gorilla
...
Fix codec pipeline Delta (or DoubleDelta) + Gorilla
2023-01-27 00:04:39 +01:00
Alexey Milovidov
d942a4ddef
Allow LowCardinality in GenerateRandom
2023-01-26 15:35:20 +01:00
Robert Schulze
227b8676cd
Tiny improvements around the Gorilla/Delta codecs
2023-01-26 11:11:24 +00:00
Kseniia Sumarokova
297516a084
Merge pull request #45614 from kssenii/rename-some-setting
...
Rename setting `max_query_cache_size`
2023-01-26 10:46:03 +01:00
kssenii
29de87e145
Rename setting
2023-01-25 16:36:36 +01:00
Vitaly Baranov
32efe92199
Merge pull request #45487 from vitlibar/use-new-copy-s3-functions-in-s3-obj-storage
...
Use new copy s3 functions in S3ObjectStorage
2023-01-25 13:22:04 +01:00
Vitaly Baranov
3fc366e747
Make retries in copyS3File() more correct.
2023-01-24 18:05:40 +01:00
Vitaly Baranov
7d72b28bfe
Use ProfileEvents::S3CopyObject again.
2023-01-24 15:54:15 +01:00
avogar
3c5a81f9f9
Add unit test for recursive checkpoints
2023-01-24 01:20:13 +00:00
Kruglov Pavel
cd1cd904a7
Merge branch 'master' into tsv-csv-detect-header
2023-01-23 23:49:56 +01:00
Alexander Tokmakov
70d1adfe4b
Better formatting for exception messages ( #45449 )
...
* save format string for NetException
* format exceptions
* format exceptions 2
* format exceptions 3
* format exceptions 4
* format exceptions 5
* format exceptions 6
* fix
* format exceptions 7
* format exceptions 8
* Update MergeTreeIndexGin.cpp
* Update AggregateFunctionMap.cpp
* Update AggregateFunctionMap.cpp
* fix
2023-01-24 00:13:58 +03:00
Kruglov Pavel
478a552a0a
Merge branch 'master' into tsv-csv-detect-header
2023-01-23 21:47:17 +01:00
Kruglov Pavel
fd7e04a96d
Merge pull request #45446 from kssenii/fix-assertion-in-cache-over-local
...
Fix Buffer's offsets mismatch logical error in stress test
2023-01-23 14:38:25 +01:00
Alexander Gololobov
91fb1eab8c
Merge pull request #45373 from ClickHouse/throttler-metrics
...
Add detailed profile events for throttling
2023-01-22 11:20:45 +01:00
Vitaly Baranov
5ceb64accc
Use new copy s3 functions in S3ObjectStorage.
2023-01-21 15:47:58 +01:00
Vitaly Baranov
f0fda580d0
Merge pull request #45188 from vitlibar/backup-to-s3-memory-optimization
...
Optimize memory consumption during backup to S3
2023-01-21 12:37:35 +01:00
Alexander Tokmakov
910d6dc0ce
Merge pull request #45342 from ClickHouse/exception_message_patterns
...
Save message format strings for DB::Exception
2023-01-20 18:46:52 +03:00
Kseniia Sumarokova
01320da02b
Update BoundedReadBuffer.cpp
2023-01-20 16:25:02 +01:00
Kruglov Pavel
28ddcc2432
Merge branch 'master' into tsv-csv-detect-header
2023-01-20 15:08:38 +01:00
Kseniia Sumarokova
c066b9bddd
Update SwapHelper.h
2023-01-20 12:19:19 +01:00
Kseniia Sumarokova
ad4a9d2880
Update SwapHelper.h
2023-01-19 18:58:09 +01:00
kssenii
f56f515392
Fix
2023-01-19 18:45:06 +01:00
Yakov Olkhovskiy
c6ee4c3908
Merge pull request #44686 from Algunenano/fix_uuid_parsing_in_values
...
Don't parse beyond the quotes when reading UUIDs
2023-01-18 19:30:53 -05:00
Alexander Tokmakov
5cd90c1a3e
Merge branch 'master' into exception_message_patterns
2023-01-17 20:04:04 +01:00
Alexander Tokmakov
72e8615bec
formatting of some exception messages
2023-01-17 20:03:56 +01:00
serxa
ce7e22b87b
add detailed profile events for throttling
2023-01-17 18:29:24 +00:00
Vitaly Baranov
1a680b0092
Abort multipart upload faster.
2023-01-17 18:00:11 +01:00
Vitaly Baranov
2de455367a
Fix using std::ios_base::end in StdStreamFromReadBuffer::seekg().
2023-01-17 17:56:14 +01:00
Kruglov Pavel
96bb99f864
Merge branch 'master' into tsv-csv-detect-header
2023-01-17 15:33:02 +01:00
Vitaly Baranov
0bea056241
Fix build.
2023-01-17 09:52:08 +01:00
Vitaly Baranov
1c845185c1
Split upload into parts of the same size for smooth uploading.
...
Correctly use AbortMultipleUpload request.
Support std::ios_base::end StdStreamBufFromReadBuffer::seekpos().
2023-01-17 09:35:43 +01:00
Vitaly Baranov
14a7ee8e26
Copy files to S3 during backup directly without using WriteBufferFromS3 to decrease memory consumption.
2023-01-17 09:35:41 +01:00
Alexander Tokmakov
522686f78b
less empty patterns
2023-01-17 01:19:44 +01:00
Vitaly Baranov
9a52087989
More complex logic: GetObjectAttributes requests will be used
...
only if the endpoint is "*.amazonaws.com", otherwise HeadObject requests will be used.
2023-01-16 20:14:39 +01:00
avogar
3ea80b0f54
Merge branch 'master' of github.com:ClickHouse/ClickHouse into tsv-csv-detect-header
2023-01-16 15:14:25 +00:00
Vitaly Baranov
7030b64096
Fix build.
2023-01-16 10:46:58 +01:00
Vitaly Baranov
16a20cd06e
Use std::string_view instead of const std::string_view &
2023-01-16 10:18:04 +01:00
Vitaly Baranov
e435edb4ab
Make checkObjectExists() easier.
2023-01-16 10:06:20 +01:00
Vitaly Baranov
a955504043
Move throw_on_error parameter to the end.
2023-01-15 20:28:16 +01:00
Vitaly Baranov
21b8aaeb8b
Stop using HeadObject requests in S3
...
because they don't work well with endpoints without explicit region.
2023-01-15 20:28:11 +01:00
Vitaly Baranov
00908dcc6c
Fix http requests without path for AWS. ( #45238 )
2023-01-13 12:35:39 +01:00
avogar
b461935374
Better
2023-01-12 13:11:04 +00:00
Kruglov Pavel
05a11ff4a4
Merge branch 'master' into tsv-csv-detect-header
2023-01-12 12:35:18 +01:00
avogar
26cd56d113
Fix tests, make better
2023-01-11 22:52:15 +00:00
avogar
3b45863d15
Make better implementation, fix tests
2023-01-11 17:12:56 +00:00
