Alexander Tokmakov
021b882455
Revert "Disable parallel s3 multipart upload for part moves. ( #41268 )"
...
This reverts commit 0414d95878
2022-09-22 13:59:25 +03:00
alesapin
57be648984
Merge pull request #41649 from ClickHouse/supress_one_more_key_doesnt_exists
...
Release AWS SDK log level + replace one exception
2022-09-22 12:38:03 +02:00
Alexey Milovidov
45afacdae4
Merge pull request #41186 from ClickHouse/fix-three-fourth-of-trash
...
Fix more than half of the trash
2022-09-22 07:28:26 +03:00
alesapin
499f678112
Release AWS SDK log level + replace one exception
2022-09-21 19:56:42 +02:00
Nikolai Kochetov
0414d95878
Disable parallel s3 multipart upload for part moves. ( #41268 )
...
* Disable parallel s3 multipart upload for part moves.
* Add setting s3_allow_parallel_part_upload
2022-09-21 19:10:32 +02:00
Kruglov Pavel
22e11aef2d
Merge pull request #40910 from Avogar/new-json-formats
...
Add new JSON formats, add improvements and refactoring
2022-09-21 14:19:08 +02:00
Alexey Milovidov
45bd3cfc30
Merge branch 'master' into fix-three-fourth-of-trash
2022-09-20 21:27:41 +02:00
avogar
868ce8bc16
Fix comments, make better naming, add docs, add setting output_format_json_quote_64bit_floats
2022-09-20 13:49:17 +00:00
Alexey Milovidov
03bbf0676f
Merge branch 'master' into revert_prefixes_s3
2022-09-20 06:14:07 +03:00
serxa
2ef696ffe1
fix issues
2022-09-19 18:40:32 +00:00
serxa
7a1d4a404a
add DiskS3* profile events per S3 API calls
2022-09-19 18:10:47 +00:00
serxa
f8aa738511
more conventional profile events names
2022-09-19 17:23:22 +00:00
Sergei Trifonov
ff2e1ff8d8
Merge branch 'master' into support_s3_api_event_metrics
2022-09-19 14:35:45 +02:00
Alexey Milovidov
730655d4fd
Fix 8/9 of trash
2022-09-19 08:53:20 +02:00
Alexey Milovidov
6b752bff3a
Merge branch 'master' into revert_prefixes_s3
2022-09-18 07:10:57 +03:00
Alexey Milovidov
f4a48cd4d6
Remove cruft
2022-09-17 22:16:31 +02:00
alesapin
33216dedf9
Merge pull request #41323 from ClickHouse/remove_bad_exception
...
Fix parts removal in case of connection loss
2022-09-17 19:14:53 +02:00
alesapin
84828874e0
Change log level
2022-09-17 19:06:54 +02:00
alesapin
d9c3549cc8
Revert s3 prefixes + add retries on write requests unexpected errors
2022-09-16 14:43:43 +02:00
Alexey Milovidov
da01982652
Merge pull request #41046 from azat/build/llvm-15
...
Switch to llvm/clang 15
2022-09-16 07:31:06 +03:00
alesapin
ad279940d6
Trying print less scary messages in case No such key for outdated parts
2022-09-14 17:25:58 +02:00
mateng0915
f7f976e94e
remove extra space
2022-09-14 19:19:47 +08:00
mateng0915
f38e262706
fixed the unnecessory changes
2022-09-14 19:19:47 +08:00
mateng0915
5badb1b186
resolve the review comments
2022-09-14 19:19:40 +08:00
teng.ma
a85c917488
fix master conflict
2022-09-14 19:18:31 +08:00
teng.ma
ebea9f9359
Feature: Support Event Tracing when calling Aws S3 API
...
Description:
============
In Computing && Storage Architecture, using S3 as remote / Shared storage, the Method to access S3 is using AWS S3 API
There is a gap between ClickHouse DB with Ozone Operation
In ClickHouse, operation is SQL and background task
In S3 , the operation should be AWS S3 API
And one sql maybe can mapped to multiple API
Solution:
=========
Added Calling API as event into system.events table
2022-09-14 19:18:31 +08:00
Kseniia Sumarokova
b2c9c04c7b
Merge pull request #40821 from kssenii/improve-marks-cache-loading
...
Allow to load marks in threadpool in advance
2022-09-13 12:31:58 +02:00
Kruglov Pavel
7d7606a1e3
Merge pull request #41162 from Avogar/fix-http-redirect
...
Support relative path in Location header after http redirect
2022-09-13 12:10:44 +02:00
kssenii
b7d751b782
Merge remote-tracking branch 'upstream/master' into improve-marks-cache-loading
2022-09-11 13:23:30 +02:00
Azat Khuzhin
4e3135383b
Fix clang-tidy warnings (from clang-15)
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:35 +02:00
Alexey Milovidov
fa62c7e982
Fix half of trash
2022-09-10 04:08:16 +02:00
avogar
d8cbd51333
Support relative path in Location header after http redirect
2022-09-09 19:26:14 +00:00
alesapin
5e00124f8a
More logging for S3
2022-09-08 16:18:21 +02:00
alesapin
6da37b92e1
Improve logging one time
2022-09-08 13:11:53 +02:00
alesapin
43493389b9
Merge branch 'master' into one_more_logging
2022-09-06 19:40:24 +02:00
alesapin
09e97a6381
Fix style
2022-09-06 18:38:34 +02:00
alesapin
ceed9f418b
Return better errors handling
2022-09-06 18:22:44 +02:00
alesapin
422b1658eb
Review fix
2022-09-06 14:42:48 +02:00
alesapin
6ea7f1e011
Better exception handling for ReadBufferFromS3
2022-09-06 13:59:55 +02:00
Sergei Trifonov
f77809ddbc
Merge pull request #40900 from ClickHouse/s3-detailed-metrics
...
S3 detailed metrics
2022-09-06 13:20:57 +02:00
alesapin
cbcf267f55
One more line of logging in write buffer from S3
2022-09-05 22:54:38 +02:00
Kruglov Pavel
cadae5a2f6
Merge pull request #40896 from kssenii/fix-memory-usage-for-remote
...
Fix extra memory allocation for remote read buffers
2022-09-05 20:38:57 +02:00
Sergei Trifonov
1c247308f1
Merge branch 'master' into s3-detailed-metrics
2022-09-05 15:55:41 +02:00
kssenii
e2df4b1da1
Merge remote-tracking branch 'origin/fix-races-in-write-buffer-from-s3' into fix-races-in-write-buffer-from-s3
2022-09-04 19:50:19 +02:00
kssenii
52375d2eb0
Merge master
2022-09-04 19:48:04 +02:00
Kseniia Sumarokova
5f757be43d
Merge pull request #40943 from kssenii/fix-deadlock-in-s3-write-buffer
...
Fix deadlock in WriteBufferFromS3
2022-09-04 13:17:41 +02:00
Kseniia Sumarokova
1e81e0ef67
Update WriteBufferFromS3.cpp
2022-09-02 18:54:34 +02:00
kssenii
239847ad16
Fix races
2022-09-02 18:27:07 +02:00
Sergei Trifonov
067e712fdf
Merge branch 'master' into s3-detailed-metrics
2022-09-02 16:59:52 +02:00
Sergei Trifonov
3daf1f5c77
fix build
2022-09-02 16:57:51 +02:00
