serxa
8724c5ad52
Merge branch 'master' into s3-streams-scheduler
2024-08-02 09:52:55 +00:00
Alexey Milovidov
75b042e9bd
Merge branch 'master' into fix-idiotic-code
2024-07-20 02:29:59 +02:00
Sema Checherinda
36468c528d
relax condition in test, remove unused counters
2024-07-18 19:55:09 +02:00
Alexey Milovidov
c7be25f0a1
Fix everything
2024-07-18 04:54:36 +02:00
Sergei Trifonov
e15b1fbb45
Merge branch 'master' into s3-streams-scheduler
2024-06-14 18:12:19 +02:00
serxa
aad55ab55f
IO scheduling on HTTP session level
2024-06-12 14:49:06 +00:00
kssenii
80f195d2b9
Refactor s3 settings
2024-05-27 12:11:04 +02:00
Antonio Andelic
449aacb3d0
Correct
2024-05-13 15:08:52 +02:00
Antonio Andelic
2b38b8a97b
Correct byte count
2024-05-13 14:49:26 +02:00
Antonio Andelic
e65dd3d939
Cancel S3 reads properly when parallel reads are used
2024-05-13 12:36:29 +02:00
Sema Checherinda
083bcfc1ce
distinct message for s3 error 'no key' for cases disk and storage
2024-05-02 13:08:25 +02:00
Sema Checherinda
5c41727725
http connections pools
2024-03-10 10:00:18 +01:00
serxa
824deab761
split resource scheduler off IO/ into Common/Scheduler/
2024-01-20 12:06:26 +00:00
Azat Khuzhin
896cbb6a75
Retry on poco exceptions while reading from S3 as well
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-23 09:07:43 +01:00
Nikita Mikhaylov
a0af0392cd
Random changes in random files ( #57642 )
2023-12-14 12:47:11 +01:00
Sema Checherinda
f999337dae
Revert "Revert "s3 adaptive timeouts""
2023-11-20 14:53:22 +01:00
Alexander Tokmakov
5031f239c3
Revert "s3 adaptive timeouts"
2023-11-20 14:28:59 +01:00
Sema Checherinda
3075bd9745
track clickhouse high level retries
2023-11-14 11:34:12 +01:00
Aleksei Filatov
f56804e6e7
Use pool for proxified S3 http sessions
2023-10-17 12:15:43 +03:00
Michael Kolupaev
9af9b4a085
Enable connection pooling for s3 table function ( #54812 )
...
Enable connection pooling for s3 table function
2023-09-21 09:27:20 -07:00
Michael Kolupaev
df71dcd94d
Fix data race in copyFromIStreamWithProgressCallback
2023-09-11 21:04:37 +00:00
Sema Checherinda
81577e041b
fix Logical Error in AsynchronousBoundedReadBuffer
2023-08-21 19:30:04 +02:00
Nikita Taranov
aec7205636
rework pool usage
2023-07-06 14:41:09 +02:00
Nikita Taranov
876d5ae0a7
fix ReadBufferFromS3
2023-06-20 20:27:43 +02:00
Nikita Taranov
b546d8e665
review fixes + test
2023-06-16 15:30:56 +02:00
Nikita Taranov
1dddcc9472
use connection pool
2023-06-14 12:51:02 +02:00
Michael Kolupaev
b51064a508
Get rid of SeekableReadBufferFactory, add SeekableReadBuffer::readBigAt() instead
2023-06-01 18:48:30 -07:00
kssenii
cd25d61795
Merge remote-tracking branch 'upstream/master' into cache-better-locks
2023-04-17 19:47:43 +02:00
Michael Kolupaev
87be78e6de
Better
2023-04-17 04:58:32 +00:00
Michael Kolupaev
e133633359
Parallel decoding with one row group per thread
2023-04-17 04:58:32 +00:00
Michael Kolupaev
683077890f
Highly questionable refactoring (getInputMultistream() nonsense)
2023-04-17 04:58:32 +00:00
Michael Kolupaev
2d4fe85513
Something
2023-04-17 04:58:32 +00:00
Michael Kolupaev
dc6e34075e
Read less unnecessary data from Parquet files
2023-04-17 04:58:32 +00:00
kssenii
d94d08c18d
Fix tests
2023-03-30 15:58:12 +02:00
kssenii
3067c1d723
Merge remote-tracking branch 'upstream/master' into resubmit-prefetches
2023-02-11 11:36:23 +01:00
kssenii
b0b865c32e
Resubmit prefetches
2023-02-08 21:26:24 +01:00
Sergei Trifonov
b0fc551c27
Merge branch 'master' into io-scheduler-integration
2023-02-08 18:16:00 +01:00
Antonio Andelic
d5117f2aa6
Define S3 client with bucket and endpoint resolution ( #45783 )
...
* Update aws
* Define S3 client with bucket and endpoint resolution
* Add defines for ErrorCodes
* Use S3Client everywhere
* Remove unused errorcode
* Add DROP S3 CLIENT CACHE query
* Add a comment
* Fix style
* Update aws
* Update reference files
* Add missing include
* Fix unit test
* Remove unneeded declarations
* Correctly use RetryStrategy
* Rename S3Client to Client
* Fix retry count
* fix clang-tidy warnings
2023-02-03 14:30:52 +01:00
serxa
21e871a0a4
integrate IO scheduler with buffers
2023-01-27 18:47:22 +00:00
Vitaly Baranov
aea9ccdb60
Pass request settings to S3::getObjectInfo().
2023-01-27 15:10:09 +01:00
Vitaly Baranov
a8304525ed
Move getObjectInfo() to a separate header.
2023-01-27 15:09:38 +01:00
Alexander Tokmakov
70d1adfe4b
Better formatting for exception messages ( #45449 )
...
* save format string for NetException
* format exceptions
* format exceptions 2
* format exceptions 3
* format exceptions 4
* format exceptions 5
* format exceptions 6
* fix
* format exceptions 7
* format exceptions 8
* Update MergeTreeIndexGin.cpp
* Update AggregateFunctionMap.cpp
* Update AggregateFunctionMap.cpp
* fix
2023-01-24 00:13:58 +03:00
Alexander Gololobov
91fb1eab8c
Merge pull request #45373 from ClickHouse/throttler-metrics
...
Add detailed profile events for throttling
2023-01-22 11:20:45 +01:00
serxa
ce7e22b87b
add detailed profile events for throttling
2023-01-17 18:29:24 +00:00
Vitaly Baranov
a955504043
Move throw_on_error parameter to the end.
2023-01-15 20:28:16 +01:00
Anton Popov
0c87031e80
Merge remote-tracking branch 'upstream/master' into HEAD
2022-12-13 16:33:21 +00:00
Anton Popov
65a78bcd91
improve performance of storage S3
2022-11-26 15:24:01 +00:00
kssenii
5e01441f61
Show progress bar while reading from s3 table function
2022-11-21 17:56:02 +01:00
Sergei Trifonov
f2f0676bcc
Revert "Revert "S3 request per second rate throttling""
2022-11-17 17:35:04 +01:00
Alexander Tokmakov
9011a18234
Revert "S3 request per second rate throttling"
2022-11-16 22:33:48 +03:00
