ClickHouse/src/IO
Dmitry Novik 197116dfeb
Merge pull request #46451 from ClickHouse/copy-s3-file-fix
Wait for tasks finish when scheduler failed
2023-02-17 20:11:23 +01:00
..
Archives Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
examples fix 2023-01-27 01:22:29 +01:00
Resource integrate IO scheduler with buffers 2023-01-27 18:47:22 +00:00
S3 Merge pull request #46451 from ClickHouse/copy-s3-file-fix 2023-02-17 20:11:23 +01:00
tests Add unit test for recursive checkpoints 2023-01-24 01:20:13 +00:00
AIO.cpp Fix -Wshorten-64-to-32 on FreeBSD 2022-12-12 08:05:28 +01:00
AIO.h Fix clang-tidy warnings in Interpreters, IO folders 2022-03-14 18:17:35 +00:00
AsynchronousReadBufferFromFile.cpp Check return value of ::close() 2023-02-07 11:28:22 +01:00
AsynchronousReadBufferFromFile.h Fix threadpool reader (for local fs) 2022-09-23 19:35:16 +02:00
AsynchronousReadBufferFromFileDescriptor.cpp Resubmit prefetches 2023-02-08 21:26:24 +01:00
AsynchronousReadBufferFromFileDescriptor.h Resubmit prefetches 2023-02-08 21:26:24 +01:00
AsynchronousReader.h Resubmit prefetches 2023-02-08 21:26:24 +01:00
AsyncReadCounters.cpp Resubmit prefetches 2023-02-08 21:26:24 +01:00
AsyncReadCounters.h Resubmit prefetches 2023-02-08 21:26:24 +01:00
BitHelpers.h Tiny improvements around the Gorilla/Delta codecs 2023-01-26 11:11:24 +00:00
BoundedReadBuffer.cpp Update BoundedReadBuffer.cpp 2023-01-20 16:25:02 +01:00
BoundedReadBuffer.h Review fixes 2022-07-17 15:13:28 +02:00
BrotliReadBuffer.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
BrotliReadBuffer.h show names of erroneous files 2022-04-16 00:10:47 +00:00
BrotliWriteBuffer.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
BrotliWriteBuffer.h Fix comments 2021-11-22 14:19:26 +03:00
BufferBase.h Update BufferBase.h 2022-02-07 17:49:53 +03:00
BufferWithOwnMemory.h Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
Bzip2ReadBuffer.cpp Fixes for -Wshorten-64-to-32 2022-10-21 13:25:19 +02:00
Bzip2ReadBuffer.h show names of erroneous files 2022-04-16 00:10:47 +00:00
Bzip2WriteBuffer.cpp Fixes for -Wshorten-64-to-32 2022-10-21 13:25:19 +02:00
Bzip2WriteBuffer.h Fix comments 2021-11-22 14:19:26 +03:00
CascadeWriteBuffer.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
CascadeWriteBuffer.h Fix clang-tidy warnings in Interpreters, IO folders 2022-03-14 18:17:35 +00:00
CMakeLists.txt fix unit test and build error 2022-01-06 11:41:24 +08:00
CompressedReadBufferWrapper.h Resubmit prefetches 2023-02-08 21:26:24 +01:00
CompressionMethod.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
CompressionMethod.h Add methods to the tests 2022-10-04 19:04:03 +00:00
ConcatReadBuffer.h Use BackupEntryFromAppendOnlyFile for Log engine, 2022-03-20 20:02:15 +01:00
ConcatSeekableReadBuffer.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
ConcatSeekableReadBuffer.h Fix incremental backups for Log family. 2022-08-31 12:57:28 +02:00
ConnectionTimeouts.cpp Cosmetics 2023-02-07 11:42:31 +00:00
ConnectionTimeouts.h Cosmetics 2023-02-07 11:42:31 +00:00
copyData.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
copyData.h Add tests 2021-05-27 15:54:47 +03:00
DoubleConverter.cpp
DoubleConverter.h abort instead of __builtin_unreachable in debug builds 2022-10-07 21:49:08 +02:00
EmptyReadBuffer.h
FileEncryptionCommon.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
FileEncryptionCommon.h Generate config.h into ${CONFIG_INCLUDE_PATH} 2022-09-28 12:48:26 +00:00
ForkWriteBuffer.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
ForkWriteBuffer.h Addressed review comments 2022-07-20 21:02:54 +02:00
HadoopSnappyReadBuffer.cpp forbid old ctor of Exception 2023-01-23 22:18:05 +01:00
HadoopSnappyReadBuffer.h abort instead of __builtin_unreachable in debug builds 2022-10-07 21:49:08 +02:00
HashingReadBuffer.h Fix incremental backups for Log family. 2022-08-31 12:57:28 +02:00
HashingWriteBuffer.cpp
HashingWriteBuffer.h Allow LowCardinality in GenerateRandom 2023-01-26 15:35:20 +01:00
HTTPChunkedReadBuffer.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
HTTPChunkedReadBuffer.h fix heap buffer overflow by limiting http chunk size 2022-08-18 14:30:52 +02:00
HTTPCommon.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
HTTPCommon.h formatting of some exception messages 2023-01-17 20:03:56 +01:00
HTTPHeaderEntries.h Replace old named collections code for url 2022-12-17 00:24:05 +01:00
IOThreadPool.cpp Address PR comments 2022-03-16 15:45:17 +00:00
IOThreadPool.h Use a shared IO thread pool 2022-03-11 08:33:34 +00:00
IReadableWriteBuffer.h
IResourceManager.h integrate IO scheduler with buffers 2023-01-27 18:47:22 +00:00
ISchedulerConstraint.h fix typos 2022-09-27 15:20:43 +00:00
ISchedulerNode.h fix build 2022-11-24 18:06:10 +00:00
ISchedulerQueue.h fix typos 2023-01-27 22:48:02 +00:00
LimitReadBuffer.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
LimitReadBuffer.h Rename "common" to "base" 2021-10-02 10:13:14 +03:00
LimitSeekableReadBuffer.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
LimitSeekableReadBuffer.h Copy files to S3 during backup directly without using WriteBufferFromS3 to decrease memory consumption. 2023-01-17 09:35:41 +01:00
Lz4DeflatingWriteBuffer.cpp check number of parameters in format string 2023-01-23 23:16:16 +01:00
Lz4DeflatingWriteBuffer.h Fix clang-tidy warnings in Interpreters, IO folders 2022-03-14 18:17:35 +00:00
Lz4InflatingReadBuffer.cpp show names of erroneous files 2022-04-16 00:10:47 +00:00
Lz4InflatingReadBuffer.h show names of erroneous files 2022-04-16 00:10:47 +00:00
LZMADeflatingWriteBuffer.cpp Fix comments 2021-11-22 14:19:26 +03:00
LZMADeflatingWriteBuffer.h Fix comments 2021-11-22 14:19:26 +03:00
LZMAInflatingReadBuffer.cpp show names of erroneous files 2022-04-16 00:10:47 +00:00
LZMAInflatingReadBuffer.h show names of erroneous files 2022-04-16 00:10:47 +00:00
MemoryReadWriteBuffer.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
MemoryReadWriteBuffer.h Fix clang-tidy warnings in Interpreters, IO folders 2022-03-14 18:17:35 +00:00
MMappedFile.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
MMappedFile.h Rename as suggested by Kita 2021-03-28 22:24:28 +03:00
MMappedFileCache.h Change class LRUCache to class CachBase. Check running CacheBase with default pcahce policy SLRU 2022-08-07 19:59:30 +00:00
MMappedFileDescriptor.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
MMappedFileDescriptor.h Fix clang-tidy warnings in Interpreters, IO folders 2022-03-14 18:17:35 +00:00
MMapReadBufferFromFile.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
MMapReadBufferFromFile.h
MMapReadBufferFromFileDescriptor.cpp Adapt internal data structures to 512-bit era (#42564) 2022-10-25 13:56:28 +02:00
MMapReadBufferFromFileDescriptor.h improvements for getFileSize 2022-06-20 15:22:56 +02:00
MMapReadBufferFromFileWithCache.cpp Rewrite StorageFile buffer creation with createReadBufferFromFileBase. 2022-12-07 22:31:32 -05:00
MMapReadBufferFromFileWithCache.h Revert "[RFC] Fix memory tracking with min_bytes_to_use_mmap_io" 2021-04-19 01:30:53 +03:00
MySQLBinlogEventReadBuffer.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
MySQLBinlogEventReadBuffer.h More fixes for PVS-Studio 2021-05-08 19:12:49 +03:00
MySQLPacketPayloadReadBuffer.cpp Enforce checking read output 2022-11-11 10:56:18 +01:00
MySQLPacketPayloadReadBuffer.h
MySQLPacketPayloadWriteBuffer.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
MySQLPacketPayloadWriteBuffer.h Fix clang-tidy warnings in Interpreters, IO folders 2022-03-14 18:17:35 +00:00
NullWriteBuffer.cpp
NullWriteBuffer.h Fix clang-tidy warnings in Interpreters, IO folders 2022-03-14 18:17:35 +00:00
OpenedFile.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
OpenedFile.h Improve performance of file descriptor cache by narrowing mutex scopes (#36682) 2022-04-28 14:56:53 +02:00
OpenedFileCache.h Fix OpenedFileCacheHits/OpenedFileCacheMisses 2021-11-10 21:15:27 +03:00
Operators.h Fix test failures 2022-07-20 07:59:02 +00:00
ParallelReadBuffer.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
ParallelReadBuffer.h Fix 2022-09-08 12:23:59 +02:00
parseDateTimeBestEffort.cpp format more messages 2023-01-25 21:16:42 +01:00
parseDateTimeBestEffort.h initial changes to close #37492 2022-08-08 19:45:00 -07:00
PeekableReadBuffer.cpp fix 2023-01-24 17:10:54 +01:00
PeekableReadBuffer.h Resubmit prefetches 2023-02-08 21:26:24 +01:00
Progress.cpp Do not write elapsed_ns in HTTP headers 2022-08-10 09:09:04 +02:00
Progress.h Fix error 2022-08-10 09:31:24 +02:00
ReadBuffer.cpp Copy files to S3 during backup directly without using WriteBufferFromS3 to decrease memory consumption. 2023-01-17 09:35:41 +01:00
ReadBuffer.h Resubmit prefetches 2023-02-08 21:26:24 +01:00
ReadBufferFromEmptyFile.h improvements for getFileSize 2022-06-20 15:22:56 +02:00
ReadBufferFromEncryptedFile.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
ReadBufferFromEncryptedFile.h Generate config.h into ${CONFIG_INCLUDE_PATH} 2022-09-28 12:48:26 +00:00
ReadBufferFromFile.cpp Check return value of ::close() 2023-02-07 11:28:22 +01:00
ReadBufferFromFile.h Better 2022-05-09 21:25:26 +02:00
ReadBufferFromFileBase.cpp Fix builds 2023-01-10 19:22:18 +00:00
ReadBufferFromFileBase.h Fix builds 2023-01-10 19:22:18 +00:00
ReadBufferFromFileDecorator.cpp Refactoring of object storages, add LocalObjectStorage 2022-07-09 12:39:31 +02:00
ReadBufferFromFileDecorator.h improvements for getFileSize 2022-06-20 15:22:56 +02:00
ReadBufferFromFileDescriptor.cpp Resubmit prefetches 2023-02-08 21:26:24 +01:00
ReadBufferFromFileDescriptor.h Resubmit prefetches 2023-02-08 21:26:24 +01:00
ReadBufferFromIStream.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
ReadBufferFromIStream.h better 2021-04-13 22:39:42 +03:00
ReadBufferFromMemory.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
ReadBufferFromMemory.h Add convenience ctor to ReadBufferFromMemory 2022-10-27 10:26:55 +02:00
ReadBufferFromPocoSocket.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
ReadBufferFromPocoSocket.h Poco::Timespan reference fix 2021-04-29 19:11:20 +03:00
ReadBufferFromS3.cpp Merge remote-tracking branch 'upstream/master' into resubmit-prefetches 2023-02-11 11:36:23 +01:00
ReadBufferFromS3.h Define S3 client with bucket and endpoint resolution (#45783) 2023-02-03 14:30:52 +01:00
ReadBufferFromString.h refactor metadatacache to reduce using of USE_ROCKSDB 2022-01-05 19:51:50 +08:00
readDecimalText.h reformat ParsingException 2023-01-24 23:21:29 +01:00
readFloatText.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
readFloatText.h reformat ParsingException 2023-01-24 23:21:29 +01:00
ReadHelpers.cpp forbid runtime strings 2023-01-26 10:52:47 +01:00
ReadHelpers.h reformat ParsingException 2023-01-24 23:21:29 +01:00
ReadSettings.h Merge remote-tracking branch 'upstream/master' into resubmit-prefetches 2023-02-11 11:36:23 +01:00
ReadWriteBufferFromHTTP.h Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
ResourceBudget.h fix typos 2023-01-27 22:48:02 +00:00
ResourceGuard.h fix typos 2023-01-27 22:48:02 +00:00
ResourceLink.h integrate IO scheduler with buffers 2023-01-27 18:47:22 +00:00
ResourceManagerFactory.h IO scheduling subsystem 2022-09-27 13:26:41 +00:00
ResourceRequest.h integrate IO scheduler with buffers 2023-01-27 18:47:22 +00:00
S3Common.cpp Split S3Common into multiple files 2023-02-13 12:28:04 +00:00
S3Common.h Split S3Common into multiple files 2023-02-13 12:28:04 +00:00
SchedulerNodeFactory.h IO scheduling subsystem 2022-09-27 13:26:41 +00:00
SchedulerRoot.h more fixes 2022-12-16 13:25:26 +00:00
SeekableReadBuffer.cpp Copy files to S3 during backup directly without using WriteBufferFromS3 to decrease memory consumption. 2023-01-17 09:35:41 +01:00
SeekableReadBuffer.h Copy files to S3 during backup directly without using WriteBufferFromS3 to decrease memory consumption. 2023-01-17 09:35:41 +01:00
SeekAvoidingReadBuffer.cpp Drop unused headers 2021-09-01 02:47:52 +03:00
SeekAvoidingReadBuffer.h Resubmit prefetches 2023-02-08 21:26:24 +01:00
SnappyReadBuffer.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
SnappyReadBuffer.h Generate config.h into ${CONFIG_INCLUDE_PATH} 2022-09-28 12:48:26 +00:00
SnappyWriteBuffer.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
SnappyWriteBuffer.h Generate config.h into ${CONFIG_INCLUDE_PATH} 2022-09-28 12:48:26 +00:00
StdStreamBufFromReadBuffer.cpp Fix using std::ios_base::end in StdStreamFromReadBuffer::seekg(). 2023-01-17 17:56:14 +01:00
StdStreamBufFromReadBuffer.h Split upload into parts of the same size for smooth uploading. 2023-01-17 09:35:43 +01:00
StdStreamFromReadBuffer.h Split upload into parts of the same size for smooth uploading. 2023-01-17 09:35:43 +01:00
SwapHelper.h Update SwapHelper.h 2023-01-20 12:19:19 +01:00
SynchronousReader.cpp Better ReadBuffer asynchronicity 2022-02-20 01:08:21 +08:00
SynchronousReader.h Get rid of static threadpools 2022-09-07 17:48:11 +02:00
TimeoutSetter.cpp base should not depend on Common 2022-04-29 10:26:35 +08:00
TimeoutSetter.h Poco::Timespan reference fix 2021-04-29 19:11:20 +03:00
UncompressedCache.h Fix review 2022-08-08 21:34:24 +00:00
UseSSL.cpp Generate config.h into ${CONFIG_INCLUDE_PATH} 2022-09-28 12:48:26 +00:00
UseSSL.h
VarInt.h Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
WithFileName.cpp Fix tests, make better 2023-01-11 22:52:15 +00:00
WithFileName.h add more tests for error diagnostics in files 2022-04-19 15:56:34 +00:00
WithFileSize.cpp Fix 2022-07-04 16:05:08 +02:00
WithFileSize.h improvements for getFileSize 2022-06-20 15:22:56 +02:00
WriteBuffer.h Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
WriteBufferDecorator.h Fix comments 2021-11-22 14:19:26 +03:00
WriteBufferFromArena.h Small refactoring of WriteBiffer-s 2021-11-11 02:11:18 +03:00
WriteBufferFromEncryptedFile.cpp Fix comments 2021-11-22 14:19:26 +03:00
WriteBufferFromEncryptedFile.h Generate config.h into ${CONFIG_INCLUDE_PATH} 2022-09-28 12:48:26 +00:00
WriteBufferFromFile.cpp Fix WriteBufferFromFile destructor after close() 2023-02-07 17:59:05 +01:00
WriteBufferFromFile.h Fix clang-tidy warnings in Interpreters, IO folders 2022-03-14 18:17:35 +00:00
WriteBufferFromFileBase.cpp
WriteBufferFromFileBase.h dbms/ → src/ 2020-04-03 18:14:31 +03:00
WriteBufferFromFileDecorator.cpp Revert "Revert "Add pool to WriteBufferFromS3"" 2022-02-01 13:36:51 +03:00
WriteBufferFromFileDecorator.h Revert "Revert "Add pool to WriteBufferFromS3"" 2022-02-01 13:36:51 +03:00
WriteBufferFromFileDescriptor.cpp Add profile events for fsync 2022-07-31 23:19:30 +03:00
WriteBufferFromFileDescriptor.h Fix clang-tidy warnings in Interpreters, IO folders 2022-03-14 18:17:35 +00:00
WriteBufferFromFileDescriptorDiscardOnFailure.cpp fix tracing of profile events 2022-12-08 15:13:53 +00:00
WriteBufferFromFileDescriptorDiscardOnFailure.h Fix clang-tidy warnings in Interpreters, IO folders 2022-03-14 18:17:35 +00:00
WriteBufferFromHTTP.cpp Fix segment fault when sending data to remote HTTP server via URL table engine 2022-08-24 17:38:16 +08:00
WriteBufferFromHTTP.h Address review comment 2022-02-12 10:46:01 +08:00
WriteBufferFromOStream.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
WriteBufferFromOStream.h Fix clang-tidy warnings in Interpreters, IO folders 2022-03-14 18:17:35 +00:00
WriteBufferFromPocoSocket.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
WriteBufferFromPocoSocket.h Fix clang-tidy warnings in Interpreters, IO folders 2022-03-14 18:17:35 +00:00
WriteBufferFromS3.cpp review fixes 2023-02-09 20:17:46 +00:00
WriteBufferFromS3.h Define S3 client with bucket and endpoint resolution (#45783) 2023-02-03 14:30:52 +01:00
WriteBufferFromString.h Less usage of StringRef 2022-07-24 18:33:52 +00:00
WriteBufferFromTemporaryFile.cpp Check return value of ::close() 2023-02-07 11:28:22 +01:00
WriteBufferFromTemporaryFile.h Temporary files evict fs cache 2022-12-22 10:22:49 +00:00
WriteBufferFromVector.h Preallocate more space 2023-01-25 16:26:14 +00:00
WriteBufferValidUTF8.cpp Fixes for -Wshorten-64-to-32 2022-10-21 13:25:19 +02:00
WriteBufferValidUTF8.h Fix clang-tidy warnings in Interpreters, IO folders 2022-03-14 18:17:35 +00:00
WriteHelpers.cpp review suggestions 2022-12-07 21:29:17 +00:00
WriteHelpers.h Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
WriteIntText.h Fix clang-tidy warnings in Interpreters, IO folders 2022-03-14 18:17:35 +00:00
WriteSettings.h Merge branch 'master' into io-scheduler-integration 2023-01-27 19:56:23 +01:00
ZlibDeflatingWriteBuffer.cpp forbid old ctor of Exception 2023-01-23 22:18:05 +01:00
ZlibDeflatingWriteBuffer.h Fix comments 2021-11-22 14:19:26 +03:00
ZlibInflatingReadBuffer.cpp Fixes for -Wshorten-64-to-32 2022-10-21 13:25:19 +02:00
ZlibInflatingReadBuffer.h show names of erroneous files 2022-04-16 00:10:47 +00:00
ZstdDeflatingAppendableWriteBuffer.cpp Preallocate more space 2023-01-25 16:26:14 +00:00
ZstdDeflatingAppendableWriteBuffer.h Preallocate more space 2023-01-25 16:26:14 +00:00
ZstdDeflatingWriteBuffer.cpp Better formatting for exception messages (#45449) 2023-01-24 00:13:58 +03:00
ZstdDeflatingWriteBuffer.h Fix comments 2021-11-22 14:19:26 +03:00
ZstdInflatingReadBuffer.cpp Merge branch 'master' into keeper-use-fallocate 2023-01-25 11:36:47 +00:00
ZstdInflatingReadBuffer.h Revert "Revert "Add a setting to use more memory for zstd decompression"" 2022-06-18 15:55:35 +03:00