thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-01 03:52:15 +00:00
Code Issues Packages Projects Releases Wiki Activity
e49ddbb678
ClickHouse/src/Backups
History
Azat Khuzhin c706101891 Fix throttling of BACKUPs from/to S3 (in case native copy was not used) 
In some cases native copy is not possible, and such requests should be
throttled.

v0: copyS3FileNativeWithFallback
v2: revert v0 and pass write_settings
v3: pass read_settings to copyFile()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-09-20 18:28:43 +02:00
..
tests Fix tests. 2023-08-03 13:52:35 +02:00
BackupCoordinationFileInfos.cpp Use forward declaration of ThreadPool 2023-04-07 11:25:35 +02:00
BackupCoordinationFileInfos.h Simplify backup coordination for file infos (#48095) 2023-03-29 15:19:40 +02:00
BackupCoordinationLocal.cpp Removed setStageForCluster and added option all_hosts to set stage for cluster 2023-05-08 14:51:04 +02:00
BackupCoordinationLocal.h Fixed clang build 2023-05-16 14:09:38 +02:00
BackupCoordinationRemote.cpp less exceptions with runtime format string 2023-08-14 21:45:59 +02:00
BackupCoordinationRemote.h Fix multiple writing of same file to backup (#51299) 2023-06-23 12:11:18 +02:00
BackupCoordinationReplicatedAccess.cpp Added Keeper retries for backups operations (#47224) 2023-04-04 18:12:08 +02:00
BackupCoordinationReplicatedAccess.h Added Keeper retries for backups operations (#47224) 2023-04-04 18:12:08 +02:00
BackupCoordinationReplicatedSQLObjects.cpp Added Keeper retries for backups operations (#47224) 2023-04-04 18:12:08 +02:00
BackupCoordinationReplicatedSQLObjects.h Added Keeper retries for backups operations (#47224) 2023-04-04 18:12:08 +02:00
BackupCoordinationReplicatedTables.cpp Use hash_of_all_files from system.parts to check identity of parts during on-cluster backups. 2023-06-14 20:39:50 +02:00
BackupCoordinationReplicatedTables.h Added Keeper retries for backups operations (#47224) 2023-04-04 18:12:08 +02:00
BackupCoordinationStage.cpp Changes after review and added comments. 2022-07-26 11:58:05 +02:00
BackupCoordinationStage.h Updated to add error or completed status in zookeeper for a cluster for backup/restore, to avoid interpreting previously failed backup/restore when zookeeper is unable to remove nodes 2023-04-12 20:26:57 +02:00
BackupCoordinationStageSync.cpp less exceptions with runtime format string 2023-08-14 21:45:59 +02:00
BackupCoordinationStageSync.h Removed setStageForCluster and added option all_hosts to set stage for cluster 2023-05-08 14:51:04 +02:00
BackupEntriesCollector.cpp Disable using fs cache for backup/restore #2. 2023-08-03 13:52:35 +02:00
BackupEntriesCollector.h Disable using fs cache for backup/restore #2. 2023-08-03 13:52:35 +02:00
BackupEntryFromAppendOnlyFile.cpp Make async reader work with any impl 2023-05-22 19:54:04 +02:00
BackupEntryFromAppendOnlyFile.h Add backup setting "decrypt_files_from_encrypted_disks" 2023-05-16 14:27:27 +02:00
BackupEntryFromImmutableFile.cpp Disable using fs cache for backup/restore. 2023-08-03 13:52:32 +02:00
BackupEntryFromImmutableFile.h Disable using fs cache for backup/restore. 2023-08-03 13:52:32 +02:00
BackupEntryFromMemory.cpp Remove ReadSettings from backup entries. 2023-05-16 14:27:27 +02:00
BackupEntryFromMemory.h Remove ReadSettings from backup entries. 2023-05-16 14:27:27 +02:00
BackupEntryFromSmallFile.cpp Disable using fs cache for backup/restore #2. 2023-08-03 13:52:35 +02:00
BackupEntryFromSmallFile.h Disable using fs cache for backup/restore #2. 2023-08-03 13:52:35 +02:00
BackupEntryWithChecksumCalculation.cpp Disable using fs cache for backup/restore. 2023-08-03 13:52:32 +02:00
BackupEntryWithChecksumCalculation.h Disable using fs cache for backup/restore. 2023-08-03 13:52:32 +02:00
BackupEntryWrappedWith.h Disable using fs cache for backup/restore. 2023-08-03 13:52:32 +02:00
BackupFactory.cpp In messages, put values into quotes 2023-03-30 22:46:18 -07:00
BackupFactory.h Add ability to override credentials for accessing base backup in S3 2023-08-30 20:16:22 +02:00
BackupFileInfo.cpp Disable using fs cache for backup/restore. 2023-08-03 13:52:32 +02:00
BackupFileInfo.h Disable using fs cache for backup/restore. 2023-08-03 13:52:32 +02:00
BackupImpl.cpp Add ability to override credentials for accessing base backup in S3 2023-08-30 20:16:22 +02:00
BackupImpl.h Add ability to override credentials for accessing base backup in S3 2023-08-30 20:16:22 +02:00
BackupInfo.cpp Add ability to override credentials for accessing base backup in S3 2023-08-30 20:16:22 +02:00
BackupInfo.h Add ability to override credentials for accessing base backup in S3 2023-08-30 20:16:22 +02:00
BackupIO_Default.cpp Disable using fs cache for backup/restore. 2023-08-03 13:52:32 +02:00
BackupIO_Default.h Disable using fs cache for backup/restore. 2023-08-03 13:52:32 +02:00
BackupIO_Disk.cpp Fix throttling of BACKUPs from/to S3 (in case native copy was not used) 2023-09-20 18:28:43 +02:00
BackupIO_Disk.h Disable using fs cache for backup/restore. 2023-08-03 13:52:32 +02:00
BackupIO_File.cpp Disable using fs cache for backup/restore. 2023-08-03 13:52:32 +02:00
BackupIO_File.h Disable using fs cache for backup/restore. 2023-08-03 13:52:32 +02:00
BackupIO_S3.cpp Fix throttling of BACKUPs from/to S3 (in case native copy was not used) 2023-09-20 18:28:43 +02:00
BackupIO_S3.h Disable using fs cache for backup/restore. 2023-08-03 13:52:32 +02:00
BackupIO.h Fix whitespaces. 2023-05-16 14:27:27 +02:00
BackupOperationInfo.h Rename BackupOperationInfo::ID to BackupOperationID 2023-08-30 18:52:43 +03:00
BackupSettings.cpp Add backup setting "check_parts" and restore setting "restore_broken_parts_as_detached". 2023-09-04 18:54:03 +02:00
BackupSettings.h Add backup setting "check_parts" and restore setting "restore_broken_parts_as_detached". 2023-09-04 18:54:03 +02:00
BackupStatus.cpp Rename backup statuses to CREATING_BACKUP, BACKUP_CREATED, BACKUP_FAILED, RESTORING, RESTORED, RESTORE_FAILED. 2022-07-27 09:04:10 +02:00
BackupStatus.h Rename backup statuses to CREATING_BACKUP, BACKUP_CREATED, BACKUP_FAILED, RESTORING, RESTORED, RESTORE_FAILED. 2022-07-27 09:04:10 +02:00
BackupsWorker.cpp Merge branch 'master' into ADQM-987 2023-09-01 18:00:20 +03:00
BackupsWorker.h Rename BackupOperationInfo::ID to BackupOperationID 2023-08-30 18:52:43 +03:00
BackupUtils.cpp Use same UUIDs for tables on replicas created by RESTORE ON CLUSTER. 2023-08-23 22:55:46 +02:00
BackupUtils.h Use same UUIDs for tables on replicas created by RESTORE ON CLUSTER. 2023-08-23 22:55:46 +02:00
CMakeLists.txt Added new commands BACKUP and RESTORE. 2021-08-23 23:41:45 +03:00
DDLAdjustingForBackupVisitor.cpp Use same UUIDs for tables on replicas created by RESTORE ON CLUSTER. 2023-08-23 22:55:46 +02:00
DDLAdjustingForBackupVisitor.h Move InDepthNodeVisitor.h back to src/Interpreters. 2022-11-17 18:16:32 +01:00
IBackup.h Move the common part of BackupIO_* to BackupIO_Default. 2023-05-16 14:27:23 +02:00
IBackupCoordination.h Fixed clang build 2023-05-16 14:09:38 +02:00
IBackupEntriesLazyBatch.cpp Disable using fs cache for backup/restore. 2023-08-03 13:52:32 +02:00
IBackupEntriesLazyBatch.h Store columns.txt in backups for the Memory table engine too. 2022-07-05 19:03:20 +02:00
IBackupEntry.h Disable using fs cache for backup/restore. 2023-08-03 13:52:32 +02:00
IRestoreCoordination.h Use same UUIDs for tables on replicas created by RESTORE ON CLUSTER. 2023-08-23 22:55:46 +02:00
registerBackupEngineS3.cpp Add ability to override credentials for accessing base backup in S3 2023-08-30 20:16:22 +02:00
registerBackupEnginesFileAndDisk.cpp Add ability to override credentials for accessing base backup in S3 2023-08-30 20:16:22 +02:00
RestoreCoordinationLocal.cpp Simplify coordination of UUIDs. 2023-09-05 20:49:43 +02:00
RestoreCoordinationLocal.h Use same UUIDs for tables on replicas created by RESTORE ON CLUSTER. 2023-08-23 22:55:46 +02:00
RestoreCoordinationRemote.cpp Remove unused code 2023-09-08 13:23:59 +02:00
RestoreCoordinationRemote.h Use same UUIDs for tables on replicas created by RESTORE ON CLUSTER. 2023-08-23 22:55:46 +02:00
RestorerFromBackup.cpp Use same UUIDs for tables on replicas created by RESTORE ON CLUSTER. 2023-08-23 22:55:46 +02:00
RestorerFromBackup.h Introduce clean-up of the source storage policy by setting it to an empty string 2023-07-27 18:17:47 +03:00
RestoreSettings.cpp Add backup setting "check_parts" and restore setting "restore_broken_parts_as_detached". 2023-09-04 18:54:03 +02:00
RestoreSettings.h Add backup setting "check_parts" and restore setting "restore_broken_parts_as_detached". 2023-09-04 18:54:03 +02:00
SettingsFieldOptionalString.cpp Introduce clean-up of the source storage policy by setting it to an empty string 2023-07-27 18:17:47 +03:00
SettingsFieldOptionalString.h Introduce clean-up of the source storage policy by setting it to an empty string 2023-07-27 18:17:47 +03:00
SettingsFieldOptionalUUID.cpp Updated strategy for handling internal backups & restores to avoid concurrent internal backups & restores - Added settings to disallow concurrent backups and restores 2023-01-17 22:27:13 +01:00
SettingsFieldOptionalUUID.h Updated strategy for handling internal backups & restores to avoid concurrent internal backups & restores - Added settings to disallow concurrent backups and restores 2023-01-17 22:27:13 +01:00
WithRetries.cpp Merge remote-tracking branch 'blessed/master' into zk_retry_timeout 2023-04-04 18:53:55 +02:00
WithRetries.h Added Keeper retries for backups operations (#47224) 2023-04-04 18:12:08 +02:00