Antonio Andelic
86ba6ad1e8
Local backup and restore
2023-11-08 10:22:44 +00:00
Nikita Mikhaylov
fa5b2bd4a5
Added Keeper retries for backups operations ( #47224 )
2023-04-04 18:12:08 +02:00
Vitaly Baranov
3f4aadfe7d
Add logging for concurrency checks for backups.
2023-03-31 23:50:35 +02:00
Vitaly Baranov
481a7a76ac
Simplify backup coordination for file infos ( #48095 )
...
* Remove obsolete code for archive suffixes.
* Simplify backup coordination, stop using it for restoring.
* Build all file infos before writing to backup. Decrease number of znodes.
* Split long values before writing to ZooKeeper.
* Use separate mutexes for unrelated activities.
* Make test test_disallow_concurrency less flaky.
* Add comments and test for backup_keeper_value_max_size.
2023-03-29 15:19:40 +02:00
Vitaly Baranov
1badc3cba0
Move information about current hosts and list of all hosts to BackupCoordination ( #47971 )
...
to simplify the code and help implementing other features.
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2023-03-24 17:38:19 +01:00
Aleksei Filatov
690d8355ca
Add classes for backup/restore UDF
2023-03-17 13:56:04 +03:00
Smita Kulkarni
0506d9289c
Updated Backup/Restore Coordination construction and removed coordination_path and added uuid in settings - Use cluster state data to check concurrent backup/restore
2023-02-16 09:30:27 +01:00
Smita Kulkarni
7fee8995d3
Addressed review comments and moved concurrency check to Backup/Restore Coordination - Use cluster state data to check concurrent backup/restore
2023-02-10 12:04:05 +01:00
Azat Khuzhin
998bf444e6
backups: remove IBackupCoordination::getFileSizeAndChecksum() (in favor of getFileInfo())
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-12-27 15:56:05 +01:00
Vitaly Baranov
dc392cd4d3
Improve synchronization between hosts in distributed backup.
...
Use ephemeral zk nodes to check other hosts for termination.
2022-07-21 11:45:26 +02:00
Vitaly Baranov
847cda87f9
BACKUP/RESTORE ON CLUSTER use async mode on replicas now.
2022-07-08 22:26:01 +02:00
Vitaly Baranov
5d7ad46f6a
Move files and write comments.
2022-07-06 11:09:31 +02:00
Vitaly Baranov
1ac46c5e48
Fix making backups containing multiple ACL tables.
2022-07-05 20:57:01 +02:00
Vitaly Baranov
43d35eec1b
Write unfinished mutations to backup.
2022-07-05 14:51:09 +02:00
Vitaly Baranov
e367d96964
Fix style.
2022-06-30 15:10:33 +02:00
Vitaly Baranov
5456bde4a2
Improve gathering metadata for storing ACL in backups.
2022-06-30 09:46:37 +02:00
Vitaly Baranov
7689e0c36f
Improve gathering metadata for backup - part 6.
2022-06-30 08:37:17 +02:00
Vitaly Baranov
6ca400fd89
Improve gathering metadata for backup - part 5.
2022-06-30 08:37:17 +02:00
Vitaly Baranov
aaf7f66549
Improve gathering metadata for backup - part 4.
2022-06-30 08:37:17 +02:00
Vitaly Baranov
8a7c970ce0
Fix style.
2022-06-19 15:58:26 +02:00
Vitaly Baranov
21f3bed435
Simplify path calculations in backup.
2022-06-15 20:32:34 +02:00
Vitaly Baranov
592f568f83
Move backup/restore code to storages and databases - part 2.
2022-06-15 20:32:31 +02:00
Vitaly Baranov
724bc4dc57
Move backup/restore code to storages and databases - part 1.
2022-06-15 20:28:43 +02:00
Vitaly Baranov
73b1894a21
Rework collecting replicated parts.
2022-06-15 20:28:42 +02:00
Vitaly Baranov
c1baad0763
Fix style.
2022-05-15 14:09:42 +02:00
Vitaly Baranov
30005a1eff
BACKUP ON CLUSTER correctly collects data of a replicated table from all replicas now,
...
and if some part doesn't exist on either replica it's no problem anymore.
2022-05-12 13:33:42 +02:00
Vitaly Baranov
68a020ecea
Implement BACKUP/RESTORE ON CLUSTER.
2022-04-25 16:34:33 +02:00
