Smita Kulkarni
383af7f3a6
Moved settings inside backups section - Updated backup/restore status when concurrent backups & restores are not allowed
2023-01-23 08:59:44 +01:00
Smita Kulkarni
310ae62d90
Updated backup/restore status when concurrent backups & restores are not allowed
...
Implementation:
* Moved concurrent backup/restore check inside try-catch block which sets the status so that other nodes in cluster are aware of failures.
* Renamed backup_uuid to restore_uuid in RestoreSettings.
Testing:
* Updated test test_backup_and_restore_on_cluster/test_disallow_concurrency to check for specific backup/restore id.
2023-01-22 19:01:09 +01:00
SmitaRKulkarni
db03dd1bb9
Merge branch 'master' into 43891_Disallow_concurrent_backups_and_restores
2023-01-19 09:32:50 +01:00
robot-clickhouse
237bb15a9f
Automatic style fix
2023-01-17 21:34:16 +00:00
Smita Kulkarni
6e06af1b25
Updated strategy for handling internal backups & restores to avoid concurrent internal backups & restores - Added settings to disallow concurrent backups and restores
2023-01-17 22:27:13 +01:00
Vitaly Baranov
8c5c423d67
Add test.
2023-01-17 13:11:24 +01:00
robot-clickhouse
46b21629ed
Automatic style fix
2023-01-09 17:23:02 +00:00
Smita Kulkarni
93530e8d34
Added settings to disallow concurrent backups and restores
...
Implementation:
* Added server level settings to disallow concurrent backups and restores, which are read and set when BackupWorker is created in Context.
* Settings are set to true by default.
* Before starting backup or restores, added a check to see if any other backups/restores are running (except internal ones).
Testing:
* Added a test test_backup_and_restore_on_cluster/test_disallow_concurrency.
2023-01-09 18:14:39 +01:00
Vitaly Baranov
b211dff013
Increase the create table timeout in test "test_backup_restore_on_cluster".
2022-12-28 00:17:19 +01:00
Vitaly Baranov
5c1f490b3a
Implement referential dependencies for table engine "Distributed"
...
and for functions cluster() and clusterAllReplicas().
2022-12-13 11:09:42 +01:00
Alexey Milovidov
61278c81e4
Merge branch 'master' into remove-useless-line
2022-09-10 05:07:10 +02:00
Vitaly Baranov
10629a66e5
Fix black.
2022-09-08 20:58:51 +02:00
Vitaly Baranov
e48cd2b6f6
Add more test cases.
2022-09-08 18:14:25 +02:00
Vitaly Baranov
122009a2bd
Use table lock if database is ordinary and zero-copy-replication is enabled.
2022-09-08 13:54:59 +02:00
Vitaly Baranov
9c847ceec9
No hardlinks while making backup of MergeTree in atomic database.
2022-09-07 11:44:50 +02:00
Alexey Milovidov
b42d26acfe
Remove one line from XML, because we do not care
2022-08-28 02:44:02 +02:00
Vitaly Baranov
dc25f18f13
Fix flaky integration test test_async_backups_to_same_destination.
2022-08-03 14:22:09 +02:00
Vitaly Baranov
51a2bf33e8
Rename backup statuses to CREATING_BACKUP, BACKUP_CREATED, BACKUP_FAILED, RESTORING, RESTORED, RESTORE_FAILED.
2022-07-27 09:04:10 +02:00
Vitaly Baranov
fc16a15ecf
Rename column "uuid" -> "id" in system.backups and allow user to set it in a query.
2022-07-27 09:04:10 +02:00
Vitaly Baranov
131019ba49
Rename column "backup_name" -> "name" in system.backups.
2022-07-27 09:04:10 +02:00
Vitaly Baranov
4c98a7bc0f
Add test for Ordinary database.
2022-07-26 08:46:51 +02:00
Vitaly Baranov
6174fe1d72
Fix tests.
2022-07-22 18:33:46 +02:00
Vitaly Baranov
36d3923622
Add one more concurrency test.
2022-07-21 20:31:43 +02:00
Vitaly Baranov
708d0eb34c
Add concurrent tests for backups.
2022-07-21 12:02:18 +02:00
Vitaly Baranov
619e22fe57
Add tests for shutdown during backup.
2022-07-21 12:01:16 +02:00
Vitaly Baranov
ad115a9a3d
Merge pull request #39254 from vitlibar/backup-checks-destination-not-in-use
...
Check that the destination for a backup is not in use.
2022-07-18 15:19:43 +02:00
Vitaly Baranov
ef3a24d20f
Fix tests.
2022-07-15 15:44:29 +02:00
Vitaly Baranov
2f47be5da7
Check that the destination for a backup is not in use.
2022-07-15 13:34:58 +02:00
Vitaly Baranov
847cda87f9
BACKUP/RESTORE ON CLUSTER use async mode on replicas now.
2022-07-08 22:26:01 +02:00
Vitaly Baranov
43d35eec1b
Write unfinished mutations to backup.
2022-07-05 14:51:09 +02:00
Vitaly Baranov
efbee5e723
Improve gathering metadata for backup - part 7.
2022-06-30 08:37:17 +02:00
Vitaly Baranov
7689e0c36f
Improve gathering metadata for backup - part 6.
2022-06-30 08:37:17 +02:00
Vitaly Baranov
47ac47350b
Store projections in backups.
2022-06-30 08:37:17 +02:00
Vitaly Baranov
8a7c970ce0
Fix style.
2022-06-19 15:58:26 +02:00
Vitaly Baranov
b0d19328b8
Add test for ReplicatedAccessStorage.
2022-06-19 14:14:41 +02:00
Vitaly Baranov
01aaaf7395
More accurate access checking for RESTORE.
2022-06-19 11:26:41 +02:00
Vitaly Baranov
ce1836f0d2
Lock tables for share before backup and restore.
2022-06-15 20:28:43 +02:00
Vitaly Baranov
131382e025
Fix async tests.
2022-06-15 20:28:42 +02:00
Vitaly Baranov
c1baad0763
Fix style.
2022-05-15 14:09:42 +02:00
Vitaly Baranov
23322b0bf6
Add async tests.
2022-05-12 19:42:05 +02:00
Vitaly Baranov
2c92fe21a9
Implement restoring to a bigger or smaller cluster.
...
Remove backup settings allow_storing_multiple_replicas: now it's always allowed.
2022-05-12 14:55:06 +02:00
Vitaly Baranov
30005a1eff
BACKUP ON CLUSTER correctly collects data of a replicated table from all replicas now,
...
and if some part doesn't exist on either replica it's no problem anymore.
2022-05-12 13:33:42 +02:00
Vitaly Baranov
202dd864ed
Fix compilation.
2022-05-03 18:34:29 +02:00
Vitaly Baranov
484c2c9c4a
Use SYSTEM SYNC DATABASE REPLICA to make code better.
2022-05-03 16:59:41 +02:00
Vitaly Baranov
828f45f078
Add new restore setting 'allow_non_empty_tables'.
2022-05-03 16:18:45 +02:00
Vitaly Baranov
b1295311c9
Fix crash when BACKUP & RESTORE are called without ON CLUSTER for replicated DB.
2022-05-03 11:01:44 +02:00
Vitaly Baranov
a8e924caf6
Make BACKUP & RESTORE synchronous by default.
2022-04-26 18:45:39 +02:00
Vitaly Baranov
a89ef54c69
Fix tests and compilation.
2022-04-26 13:32:23 +02:00
Vitaly Baranov
78bcb96098
Rename backup & restore setting 'async' -> 'sync', and make backup & restore async by default.
2022-04-26 09:51:19 +02:00
Vitaly Baranov
4de4fff590
Fix tests.
2022-04-25 16:34:34 +02:00
