vdimir
15234474d7
Implement system table blob_storage_log
2023-11-21 09:18:25 +00:00
Alexey Milovidov
62a87665c5
Fix build
2023-11-19 16:31:18 +01:00
Sema Checherinda
a950595c24
Merge pull request #56314 from CheSema/s3-aggressive-timeouts
...
s3 adaptive timeouts
2023-11-19 14:12:14 +01:00
Alexey Milovidov
edc3b2fe48
Merge pull request #56958 from ClickHouse/metric-queued-jobs
...
Add metrics for the number of queued jobs, which is useful for the IO thread pool
2023-11-19 10:37:18 +01:00
Alexey Milovidov
d56cbda185
Add metrics for the number of queued jobs, which is useful for the IO thread pool
2023-11-18 19:07:59 +01:00
Antonio Andelic
9bcedf3764
Cleanup
2023-11-17 10:27:19 +00:00
Antonio Andelic
7dda3b2353
Review comments
2023-11-17 10:11:15 +00:00
Antonio Andelic
9d965368a2
Fix build
2023-11-15 08:36:24 +00:00
Antonio Andelic
2f9ac9b49c
Address comments
2023-11-14 14:33:34 +00:00
Sema Checherinda
8d36fd6e54
get rid off of client_with_long_timeout_ptr
2023-11-14 11:34:12 +01:00
Sema Checherinda
770a762317
aggressive timeout
2023-11-14 11:34:11 +01:00
Antonio Andelic
9e91e4d671
Define BackupReferenceEntry
2023-11-13 14:43:02 +00:00
Antonio Andelic
59480205d4
Merge branch 'master' into keeper-map-backup-restore
2023-11-13 12:21:26 +00:00
Vitaly Baranov
1711bed63e
Load base backups lazily (if a backup is not needed it won't be loaded).
2023-11-09 19:29:04 +01:00
Antonio Andelic
f9895ab37b
Small fixes and add test
2023-11-09 15:56:57 +00:00
Vitaly Baranov
e48d9f18a8
Update BackupsWorker.cpp
2023-11-09 15:01:25 +01:00
Kseniia Sumarokova
0760e69e54
Merge pull request #56312 from ClickHouse/parallelize-backup-entries-collector
...
Parallelize `BackupEntriesCollector`
2023-11-09 13:07:48 +01:00
Antonio Andelic
1f000242a1
Merge branch 'master' into keeper-map-backup-restore
2023-11-08 13:16:47 +00:00
Antonio Andelic
18a5eeec38
Make on cluster backup/restore work
2023-11-08 13:16:38 +00:00
alesapin
4a097cd373
Merge pull request #55216 from vitlibar/backup-use-two-more-thread-pools
...
Use more thread pools in BACKUP/RESTORE to avoid its hanging in tests
2023-11-08 12:18:10 +01:00
kssenii
080715e598
Fix
2023-11-08 11:29:11 +01:00
Antonio Andelic
86ba6ad1e8
Local backup and restore
2023-11-08 10:22:44 +00:00
Vitaly Baranov
da5f48e44a
Use map instead of array.
2023-11-08 08:45:50 +01:00
kssenii
271059dcb8
Fxi
2023-11-07 19:03:45 +01:00
kssenii
15517d04df
Fix
2023-11-07 18:02:44 +01:00
kssenii
70048236f3
Add ProfileEvents column to system.backups
2023-11-07 17:32:08 +01:00
kssenii
53423a8f5c
Add metrics
2023-11-07 17:10:45 +01:00
kssenii
437711a9df
Use separate pool
2023-11-07 16:47:12 +01:00
Kseniia Sumarokova
d89356103c
Update BackupEntriesCollector.cpp
2023-11-06 18:28:18 +01:00
kssenii
8c1aaa51e4
Fxi
2023-11-06 16:37:01 +01:00
kssenii
9b9a6f8afc
Parallelize BackupEntriesCollector
2023-11-03 17:34:09 +01:00
kssenii
6fc4c8d332
Add retries
2023-10-30 17:20:17 +01:00
Vitaly Baranov
8966ae4c0e
Schedule threads while making a backup faster.
2023-10-03 16:08:00 +02:00
Vitaly Baranov
05f82d48df
Use 2 more thread pools to avoid hanging in case BACKUP/RESTORE ON CLUSTER ASYNC. Create thread pools lazily.
2023-10-03 16:07:55 +02:00
alesapin
61a299843b
Fix deadlock in backups
2023-09-29 14:02:43 +02:00
robot-ch-test-poll4
0f2d7233d9
Merge pull request #54804 from vitlibar/more-configurable-collecting-metadata-for-backup
...
More configurable collecting metadata for backup
2023-09-27 22:31:41 +02:00
Robert Schulze
cde10fe7b5
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-reenable-checks
2023-09-26 18:59:41 +00:00
Vitaly Baranov
fe008c23c4
Merge pull request #54900 from vitlibar/retry-backup-s3-operations-after-conection-reset
...
Retry backup S3 operations after connection reset failure
2023-09-26 18:36:10 +02:00
Vitaly Baranov
1f198d8659
Add comments.
2023-09-26 18:07:36 +02:00
Robert Schulze
9fff447716
Re-enable clang-tidy checks
2023-09-26 09:34:12 +00:00
Vitaly Baranov
a93d64ab24
More configurable collecting metadata for backup.
2023-09-25 12:22:18 +02:00
Vitaly Baranov
1e567d5008
Retry backup s3 operations after ConnectionResetException.
2023-09-23 01:56:28 +02:00
Victor Krasnov
fea886907d
Fix data race during backup_log initialization
2023-09-22 09:54:33 +00:00
Azat Khuzhin
c706101891
Fix throttling of BACKUPs from/to S3 (in case native copy was not used)
...
In some cases native copy is not possible, and such requests should be
throttled.
v0: copyS3FileNativeWithFallback
v2: revert v0 and pass write_settings
v3: pass read_settings to copyFile()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-09-20 18:28:43 +02:00
Sema Checherinda
d9e15c00c9
limit the delay before next try in S3
2023-09-14 19:45:07 +02:00
robot-ch-test-poll4
839f69c940
Merge pull request #53765 from vitlibar/sync-uuids-of-tables-on-replicas
...
Sync UUIDs of tables on replicas after RESTORE
2023-09-08 17:30:32 +02:00
Vitaly Baranov
2643e48310
Remove unused code
2023-09-08 13:23:59 +02:00
robot-clickhouse-ci-1
7403ee689f
Merge pull request #53877 from vitlibar/add-restore-setting-allow-broken-parts
...
Add restore setting "restore_broken_parts_as_detached"
2023-09-05 21:28:08 +02:00
Vitaly Baranov
82b1c09150
Simplify coordination of UUIDs.
2023-09-05 20:49:43 +02:00
Vitaly Baranov
8060407c70
Add backup setting "check_parts" and restore setting "restore_broken_parts_as_detached".
2023-09-04 18:54:03 +02:00
