Provide incremental backup capabilities from DDP to S3 Glacier target

Enable Defender Data Protect (DDP) to perform incremental backups directly to S3 Glacier-based tape storage targets such as IBM Storage Protect (SP) S3 storage agent and IBM Deep Archive on Diamondback.

Business Use Case:

While Defender Data Protect provides high availability many customers want to leverage tape as last line of defense for disaster recovery. Tape is a reliable media and provides an air-gap capabilities. Customers want to incrementally backup their backup data stored in Defender DDP to remote S3 Glacier target on tape. The backup window shall not exceed 8 hours (depending on the amount of data).

Even more important, customers want to recovery their Defender DDP instances from the backup data stored in the S3 Glacier target. Existing state-of-the-art solutions (see Appendix: State-of-the-Art) do not adequately meet this use case.

Requested Solution: We propose implementing incremental backup capabilities from DDP to S3 Glacier targets. We also propose to improve the recovery process (Cloud Retrieve) from S3 Glacier target.

Advantages:

• Eliminates the need to rehydrate full backup data in DDP.
• Upon backup, the amount of backup data transferred between DDP and the S3 Glacier target is reduced, and the backup time window is shortened.
• Upon restoration the data is retrieved in an optimized manner from tape through the S3 Glacier API, reducing the restoration duration (RTO)
• Reduces required storage capacity for the Storage Protect Cold Data Cache (DCD).
• Enables automatic migration of data from CDC to tape storage.
• Facilitates automatic retrieval from tape to CDC when data restor
• ation to DDP is required.

Challenges:

• The need for defragmentation of incremental backup data in the S3 Glacier storage target.
• Optimization of the restore process leveraging the S3 Glacier API