low riskBackup & DR

Backup & disaster-recovery test

Rehearse restoring the platform and workloads from backups to prove RPO/RTO.

Change scope

Non-production restore rehearsal

Maintenance impact

None on production (rehearsed in an isolated environment).

Prerequisites
  • ·etcd + PV + object backups available
  • ·An isolated restore environment
Pre-checks
  • ·Backups recent and readable
Procedure
  1. 1

    Restore etcd and cluster config into the isolated environment.

  2. 2

    Restore persistent data and redeploy platform components (GitOps rebuild).

  3. 3

    Validate a representative GPU workload end-to-end.

Validation
  • Restore completes within the RTO
  • Data loss within the RPO
  • A GPU workload runs post-restore
Rollback

Tear down the isolated environment — production is untouched.

Communication

Share the DR test results and any gaps found with stakeholders.