Curious Pandas

From backup-and-restore to active-active

Four ways to survive losing a whole site, from cheap and slow to expensive and near-instant. The right one is the cheapest that meets each system's targets - and replication, the thing that makes the fast ones fast, copies your mistakes too.

15 min+40 XP for finishing

Backups protect your data. Disaster recovery (DR) is about the rest: if the building, the data centre or the whole cloud region you run in is gone, where does the system run tomorrow, and how quickly can it be there?

AWS’s whitepaper Disaster Recovery of Workloads on AWS sorts the answers into four approaches, “ranging from the low cost and low complexity of making backups to more complex strategies using multiple active Regions”. The names are used across the industry, whichever cloud or data centre you’re in.

Visual guideFour patterns, cheapest to fastest
Four patterns, cheapest to fastestFour disaster recovery patterns in a row. Backup and restore is cheapest and slowest, recovering in hours to a day. Pilot light keeps data replicated and core infrastructure ready but application servers switched off. Warm standby runs a smaller working copy all the time. Multi-site active/active serves users from both sites at once and recovers in near zero time, at the highest cost.backup, restorehours to a daypilot lightdata on, servers offwarm standbysmall copy runningactive/activeboth sites servingcosts morecosts morecosts moreFour patterns, cheapest to fastestFour disaster recovery patterns in a row. Backup and restore is cheapest and slowest, recovering in hours to a day. Pilot light keeps data replicated and core infrastructure ready but application servers switched off. Warm standby runs a smaller working copy all the time. Multi-site active/active serves users from both sites at once and recovers in near zero time, at the highest cost.backup, restorehours to a daypilot lightdata on, servers offwarm standbysmall copy runningactive/activeboth sites servingcosts morecosts morecosts more
  1. Backup and restore: copy backups to another region; after a disaster, rebuild everything there and restore. Cheapest, slowest.
  2. Pilot light: data is replicated continuously and core infrastructure is ready, but application servers stay switched off until a failover.
  3. Warm standby: a scaled-down but working copy runs all the time. It can take traffic at once, then scales up.
  4. Active/active: both sites serve users all the time, so there is nothing to fail over to. Most complex, most costly, recovery near zero.

What separates them

  • Backup and restore is, in the whitepaper’s words, “a suitable approach for mitigating against data loss or corruption”, and for many systems it’s enough. Recovery means redeploying “the infrastructure, configuration, and application code” as well as the data. Without infrastructure as code, it warns, that “may be complex” and can blow your RTO.
  • Pilot light vs warm standby is the distinction people mix up. The whitepaper is precise: “pilot light cannot process requests without additional action taken first, whereas warm standby can handle traffic (at reduced capacity levels) immediately.”
  • Multi-site active/active “is the most complex and costly approach to disaster recovery, but it can reduce your recovery time to near zero for most disasters”.

None of them is “best”. The right one is the cheapest that meets a system’s RTO and RPO, which is why the targets from the previous lesson come first. Most organisations end up with different patterns for different systems.

Pick a recovery patternillustrative monthly prices

  • Pick a workload and a pattern, then run a drill.
Check yourself+10 XP

What is the difference between pilot light and warm standby?

Check yourself+10 XP

A payment service needs RTO 15 minutes and RPO 1 minute. Warm standby meets both; active/active does too. Which should you pick?

Check yourself+10 XP

Your shop runs warm standby. A bad deploy corrupts the orders table. Why doesn't failing over help?

Sources

Finished reading?

Missions and quizzes above earn their own XP. This marks the lesson done.