New insights by RSS

Business Continuity Plan Testing: Test Types, Schedule and Scoring

By Theo Vasquez · · 9 min read · Filed under Business Continuity, Crisis Management
Business Continuity Plan Testing: Test Types, Schedule and Scoring

Business continuity plan testing is the scheduled work of proving that the plan does what it claims: the right people show up, the workarounds run, and critical activities come back within the recovery time objectives leadership signed off. A plan nobody has tested is a list of intentions. Test results are what turn it into a plan.

There are five common test types, and they form a ladder. A plan walkthrough checks the document. A tabletop exercise checks decisions. A functional test runs one capability for real. A simulation runs several teams against the clock. A full interruption test switches production off and recovers it. Most organizations should run the first four every year and the fifth rarely, if ever.

Tests, exercises and what the standards ask

ISO 22301:2019, the international standard for business continuity management systems, puts the requirement in clause 8.5, titled "Exercise programme." In short, it asks for exercises and tests that, taken together over time, validate your continuity strategies and solutions. They should match your continuity objectives, use planned scenarios with stated aims, build competence in the people who respond, end in a formal post-exercise report, and recur at planned intervals and after significant change.

NIST Special Publication 800-84, the Guide to Test, Training, and Exercise Programs for IT Plans and Capabilities (2006), draws a useful line. A test uses measurable checks, such as whether a call tree finishes within its time limit. An exercise simulates an emergency to validate part of a plan, either by discussion (a tabletop) or by people performing their roles (a functional exercise, scaling up to full-scale events). The working rule: a test produces a number with a pass mark, and an exercise tests judgment. You need both.

Five test types and what each one proves

Type What happens What it proves What it cannot prove
Plan walkthrough Owners read their sections to a reviewer, checking names, numbers and steps The document is current and consistent That anyone can carry it out
Tabletop exercise Decision makers talk through a scenario as injects arrive Authority, escalation and information flow That systems or workarounds function
Functional test One capability performed for real: call tree, failover, restore, manual order taking That capability meets its target How it interacts with the rest
Simulation Several teams respond in real time with real tools and handoffs Coordination under time pressure Full-load performance in production
Full interruption Production is shut down and the business runs from the recovery setup The whole recovery under real conditions Little, but it can cause the outage it guards against

The walkthrough catches the embarrassing faults cheaply: a phone number for someone who left in the spring, an alternate site the company stopped leasing. Run it after every business impact analysis (BIA) refresh or office move.

The tabletop is the annual test of your crisis team, not of your recovery capability. Its design decides its value, and our guide to designing a tabletop exercise that exposes real gaps covers objectives, injects and facilitation.

Functional tests are where recovery times get measured. Restore the order database to a clean server and time it. Have the warehouse take orders on paper for an hour. Send the staff notification from a phone with the corporate network unplugged. Each one needs an owner, a target and a stopwatch. A simulation then strings them together in real time and finds the handoff failures, such as a restore finished at 2 p.m. that nobody reports to the business until 4.

A full interruption test is the only one that removes every assumption, and the one most likely to hurt. It makes sense where a regulator expects it or a recovery site must be proven at full load. For most firms, functional tests plus one good simulation cover the same ground at far less risk. If you run one, write abort criteria and a rollback plan first.

A yearly testing schedule

A mid-size firm might lay out its year like this; smaller firms can fold it into four events.

When Test Scope Owner
January Plan walkthrough Every team's section, after the BIA refresh Continuity lead
February Functional: call tree All staff, after hours, phones only HR
April Tabletop Crisis team, last year's top risk Crisis management lead
May Functional: tier 1 restore One critical application, confirmed usable by its owner IT recovery lead
July Functional: alternate work One department at the alternate site for a day Facilities
September Functional: vendor down A critical SaaS platform or supplier off for half a day Process owner
October Simulation Two or three teams, built around the year's weakest results Continuity lead

Add a retest within 90 days for every missed objective, and a targeted test after any major change. Two more rules keep the schedule honest. Rotate scenarios so that over two or three years every critical activity, and every type of loss (people, premises, technology, suppliers), gets tested at least once. And make at least one test a year unannounced, or known only to the evaluators, because a recovery run by rested people with cleared calendars is a best case.

What to record

Auditors, examiners and next year's planner will rely on the record, so write it during the test. Capture:

  • Objectives, each written so it can fail, with a met or not met result. "Restore the order system and have customer service confirm it usable within 4 hours" can fail. "Test the restore" cannot.
  • Scope and assumptions, including anything simulated rather than performed.
  • Scenario and injects, with the time each was delivered and to whom.
  • Timings as timestamps: disruption start, detection, decision to invoke, first workaround running, system restored, business owner confirms usable.
  • Deviations from the plan. Undocumented steps that worked are findings too, because the next person will not know them.
  • Findings, each with a named owner, a due date and the evidence that will close it.

Whatever you call the report, an open finding from this year's test becomes an objective in next year's.

Scoring achieved RTO against target

Recovery time scoring is where test reports most often flatter the program. Three decisions fix that.

First, start the clock at the disruption, not when someone invokes the plan. Detection and decision time are part of the outage customers live through, so record them separately but count them.

Second, stop the clock when the business owner confirms the activity is usable at the level the BIA requires, not when IT reports the server is up. A database restored at 1 p.m. with no working interface to the warehouse is not recovered.

Third, use a plain scale:

Result Rule
Met Achieved time at or under target, plan followed as written
Met with findings At or under target, but only through undocumented steps, outside help or one irreplaceable expert
Missed Achieved time over target
Not demonstrated Test stopped, skipped or done on paper only

Score data loss the same way: the achieved recovery point is the timestamp of the last good transaction you got back, measured against the RPO. If those targets are still open, start with our guide to setting RTO and RPO.

A worked example

A fictional distributor tests the restore of its order management system against a 4-hour RTO. The simulated failure starts at 9:00 a.m. Monitoring flags it at 9:25, the plan is invoked at 10:10, the restore finishes at 4:20 p.m., and customer service confirms the system usable at 6:00 p.m. Achieved RTO: 9 hours. Result: missed, by 5 hours. The record also shows where the time went: 70 minutes before anyone invoked the plan, a little over six hours of restore, and 100 minutes of validation because nobody had a checklist for it.

What does the gap cost? Put the company's own figures into our downtime cost calculator: $18 million in annual revenue, 70 percent of it flowing through the order system, 40 percent of delayed orders recovered later, 2,600 trading hours a year, and 30 staff at a loaded $42 an hour losing 60 percent of their output. An outage costs about $3,660 an hour, so the five hours between target and achieved come to roughly $18,300 per incident before penalties or overtime. That figure, rather than "RTO missed," is what gets a faster restore approach funded.

Treat any time achieved in an announced test as a floor. Real incidents start at 2 a.m., with the one expert on a plane.

Turning results into changes

A test that ends with a report and no changes has only measured the problem. For each finding, decide whether it changes the plan, the infrastructure, the training or the target. Log the change in the plan itself (section 11 of our business continuity plan template has a slot for it) and book the retest before closing the item. Technical findings usually land in recovery runbooks, and the disaster recovery plan template shows where restore procedures and their measured times belong.

Some targets turn out to be wrong rather than missed. If every way to hit a 4-hour RTO costs more than four hours of outage would, take the evidence to the activity owner and reset the target in writing.

The usual ways programs go soft: testing only technology, reusing last year's scenario, letting the plan's author grade the test, and closing findings on a promise instead of a retest. A test that found three real gaps went well.

Frequently asked questions

How often should a business continuity plan be tested?

At least once a year for the plan as a whole, using a mix of test types, and again after a significant change such as a new site, system or key supplier. ISO 22301 does not fix a frequency. Contact lists and notification tools deserve a quarterly check because they decay fastest.

What is the difference between a tabletop exercise and a functional test?

A tabletop exercise is a discussion: people talk through what they would do in a scenario, and nothing is switched off or restored. A functional test performs one capability for real, such as restoring a system or running a call tree, and measures it against a target. One tests decisions, the other tests capability.

Does a small business need a full interruption test?

Usually not. The risk of causing a real outage outweighs what it adds. A small firm learns more from restoring its key systems to a spare machine and running a day of its manual workarounds.

What counts as passing a business continuity test?

Each objective met as written: the activity was usable within its RTO, data loss stayed within its RPO, and the plan worked without hidden steps. A test that misses its targets still pays off if it produces owned, dated fixes and a retest.