Chapter 9 · Test
Test — Turn Uncertainty into Evidence
Test like you mean it. Start with why, and let evidence — not optimism — carry you into release.
Step Inside
Testing turns theory into evidence — replace "we ran the tests" with "we know we're ready."
Testing turns theory into evidence. Start with why: write a hypothesis, define pass/fail up front, and choose the right kind of test — developmental or acceptance; verification or validation. Two valid cultures frame the work: NASA's caution-first (simulate exhaustively, build in redundancy, verify before flight) and SpaceX's iterate-fast (prototype, fly often, learn from every failure). The Right-Sized move is to blend them: simulate for safety, iterate for speed.
Run a crisp TRR to lock versions, stabilize the environment, set roles and abort criteria, and confirm data capture works before the first run — because environmental instability loves to masquerade as system failure. On test day, over-communicate, lean on a skilled technician, keep safety nonnegotiable, and let no one freelance (the "rogue agent" quadcopter is a cautionary tale).
Afterward, document or lose it: hotwash while it's fresh, verify data integrity, log anomalies, run root-cause analysis, and update the risk register and baseline. Testing spans seven realms — from risk-reduction ("does this idea even work?") to beta ("does it solve the customer's problem?") — and the goal throughout is the same: replace "we ran the tests" with "we know we're ready."
"The more we sweat in testing, the less we bleed in production."
Action Plan
Leader Action Items for Better Test Outcomes
Four steps to get started
-
Use the TRR Template.
Before your next test, download the TRR checklist from the RSF Framers Community. Structure a focused, high-quality review to surface issues before hitting the range. -
Start with Why.
Every test should begin with a clear purpose. Write down why you're testing and what success looks like. Then make sure every team member sees it. -
Hire a Tech.
A skilled technician can catch manufacturing issues, execute safety procedures, and save the day when plans break down. Technicians are often the institutional memory of your system. Ignore them at your peril. -
Design for Test and Record Everything.
Build in test points. Use debug ports, instrumentation, and cameras. A single video can validate performance, capture a surprise, or become your next PR milestone.
Directed Tools and Templates
Test smarter, not harder.
The Test Hub holds everything you need to run a right-sized test phase — TRR checklists, test plans, hotwash templates, and root-cause worksheets. Review Hub covers the gate criteria that turn test results into a confident release decision.
Self-Assessment
Test-Phase Health Check
Testing is where confidence is built or quietly lost — the difference between "we ran the tests" and "we know we're ready." This scores the six disciplines of a right-sized test phase separately, so you can see which is building confidence and which is leaving you on hope. Answer honestly; it's a mirror, not a report card.
1 = Never true · 2 = Rarely · 3 = Sometimes · 4 = Often · 5 = Consistently — answer honestly. This is a mirror, not a report card.
References & Further Study
Go Deeper
- bookAccelerate
- bookLessons Learned in Software Testing
- bookPractical Reliability Engineering
- article
- article
- article
- videoJez Humble — Continuous Delivery
- videoTest Like You Fly (Frank DeMauro)
- videoReflecting on Continuous Delivery