Module 11 Summary
What this module established
Take the model as a parameter and everything except the model's own behaviour becomes testable with no key, no cost and no network - which is where most bugs actually live.
Carry forward
- Script the fake's responses to drive retry, refusal and give-up paths. You cannot make a real model return invalid JSON on demand.
- Assert on citations, figures, length and absence of hedging. Exact-match assertions fail on harmless rewording and end up disabled.
- Split the offline suite from the paid one and keep it fast. A suite that takes minutes is a suite people stop running.
Before moving on
Move on when the offline suite passes with no key in seconds, and the refusal and retry paths are both exercised.
