Module 05 Summary

What this module established

Score retrieval, citation and answer separately. An answer that is right by luck - correct, citing nothing - is indistinguishable from a working system until the question is one where general knowledge and your documents diverge.

Carry forward

• Ranks tell you what k should be; recall alone cannot. And the empty case is what keeps your threshold honest.
• Measure generation on a fixed context, or a retrieval gain and a generation regression cancel out and look like no change.
• An index rebuild is a change to the retrieval layer even when no code moved. Run the set before and after and read the broken list.

Before moving on

Move on when retrieval, citation and generation are scored apart, and an index rebuild has been regression-tested per case.

Mark complete