Module 07 Activity

Scenario

The system refuses when nothing comes back. It can still invent, still answer from stale documents, and still pick a side when two passages disagree - all with correct-looking citations.

What you produce

Three detectors specified - conflict, staleness, unsupported claim - and combined into one escalation rule.

Steps

1. Give every passage an as-of date, and choose a staleness limit justified by how often that kind of document actually changes.
2. Specify how a numeric disagreement between the top passages would be recognised, and what the answer should say when one is found.
3. Specify the unsupported-term check and apply it by hand across your fifteen answers. Report how often it flags something.
4. Combine conflict, staleness, unsupported terms and a close score gap into one escalation rule, and say what the reviewer receives.
5. Introduce one contradiction into your corpus deliberately and confirm your conflict rule would catch it. Then remove it.
6. Write down what these three detectors cannot catch.

Evidence to hand in

• The staleness limits with their justification.
• The conflict rule and the wording it produces.
• The unsupported-term results across fifteen answers.
• The combined escalation rule and the reviewer's view.
• Evidence the planted contradiction would be caught.
• What the detectors miss.

Review checklist

• Staleness limits differ by document type, with a reason.
• Conflicts are surfaced to the reader rather than resolved silently.
• The escalation rule reports reasons, not just a verdict.
• The planted contradiction is genuinely caught by the stated rule.
• The limits of the detectors are written down.

Mark complete