Module 11 Activity

Scenario

The capstone. Everything in this course, written as a design brief a competent stranger could build from without asking you anything.

What you produce

A complete RAG design brief with an evaluation plan, for a corpus and an audience you have named.

Steps

1. Write the scope: who asks, what it answers from, what it never answers, how fast it must respond, and what success looks like in observable terms.
2. Specify chunking, metadata and permissions together, including an id format that survives the corpus being reorganised.
3. Build the evaluation plan from kinds rather than questions. Report the count per kind and the refusal share.
4. State the failure modes you accept, each with a mitigation and a residual risk.
5. Assemble the brief so that every field has a value and none says 'to be decided'.
6. Hand it to someone and write down every question they have to ask. Revise until those questions disappear.

Evidence to hand in

• The complete brief, every field populated.
• The evaluation plan with kinds, counts and refusal share.
• The accepted-failures table with three columns.
• The list of questions your reader had to ask, and the revised brief.

Review checklist

• No field says 'to be decided'.
• The evaluation plan covers at least six kinds with a refusal share above a quarter.
• Every accepted failure has a mitigation and a residual risk.
• Next steps name what you know is missing.
• The reader's questions are recorded, and the brief was revised in response.

Mark complete