Module 13 Knowledge Check
5 questions. Pass mark 4 out of 5. Answer every question before checking the answer key below, then retry after reading the feedback.
1. A must_never rule is enforced when…
- A. it is in the system prompt
- B. the capability does not exist in any code path
- C. the model complies in testing
- D. it is documented
2. The refusal string should be…
- A. phrased by the model each time
- B. fixed, so tests can assert on it exactly
- C. omitted
- D. personalised
3. The refusal branch in tests should be forced by…
- A. a carefully chosen question
- B. a parameter
- C. an empty corpus
- D. a mocked exception
4. Boundary checks in the report must be…
- A. high
- B. exactly true
- C. above a threshold
- D. trending upward
5. A report that never blocks a release is…
- A. a sign of quality
- B. a formality
- C. the goal
- D. evidence of good engineering
---
Answer Key and Explanations
Check these only after attempting every question.
1. B - the capability does not exist in any code path
A prohibition that depends on the model complying is not enforced.
2. B - fixed, so tests can assert on it exactly
Twenty variants means no test can match, and several will contain a hedged guess.
3. B - a parameter
A chosen question depends on the corpus and the threshold, both of which change.
4. B - exactly true
A single violation blocks release regardless of every other number.
5. B - a formality
The verdict is the output; if it cannot be negative it carries no information.
Practical Check
Apply this module to your own work: complete the module activity for *Capstone: Useful AI Assistant with Evaluation Checklist*, then write one sentence naming what your result shows and one naming what it does not.
Strong Answer Pattern
A strong answer names the task, the evidence used, the check performed, and the remaining limitation. It avoids "proved", "guaranteed", or "always" unless the evidence genuinely supports it.