Module 03 Knowledge Check
5 questions. Pass mark 4 out of 5. Answer every question before checking the answer key below, then retry after reading the feedback.
1. Which work should NOT be given to a model step?
- A. Summarising a document
- B. Exact arithmetic, lookups, and rule application that code can do reliably
- C. Drafting an email
- D. Classifying sentiment
2. The main benefit of pushing logic into deterministic nodes is…
- A. Lower cost only
- B. Reproducibility - the same input gives the same result, so it can be tested
- C. Nicer output
- D. Fewer nodes
3. A model step that must return structured data should…
- A. Be trusted to format correctly
- B. Be validated against a schema, with a defined path when validation fails
- C. Use a longer prompt
- D. Run twice
4. Setting temperature to 0 makes an LLM step…
- A. Deterministic and testable
- B. More consistent, but still not guaranteed identical across versions or providers
- C. Faster
- D. Cheaper
5. A good rule when designing a new node is…
- A. Default to the model
- B. Ask whether code could do it reliably first, and use the model only where judgement is genuinely needed
- C. Always use code
- D. Combine both in one node
---
Answer Key and Explanations
Check these only after attempting every question.
1. B - Exact arithmetic, lookups, and rule application that code can do reliably
Determinism is free in code and expensive-to-impossible in a model. Use each for what it is good at.
2. B - Reproducibility - the same input gives the same result, so it can be tested
Every deterministic node is one fewer source of run-to-run variance.
3. B - Be validated against a schema, with a defined path when validation fails
Schema validation converts a silent format drift into a handled, visible failure.
4. B - More consistent, but still not guaranteed identical across versions or providers
Low temperature reduces variance; it does not make a model step equivalent to code.
5. B - Ask whether code could do it reliably first, and use the model only where judgement is genuinely needed
Reserving the model for judgement keeps the surface where things can go wrong as small as possible.
Practical Check
Apply this module to your own work: complete the module activity for *Deterministic Steps Versus LLM Steps*, then write one sentence naming what your result shows and one naming what it does not.
Strong Answer Pattern
A strong answer names the task, the evidence used, the check performed, and the remaining limitation. It avoids "proved", "guaranteed", or "always" unless the evidence genuinely supports it.