Module 12 Knowledge Check
5 questions. Pass mark 4 out of 5. Answer every question before checking the answer key below, then retry after reading the feedback.
1. The two report sections most often dropped are…
- A. question and data
- B. uncertainty and limitations
- C. method and result
- D. result and next step
2. Putting the analysis in importable modules rather than notebook cells means…
- A. it runs faster
- B. the same code can be unit-tested and reused by a job or another report
- C. the report is shorter
- D. no seed is needed
3. A chart accompanying a significant difference should ideally show…
- A. the two means with error bars
- B. the distributions, including their overlap
- C. the p-value
- D. the raw data table
4. An interval of [+0.06, +3.66] pp against a pre-set 2 pp bar is…
- A. a clear launch
- B. a real effect of uncertain importance
- C. no effect
- D. practically irrelevant
5. The conclusive test of reproducibility is…
- A. passing the checklist
- B. deleting the outputs, restarting the kernel, re-running and comparing
- C. recording package versions
- D. having no absolute paths
---
Answer Key and Explanations
Check these only after attempting every question.
1. B — uncertainty and limitations
They are what distinguishes an analysis from an argument.
2. B — the same code can be unit-tested and reused by a job or another report
A notebook cell cannot be imported. The report then cites return values through inline expressions.
3. B — the distributions, including their overlap
The group SDs were around 9 against a difference of 3.24 — real, reliable and small relative to individual variation.
4. B — a real effect of uncertain importance
It excludes zero but straddles the bar, so the data cannot say whether the effect clears the threshold.
5. B — deleting the outputs, restarting the kernel, re-running and comparing
Without restarting, objects still in memory make code appear to work when it depends on a step that no longer exists.
Practical Check
Apply this module to your own work: complete the module activity for *Capstone: Statistical Report*, then write one sentence naming what your result shows and one naming what it does not.
Strong Answer Pattern
A strong answer names the task, the evidence used, the check performed, and the remaining limitation. It avoids "proved", "guaranteed", or "always" unless the evidence genuinely supports it.
