Module 05 Assessment: Generalisation and Leakage Check
Assessment ID: ML-M05-QA01 Estimated active time: 35-50 minutes Status: Draft
Part A: Concept checks
Answer in one or two sentences.
- What score did a model achieve using every column, including post-outcome ones?
- Which single column was doing that work, and how did you identify it?
- What is the score once the leaking columns are removed?
- Explain the gap between those two numbers in one sentence.
- From your learning curve, is more data or a better model the constraint?
Part B: Applied task
Use the supplied synthetic dataset to complete the module activity: Compare a leaky experiment with a repaired one and explain why the score changed.
Part C: Explanation
Explain the leak, the honest score, and what your learning curve says about where to spend effort next.
Rubric
| Level | Evidence |
|---|---|
| Pass | Completes the activity, explains the output in plain English, compares or limits the result properly, and avoids overclaiming. |
| Revise | Completes most of the task but misses one important comparison, limitation, or data-safety boundary. |
| Not yet | Treats synthetic results as real-world proof, omits the required evidence, or ignores the module safety rule. |
Safety rule
Do not use real personal, confidential, employer, client, health, financial, authentication, or sensitive data.
