Module 06 Assessment: Metrics and Thresholds Check
Assessment ID: ML-M06-QA01 Estimated active time: 35-50 minutes Status: Draft
Part A: Concept checks
Answer in one or two sentences.
- What does the confusion matrix show that accuracy alone does not?
- Report precision and recall at three thresholds.
- Which error type costs more in this scenario, and what follows for the threshold?
- What did the ten most confident mistakes have in common?
- Why is a bucket of fewer than ten rows unreliable evidence?
Part B: Applied task
Use the supplied synthetic dataset to complete the module activity: Compare thresholds and write why one operating point fits the decision better.
Part C: Explanation
Explain your threshold choice, the error pattern you found, and two limits on the metric you reported.
Rubric
| Level | Evidence |
|---|---|
| Pass | Completes the activity, explains the output in plain English, compares or limits the result properly, and avoids overclaiming. |
| Revise | Completes most of the task but misses one important comparison, limitation, or data-safety boundary. |
| Not yet | Treats synthetic results as real-world proof, omits the required evidence, or ignores the module safety rule. |
Safety rule
Do not use real personal, confidential, employer, client, health, financial, authentication, or sensitive data.
