Module 7 Lesson: Sampling Variation and Confidence Intervals
Classroom Explanation
Imagine we are in class and someone puts a small table on the board. The table looks simple, so it is tempting to jump straight to the answer. In statistics, we slow down first. We ask what question the table can answer, what question it cannot answer, and what kind of claim would be safe.
In this module, the goal is to interpret estimates with uncertainty ranges instead of false precision. The important part is not only the calculation. The important part is the thinking before and after the calculation.
Why This Matters
The common mistake is saying there is a 95% chance this exact interval contains the true value. The beginner-safe wording is that the method gives a reasonable uncertainty range. This mistake can make a report sound more confident than the evidence deserves.
Key Ideas
1. A statistic describes the sample.
A statistic is calculated from the sample in front of us. It is useful, but it is still only an estimate of something broader.
2. A parameter is the unknown value in the wider population.
A parameter is the wider value we wish we knew. We rarely see it directly, so we use sample evidence carefully.
3. A confidence interval gives a reasonable range for the unknown value under the method used.
A sample estimate is not the final truth. The interval reminds us that another reasonable sample could have produced a nearby but different result.
Worked Example
A course completion estimate of 68% with an interval from 61% to 75% should be written as an uncertain estimate, not as exactly 68%.
Here is the dataset used in this module.
| estimate_id | metric | estimate | lower_ci | upper_ci | sample_size |
|---|---|---|---|---|---|
| CI01 | average study hours | 5.2 | 4.6 | 5.8 | 120 |
| CI02 | course completion rate | 0.68 | 0.61 | 0.75 | 180 |
| CI03 | average delivery time | 33.5 | 30.2 | 36.8 | 75 |
| CI04 | support ticket rate | 0.052 | 0.044 | 0.060 | 900 |
| CI05 | proportion preferring practice tasks | 0.57 | 0.49 | 0.65 | 150 |
Read the table slowly. First name the unit. Then name the variables. Then name the comparison or pattern. Only after that should you write the conclusion.
How To Think Through It
- State the question in one sentence.
- Name the unit of analysis.
- Identify the outcome and comparison.
- Check the denominator, sample, uncertainty, or assumption.
- Write only what the data supports.
- Add one limit so the result does not overclaim.
Common Mistake
The common mistake is saying there is a 95% chance this exact interval contains the true value. The beginner-safe wording is that the method gives a reasonable uncertainty range.
How To Write The Result
The sample completion rate is 68%, and the uncertainty range suggests the wider completion rate may plausibly be around 61% to 75%.
Practice Prompt
Interpret three intervals and write one common misinterpretation to avoid.
Takeaway
When a statistical result feels obvious, pause and ask: what exactly was measured, compared, and assumed?