Module 1 Worksheet: Statistical Questions and Data Claims
Scenario
You are helping a beginner analyst review a small synthetic dataset. Your job is not to sound impressive. Your job is to make the safest useful statement.
Data
Dataset: claim-review-scenarios.csv
| scenario_id | vague_claim | likely_claim_type | safer_question | boundary_note |
|---|---|---|---|---|
| C01 | Students learn better with short lessons | inferential | In this sample do students using short lessons have higher checkpoint scores than students using long lessons? | Can compare groups but cannot prove lesson length caused the difference. |
| C02 | The new button improves signups | causal | In a randomized A/B test did the new button produce a higher signup rate than the old button? | Needs random assignment and practical-size review. |
| C03 | People who study more always score higher | predictive | In this dataset how strongly are study hours associated with score? | Association is not a guarantee for every learner. |
| C04 | The support team was worse in March | descriptive | Did the March support ticket rate per active account increase compared with February? | Counts alone are not enough without active-account denominators. |
| C05 | The training program works for everyone | inferential | Among learners who completed the training what average score change was observed? | Completion bias may make the result too optimistic. |
Your Task
Rewrite three vague claims into statistical questions and add one boundary note for each claim.
Questions
- What is the statistical question?
- What is the unit of analysis?
- Which variables matter most?
- What summary, comparison, or visual check is suitable?
- What does the evidence suggest?
- What should not be claimed?
- What limitation should be mentioned?
Write Your Conclusion
Write two to four careful sentences. Use plain English. Do not use words like proves, guarantees, or always unless the evidence truly supports them.
Self-Check
- Did I name the question?
- Did I use the right denominator or comparison?
- Did I avoid claiming more than the data can support?
- Did I mention uncertainty, bias, assumptions, or limits where needed?