Your experiment decision record
Write this before opening the test. Replace every prompt with your own reasoning.
- Row unit, prediction time, action and person responsible for reviewing alerts:
- Regression and classification label definitions and availability horizon:
- Features allowed and forbidden, with two availability examples:
- Exact split windows, gaps and why random/group splits answer different questions:
- Baselines, primary metrics and proposed operational cost assumptions:
- Candidate models, training-only tuning search and selection rule:
- Calibration policy and threshold selection window, including capacity constraint:
- Validation results with sample sizes and uncertainty/limitations:
- Freeze identifier and date; what changes would require a new evaluation:
- After freeze only: final test results and baseline comparison, including capacity:
- Error investigation and what cannot be inferred causally:
- Handoff owner, monitoring signals, matured-label schedule, fallback and go/no-go:
Do not write that the system is production-ready merely because code runs.