Capstone: Reliability Report for an LLM App
In this capstone you will produce a reliability report for an LLM application: its evaluation results, its cost and latency profile, its known failure modes, and the gates it must pass to ship.
Units
- Unit 12.00: Choosing the application and its quality bar
- Unit 12.01: Running the evaluation set
- Unit 12.02: Measuring cost, latency, and failure rate
- Unit 12.03: Documenting known failure modes
- Unit 12.04: The report and the gates it proposes