Optimization, Initialization, Normalization, and Regularization

teach why training can fail and how to diagnose it.

Units

1. Unit 05.00: Learning rate and optimizer choice
2. Unit 05.01: SGD, momentum, Adam, and practical trade-offs
3. Unit 05.02: Initialization and vanishing/exploding gradients
4. Unit 05.03: Batch normalization and layer normalization intuition
5. Unit 05.04: Dropout, weight decay, and early stopping
6. Unit 05.05: Learning curves and instability signals
7. Unit 05.06: Project step: training diagnostics report

Module work

• Activity
• Knowledge check
• Summary