Deep Learning · Module 6
Answers and explanations · Ask what extra flexibility actually buys
Compare these references after your own attempt. You can read them at any time; they do not record a live model or vendor run.
Deep Learning · Module 6
Compare these references after your own attempt. You can read them at any time; they do not record a live model or vendor run.
06A. Linear(2,1) has 3 parameters. The 2–16–1 MLP has (32+16)+(16+1)=65. The displayed 2–16–16–1 MLP has 48+272+17=337. ReLU permits non-affine behavior; extra affine layers alone collapse to an affine map.
06B. A half-plane cannot include the entire inner circle while excluding the entire outer one. Multiple learned piecewise-linear regions can approximate an enclosing boundary. Finite noisy data still requires evaluation; representational possibility is not a performance guarantee.
06C. A sound plan fixes split IDs, train-only scaling, candidates, seeds and budget; selects checkpoint and model by validation loss; and uses the test set once after those choices. Accuracy/confusion can support interpretation. No score should be invented in advance.