Multi-layer networks

Check your knowledge

Which of the following is true when the model overfits during training?

Training and validation accuracy start to decrease

Validation accuracy increases, training accuracy stops to increase

Training accuracy continues to increase, validation accuracy starts decreasing

Validation accuracy becomes significantly smaller than training accuracy

We have defined two-layer model, and it does not show any benefits comparing to one-layer model. What could be the problem?

The size of the hidden layer is larger than the size of the output layer

The size of the hidden layer is the same as the size of the output layer

We have forgotten to specify activation function between layers

You must answer all questions before checking your work.