The existence and optimality properties of the critical points of the linear neural networks with mean-squared loss function in the face of regularization.