neural network zeroing out after back propogation
I am trying to create a neural network from scratch in c++. I am training it on the NMIST dataset and using a linear algebra library called armadillo. I have figured out feed forward and calculating loss as well as accessing my dataset. However I can not get the network to optimize correctly as it is always just going to zero. My average loss just goes to 1.