I’m trying to finetune the inceptionv3 model on my dataset.The unfrozen layers starting from the 250th layer onwards. And I’m using RMSprop optimizer. While during training there is huge difference between training loss and validation loss and overfitting occurs. How can I reduce the validation loss and optimize the validation accuracy during training?
I have greyscale image dataset and have 4 classes each for training and validation.