Low Accuracy on MNLI Validation Set Using Hugging Face DistilBERT Model
I’m encountering low accuracy (7.90) when evaluating my Hugging Face DistilBERT model on the MNLI validation set. I suspect that I might not be training or preparing the model correctly. Could someone help me verify if my approach to tokenization, data loading, and evaluation is correct? Any advice or pointers would be greatly appreciated!