TFWhisperForConditionalGeneration model.generate() returns repetitions of first word in sequence after finetuning
I fine-tuned TFWhisperForConditionalGeneration.from_pretrained("openai/whisper-tiny")
on the German version of mozilla-foundation/common_voice_11_0
. The training process looks fine (validation loss decreases asymptotically and WER drops) but when doing inference with the fine-tuned model, the output just consists of repeating words: