Llama-3-8B-Instruct does not return scores for the input, only -inf values. It’s not a problem with other models. How can I fix it?
Here are the main functions for this. Basically, I need to calculate the surprisal for each of two options given the prompt.
Llama-3-B-Instruct does not return scores for the input, only -inf values. It’s not a problem with other models. How can I fix it?
Here are the main functions for this. Basically, I need to calculate the surprisal for each of two options given the prompt.