I am trying to run the Merlyn-education-corpus-qa model on my two RTX 4090 graphics cards. The code I am using is exactly the same as the one on the HuggingFace page for the model (https://huggingface.co/MerlynMind/merlyn-education-corpus-qa). The only change I’ve made to the code is adding the .half() to the model and the inputs:

I am trying to run the Merlyn-education-corpus-qa model on my two RTX 4090 graphics cards. The code I am using is exactly the same as the one on the HuggingFace page for the model (https://huggingface.co/MerlynMind/merlyn-education-corpus-qa). The only change I’ve made to the code is adding the .half() to the model and the inputs:

I am trying to run the Merlyn-education-corpus-qa model on my two RTX 4090 graphics cards. The code I am using is exactly the same as the one on the HuggingFace page for the model (https://huggingface.co/MerlynMind/merlyn-education-corpus-qa). The only change I’ve made to the code is adding the .half() to the model and the inputs: