For example,I am using Ollama or transformer api to infer a result,but the inference process was interrupted because I accidently typed ctrl+c or internet connection is unstable.
Is it possible to recover the inference based on the existing output(like sentences) and prompt and any needed cache?
Many thanks
I am not sure if it is possible.
New contributor
yifan zhang is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.