I’m new to llama and prompting in general, and would appreciate some help here.
Basically I am trying to use llama (8B with ollama) to extract a section from a long text. I used a prompt like this one:
I have a long document, and I need to extract a specific section titled ‘Introduction’. Please locate the section in the text that starts with the heading ‘Introduction’ and provide the entire content of this section until the next heading or until the end of the document. If the section isn’t found, indicate that as well.
However, llama didn’t seem to follow the prompt, and I kept on getting a section-by-section summary of the text. The same prompt seems to be working as expected on gpt-4o. Any suggestions on what might be wrong? (The text fits into the context window, and I set temperature at 0) Appreciate any suggestions or pointers here.