Relative Content

Tag Archive for langchainlarge-language-modelollamaretrieval-augmented-generation

How to load web articles into RAG LLM for embedding

I watched this tutorial (https://youtu.be/2TJxpyO3ei4) on setting up RAG (retrieval augmented generation) using LLMs (I used a local embedding model and a local model for queries). I want to be able to have a data folder where I can read the documents from HTML files (or more preferably links). I believe this website (https://python.langchain.com/v0.1/docs/modules/data_connection/document_loaders/html/) goes through it but I don’t know how to add this to my already existing code that loads the document.