My project is about find the correct information from a document that user uploaded. So, i decide to use RAG to help OpenAI model, by limited a region that it should search to find the correct answer for the prompt ( question ) that user need. But RAG model that i implemented face several challenges related to data chunking, embedding management, and keeping up with changing data and it isn’t automate because every time i had a new document i should change value of the chunk size, embedding prompts and overlap. Can you suggest me a solution to overcome with those challenges?
I trying to find the correct information from a document that user uploaded.The information that i try to find not change. but the document that i receive changing every time. So, it may has a different words to describe the same thing.
Negar Negahdaripour is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.