I am developing a project where I give a transcript of a video to an LLM (I’m simply calling OpenAI’s APIs). The LLM generates a wide range of data such as summaries, named entities (NER), etc. I want to store all the data in a database. I’m considering using a relational database and perhaps I’ll need to pre-process the LLM-generated response to store in the tables (OR should I store the data as a JSON format?). Another option is a NoSQL database (eg. MongoDB) where I can dump the response as a document in collections. Can someone please guide me? What is the best practice for the production environment?
Bhushan Mahajan is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
1