I want to use Raft Retrieval Augmented Fine Tuning to build a smart chatbot. My data consists of scraped text from multiple websites. Should I transform it all to QAD format? If so, is there a way to do it automatically?
considering that my dataset is very large and doing it manually would be very difficult?