I have in-memory text, json format, and I am trying to load dataset (HuggingFace) directly from text in-memory.
If I will save it into file – I can load the dataset using huggingface load_dataset:
from datasets import load_dataset
dataset = load_dataset('json', data_files='my_file.json')
See also: https://huggingface.co/docs/datasets/v1.11.0/loading_datasets.html#from-local-files
Can I load the dataset directly from the in-memory text without saving it into file?