I need help parsing json files weighing more than 50mb. I am new to the topic of parsing and I have such a task in front of me: I need to parse the json file and write it into a Python dictionary, however, I was given a restriction and this can be done using only 1MB of RAM. Can you please tell me which libraries are best used to solve the problem and which approach to apply in general? Now my choice seems to have settled on the ijson library.
I tried to use the built-in json library, but it is expected to take up more memory than 1MB, and I wanted to work with yajl, but for some reason it refuses to download on my device, I tried using pip
required is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.