How to process Python Polars LazyFrame in batches
I would like to lazy load a large parquet file. I then need to process it in batches because I’m writing into a database, and there is a limit to how many rows can be written to the database at once. LazyFrame has no write_database method, so I’m collecting batches into a dataframe to use DataFrame.write_database.