Relative Content

Tag Archive for pythonpython-polarsdelta-lake

Concurrency with Python polars delta lake writes

I’m using Python Polars to append a dataframe to a local delta lake instance. When I attempt to run more than one instance of the script, the initial running script is terminated with no error. My understanding is that writing to delta lake in “append” mode should mitigate any write conflicts. The partitioning on source should separate writes as well.