Backstory: I have 12 zip files in Gen2 storage, each around 300 mb.
I am running a notebook within a pipeline job.
It goes smoothly until extracting the 6th zip file using pd.read_csv(compression =’zip’).
around the 27min 57 secs mark, the token is expired.