I am running a Google Transfer Job to copy files from ADLS to GCS.

Seems when a specific file in ADLS is being written or updated, the storage transfer job fails for that specific file.

Error The condition specified using HTTP conditional header(s) is not met.

I assumed that the job would pick up the last version of the files if its currently being overwritten or leave the files for that job instance and pick up next time.

Any idea on how to resolve this issue?