We have a requirement to copy files using azure data factory from one Azure storage account with a specific folder hierarchy (3 level and 4 level- both types of hierarchy structure) to another storage account (with different access permissions) with a flattened folder structure with file names prefix from source folder names.

For example if from storage account A, Container B, the file C is copied from B/x/y/z/C path then the destination filename would be x__y__z__C inside sink container.

The file size may be large files (>10 GB) or small files.

If anyone has any idea / done similar implementation any help would be appreciated.

I have tried with Get Metadata in a foreach loop but it was not working since there are multiple hierachies.
Also since file names should not be default ADF provided flatten hierarchy feature could not be used