I’m developing an ADF Pipeline which should copy all the files from ADLS Gen2 /source/{sub_dirs}/*.csv files to Another ADLS Gen2 Path without creating sub_dirs folder but copy the files into /target/
A more easier explanation would be a below unix copy code.
cp /source/*/*.csv /target/
Example:
/source/sub1/file1.csv
/source/sub2/file2.csv
should be copied into
/target/file1.csv
/target/file2.csv
My pipeline however is creating a subdirectory same as present in source.
I don’t know where things are going wrong but i would really appreciate your input to achieve the excepted output.
FYI,
my design looks like this.
- Metadata Activity which gets all the file name from /source/{sub_dirs}/*.csv and is visible in the output.
- For Loop Activity to copy from source to target