An csv file with 200 columns in adls. fetch only the list of columns from the config table. config table is in Azure SQL.config table has only 10 column names. how to create pipeline with this scenario in Azure datafactory?
Created a Lookup activity to fetch column names from the Azure SQL config table.
Added a ForEach activity to iterate over the column names.
Inside the ForEach activity, created a variable to store the current column name.
Added a Copy activity to filter the CSV file based on the current column name.
it is not working.
New contributor
Manushi is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.