We have copied all the files from multiple drives in the sharepoint site using Azure Data Factory pipelines and we have followed the same folder structure (heirarcy of folders) while copying the files. Now we want to make sure if a file is deleted from the sharepoint then it should be deleted from ADLS container.
We have created pipeline for two phase one getting files from Sharepoint and storing it in json format with name sitename_documentLibrary. Then we crawl adls container and call the respective json file. Here we are missing the folder structure. If in one document library there are A and B folder both have 1.txt it will create a mess because important files may delete. So please suggest me alternate approach for this.