We want to get all files from the sharepoint into our ADLS container. In sharepoint drive there are arround 60k files but through our existing pipeline we are getting only 600 files. We have a web activity with below url:-

https://graph.microsoft.com/v1.0/drives/@{pipeline().parameters.DriveID}/items/?$filter=lastModifiedDateTime ge @{pipeline().parameters.lastUpdate}&$count=true

And we are also handling odata.nextLink efficiently. I don’t know where I’m going wrong. We have huge heirarcy of folder like :-
In drive we have A, B, C, D folders where A has E, F , G and again they have subfolders. So there is a huge heirarcy (max hierarchy we have is 10 level). Now please help me to find the best approach so that we can copy all the files from sharepoint without missing a single file.

I tried to use different MS graph api url where we will first get the root folders, then we will update the folder I’d but this logic is very difficult because of the heirarcy of folders we have.