We are trying to handle (to import data via Plaid API), large amount of data on the spreadsheet (google sheet). The external API needs to be used in the while loop because response needs to be check the condition is true or false. If the conditions meets true then the loop will continue until condition false. And also the external API has limit restrictions(50 calls per minute). We need to store all the response in a single variable like array collection then we need to format and manipulate them in the spreadsheets.

We have shared the code here for you.

Following approach: https://gist.github.com/sdesalas/2972f8647897d5481fd8e01f03122805

Async.call('updateSpreadSheet');

var responseData = [];

function updateSpreadSheet(){
  var collection = [];
  let response = fetchAPITransactions();
  if( response == true ){
   collection = fetchMoreAPITransactions();
  }
  if(collection.length > 0 ){
   manipulateDatatToSpreadsheet(collection);
  }
}

function manipulateDatatToSpreadsheet(){
 //format data and add/remove data on the spreadsheets.
}

function fetchMoreAPITransactions( response ){
 while( response == true ){
    responseData.push( response);
  break;
  }
  return responseData;
}
 
function fetchAPITransactions(){
 //call api end point and response. 50 calls per minute. 
 var response = responsedataofAPI;
 return response;
}

Is this approach correct for calling the Async function to execute the loop, the triggers are not called sequentially, this makes the data in the Spreadsheet also not in correct format. or not in sequence as per date order. This process also runs for a very long time 45 to 60 minutes which is not practically feasible while retrieving the data. What is the best approach in this case? We expect the data to be ordered by date in the spreadsheet and to fetch the data much quicker.

Thanks in Advance.