I have a glue job which reads data from S3 (csv file) and then transform data using below query before inserting the data into SQL Server table.
This job is part of workflow and job using bookmark on S3 so that it runs only for new or updated file. Job is failing in scenario when there is no new file or updated file in S3 folder. Job works fine when S3 has new or updated file. How can I make sure the job runs fine in either case.
SELECT 'SomeValue' As Column0, Column1,Column2,Column3,Sum(Column4) FROM MyTable Group By Column1,Column2,Column3