Goal: Run a query and aggregate that data to a preexisting table every day at 6:30 AM EST which is connected to a Looker Studio report
Problem: When I schedule and test the query during my working hours and let it run, it works (around 9:30-10:30am EST). The table is updated as expected and I can see the data with my connected Looker Studio report. However, when I let the scheduled query run the next day at my desired time, 6:30AM, it runs successfully according to the logs however the table will not be updated.
Other information: My other scheduled queries are working as expected, but they are running DELETE from table commands. My original query to aggregate the data works as expected when I run it manually in the console, or do a Scheduled Backfill. I am using the Destination for Query results form to identify my dataset and table location. My current roles are BigQuery Data Viewer and Owner.
Why is this not working when I need it to run? Why am I not getting any errors? Does this have something to do with the timing? It doesn’t make sense to me why it works when I’m online and schedule it to run within a couple of minutes, but when I leave it be overnight it does not work.
Lily Tran is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.