Is there a way to trigger DAG when the current run fails?
Can I trigger a DAG immediately when the current run fails (it doesn’t matter which of the tasks failed), without scheduling it?
Airflow script to schedule dag for every hour has loaded data for next 5 days instead of live updates every hour
I created an Airflow script that pulls info from Open weather api and loads into Postgres database locally.The Dag is running successfully and executes every hour however data for next 5 days has been loaded into my database instead of sequential loading of data every hour and updating the database. Whenever I trigger the Dag, the data is not updated anymore, just whatever data was loaded initially exists and no updates anymore.
Create a DAG function which run everyday at 7 A.M
To create a DAG function in Airflow that runs a Bash command every day at 7 A.M, you can follow these steps: