Relative Content

Tag Archive for airflowairflow-2.x

Airflow unable to create task groups dynamic

I have a task group that reads tables from schema and chunks it.
Another task group is responsible for doing a few operations on a group of tables. Airflow is trying to create the groups before knowing(checkTablesExist executes on startup and the following fails because context is not available ) how many tables exist and it is causing problems.

Airflow custom back fill Between start and end dates

I am looking for solution in airflow to schedule backfill run’s between custom start date and end date. I don’t have access to airflow API using CLI. I can use airflow UI as well trigger dag with Config. Using Config route how can I pass start_date, end_date to DAG & trigger it. Any help or direction on this will be appreciated. We are on airflow 2.xx version

Not able to find my DAG in airflow WEB UI even though the dag is in correct folder

I have been trying past 2 days to resolve this. There is a DAG python script which I created and saved it in the dags folder in airflow which is being referred to in the “airflow.cfg” file. The other dags are getting updated except for one dag. I tried to restart scheduler and also tried to reset the airflow db using airflow db reset and then tried airflow db init once again but still the same issue exists.