Relative Content

Tag Archive for conditional-statementsairflowdirected-acyclic-graphs

How to dynamically generate Airflow DAGs with groups, task and conditionals?

I am trying to create a bunch of python scripts to automate the creation of DAGs for Airflow 2.9.x. The idea is to list all tasks in Excel as these DAGs will have to orchestrate tasks for many different groups of Data Engineers and filling an Excel seems to be the best idea until we have a more dynamic was like a JS website to enter and arrange them in order.