I have already set up the following infrastructure:

Is it possible to set schedule_after_task_execution=False from within a DAG? I need this functionality only for one particular DAG that has a problem with the “mini scheduler”.
Is it possible to be set?
I tried this code but it doesn’t seem to work:

I’m trying to execute the same query for a list of BQ tables as separate tasks using BigQueryInsertJobOperator

I installed Airflow Version: v2.8.2 using Docker. When I use “Trigger DAG” on the page to execute a task, the task doesn’t run immediately. Instead, it stays in the queue and only executes after 5 minutes, even though my worker and resources are sufficient. I want the task to execute immediately whenever I click “Trigger DAG”. What should I do?

I am using Airflow to periodically run a query on an Oracle server. The connection string is defined in an Airflow variable called password_oracle_connections, so that it remains secret.

I’ve been trying to implement a master dag, that would trigger multiple dags, wait for their execution and proceed with the next tasks.

I have a dag that calls on a function that returns a PythonOperator. I want to get the results of this task, so that I can pass it to another task. Any ideas if this is possible?

This question is an addendum to Can I use airflow tags to determine if all DAGs with a certain tag has finished running?

I have Airflow in docker compose and I want to load D:del_10datamy_data.csv from local PC to Big Query.

After some changes logs are not visible in Web-UI, but log-file in log-catalog in worker container is OK