I have an airflow job which launches a Spark job in one task and next task extract the application logs to find the spark job appplication Id . I am using Xcom push in the spark submit task and then xcom_pull in the next task