Airflow Glue Catalog Partition sensor
I have a glue catalog table which is updated by an upstream process multiple times in a day. Table is partitioned on two columns business_date and source. Upstream will never append data in a partition. If partition already exists, it will be overwritten. Also upstream can modify the table for only older business_date as well (e.g. one month old business date).