I have a requirement to gather run duration (time) for the last 3 months, for a particular airflow job.

In our CDE environment we use airflow to call spark DBT jobs, of late the run duration of job have increased drastically.
I assume there would be a way to gather this jobs runtime duration for further analysis etc. Hoping for some assistance / guidance in getting his done.

CDP Public Cloud / CDE Version – 1.19.3-b29

Thanks

Capturing details via CDE UI is not feasible hence want to know of other methods to get this required information