I have configured spark history server. I am exposing my Spark application metrics to prometheus to create a grafana dashboard. since the spark_info metric data is short-lived and getting removed from prometheus/thanos, I am looking to create Grafana dashboard based on spark history metrics.
Is the spark history server compatible with the Prometheus format ?
How can I expose Spark History server metrics to Prometheus ?

I tried to scrape the endpoing http://localhost:18080 (spark history UI), but it is throwing error related to format issue.