I’m launching a job (automatically detected as batch) that reads a csv (3 records) and outputs the same content to Kafka. At the end of this job, which takes about 3s to run, I need to get some metrics, including custom ones.
Problem is that no metrics are reported until the internal is reached. I’m using a custom reporter that uses Prometheus push gateway and I’ve even called .report() on .close(). Still no metrics are showing.
Other jobs, long-lived, are working just fine.
Am I missing something or this something that is not supported?
Thanks
I’ve called Thread.sleep on one of the mappers that adds a custom metric, and it works it the goes beyond metric interval.