Accessing Kafka Headers when ingesting message with promtail
I am currently trying to ingest Kafka Messages on certain topics to loki using promtail.
So far, everything seems to work out.
But I do also need some of the Kafka Message Headers as labels in loki.
How do I change the Promtail scrape interval for Kafka job
I have Kafka running in a Kubernetes cluster and using Promtail to send Kafka messages to Loki. Right now there is about a 5 second delay between when the message is produced and when Loki receives it. I’d like to know if there is any way to get this delay shortened to as close to “real-time” as possible.