I have an eks cluster that includes multiple namespaces each with different microservices/components. I am looking to collect the Kafka metrics with Prometheus to build Grafana dashboards. I am installing using this helm chart “helm install my-kube-prometheus-stack prometheus-community/kube-prometheus-stack” inside of its’ own namespace “monitoring”. My Kafka components live in a namespace called “confluent-dev”. Once I access my Prometheus UI, I notice that I am only getting the metrics for the Kubernetes and can’t see any Kafa metrics.

One thing I had tried was to deploy the Promethues and Grafana inside the same namespace as Kafka, confluent-dev, but was still unable to see the Kafka targets.. Is there something I am missing? Should I be using a different Helm chart? How can I deploy Prometheus and Grafana into my EKS cluster to gather these Kafka metrics as well as the kubernetes metrics?