Relative Content

Tag Archive for c#.netapache-kafkakafka-consumer-apiconfluent-kafka-dotnet

Uneven distribution of consumed messages per consumer inside same consumer group for Kafka

I have to consume messages from a topic on a Kafka cluster with 10 partitions where messages are being evenly distributed accros them. I have a ASP.NET application with 10 background services where each service fires up a consumer (Confluent.Kafka 2.6.1) so that I can process messages from each partition in parallel. For now, I’m not doing any real processing so that is not affecting the time to consume new messages.