I want to consume large as possible batches from Kafka via Spring-Cloud-Stream. But currently the first batch is big (~450 messages) and then all following payloads are around 1-10 messages. Between the small batches are only ~100ms:

I tried to set these config-values but without effect:

message.max.bytes: 99999999
max.poll.records: 1000
max.partition.fetch.bytes: 99999999
fetch.min.bytes: 99999999
fetch.max.bytes: 99999999
fetch.max.wait.ms: 5000

It seems, that these values are completely ignored. I tried these locations:

• spring.cloud.stream.binders.<BROKER-NAME>.environment.spring.cloud.stream.kafka.binder.consumer-properties
• spring.cloud.stream.binders.<BROKER-NAME>.environment.spring.cloud.stream.kafka.binder.configuration
• spring.cloud.stream.kafka.bindings.<BROKER-NAME>.consumer.configuration
• spring.cloud.stream.kafka.bindings.<BINDER-NAME>.consumer.configuration

Do I use the wrong config location?

Versions:

spring-cloud-stream: 4.1.2
spring-cloud-starter-stream-kafka: 4.1.2