I am trying to set the group.instance.id
parameter for Kafka Connect connectors so I can utilize Static Membership for the workers.
I believe this parameter has to be unique at the consumer level.
For the case of group.id
, we can just set it in the worker.properties
file:
group.id=connect-$connectorname
However, where can we set the group.instance.id
? If it is set in the worker.properties
file, can it be unique at the consumer level?
Or do we need to manually set it in the function where the consumers and their IDs are generated?
I was thinking it would be good to have it be set to the consumer id (something like instance-id123, instance-id321, ...
but not sure where to add the logic to do that.