Relative Content

Tag Archive for apache-kafkakraft

Error Starting Multiple Kafka Brokers with KRaft using Docker Compose: Metadata and Checkpoint File Issues

When attempting to deploy multiple Kafka brokers using Docker Compose with KRaft consensus protocol, the setup fails to initialize correctly. Each Kafka broker is configured to use KRaft (KAFKA_CFG_PROCESS_ROLES=controller,broker), with listeners and advertised listeners defined for each node (kafka-1, kafka-2, kafka-3). Despite configuring these settings, the brokers encounter errors related to metadata file creation (Error while writing meta.properties file) during startup. These errors prevent the brokers (kafka-2 and kafka-3) from fully initializing and cause them to exit with code 1. The setup works when deploying a single broker (kafka-1), suggesting that the issue specifically pertains to configuring multiple brokers with KRaft using Docker Compose.

Kafka cluster. Kraft mode.Constantly changing controller, lots of errors

We have many projects related to Kafka. On one of them, a couple of years ago they raised a cluster of 3 Kafka with version 3.3.1. And everything in general was fine, when suddenly I recently planned to raise a connector on it from the database and before that I decided to look at the logs.. And so there is an endless change of controllers and errors, and so on endlessly.. At the same time, I can create a topic and delete it too. Clients and the sender interact without problems, they do not observe any errors.