Relative Content

Tag Archive for apache-kafkaapache-kafka-connectclickhousechange-data-captureclickhouse-kafka

Handling DELETE operations with ClickHouse Kafka Connect Sink

I’m working on a project related to building streaming change data capture using Kafka Connect. The source of changes is MySQL, then they are sent to the corresponding Kafka topic, and then applied to the table in ClickHouse using ClickHouse Kafka Connect Sink. Operations like INSERT and UPDATE are processed normally, but this sink connector cannot process operations like DELETE according to documentation (https://clickhouse.com/docs/en/integrations/kafka/clickhouse-kafka-connect-sink#limitations:~:text=Deletes%20are%20not%20supported) and usage experience.