I am currently migrating a large database (~500GB) from MySQL to ClickHouse and need guidance on how to handle the following technical challenges:
Syncing Data During Migration:
I need to keep the MySQL and ClickHouse databases in sync during the migration process. What are effective ways to achieve this, considering the size and frequency of updates?
During the migration, I want to ensure that all data is accurately transferred, especially given the differences in how MySQL and ClickHouse handle data types and queries.
I need to set up and schedule ETL jobs for both the migration and ongoing synchronization. How can I do this in a way that minimizes downtime and maintains performance?
Indresh is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
2