I want to create a data historian which collects the data from meters and meter is sending data every minute. I want store it in some DB for for like 5 or 10 year and want to use that data for forecasting, Analytics and other user Functions.
I’m confused
- If there are 100,000 meters someday is MQTT will be able to handle data.
- What database should we use apart from Postgres SQL.
- How Kafka can be useful in this.
- Any Suggestions to design such things.
I’m thinking of using Kafka as medium for data transfer, but confused which DB to choose to store data. Also, want to know if Prometheus can somewhat helpful in the whole scenario. Any help would be appreciated.