Need advice on design a streaming data system [closed]
Closed 1 min ago.
Need advise on design a streaming data system
About the context, I am building an API where we will be streamed enormous amount of data to our API. I am using Spring Boot to build the API but one of my colleague says we will need a streaming framework like Kafka or SQS to handle the message. Can someone advise which streaming framework is appropriate and how the structure should be to handle let say e.g 200Mb of text file/hour => business process => store to db .
Happy for any suggestions about the structure and tech stack