Spark streaming Kafka into Hbase becomes slow after few hours
We have a structured streaming spark job which reads the data from Kafka and write into Hbase. We use hdinsight cluster where our spark version 3.3.1.5.4.5.
We have a structured streaming spark job which reads the data from Kafka and write into Hbase. We use hdinsight cluster where our spark version 3.3.1.5.4.5.