Currently, I am exploring Driver Process in Apache Spark. I Have few questions around apache spark:
- Who will create Driver process, After submitting pyspark/ jar(scala) code into Spark cluster.
- Driver Process is unique to corresponding spark application or across to all submitted application in the cluster