I have a container running Spark on port 7077, and got the container IPAddress through Docker inspect command, and I’m trying to create a SparkSession through my host machine (I’m using Jupyter on my host) on the container’s cluster.

I Tried the following
`from pyspark.sql import SparkSession

spark = (
SparkSession
.builder
.master(“spark://1.2.0.4:7077”)
.getOrCreate()
)`

But it didn’t work, and I got the error:

An error occurred while calling o24.conf. : java.lang.IllegalStateException: LiveListenerBus is stopped.