I’m trying to write delta table in to S3 bucket and getting this error.
Py4JJavaError: An error occurred while calling o229.save. : java.lang.NoClassDefFoundError: org/apache/spark/sql/execution/datasources/FileFormatWriter$Empty2Null
I’m using delta-spark:3.2.0, pyspark:3.5.1, Python:3.11, JDK 11, hadoop-aws:3.4.0 and delta-core_2.12:2.3.0