I am sending compressed data into Event Hub to overcome 1 MB hard limit in Azure Event Hub .
I also have to read this in Py-spark and update Delta table .
The compressed data send to Event hub is coming as null in Py-spark stream .
Please suggest to read .
This is how I am reading from Event Hub
df_stream_body = df_stream.select(F.from_json(F.col("body").cast("string"), message_schema).alias("Payload"))