We have upgraded spark from 3.3.2 to 3.5.1 and the spark history URL is not able to parse the logs completely. We have tried using Minio and DELL ECS storage where 1 log file is available. The same works parsing works in 3.3.2 version.

I have spark history server running on kubernetes. Its configured to read events from a directory and i see events written there by my spark jobs. Spark history server does come up but shows no events. I have browsed questions posted about this issue but was unable to solve the problem.
My Set up:
Spark events are written to a file store with correct uid and gid. I am able to confirm this by logging into my pod and checking files. I am able to read the files, write to the directory without a problem. Set up a spark history server pointing at that directory. Server comes up clean. Log shows that its scanning/parsing and finished parsing files in the correct directory for events yet nothing is displayed.