We have upgraded spark from 3.3.2 to 3.5.1 and the spark history URL is not able to parse the logs completely. We have tried using Minio and DELL ECS storage where 1 log file is available. The same works parsing works in 3.3.2 version.

Any solution would be appreciated.

We have tried using Minio and DELL ECS. They work for 3.3.2 version but not 3.5.1 version.
We have increased the memory and cpu to the below.

Let us know how to debug this. Is it issue with kubernetes deployment or history server URL issues for 3.5.1 ?

resources:
requests:
cpu: 4000m
memory: 4096Mi