I have spark executed in two different instances (one with spark.sql.adaptive.coalescePartitions.enabled=false and other spark.sql.adaptive.coalescePartitions.enabled=true). In the first instance the stage graphs has some retries and other one doesn’t have. Can you help me to understand retry means here and why the extra data shuffle it is doing.
1st one.
2nd one: