I’m trying to find specific documentation about how Spark’s Catalyst optimizer works in detail because I plan on customizing it in a way that’s tailored to reduce resource usage rather than computational time.

I do understand its role and how it’s used but what I want to know is how does the optimizer does the optimization without having to execute the code? Does it use a AI model? Is it brute computation?