I’m using Hydra to manage parameters configuration of my model, and I wanted to do hyperparameter tuning.
I’m using two different optimizers, adam and sgd, and they have different parameters, so I wanted to use nested sweep to set those parameter; but I’m not sure if Hydra’s Basic Sweeper does support Nested Tuning and, if so, how to do it. Documentation doesn’t really say anything about it, but maybe I’m missing something.