I have a custom layer in my VAE which handles the loss calculation. I have a custom callback which is meant to update the beta value at the beginning of every epoch. The calculation is correct because it prints out the desired beta value at the beginning of every epoch. However, the real beta value in the CustomVariationalLayer is never updated.