I am running two machines with two GPUs each. I placed the TF_CONFIG on both machines in additional to the training code as stated in the [Tensor Tutorial].(https://www.tensorflow.org/api_docs/python/tf/distribute/MultiWorkerMirroredStrategy)