Restoring an optimizer state across multiple devices in JAX
I’m training a model using jax and optax on four GPUs and need to save and restore the optimizer state, but I’m running into a problem loading it. The optimizer state is initialized —
Restoring an optimizer state across multiple devices in JAX
I’m training a model using jax and optax on four GPUs and need to save and restore the optimizer state, but I’m running into a problem loading it. The optimizer state is initialized —
Restoring an optimizer state across multiple devices in JAX
I’m training a model using jax and optax on four GPUs and need to save and restore the optimizer state, but I’m running into a problem loading it. The optimizer state is initialized —
Restoring an optimizer state across multiple devices in JAX
I’m training a model using jax and optax on four GPUs and need to save and restore the optimizer state, but I’m running into a problem loading it. The optimizer state is initialized —