I’m running a JupyterHub installation on Kubernetes (EKS) and an elastic Ray cluster automatically starts for each user when their notebook starts, and automatically stops when the notebook closes. JupyterHub users can access their Ray cluster dashboard securely through their browsers through an dynamically created reverse proxy which provides authentication and TLS, so that no port-forwarding and other workarounds are required. Ray client is pre-installed on all notebooks, so all that users need to do to use Ray in their notebooks is to call ray.init() to connect to their cluster (RAY_ADDRESS environment variable is injected to the notebook container).

I’m reading Ray’s Architecture doc, and it says: