Relative Content

Tag Archive for python-3.xrabbitmqcelery

Routing celery task to a specific worker

I am designing a system where each user will have its own LLM. When a client logs into the system, an unused worker will load a model and answer all chat requests for the client during the session. During this session of back and forth with the client, the worker is pinned to this client and should not receive any other requests.