Relative Content

Tag Archive for python-3.xazureazure-functionsazure-openai

Azure Service Bus Trigger Function Not Achieving Desired Concurrency Levels

I have implemented a system where requests are processed asynchronously using an Azure Service Bus. These requests initiate an operation that, once complete, returns a response to the initiating actor. My objective is to manage the flow of requests to OpenAI efficiently, particularly by limiting the number of concurrent requests to 8 to prevent token bottlenecks.