I’m encountering a perplexing issue with asyncio where consecutive runs of my function within a short timeframe result in mixed responses. The function sends prompts and data to an AI service simultaneously and retrieves responses. Strangely, when I execute the function with different data quickly after a few runs in succession, the responses include information from the previous call and there is data mixing, despite the new data being completely unrelated.

I suspect there might be a concurrency issue or caching problem at play, but I’m struggling to pinpoint the exact cause.

The function uses asyncio for asynchronous execution, and I’ve ensured that each call is independent of the others.

I’d greatly appreciate any insights, suggestions, or debugging tips to resolve this issue and ensure that each function call produces the expected response based on the provided data. Thank you in advance for your assistance!