How to run a function specific number of times in a minute with Celery
I’m trying to scrape some data off web, but I’m getting HTTP error 429. I know that I can only send 20 requests per minute, so I wanted to solve this by using Celery in Python to create something like a token bucket. Simplified example:
How to use run a function specific number of times in a minute with Celery
I’m trying to scrape some data off web, but I’m getting HTTP error 429. I know that I can only send 20 requests per minute, so I wanted to solve this by using Celery in Python to create something like a token bucket. Simplified example:
How to use run a function specific number of times in a minute with Celery
I’m trying to scrape some data off web, but I’m getting HTTP error 429. I know that I can only send 20 requests per minute, so I wanted to solve this by using Celery in Python to create something like a token bucket. Simplified example: