Relative Content

Tag Archive for pythoncelery

How to handle failures in celery async chain tasks?

I have a chain of celery tasks as shown below. I want to run the on_failure function whenever any task in this chain fails. Currently if any intermediate task fails the main task gets stuck and keeps waiting.
I am using group task because I want to process these tasks in parallel. If there is any other better approach please let me know.

Celery: sending the result of one task to a group of task

I am trying to design a straightforward workflow in Celery: a Father Task that produces some data and returns them, N different children tasks that elaborate the same data coming from the father and return their result.
As a bonus, I would like to process all the children’s results together.