Collectives™ on Stack Overflow
Find centralized, trusted content and collaborate around the technologies you use most.
Learn more about Collectives
Teams
Q&A for work
Connect and share knowledge within a single location that is structured and easy to search.
Learn more about Teams
I'm trying to understand how celery works
In my django application in
tasks.py
file I have created one task:
@celery.shared_task(default_retry_delay=2 * 60, max_retries=2)
def my_task(param1, param2):
# There are some operations
I call this task by using this code:
my_task.delay(param1, param2)
Inside of this my_task
there is one condition where this task should be started again but after one minute delay
I have found that there are some kind of ETA and countdown for tasks, but their examples are only with apply_async
Is it possible to use some kind countdown for delay
?
So delay is clearly convenient, but if you want to set additional
execution options you have to use apply_async.
As documentation states delay
cannot be used with additional options set so you should just convert your call into apply_async
If you want to add execution options, the docs suggest you use a signature. e.g:
my_task.s(arg1, arg2).apply_async(countdown=60)
–
Just to add to iklinac's answer. This is how you would call the task using apply_async()
my_task.apply_async(args=(param1, param2), countdown=60)
my_task.apply_async(kwargs={'param1':param1, 'param2':param2}, countdown=60)
The second option will really come in handy if you are using a tool like Flower for monitoring. You can look at Celery tasks best practices page for other tips.
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.