Distributed processing using celery in python
Celery is an asynchronous task queue based on distributed message passing. Tasks are executed concurrently on one or more worker servers using multiprocessing, Eventlet or gevent. Tasks can execute asynchronously (in the background) or synchronously (wait until ready). Architecture: Fig1 : Celery architecture The main part of this architecture is the broker (transporter), which handles all the task processing. The client sends tasks to the broker, and the broker uses round robin to distribute those tasks to workers. ...