search

codemation / easyjobs

A celery like jobs framework for managing and distributing async / non-async tasks
https://pypi.org/project/easyjobs/
MIT License
36 stars 4 forks source link

Improvment - Refactor task distribution #6

Closed codemation closed 3 years ago

codemation commented 3 years ago

Description

refactored task distribution, corrected some issues preventing tasks from running, reduced queue usage to only callbacks & manager -> worker methods, jobs are now reserved using a worker_id & request_id, since single process can have multiple workers & thus need a unique id to reserve when running

Preparation step for next refactor which will allow multiple workers on a Manager