Open jkryanchou opened 7 years ago
This should be possible with simple overloading of the Job class. Add it as an example/recipe ?
@sylvinus I would post it later. I mean that using cache (redis or any other cache-db) to handle concurrent reads/writes before writing to MongoDB.
I have got insighted into your worker implementation. While I found that worker has heavily write to Mongo. I thought it might not be a good performance on saving result. Why not writing to redis (cache) firstly to instead of saving to MongoDB in order to handle more I/O operations to gain more performance.