Open dmeliza opened 10 years ago
The pipeline-based model is highly amenable to parallelization. Instead of directly passing chunks between processing modules, they're placed into queues and then assigned to workers. Simple in principle but potentially a lot of work.
The pipeline-based model is highly amenable to parallelization. Instead of directly passing chunks between processing modules, they're placed into queues and then assigned to workers. Simple in principle but potentially a lot of work.