skuschel / generatorpipeline

Parallelize your data-processing pipelines with just a decorator.
GNU General Public License v3.0
2 stars 4 forks source link

accumulators in their own process #39

Open skuschel opened 1 year ago

skuschel commented 1 year ago

Accumulators are restricted to the main process and thread. In principle accumulators could be in another python process. Maybe there is an easy way to do this while still keeping their object nature exposed to the main process. Only the accumulate method must be non-blocking speed up processing.