skuschel / generatorpipeline

Parallelize your data-processing pipelines with just a decorator.
GNU General Public License v3.0
2 stars 3 forks source link

Inserting Elements in parallel Process #10

Open skuschel opened 2 years ago

skuschel commented 2 years ago

Maybe just create all elements on the other process and transfer them back to the main process as generators cannot be pickled? That is not proper memory management but maybe better?

Feature in main process was added in #9