Modifying "process_file_list" function in cli.py

SINTEF / pyopia

Python Ocean Particle Image Analysis

https://pyopia.readthedocs.io

BSD 3-Clause "New" or "Revised" License

11 stars 6 forks source link

Modifying "process_file_list" function in cli.py #330

Closed arsalanmstn closed 3 weeks ago

arsalanmstn commented 4 weeks ago

The 'process_file_list' function needs to be replaced outside of the process function and modified with extra arguments as: process_file_list(file_list, c, pipeline_config, logger) This change is needed because multiprocessing is unable to pickle a nested function (process_file_list) for use across multiple processes on "Windows platform".

emlynjdavies commented 3 weeks ago

I think this was also one of the reasons threading was simpler to implement