search

uqfoundation / pathos

parallel graph management and execution in heterogeneous computing
http://pathos.rtfd.io
Other
1.38k stars 89 forks source link

Can't pickle '_subprocess_handle' object #182

Open ankurash opened 4 years ago

ankurash commented 4 years ago

Error during clipping: Can't pickle '_subprocess_handle' object: <_subprocess_handle object at 0x00...>

Python 2.7.16 on Windows 10 with following list of relevant packages: dill 0.3.1.1 multiprocess 0.70.9 multiprocessing-on-dill 3.5.0a4 pathos 0.2.5 ppft 1.6.6.1 setuptools 40.6.2

code structure:

from pathos.multiprocessing import ProcessingPool as Pool
class X:
    methodA(args):
         call some library function(new_args)
    methodB(args):
         pool = Pool(4)
         pool.map(methodA, new_args)
    methodC(args)
         call methodB(new_args)
main()