search

asuiu / pyxtension

Pure Python extensions library that includes Scala-like streams, Json with attribute access syntax, and other common use stuff
MIT License
43 stars 1 forks source link

Use pathos multiprocess for mpmap #17

Open asuiu opened 2 years ago

asuiu commented 2 years ago

Standard lib multiprocess is not able to handle lambda functions due to use of limited serializer (Pickle). Pathos multiprocess fork is able to serialize lambdas using Dill serializer.

Proposal is to make pyxtension use this improved multiprocessing library to handle cases like lambda functions and other advantages it brings