uqfoundation / pathos

parallel graph management and execution in heterogeneous computing
http://pathos.rtfd.io
Other
1.36k stars 91 forks source link

Speeding up dill #248

Closed mattiasmar closed 1 year ago

mattiasmar commented 1 year ago

Hello, I believe the serialization of dill is the bottleneck in my solution. Is there a way to control dill's parameters through pathos (dill.settings)? Thanks!

mmckerns commented 1 year ago

If you import dill and change the settings with dill.settings, it should also impact how pathos serializes objects. So, yes, just modify dill.settings. Reopen this if your question is not answered.