mmckerns
commented
2 years ago I would guess, from the traceback, that you are trying to use a class method in the map and not a function. That's ok, but generally causes the class instance to also be serialized. The traceback shows that right away, dill hands off the object to pickle, and then pickle fails to serialize it. A small bit of googling shows that _cffi_backend is actually _cffi_backend.so and thus not python code. So, the class will fail to serialize, unless a __reduce__ method (or similar) is defined in the class. You can try avoiding the serialization of the class by using other serialization variants (e.g. dill.settings['recurse'] = True or dill.settings['byref'] = True), but I assume these will also fail. You could write your own custom class that wraps the class method and provides a __reduce__ method, or potentially a custom function. Hard to say much more without more information. You can, potentially, post the versions of pathos, multiprocess, dill, CFFI, and etc you are using, and also the pickle traceback (e.g. use dill.detect.trace(True)) before running your code.
SohanTirpude
Hello all,
When I tried to run below code I am getting "TypeError: can't pickle _cffi_backend.FFI objects" on "results.get()".
And this is the error log
I cannot share the code due to organization guidelines. Without code if no one can help me then let me know, I'll close this issue.
Thank you.