search

chapel-lang / chapel

a Productive Parallel Programming Language
https://chapel-lang.org
Other
1.77k stars 417 forks source link

[Feature Request]: Chapel and Python file communication via Pickle #25657

Open Iainmon opened 1 month ago

Iainmon commented 1 month ago

Summary of Feature

Description: Being able to have chapel/python file reading and writing via Python's pickle system. Is this issue currently blocking your progress?

Yes

bradcray commented 1 month ago

Does Python provide a C API to their pickling system? Is their pickling format open and stable across releases?

Iainmon commented 1 month ago

@bradcray It looks like there are C++ bindings for pickling: https://www.picklingtools.com/ . I am not sure how widely this format is used and am new to it, but it seems to be the standard data encoding format for the python community.

lydia-duncan commented 1 month ago

I would say "a standard data encoding format" rather than "the standard data encoding format". Pickle was one of the options I encountered when deciding what program to use to support our Python interoperability. So it's been around for a few years. I can't speak for its stability, having not looked into it beyond determining if it was a good fit for what we were trying to accomplish at the time.