search

apache / fury

A blazingly fast multi-language serialization framework powered by JIT and zero-copy.
https://fury.apache.org/
Apache License 2.0
3.12k stars 248 forks source link

[Python] Optimize collection serialization protocol by homogenization #1934

Open chaokunyang opened 2 weeks ago

chaokunyang commented 2 weeks ago

Feature Request

The new collection serialization protocol in https://fury.apache.org/docs/specification/fury_xlang_serialization_spec/#list can be 2x faster than current one in pyfury. #923 has proved it. we should implement this protocol

image

Is your feature request related to a problem? Please describe

No response

Describe the solution you'd like

https://fury.apache.org/docs/specification/fury_xlang_serialization_spec/#lis

Describe alternatives you've considered

No response

Additional context

https://github.com/apache/fury/pull/923

pandalee99 commented 5 days ago

This is an interesting design, and I will try to implement it at pyfury.Wonder if efficiency would be good in a dynamic language.