[Question] <title>How does Fury perform in terms of speed and size when serializing and deserializing Java arrays?

apache / fury

A blazingly fast multi-language serialization framework powered by JIT and zero-copy.

https://fury.apache.org/

Apache License 2.0

3.12k stars 248 forks source link

Open a1342772 opened 3 days ago

a1342772 commented 3 days ago

How does Fury perform in terms of speed and size when serializing and deserializing Java arrays?

chaokunyang commented 3 days ago

Performance:

For primitive array, it's as fast as a memory copy.
For object array, depending on the data, the cost are basically (array_len * cost(element)) * 10% for most cases.

Size:

For primitive array, it's array_len * size(element)
For object array, fury are smaller than JDK serialization. Depending on the element type, the size reduction can be different.

chaokunyang commented 3 days ago

@a1342772 You could test it by yourself. It the test result is unexpected, please share your test code and result here, then we can dive into it.