ray-project / mobius

Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.
https://ray-project.github.io/mobius/
Apache License 2.0
85 stars 13 forks source link

Zero-Copy buffer pool between java/python and native layer. #37

Open ashione opened 2 years ago

ashione commented 2 years ago

We'd better avoid duplicated copy from JNI/Cython to cpp objects.

Current data transporting pipeline:

Actually, we don't need copy them between transfer and data writer, which is why we proposal zero-copy buffer pool. How buffer pool works: