search

invesdwin / invesdwin-context-integration

invesdwin-context modules that provide integration features
GNU Lesser General Public License v3.0
1 stars 0 forks source link

implement channel for apache arrow #69

Open subes opened 8 months ago

subes commented 8 months ago

https://arrow.apache.org/docs/java/ipc.html

subes commented 8 months ago

should use the streaming ipc format, its rather maybe an ISerde implementation, not an actual channel

subes commented 8 months ago

Could be used for shared memory transfers between processes over a different rpc framework: https://awsdocs-neuron.readthedocs-hosted.com/en/v1.16.1/neuron-guide/neuron-runtime/v1/nrt-theory-of-operation.html#shared-memory-for-inference-ifmaps-and-ofmaps (useful only for large payloads, not for latency reduction)