Prototype to use Arrow Tensor IPC message to add a tensor UDT.
The aim are twofold:
Add a tensor UDT which is the main objective for our target workflows
Use some kind of arrow encoding in hopes that it can be improved on
Its worth noting that in current world the bytes will still passed through python pickler on the way to python executors, which can't be great for performance.
Prototype to use Arrow Tensor IPC message to add a tensor UDT.
The aim are twofold:
Its worth noting that in current world the bytes will still passed through python pickler on the way to python executors, which can't be great for performance.