ella delegates handling of lazy execution/logical plans to datafusion internally. Datafusion/arrow only implements most operations for scalar arrays, which means that extension types like Tensors are unsupported.
Fully implementing support for tensors is going to be somewhat complicated. I will probably require a full set of custom physical nodes that implement all of the operations for tensors. In addition, for tensors to work in plans generated by SQL queries and not just the expressions API we would need some kind of custom planner or analyzer rule that would walk the logical plan and replace nodes as needed.
ella delegates handling of lazy execution/logical plans to datafusion internally. Datafusion/arrow only implements most operations for scalar arrays, which means that extension types like Tensors are unsupported.
Fully implementing support for tensors is going to be somewhat complicated. I will probably require a full set of custom physical nodes that implement all of the operations for tensors. In addition, for tensors to work in plans generated by SQL queries and not just the expressions API we would need some kind of custom planner or analyzer rule that would walk the logical plan and replace nodes as needed.