Following @YoelShoshan's proposal and #219 I implemented some sort of prototype for supporting Nested Tensors.
Note that it requires latest PyTorch version (and it will to do so, since they still working on it). Current version is 1.13.0.
Example of how I used it in a data pipeline (DTI task, so the sequence are differ in size between samples!):
(NOT FOR MERGE) Hey All,
Following @YoelShoshan's proposal and #219 I implemented some sort of prototype for supporting Nested Tensors. Note that it requires latest PyTorch version (and it will to do so, since they still working on it). Current version is 1.13.0.
Example of how I used it in a data pipeline (DTI task, so the sequence are differ in size between samples!):