Closed jacobbieker closed 9 months ago
Apparently, DataPipes have been merged into PyTorch core: https://github.com/pytorch/pytorch/tree/main/torch/utils/data/datapipes so we could switch to that implementation instead, to keep up with PyTorch. We lose DataLoader2 and the like, but seems relatively straightforward, as we've mostly implemented our own datapipes.
ready to close?
https://github.com/pytorch/data/issues/1196
Future of datapipes is being debated now, not sure when it will be announced what is going to happen with it or how it might get refactored/changed, but this will have a very large effect on this repo. Nothing should change soon, and these datapipes should keep working with future versions of PyTorch, but seemingly might not have new features or bug fixes (like the odd issue with
Dataloader2
not working as well asDataloader
) happen to it.