asgersvenning / pyremotedata

This repository contains the python module "pyRemoteData" which handles high-bandwidth data transfer with LFTP.
https://asgersvenning.github.io/pyremotedata/
MIT License
3 stars 1 forks source link

Fix and refactor PyTorch integration #8

Open asgersvenning opened 1 month ago

asgersvenning commented 1 month ago

Currently, the PyTorch integration classes are much to narrow in scope, and not implemented properly either.

The classes should easily integrate with common PyTorch patterns for Datasets and DataLoaders, and be extendible to more complex use cases as well.