Closed dfulu closed 8 months ago
Use datapipes from torch rather than torchdata. Solves #94
Checked this works locally by creating small set of batches with save_batches.py and training on them.
save_batches.py
Pull Request
Description
Use datapipes from torch rather than torchdata. Solves #94
Checked this works locally by creating small set of batches with
save_batches.py
and training on them.Checklist: