Support pickling for PyTorch datasets to allow multiprocessing in dataloader

salu133445 / muspy

A toolkit for symbolic music generation

https://salu133445.github.io/muspy/

MIT License

435 stars 51 forks source link

Support pickling for PyTorch datasets to allow multiprocessing in dataloader #75

Open jeremyjordan opened 1 year ago

jeremyjordan commented 1 year ago

Moves TorchRepresentationDataset and TorchMusicFactoryDataset to be defined outside of to_pytorch_dataset so that pickle can import the class definitions in a new process.

Fixes #74