Fix and optimize multiprocessing dataloaders

qiuqiao / SOFA

SOFA: Singing-Oriented Forced Aligner

MIT License

116 stars 17 forks source link

Closed yqzhishen closed 6 months ago

yqzhishen commented 6 months ago

This PR fixes #18.

Changes:

Close h5py file handles after reading metadata on main process to avoid pickling
Add persistent_workers, pin_memory and prefetch_factor when creating dataloaders