mihirkatare / DeepMEM

Deep Learning Implementations for Sustainable Matrix Element Method Calculations [ IRIS-HEP Fellowship ]
Apache License 2.0
2 stars 0 forks source link

Add C-based multiprocessing (Caching Dataloader) #15

Open mihirkatare opened 3 years ago

mihirkatare commented 3 years ago

With reference to this forum discussion: https://discuss.pytorch.org/t/reuse-of-dataloader-worker-process-and-caching-in-dataloader/30620. Implement Caching dataloaders to improve efficiency for larger databases which may be used in the future.