facebookresearch / pytorch3d

PyTorch3D is FAIR's library of reusable components for deep learning with 3D data
https://pytorch3d.org/
Other
8.7k stars 1.3k forks source link

Loading Co3D: When num_worker > 0, the memory will continue to rise until it exceeds. #1646

Closed zhaomingheyuhan closed 10 months ago

zhaomingheyuhan commented 1 year ago

When num_worker = 0, there was no problem but slow. What could possibly cause such a problem?

bottler commented 10 months ago

I think this is a general question about pytorch dataloading memory usage. There are many tricks but it isn't pytorch3d-specific. We can't help here.