Dataloading revamp - Githubissues

nerfstudio-project / nerfstudio

A collaboration friendly studio for NeRFs

https://docs.nerf.studio

Apache License 2.0

8.87k stars 1.18k forks source link

Open AntonioMacaronio opened 2 weeks ago

AntonioMacaronio commented 2 weeks ago

Problems and Background

With a sufficiently large enough dataset, the current datamanager(s) will try to cache the entire dataset into RAM, which will lead to an OOM error
Using a IterableDataset (which also supports streaming) can resolve these issues!