search

bennyguo / instant-nsr-pl

Neural Surface reconstruction based on Instant-NGP. Efficient and customizable boilerplate for your research projects. Train NeuS in 10min!
MIT License
856 stars 84 forks source link

[WIP] Add Scannet Dataset #12

Closed pablovela5620 closed 2 years ago

pablovela5620 commented 2 years ago

Adding scannet dataset based on #3

pablovela5620 commented 2 years ago

@bennyguo so I've added the initial scannet dataset (without geometric cues). But I'm having some trouble getting it actually working with the baseline nerf model. Its heavily based on the MonoSDF repo. Specificall the scene_dataset using the already preprocessed scannet data they provide see here for more info.

I'm still fairly new to nerf/neus so some guidance on how to get this working (results shouldn't be too good due to lack of geometric cues) would be helpful. I have not managed to get it training

Thanks!

bennyguo commented 2 years ago

@pablovela5620 This is a great start! I'll look into the code after a paper submission deadline tomorrow.

bennyguo commented 2 years ago

@pablovelaimmersed Thanks! I've managed to get NeRF to train on the scannet dataset (the quality isn't good though). NeuS training still fails and I'm working on it. You could do some digging too. I've merged the changes and start a new PR. Please continue the work based on the new code and comment there. This PR is closed.