search

ethanweber / nerfiller

NeRFiller project https://ethanweber.me/nerfiller/
Apache License 2.0
96 stars 3 forks source link

llff dataset question #8

Closed Arcxml closed 6 months ago

Arcxml commented 6 months ago

Hello, thank you very much for your project. I want to ask a question, as far as I understand, the nerfstudio library does not support LLFF type dataset, but I see that you have used the SPIN dataset. Did you perform additional processing on its data?

ethanweber commented 6 months ago

Hi! So this part of the code, this part of the code, and this part of the code might be relevant. We convert the format to Nerfstudio and then turn off distortion loss with forward_facing_snippet = "--pipeline.model.distortion_loss_mult 0.0". It's not foolproof but it works for some scenes like the backpack we show from the SPIN dataset. However, I don't think all of their captures will work as well. We didn't use the full dataset. You might also want to play with setting the near and far distances when sampling rays. Essentially, you can try to get Nerfacto's scene contraction to work instead of supporting LLFF NDC directly.