search

google / nerfies

This is the code for Deformable Neural Radiance Fields, a.k.a. Nerfies.
https://nerfies.github.io
Apache License 2.0
1.64k stars 221 forks source link

train loss becomes nan #15

Closed Carinazhao22 closed 3 years ago

Carinazhao22 commented 3 years ago

Hi, while I am training my data locally, the loss becomes nan. What are the possible reasons? Thank you!
b63c8a64498a8caa91e9c9f85adea6d

keunhong commented 3 years ago

To start off, here are some things you can try to see if it helps:

  1. Weaken the elastic loss (set the weight to something smaller)
  2. Lower the learning rate

It's also possible that the cameras from COLMAP are bad, which would also explain the distortion. In this case you can try running COLMAP with more aggressive filtering of poorly registered frames.

Carinazhao22 commented 3 years ago

got it. Thank you!