search

kwea123 / nerf_pl

NeRF (Neural Radiance Fields) and NeRF in the Wild using pytorch-lightning
https://www.youtube.com/playlist?list=PLDV2CyUo4q-K02pNEyDr7DYpTQuka3mbV
MIT License
2.74k stars 483 forks source link

Try to generate high resolution pictures but failed. #67

Closed jerrysheen closed 3 years ago

jerrysheen commented 3 years ago

Hi kwea123,

when I try to use 4032 3024 original pictures to generate 1512 1134 pictures. The lose / val/ train becomes to nan.

Screenshot from 2021-03-17 21-01-27

And there is no ckpt file generated after these parameters went to nan.

When I try the final result. It can only generate a black image. Can you help me to figure out where is wrong? Did I use too high resolutions? Thanks

kwea123 commented 3 years ago

Hi, the code can handle any resolution theoretically, I have trained once high resolution without problem. The model trains to epoch17, so I assume early epochs don't have problem? Do you have the log until the 16th epoch, and how does the model perform at that point?

jerrysheen commented 3 years ago

the log until the 16th epoch, and how does the model perform at that point?

Hi, I think I solved the problem maybe. I think that's because I took the photos vertically, but the original model treats the images only horizontally? (And I can only set the parameter as 1512 1134 instead of 1134 1512. ) When I took images horizontally, the result is good.