snap-research / NeROIC

Other
937 stars 121 forks source link

Perform baddly on validation set #13

Open Choconuts opened 2 years ago

Choconuts commented 2 years ago

I use the milkbox dataset to train the model and the training PSNR is about 29. However, the images synthesis in validation are nearly blank with a little noise, and the PSNR is extremely low. Is it overfitting?

I just run like this for the geometry model:

python train.py
--config
configs/milkbox_geometry.yaml
--datadir
data\milkbox_dataset
zfkuang commented 2 years ago

It might be overfitting. can you send me your log file?

Also, did you try the other two datasets?

Choconuts commented 2 years ago

version_2.zip not yet.

zfkuang commented 2 years ago

It looks like your initialization is a bit different from my side, what's your ubuntu version and did you use the conda command in the guide to install all the packages?

Screen Shot 2022-08-13 at 1 44 57 AM My initialization

Screen Shot 2022-08-13 at 1 43 15 AM Yours

Choconuts commented 2 years ago

I use windows. Does it matter so much? I mean initialization, since it can converge on training-set easily after all. How can I correct the initialization?

zfkuang commented 2 years ago

It might be, but there're some other things that looks odd: for example your camera loss is extremely high, indicating that the system didn't find a good camera pose either. So my guess is that there're some nuances between the packages on different platforms causing all the trouble. I would suggest using ubuntu, because all experiments are conducted on it. I can also test the model on windows later to see how to fix that.

Choconuts commented 2 years ago

OK, thank you.