rover-xingyu / Ha-NeRF

[CVPR 2022] Ha-NeRF😆: Hallucinated Neural Radiance Fields in the Wild
148 stars 13 forks source link

How do you compare different methods #6

Open y6216886 opened 2 years ago

y6216886 commented 2 years ago

Thanks for your excellent work. I have a question about comparison with other methods.

Some works (for example, NeRF--) set the same training epoch (e.g., epoch=20). Then, they compare different methods using the performance of the trained checkpoint of epoch 20.

Other works save the checkpoint of the best validation performance and compare it with the best performance of different methods.

Which one does Ha-NeRF choose for validation? Thanks for your time!

y6216886 commented 2 years ago

By the way, what kind of LPIPS metric do you use, vgg or alex?

rover-xingyu commented 2 years ago

Thanks for your interest! We use alex to evaluate LPIPS and compare different methods using the checkpoint of the same epoch.

y6216886 commented 2 years ago

Thanks for your interest! We use alex to evaluate LPIPS and compare different methods using the checkpoint of the same epoch.

Thank you so much!