limacv / Deblur-NeRF

MIT License
258 stars 28 forks source link

Evaluation with trained model weight #2

Closed dogyoonlee closed 2 years ago

dogyoonlee commented 2 years ago

I really appreciate to your awesome work!

I wonder do you have any specific evaluation code with trained model weight?

Could you share the code if you have?

Mercury1010 commented 2 years ago

I have the same question, Could you send me one, really appreciate it! Here is my email adress: Mercuryxzh@163.com

Mercury1010 commented 2 years ago

邮件已送达 马力的邮箱 I have the same question, Could you send me one, really appreciate it! Here is my email adress: Mercuryxzh@163.com

limacv commented 2 years ago

The evaluation code lies inside the run_nerf.py together with the training code here. To render video or test views, you can also call the run_nerf.py with --render_only args. The pretrained model weight will be released in the dataset folder in a few days. Thanks!

dogyoonlee commented 2 years ago

@limacv Thanks a lot! By the way, can I ask a question about quantitative results in your paper? For the Table 1 in your paper, How many kernel point was used to produce the best results? Are the results produced by the model whose kernel points are 5 or more? (probably, 10~12?)

It will be really helpful to me if you let me know!

Again, I really appreciate to your awesome work and congratulate acceptance to CVPR!

limacv commented 2 years ago

All of the results shown in the paper (except the ablation on the kernel point) use 5. But as the ablation shows, more points lead to better quality. So it is really just a trade-off between the training time and the quality.

dogyoonlee commented 2 years ago

@limacv I get it. Then as I understand, for example, the best results of tanabata scene(camera motion) which is represented as 27.11 is the performance of deblur-nerf with kernel point 5. Is that right?

image

That means the results on dotted green line(kernel point 5) of middle camera motion blur in following table is not tanabata scene.

image

Could you let me know which scenes are used on above table, respectively?( Small, Middle, Large )

limacv commented 2 years ago

Yes, and this ablation uses the FACTORY scene, but we re-synthesize the blur in Blender under different settings. Basically, we synthesize different degrees of blur to conduct the ablations, so the PSNR and the SSIM are inconsistent with Table 1.

dogyoonlee commented 2 years ago

@limacv That's really helpful information. Thank you again!! :)