VITA-Group / GNT

[ICLR 2023] "Is Attention All NeRF Needs?" by Mukund Varma T*, Peihao Wang* , Xuxi Chen, Tianlong Chen, Subhashini Venugopalan, Zhangyang Wang
https://vita-group.github.io/GNT
MIT License
338 stars 24 forks source link

Rendering results of nerf_synthetic lego validation dataset by provided single-scene model #16

Open leo-frank opened 1 year ago

leo-frank commented 1 year ago

Description:

I use the pretrained model that you provided at lego synthetic by provided single-scene model at https://drive.google.com/file/d/1IbhbBr5XfxQz0jSQM3nLX_htTbvc59kj/view?usp=share_link the command is: CUDA_VISIBLE_DEVICES=2 python3 eval.py --config configs/gnt_blender.txt \ --eval_dataset nerf_synthetic \ --eval_scenes lego --run_val\ --expname gnt_author_pretrained_single_lego \ --ckpt_path out/gnt_lego_from_single_ckpt/pretrained_lego_model_435000.pth \ (gnt_blender.txt is not modified)

Results:

  1. rendering results on validation set seems not correct, since the color has some green

image

  1. but the metrics seems resonable as this screenshot shows:

image

Questions:

I wonder the cause of such unexpected rendering results.Is it caused by my command or anything else?

Fortunanto commented 1 year ago

Have you solved this issue? it happens all the same using gnt_full model as a checkpoint model.

leo-frank commented 1 year ago

No, I can't solve it. I tried 3 types of model: 1) single-scene model provided by author 2) cross-scene model provided by author 3) single-scene model trained by myself all of these have the same issues.