search

VITA-Group / GNT

[ICLR 2023] "Is Attention All NeRF Needs?" by Mukund Varma T*, Peihao Wang* , Xuxi Chen, Tianlong Chen, Subhashini Venugopalan, Zhangyang Wang
https://vita-group.github.io/GNT
MIT License
338 stars 24 forks source link

How to visualization the view attention？Just like Figure 6 in your paper #20

Open gjgjgjfff opened 10 months ago

gjgjgjfff commented 10 months ago

Thank you for your wonderful work and look forward to your reply！

MukundVarmaT commented 7 months ago

To visualize view attention, I use the attention matrix (Nrays x Npts x Nviews x Dim) from here and average across the channel dimension(Nrays x Npts x Nviews), further followed by computing the view number with maximum attention value (Nrays x Npts). Finally, the mode across points for each ray is computed and visualized (Nrays).

Unfortunately I cannot seem to find the code for it, but the above is the general idea. Let me know if you run into any problems