facebookresearch / hyperreel

Code release for HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Sampling
MIT License
472 stars 34 forks source link

Key frame setting #33

Open chenxueh opened 2 months ago

chenxueh commented 2 months ago

Great work! (1)I would like to ask why the key frame test in the paper is 1,4,16,50 instead of within 10, such as 1,2,3,4,5..... Is this selection rigorous? Because I think the keyframe too far will lack the correlation between frames. (2)Is your work similar to six-plane factorization combined with tensor factorization like Hexplane?Doesn't count as a six-plane projection?

chenxueh commented 2 months ago

"To accelerate volume rendering, we would like to query color and opacity only for points with non-zero wk."I'm not sure where is that explained in the sample network?The sampling network is a ray intersecting a plane, compared to nerf, it's all about getting the sample points. What's the advantage of it? I'm sorry I don't understand how sampling networks work. I think it forms planes with the rays, and then the rays intersect again. So why not just direct light sampling, to add offset?