search

facebookresearch / hyperreel

Code release for HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Sampling
MIT License
475 stars 34 forks source link

Application of Datasets for 360 ° Scene #29

Closed dzls952402394 closed 12 months ago

dzls952402394 commented 12 months ago

It's a great work!

I have a question about the application of Datasets for 360 ° Scene.

Your work use Plucker parameterization.

I have seen your website, but I don't see any 360° scene.

Is there any difficulty in rendering 360 ° scene data?

benattal commented 12 months ago

Hey! We show some results in the paper on outward facing hemispherical captures (the Immersive Light Field Video dataset), and one result in the supplement on a 360 outward facing capture. These datasets have a relatively small baseline between input images --- even though we use the Plucker parameterization, our method tends to struggle with large baseline captures, for example inward-facing or object centric 360 degree captures.

It may be possible to improve performance, to some degree, by increasing the number of points that the ray-conditioned sample network predicts, at the cost of increased runtime.

Hope this helps!

dzls952402394 commented 12 months ago

I have seen the result of 360 degree Fov in your supplement, and thanks for your reply!