search

Neos-Metaverse / NeosPublic

A public issue/wiki only repository for the NeosVR project
193 stars 9 forks source link

Stereoscopic Depth Map integration #595

Open NicholiNoah opened 4 years ago

NicholiNoah commented 4 years ago

Neos does a great job incorporating monoscopic depth maps. Lately I've been creating content with stereoscopic depth maps (independent left and right RGB+Depth) photos and soon video. Not surprisingly, stereo is noticeably more immersive. Could Neos also incorporate depth map into the stereo channel? I've attached a VR180 example of stereo RGB+Depth for reference. VR180_RGBD

Frooxius commented 4 years ago

Hmm, there's a bit of a question how to best integrate this. The current rendering method in Neos only works for a single depth map, but this would require some kind of projection method that combines both views and resolves occlusion. I'd have to see if there are any sort of good algorithms/shaders to handle that.