Cubic mapping support for 360 video

[arianaa30]

I see a CubeSceneObject in the API. Does GearVRf support playing of the Cubic mapped 360 videos, as introduced by Facebook recently?

https://code.facebook.com/posts/1638767863078802/under-the-hood-building-360-video/

[thomasflynn]

I think something custom will need to be done for this. Video is done via the texture_external_oes extension: https://www.khronos.org/registry/gles/extensions/OES/OES_EGL_image_external.txt

texture_external_oes does not support cube maps. I suspect what would need to be done is to use a custom shader with each cubeface. each cubeface would have a specific set of texture coords that maps to the necessary areas in the video texture (done via texture_external_oes). let me talk with some people internally and see if our ideas line up.

[arianaa30]

Thanks. I would also ask this from FB guys maybe they have a player available for their cube maps.

[danke-sra]

@arianaa30 FYI, if it is hard to render a cubemap from a single texture (as from the video), a quick way is to blit it into 6 textures and use normal cubemap to render the video.

[apjagdale]

@arianaa30 Not quite right but you can check this: https://github.com/apjagdale/GearVRf-Demos/tree/GearVrfDemoBranch/gvr-fbCubic360Video