JoeLudwig
commented
3 years ago The VR side of this should be fairly straightforward. I'm more worried about the tablet part of this and streaming a view of the VR scene over to that side.
Were you running a custom VR app when you experimented with this before, or did it work with any VR app?
tkbala
What would this gadget do?
Virtual Reality (VR) users often need to work with other users, who observe them outside of VR using an external display. Communication between them is difficult; the VR user cannot see the external user’s gestures, and the external user cannot see VR scene elements outside of the VR user’s view.
The gadget would allow external users to explore the VR scene spatially, to annotate in 3D in the VR scene, and place them at correct depths, and to have shared discussions via a shared static virtual display.
I had previously developed a version of this using IVROVerlays, but it is capable of rendering only 2D elements in the scene. The video and a research paper on the system can be found at Transceivr - https://www.tkbala.com/transceivr
Who would use this gadget?
Users who carry out collaborative tasks in VR, in which one or more users are outside VR (spectators)
Assuming that you're on the team, what other skillsets would you need to make this project happen over a couple days of hacking?
I would need members who have experience with ReactJS, and possibly members who have experience developing multi-user networked applications.
What will be the toughest part of building this gadget?
To allow rendering of 3D annotations at the right position in the VR scene.