JoeLudwig
commented
3 years ago This would require a AvModel prop that lets the gadget say it wants the camera image projected onto the model.
Open Adil3tr opened 3 years ago
JoeLudwig
commented
3 years ago This would require a AvModel prop that lets the gadget say it wants the camera image projected onto the model.
What would this gadget do?
This gadget would allow the user to create real world camera portals, and to create virtual world rendering portals. These would allow the user to define a 3D space in their play area, such as a keyboard, a glass of water, a door, etc and have that window remain persistent in space and provide a view of that object. Obvious use cases would be using a mouse and keyboard while in VR, but you could also make a window for a friend to see them while you play. The gadget doesn’t need to actually see your real world environment, it just passes through on the cross section of the room anchored 3D object. A person wearing a Vive tracker on their head could also be passed through the same way, as a passthrough zone relative to the tracker.
It could also allow the user to make a window out of passthrough back into the game, allowing existing VR software and games to act as AR software by removing nonessential elements. There would be a toggleable blue shimmering backlight on portals of AR into VR, and an orange one on VR into AR.
While researching this, I found an attempt in the form of a SteamVR overlay that uses 2D planes using the Vive camera: https://store.steampowered.com/app/864790/FragmentVR/
Who would use this gadget?
This gadget would be ideal for people working in VR, people using VR socially locally, users who want to have a snack on a table next to them (see the object to grab it and then using touch for the rest), or anything else. Even just for keyboard and mouse this may be a better solution than any competitor as it works with any hardware, includes the mouse, and can be useful for lots other use cases like leaving a door open in the world to talk to someone.
Assuming that you're on the team, what other skillsets would you need to make this project happen over a couple days of hacking?
I actually could make the artwork for the cards, but I am not a programmer or experienced with 3D modelling.
What will be the toughest part of building this gadget?
The toughest part of building this gadget would be to have the 3D passthough running on only part of the screen, and on a 3D object at that. The steamVR overlay I linked does not work on the Index, which may be because it was using the webcam functionality of the index camera, and cannot combine two images or incorporate the 3D passthrough.