search

Yellow-Dog-Man / Resonite-Issues

Issue repository for Resonite.
https://resonite.com
121 stars 2 forks source link

Support for tracking the user's camera against a real world tracking device, e.g., a Vive Tracker. #1728

Open Geenz opened 2 months ago

Geenz commented 2 months ago

Is your feature request related to a problem? Please describe.

For CAVE and virtual production applications, you typically track a virtual camera's position against the real world position of a camera or other viewing device (such as 3D glasses). As of today, we don't have a great built-in way to do this without a good deal of work.

Describe the solution you'd like

The ability to use a tracker to move the user's camera in desktop mode.

Describe alternatives you've considered

Using a web socket with some protoflux to manually move the user's camera.

Additional Context

Related to #1727 as it pertains to CAVE and virtual production scenarios. Probably other applications. Listing this for eventual work.

Requesters

No response

shiftyscales commented 2 months ago

You mention Vive tracker in the issue title, but your application/use-case doesn't also involve VR(?) I'm kind of confused, @Geenz. Trackers already exist as tracked devices that can have a camera (or camera anchor) parented to them as needed. I'm not sure what would be a good deal of work about that? It's something that's already possible/supported.

Geenz commented 2 months ago

@shiftyscales A lot of virtual production studios utilize a bunch of solutions for this outside of VR. Other examples are OptiTrack. Vive trackers are a low cost solution for consumers, and perhaps our most directly relevant solution for scenarios such as these.

shiftyscales commented 2 months ago

Okay- so this issue is about supporting other kinds of tracking devices then?

Geenz commented 2 months ago

In a sense yes. This is more focused on virtual production or attaching a tracker to a given camera when not in VR however.

Geenz commented 2 months ago

To provide a broader description of how this works in the virtual production and CAVE spaces:

This is done without any headset involved. Two examples I've worked with in the wild are:

Any specific solution involving alternative (non-SteamVR) tracking backends are separate issues. This is more about attaching a tracking solution to the camera for this purpose.

HTC's Vive Ultimate Trackers are also suitable for this, as are various SteamVR based trackers.