stereolabs / zed-unity

ZED SDK Unity plugin
https://www.stereolabs.com/documentation/guides/using-zed-with-unity/introduction.html
MIT License
251 stars 57 forks source link

Oculus Quest Link with ZED Mini #98

Closed hankh1105 closed 2 years ago

hankh1105 commented 4 years ago

I heard the Quest Link cable makes the HMD PC powered now, I'm curious if it is compatible with ZED unity development?

DanielPD commented 4 years ago

Can confirm that this works as expected in Unity 2019.3.15 with the latest Oculus integration and ZED 3.1.0: I'm using my Oculus Quest tethered to the PC with a USB cable, and A ZED Mini stuck to the front of the headset, also tethered to the PC with a USB cable. I'm getting all the passthrough AR goodness :)

(It also works well with VirtualDesktop streaming to the Quest. That way you only have 1 USB cable for the ZED going to the headset, makes it a bit more manageable)

KP021 commented 4 years ago

Thanks, @DanielPD Can you post more details about how you got it to work?

DanielPD commented 4 years ago

Well, it actually just works as you would expect :D

First make sure you have the Quest updated and the Oculus software installed and updated on the PC (you might need to op-in for the beta release). Then set up the link connection between headset and PC, and confirm that it all works.

Then in your Unity project make sure to enable VR support: Project Settings -> Player -> XR Settings -> (Depricated) Virtual Reality Supported

(I haven't tried with the new XR Plugin Management system yet)

Import the ZED for Unity package, drag the ZED_Rig_Stereo prefab to the scene and press play. Unity should automatically recognise the Quest-through-link as a generic Oculus device and should output the stereo image to the headset.

Note that you don't actually need the Oculus Integration Unity plugins for the basic 3D camera images to work. However if you're doing anything more complex in VR I would definitely recommend importing them in your project.

tommasorosi commented 4 years ago

I tried it and it works, but the stereo images of the ZED felt just a bit weird, something I never felt with the Rift. This doesn't happen to me with virtual objects, only with the stereo images from the ZED. Anyone else feels like the experience is just a bit off?

KP021 commented 4 years ago

Thanks, @DanielPD for sharing. Did you try developing apps using both the ZED's video and VR environment? @tommasorosi Well it may be because the eyes align with the ZED better on Rift while on Oculus the ZED may be vertically displaced from where your eyes would be.

zuhayr-shaikh commented 4 years ago

HMM so this can be potentially solved with a different mounting setup?

wsteelenyc commented 3 years ago

Anyone done any experimenting with the quest 2 via link?

WHAMWONG commented 3 years ago

I tried to do the experiment with the Oculus Quest 2 via link. Yes, it works. Once the quest 2 is connected to the PC via the link, the quest 2 switches to PCVR system mode, which actually gives very little difference from the Oculus Rift. The field of view of AR will be farther away when using the quest 2, compared to using Rift. I think it's because Stereolabs is not yet compatible with the quest 2.

Using the new XR Plugin Management system will cause the zed camera to fail to open and still require Virtual Reality Supported to be turned on, as @DanielPD said.

github-actions[bot] commented 2 years ago

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment otherwise it will be automatically closed in 5 days