HTC Vive black screen in unity applications

[Bundenth]

Hi,

After downloading the DLL and configuring the OSVR Server as per instructions the HTC vive screens remain black when running simple Unity demos. The OSVR server starts correctly and acknowledges that a Vive is connected and calibrated (along with the 2 lighthouses and a controller), and indeed in the Unity Editor the HMD is tracked and the camera moves as expected when the Vive is moved. However, the HTC vive itself remains black.

I have the HTC vive dlls in the Plugins/Android/x86 folder, and I've checked the renderManager dlls are also present. What I've noticed is that when the scene is started, Unity shows an error in the console:

[OSVR-Unity] Failed to create RenderManager. UnityEngine.Debug:LogError(Object) OSVR.Unity.DisplayController:SetupRenderManager() (at Assets/OSVRUnity/src/DisplayController.cs:143) OSVR.Unity.DisplayController:SetupDisplay() (at Assets/OSVRUnity/src/DisplayController.cs:176) OSVR.Unity.DisplayController:Update() (at Assets/OSVRUnity/src/DisplayController.cs:317)

Has anyone tested the plugin in Unity?

[rpavlik]

You shouldn't have to add any Vive-related files to Unity - part of the purpose of OSVR is to make applications hardware independent. (Why are you putting files in the Android directory? Are you running the Vive from an Android device?)

Does the Render Manager D3D Present demo (included with the OSVR runtime installer) work on your Vive? It may be that you haven't quit steamvr all the way, or that your system doesn't support direct mode (or that you have a dual-GPU system which takes some coaxing to get Unity to handle correctly). In any case, the RenderManager example will provide access to much more useful debugging information.

I have run several unity applications on a Vive using this plugin, without modifying the applications at all - just swapping out OSVR Servers/server configurations.

[Bundenth]

@rpavlik thanks for the response.

(Apologies for the long response!)

My bad, I added the dll for the vive to the Plugins/x86 (not Android) folder as when I was configuring the same thing for the OSVR-Oculus it mentioned to place the dlls in that folder (I assumed it was the same case for Vive). I have tried removing it and the behaviour remains the same (Unity Editor tracks the headset but the Vive still prints black). Incidentally, the light status on the Vive is red all the way through.

I did try the RenderManager example but that did not work at all. I managed to copy the log output for various apps there:

RenderManagerD3DTest2D

_[OSVR] Connecting to default (local) host [OSVR] Client context initialized for org.opengoggles.exampleclients.TrackerCallback [OSVR] Got connection to main OSVR server [OSVR] Connection process took 1000ms: have connection to server, don't have path tree [OSVR] Interface initialized for /controller/left/1 [OSVR] Could not resolve source for /controller/left/1 [OSVR] Interface initialized for /controller/right/1 [OSVR] Could not resolve source for /controller/right/1 [OSVR] Connecting to default (local) host [OSVR] Client context initialized for com.osvr.renderManager [OSVR] Got connection to main OSVR server [OSVR] Got updated path tree, processing [OSVR] Connected 0 of 0 unconnected paths successfully [OSVR] Connection process took 47ms: have connection to server, have path tree [OSVR] Interface initialized for /me/head [OSVR] Constructed a TrackerHandler for com_osvr_Vive/Vive@localhost:3883 sensor 0 [OSVR] Successfully produced handler for /me/head [OSVR] Interface initialized for /me/head [OSVR] Interface initialized for /me/head [OSVR] Display: HTC Vive/Vive PRE [Display descriptor note: This is a sample descriptor file only - please follow the instructions to use the ViveDisplayExtractor to generate a correct one for your device!] [OSVR] Created an OSVR_DisplayConfigObject! RenderManager::createRenderManager(): Got Display info from server (ignore earlier errors that occured while we were waiting to connect) OSVRDisplayConfiguration::parse(): Using rgb point sample distortion. OSVRDisplayConfiguration::parse(): ERROR: Couldn't open file HTC_Vive_meshdata.json! createRenderManager: Could not parse /display string from server. Could not create RenderManager [OSVR] Client context shut down for org.opengoggles.exampleclients.TrackerCallback vrpn_Endpoint::send_pending_reports(): select() failed. Error (10093): Either the application has not called WSAStartup, or WSAStartup failed. . vrpn_Connection_IP::send_pending_reports: Closing failed endpoint. vrpn_Connection::~vrpn_Connection: Connection was deleted while 2 references still remain. vrpn_Endpoint::send_pending_reports(): select() failed. Error (10093): Either the application has not called WSAStartup, or WSAStartup failed. . vrpn_Connection_IP::send_pending_reports: Closing failed endpoint. vrpn_Connection::~vrpnConnection: Connection was deleted while 5 references still remain.

EnableOSVRDirectMode

Attempting to enable DirectMode for HDK 1.3: Success! Attempting to enable DirectMode for HDK 1.2: Success!

DirectModeDebugging

_OK, we opened the key! No NVIDIA manual whitelist entry found. (Ideally, it should work fine like this for common displays...) However, if the system has not been rebooted since the whitelist entry was removed, the previous whitelist behavior will still hold.

Getting number of VR-capable displays of type: OSVR (Early - SEN) (vendor ID hex 0xae4c) No displays of this type reported.

Getting number of VR-capable displays of type: OSVR (Current - SVR) (vendor ID hex 0xd24e) No displays of this type reported.

Getting number of VR-capable displays of type: Vuzix (vendor ID hex 0xf226) No displays of this type reported._

I can see in the README file something regarding whitelisting the NVIDIA card (?), I have a single GPU NVIDIA GTX 980 with 365.10 drivers which seem to be higher than the ones required (361).

For the sake of completion, here is my server config file:

_{ "description": "This configuration supports video (so-called 'positional') and IMU fusion tracking, in addition to orientation-only tracking, with the OSVR HDK. It is configured for RenderManager applications in direct mode (portrait) on HDK 1.3 optics.", "display": "displays/HTC_Vive.json", "renderManagerConfig": "sample-configs/renderManager.direct.landscape.json", "drivers": [{ "plugin": "com_osvr_VideoBasedHMDTracker", "driver": "VideoBasedHMDTracker", "params": { "showDebug": false, "includeRearPanel": true, "headCircumference": 55.75, "calibrationFile": "videotrackerCombinedCalibrationFile13.json" } }, { "plugin": "org_osvr_filter_videoimufusion", "driver": "VideoIMUFusion", "params": { "name": "HeadFusion", "input": { "imu": "/com_osvr_Multiserver/OSVRHackerDevKitPrediction0/semantic/hmd", "faceplate": "/com_osvr_VideoBasedHMDTracker/TrackedCamera0_0/semantic/hmd/front" }, "eyeHeight": 0, "cameraIsForward": true } }]

}_

I can see some errors there, particularly the one referring to the HTC_Vive_meshdata display file (which I have as an optional display file; using it in the OSVR server config crashed my server).

Thanks in advance!

[rpavlik]

Yeah, looks like you've found some old documentation: no hardware plugins should have you put anything in your unity plugins folder. If you find where it says to do this, please file an issue. Unity is strictly a client, and the hardware is strictly on the server side: putting hardware plugins in a folder in Unity will have at best no effect at all.

The note that appears when the display descriptor is loaded gives me the answer here: looks like you never finished installing the OSVR Vive plugin properly. It has to generate two files based on your specific unit, with absolute paths to where your server is. See the instructions in the OSVR docs repo and be sure to do the display extractor step: that's the key one you've missed.

On Thu, Jul 14, 2016, 4:20 AM Bundenth notifications@github.com wrote:

@rpavlik https://github.com/rpavlik thanks for the response.

(Apologies for the long response!)

My bad, I added the dll for the vive to the Plugins/x86 (not Android) folder as when I was configuring the same thing for the OSVR-Oculus it mentioned to place the dlls in that folder (I assumed it was the same case for Vive). I have tried removing it and the behaviour remains the same (Unity Editor tracks the headset but the Vive still prints black). Incidentally, the light status on the Vive is red all the way through.

I did try the RenderManager example but that did not work at all. I managed to copy the log output for various apps there:

RenderManagerD3DTest2D

_[OSVR] Connecting to default (local) host [OSVR] Client context initialized for org.opengoggles.exampleclients.TrackerCallback [OSVR] Got connection to main OSVR server [OSVR] Connection process took 1000ms: have connection to server, don't have path tree [OSVR] Interface initialized for /controller/left/1 [OSVR] Could not resolve source for /controller/left/1 [OSVR] Interface initialized for /controller/right/1 [OSVR] Could not resolve source for /controller/right/1 [OSVR] Connecting to default (local) host [OSVR] Client context initialized for com.osvr.renderManager [OSVR] Got connection to main OSVR server [OSVR] Got updated path tree, processing [OSVR] Connected 0 of 0 unconnected paths successfully [OSVR] Connection process took 47ms: have connection to server, have path tree [OSVR] Interface initialized for /me/head [OSVR] Constructed a TrackerHandler for com_osvr_Vive/Vive@localhost:3883 sensor 0 [OSVR] Successfully produced handler for /me/head [OSVR] Interface initialized for /me/head [OSVR] Interface initialized for /me/head [OSVR] Display: HTC Vive/Vive PRE [Display descriptor note: This is a sample descriptor file only - please follow the instructions to use the ViveDisplayExtractor to generate a correct one for your device!] [OSVR] Created an OSVR_DisplayConfigObject! RenderManager::createRenderManager(): Got Display info from server (ignore earlier errors that occured while we were waiting to connect) OSVRDisplayConfiguration::parse(): Using rgb point sample distortion. OSVRDisplayConfiguration::parse(): ERROR: Couldn't open file HTC_Vive_meshdata.json! createRenderManager: Could not parse /display string from server. Could not create RenderManager [OSVR] Client context shut down for org.opengoggles.exampleclients.TrackerCallback vrpn_Endpoint::send_pending_reports(): select() failed. Error (10093): Either the application has not called WSAStartup, or WSAStartup failed. . vrpn_Connection_IP::send_pending_reports: Closing failed endpoint. vrpn_Connection::~vrpn_Connection: Connection was deleted while 2 references still remain. vrpn_Endpoint::send_pending_reports(): select() failed. Error (10093): Either the application has not called WSAStartup, or WSAStartup failed. . vrpn_Connection_IP::send_pending_reports: Closing failed endpoint. vrpn_Connection::~vrpnConnection: Connection was deleted while 5 references still remain.

EnableOSVRDirectMode

Attempting to enable DirectMode for HDK 1.3: Success! Attempting to enable DirectMode for HDK 1.2: Success!

DirectModeDebugging

_OK, we opened the key! No NVIDIA manual whitelist entry found. (Ideally, it should work fine like this for common displays...) However, if the system has not been rebooted since the whitelist entry was removed, the previous whitelist behavior will still hold.

Getting number of VR-capable displays of type: OSVR (Early - SEN) (vendor ID hex 0xae4c) No displays of this type reported.

Getting number of VR-capable displays of type: OSVR (Current - SVR) (vendor ID hex 0xd24e) No displays of this type reported.

Getting number of VR-capable displays of type: Vuzix (vendor ID hex 0xf226) No displays of this type reported._

I can see in the README file something regarding whitelisting the NVIDIA card (?), I have a single GPU NVIDIA GTX 980 with 365.10 drivers which seem to be higher than the ones required (361).

For the sake of completion, here is my server config file:

_{ "description": "This configuration supports video (so-called 'positional') and IMU fusion tracking, in addition to orientation-only tracking, with the OSVR HDK. It is configured for RenderManager applications in direct mode (portrait) on HDK 1.3 optics.", "display": "displays/HTC_Vive.json", "renderManagerConfig": "sample-configs/renderManager.direct.landscape.json", "drivers": [{ "plugin": "com_osvr_VideoBasedHMDTracker", "driver": "VideoBasedHMDTracker", "params": { "showDebug": false, "includeRearPanel": true, "headCircumference": 55.75, "calibrationFile": "videotrackerCombinedCalibrationFile13.json" } }, { "plugin": "org_osvr_filter_videoimufusion", "driver": "VideoIMUFusion", "params": { "name": "HeadFusion", "input": { "imu": "/com_osvr_Multiserver/OSVRHackerDevKitPrediction0/semantic/hmd", "faceplate": "/com_osvr_VideoBasedHMDTracker/TrackedCamera0_0/semantic/hmd/front" }, "eyeHeight": 0, "cameraIsForward": true } }]

}_

I can see some errors there, particularly the one referring to the HTC_Vive_meshdata display file (which I have as an optional display file; using it in the OSVR server config crashed my server).

Thanks in advance!

— You are receiving this because you were mentioned.

Reply to this email directly, view it on GitHub https://github.com/OSVR/OSVR-Vive/issues/18#issuecomment-232612600, or mute the thread https://github.com/notifications/unsubscribe/AADuyZomO81EnoSfJpb3dFfF2qBMG95zks5qVf9zgaJpZM4JLnT9 .

Ryan A. Pavlik, Ph.D. CTO - OSVR Platform Sensics, Inc. www.sensics.com

Latest news and blog posts (subscribe here http://sensics.com/subscribe-to-our-mailing-list/ to get weekly updates):

July 20: Conversation with Dio Gonzalez, Principal Software Engineer at Unity Labs http://sensics.com/vrguy-podcast-episode-19-dio-gonzalez-principal-software-developer-unity-labs/

July 19: Sensics and LaputaVR team up to provide OSVR support to LaputaVR devices http://sensics.com/sensics-laputa-vr-team-provide-osvr-support-laputa-vr-devices/

July 13: VRguy podcast: Shaun Williams, CEO of MAG games http://bit.ly/29vCqIW