alvr-org / ALVR

Stream VR games from your PC to your headset via Wi-Fi
MIT License
5.34k stars 477 forks source link

Problems encountered when setting up the "Stream headset microphone" #1070

Closed xuan25 closed 2 years ago

xuan25 commented 2 years ago

Description

I am trying to setup the headset microphone streaming without the "Virtual Audio Cables" driver. My PC uses an audio interface with multiple input and output channels. I would like ALVR to act as an audio output software that takes the audio from the headset's microphone and outputs it to the audio output channel I specified. Then I could route the audio in my audio interface to wherever I desired. However, after I set it up in ALVR, it kept warning me that "Game Audio and Microphone cannot point to the same device".

At this point, I set the "Virtual microphone input" in ALVR to the WDM device corresponding to Channel 3-4 and the output of Channel 3-4 is routed to the input of Channel 1-2 in the audio interface driver so that other software would capture the audio from Channel 1-2 inputs. Besides, I also made the corresponding settings of "Virtual microphone output" in the ALVR. Afterwards, when I tried to connect my headset to the PC, the ALVR client raised the error "Connection Error: ent/src/connection.rs:168: At alvr/sockets/src/control_so", and the server reported the warning mentioned above. The screenshot is shown below.

Screenshot 2022-05-21 003126

In addition, I've also noticed that ALVR appears to try to automatically set up my default audio input and output devices, which sometimes breaks the audio routing of my system while I am not on VR. I may have accidentally triggered something to let the ALVR try to change my settings. Therefore I wonder if I can disable this feature and only set the audio output of the software, then I can set up the rests manually.

I would appreciate any help and guidance.

Thanks in advance!

General Troubleshooting

Environement

Hardware

Note: for Linux, an upload to the hw-probe database is preferred: hw-probe -all -upload

CPU: AMD Ryzen 7 3800X

GPU: NVIDIA GeForce GTX 1080 Ti

Audio: ESI MAYA22 USB

Installation

ALVR Version: 18.2.3

SteamVR Version: 1.21.12

Install Type:

OS Name and Version (winver on Windows or grep PRETTY_NAME /etc/os-release on most Linux distributions): Windows 11 Pro 21H2

Session Log

02:11:11.620686800 [INFO] #{"id":"SessionUpdated"}#
02:11:11.620903900 [INFO] #{"id":"Session","data":{"serverVersion":"18.2.3","setupWizard":false,"locale":"system","openvr_config":{"universe_id":2,"headset_serial_number":"1WMGH000XX0000","headset_tracking_system_name":"oculus","headset_model_number":"Miramar","headset_driver_version":"1.55.0","headset_manufacturer_name":"Oculus","headset_render_model_name":"generic_hmd","headset_registered_device_type":"oculus/1WMGH000XX0000","eye_resolution_width":1824,"eye_resolution_height":1920,"target_eye_resolution_width":1824,"target_eye_resolution_height":1920,"seconds_from_vsync_to_photons":0.005,"force_3dof":false,"tracking_ref_only":false,"enable_vive_tracker_proxy":false,"aggressive_keyframe_resend":false,"adapter_index":0,"codec":1,"refresh_rate":120,"use_10bit_encoder":false,"sw_thread_count":0,"encode_bitrate_mbs":30,"enable_adaptive_bitrate":true,"bitrate_maximum":200,"latency_target":12000,"latency_use_frametime":false,"latency_target_maximum":30000,"latency_target_offset":0,"latency_threshold":3000,"bitrate_up_rate":1,"bitrate_down_rate":3,"bitrate_light_load_threshold":0.7,"controllers_tracking_system_name":"oculus","controllers_manufacturer_name":"Oculus","controllers_model_number":"Miramar","render_model_name_left_controller":"oculus_quest2_controller_left","render_model_name_right_controller":"oculus_quest2_controller_right","controllers_serial_number":"1WMHH000X00000_Controller","controllers_type_left":"oculus_touch","controllers_type_right":"oculus_touch","controllers_registered_device_type":"oculus/1WMHH000X00000_Controller","controllers_input_profile_path":"{oculus}/input/touch_profile.json","controllers_mode_idx":7,"controllers_enabled":true,"position_offset":[0.0,0.0,0.0],"tracking_frame_offset":0,"controller_pose_offset":-1.0,"serverside_prediction":false,"linear_velocity_cutoff":0.01,"angular_velocity_cutoff":10.0,"position_offset_left":[-0.0065,0.002,-0.051],"rotation_offset_left":[40.0,0.0,0.0],"haptics_intensity":1.0,"haptics_amplitude_curve":0.4,"haptics_min_duration":0.01,"haptics_low_duration_amplitude_multiplier":2.5,"haptics_low_duration_range":0.5,"use_headset_tracking_system":false,"enable_foveated_rendering":true,"foveation_center_size_x":0.4,"foveation_center_size_y":0.35,"foveation_center_shift_x":0.4,"foveation_center_shift_y":0.1,"foveation_edge_ratio_x":4.0,"foveation_edge_ratio_y":5.0,"enable_color_correction":true,"brightness":0.0,"contrast":0.0,"saturation":0.5,"gamma":1.0,"sharpening":0.0,"enable_fec":true,"linux_async_reprojection":false},"clientConnections":{"0473.client.alvr":{"displayName":"Oculus Quest 2","manualIps":[],"trusted":true}},"sessionSettings":{"video":{"adapterIndex":0,"renderResolution":{"scale":1.0,"absolute":{"width":2880,"height":1600},"variant":"scale"},"recommendedTargetResolution":{"scale":1.0,"absolute":{"width":2880,"height":1600},"variant":"scale"},"preferredFps":120.0,"codec":{"variant":"HEVC"},"clientRequestRealtimeDecoder":true,"use10bitEncoder":false,"swThreadCount":0,"encodeBitrateMbs":30,"adaptiveBitrate":{"enabled":true,"content":{"bitrateMaximum":200,"latencyTarget":12000,"latencyUseFrametime":{"enabled":false,"content":{"latencyTargetMaximum":30000,"latencyTargetOffset":0}},"latencyThreshold":3000,"bitrateUpRate":1,"bitrateDownRate":3,"bitrateLightLoadThreshold":0.7}},"secondsFromVsyncToPhotons":0.005,"foveatedRendering":{"enabled":true,"content":{"centerSizeX":0.4,"centerSizeY":0.35,"centerShiftX":0.4,"centerShiftY":0.1,"edgeRatioX":4.0,"edgeRatioY":5.0}},"colorCorrection":{"enabled":true,"content":{"brightness":0.0,"contrast":0.0,"saturation":0.5,"gamma":1.0,"sharpening":0.0}}},"audio":{"linuxBackend":{"variant":"alsa"},"gameAudio":{"enabled":true,"content":{"deviceId":{"name":"","index":1,"variant":"default"},"muteWhenStreaming":true,"config":{"averageBufferingMs":50,"batchMs":10}}},"microphone":{"enabled":true,"content":{"inputDeviceId":{"name":"MAYA22 Virtual CH 3-4 (ESI Audio Device (WDM) - Maya22 USB)","index":2,"variant":"name"},"outputDeviceId":{"name":"MAYA22 CH 1-2 (ESI Audio Device (WDM) - Maya22 USB)","index":1,"variant":"name"},"sampleRate":44100,"config":{"averageBufferingMs":50,"batchMs":10}}}},"headset":{"modeIdx":2,"universeId":2,"serialNumber":"1WMGH000XX0000","trackingSystemName":"oculus","modelNumber":"Miramar","driverVersion":"1.55.0","manufacturerName":"Oculus","renderModelName":"generic_hmd","registeredDeviceType":"oculus/1WMGH000XX0000","trackingFrameOffset":0,"positionOffset":[0.0,0.0,0.0],"force3dof":false,"trackingRefOnly":false,"enableViveTrackerProxy":false,"controllers":{"enabled":true,"content":{"modeIdx":7,"trackingSystemName":"oculus","manufacturerName":"Oculus","modelNumber":"Miramar","renderModelNameLeft":"oculus_quest2_controller_left","renderModelNameRight":"oculus_quest2_controller_right","serialNumber":"1WMHH000X00000_Controller","ctrlTypeLeft":"oculus_touch","ctrlTypeRight":"oculus_touch","registeredDeviceType":"oculus/1WMHH000X00000_Controller","inputProfilePath":"{oculus}/input/touch_profile.json","poseTimeOffset":-1.0,"clientsidePrediction":false,"serversidePrediction":false,"linearVelocityCutoff":0.01,"angularVelocityCutoff":10.0,"positionOffsetLeft":[-0.0065,0.002,-0.051],"rotationOffsetLeft":[40.0,0.0,0.0],"hapticsIntensity":1.0,"hapticsAmplitudeCurve":0.4,"hapticsMinDuration":0.01,"hapticsLowDurationAmplitudeMultiplier":2.5,"hapticsLowDurationRange":0.5,"useHeadsetTrackingSystem":false}},"extraLatencyMode":false},"connection":{"clientDiscovery":{"enabled":true,"content":{"autoTrustClients":false}},"webServerPort":8082,"streamProtocol":{"throttledUdp":{"bitrateMultiplier":1.5},"variant":"tcp"},"streamPort":9944,"aggressiveKeyframeResend":false,"onConnectScript":"","onDisconnectScript":"","enableFec":true},"extra":{"theme":{"variant":"systemDefault"},"clientDarkMode":false,"revertConfirmDialog":true,"restartConfirmDialog":true,"promptBeforeUpdate":true,"updateChannel":{"variant":"stable"},"logToDisk":true,"notificationLevel":{"variant":"warning"},"excludeNotificationsWithoutId":false,"patches":{"removeSyncPopup":true,"linuxAsyncReprojection":false}}},"advanced":false}}#
02:11:11.660526700 [INFO] Instance version: 0x4030c9
02:11:11.660543700 [INFO] Enabling device properties2
02:11:11.663068800 [INFO] Adapter Vulkan AdapterInfo { name: "NVIDIA GeForce GTX 1080 Ti", vendor: 4318, device: 6918, device_type: DiscreteGpu, backend: Vulkan }
02:11:11.754870600 [INFO] Adapter Dx12 AdapterInfo { name: "NVIDIA GeForce GTX 1080 Ti", vendor: 4318, device: 6918, device_type: DiscreteGpu, backend: Dx12 }
02:11:11.754907100 [INFO] Adapter Dx12 AdapterInfo { name: "Microsoft Basic Render Driver", vendor: 5140, device: 140, device_type: Cpu, backend: Dx12 }
02:11:11.755334200 [INFO] #{"id":"SessionUpdated"}#
02:11:11.755405100 [INFO] #{"id":"Session","data":{"serverVersion":"18.2.3","setupWizard":false,"locale":"system","openvr_config":{"universe_id":2,"headset_serial_number":"1WMGH000XX0000","headset_tracking_system_name":"oculus","headset_model_number":"Miramar","headset_driver_version":"1.55.0","headset_manufacturer_name":"Oculus","headset_render_model_name":"generic_hmd","headset_registered_device_type":"oculus/1WMGH000XX0000","eye_resolution_width":1824,"eye_resolution_height":1920,"target_eye_resolution_width":1824,"target_eye_resolution_height":1920,"seconds_from_vsync_to_photons":0.005,"force_3dof":false,"tracking_ref_only":false,"enable_vive_tracker_proxy":false,"aggressive_keyframe_resend":false,"adapter_index":0,"codec":1,"refresh_rate":120,"use_10bit_encoder":false,"sw_thread_count":0,"encode_bitrate_mbs":30,"enable_adaptive_bitrate":true,"bitrate_maximum":200,"latency_target":12000,"latency_use_frametime":false,"latency_target_maximum":30000,"latency_target_offset":0,"latency_threshold":3000,"bitrate_up_rate":1,"bitrate_down_rate":3,"bitrate_light_load_threshold":0.7,"controllers_tracking_system_name":"oculus","controllers_manufacturer_name":"Oculus","controllers_model_number":"Miramar","render_model_name_left_controller":"oculus_quest2_controller_left","render_model_name_right_controller":"oculus_quest2_controller_right","controllers_serial_number":"1WMHH000X00000_Controller","controllers_type_left":"oculus_touch","controllers_type_right":"oculus_touch","controllers_registered_device_type":"oculus/1WMHH000X00000_Controller","controllers_input_profile_path":"{oculus}/input/touch_profile.json","controllers_mode_idx":7,"controllers_enabled":true,"position_offset":[0.0,0.0,0.0],"tracking_frame_offset":0,"controller_pose_offset":-1.0,"serverside_prediction":false,"linear_velocity_cutoff":0.01,"angular_velocity_cutoff":10.0,"position_offset_left":[-0.0065,0.002,-0.051],"rotation_offset_left":[40.0,0.0,0.0],"haptics_intensity":1.0,"haptics_amplitude_curve":0.4,"haptics_min_duration":0.01,"haptics_low_duration_amplitude_multiplier":2.5,"haptics_low_duration_range":0.5,"use_headset_tracking_system":false,"enable_foveated_rendering":true,"foveation_center_size_x":0.4,"foveation_center_size_y":0.35,"foveation_center_shift_x":0.4,"foveation_center_shift_y":0.1,"foveation_edge_ratio_x":4.0,"foveation_edge_ratio_y":5.0,"enable_color_correction":true,"brightness":0.0,"contrast":0.0,"saturation":0.5,"gamma":1.0,"sharpening":0.0,"enable_fec":true,"linux_async_reprojection":false},"clientConnections":{"0473.client.alvr":{"displayName":"Oculus Quest 2","manualIps":[],"trusted":true}},"sessionSettings":{"video":{"adapterIndex":0,"renderResolution":{"scale":1.0,"absolute":{"width":2880,"height":1600},"variant":"scale"},"recommendedTargetResolution":{"scale":1.0,"absolute":{"width":2880,"height":1600},"variant":"scale"},"preferredFps":120.0,"codec":{"variant":"HEVC"},"clientRequestRealtimeDecoder":true,"use10bitEncoder":false,"swThreadCount":0,"encodeBitrateMbs":30,"adaptiveBitrate":{"enabled":true,"content":{"bitrateMaximum":200,"latencyTarget":12000,"latencyUseFrametime":{"enabled":false,"content":{"latencyTargetMaximum":30000,"latencyTargetOffset":0}},"latencyThreshold":3000,"bitrateUpRate":1,"bitrateDownRate":3,"bitrateLightLoadThreshold":0.7}},"secondsFromVsyncToPhotons":0.005,"foveatedRendering":{"enabled":true,"content":{"centerSizeX":0.4,"centerSizeY":0.35,"centerShiftX":0.4,"centerShiftY":0.1,"edgeRatioX":4.0,"edgeRatioY":5.0}},"colorCorrection":{"enabled":true,"content":{"brightness":0.0,"contrast":0.0,"saturation":0.5,"gamma":1.0,"sharpening":0.0}}},"audio":{"linuxBackend":{"variant":"alsa"},"gameAudio":{"enabled":true,"content":{"deviceId":{"name":"","index":1,"variant":"default"},"muteWhenStreaming":true,"config":{"averageBufferingMs":50,"batchMs":10}}},"microphone":{"enabled":true,"content":{"inputDeviceId":{"name":"MAYA22 Virtual CH 3-4 (ESI Audio Device (WDM) - Maya22 USB)","index":2,"variant":"name"},"outputDeviceId":{"name":"MAYA22 CH 1-2 (ESI Audio Device (WDM) - Maya22 USB)","index":1,"variant":"name"},"sampleRate":44100,"config":{"averageBufferingMs":50,"batchMs":10}}}},"headset":{"modeIdx":2,"universeId":2,"serialNumber":"1WMGH000XX0000","trackingSystemName":"oculus","modelNumber":"Miramar","driverVersion":"1.55.0","manufacturerName":"Oculus","renderModelName":"generic_hmd","registeredDeviceType":"oculus/1WMGH000XX0000","trackingFrameOffset":0,"positionOffset":[0.0,0.0,0.0],"force3dof":false,"trackingRefOnly":false,"enableViveTrackerProxy":false,"controllers":{"enabled":true,"content":{"modeIdx":7,"trackingSystemName":"oculus","manufacturerName":"Oculus","modelNumber":"Miramar","renderModelNameLeft":"oculus_quest2_controller_left","renderModelNameRight":"oculus_quest2_controller_right","serialNumber":"1WMHH000X00000_Controller","ctrlTypeLeft":"oculus_touch","ctrlTypeRight":"oculus_touch","registeredDeviceType":"oculus/1WMHH000X00000_Controller","inputProfilePath":"{oculus}/input/touch_profile.json","poseTimeOffset":-1.0,"clientsidePrediction":false,"serversidePrediction":false,"linearVelocityCutoff":0.01,"angularVelocityCutoff":10.0,"positionOffsetLeft":[-0.0065,0.002,-0.051],"rotationOffsetLeft":[40.0,0.0,0.0],"hapticsIntensity":1.0,"hapticsAmplitudeCurve":0.4,"hapticsMinDuration":0.01,"hapticsLowDurationAmplitudeMultiplier":2.5,"hapticsLowDurationRange":0.5,"useHeadsetTrackingSystem":false}},"extraLatencyMode":false},"connection":{"clientDiscovery":{"enabled":true,"content":{"autoTrustClients":false}},"webServerPort":8082,"streamProtocol":{"throttledUdp":{"bitrateMultiplier":1.5},"variant":"tcp"},"streamPort":9944,"aggressiveKeyframeResend":false,"onConnectScript":"","onDisconnectScript":"","enableFec":true},"extra":{"theme":{"variant":"systemDefault"},"clientDarkMode":false,"revertConfirmDialog":true,"restartConfirmDialog":true,"promptBeforeUpdate":true,"updateChannel":{"variant":"stable"},"logToDisk":true,"notificationLevel":{"variant":"warning"},"excludeNotificationsWithoutId":false,"patches":{"removeSyncPopup":true,"linuxAsyncReprojection":false}}},"advanced":false}}#
02:11:11.759765800 [INFO] Serial Number: 1WMGH000XX0000
02:11:11.759788000 [INFO] Model Number: Miramar
02:11:11.759795500 [INFO] Render Target: 3648 1920
02:11:11.759805300 [INFO] Seconds from Vsync to Photons: 0.005000
02:11:11.759812900 [INFO] Refresh Rate: 120
02:11:11.790063300 [INFO] Using NVIDIA GeForce GTX 1080 Ti as primary graphics adapter.
02:11:11.790095900 [INFO] OSVer: MajorVersion=10 MinorVersion=0 Build=22000
02:11:18.262645100 [WARN] Handshake: Game audio and microphone cannot point to the same device!
02:11:19.452493800 [WARN] Handshake: Game audio and microphone cannot point to the same device!
02:11:30.411192800 [WARN] Handshake: Game audio and microphone cannot point to the same device!
02:11:31.989494500 [WARN] Handshake: Game audio and microphone cannot point to the same device!
02:11:33.018755900 [WARN] Handshake: Game audio and microphone cannot point to the same device!
02:11:34.077268300 [WARN] Handshake: Game audio and microphone cannot point to the same device!
02:11:35.163790100 [WARN] Handshake: Game audio and microphone cannot point to the same device!
02:11:36.289369800 [WARN] Handshake: Game audio and microphone cannot point to the same device!
02:11:37.410488400 [WARN] Handshake: Game audio and microphone cannot point to the same device!
02:11:38.674165000 [WARN] Handshake: Game audio and microphone cannot point to the same device!
02:11:39.868085800 [WARN] Handshake: Game audio and microphone cannot point to the same device!
02:11:41.000839400 [WARN] Handshake: Game audio and microphone cannot point to the same device!
02:11:42.031663100 [WARN] Handshake: Game audio and microphone cannot point to the same device!
02:11:43.150520000 [WARN] Handshake: Game audio and microphone cannot point to the same device!
02:11:44.283093900 [WARN] Handshake: Game audio and microphone cannot point to the same device!
02:11:45.371467400 [WARN] Handshake: Game audio and microphone cannot point to the same device!
02:11:46.427061200 [WARN] Handshake: Game audio and microphone cannot point to the same device!
02:11:47.553486800 [WARN] Handshake: Game audio and microphone cannot point to the same device!
02:11:48.686768400 [WARN] Handshake: Game audio and microphone cannot point to the same device!
02:11:49.806164100 [WARN] Handshake: Game audio and microphone cannot point to the same device!
02:11:50.932452200 [WARN] Handshake: Game audio and microphone cannot point to the same device!
02:11:52.058671200 [WARN] Handshake: Game audio and microphone cannot point to the same device!
02:11:53.185522300 [WARN] Handshake: Game audio and microphone cannot point to the same device!
RyanDanWhite commented 2 years ago
stale[bot] commented 2 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.