Mixed Reality Capture for HoloLens

[mluketin]

Hi, thank you for examples.

I made a call between laptop and hololens and noticed that hololens sends plain video without holograms. Will you enable mixed reality capture on hololens?

[morosev]

WebRTC build is fixed for SDK 17134 and it works fine on HL emulator. The message "Failed to load 'Org.WebRtc.dll', expected x86 architecture, but was Unknown architecture. You must recompile your plugin for x86 architecture." is not present any more. The application has been tested in the following environment: VS 2017 15.7.2, Windows SDK 17134, HL Emulator 17134.

[ghost]

Successfully deployed Unity app(D3D) to HoloLens but I'm unable to see PC webcam in Hololens. PC works fine. Any idea how to resolve this problem? After trying to debug whole application there is no warning/error, @gjavi1 would you please describe how did you add reference WebRtcScheme.dll to appxmanifest?

[zhangalex]

@morosev

Do you have any idea why I encounter this error while building WebRtcUnityD3D?

7> Assembly-CSharp -> C:\Projects\ortclib\common\windows\samples\PeerCC\Output\PeerCC.ClientUnityD3D.Assembly-CSharp\WebRtc\bin\x86\Release\Assembly-CSharp.dll 8>------ Rebuild All started: Project: PeerConnectionClientUnity, Configuration: Release x86 ------ 8>C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\App.cs(56,13,56,71): warning CS0618: 'ApplicationView.SuppressSystemOverlays.set' is obsolete: 'Use the TryEnterFullScreen method and IsFullScreenMode property instead of SuppressSystemOverlays. For more info, see MSDN.' 8> PeerConnectionClientUnity -> C:\Projects\ortclib\common\windows\samples\PeerCC\Output\PeerCC.ClientUnityD3D\WebRtc\bin\x86\Release\PeerConnectionClientUnity.exe 8> UnityWSAPlayerDir "C:\Program Files\Unity\Editor\Data\PlaybackEngines\MetroSupport\". 8> UnityProjectDir "". 8> Copying unprocessed assemblies... 8> Running AssemblyConverter... 8> System.InvalidOperationException: Sequence contains no matching element 8> at System.Linq.Enumerable.Single[TSource](IEnumerable1 source, Func2 predicate) 8> at Unity.OperationContext.SetWinRTBridge(AssemblyDefinition assembly) 8> at Unity.CreateWinRTBridgeStep.Execute() 8> at Unity.Step.Execute(OperationContext operationContext, IStepContext previousStepContext) 8> at Unity.Operation.Execute() 8> at Unity.Program.Main(String[] args) 8>C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\PeerConnectionClientUnity.csproj(446,5): error MSB3073: The command ""C:\Projects\ortclib\webrtc\windows\solutions......\common\windows\samples\PeerCC\Unity\Tools\AssemblyConverter.exe" -platform=uap -lock="C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\project.lock.json" -bits=32 -configuration=Release -removeDebuggableAttribute=False -uwpsdk=10.0.16299.0 -path="." -path="C:\Program Files\Unity\Editor\Data\PlaybackEngines\MetroSupport\Players\UAP\dotnet\x86\Release" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.TilemapModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.TextRenderingModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.UIModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.UIElementsModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.SpriteMaskModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.SharedInternalsModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.ScreenCaptureModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.PhysicsModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.TerrainPhysicsModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.TerrainModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.StyleSheetsModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.UNETModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.VRModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.VideoModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.VehiclesModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.WindModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.WebModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.UnityWebRequestAudioModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.UnityConnectModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.UnityAnalyticsModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.UnityWebRequestWWWModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.UnityWebRequestTextureModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.UnityWebRequestModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.ClothModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.AudioModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.AssetBundleModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.ARModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.DirectorModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.CrashReportingModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.CoreModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\Assembly-CSharp.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.AnimationModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.AIModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.AccessibilityModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.ParticlesLegacyModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.JSONSerializeModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.Physics2DModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.PerformanceReportingModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.ParticleSystemModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.GridModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.GameCenterModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.InputModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.IMGUIModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.ImageConversionModule.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.Timeline.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\nunit.framework.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.UI.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.SpatialTracking.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\PeerConnectionClientCore.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.HoloLens.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.StandardEvents.dll" "C:\Projects\ortclib\common\windows\samples\PeerCC\ClientUnity\UnityEngine.Networking.dll"" exited with code 1. ========== Rebuild All: 7 succeeded, 1 failed, 0 skipped ==========