asus4 / tf-lite-unity-sample

TensorFlow Lite Samples on Unity
873 stars 254 forks source link

iOS - BlazePose sample works for only for 1 device orientation + tracking breaks down at sides #157

Closed sonnybsj closed 3 years ago

sonnybsj commented 3 years ago

Environment:

Describe the bug This bug report is for iOS, but it may apply to Android or any device whose camera's orientation can be changed.

Expected behaviour

Additional context

Workaround This workaround can be used to:

  1. Get the sample to work on Landscape (back camera on the left side)
  2. Fix the tracking breakdown as the tracked user moves to the side

Comment out these lines in Invoke() and InvokeAsync() methods in PoseLandmarkDetect.cs

https://github.com/asus4/tf-lite-unity-sample/blob/928157b3ce81945fb53722099b22cf04bf3fcbfb/Assets/Samples/BlazePose/PoseLandmarkDetect.cs#L107-L109

https://github.com/asus4/tf-lite-unity-sample/blob/928157b3ce81945fb53722099b22cf04bf3fcbfb/Assets/Samples/BlazePose/PoseLandmarkDetect.cs#L133-L135

            //var resizeOptions = (inputTex is WebCamTexture)
            //    ? base.resizeOptions.GetModifedForWebcam((WebCamTexture)inputTex)
            //    : base.resizeOptions;
sonnybsj commented 3 years ago

Just documenting the issue for now... It's not a priority for me right now given the workaround I mentioned, but I might look into it later.