search

microsoft / MixedRealityToolkit-Unity

This repository is for the legacy Mixed Reality Toolkit (MRTK) v2. For the latest version of the MRTK please visit https://github.com/MixedRealityToolkit/MixedRealityToolkit-Unity
https://aka.ms/mrtkdocs
MIT License
6.02k stars 2.12k forks source link

Playback of eye tracking recording in EyeTrackingDemo-05-Visualizer does not work #11339

Closed DivinorWieldor closed 10 months ago

DivinorWieldor commented 1 year ago

Describe the bug

A clear and concise description of what the bug is.

When using the "record and replay eye gaze data" of this scene, if we start recording the eye gaze data and then attempt to play it back again, the app states that no recording was found and stops replay.

To reproduce

Steps to reproduce the behavior:

Go to EyeTrackingDemo-00-RootScene Select "Visualizer" from the navigation bar Click on "Record Eye Gaze" button under the "Record and Replay Eye Gaze" panel Optional: look at the eye gaze panel Click on "Stop recording eye gaze" Click on "Show Heatmap" button See that no replay plays and for a single frame the text states "no eye gaze data found"

Expected behavior

A clear and concise description of what you expected to happen.

If "Record Eye Gaze" button is clicked, the user looks at the panel to provide data, and then stop and save the recording, "show heatmap" should play the heatmap recording. This can be seen as the expected behavior in the Unity game scene during simulation.

Screenshots

If applicable, add screenshots to help explain your problem.

https://user-images.githubusercontent.com/55066515/210361188-c78b02d9-0c36-4ec1-aa30-5cd4c2e56a47.mp4

Your setup (please complete the following information)

Target platform (please complete the following information)

Additional context

Add any other context about the problem here.

When looking at the output log on Visual Studio, when recording is activated and stopped, there are multiple exceptions thrown by the program. These may be why no data can be found by the playback feature because the data recorder crashes and no data is then found.

DivinorWieldor commented 1 year ago

It appears that this issue is caused by the default permissions of the project not being comprehensive enough. After looking around a bit and enabling additional capabilities (under the "Publishing Settings"), I have managed to get this feature working now. To resolve this, I enabled "MusicLibrary" "Pictures Library" "Videos Library" "UserDataTasks." I am uncertain which one was the permission that resolved the issue.

Leaving the issue open as I did not see this as a thing to look out for among the documentation. The label is incorrect but I seem to be unable to fix that myself.

AMollis commented 1 year ago

@marlenaklein-msft is this reproducible in MRTK3 sample scenes?

IssueSyncBot commented 10 months ago

We appreciate your feedback and thank you for reporting this issue.

Microsoft Mixed Reality Toolkit version 2 (MRTK2) is currently in limited support. This means that Microsoft is only fixing high priority security issues. Unfortunately, this issue does not meet the necessary priority and will be closed. If you strongly feel that this issue deserves more attention, please open a new issue and explain why it is important.

Microsoft recommends that all new HoloLens 2 Unity applications use MRTK3 instead of MRTK2.

Please note that MRTK3 was released in August 2023. It features an all-new architecture for developing rich mixed reality experiences and has a minimum requirement of Unity 2021.3 LTS. For more information about MRTK3, please visit https://www.mixedrealitytoolkit.org.

Thank you for your continued support of the Mixed Reality Toolkit!