microsoft / MixedRealityToolkit-Unity

This repository is for the legacy Mixed Reality Toolkit (MRTK) v2. For the latest version of the MRTK please visit https://github.com/MixedRealityToolkit/MixedRealityToolkit-Unity
https://aka.ms/mrtkdocs
MIT License
6k stars 2.12k forks source link

Motion Controller not working with Unity UI Buttons #1205

Closed Marbl70 closed 6 years ago

Marbl70 commented 6 years ago

Tried to use Motion Controllers together with Unity UI buttons, using latest MixedRealityToolkit from master branch, Unity 2017.2 f3 MRTP, Windows Fall Creator Update and the "InputManagerTest" sample scene from HoloToolkit examples.

When starting the InputManagerTest scene and moving the cursor above the UI canvas button, the cursor is correctly drawn above the button and the button is highlighted.

But after the first click on the button, suddenly the cursor jumps to a different spot and is not drawn above the button anymore when moving over it.

And even worse: clicks are not triggering the button onClick event anymore.

Tried different things but failed to get the motion controller working properly with ui buttons, so that the ui button can be pointed at with the motion controller cursor and pressed by a motion controller button click.

Is there a working sample that shows how point and submit works with motion controllers and ui buttons?

StephenHodgson commented 6 years ago

Hmm, this sounds like a bug.

Let me do a quick test to verify.

Marbl70 commented 6 years ago

Hi Stephen,

I used the „InputManagerTest“ scene from "HoloToolkit-Examples/Input/Scenes“.

This scene has a ui canvas button which I tested using the Mixed Reality Portal Simulator as well as a real acer headset device + controller

Thanks, Martin

Am 20.10.2017 um 00:12 schrieb Stephen Hodgson notifications@github.com:

Hmm, this sounds like a bug.

Which example scenes were you using?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/Microsoft/MixedRealityToolkit-Unity/issues/1205#issuecomment-338052684, or mute the thread https://github.com/notifications/unsubscribe-auth/AfanZzE3SZxGLEu8pHBgPelZzeuKqTeeks5st8lYgaJpZM4P_4ij.

StephenHodgson commented 6 years ago

Hmm. I've had two different tests have different results.

image

I was able to get the controller to "take" focus and click, highlight, etc.

I was also able to duplicate it. We need to figure out exactly what's happening to get a conclusive result with a fix.

I think it's a little difficult to aim at objects without a laser pointer.

StephenHodgson commented 6 years ago

Okay, I'm pretty sure I figured it out. There was an open issue about how when you turn your body the motion controllers become de-synced from your view.

This affects what you're pointing at and raycasting against. I noticed that the focus was happening when I wasn't gazing nor pointing at the UI.

StephenHodgson commented 6 years ago

I'm going to close this as a duplicate of the other issue.