search

google-ai-edge / mediapipe

Cross-platform, customizable ML solutions for live and streaming media.
https://ai.google.dev/edge/mediapipe
Apache License 2.0
26.81k stars 5.09k forks source link

Unity Support #36

Closed nadir500 closed 5 years ago

nadir500 commented 5 years ago

Can we see Unity Engine port of it? It would so much great of we used it inside the engine

manwithsteelnerves commented 2 years ago

@ROBYER1

I was following this thread and it started long back where there are not much devices which support AR Core. But, now there are many.

Would be great if you can share the use-case list!

EigenSpiral commented 2 years ago

Hi, Does anyone know how the hand tracking performance of Mediapipe & Leap motion compares?

boehm-e commented 2 years ago

@EigenSpiral I have a leap motion since years now. I find that Mediapipe is better at guessing partially occluded finger's positions. I cannot compare the performance (in term of speed), since I run mediapipe on my phone, and leap motion on my laptop. Both run smoothly. Maybe mediapipe is even faster.

EigenSpiral commented 2 years ago

@boehm-e Thank you for sharing! How does it compare on depth perception?

ROBYER1 commented 2 years ago

There isn't really depth with Mediapipe so Leap or any depth sensing camera is better there. I would strongly advise you try the linked sample repo above and compare for yourself in your own project!

manwithsteelnerves commented 2 years ago

We recently release Easy ML Kit which targets to get google's ML Kit, Media Pipe and Tensorflow in Unity. Currently we released 2 features (Barcode scanning and object detection) and others are in developement.

We have ARFoundation Camera as one of the input sources (along with live cam and image/textures) which will be quite useful for AR Apps. Would be great if you can share us what features you are expecting so we can prioritize.

EigenSpiral commented 2 years ago

Hi, It would be great if there was a way to connect the Mediapipe finger tracking with controlling virtual hand objects in Unity.

On Sat, May 7, 2022 at 5:02 AM IP @.***> wrote:

We recently release Easy ML Kit https://u3d.as/2PMe which targets to get google's ML Kit, Media Pipe and Tensorflow in Unity. Currently we released 2 features (Barcode scanning and object detection) and others are in developement.

We have ARFoundation Camera as one of the input sources (along with live cam and image/textures) which will be quite useful for AR Apps. Would be great if you can share us what features you are expecting so we can prioritize.

— Reply to this email directly, view it on GitHub https://github.com/google/mediapipe/issues/36#issuecomment-1120170202, or unsubscribe https://github.com/notifications/unsubscribe-auth/AXCFJIYDGAEACK3X7CNAL7TVIYWSXANCNFSM4IOHEELQ . You are receiving this because you were mentioned.Message ID: @.***>

manwithsteelnerves commented 2 years ago

Sure! Will definitely have a note! We just released with Text Recognition and current features in development are Face detection and Pose estimation.