Unity-Technologies / sentis-samples

Sentis samples internal development repository. Contains example and template projects for Sentis package use.
Other
174 stars 30 forks source link

Object Detection and Image Segmentation #1

Open RossMelbourne opened 1 year ago

RossMelbourne commented 1 year ago

I was wondering if Unity plans on releasing samples showing how to do Object Detection and Image Segmentation using a normal camera or even a webcam? I know this has been done by people using Barracuda so I am assuming it will work even better with Sensis. Thank you for all the great new features in Unity.

LiutaurasVysniauskasUnity commented 11 months ago

Thank you for the suggestion. This is known internally as Task 258

elephantpanda commented 10 months ago

Hi we have some new models on Hugging Face.. This includes an object detection model YOLOv7 and a face detection using a camera (blaze-face). We will be adding more including segmentation soon. Stay tuned.

rawatsaurabh commented 8 months ago

Hello @pauldog , are you referring to this example : https://huggingface.co/unity/sentis-YOLOv8n , As there is no YOLOv7, More over it doesn't take the direct camera feed rather the static video. Please let me know if I misinterpret it.

elephantpanda commented 8 months ago

There is this one too: https://huggingface.co/unity/sentis-yolotinyv7

Yes feel free to implement the camera feed yourself.

RC137 commented 7 months ago

Hi, I tried to get an image segmentation which works fine with Barracuda to work with Sentis, but with very little luck :( I wanted to use the "109_Selfie_Segmentation" from PINTO_model_zoo, which works with barracuda, but not with Sentis. Is this a problem with model compatibility? What can I do to get it working?