Unity-Technologies / sentis-samples

Sentis samples internal development repository. Contains example and template projects for Sentis package use.
Other
116 stars 20 forks source link

Object Detection and Image Segmentation #1

Open RossMelbourne opened 9 months ago

RossMelbourne commented 9 months ago

I was wondering if Unity plans on releasing samples showing how to do Object Detection and Image Segmentation using a normal camera or even a webcam? I know this has been done by people using Barracuda so I am assuming it will work even better with Sensis. Thank you for all the great new features in Unity.

LiutaurasVysniauskasUnity commented 7 months ago

Thank you for the suggestion. This is known internally as Task 258

pauldog commented 5 months ago

Hi we have some new models on Hugging Face.. This includes an object detection model YOLOv7 and a face detection using a camera (blaze-face). We will be adding more including segmentation soon. Stay tuned.

rawatsaurabh commented 3 months ago

Hello @pauldog , are you referring to this example : https://huggingface.co/unity/sentis-YOLOv8n , As there is no YOLOv7, More over it doesn't take the direct camera feed rather the static video. Please let me know if I misinterpret it.

pauldog commented 3 months ago

There is this one too: https://huggingface.co/unity/sentis-yolotinyv7

Yes feel free to implement the camera feed yourself.

RC137 commented 2 months ago

Hi, I tried to get an image segmentation which works fine with Barracuda to work with Sentis, but with very little luck :( I wanted to use the "109_Selfie_Segmentation" from PINTO_model_zoo, which works with barracuda, but not with Sentis. Is this a problem with model compatibility? What can I do to get it working?