[New tool] YOLOv8 Segmentation

opendr-eu / opendr

A modular, open and non-proprietary toolkit for core robotic functionalities by harnessing deep learning

Apache License 2.0

611 stars 94 forks source link

[New tool] YOLOv8 Segmentation #468

Closed tsampazk closed 7 months ago

tsampazk commented 10 months ago

This PR adds a new tool using ultralytics YOLOv8 for segmentation usage.

~WIP~

[x] YOLOv8 segmentation learner (first version)
[x] Webcam demo
[x] Inference demo
[x] Learner documentation file
[x] Tests
[ ] ~ROS nodes~ Will be added in subsequent PR (#492)
[ ] ~ROS docs~ Will be added in subsequent PR (#492)

~Update: Ran into dependency issues with opencv version~ Changes in dependency resolving/installation fixed the issue, verified through CI.

tsampazk commented 7 months ago

Since this tool is not a main tool, but just nice-to-have, we can go ahead and review and merge it. ROS1/2 nodes can be added later if needed. @thomaspeyrucain do you think it can prove useful? It provides bounding boxes and segmentation masks for the objects detected within, with very good performance in terms of both speed and accuracy. The classes that can be detected are listed here with the exception that within OpenDR, class 0 is background and class 80 is person.

thomaspeyrucain commented 7 months ago

Hello @tsampazk , I think it would be really useful and can make us able to grasp more types of objects more effectively

tsampazk commented 7 months ago

Hello @tsampazk , I think it would be really useful and can make us able to grasp more types of objects more effectively

Alright, happy to hear that, i will add the ROS nodes in a subsequent PR.