stashapp / CommunityScripts

This is a public repository containing plugin and utility scripts created by the Stash Community.
https://docs.stashapp.cc/add-ons/
GNU Affero General Public License v3.0
181 stars 142 forks source link

[Feature] Image Polygonal Annotations for Machine Learning Labeling/Training #411

Open HybrisF opened 8 months ago

HybrisF commented 8 months ago

Is your feature request related to a problem? Please describe. I think the whole project could benefit if images and galleries have the functionality, to label objects directly inside of the web image view and store them logistically.

Describe the solution you'd like When viewing an image, a separate mode could be activated to draw COCO conform polygons on an overlay canvas of the image and assign labels to them. In addition to the work for the marking of objects in the already processed photos, the markings could be used for the training of data models in the backend to process photos that have not yet been viewed. For the time being, however, my enquiry only relates to the possibility of marking objects in a similar way to the tool LabelMe.

Describe alternatives you've considered Of course this can be performed offline with the mentioned tool, but having all in one place could be an advantage. As I said, the labels drawn by a user, are also great data for e.g. search hits.

WithoutPants commented 7 months ago

This sounds out of scope of the main function of stash, and likely serving a niche group of users. It is potentially something more suited to a plugin.