Segment Anything V2 - Githubissues

huggingface / transformers.js

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!

https://huggingface.co/docs/transformers.js

Apache License 2.0

12.07k stars 764 forks source link

Segment Anything V2 #874

Open msurguyamzn opened 3 months ago

msurguyamzn commented 3 months ago

Model description

https://ai.meta.com/blog/segment-anything-2/

Prerequisites

[ ] The model is supported in Transformers (i.e., listed here)
[ ] The model can be exported to ONNX with Optimum (i.e., listed here)

Additional information

Would be great to support SAM V2, however I don't know what needs to happen to support it. Would love community support to write out the instructions on how to implement this.

Your contribution

Can write medium-grade JS and run testing :)

xenova commented 3 months ago

This is currently being worked on in transformers:

feature request: https://github.com/huggingface/transformers/issues/32308
PR: https://github.com/huggingface/transformers/pull/32394