search

software-mansion-labs / ex_vision

Apache License 2.0
61 stars 5 forks source link

Support SAM2 #17

Open andr-ec opened 2 months ago

andr-ec commented 2 months ago

Would be awesome to support sam2!

https://ai.meta.com/sam2/

There's an implementation of the original sam: https://github.com/elixir-image/image/blob/main/livebook/segment_anything.livemd https://elixirforum.com/t/running-facebooks-segmentation-model-using-ortex/63422/13

It also ortex.

mkopcins commented 2 months ago

Hi! Thank You for reaching out! Right now there is no memory bank export in onnx for the SAM2 model (it is said to be exported 'soon'), so the functionality would be the same as in SAM (video tracking would not work). We are not plannig on doing the export on our own at this time, but this might change in the future

andr-ec commented 1 month ago

@mkopcins

It looks like someone has now done it? Is that all that's needed? https://github.com/axinc-ai/segment-anything-2