kijai / ComfyUI-segment-anything-2

ComfyUI nodes to use segment-anything-2
Apache License 2.0
546 stars 33 forks source link

Making SAM 2 run 2x faster #38

Open mvoodarla opened 3 weeks ago

mvoodarla commented 3 weeks ago

I was pretty amazed with SAM 2 when it came out given all the work I do with video. My company works a ton with it and we decided to take a crack at optimizing it, and we made it run 2x faster than the original pipeline!

Unlike LLMs, video models are notorious for incredibly inefficient file reading, storage, and writing which makes them much slower than they need to be.

We wrote a bit about our work here and thought we'd share with the community: https://www.sievedata.com/blog/meta-segment-anything-2-sam2-introduction