Gy920 / segment-anything-2-real-time

Run Segment Anything Model 2 on a live video stream
Apache License 2.0
168 stars 31 forks source link

Making SAM 2 run 2x faster #6

Closed mvoodarla closed 2 months ago

mvoodarla commented 2 months ago

I was pretty amazed with SAM 2 when it came out given all the work I do with video. My company works a ton with it and we decided to take a crack at optimizing it, and we made it run 2x faster than the original pipeline!

Unlike LLMs, video models are notorious for incredibly inefficient file reading, storage, and writing which makes them much slower than they need to be.

We wrote a bit about our work here and thought we'd share with the community: https://www.sievedata.com/blog/meta-segment-anything-2-sam2-introduction