Start using ggml-alloc in SAM.cpp

YavorGIvanov / sam.cpp

MIT License

1.24k stars 52 forks source link

Closed YavorGIvanov closed 10 months ago

YavorGIvanov commented 10 months ago

Remove scratch buffers from image encoder
This change makes the whole inference a bit slower. I will additionally investigate why this happens and speed it up again.