how to distill from largeVit to tinyVit

ChaoningZhang / MobileSAM

This is the official code for MobileSAM project that makes SAM lightweight for mobile applications and beyond!

Apache License 2.0

4.86k stars 505 forks source link

Open YuerGu opened 1 year ago

YuerGu commented 1 year ago

I am interested in your distillation work, and i want to adapt into my work, so how you distill from largeVit to tinyVit? can you give me an example？