The R50 image encoder is around 250MB in size. Was anyone here able to reduce the size drastically (to around 20MB)? I was thinking about doing knowledge distillation with a student model that has also ModifiedResnet architecture, but with fewer layers, filters and so on.
Hi,
The R50 image encoder is around 250MB in size. Was anyone here able to reduce the size drastically (to around 20MB)? I was thinking about doing knowledge distillation with a student model that has also ModifiedResnet architecture, but with fewer layers, filters and so on.
Any ideas and experiences are welcome :)