Describe the feature
Allow transfer learning using FAIR's Segment Anything Model (SAM), which is a ViT under the hood.
Motivation
SAM is an Apache-licensed instance segmentation model trained on over a billion images. They claim that is a foundation model for instance segmentation.
Describe the feature Allow transfer learning using FAIR's Segment Anything Model (SAM), which is a ViT under the hood.
Motivation
SAM is an Apache-licensed instance segmentation model trained on over a billion images. They claim that is a foundation model for instance segmentation.
Support for fine-tuning SAM is one of the most requested features in the downstream repository (see https://github.com/facebookresearch/segment-anything/issues/5).
Related resources Official website, with demo SAM weights from the official repo Semantic-SAM timm implementation (for classification)