add Segment anything

[jinwonkim93]

This PR is to add segment anything. SamDetector returns segmented map like controlnet-segment-anything.

Usage

from controlnet_aux import SamDetector
from PIL import Image

sam = SamDetector.from_pretrained("./", model_type="vit_b", filename="sam_vit_b_01ec64.pth")
img = Image.open("image.png")
sam(img)

model_type : vit_h, vit_l, vit_b

Limitation

• There is no weight on huggingface hub, so you should download weight from https://github.com/facebookresearch/segment-anything. But download from hub is supported.

[patrickvonplaten]

Works for me!