ControlNet with SAM mask condition for image generation

IDEA-Research / Grounded-Segment-Anything

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

https://arxiv.org/abs/2401.14159

Apache License 2.0

14.68k stars 1.36k forks source link

ControlNet with SAM mask condition for image generation #24

Open gasvn opened 1 year ago

gasvn commented 1 year ago

Thanks for the great work. We have trained a ControlNet+StableDiffusion based on the SAM segmentation mask for fine-grained image generation. Replacing the standard inpainting model in your repo with this generation model may help the grounding DINO to have finer-grained image generation. We are trying now!!!! Looking for contributions and suggestions! https://github.com/sail-sg/EditAnything

rentainhe commented 1 year ago

Excellent work!