search

lllyasviel / ControlNet-v1-1-nightly

Nightly release of ControlNet 1.1
4.77k stars 376 forks source link

Segmentation annotation #22

Closed lbeltrame closed 1 year ago

lbeltrame commented 1 year ago

Is there a reference (paper, dataset, or anything) describing which color represents which concept? It is very useful to build masks manually for ControlNet.

dedoogong commented 1 year ago

I also wonder how to prepare annotation for training CNet segmentation. Your great guide showed custom dataset prepare regarding very simple case, but Segmentation must involve much more sophisticated processes. Can you guide me in more detail? for example, in your guide, you showed a example of circle images. If there is one circle and one star in the image, should I make segmentation GT map(is it needed?) like a circle filled with red color and blue color for the star and black color for the background.

Regarding segmentation class id map(e.g., in COCO format), I would set class id 0 for background, and 1 for the red circle and 2 for the blue star.

But are those class ids needed? Maybe no? and just I need to make prompt "vivid red circle and blue star with black background"?

Thank you!

lllyasviel commented 1 year ago

please refer to ade20k or coco's doc for questions related to seg colors