search

YuliangXiu / ECON

[CVPR'23, Highlight] ECON: Explicit Clothed humans Optimized via Normal integration
https://xiuyuliang.cn/econ
Other
1.1k stars 105 forks source link

How to get human mask? #76

Closed luoshuiyue closed 1 year ago

luoshuiyue commented 1 year ago

Thanks for great work! I want to ask how to get the mask to obtain the human object in the image becasue I can see very great performance. Can you share with me what method you used in this paper?

YuliangXiu commented 1 year ago

rembg + Mask-RCNN, you could check process_image for more details.

luoshuiyue commented 1 year ago

thanks very much~

luoshuiyue commented 1 year ago

The original image with mask and background removed can be obtained by rembg. Why do we need Mask R CNN? And I observed that rembg's mask didn't turn out very well, but his original image with the background removed did but there was 艾also some extra background.

YuliangXiu commented 1 year ago

@luoshuiyue This is because rembg can only segment the foreground (fine-level), but what we really need is instance mask, so we also use Mask R-CNN for instance segmentation (coarse-level).