search

TemryL / ComfyUI-IDM-VTON

ComfyUI adaptation of IDM-VTON for virtual try-on.
GNU General Public License v3.0
254 stars 29 forks source link

Feature Request: Auto-Masking Node #53

Closed spenpal closed 2 weeks ago

spenpal commented 2 weeks ago

Is it possible to add a node for auto-masking (just like the one on the HF Hub demo)?

TemryL commented 2 weeks ago

Can you give more details? The current implementation already auto generate mask using SAM.

spenpal commented 2 weeks ago

From what I see on the documentation, you have give a prompt to SAM for it to generate a mask of the clothing.

On the IDM VTON Hugging Face demo, there is an option for "Generate Auto-Mask", which doesn't ask for any text input. It automatically masks the upper body portion of your human.

Correct me if I am wrong, but I don't see any option in the IDM VTON nodes to do the same functionality.

TemryL commented 2 weeks ago

Yes, you're right! However, I think the mask generation is out of IDM-VTON scope as there are many ways to generate masks and SAM is just one of them. From what I saw, the demo uses OpenPose detector as annotator and this seems to be already implemented in ControlNet nodes.

spenpal commented 2 weeks ago

Thanks for letting me know! I will check out the ControlNet nodes then.

TemryL commented 2 weeks ago

Let me know if you find what you are looking for! If yes, we could add it as a workflow example.