ToTheBeginning / PuLID

[NeurIPS 2024] Official code for PuLID: Pure and Lightning ID Customization via Contrastive Alignment
Apache License 2.0
2.7k stars 189 forks source link

πŸ€” PuLID doesn't support anime faces. πŸ“„PuLID warning: No faces detected #123

Open NeoAnthropocene opened 1 month ago

NeoAnthropocene commented 1 month ago

⚠ Just a heads-up for other creators like me who want to use the PuLID in their workflows: it doesn't support anime and animal faces. InstantID can detect at least the anime character faces.

❓ It seems like the EVA CLIP is already handling the face detection. I'm curious though if there's a way to make it even better at face detection like the InstantID method does.

image

πŸ”— Reference to the images that fails on PuLID face detection:

W5965YFPRFY8QX4T02NX9WP680 ComfyUI_37219_ download (3) dfba8ad2-7b90-4d49-add9-074bd40fd025

LongVu219 commented 3 weeks ago

in paper, the authors mentioned that they use some "human face recognition" network to extract the face's feature and embed original ID face's feature during training, so it is why it won't work for animal, object or anime. I wonder can we avoid this issue by using some "everything-recognition" network