ToTheBeginning / PuLID

Official code for PuLID: Pure and Lightning ID Customization via Contrastive Alignment
Apache License 2.0
1.04k stars 62 forks source link

face collapse #46

Open hangnima opened 2 months ago

hangnima commented 2 months ago

Thank you for the open source code for learning. I have a question to ask. I found that the consistency of the faces generated in close range (when the characters are close to the camera) is very high, but in long range (when the characters are far from the camera), the faces are prone to collapse

AlChico85 commented 2 months ago

What generator do you use ? A1111 ? ComfyUi ? What what do you mean by "collapse" ? Are the Faces like burned-in with funny colors and so on ?

I can only speak of A1111, i noticed this also if the face is further away, than it looks like a Zombie. Solution: you can lower the strength of the "control weight" in ControlNet (0.6 works for me if the face is further away - you may want to go even lower, just play around with the value) and also in some cases start the use of ControlNet by 15% or 20% (Starting Control Step at 0.15 or 0.2) - so this fixed it for me.

hangnima commented 2 months ago

For example, the eyes in this picture. Some cases may have distorted facial features in some distant portraits image

AlChico85 commented 2 months ago

You can easily fix this with adetailer