foivospar / Arc2Face

[ECCV 2024🔥] Arc2Face: A Foundation Model of Human Faces
https://arc2face.github.io/
MIT License
492 stars 32 forks source link

Is it possible to use human pose guided controlnet with Arc2Face to generate full body human image? #19

Closed silence-tang closed 2 weeks ago

silence-tang commented 2 weeks ago

Hi, this is a great work! May I ask is it possible to use human pose guided controlnet with Arc2Face to generate full body human image?

foivospar commented 2 weeks ago

Hi! Our model is trained on aligned and cropped face images, so adding a pre-trained ControlNet for human poses will most likely lead to inconsistencies. Extending it to full-body generation would probably require further training (the model, the ControlNet, or both) on body data.

silence-tang commented 2 weeks ago

Hi! Our model is trained on aligned and cropped face images, so adding a pre-trained ControlNet for human poses will most likely lead to inconsistencies. Extending it to full-body generation would probably require further training (the model, the ControlNet, or both) on body data.

Thanks for your answer!