foivospar / Arc2Face

[ECCV 2024🔥] Arc2Face: A Foundation Model of Human Faces
https://arc2face.github.io/
MIT License
492 stars 32 forks source link

ID modifications but with text input #18

Open gebaltso opened 1 month ago

gebaltso commented 1 month ago

Hello and congrats on your great work! Just to clarify something: Is it possible to generate new images for the same id but providing a text input to guide the modification? Eg change hair color or pose etc. Thanks in advance.

foivospar commented 1 month ago

Hi! This model focuses exclusively on ID information and adapts the CLIP encoder accordingly. It is not designed to follow text promps. This could perhaps be achieved by combining our ID encoder with the original text encoder in some way, but in the current state we only support ID input (plus compatible conditions/adapters such as ControlNet).