I'm trying to experiment with FaceID to keep the face consistency when doing Image2Image.
Basically I'm transforming this input image:
In this:
With an Image2Image fashion.
I'm trying to use IPAdapter FaceID to keep the face of the two person, and possibly to any given number of person in a photo.
When using only 1 IPAdapter this either make a merge of the two face or put the same face on the two persons.
I would like to be able to use the SEGS/BBOX from a face detector to generate the needed number of IPAdapter with the attention mask given by the SEGS/BBOX itself. However when I give batch/list of image and attention mask to IPAdapter this consider it as multiple instance of the same face and failed to give good result. When I enable unfold batch I get multiple model.
I'm trying to experiment with FaceID to keep the face consistency when doing Image2Image.
Basically I'm transforming this input image:
In this:
With an Image2Image fashion.
I'm trying to use IPAdapter FaceID to keep the face of the two person, and possibly to any given number of person in a photo.
When using only 1 IPAdapter this either make a merge of the two face or put the same face on the two persons. I would like to be able to use the SEGS/BBOX from a face detector to generate the needed number of IPAdapter with the attention mask given by the SEGS/BBOX itself. However when I give batch/list of image and attention mask to IPAdapter this consider it as multiple instance of the same face and failed to give good result. When I enable
unfold batch
I get multiple model.