Some loss of identity when using image kps for head positioning

instantX-research / InstantID

InstantID: Zero-shot Identity-Preserving Generation in Seconds 🔥

https://instantid.github.io/

Apache License 2.0

11.04k stars 805 forks source link

Open zhuangriyuan opened 6 months ago

zhuangriyuan commented 6 months ago

everything looks perfect until I use image for changing the head position. Having identity loss issue with image_kps on.

haofanwang commented 6 months ago

Could you pose your input and output here?

zhuangriyuan commented 6 months ago

Input: Screenshot 2024-04-15 132343 Output: ComfyUI_temp_vxhzg_00002_ Workflow: Screenshot 2024-04-15 132436

sanane-ulan commented 6 months ago

maybe you should try with dept map controlnet, openpose may interfere with instantid

zhuangriyuan commented 6 months ago

This is solved. After the generation, just need to upscale the face and apply the instantid again and then composite the face on top