wty-ustc / HairCLIPv2

[ICCV 2023] HairCLIPv2: Unifying Hair Editing via Proxy Feature Blending
160 stars 17 forks source link

Extension to videos #11

Open nsarafianos opened 3 months ago

nsarafianos commented 3 months ago

Thanks a lot for putting this code up. The results on images look super good.

I have a question on getting this to work on video inputs where they edited hair is temporally consistent. If one moves the global code out of the for loop then the hair is consistent but static (does not follow the head motion since the keypoints are not optimized per frame in the latent global code) while if you keep the global latent code inside the for loop then the hair is changing between consecutive frames (text prompt is the same but optimization yields different results).

Do you have any insights or pointers on things I might have missed.

Thanks a lot!

seetimee commented 3 months ago

same question

MtYCNN commented 2 weeks ago

same question