search

andrerochow / fsrt

Official implementation of the CVPR 2024 paper "FSRT: Facial Scene Representation Transformer for Face Reenactment from Factorized Appearance, Head-pose, and Facial Expression Features"
https://andrerochow.github.io/fsrt
63 stars 3 forks source link

the identity is not equal to the source image #5

Open loboere opened 4 weeks ago

loboere commented 4 weeks ago

Is there a parameter to make the res video look more like the source image?

andrerochow commented 4 weeks ago

Is there a parameter to make the res video look more like the source image?

Hi, there is no parameter for this, but try animating with relative motion transfer, which should always ensure very good ID preservation.

ZerRui commented 2 weeks ago

https://github.com/andrerochow/fsrt/assets/34739958/ab119124-a06b-4747-8657-55cb0f4f986e

https://github.com/andrerochow/fsrt/assets/34739958/537d4d45-9d94-490f-8810-d40231a65921

https://github.com/andrerochow/fsrt/assets/34739958/84d97918-1b7d-4061-94a9-f5f11396d346

Thank you for your excellent work. I tested MEAD as the driving source, and the results were quite good when driving characters from the MEAD dataset. However, when I tested with personal images, both relative and absolute motion transfer showed significant inconsistencies compared to the source.