AliaksandrSiarohin / first-order-model

This repository contains the source code for the paper First Order Motion Model for Image Animation
https://aliaksandrsiarohin.github.io/first-order-model-website/
MIT License
14.49k stars 3.21k forks source link

Problem on overlapping legs #223

Open CrossLee1 opened 4 years ago

CrossLee1 commented 4 years ago

Thanks for your awesome work~

I conducted experiments with my own data with your provided code, and find that when human legs in driving video overlap, the generated ones cannot determine which one should be at front, leading to a confused result.

image

Do you have some advices on solving this? Thanks~

AliaksandrSiarohin commented 4 years ago

It is not possible to understand for the network if you are using 2d keypoints, you should consider using 3d keypoints.