search

pkhungurn / talking-head-anime-demo

Demo for the "Talking Head Anime from a Single Image."
MIT License
1.99k stars 286 forks source link

Shoulder Movements #21

Closed t-qureshi closed 3 years ago

t-qureshi commented 3 years ago

Hye ,@dragonmeteor @sheiun, First of All thanks for this great work. Its results are really good. I just want to move the shoulder as well . Kindly guide me how i can achieve this thing.

dragonmeteor commented 3 years ago

Unfortunately, the current model cannot move shoulders because it was not trained to do so. You'd have to create a new model or use other types of image processing techniques.

If it were me, I would go with the "new model" path and create a new model that takes a larger image contains the whole upper body. I would then generate a new dataset that contains upper body movement. (I'm not sure how to do this because I don't yet know how to control shoulders.) Then I would train the new model on the new dataset and iterate on the architecture.

For other image processing techniques, I have no idea. You have to do your own research.