search

yerfor / GeneFacePlusPlus

GeneFace++: Generalized and Stable Real-Time 3D Talking Face Generation; Official Code
MIT License
1.49k stars 218 forks source link

Full/half body Torso #93

Open chenkaiustc opened 7 months ago

chenkaiustc commented 7 months ago

Is this repo work for full or half body torso? I use default setting and modify the supported input size in the code to train a half body model. But it works pretty bad. Any way to solve it? Thanks!

WuCongfeng commented 7 months ago

You can use the method of training the head separately, and then apply it to the half or whole body. Currently, the test results are still good, and training the body alone will still result in a lack of fusion between the body and the hair. This is my case: https://www.bilibili.com/video/BV1E1421f7zY/?spm_id_from=333.999.0.0

chenkaiustc commented 6 months ago

You can use the method of training the head separately, and then apply it to the half or whole body. Currently, the test results are still good, and training the body alone will still result in a lack of fusion between the body and the hair. This is my case: https://www.bilibili.com/video/BV1E1421f7zY/?spm_id_from=333.999.0.0

Thanks for your kind reply. Can you give me some hints on applying head training method to half or whole body? Does that mean change the head segmentation map to whole body segmentation?