Torso Training

[schxnhxlz]

Hi there! Just saw the author added the ability to train the torso. What does this mean exactly? How does it improve the outcome?

[Ap1075]

@ZiqiaoPeng extending this question along the same lines. Does torso help with the double chin problem? + how do we use it for inference?

[zhouzhenneng]

I also want to know, how to solve the double chin problem, the torso training of ER-NERF can solve it

[zhouzhenneng]

@ZiqiaoPeng extending this question along the same lines. Does torso help with the double chin problem? + how do we use it for inference?@ZiqiaoPeng 以同样的方式扩展这个问题。躯干有助于解决双下巴问题吗？ + 我们如何使用它进行推理？

if same as ER-NERF torso training with Hubert, the training command is: python main.py /root/share/SyncTalk/train/data/xxx_head/ --workspace /root/share/SyncTalk/train/trial/xxx_head/ -0 --torso --head_ckpt /root/share/SyncTalk/train/trial/xxx_head/checkpoints/xxxxx.pth --iters 200000 --asr_model hubert

the inference command: python main.py /root/share/SyncTalk/train/data/xxx_head/ --workspace /root/share/SyncTalk/train/xxx_head/ -0 --torso --test --test_train --aud xxxx_hu.npy --smooth_path --asr_model hubert

[ZiqiaoPeng]

Please see the latest readme. Training torso can solve the problem of double chin.