KU-CVLAB / GaussianTalker

Official implementation of “GaussianTalker: Real-Time High-Fidelity Talking Head Synthesis with Audio-Driven 3D Gaussian Splatting” by Kyusun Cho, Joungbin Lee, Heeji Yoon, Yeobin Hong, Jaehoon Ko, Sangjun Ahn and Seungryong Kim
Other
189 stars 21 forks source link

Training not Converge #15

Closed ldz666666 closed 1 month ago

ldz666666 commented 1 month ago

Hi, thanks for your amazing work I have tried to reproduce the results, and i followed the data-processing procedure in readme.md. However, when i train on Obama dataset and my own dataset, the training loss seems not converge. here are my arguments and command

python train.py \
-s mnt/workspace/talking_head/GaussianTalker/data/ids/Obama \
--model_path /mnt/workspace/talking_head/GaussianTalker/output/Obama \
--configs arguments/64_dim_1_transformer.py

and the loss log seems super weird

截屏2024-05-15 11 28 20

the rendered image has no head, which is different from the original paper.

截屏2024-05-15 11 30 39 截屏2024-05-15 11 29 59

similar results were observed on my own data, any ideas ? The only difference between my env with yours is i use torch Version: 1.12.1 and cuda 11.3

ldz666666 commented 1 month ago

Figured it out, close

jimydavis commented 4 days ago

@ldz666666 how did you figure this out? thanks!