search

jdh-algo / JoyHallo

JoyHallo: Digital human model for Mandarin
https://jdh-algo.github.io/JoyHallo/
MIT License
369 stars 35 forks source link

inference script causes training to begin #3

Closed linuxandchill closed 2 months ago

linuxandchill commented 2 months ago

when running sh joyhallo-infer.sh it appears that a training process is kicked off

09/16/2024 19:31:39 - ERROR - root - Failed to execute the training process: Error(s) in loading state_dict for Net:

DBDXSS commented 2 months ago

This is not referring to the training process, but an error in thecheckpoint loading process. Which checkpoints are you using, ch-hallo or joyhallo?

linuxandchill commented 2 months ago

This is not referring to the training process, but an error in thecheckpoint loading process. Which checkpoints are you using, ch-hallo or joyhallo?

using joyhallo, downloaded from huggingface: wget https://huggingface.co/spaces/jdh-algo/JoyHallo-v1/resolve/main/pretrained_models/joyhallo/net.pth

DBDXSS commented 2 months ago

This is not referring to the training process, but an error in thecheckpoint loading process. Which checkpoints are you using, ch-hallo or joyhallo?

using joyhallo, downloaded from huggingface: wget https://huggingface.co/spaces/jdh-algo/JoyHallo-v1/resolve/main/pretrained_models/joyhallo/net.pth

Can you provide the complete log?

linuxandchill commented 2 months ago

i have been able to resolve this, seems that i didn't have the wav2vec model

am having another issues with CUDA but i will try to resolve. maybe a Docker container would help to include ?

DBDXSS commented 2 months ago

Glad to hear that. Thanks for your suggestion, we will consider adding the Docker container.