I encountered some difficulties in the process of reproducing the paper----the model cannot be loaded and cannot run through the inference process

sstzal / DiffTalk

[CVPR2023] The implementation for "DiffTalk: Crafting Diffusion Models for Generalized Audio-Driven Portraits Animation"

419 stars 41 forks source link

I encountered some difficulties in the process of reproducing the paper----the model cannot be loaded and cannot run through the inference process #13

Open jianmanLin opened 12 months ago

jianmanLin commented 12 months ago

hello friends Has anyone successfully reproduced this paper? I encountered some difficulties in the process of reproducing the paper, and I directly used the model parameters provided by the author. When strict is set to True in m, u = model.load_state_dict(sd, strict=True), the model cannot be loaded and cannot run through the reasoning process. I also trained it myself and found that the saved model reached 8.2G. Does anyone have the same problem, hope to get your help, thank you