ali-vilab / dreamtalk

Official implementations for paper: DreamTalk: When Expressive Talking Head Generation Meets Diffusion Probabilistic Models
https://dreamtalk-project.github.io/
MIT License
1.59k stars 193 forks source link

Some weights of the model checkpoint at jonatasgrosman/wav2vec2-large-xlsr-53-english were not used when initializing Wav2Vec2Model: ['lm_head.weight', 'lm_head.bias'] #31

Open Yazdi9 opened 7 months ago

Yazdi9 commented 7 months ago

Guessed Channel Layout for Input Stream #0.0 : mono Input #0, wav, from 'data/audio/German4.wav': Metadata: encoder : Lavf58.29.100 Duration: 00:00:06.84, bitrate: 256 kb/s Stream #0:0: Audio: pcm_s16le ([1][0][0][0] / 0x0001), 16000 Hz, mono, s16, 256 kb/s Stream mapping: Stream #0:0 -> #0:0 (pcm_s16le (native) -> pcm_s16le (native)) Press [q] to stop, [?] for help -async is forwarded to lavfi similarly to -af aresample=async=1:min_hard_comp=0.100000:first_pts=0. Output #0, wav, to 'tmp/codeformer_sr_english@M030_front_neutral_level1_001@male_face/codeformer_sr_english@M030_front_neutral_level1_001@male_face_16K.wav': Metadata: ISFT : Lavf58.76.100 Stream #0:0: Audio: pcm_s16le ([1][0][0][0] / 0x0001), 16000 Hz, mono, s16, 256 kb/s Metadata: encoder : Lavc58.134.100 pcm_s16le size= 214kB time=00:00:06.78 bitrate= 258.2kbits/s speed= 192x
video:0kB audio:214kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.035636% Some weights of the model checkpoint at jonatasgrosman/wav2vec2-large-xlsr-53-english were not used when initializing Wav2Vec2Model: ['lm_head.weight', 'lm_head.bias']

developer-JingHSY commented 7 months ago

I met the same question。

YifengMa9 commented 7 months ago

The warning message "Some weights ... Wav2Vec2Model: ['lm_head.weight', 'lm_head.bias']" is not an issue and does not indicate a program error. Apologies for any confusion caused by not removing this message.

gpfworld commented 3 months ago

The warning message "Some weights ... Wav2Vec2Model: ['lm_head.weight', 'lm_head.bias']" is not an issue and does not indicate a program error. Apologies for any confusion caused by not removing this message.

The warning message "Some weights ... Wav2Vec2Model: ['lm_head.weight', 'lm_head.bias']" is not an issue and does not indicate a program error. Apologies for any confusion caused by not removing this message.

The warning message "Some weights ... Wav2Vec2Model: ['lm_head.weight', 'lm_head.bias']" is not an issue and does not indicate a program error. Apologies for any confusion caused by not removing this message.

Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'data/audio/acknowledgement_english.m4a': Metadata: major_brand : M4A minor_version : 0 compatible_brands: M4A isommp42 creation_time : 2023-12-20 14:25:20 iTunSMPB : 00000000 00000840 00000000 00000000000C23C0 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 Duration: 00:00:16.57, start: 0.000000, bitrate: 246 kb/s Stream #0:0(und): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, mono, fltp, 244 kb/s (default) Metadata: creation_time : 2023-12-20 14:25:20 handler_name : Core Media Audio -async is forwarded to lavfi similarly to -af aresample=async=1:min_hard_comp=0.100000:first_pts=0. Output #0, wav, to 'tmp/acknowledgement_english@M030_front_neutral_level1_001@male_face/acknowledgement_english@M030_front_neutral_level1_001@male_face_16K.wav': Metadata: major_brand : M4A minor_version : 0 compatible_brands: M4A isommp42 iTunSMPB : 00000000 00000840 00000000 00000000000C23C0 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 ISFT : Lavf57.25.100 Stream #0:0(und): Audio: pcm_s16le ([1][0][0][0] / 0x0001), 16000 Hz, mono, s16, 256 kb/s (default) Metadata: creation_time : 2023-12-20 14:25:20 handler_name : Core Media Audio encoder : Lavc57.24.102 pcm_s16le Stream mapping: Stream #0:0 -> #0:0 (aac (native) -> pcm_s16le (native)) Press [q] to stop, [?] for help size= 519kB time=00:00:16.61 bitrate= 256.0kbits/s speed=64.5x video:0kB audio:519kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.014667% Some weights of the model checkpoint at jonatasgrosman/wav2vec2-large-xlsr-53-english were not used when initializing Wav2Vec2Model: ['lm_head.bias', 'lm_head.weight']

I met the same question