modelscope / FunASR

A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Recognition, Voice Activity Detection, Text Post-processing etc.
https://www.funasr.com
Other
6.98k stars 744 forks source link

About Seaco-paraformer bias_embed weights #1320

Closed locasxe closed 9 months ago

locasxe commented 9 months ago

❓ Questions and Help

I found that: in function load_pretrained_model: logging.debug("Loaded src_state keys: {}".format(src_state.keys())) logging.debug("Loaded dst_state keys: {}".format(dst_state.keys())) dst_state.update(src_state) obj.load_state_dict(dst_state, strict=True) if dst_state.update(src_state) is removed: obj.load_state_dict(src_state, strict=True) ERROR====》Missing key(s) in state_dict: “bias_embed.weight”

What is your question?

So, indeed, bias_embed.weight is missing in src_state, is this normal? And why?

What have you tried?

What's your environment?

R1ckShi commented 9 months ago

bias_embed is initialized but not used, hotwords are embedded with the asr decoder embedding