FunAudioLLM / SenseVoice

Multilingual Voice Understanding Model
https://funaudiollm.github.io/
Other
2.61k stars 249 forks source link

"AssertionError: iic/SenseVoiceSmall is not registered" while deploying it on server via fastapi #105

Closed abysee closed 3 weeks ago

abysee commented 3 weeks ago

Hi, I encountered a problem when deploying SenseVoice on server via fastapi, it raised "AssertionError: iic/SenseVoiceSmall is not registered".

I was following exactlly the instruction:

export SENSEVOICE_DEVICE=cuda:0
fastapi run --port 

And I've looked up at #https://github.com/FunAudioLLM/SenseVoice/issues/52 and tried to add the following into api.py but it doesn't work.

    trust_remote_code=True,
    remote_code="./model.py",

Could you please give me some suggestions?

abysee commented 3 weeks ago

I just fixed it myself, it seemed to be related to modelscope when loading the model. I upgraded the modelscope module to the newest version via pip isntall -U modelscope and then redid the whole process and it worked.