sensevoice-onnx模型每次识别新的（之前没有见过的）输入语音都要加载10几秒，很影响推理效率，这个问题如何解决？ - Githubissues

FunAudioLLM / SenseVoice

Multilingual Voice Understanding Model

https://funaudiollm.github.io/

Other

3.49k stars 317 forks source link

sensevoice-onnx模型每次识别新的（之前没有见过的）输入语音都要加载10几秒，很影响推理效率，这个问题如何解决？ #141

Open Nicksooooo opened 1 month ago

Nicksooooo commented 1 month ago

Notice: In order to resolve issues more efficiently, please raise issue following the template. （注意：为了更加高效率解决您遇到的问题，请按照模板提问，补充细节）

🐛 Bug

To Reproduce

Steps to reproduce the behavior (always include the command you ran):

Run cmd '....'
See error

Code sample

Expected behavior

Environment

OS (e.g., Linux):
FunASR Version (e.g., 1.0.0):
ModelScope Version (e.g., 1.11.0):
PyTorch Version (e.g., 2.0.0):
How you installed funasr (pip, source):
Python version:
GPU (e.g., V100M32)
CUDA/cuDNN version (e.g., cuda11.7):
Docker version (e.g., funasr-runtime-sdk-cpu-0.4.1)
Any other relevant information:

Additional context

Nicksooooo commented 1 month ago

不只是启动模型的第一次输入语音，而是每次输入新的语音后，都要加载模型10几秒，很影响效率，如何解决