search

modelscope / FunASR

A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Recognition, Voice Activity Detection, Text Post-processing etc.
https://www.funasr.com
Other
7.02k stars 747 forks source link

How to deploy the streaming asr paraformer model? #720

Closed yangb05 closed 1 year ago

yangb05 commented 1 year ago

Hi, I tried to deploy the streaming asr paraformer model published on Modelscope with triton according to the README, but the provided model is named 'model.pb' instead of 'model.onnx'. The questions are:

  1. Is it possible to deploy the streaming paraformer with triton according to the README?
  2. How can I deploy the 'model.pb'?
LauraGPT commented 1 year ago

Yeah, the streaming asr paraformer model is not supported for deployment now. We are working at it this month. Please wait for it.

LauraGPT commented 1 year ago

We have released the deployment of the streaming asr model(Paraformer-online). Please ref to the docs