k2-fsa / sherpa

Speech-to-text server framework with next-gen Kaldi
https://k2-fsa.github.io/sherpa
Apache License 2.0
515 stars 103 forks source link

Simplify zipformer model repo in Triton #393

Closed wd929 closed 1 year ago

wd929 commented 1 year ago

Hi all,

This PR is to support using 3 onnx models for Zipformer in Triton, which simplifies the previous model_repo (which has 2 more onnx models). We can directly use export-onnx.py in icefall without any modifications. Also add automatic script to download pre-trained models, call export-onnx.py, generate model configurations and finally deploy the model in triton server.

Thanks, Wen

csukuangfj commented 1 year ago

Thanks! Is it ready to merge?

wd929 commented 1 year ago

Yes. Thank you!

csukuangfj commented 1 year ago

Thanks!