This PR is to support using 3 onnx models for Zipformer in Triton, which simplifies the previous model_repo (which has 2 more onnx models).
We can directly use export-onnx.py in icefall without any modifications.
Also add automatic script to download pre-trained models, call export-onnx.py, generate model configurations and finally deploy the model in triton server.
Hi all,
This PR is to support using 3 onnx models for Zipformer in Triton, which simplifies the previous model_repo (which has 2 more onnx models). We can directly use export-onnx.py in icefall without any modifications. Also add automatic script to download pre-trained models, call export-onnx.py, generate model configurations and finally deploy the model in triton server.
Thanks, Wen