FunAudioLLM / CosyVoice

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
https://funaudiollm.github.io/
Apache License 2.0
6.01k stars 643 forks source link

是否有计划推出ONNX版本呢? #361

Open busishengui opened 1 month ago

busishengui commented 1 month ago

感觉CPU环境下的部署还是用ONNX或者MNN比较好, 在Roadmap中没有看到相应的计划, 未来是否可以呢?

aluminumbox commented 1 month ago

we have flow onnx model, but its gpu memory is not very stable. we also have llm libtorch model. but we don't plan to support every module with both onnx and libtorch, we only provide our production best practice

github-actions[bot] commented 3 weeks ago

This issue is stale because it has been open for 30 days with no activity.