Open busishengui opened 1 month ago
we have flow onnx model, but its gpu memory is not very stable. we also have llm libtorch model. but we don't plan to support every module with both onnx and libtorch, we only provide our production best practice
This issue is stale because it has been open for 30 days with no activity.
感觉CPU环境下的部署还是用ONNX或者MNN比较好, 在Roadmap中没有看到相应的计划, 未来是否可以呢?