PaddlePaddle / PaddleSlim

PaddleSlim is an open-source library for deep model compression and architecture search.
https://paddleslim.readthedocs.io/zh_CN/latest/
Apache License 2.0
1.54k stars 348 forks source link

咨询CNN+Transformer部署 #1749

Open ywfwyht opened 1 year ago

ywfwyht commented 1 year ago

您好,请问CNN+Transformer部署的思路过程是什么?有参考学习的代码吗?

ceci3 commented 4 months ago

可以试下FastDeploy的服务化部署,基于Triton Inference Server,集成FastDeploy Runtime(包括Paddle Inference、ONNX Runtime、TensorRT以及OpenVINO) https://github.com/PaddlePaddle/FastDeploy/blob/develop/serving/README_CN.md