search

PaddlePaddle / FastDeploy

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
https://www.paddlepaddle.org.cn/fastdeploy
Apache License 2.0
3.01k stars 465 forks source link

部署llm是否使用paddlepaddle2.6也可以？和使用nightly的区别是什么？ #2527

Open Aganlengzi opened 1 month ago

Aganlengzi commented 1 month ago

看到 https://github.com/PaddlePaddle/FastDeploy/tree/develop/llm 想知道 部署llm是否使用paddlepaddle2.6也可以？和使用nightly的区别是什么？

Jiang-Jia-Jun commented 1 month ago

目前需要依赖nightly版本Paddle，对于大模型支持的部分优化还未正式发版