PaddlePaddle / FastDeploy

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
https://www.paddlepaddle.org.cn/fastdeploy
Apache License 2.0
2.81k stars 441 forks source link

升级ppdiffusers 使用paddle_tensorrt后端报错 #2330

Open co63oc opened 6 months ago

co63oc commented 6 months ago

环境

问题日志及出现问题的操作流程

https://github.com/PaddlePaddle/PaddleMIX/pull/322#issuecomment-1862094402 升级PaddleMIX代码 代码分支 https://github.com/co63oc/PaddleMIX/tree/attention

使用这里的脚本,参考这里的文档 顺利跑出结果

使用paddle后端可以正常运行 python infer.py --model_dir static_model/stable-diffusion-v1-5 --scheduler "preconfig-euler-ancestral" --backend paddle --device gpu --task_name text2img 使用paddle_tensorrt后端报错 python infer.py --model_dir static_model/stable-diffusion-v1-5 --scheduler "preconfig-euler-ancestral" --backend paddle_tensorrt --device gpu --task_name text2img 错误堆栈为C++错误 创建 CustomSkipLayerNormPluginDynamic 失败 image

rainyfly commented 5 months ago

收到您的反馈,可能是paddle tensorrt对这个的支持还存在点问题,后续找人看下