PaddlePaddle / FastDeploy

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
https://www.paddlepaddle.org.cn/fastdeploy
Apache License 2.0
2.94k stars 456 forks source link

什么时候支持SSE指令集CPU #1103

Closed yzm0080 closed 2 months ago

yzm0080 commented 1 year ago

支持SSE指令集CPU,在一些低功耗CPU上使用

工控机上多采用低功耗的cpu,例如 Intel Atom系列,它不支持AVX 及 FMA指令集,只支持SSE。 在windows开发机上编译PaddleOCR工程示例,正常运行,部署到工控机的windows10上却无法运行,用cpu-z工具查看cpu信息时才注意到是 Intel Atom x5-Z8350,不支持AVX 及 FMA指令集。

TensorFlow Lite好像是支持SSE指令集cpu。

ZeyuChen commented 1 year ago

@yzm0080 https://github.com/PaddlePaddle/FastDeploy

关于CPU的部署可以关注下FastDeploy这个产品,未来这类需求会通过FastDeploy来满足,欢迎提相关Issues。

jiangjiajun commented 1 year ago

FastDeploy里面集成了ONNX Runtime后端,可以试用下哈

nefusmzj commented 1 year ago

您的意思是,FastDeploy配置使用ONNX Runtime的后端,可以在不支持AVX的CPU上运行吗?