search

PaddlePaddle / FastDeploy

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
https://www.paddlepaddle.org.cn/fastdeploy
Apache License 2.0
2.98k stars 465 forks source link

DLA 量化测速 #1569

Open ShawnXsw opened 1 year ago

ShawnXsw commented 1 year ago

环境 【FastDeploy版本】： 如fastdeploy-linux-gpu-1.0.3 【系统平台】: jetpack 5.1 【硬件】： Orin AGX， CUDA 11.4 CUDNN 8.4

INT8模型推理未采用DLA加速，同时未找到启动DLA接口

ShawnXsw commented 1 year ago

@wang-xinyu 请问这个有接口吗？

ShawnXsw commented 1 year ago

@wang-xinyu 请问这个有接口吗？

@DefTruth