search

ARM-software / armnn

Arm NN ML Software. The code here is a read-only mirror of https://review.mlplatform.org/admin/repos/ml/armnn
https://developer.arm.com/products/processors/machine-learning/arm-nn
MIT License
1.14k stars 307 forks source link

How to use the profiling data to improve my inference #741

Closed zxros10 closed 6 months ago

zxros10 commented 7 months ago

I get profiling data with ExecuteNetwork -e. Now I need improve my model inference time. Is there practice example or document explain the data item in the json, and show how to improve profiling ? Thanks

TeresaARM commented 7 months ago

Hi, in the ExecuteNetwork command, what backend are you using "-c CpuRef" or -c "CpuAcc" or "-c GpuAcc" ?

zxros10 commented 7 months ago

Hi, in the ExecuteNetwork command, what backend are you using "-c CpuRef" or -c "CpuAcc" or "-c GpuAcc" ?

-c GpuAcc

tracyn-arm commented 7 months ago

This topic has come up before and here are some links in case it helps: