ARM-software / ComputeLibrary

The Compute Library is a set of computer vision and machine learning functions optimised for both Arm CPUs and GPUs using SIMD technologies.
MIT License
2.75k stars 767 forks source link

ACL performance gap between baremetal and linux. #1065

Closed goldhandsome closed 10 months ago

goldhandsome commented 11 months ago

Hello, Now, we are using acl library to run cnn model on bare metal device. We test the same model on linux and bare-metal. We found it has about 5× latency.

 environment: linux + a57 vs bare metal + a53

Is there having some differences between bare metal and linux?

morgolock commented 11 months ago

Hi @goldhandsome

Could you please share more details about the model you're running? Is it a well known model like mobilenet?

Can you please share the performance figures you observe?

How do you run the model on Linux? How do you run the model on bare metal? Do you use one of our graph examples? if so what command you use to execute the model?