search

ARM-software / armnn

Arm NN ML Software. The code here is a read-only mirror of https://review.mlplatform.org/admin/repos/ml/armnn
https://developer.arm.com/products/processors/machine-learning/arm-nn
MIT License
1.14k stars 307 forks source link

Error message while executing inference with NPU #674

Closed Rahn80643 closed 1 year ago

Rahn80643 commented 1 year ago

Hi,

We adopted two methods to compile our ArmNN inference code, the first method is compiling via Makefile and the other one is via CMakeLists. We logged the execution time from these compiling approaches and compared the results based on the same inference code, test image, and test model, and the logs are shown in the attachment. logs.zip

However, the execution results contain the following error message:

Error: An error occurred attempting to execute a workload: An error has occurred waiting for the inference of a pre-compiled object: Timed out while waiting for the inference to complete

Why does the execution of NPU produce the error above? Since it takes time to reset the status of NPU, how to resolve the issue?

Best Regards

xiaotongnii commented 1 year ago

@Rahn80643 you mean erro happend due to different builds, can show the Makefile which generated from CMake.

MikeJKelly commented 1 year ago

Hi @Rahn80643

I haven't seen that error message before, from looking at the EthosN code it occurs when the NPU returns a WaitErrorCode::Timeout but I do not know the situations why that might occur. I think you would be better off asking that question on the NPU GitHub:

https://github.com/ARM-software/ethos-n-driver-stack

The engineers there would be better able to answer this one.

Best regards, Mike

Rahn80643 commented 1 year ago

@Shelton-N,

the attachment is the Makefile generated from CMake

Best Regards, Rahn Makefile_from_CMakeLists.txt

FrancisMurtagh-arm commented 1 year ago

Closing as this issue would be best asked on NPU Github: https://github.com/ARM-software/ethos-n-driver-stack

Regards, Francis.