search

ARM-software / armnn

Arm NN ML Software. The code here is a read-only mirror of https://review.mlplatform.org/admin/repos/ml/armnn
https://developer.arm.com/products/processors/machine-learning/arm-nn
MIT License
1.14k stars 307 forks source link

Failed UnitTest for ArmComputeCl on Android #672

Closed xiaotongnii closed 1 year ago

xiaotongnii commented 1 year ago

version：armnn22.02 unitTest for gpu has 20 failed

I build arm compute library and armnn from Guide. why appear 20 faileld for test Compute_ArmComputeCl?

Please give some advices, more deatils:

azxcv:/data/local/tmp/gpu # ./UnitTests  --test-suite=Compute_ArmComputeCl
[doctest] doctest version is "2.4.6"
[doctest] run with "--help" for options

/home/xtn/src/backends/cl/test/ClLayerTests.cpp:506:
TEST SUITE: Compute_ArmComputeCl
TEST CASE:  IgnorePaddingSimpleAveragePooling2dNoPaddingUint8

/home/xtn/src/armnnTestUtils/UnitTests.hpp:55: ERROR: CHECK( result.m_Result ) is NOT correct!
  values: CHECK( false )
  logged: 2 different values at: [0,0,0,1] (3 != 4), [0,0,1,1] (3 != 4)

===============================================================================
/home/xtn/src/backends/cl/test/ClLayerTests.cpp:574:
TEST SUITE: Compute_ArmComputeCl
TEST CASE:  LargeTensorsAveragePooling2dUint8

/home/xtn/src/armnnTestUtils/UnitTests.hpp:55: ERROR: CHECK( result.m_Result ) is NOT correct!
  values: CHECK( false )
  logged: 300 different values at: [0,0,1,1] (0 != 1), [0,0,1,11] (0 != 1), [0,0,2,1] (0 != 1), ... (and 297 other differences)

===============================================================================
/home/xtn/src/backends/cl/test/ClLayerTests.cpp:621:
TEST SUITE: Compute_ArmComputeCl
TEST CASE:  AddBroadcastUint8

/home/xtn/src/armnnTestUtils/UnitTests.hpp:55: ERROR: CHECK( result.m_Result ) is NOT correct!
  values: CHECK( false )
  logged: 6 different values at: [0,0,1,0] (3 != 2), [0,0,1,2] (4 != 3), [0,1,1,0] (4 != 3), ... (and 3 other differences)

===============================================================================
...
/home/xtn/src/backends/cl/test/ClLayerTests.cpp:2002:
TEST SUITE: Compute_ArmComputeCl
TEST CASE:  CompareSoftmaxUint8

/home/xtn/src/armnnTestUtils/UnitTests.hpp:55: ERROR: CHECK( result.m_Result ) is NOT correct!
  values: CHECK( false )
  logged: 314 different values at: [0,0] (10 != 11), [0,1] (12 != 13), [0,2] (9 != 10), ... (and 311 other differences)

===============================================================================
/home/xtn/src/backends/cl/test/ClLayerTests.cpp:2032:
TEST SUITE: Compute_ArmComputeCl
TEST CASE:  CompareAveragePooling2dWithRefUint8

/home/xtn/src/armnnTestUtils/UnitTests.hpp:55: ERROR: CHECK( result.m_Result ) is NOT correct!
  values: CHECK( false )
  logged: 248 different values at: [0,0,0,1] (131 != 132), [0,0,0,5] (124 != 125), [0,0,0,6] (135 != 136), ... (and 245 other differences)

===============================================================================
[doctest] test cases:  763 |  743 passed | 20 failed | 4192 skipped
[doctest] assertions: 1528 | 1508 passed | 20 failed |
[doctest] Status: FAILURE!
ArmRyan commented 1 year ago

Hi @Shelton-N ,

What devices are you running these on? What Os are you using? What toolchain is being used? Are you also using ACL 22.02 with ArmNN 22.02?

keidav01 commented 1 year ago

Hi @Shelton-N ,

Could you provide more information please? Otherwise I will close this issue at on Friday September 23rd