ARM-software / ComputeLibrary

The Compute Library is a set of computer vision and machine learning functions optimised for both Arm CPUs and GPUs using SIMD technologies.
MIT License
2.75k stars 767 forks source link

Accuracy problem with F16 NEFullyConnectedLayer #1112

Open allnes opened 2 weeks ago

allnes commented 2 weeks ago

Hi,

I try to use NEFullyConnectedLayer FP16 in our OpenVINO CPU plugin and my tests is failed by accuracy.

Attach reproducer main.txt

Also attach data where it was reproduced: out_ref.txt out_acl.txt arg1.txt arg0.txt

And attach debug log from application: log.txt

I get accuracy degradation every 10-20 runnings of reproducer

allnes commented 2 weeks ago

Also attaching common info

Output of 'strings libarm_compute.so | grep arm_compute_version':

arm_compute_version.embed - f2eda6665c12d568e179f5b0e7a24ccdc0ac824d

Platform:

Mac Studio - Apple M2 Max

Operating System:

MacOS Sonoma - Version 14.5 (23F79)