search

ARM-software / android-nn-driver

MIT License
151 stars 60 forks source link

About FP16 and FP32 support in 18.08 #9

Closed uikilin100 closed 3 years ago

uikilin100 commented 5 years ago

In 18.08 release note, I could see FP16 support. What's the difference between this version and previous version of FP32 and FP16 support?

MatthewARM commented 5 years ago

Hi @uikilin100 in 18.08 we added experimental support for Model.relaxComputationFloat32toFloat16 as documented here: https://source.android.com/devices/interaction/neural-networks. That support was improved in 18.11. The last time I tested it, when enabled it still didn't pass all of the VTS tests, although we have been working actively with Google on this issue and I hope it will pass them soon.

MatthewARM commented 4 years ago

There will be further improvements to FP16 in the 19.11 release, for both Model.relaxComputationFloat32toFloat16 and direct usage of FP16 at the NNAPI level.

MatthewARM commented 3 years ago

Closing old issue, I hope this was helpful.