eembc / mlmark

EEMBC's Machine-Learning Inference Benchmark targeted at edge devices.
https://www.eembc.org/mlmark
Other
45 stars 5 forks source link

ArmNN Target does not have SSDMobileNet support yet #9

Closed petertorelli closed 4 years ago

petertorelli commented 5 years ago

ArmNN only supports SSDMobileNet via the TFLite parser, not the TFParser. However, the SSDMobileNet mAP accuracy score is very low on ArmNN, compared to running the same model in native Python TensorFlowLite, which scores an expected value. There are two open issues on Arm's GitHub repo for ArmNN addressing this issue:

MLMark is awaiting resolution on these issues to update the target in a V1.0.x release.

petertorelli commented 5 years ago

This issue is resolved and is in the queue for release.

petertorelli commented 4 years ago

Resolved in 6ed21b5350f92af5faae931c2f01cb041c038fc6