search

XiaoMi / mobile-ai-bench

Benchmarking Neural Network Inference on Mobile Devices
Apache License 2.0
363 stars 58 forks source link

Has any benchmark result for NNlib #24

Closed ysh329 closed 5 years ago

ysh329 commented 5 years ago

Hi, all!

Has any benchmark result for nnlib with mace, ncnn or etc? Besides, I wanna ask which performance is better between nnlib and SNPE?

Thanks in advance.

liyinhgqw commented 5 years ago

I don't think ncnn has support nnlib yet. For Mace and SNPE, they have almost the same performance. For model prepare time, Mace is better.

ysh329 commented 5 years ago

Excuse, I'm little confused, what's the nnlib? Is an Android common API for deep learning? Does it have raw implementation?

lee-bin commented 5 years ago

It's a library which can be found in https://developer.qualcomm.com/software/hexagon-dsp-sdk as hexagon nn, you can get all the information from Hexagon DSP SDK. So basically, it's for Hexagon DSP and is usually integrated with deep learning inference engines, e.g., SNPE, MACE. The benchmark results of DSP of MACE and SNPE all use nnlib.

ysh329 commented 5 years ago

Greatly thank you, bin.

Besides, I wanna ask what's the relationship between DSP/AIP runtimes of SNPE and Hexagon NN. Of course, I wanna know the performance between them. Any idea?

lee-bin commented 5 years ago

DSP of SNPE is based on Hexagon NN, so its performance is also based on Hexagon NN.

ysh329 commented 5 years ago

Greatly and always Thank you ~~ bin