search

yuenshome / yuenshome.github.io

https://yuenshome.github.io
MIT License
84 stars 15 forks source link

MNN: A UNIVERSAL AND EFFICIENT INFERENCE ENGINE #100

Open ysh329 opened 4 years ago

ysh329 commented 4 years ago

Mobile Neural Network (MNN), a universal and efficient inference engine tailored to mobile applications. In this paper, the contributions of MNN include:

  1. presenting a mechanism called pre-inference that manages to conduct runtime optimization;
  2. delivering thorough kernel optimization on operators to achieve optimal computation performance;
  3. introducing backend abstraction module which enables hybrid scheduling and keeps the engine lightweight. Extensive benchmark experiments demonstrate that MNN performs favorably against other popular lightweight deep learning frameworks.

MNN is available to public at: https://github.com/alibaba/MNN

ysh329 commented 4 years ago

MNN: A Universal and Efficient Inference Engine https://proceedings.mlsys.org/static/paper_files/mlsys/2020/7-Paper.pdf