search

Tencent / TNN

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.
Other
4.41k stars 771 forks source link

stream operation #172

Open fangxuefei1989 opened 4 years ago

fangxuefei1989 commented 4 years ago

官方会考虑推出流式的算子实现吗？在实时的数据流中，可以收到一部分数据就处理，可以减少延迟，分摊运算量

谷歌在tensorflow的develop中有类似的实现：https://github.com/google-research/google-research/tree/master/kws_streaming

相关文献：Streaming keyword spotting on mobile devices

darrenyao87 commented 4 years ago

@fangxuefei1989 streaming 是个很不错的建议。 @neiltian-tencent 可以研究一下。另外为了增大throughpu，可以考虑double buffer甚至triple buffer

flytair commented 3 years ago

有进展了吗? 在实时音频相关方面非常需要streaming.