search

Tencent / TNN

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.
Other
4.38k stars 766 forks source link

有TNN进行int8量化的说明文档吗？ #1075

Closed APeiZou closed 3 years ago

APeiZou commented 3 years ago

Is your feature request related to a problem? Please describe. A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like A clear and concise description of what you want to happen.

Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.

Additional context Add any other context or screenshots about the feature request here.

APeiZou commented 3 years ago

@nihui @seanxcwang有TNN进行int8量化的说明文档吗？

seanxcwang commented 3 years ago

一个简单的PTQ操作文档 https://github.com/Tencent/TNN/blob/master/doc/en/user/quantization_en.md

Liujingxiu23 commented 2 years ago

@seanxcwang 请问非图像输入，且为多输入，输入有input_name1(int序列), input_name2(1个float值)， input_name3(一个int值)，请问该如何准备 quantization_cmd 中input_path中的文件？ 有没有样例，或者说明，或者举例一下，要不实在难以操作呀

xing-shuai commented 2 years ago

@Liujingxiu23 看源码，是不支持多输入量化好像