search

Tencent / TNN

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.
Other
4.4k stars 770 forks source link

量化模型转换工具支持非对称量化 #1465

Closed gttiankai closed 2 years ago

gttiankai commented 2 years ago
  1. 目前 PTQ 的工具已经支持了非对称量化，但是 QAR 量化模型转换工具并没有支持
gttiankai commented 2 years ago

已支持。