search

666DZY666 / micronet

micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/int8(ptq-calibration)、op-adapt(upsample)、dynamic_shape
MIT License
2.2k stars 478 forks source link

关于TensorRT #70

Open zhangfeixiang222 opened 3 years ago

zhangfeixiang222 commented 3 years ago

请问大佬，能描述一下目前TensorRT所完成了哪些工作吗，想了解一下与之相关的编程，可又不知从何下手，麻烦了。

666DZY666 commented 3 years ago

对于tensorrt，由于某些原因这里目前仅提供部分参考代码，完成的工作与学习资料可参考 相关资料-部署-tensorrt。 后续考虑加入可完整运行demo。