search

pytorch / TensorRT

PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
https://pytorch.org/TensorRT
BSD 3-Clause "New" or "Revised" License
2.5k stars 344 forks source link

❓ [Question] is there in8 quantization support with python? #682

Closed yokosyun closed 2 years ago

yokosyun commented 2 years ago

❓ Question

I did quantize to FP16 by using python. but i didn't find way to do that with int8 let me know if there is support

yokosyun commented 2 years ago

sorry I found a doc to do that https://nvidia.github.io/TRTorch/tutorials/ptq.html