search

pytorch / TensorRT

PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
https://pytorch.org/TensorRT
BSD 3-Clause "New" or "Revised" License
2.47k stars 340 forks source link

Support TensorRT Post Training Quantization #35

Closed narendasan closed 4 years ago

narendasan commented 4 years ago

We want to be able to use TensorRT's PTQ using a PyTorch dataset to support INT8 execution.

narendasan commented 4 years ago

Branch to track for PTQ implementation https://github.com/narendasan/TRTorch/tree/ptq