[PyTorch] INT8 for inference (weights only)

aws-neuron / aws-neuron-sdk

Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and integrated with your favorite AWS services

https://aws.amazon.com/machine-learning/neuron/

Other

465 stars 154 forks source link

[PyTorch] INT8 for inference (weights only) #971

Open eshalakhotia opened 3 months ago