[PyTorch] INT8 compute for inference

aws-neuron / aws-neuron-sdk

Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and integrated with your favorite AWS services

https://aws.amazon.com/machine-learning/neuron/

Other

444 stars 148 forks source link

[PyTorch] INT8 compute for inference #964

Open eshalakhotia opened 1 month ago