How bayesian network be used in quantization?

IntelLabs / bayesian-torch

A library for Bayesian neural network layers and uncertainty estimation in Deep Learning extending the core of PyTorch

BSD 3-Clause "New" or "Revised" License

483 stars 67 forks source link

How bayesian network be used in quantization? #5

Closed LeopoldACC closed 11 months ago

LeopoldACC commented 2 years ago

@peteriz @jpablomch @ranganathkrishnan we can get the $\mu$ and $\sigma$ of each weight ,so how it can be used to quantization which mapping the $w{float32 }$ into $w{int8}$

ranganathkrishnan commented 2 years ago

@LeopoldACC Quantization of variational parameters in the Bayesian layers is not supported currently.

ranganathkrishnan commented 11 months ago

@LeopoldACC Quantization of Bayesian deep neural network models are supported in the latest release v0.4.0. Please check out!