How bayesian network be used in quantization?

IntelLabs / bayesian-torch

A library for Bayesian neural network layers and uncertainty estimation in Deep Learning extending the core of PyTorch

BSD 3-Clause "New" or "Revised" License

547 stars 73 forks source link

How bayesian network be used in quantization? #5

Closed LeopoldACC closed 1 year ago

LeopoldACC commented 3 years ago

@peteriz @jpablomch @ranganathkrishnan we can get the $\mu$ and $\sigma$ of each weight ,so how it can be used to quantization which mapping the $w{float32 }$ into $w{int8}$

ranganathkrishnan commented 3 years ago

@LeopoldACC Quantization of variational parameters in the Bayesian layers is not supported currently.

ranganathkrishnan commented 1 year ago

@LeopoldACC Quantization of Bayesian deep neural network models are supported in the latest release v0.4.0. Please check out!