piEsposito / blitz-bayesian-deep-learning

A simple and extensible library to create Bayesian Neural Network layers on PyTorch.
GNU General Public License v3.0
918 stars 107 forks source link

Questions regarding weight modeling #91

Closed Philippe-Drolet closed 2 years ago

Philippe-Drolet commented 3 years ago

Hello,

Thanks for the library, it is quite useful!

I have two questions, first: In the constructor of linear_bayesian_layer.py, where do the default values of the parameters come from? image

Second: How am I to understand the distributions from which we sample our weights and biases? they have simply a mu and rho but surely they cannot all be regular normal distributions, they are probably more akin to mixture models , no?.Should I want to model the distributions, how should I go at it? Thanks