What is the function of the fixed prior value (i.e., prior_mu and prior_sigma) ?

kumar-shridhar / PyTorch-BayesianCNN

Bayesian Convolutional Neural Network with Variational Inference based on Bayes by Backprop in PyTorch.

MIT License

1.42k stars 323 forks source link

What is the function of the fixed prior value (i.e., prior_mu and prior_sigma) ? #63

Open kikyo97 opened 3 years ago

kikyo97 commented 3 years ago

Can the prior distribution be arbitrarily set? In the CNN, the weight can be optimized by the back propagate. However, in the BCNN, the W_mu and W_sigma always seem to be approximated the initial prior distribution?