kumar-shridhar / PyTorch-BayesianCNN

Bayesian Convolutional Neural Network with Variational Inference based on Bayes by Backprop in PyTorch.
MIT License
1.43k stars 324 forks source link

GPU Memory usage #70

Open Neronjust2017 opened 2 years ago

Neronjust2017 commented 2 years ago

Hi, thanks for your great work! I wonder if the GPU memory usage will grow linearly with the parameter "num_ens" in the code? If I increase "num_ens", there will be an OOM error definitely, right? Maybe it's better to implement the MC sampling process in the "forward" function of the "BBBConv" and "BBBLinear" to avoid this issue.