search

kyle-dorman / bayesian-neural-network-blogpost

Building a Bayesian deep learning classifier
https://medium.com/towards-data-science/building-a-bayesian-deep-learning-classifier-ece1845bc09
481 stars 105 forks source link

about BNN in NLP #9

Open ShellingFord221 opened 4 years ago

ShellingFord221 commented 4 years ago

Hi, I have read your explanation about Bayesian neural network, aleatoric uncertainty and epistemic uncertainty. It is very excellent and straightforward. But I also notice an interesting phenomenon that when we talk about Bayesian deep learning, we seldom talk about those interesting tasks in NLP. Why is that? I think that making weights distribution and aleatoric / epistemic uncertainty are still useful in NLP tasks, but there are less applications then in CV area. And also in my experiments, Bayesian neural networks fail to capture those useful features and make wrong judgement about aleatoric / epistemic uncertainty. I really wonder why. If we can have a discussion about this, I will be be be very grateful. Thanks.

fsndzomga commented 6 months ago

Would love to have a feedback on this