Add marginal likelihood sampling methods to enable model selection workflows. A few common implementations are:
[ ] Annealed Importance Sampling [1]
[ ] Bridge Sampling [2]
[ ] Nested Sampling [3]
[ ] Bayesian Quadrature [4]
R. M. Neal, ‘Annealed Importance Sampling’, Sep. 04, 1998, arXiv: arXiv:physics/9803008.
Bennett, C. H. Efficient estimation of free energy differences from Monte Carlo data. Journal of Computational Physics, 22(2):245–268, 1976. Direct PDF
J. Skilling, ‘Nested Sampling’, in AIP Conference Proceedings, Garching (Germany): AIP, 2004, pp. 395–405. doi: 10.1063/1.1835238.
H. Chai, J.-F. Ton, R. Garnett, and M. A. Osborne, ‘Automated Model Selection with Bayesian Quadrature’, Mar. 01, 2019, arXiv: arXiv:1902.09724.
Motivation
Marginal log-likelihood is a very useful metric for model selection; however, direct computation of this integral is commonly intractable due to dimensional expansion for anything but the lowest number of parameters. To acquire this information, sampling and alternative bayesian integration methods have been investigated.
Feature description
Add marginal likelihood sampling methods to enable model selection workflows. A few common implementations are:
Motivation
Marginal log-likelihood is a very useful metric for model selection; however, direct computation of this integral is commonly intractable due to dimensional expansion for anything but the lowest number of parameters. To acquire this information, sampling and alternative bayesian integration methods have been investigated.
Possible implementation
No response
Additional context
No response