search

parsing-science / pymc3_models

Apache License 2.0
157 stars 24 forks source link

meta: Testing probabilistic programs #8

Closed rlouf closed 2 years ago

rlouf commented 6 years ago

It is not clear how we should implement tests for probabilistic models due to the randomness associated with the sampling process. Currently, the tests check that the API works as expected, but not the validity of the outputs.

The following blog article has some interesting ideas:

https://alexey.radul.name/ideas/2016/on-testing-probabilistic-programs/

twiecki commented 6 years ago

In PyMC3 we have regression tests that check numerical output and set the seed.

rlouf commented 6 years ago

That makes sense, thanks for the pointer.