Add common interface tests for minimum required functionality - Githubissues

stan-dev / stan

Stan development repository. The master branch contains the current release. The develop branch contains the latest stable development. See the Developer Process Wiki for details.

https://mc-stan.org

BSD 3-Clause "New" or "Revised" License

2.59k stars 368 forks source link

Add common interface tests for minimum required functionality #833

Open syclik opened 10 years ago

syclik commented 10 years ago

We should have a description of the minimum required functionality that a Stan interface must implement. This may include

[ ] compiling a Stan model from a file
[ ] sampling of the model
[ ] optimization of the model
[ ] repeatability of results given a fixed seed
[ ] data I/O
[ ] exporting generated samples

Additional:

[ ] what visualizations are available
[ ] posterior analysis (this should be further broken down)
[ ] R-hat
[ ] n_eff
[ ] extractions
[ ] samples +/- warmup +/- scrambling +/- structured extraction
[ ] operations allowed with Stan model
[ ] log prob +/- constrained
[ ] gradients
[ ] higher order derivatives
[ ] variable name access
[ ] variable dimensions access
[ ] transforms to and from constrained form

bob-carpenter commented 10 years ago

[syclik: moved comment and checkboxes to first comment so number of check boxes to completion shows up on issues screen]