search

stan-dev / posterior

The posterior R package
https://mc-stan.org/posterior/
Other
167 stars 23 forks source link

Performance benchmarks #159

Open mjskay opened 3 years ago

mjskay commented 3 years ago

Pinging off of https://github.com/stan-dev/posterior/pull/157#issuecomment-846611937, would it be useful to have some standard benchmarks we use for evaluating performance?

Does anyone have experience setting something like this up? I noticed that the bench package looks to be developing infrastructure for doing this with continuous integration using scripts with calls to bench::mark() in a bench/ subdirectory. Might be worth playing with.

jgabry commented 3 years ago

Good idea. I haven't used bench but at first glance I agree it seems worth playing with. Could be a good solution.

mjskay commented 3 years ago

Noting here so we don't forget: from the conversation over at https://github.com/stan-dev/posterior/pull/160#issuecomment-847435468 I think that touchstone, not bench, is the more promising direction for this.

assignUser commented 2 years ago

Hey @mjskay! As discussed {touchstone} is now in a stable state, would love your feedback!