search

electionscience / vse-sim

Methods for running simulations to calculate Voter Satisfaction Efficiency (VSE) of various voting systems in various conditions.
https://electionscience.github.io/vse-sim
57 stars 17 forks source link

Document random seeds, and allow specification of seeds for reproducibility and testing #13

Closed nealmcb closed 7 years ago

nealmcb commented 7 years ago

The ability to replicate results is critical for simulations and other scientific results used in policy discussions related to fundamental aspects of society like election methods.

For replication of results, testing and exploring the implications of election simulations, the system needs to document the random seeds used in each simulation when reporting the results, and allow the user to specify the seed for a simulation and any other parameters necessary to reproduce the result.

For background on reproducability in another complicated and important field, see A minimum standard for publishing computational results in the weather and climate sciences: Damien Irving

jamesonquinn commented 7 years ago

closed with commit ed381fd76d31cd92d7a72dd3bc015ddf1a6863f9 (save seed; resolves #13)