Closed albi3ro closed 11 months ago
No blocker from me. I'll leave @trbromley and another to approve.
Do we have reason to believe that the benchmark timings are significantly different now versus then?
Do we have reason to believe that the benchmark timings are significantly different now versus then?
Yes, they are very different.
Do we have reason to believe that the benchmark timings are significantly different now versus then?
Yes, they are very different.
Are we able to update instead of remove?
This PR proposes to remove the benchmarks from the readme until such time as we have updated benchmarks.
The table is four years old, and the graph is over a year old. We also have no idea what the simulations were run on, other than it is potentially something with 48 available cores.
The benchmarks also provide no information about what was measured. Single expectation value?
If we are to advertise benchmarks for the plugin, they should be maintained routinely, and fully specified.