Closed bmcfee closed 8 months ago
Just bumping this one, since it's been quite a while. :grin:
@faroit any hope of getting this merged? The benchmarks by now are pretty inaccurate of the current state, and it's causing confusion out there.
@bmcfee sorry again. i forgot about this one
@bmcfee merged this for now and create new plots later
Awesome, thanks!
This PR updates the benchmark suite for the following versions:
I wasn't able to get the docker instructions to work - apt is failing with some of the python dependencies. The virtual environment sort of works, but requires special care when installing torch without GPU support. I haven't bothered to update the instructions here, but they probably could use a general overhaul.
I have a run going on my dev machine currently, but the results aren't finished. I expect these will be re-run by @faroit anyway, but let me know if anything needs to be done from the PR side.