Benchmark: use no_grad() in PyTorch for inference

[cgravill]

Using longer runs (5 seconds) from #894

Before:

After:

It's possible this helped inference but note there are some overall shifts on forward and backwards as well. Given this is the right thing to do I suggest adding this in any case.