Cache real perfs for tests.
Perf calculation code is pretty stable now so doesn't make a lot of sense to calculate the super slow real perfs in tests every time.
Speed up convolution.
Not noticeable in normal use, but speeds up tests a lot. Performance improved by about 130%.