Open colbrydi opened 1 year ago
Is this about the see-benchmark or a particular file you used for benchmark?
We ran two different see-benchmark runs which sets the seed to the JOBID+ARRAYID however we got exactly the same answers which suggests that the see is not working. Could be we are passing it in incorrectly, overwriting it or something else. My guess is it will be an easy fix once we determine where it is occurring.
I just ran two different benchmarks and noticed that changing the see did NOT change the output. Something is wrong.