Hard-codes the seed as in the main EleutherAI harness to remove an added source of non-deterministic behavior. Note this removes the optional seed arg in the CLI.
Moves seed setter and random number generator getter into the evaluate function to ensure library users properly handle the numpy, random, etc. seeding.
cc @samsontmr for input since we've run into repro issues with seeding together.
evaluate
function to ensure library users properly handle thenumpy
,random
, etc. seeding.cc @samsontmr for input since we've run into repro issues with seeding together.