bigscience-workshop / lm-evaluation-harness

A framework for few-shot evaluation of autoregressive language models.
MIT License
101 stars 30 forks source link

Hard-code `seed`s to reduce non-deterministic behavior #121

Closed jon-tow closed 2 years ago

jon-tow commented 2 years ago

cc @samsontmr for input since we've run into repro issues with seeding together.