huggingface / cosmopedia

Apache License 2.0
454 stars 45 forks source link

Fixing bechmark evaluation README #24

Open morphpiece opened 4 months ago

morphpiece commented 4 months ago

The instructions given in the README.md of benchmark evaluation need a couple of additions to work.

  1. deepspeed needs to be installed.
  2. Remove the spaces in the MODEL variable declaration.
  3. Declare OUTPUT_DIR
  4. Fixed location of run_evals_accelerate.py