bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.
Apache License 2.0
745 stars 193 forks source link

Problem launching evaluation #75

Closed ck-amrahd closed 1 year ago

ck-amrahd commented 1 year ago

Hi, I am trying to run the evaluation of Santacoder using the script provided, but I am getting the following error which I am not able to find out why:

File "/home/kcdharma/ndec/eval/bin/accelerate", line 8, in <module>
  sys.exit(main())
File "/home/kcdharma/ndec/eval/lib/python3.10/site-packages/accelerate/commands/accelerate_cli.py", line 43, in main
  args.func(args)
File "/home/kcdharma/ndec/eval/lib/python3.10/site-packages/accelerate/commands/launch.py", line 910, in launch_command
  simple_launcher(args)
File "/home/kcdharma/ndec/eval/lib/python3.10/site-packages/accelerate/commands/launch.py", line 397, in simple_launcher
  process = subprocess.Popen(cmd, env=current_env)
File "/usr/lib/python3.10/subprocess.py", line 966, in __init__
  self._execute_child(args, executable, preexec_fn, close_fds,
File "/usr/lib/python3.10/subprocess.py", line 1762, in _execute_child
  env_list.append(k + b'=' + os.fsencode(v))
File "/usr/lib/python3.10/os.py", line 810, in fsencode
  filename = fspath(filename)  # Does type-checking of `filename`.

TypeError: expected str, bytes or os.PathLike object, not NoneType

Any help is appreciated.