RD2024-25: Remove ray.remote from lm-harness job

mozilla-ai / lm-buddy

Your buddy in the (L)LM space.

Apache License 2.0

64 stars 3 forks source link

RD2024-25: Remove ray.remote from lm-harness job #26

Closed sfriedowitz closed 8 months ago

sfriedowitz commented 8 months ago

Adding this one on here because it was so quick to bang out.

Note to users: You will need to specify entrypoint_num_gpus upon job submission w/ the Ray client if you want to run a GPU-powered lm-harness evaluation now. It can no longer be specified on the config YAML file.