mozilla-ai / lm-buddy

Your buddy in the (L)LM space.
Apache License 2.0
63 stars 3 forks source link

Bumping the library version and pinning lm-eval-harness to a PyPI Distribution #78

Closed veekaybee closed 8 months ago

veekaybee commented 8 months ago

What's changing

We wanted to pin lm-eval to a git hash to encompass the latest changes, but PyPI doesn't allow to publish packages with git-hash pinned dependencies, so reverting for now so we can update the PyPI version with the latest Ray on publish.

How to test it

Related Jira Ticket

Additional notes for reviewers

See errors here: https://github.com/mozilla-ai/lm-buddy/actions/runs/8238935806/job/22531036074

sfriedowitz commented 8 months ago

(we could in theory switch back to uv in our CI, but no worries either way)

veekaybee commented 8 months ago

Yup, will do once we bump that lm-harness version