Closed veekaybee closed 8 months ago
We wanted to pin lm-eval to a git hash to encompass the latest changes, but PyPI doesn't allow to publish packages with git-hash pinned dependencies, so reverting for now so we can update the PyPI version with the latest Ray on publish.
See errors here: https://github.com/mozilla-ai/lm-buddy/actions/runs/8238935806/job/22531036074
(we could in theory switch back to uv in our CI, but no worries either way)
uv
Yup, will do once we bump that lm-harness version
What's changing
We wanted to pin lm-eval to a git hash to encompass the latest changes, but PyPI doesn't allow to publish packages with git-hash pinned dependencies, so reverting for now so we can update the PyPI version with the latest Ray on publish.
How to test it
Related Jira Ticket
Additional notes for reviewers
See errors here: https://github.com/mozilla-ai/lm-buddy/actions/runs/8238935806/job/22531036074