Pinning lm-harness at the git hash

mozilla-ai / lm-buddy

Your buddy in the (L)LM space.

Apache License 2.0

64 stars 3 forks source link

Pinning lm-harness at the git hash #76

Closed veekaybee closed 7 months ago

veekaybee commented 7 months ago

What's changing

We'd like to pin lm-harness to the hash resolving trust_remote_code (see issue here:https://github.com/mozilla-ai/lm-buddy/issues/49), and also updating to include wandb for logging

How to test it

Related Jira Ticket

Additional notes for reviewers

veekaybee commented 7 months ago

Ultimately after some research looks like we'll have to use pip for pinned githashes for now :\, so I've changed it here, but I'm guessing in a few months we'll be able to revert this