Bug fix / refactor - Githubissues

vwxyzjn / lm-human-preference-details

RLHF implementation details of OAI's 2019 codebase

MIT License

152 stars 7 forks source link

Closed vwxyzjn closed 1 year ago

vwxyzjn commented 1 year ago

Let's just unify the naming to lm_backbone.
added an e2e test case as the main should not break.
let's use accelerator.unwrap_model so that we can run the stuff natively without having a hard dependency on accelerate launch

liutianlin0121 commented 1 year ago

Awesome, LGTM! Thanks.