search

allenai / open-instruct

Apache License 2.0
1.08k stars 140 forks source link

Llama 3 evals #177

Closed hamishivi closed 2 weeks ago

hamishivi commented 2 weeks ago

Adds additional_stop_sequence to most eval scripts to allow for an additional stop token (primarily useful for llama 3 instruct). I also merged from main so there are random other commits in here.

hamishivi commented 2 weeks ago

Yup, it's <|eot_id|>. I'll add a comment.