Change mmlu config - Githubissues

IINemo / lm-polygraph

MIT License

111 stars 21 forks source link

Change mmlu config #189

Closed rvashurin closed 4 months ago

rvashurin commented 4 months ago

Only impose subject limit on mmlu if len(subject) > limit
Use different splits
Change XSum to continuation prompt
Add wmt19