Y-IAB / lm-evaluation-harness

A framework for few-shot evaluation of language models.
https://www.eleuther.ai
MIT License
0 stars 0 forks source link

Add new task groups for low-cost evaluation. #20

Closed myeongho-jeong-yanolja closed 5 months ago

myeongho-jeong-yanolja commented 5 months ago
  1. Simplify task name (because it becomes too long). The detail of task name is in README.
  2. add simple evaluation group, which exclude llm-eval for cost & time eifficiency.