search

Y-IAB / lm-evaluation-harness

A framework for few-shot evaluation of language models.
https://www.eleuther.ai
MIT License
0 stars 0 forks source link

Hard for Puree to list all tasks #25

Open rifqiyan opened 5 months ago

rifqiyan commented 5 months ago

If we want to show available tasks on Puree, we will need to scrap lot of yaml files. It will be nice if we can have task list metadata collected so Puree only need to read a single file.

rifqiyan commented 5 months ago

TODO: move the metadata outside of the repo