Elevator Pitch: This project provides a unified framework to test autoregressive language models (GPT-2, GPT-3, GPTNeo, etc) on a large number of different evaluation tasks.
Goal Outputs: An open source library and a paper about the library.
Milestones: At a high level, what are the major milestones of this project (including completed ones)? Which ones are completed and which ones are in progress?
Other non-task things that need doing: