GEM-benchmark / GEM-metrics

Automatic metrics for GEM tasks
https://gem-benchmark.com
MIT License
60 stars 20 forks source link

#30: add type hints #75

Closed madaan closed 2 years ago

madaan commented 2 years ago

Addresses #30 to a large extent.

The hope is that adding type hints will prevent bugs and improve the readability. However, this is likely going to be something we'll need to do at regular intervals (unless we enforce type hints in all new PRs).

The PR passes all the unit tests except nubia which gives an OOM.