search

GEM-benchmark / GEM-metrics

Automatic metrics for GEM tasks
https://gem-benchmark.com
MIT License
60 stars 20 forks source link

Add support for docker and add all the metrics from repro #74

Open sebastianGehrmann opened 2 years ago

sebastianGehrmann commented 2 years ago

Just opening an issue for this to have it documented. We want docker support for metrics in the library and we want to add support for the suite from repo (https://github.com/danieldeutsch/repro/tree/master/repro/models)