search

GEM-benchmark / GEM-metrics

Automatic metrics for GEM tasks
https://gem-benchmark.com
MIT License
60 stars 20 forks source link

Example on a single metric usage with the input format #62

Closed asnota closed 2 years ago

asnota commented 2 years ago

The expected input format with an example of the metric usage might be useful to add to the docstrings of each of the metrics.

tuetschek commented 2 years ago

@asnota would the current README be OK? All metrics should compute the same, so there's probably no need to add this individually.

asnota commented 2 years ago

Agree, if it is given as an argument to compute() function, its usage should be straight forward.