danieldeutsch / sacrerouge

SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.
Apache License 2.0
134 stars 11 forks source link

Adding automatically generating "score" and "evaluate" commands for each metric #7

Closed danieldeutsch closed 4 years ago

danieldeutsch commented 4 years ago

Sketch of implementation idea for #2

JPeterson462 commented 4 years ago

Commit d750549 includes the filled in logic for metric_command to add argparse arguments based on metric constructors (and excludes dataset readers in Metric._registry)