Check for reference data type?

GEM-benchmark / GEM-metrics

Automatic metrics for GEM tasks

https://gem-benchmark.com

MIT License

60 stars 20 forks source link

Check for reference data type? #92

Closed tuetschek closed 2 years ago

tuetschek commented 2 years ago

Currently, GEM always expects a list of references. If you pass on a single string, it won't crash but the results are wrong. That's confusing – we should either handle single strings properly, or crash with an informative error message

tuetschek commented 2 years ago

Related to #60

tuetschek commented 2 years ago

Fixed in #94 .