CoderPat / MuDA

9 stars 6 forks source link

Add option to compare hypotheses files to references file for tag precision/recall/f1 #15

Closed CoderPat closed 1 year ago

CoderPat commented 1 year ago

Adds simple comparison between hypothesis (model decoded) and reference files based on MuDA tags.

Example stdout: image

Based on the LabelWordBucketer from compare-mt https://github.com/neulab/compare-mt/blob/master/compare_mt/bucketers.py (optionally pinging @neubig since he probably knows this code)