allenai / pawls

Software that makes labeling PDFs easy.
https://pawls.apps.allenai.org
Apache License 2.0
390 stars 74 forks source link

Improve accuracy calculation and export functions #121

Closed lolipopshock closed 3 years ago

lolipopshock commented 3 years ago
  1. Select contatining tokens for free-form annotations and add in the outputs
  2. Better token accuracy report:
    1. Only compute the scores for labeled tokens
    2. Enable generating per-category token-level f1 scores