search

SigmaWe / DocAsRef

Using document as reference summary in summary evaluation
2 stars 0 forks source link

Dump results #22

Open forrestbao opened 1 year ago

forrestbao commented 1 year ago
  1. Additional metrics to test
    • [high priority] BERTScore-sentence, MNLI, {RoBERTa, DeBERTA}, Entail - Contradict, top-k and top-p
    • [medium] BERTScore-original, DeBERTa -- to see how much language models impact it
    • [low] BERTScore-sentence, cosine, DeBERTa -- again, to see the impact of language models
  2. how to print result into Google Sheets Done https://github.com/SigmaWe/EvalBase/pull/4
forrestbao commented 1 year ago

Please run BERTScore sentence, non-MNLI just simple cosine, but with sentence weighting when you have time. @TURX