fladhak / creative-summ-data

9 stars 1 forks source link

Metrics #2

Open Aadyant12 opened 2 years ago

Aadyant12 commented 2 years ago

Kindly provide a method to access the various metrics using which our results would be assessed.

Bobby-Hua commented 2 years ago

Hi! Is it possible to share the specific implementation of ROUGE scores, METEOR, and pretrained metrics that are used to evaluate our blind test set performance? I was hoping to also report these metrics on the original dev and test sets in the paper. Having the exact same implementation will be super helpful.