KaijuML / rotowire-rg-metric

Code for the RG metric of Challenges in Data-to-Document Generation (Wiseman, Shieber, Rush; EMNLP 2017)
7 stars 2 forks source link

Wired rg result #6

Open Skinny-Joey opened 1 year ago

Skinny-Joey commented 1 year ago

I finish every step, and try to use the pretrained model to predict gold summary of rotowire. But the results is lower than I thought. Am I doing it right?

[2022-12-08 16:18:48,032 INFO] prec 0.8927842974662781 [2022-12-08 16:18:48,032 INFO] nodup_prec 0.8919917941093445 [2022-12-08 16:18:48,032 INFO] total correct 2190.0 [2022-12-08 16:18:48,032 INFO] nodup correct 2172.0