how to compute adequacy score?

PrithivirajDamodaran / Parrot_Paraphraser

A practical and feature-rich paraphrasing framework to augment human intents in text form to build robust NLU models for conversational engines. Created by Prithiviraj Damodaran. Open to pull requests and other forms of collaboration.

Apache License 2.0

865 stars 141 forks source link

how to compute adequacy score? #49

Open hyungkwonko opened 1 year ago

hyungkwonko commented 1 year ago

Hi, thank you for open sourcing this.

Could you please let me know where can I find the training code of the adequacy score? or is there anyway I can re-implement to calculate the adequacy score?

Thanks,

damyana79 commented 1 year ago

Yes, I also have the same question. If I want to train a parrot model for a different language, how is adequacy computed?

damyana79 commented 1 year ago

From the first glance it seems to be a model trained on an entailment task. Still, I'm not sure.