google-research / true

Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
Apache License 2.0
71 stars 10 forks source link

ANLI model #14

Closed UntotaufUrlaub closed 1 year ago

UntotaufUrlaub commented 1 year ago

Hi,

I would like to reuse/reevaluate your ANLI and Q2-relaxed metric, have you shared code and model? I did not see it in this repo.

kind regards

roeeaharoni commented 1 year ago

Hi, the NLI model we open-sourced is available here: https://huggingface.co/google/t5_xxl_true_nli_mixture Re Q^2, the open-sourced version is available here: https://github.com/orhonovich/q-squared (it is of lower quality than the one used in the paper).