search

facebookresearch / online_dialog_eval

Code for the paper "Learning an Unreferenced Metric for Online Dialogue Evaluation", ACL 2020
Other
28 stars 7 forks source link

Easy to use API to compute MauDe scores on input dialog #3

Open koustuvsinha opened 4 years ago

koustuvsinha commented 4 years ago

It would be great to have an easy to use / install API to compute MaUde score on any given input.

nonstopfor commented 4 years ago

Is there any progress for this? I try to fine tune MaUde and use it to infer, but have meet many problems.

koustuvsinha commented 4 years ago

I haven't got time around to implement this. Would be a good first issue, would you want to have a go?

nonstopfor commented 4 years ago

I haven't got time around to implement this. Would be a good first issue, would you want to have a go?

I'm trying this.

Pwang001 commented 3 years ago

Is there anyway to evaluate on personal data?

koustuvsinha commented 3 years ago

Hi @Pwang001 , it should be straightforward to evaluate on your personal data : you can follow the steps in the inference.py script to load a custom dataframe

Pwang001 commented 3 years ago

Hi @Pwang001 , it should be straightforward to evaluate on your personal data : you can follow the steps in the inference.py script to load a custom dataframe

Thanks Koust, it worked. I create a csv file(my data) contains "context"(default) and "response"(customized) columns followed by a little modification of command inside run_inference.sh.