search

ictnlp / DialoFlow

Code for ACL 2021 main conference paper "Conversations Are Not Flat: Modeling the Dynamic Information Flow across Dialogue Utterances".
MIT License
93 stars 10 forks source link

about the Automatic evaluation #15

Open bingfeiz opened 2 years ago

bingfeiz commented 2 years ago

First of all, thank you very much for your help. I have encountered a problem and hope you can answer it. I used myself to implement the automatic evaluation indicators, but the results are quite different from those in the paper. Can you please disclose the implementation code of your evaluation indicators?

lizekang commented 2 years ago

Hi, we use the evaluation scripts from (https://github.com/microsoft/DialoGPT). What is the problem?

bingfeiz commented 2 years ago

First of all thank you for your answer. The method in the code is a bit confusing, you are using the automatic evaluation under which folder, dstc or pycocoevalcap?

lizekang commented 2 years ago

It's in dstc/. You can refer to (https://github.com/mgalley/DSTC7-End-to-End-Conversation-Modeling) for more details.

bingfeiz commented 2 years ago

Thank you very much for your answer