search

smartyfh / MultiWOZ2.4

MultiWOZ 2.4: A Multi-Domain Task-Oriented Dialogue Dataset
MIT License
60 stars 7 forks source link

Which TripPy result is valid? #6

Closed ZhangzihanGit closed 2 years ago

ZhangzihanGit commented 2 years ago

Hi,

Thanks for your hard work.

In the paper, the Joint goal accuracy for TriPy on MWZ2.4 is 59.62%, however, in the README table, the accuracy is 64.75%. Which one is valid? Thank you!

smartyfh commented 2 years ago

Hi,

Thanks for your hard work.

In the paper, the Joint goal accuracy for TriPy on MWZ2.4 is 59.62%, however, in the README table, the accuracy is 64.75%. Which one is valid? Thank you!

Hi, 64.75% is the correct one. The arxiv paper has not been updated yet.

ZhangzihanGit commented 2 years ago

Thanks for the quick reply!