declare-lab / MIME

This repository contains PyTorch implementations of the models from the paper An Empirical Study MIME: MIMicking Emotions for Empathetic Response Generation.
MIT License
43 stars 11 forks source link

Dataset Sample Number Mismatched #6

Open jeremychang9 opened 2 years ago

jeremychang9 commented 2 years ago

Hi, I was trying to evaluate your model with the output.txt. However, I found that the number of the dataset sample was different. There are supposed to have 5259 samples in the testing set, but yours only get 5255 samples.

For instance, the last dialogue (the last 2 turns of sample) should be:

I have a big test on Mondaycomma I am so nervous. What is the test on? It's for my Chemistry class. I haven't slept much because I'm worried so I keep studying. Chemistry is quite difficult_comma_have you studied hard?

"sys_dialog_texts.test.npy" also get 5255 samples. Maybe you should check it out, leave a message if you get any news. Thank you.