Problem with inference script and replication of paper results

ranjaykrishna / iq

Information Maximizing Visual Question Generation

https://cs.stanford.edu/people/ranjaykrishna/iq/index.html

Other

66 stars 14 forks source link

Problem with inference script and replication of paper results #7

Open sarthak268 opened 4 years ago

sarthak268 commented 4 years ago

The inference script provided in the repo doesn't seem to work in its current form. I had to make some changes to it to make it run. In doing so, I am not able to replicate the results provided in the paper. The quantitative metrics give a much lower score in comparison to what is reported in the paper. Please help us point out the mistake we are doing or update the inference/training file with the correct one. Thank you.

cyzus commented 2 years ago

@sarthak268 Hi, were you able to replicate the results? I am also having trouble getting a similar score compared to what is reported in the paper

mahmudhasankhan commented 1 year ago

@sarthak268 Hello, I am getting poor results as well. Did you find anything worth mentioning about this matter?

PAradoxLG commented 1 year ago

@sarthak268 Hi,I am getting poor results as well .Did you find angthing worth mentioning about this matter?