percyliang / sempre

Semantic Parser with Execution
Other
830 stars 299 forks source link

Unable to replicate the freebase results on webquestions #154

Open wsxsh opened 7 years ago

wsxsh commented 7 years ago

I want to replicate the result in the paper Imitation Learning of Agenda-Based Semantic Parsers about the webquestions dataset. I find parameters have been trained and uploaded on the codalab.So I load the parameters in the ./run command and use the webquestions. However, i can't get the same result in the 3rd training process listed in the log file. Actually, what I get is much different. What's wrong with me? Is there anyone who have successfully get the result? Thanks very much.

ppasupat commented 7 years ago

Not sure if this is the same person that I have responded in the email. In that case the issue was fixed by downloading the old version of CoreNLP from CodaLab. This can be done by replacing the whole lib directory with the lib bundle from https://worksheets.codalab.org/worksheets/0x8fdfad310dd84b7baf683b520b4b64d5/