search

allenai / ARC-Solvers

ARC Question Solvers
http://data.allenai.org/arc/
Apache License 2.0
82 stars 16 forks source link

README.md with not replicable steps #22

Open abarbosa94 opened 5 years ago

abarbosa94 commented 5 years ago

Hey there, I'm trying to replicate some of the solvers in my machine but I am having problems with all of them. More specifically, I am trying to reproduce the BiLSTM Max-out with Question to Choices Max Attention.

I did not trained anything. I just tried to evaluate the trained model. I am receiving the following error however:

IndexError: invalid index of a 0-dim tensor. Use tensor.item() to convert a 0-dim tensor to a Python number

Could anyone please help?

legodps commented 5 years ago

I was able to get the decompatt model working, the Bidaf model failed for different reasons, but the DGEM model failed for that reason as well on evaluating the test set after running all the iterations

abarbosa94 commented 5 years ago

I managed to got these working, but the results are not similar to the presented before. I was thinking about if its worth to submit a PR with the changes that I needed to do to fix versions, but this project seems to not be updated very often by maintainers :<