search

marcotcr / checklist

Beyond Accuracy: Behavioral Testing of NLP models with CheckList
MIT License
2.01k stars 204 forks source link

Tutorial not reproducable because some modules aren't part of the repo. #23

Closed ashutosh-dwivedi-e3502 closed 4 years ago

ashutosh-dwivedi-e3502 commented 4 years ago

Following lines from tutorial-4 use the hard coded path to import a module which is not part of the repo.

sys.path.append('/home/marcotcr/work/ml-tests/')
from mltests import model_wrapper
model = model_wrapper.ModelWrapper()
tongshuangwu commented 4 years ago

Hi! As mentioned in the original 4. The CheckList process.ipynb file, this is to be expected: we were running a QQP model locally, so

You won't be able to run them, but you can substitute your own model here if you want.

That said, we realize it can be frustrating and have revised tutorial-4 so it directly loads existing models/datasets hosted online. As of now, you should be able to run the entire tutorial without any change of code.

Please let us know if you still run into issues :)

ashutosh-dwivedi-e3502 commented 4 years ago

Thanks a lot for posting the updated tutorial.