marcotcr / checklist

Beyond Accuracy: Behavioral Testing of NLP models with CheckList
MIT License
2.01k stars 204 forks source link

Add lexicon from csv #105

Closed nking-1 closed 3 years ago

nking-1 commented 3 years ago

Adds a new function to the Editor, add_lexicon_from_csv, that adds a new lexicon tag from a CSV file.

The new functionality is documented in this notebook: https://github.com/Nking92/checklist/blob/csv_lexicon/notebooks/CSV%20Lexicon%20Example.ipynb

I also implemented __hash__ for MunchWithAdd so removing duplicates will work with munches in the lexicon.