Eng 5025 evaluation set - Githubissues

writer / fitbert

Use BERT to Fill in the Blanks

https://pypi.org/project/fitbert/

Apache License 2.0

82 stars 14 forks source link

Eng 5025 evaluation set #6

Closed melisa-writer closed 5 years ago

melisa-writer commented 5 years ago

Adding scripts for test data generation.

Remark: I'm not sure where to upload files. It's not a part of the service library -> I've created a subfolder (added to .dockerignore)

get_phrase.py - looks for verb/noun phrases in pos tags sequences
get_options.py - conjugates verbs (pyinflect lib) or looks for derivationally related forms (NLTK Wordnet)
get_gap.py - uses the above to generate masked sentence, answer and options
main.py - reads csv, applies get_gap to sentences and writes to json
utils.py - helper functions used in main.py (removed from main for clarity)

Sample output: world_news_in_month_tense.json

Updates:

dockerignore update (see remark)
use multi_rank
GPU support

sam-writer commented 5 years ago

I added a few more comments, and an update to the main readme. I made a colab notebook to show usage and put it in the readme.

I ❤️ this PR. Thank you. I hope you know, the comments all come from a place of loving this code and wanting it to be 💅