Conjugation example reproducability

writer / fitbert

Use BERT to Fill in the Blanks

https://pypi.org/project/fitbert/

Apache License 2.0

82 stars 14 forks source link

Conjugation example reproducability #17

Open obsh opened 4 years ago

obsh commented 4 years ago

Hi, I'm running fitbert in the Google Colab Notebook, first time example with conjugation works but in each subsequent execution it substitutes masked with "looks" not "looking".

Notebook link: https://colab.research.google.com/drive/1o1pOO-ozEOHOKO5_j48_TbwgYyP1U7b8

sam-writer commented 4 years ago

hmmm... this seems to have to do with caching:

Notice how the second request is ~30x faster

sam-writer commented 4 years ago

I can't think where any caching would be happening though...