uclnlp / jack

Jack the Reader
MIT License
257 stars 82 forks source link

Vocab associates OOV words to zeros vectors #378

Open pminervini opened 6 years ago

pminervini commented 6 years ago

This causes issues when normalising etc.

https://github.com/uclmr/jack/blob/master/jack/readers/classification/shared.py#L229

I will extend this to allow an optional alternative behavior, where the word's hash is used as a seed for generating a random vector.