search

cpllab / lm-zoo

Easy black-box access to state-of-the-art language models
https://cpllab.github.io/lm-zoo/
MIT License
14 stars 6 forks source link

Test harness breaks with BOS token #19

Closed hans closed 4 years ago

hans commented 4 years ago

The unking test breaks if models prepend BOS, since the indexing is then off: https://github.com/cpllab/lm-zoo/blob/api-revision2/test.py#L118

JRNN is an example of such a model which breaks the test.

hans commented 4 years ago

Fixed (ish) in 0064040fa9306ea81c452452ca7dcfba6d631b36