search

yannvgn / laserembeddings

LASER multilingual sentence embeddings as a pip package
BSD 3-Clause "New" or "Revised" License
224 stars 29 forks source link

Fix BPE codes adapter #39

Closed yannvgn closed 2 years ago

yannvgn commented 2 years ago

Fixes #37 Fixes #38

BPECodesAdapter is not compatible with subword-mnt 0.3.8. It is now replaced by adapt_bpe_codes, which returns a real TextIOBase (more precisely StringIO) object.