Why do Digits always mapped to zero?

bheinzerling / bpemb

Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)

https://nlp.h-its.org/bpemb

MIT License

1.18k stars 101 forks source link

Closed sumyatthitsar closed 5 years ago

sumyatthitsar commented 5 years ago

We want to encode text including digits. But the problem is all digits returns as zero. Anyone help me!

bheinzerling commented 5 years ago

Hi, please see my reply to the same question here:

sumyatthitsar commented 5 years ago

Thank you for your reply!