vectors for SOS and EOS

anoopkunchukuttan / indic_nlp_library

Resources and tools for Indian language Natural Language Processing

http://anoopkunchukuttan.github.io/indic_nlp_library/

MIT License

546 stars 158 forks source link

vectors for SOS and EOS #34

Closed samyakag closed 3 years ago

samyakag commented 3 years ago

I wanted to know if there is any vector representation for SOS and EOS in the Hindi embeddings.

anoopkunchukuttan commented 3 years ago

Which Hindi embeddings do you mean?

samyakag commented 3 years ago

indicnlp.v1.hi.vec

anoopkunchukuttan commented 3 years ago

No, we do not have a vector representation for SOS and EOS. I don't think they will be particularly informative when it comes to word embeddings since they will occur in all sorts of contexts.