Question: What about sentence end/start markers?

stanfordnlp / GloVe

Software in C and data files for the popular GloVe model for distributed word representations, a.k.a. word vectors or embeddings

Apache License 2.0

6.86k stars 1.51k forks source link

Question: What about sentence end/start markers? #84

Closed queirozfcom closed 7 years ago

queirozfcom commented 7 years ago

Hi. I'm about to prepare a large file to train glove on but in the README there's no mention of what I should do at the beginning or end of sentences.

E.g. the sentence "One cat jumped up the tree. The dog, however, just barked."

becomes "one cat jumped up the tree the dog however just barked" or "<START> one cat jumped up the tree <END> <START> the dog however just barked <END>"?