bnosac / doc2vec

Distributed Representations of Sentences and Documents
Other
46 stars 5 forks source link

space part of dictionary #3

Closed jwijffels closed 3 years ago

jwijffels commented 3 years ago

find out why "" is part of the word dictionary and if nothing is provided in a tokenised list, we still get the "" embedding

jwijffels commented 3 years ago

regarding "", looks fine - was just data preparation which should not have leading/trailing spaces