literature research on preprocessing for word embeddings - Githubissues

MediaUncovered / NewsAnalysis

use word embeddings to uncover bias in newspapers

5 stars 1 forks source link

literature research on preprocessing for word embeddings #12

Open Tilana opened 7 years ago

Tilana commented 7 years ago

What are best practices in preprocessing for word embeddings?

change words to lower case
remove punctuation
remove stopwords?
lemmatize?

Note: take collection sizes into account!