Add in_vocab, stemmed words, and word freq to pickle

hassonlab / 247-pickling

Contains code to create pickles from raw/processed data

1 stars 9 forks source link

Closed zkokaja closed 3 years ago

zkokaja commented 3 years ago

Adds new in_{LM} columns
Adds stemmed and lemmatized versions of each word
Does not lowercase all entries by default, and fixes the corresponding word frequency counts to match

hvgazula commented 3 years ago

Are you merging this yourself or do you want me to review this? If yes, may I look at it over the weekend?