Text features from prior work - Githubissues

clulab / twitter4food

Repository for the health informatics analytics on twitter project

Apache License 2.0

1 stars 4 forks source link

Text features from prior work #16

Open herongrove opened 7 years ago

herongrove commented 7 years ago

Kokkos & Tzouramanis (2014) on gender:

[ ] % lowercase characters (a–z)
[ ] % uppercase characters (A-Z) (would require changes to tokenization)
[ ] % whitespace characters (possibly incompatible with our tokenization)
[ ] avg. word length (in characters)
[ ] vocabulary richness (types / tokens)
[ ] % words > 6 characters
[ ] % ? marks
[ ] % ??? multiple marks
[ ] % ! marks
[ ] % !!! multiple marks
[ ] % words ending in -able, -al, -ful, -ic, etc.

Rao, Yarowsky, Shreevats, Gupta (2010) on gender:

[ ] emoticons (as a class) based on a Wikipedia list
[ ] repeated alphabets (nooooooo waaaaay)
[ ] self bigrams, e.g. 'my husband', 'I saw'
[ ] laughs as a class (LOL, ROTFL, LMFAO, haha, hehe)