Expand HS bag - Githubissues

JherezTaylor / hatespeech_codewords

A contextual approach for detecting hate speech code words

MIT License

9 stars 3 forks source link

Expand HS bag #59

Closed JherezTaylor closed 7 years ago

JherezTaylor commented 7 years ago

[x] Use gloVe word vectors and get the top k similar words

JherezTaylor commented 7 years ago

ConceptNet can be used to yield the co-occurrence of words for each word in the HS bag See https://github.com/commonsense/conceptnet5

JherezTaylor commented 7 years ago

This was fixed by d399708 but it's slow and should be used sparingly, the better approach is the use the brown cluster id as a measure of similarity.