Emoticons :)

[dafajon]

Apart from emojis, there are emoticons such as :), ;), :P, xD. Tokenizers tend to dismiss them as punctuations yet they are tokens of emotion.

• One way is to incorporate our tokenizers to recognize such patterns.
• Implement an EmojiVectorizer specific to emojis and emoticons and use it in union with other vectorizers. This approach can also produce coarse grained features such as contains_anger, contains_laughter based on a rule based coarse grained grouping of emojis. Which is an approach that was thought in one of our customers

[husnusensoy]

Please do not mention customer specific projects and their names in here. Do we have complete list of such emoji tokens ?

[dafajon]

This Wikipedia article contains separate list of Western and Eastern (Korean, Japanese etc.) style emoticons. They are also categorized by emotions they convey. This can bu used to build a list and emoticon -> emotion dict.

[ertugrul-dmr]

@dafajon This dict below might be useful for this case:

https://github.com/NeelShah18/emot/blob/master/emot/emo_unicode.py

[dafajon]

This dict also refers to the same Wikipedia page; so we can use this dict. Thanks for sharing.