Adding support to Unicode Emoji 13.0.0

cbaziotis / ekphrasis

Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).

MIT License

660 stars 91 forks source link

Adding support to Unicode Emoji 13.0.0 #24

Open neerajvashistha opened 4 years ago

neerajvashistha commented 4 years ago

Changelog:

Added support to unicode emoji 13.0.0
Added support to HASH TAG expansion for all caps as explained https://github.com/cbaziotis/ekphrasis/pull/23 and https://github.com/mingfengwan/ekphrasis/commit/f56de1f3e21e8ae1e423145e1904ff5062c75fee

'!!!!! RT @mleew17: boy dats cold...tyga dwn bad for cuffin dat hoes in the 1st place!! #IMUSTGO =/ 😀'
'!!!!! RT : boy dats cold ... tyga dwn bad for cuffin dat hoes in the 1st place !! imus tgo <annoyed> <grinning face>'