Open chris31415926535 opened 3 years ago
This issue stumped me as well during the development of my own port. There are even more duplicates, like
line no. | element | sentiment |
---|---|---|
342 | o.o | -0.6 |
4853 | o.o | -0.8 |
I worked around the issue by replacing existing mappings by subsequent entries, thus keeping the original lexicon intact. However, as you mentioned, this does not seem like a sustainable solution. I would really appreciate a follow-up from @cjhutto or any of the other co-authors as to what would be the most appropriate permanent option.
Thanks for making VADER. I'm working on another port and am having a blast.
There are instances of words/emojis that have two entries with different sentiment values in the most recent version of
vader_lexicon.txt
. This is a potential source of bugs and inconsistencies between ports. I've included the list below with the line number in vader_lexicon.txt, the words, and the sentiment values.It looks the Python version of VADER takes the last value it finds. For example, "lol" has two sentiment values: +2.9 at line 305, and+1.8 at line 4406. To reproduce the output in test sentence 13 from the main Readme (copied below), I need to assign "lol" a sentiment of 1.8.
Today only kinda sux! But I'll get by, lol----------------------- {'pos': 0.317, 'compound': 0.5249, 'neu': 0.556, 'neg': 0.127}
I see three main options:
Obviously it's your call, but I didn't see this in any other Issues or Pull Requests so I wanted to surface it. I'm happy to chat or help in any way I can.