search

jerbarnes / semeval22_structured_sentiment

SemEval-2022 Shared Task 10: Structured Sentiment Analysis
75 stars 42 forks source link

null values in MPQA dataset #20

Closed luxinyu1 closed 3 years ago

luxinyu1 commented 3 years ago

null values exist both in keys Intensity and Polarity in MPQA dataset. This bug occurs in the newest commit 99f2f885aba188a52afeb9523cc9b9d194465d85.

jerbarnes commented 3 years ago

Hi,

Thank you for pointing this out. I've just updated the process_mpqa.py script to remove any annotations with null polarity. For other datasets, I've manually corrected any occurrences as well. For intensity, I have not removed them, as we do not explicitly use this feature in the current shared task, but we will need to keep this in mind for any future iterations.

luxinyu1 commented 3 years ago

Hi,

Thank you for pointing this out. I've just updated the process_mpqa.py script to remove any annotations with null polarity. For other datasets, I've manually corrected any occurrences as well. For intensity, I have not removed them, as we do not explicitly use this feature in the current shared task, but we will need to keep this in mind for any future iterations.

Thanks for your revision, I believe this issue has been solved.