jerbarnes / semeval22_structured_sentiment

SemEval-2022 Shared Task 10: Structured Sentiment Analysis
75 stars 42 forks source link

Mistake in darmstadt_unis annotation #31

Open sadra-barikbin opened 2 years ago

sadra-barikbin commented 2 years ago

Hi, darmstadt_unis train sample 1666 is seemingly wrong. It is:

{'opinions': [{'Intensity': 'Strong',
   'Polar_expression': [['All', 'care money'], ['0:3', '9:28']],
   'Polarity': 'Negative',
   'Source': [[], []],
   'Target': [['they'], ['4:8']]},
  {'Intensity': 'Average',
   'Polar_expression': [['not', 'care education'], ['31:34', '9:44']],
   'Polarity': 'Negative',
   'Source': [[], []],
   'Target': [['they'], ['4:8']]}],
 'sent_id': 'Colorado_Technical_University_Online_1_07-10-2008-17',
 'text': 'All they care about is money , not education .'}

In polar expression, care education is not a contiguous expression in the sentence. Maybe care should be replaced with not and vice versa.

Also in train sample 2015 the same thing is happened.

{'opinions': [{'Intensity': 'Strong',
   'Polar_expression': [['great', 'made sense'], ['28:33', '19:49']],
   'Polarity': 'Positive',
   'Source': [[], []],
   'Target': [['Online Program'], ['4:18']]}],
 'sent_id': 'University_of_Phoenix_Online_112_01-09-2006-5',
 'text': "The Online Program made for great practical sense given my wife's pregnancy and time constraints ."}

In polar expression, made sense is not a contiguous expression in the sentence. It should have been separated.

Finally in dev sample 55 the same thing is happened:

{'opinions': [{'Intensity': 'Weak',
   'Polar_expression': [['some', 'deserves improvement'], ['35:39', '26:51']],
   'Polarity': 'Negative',
   'Source': [[], []],
   'Target': [['instruction'], ['14:25']]}],
 'sent_id': 'University_of_Maryland_University_College_3_01-03-2008-2',
 'text': 'The medium of instruction deserves some improvement , but otherwise , I think it has all the pros and cons of any regular F2F university .'}

In polar expression, deserves improvement is not a contiguous expression in the sentence. It should have been separated or have been combined with some.