jerbarnes / semeval22_structured_sentiment

SemEval-2022 Shared Task 10: Structured Sentiment Analysis
75 stars 42 forks source link

Mistake in MPQA annotation #30

Open sadra-barikbin opened 2 years ago

sadra-barikbin commented 2 years ago

Hi, Thanks for organizing this task.

Target expression of third opinion in MPQA train sample 1898 is seemingly wrong. It is the it within with !

   'Polar_expression': [['expressed the hope'], ['27:45']],
   'Polarity': 'Positive',
   'Source': [['Iranian president'], ['4:21']],
   'Target': [['it'], ['52:54']]}

Sentence is: The Iranian president also expressed the hope that with the return of President Chavez the Venezuelan government would be able to achieve its exalted objectives with the support of the people .

Also Target expression of second opinion in MPQA train sample 2293 is wrong as well. It is the American within Americans.

{'Intensity': 'Weak',
   'Polar_expression': [['avowed'], ['244:250']],
   'Polarity': 'Neutral',
   'Source': [['generals'], ['264:272']],
   'Target': [['American'], ['25:33']]}

Sentence is: In direct response , the Americans , who preach democracy to the entire planet , recognizing that they could no longer tolerate someone like Chavez reverted to their old bullying and dictatorial tactics and arranged for an army coup by several avowed pro-American generals , who managed to remove Chavez from power in a few short hours .

Furthermore, MPQA dev sample 2007 seems to be totally wrong:

{'opinions': [{'Intensity': 'Average',
   'Polar_expression': [[','], ['17:18']],
   'Polarity': 'Positive',
   'Source': [['sa'], ['12:14']],
   'Target': [[','], ['7:8']]}],
 'sent_id': 'xbank/wsj_0583-27',
 'text': 'Sansui , he said , is a perfect fit for Polly Peck \'s electronics operations , which make televisions , videocassette recorders , microwaves and other products on an " original equipment maker " basis for sale under other companies \' brand names .'}