kevinscaria / InstructABSA

Instructional learning for Aspect Based Sentiment Analysis [NAACL-2024]
https://aclanthology.org/2024.naacl-short.63/
MIT License
147 stars 24 forks source link

The ignorance of "conflict" label #18

Open Bigggapple opened 1 year ago

Bigggapple commented 1 year ago

Hi, I would like to know if you do any dataset processing in the joint task scenario. You mentioned in your paper that you have ignored the "conflict" label in ATSC task, so I want to know if you have deleted those sentences with "conflict" labels in the evaluation of the joint task. To be more specific, if the model did not predict the polarity as "conflict" in the joint task, would you ignore this wrong prediction? Because there are only examples for positive, neutral, and negative cases in the instruction, I was thinking about how you treat the "conflict" case in the joint task. Thank you.