kevinscaria / InstructABSA

Instructional learning for Aspect Based Sentiment Analysis [NAACL-2024]
https://aclanthology.org/2024.naacl-short.63/
MIT License
135 stars 22 forks source link

Unable to reproduce the results #11

Closed SupritYoung closed 1 year ago

SupritYoung commented 1 year ago

Hello, I was not able to reproduce your results since your data is not open-sourced. I have transformed the data following the format you requested in your README, as shown in the attached image.

image

However, the results I obtained were far from the results reported in your paper. Would it be possible for you to open-source the data or help point out if there is any mistake in the data format transformation that might have caused this issue?

image
suntea233 commented 1 year ago

hi, did you get the entire dataset from other link? I saw the dataset is opened on kaggle. Did you train the model by the whole dataset and cannot reproduce the results in this paper?

kevinscaria commented 1 year ago

Dataset uploaded to the folder and the notebook to reproduce results is here.