search

MikeWangWZHL / EEG-To-Text

code for AAAI2022 paper "Open Vocabulary Electroencephalography-To-Text Decoding and Zero-shot Sentiment Classification"
152 stars 33 forks source link

Concerns about Incorrect Results and a Suggestion for Paper Withdrawal #6

Closed winterfell00 closed 6 months ago

winterfell00 commented 7 months ago

I don't mean to offend, but the results reported in your paper are incorrect. If, under the correct testing procedure, the results are completely different from what is stated in your paper, I believe it would be best for you to withdraw it to prevent any potential spread of misinformation.

A-Ayerh commented 6 months ago

I don't mean to offend, but the results reported in your paper are incorrect. If, under the correct testing procedure, the results are completely different from what is stated in your paper, I believe it would be best for you to withdraw it to prevent any potential spread of misinformation.

How were you able to run the eval_decoding.py file? I'm running into errors: AttributeError: 'list' object has no attribute 'squeeze' AttributeError: 'list' object has no attribute 'tolist'

And if I comment those out then the BLEU scores all end up as 0.

MikeWangWZHL commented 6 months ago

@winterfell00 Thanks for the suggestion, we will update the paper to make the unintented bug in the testing procedure clear to prevent any further confusion; I have also made this clear in the README note @A-Ayerh Thank you for the question, I have updated the .py eval_decoding.py file, let me know if the problem is still not fixed