GanjinZero / ICD-MSMN

Code Synonyms Do Matter: Multiple Synonyms Matching Network for Automatic ICD Coding [ACL 2022]
https://arxiv.org/abs/2203.01515
50 stars 8 forks source link

Got a lower test_metric #12

Closed ghost closed 6 months ago

ghost commented 7 months ago

Hi, thanks for the great work.

After setting the embedding path and trained model path according to the readme, I ran the eval_model.py on the mimic-3 full dataset and got the following test results:

image

But these results are lower than the results in the paper, I don't know what the reason is, is there a problem with my settings?

Looking forward to your reply, Best wishes.

GanjinZero commented 7 months ago

I think if you use my trained model, you do not need embedding path. The AUC seems very odd.

ghost commented 7 months ago

Thank you for your reply, I think the problem is solved, I ran main.py trained a new model and got very close results.