BUPT-GAMMA / CompareNet_FakeNewsDetection

Compare to The Knowledge: Graph Neural Fake News Detection with External Knowledge (ACL 2021)
89 stars 35 forks source link

No such file or directory: 'ckpt/MODELNAME' #5

Open alvinsun724 opened 2 years ago

alvinsun724 commented 2 years ago

Hi, thanks for sharing the code. when I run the test command "python main.py --mode 1 --model_file MODELNAME" it has an error as below, I am wondering if you could help me please? Much appreciated

image

shiv6891 commented 2 years ago

It worked for me by giving MODELNAME only instead of ckpt/MODELNAME

alvinsun724 commented 2 years ago

It worked for me by giving MODELNAME only instead of ckpt/MODELNAME

Thank you, may I ask if you just use the test command "python main.py --mode 1 --model_file MODELNAME" or after using the train command "python main.py --mode 0"?

Additionally, I get the result as image and it seems different from the result shows in table 2, I am wondering if you have the same issue?

Thanks a lot

chenhz12 commented 2 years ago

Accuracy on the OOD test set 2: 0.6932 Precision on the OOD test set 2 macro / micro: 0.7136, 0.6932 Recall on the OOD test set 2 macro / micro: 0.6932, 0.6932 F1 on the OOD test set 2 macro / micro: 0.6883, 0.6932 Latex: 69.32 & 71.36 & 69.32 & 68.83

Accuracy on the OOD test set 2: 0.9165 Precision on the OOD test set 2 macro / micro: 0.9182, 0.9165 Recall on the OOD test set 2 macro / micro: 0.9168, 0.9165 F1 on the OOD test set 2 macro / micro: 0.9165, 0.9165 Latex: 91.65 & 91.82 & 91.68 & 91.65

This is my result and I think minor difference is acceptable.