bm2-lab / PanPep

GNU General Public License v3.0
42 stars 9 forks source link

Can not repeat results in Output #9

Closed RysBen closed 9 months ago

RysBen commented 1 year ago

Hi there,

I ran PanPep with below commands:

python PanPep.py     --learning_setting few-shot     --input ./Data/Example_few-shot.csv     --output t1.csv
python PanPep.py     --learning_setting zero-shot     --input ./Data/Example_zero-shot.csv     --output t2.csv
python PanPep.py     --learning_setting majority     --update_step_test 1000     --input ./Data/Example_majority.csv     --output t3.csv

Then, I respectively compared t1.csv, t2.csv, t3.csv with Output/Example_few-shot_output.csv, Example_zero-shot_output.csv, Example_majority_output.csv. However, I could not repeat results in Output, below is the difference: image

Any suggestion would be appreciated.

GaoYiChengTJ commented 12 months ago

Hi, thanks for your interest in our work. Based on the very small errors of your results, it seems that this difference may raised by the device or random seed. I hope this response can resolve your question.