Issue with the reproduced results

clear-nus / octopi

19 stars 2 forks source link

Issue with the reproduced results #2

Open xiaoen0 opened 2 weeks ago

xiaoen0 commented 2 weeks ago

Hello authors,

Thank you for your excellent work.

I followed the training hyperparameters described in Section V-B of your paper to reproduce the results. However, I found significant discrepancies in the PC, POM, and PSS results compared to those reported in your paper, although the OPD results are largely consistent.

Have I overlooked any details? Could you provide an explanation for this situation or offer some suggestions for reproducing these results?

xiaoen0 commented 2 weeks ago

I reproduced the experience again, and the results improved. Could you please clarify how many times the experiment was repeated to obtain the average results reported in the paper?