The result is different with the readme.md in this repo.

microsoft / robustlearn

Robust machine learning for responsible AI

http://aka.ms/roblearn

MIT License

458 stars 57 forks source link

The result is different with the readme.md in this repo. #22

Closed 17679393389 closed 1 year ago

17679393389 commented 1 year ago

Hi,Doc Wang.I'm just download the code of Diversify and the dataset,and ran it use your second command that gave in the readme.md file.But my best result is 83.9% which your offer are 88%.I'm just want to know what is the reason? Thank you ,looking forward to your reply.

jindongwang commented 1 year ago

Which pytorch version do you use? Did you use the same environment as said in the readme file?

jindongwang commented 1 year ago

Please wait for a few days. We are rerunning the program using latest Pytorch version. I know that you may not get the best results as readme using newer version of Pytorch. We have the training logs available online at: https://wandb.ai/luw12thu/diversify.

jindongwang commented 1 year ago

Hi @17679393389 I have updated the results and hyperparameters to reproduce the results. Please refresh the code repo and see README file.