search

MedMNIST / experiments

Codebase for reproducible benchmarking experiments in MedMNIST v2
Apache License 2.0
44 stars 18 forks source link

Unable to Reproduce Results #11

Closed pervaizniazi closed 10 months ago

pervaizniazi commented 1 year ago

Hi There,

Thank you for releasing the code and dataset. I'm trying to reproduce results on BlooodMNIST and PneumoniaMNIST datasets for ResNet-50 (224). The average accuracies of 3 runs for these datasets are 1.51(for BlooodMNIST) and 2.12( for PneumoniaMNIST) less than from reported in the paper. I am using the same hypermaters mentioned in the code. What can be the issue?

duducheng commented 10 months ago

Probably due to randomness, which can never be avoided in machine learning settings. If you need to compare the results, you can also check our released weights.

Jiancheng