apple / ml-cvnets

CVNets: A library for training computer vision networks
https://apple.github.io/ml-cvnets
Other
1.77k stars 225 forks source link

Segmentation accuracies are inconsistent #12

Open hkzhang-git opened 2 years ago

hkzhang-git commented 2 years ago

In the published paper, for segmentation w/ DeepLabv3, accuracies of MobileViT-XXS, MobileViT-XS and MobileViT-S are 73.6, 77.1 and 79.1 respectively. However, in readme-mobilevit.md, the authors states that the segmentation accuacies of the three mentioned models are 72.8, 77.1 and 79.3. For MobileViT-XXS, mIOU is change from 73.6 to 72.8. What causes such a big drop? Does the training process is very unstable?