microsoft / microxcaling

PyTorch emulation library for Microscaling (MX)-compatible data formats
MIT License
165 stars 21 forks source link

Large accuracy loss on MobileVit model #27

Open zks878 opened 3 months ago

zks878 commented 3 months ago

Hello everyone, I would like to reproduce the results in the paper. When converting to MX format on various models, I found that MobileVit experiences a significant accuracy loss (accuracy<1%), However this issue does not occur with ResNet-18 20 and 50.

I would like to ask if anyone else has encountered this situation and how to resolve it . Thank you!