search

Azure / azure-sdk-for-python

This repository is for active development of the Azure SDK for Python. For consumers of the SDK we recommend visiting our public developer docs at https://learn.microsoft.com/python/azure/ or our versioned developer docs at https://azure.github.io/azure-sdk-for-python.
MIT License
4.54k stars 2.76k forks source link

Difference in values of confusion matrix after training between python sdk and what's displayed on vision portal. #35946

Open rishk2697 opened 3 months ago

rishk2697 commented 3 months ago

Describe the bug Im trying to perform object detection to determine if my book called X which has different front covers is present in the image or not!

Using python sdk, annotated images in local system, uploaded images & annotations via sdk, checked on portal - got uploaded with the region, did regular training via sdk and printed the performance metrics to cross check with what is shown in portal under performance tab, and got different results.

To Reproduce Steps to reproduce the behavior:

  1. Take set of images(100) for object detection
  2. Annotate them
  3. Upload images & annotations on the portal using sdk
  4. Regular train the model using python SDK
  5. Print confusion metrics in local
  6. Compare with what is displayed on the portal

Expected behavior Difference in values between what is displayed on portal and what is fetched using python sdk

Screenshots Metrics displayed on local Metrics displayed on portal

Additional context Also have made sure Iteration ID is correct, please refer both screenshots. Also I'd like to point it out again, Ive only done training, not quick test and I'm unable to understand why is there a difference in values.

xiangyan99 commented 3 months ago

Thanks for the feedback, we’ll investigate asap.