microsoft / VoTT

Visual Object Tagging Tool: An electron app for building end to end Object Detection Models from Images and Videos.
MIT License
4.28k stars 834 forks source link

Export to Azure Custom Vision Service exhibits random behavior... #939

Open freq-0ut opened 4 years ago

freq-0ut commented 4 years ago

Describe the bug After configuring an export to the "Azure Custom Vision Service" option, I try several times to export the assets in my VoTT project to my CustomVision.ai project, but am surprised to see the random results. Only some of the images actually get exported (despite what selection was made for "Asset State" in the configuration). What's worse, when the exported images show up in the CustomVision project, their tag info gets lost or mixed up, with some tagged items incorrectly showing up in the "Untagged" section. Executing the Export again (without changing ANY settings) will result it another random and incomplete set of images being exported to the CustomVision project, and again much of the tag info gets lost in the transfer. No matter how many times I re-execute the export, the images never arrive completely and correctly into the CustomVision project. What am I missing here?!

To Reproduce Steps to reproduce the behavior:

  1. In VoTT settings, configure an export for Azure Custom Vision Service
  2. Save and export the VoTT project
  3. When the export is complete, VoTT will say something like: "72 of 486 assets exported" (even if it was configured to export ALL ASSETS)
  4. Go to your CustomVision.ai project and examine the random results of the export.

Expected behavior If I select to export All Assets, it should. Or when I select to export only the Tagged Assets, it should. Instead, it only exports a random chunk of images, and much of the tag information gets lost in the transfer.

Desktop

Additional context Is there a different way to upload already-tagged images into the customvision.ai website? VoTT seems to be the ONLY tool that can do this, but I need it to do it correctly!