dotnet / machinelearning-modelbuilder

Simple UI tool to build custom machine learning models.
Creative Commons Attribution 4.0 International
265 stars 56 forks source link

Can't Train Azure Model? #1824

Closed Philip2809 closed 2 years ago

Philip2809 commented 3 years ago

Hello There!

I wanted to do a quick project with machine learning and followed: https://docs.microsoft.com/en-us/dotnet/machine-learning/tutorials/object-detection-model-builder

BUT I ran into a problem; Visual studio thinks that the training failed when it did not according to Microsoft Azure Machine Learning Studio. I did it 3 times but got the same resultat. I can assure you I have a good internet connection because I am writing this and talking to people on discord. I even restarted visual studio, nothing helped.

Any help appreciated, Best regards Philip Magyar

IMAGES: image image

LOG: logfile.txt

Philip2809 commented 3 years ago

BTW I downloaded the latest verion from: https://marketplace.visualstudio.com/items?itemName=MLNET.07 earlier today, as I found; https://github.com/dotnet/machinelearning-modelbuilder/issues/1793

Philip2809 commented 3 years ago

I think I found out what I did wrong but correct my if I am incorrect, I had WAY too little to train on, only 9 images and all failed or "skipped"?

EDIT: did one with 56 images, still same error

zewditu commented 3 years ago

@ Philip2809 sorry for hitting the issue, I only reproduce this issue when I lost my connection. If you want to consume your model generated in Azure machine learning studio let us know, we will send you a sample project with code that shows how to consume your model. @beccamc any thought on this?

Philip2809 commented 3 years ago

Hi zewditu! I found another way to this issue, one that might even be more suitable for what I am trying to do: https://www.customvision.ai/

Tho I think this error was more a problem on my side; the files were not uploading correctly? I don't know, wierd thing it did do the training phase. If you want I can send a zip/rar with the files that that I tried training and the vott export json. Best Regards Philip Magyar

zewditu commented 3 years ago

@ Philip2809 please send your data. Assume your data is not in the proper format, are you expecting to get information on the data page if there is something wrong with your data instead of your training failure?

zewditu commented 3 years ago

@JakeRadMSFT @LittleLittleCloud and @beccamc are all data issues in OD notified to the user on the data page?

Philip2809 commented 3 years ago

ml_train_data.zip Here is the data: About the project, maybe weird but me and some friends wanted to find the position for the ender pearls on the screen from a screenshot for the game "Minecraft". And later use that data to find the angle and stuff to find where a thing is in the game.

Philip2809 commented 3 years ago

Stop-Signs.zip Here is the example stop-sign project, I deleted the images but you can just download them if you need them. I could not upload a 105 mb file here

beccamc commented 2 years ago

@v-Hailishi Can you try to reproduce this with the training data above?

v-Hailishi commented 2 years ago

@beccamc This issue is not repro on the latest main branch: 16.13.5.2222101 when I using above training data ml_train_data.zip image Run link in Azure portal: https://ml.azure.com/experiments/id/8ad34cd8-0b2e-445b-a3a7-5760c3306ece/runs/AutoML_5dd26aea-c5d5-4d2d-902a-ea6d8ebdb336?wsid=/subscriptions/83635e26-687a-4333-a2a0-33e3cd1f573a/resourceGroups/FullTestPass/providers/Microsoft.MachineLearningServices/workspaces/FullTestPass&tid=72f988bf-86f1-41af-91ab-2d7cd011db47#details

beccamc commented 2 years ago

@Philip2809 Can you update your Model Builder version and see if the problem is still happening?

Philip2809 commented 2 years ago

Hello! I no longer use this to image recognition, I used Custom Vision for a while to make a model and use it but later found out it wasn't what I was looking for. Also it turned out image recognition was not really used in the project I was working on so I stopped using it.

Sadly I no longer have the project where I was testing this stuff out as I have a new computer, the old one was erased. It it trains as it should now I would guess either the bug was fixed or something was wrong in my environment.

Best Regards Philip Magyar

beccamc commented 2 years ago

Thanks for the response Philip! Let us know if you run into any other problems using our product in the future.