search

apple / turicreate

Turi Create simplifies the development of custom machine learning models.
BSD 3-Clause "New" or "Revised" License
11.19k stars 1.14k forks source link

Simple Image Classification Model gives different confidence level (Between Coreml UI and iOS App) #3468

Open VipulArvind opened 1 year ago

VipulArvind commented 1 year ago

Here is what I have done

  1. Create a model using Create ML Tool
  2. Test the model and it passes 100% times
  3. Verify by adding more images in UI tool and it passes
  4. Generate the .nlmodel file from CreateML UI
  5. use the model in iOS app and check the result of VNClassificationObservation.
  6. The confidence level is a lot different.
  7. And running this request on same image in program tends to finally put the correct confidence level (like in 3rd or 4th attempt)
  8. There is NOTHING fancy and I am using the simple app (https://iosexample.com/classifying-images-with-vision-and-core-ml/) to test my model