Image Segmentation Android sample to support multiple models

ml-gde / e2e-tflite-tutorials

Project tracking of the "Mobile ML Working Group", for the End-to-End TensorFlow Lite tutorials.

Apache License 2.0

133 stars 26 forks source link

Image Segmentation Android sample to support multiple models #26

Open khanhlvg opened 4 years ago

khanhlvg commented 4 years ago

Currently the TFLite image segmentation sample only supports 1 segmentation model trained on COCO dataset with mobilenet_v2_0.5 backbone.

However, there are many different versions of image segmentation with different backbone architectures and trained on different datasets. We'd like to integrate these models into the sample app and allow users to try different models by selecting them from the sample app UI.

Please directly contribute pull request to the tensorflow/examples with this enhancement.

margaretmz commented 4 years ago

Just to add a bit more details to the requirements - you can refer to these 2 examples:

Image Classifier (Java, Camera2)
- download.gradle for downloading the various models
- [Classifier.java]() switches the models
- CameraActivity.java has the UI code to switch the models with modelSpinner
Cartoonizer (Kotlin, CameraX)
- Most of the code is in CameraFragment.kt with modelSpinner. The project uses ML Model Binding so the classes for loading the models and creating interpreters etc are the generated classes under app/build/generated/ml_source_out/debug/[package-name]/ml/

khanhlvg commented 4 years ago

FYI the TFLite team is working on updating the Android image segmentation model to demonstrate 2 ways of running segmentation models: with Task API and with Support Library + vanilla TFLite interpreter.

We should wait a few weeks before starting to work on this.