Google ML Kit

[hemangsk]

Plugin Request

Collection of plugins using Google's ML Kit for on-device ML.

Name: Google ML Kit Package: @capacitor-community/google-ml-kit

Platform(s)

• Android
• iOS

Existing Solutions

• Vision: https://github.com/trancee/capacitor-google-mlkit-vision/
• Language ID : https://github.com/hemangsk/capacitor-mlkit-language

Description

This SDK is available for both iOS and Android and seems to cover an extensive number of use cases.

• Vision

  • Text Recognition
  • Face Detection
  • Pose Detection
  • Barcode Scanning
  • Image Labeling
  • Object Detection and Tracking
  • Digital Ink Recognition

• Natural Language

  • Language Identification
  • Translate Text
  • Smart Replies

I think each of these could reside in their own plugins, where each plugin does one task and does it well.

[riderx]

@hemangsk i added your plugin to awesome-capacitor if that is useful please take time to star the repo as well :)

[andrew-lyons]

We've made a plugin for the Digital Ink library of this kit for our own organization's use. We would love to publish it, we structured it as an open-source project from the get go.

[andrew-lyons]

Made a proposal here

[NLueg]

I just published a plugin for Text Recognition: https://www.npmjs.com/package/@pantrist/capacitor-plugin-ml-kit-text-recognition

[andrew-lyons]

@NLueg Would love for some action on this issue or the one I proposed, would be cool to make a suite of plugins.

[riderx]

@NLueg Awesome work ! don't forget to add it to : https://github.com/riderx/awesome-capacitor :)

[typefox09]

Could we get image labeling in their also, something similar to the Cordova package offered:

https://ionicframework.com/docs/native/firebase-vision

[robingenz]

Hey everyone, I would like to share my new project https://github.com/capawesome-team/capacitor-mlkit with you. 🎉 It is exactly what this issue is about - a monorepo for Capacitor ML Kit Plugin just like https://github.com/capawesome-team/capacitor-firebase for Firebase. The following plugins are currently supported:

• 📷 Barcode Scanning
• 🔠 Translation

More plugins coming soon. PRs are welcome. I appreciate any feedback.

[andrew-lyons]

@robingenz Awesome! I'll take a look and may just make a PR to include the digital ink plugin I've developed thus far. If there's room for contributors would also love to see about contributing towards getting the whole ML Kit suite into ionic plugins.