openfoodfacts / smooth-app

🤳🥫 The new Open Food Facts mobile application for Android and iOS, crafted with Flutter and Dart
https://world.openfoodfacts.org/open-food-facts-mobile-app?utm_source=off&utf_medium=web&utm_campaign=github-repo
Apache License 2.0
859 stars 285 forks source link

Supercharge the app with artificial intelligence (Tracker) #4027

Open teolemon opened 1 year ago

teolemon commented 1 year ago

What

### Tasks
- [ ] https://github.com/openfoodfacts/smooth-app/issues/3279
- [ ] https://github.com/openfoodfacts/smooth-app/issues/3986
- [ ] https://github.com/openfoodfacts/smooth-app/issues/3985
- [ ] https://github.com/openfoodfacts/smooth-app/issues/4069
- [ ] https://github.com/openfoodfacts/smooth-app/issues/3326
- [ ] https://github.com/openfoodfacts/smooth-app/issues/3775
- [ ] https://github.com/openfoodfacts/smooth-app/issues/3278
- [ ] https://github.com/openfoodfacts/smooth-app/issues/3340
- [ ] https://github.com/openfoodfacts/smooth-app/issues/2457
- [ ] Add optional offline ingredient extraction using MLKIT (disabled on the F-Droid build)
- [ ] Add offline packaging extraction using MLKIT (disabled on the F-Droid build)
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5654
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5652
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5653
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5007
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5655
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5006
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5008
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5401
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5402
- [ ] Add an optional button on the product page to jump to Hunger Games crops and logos view for the product
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5656
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5387
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5322
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5010
- [ ] Use the DUMP API to make an offline Hunger Games ? https://openfoodfacts.github.io/robotoff/references/api/#tag/Insights/paths/~1insights~1dump/get

Part of

teolemon commented 1 year ago

@raphael0202 I added the idea to do on-device language recognition here

teolemon commented 10 months ago

What

Create a custom Tensorflow model for MLKit to classify Nutrition facts, Packaging instruction, Front and Ingredients photo on device Create a custom Tensorflow model for MLKit to classify food, pet food, cosmetics and other products on device

How

https://developers.google.com/ml-kit/vision/image-labeling?hl=fr https://developers.google.com/ml-kit/vision/face-detection?hl=fr

teolemon commented 10 months ago

Explore using the on-device LLM for various tasks