search

openfoodfacts / smooth-app

The new Open Food Facts mobile application for Android and iOS, crafted with Flutter and Dart
https://world.openfoodfacts.org/open-food-facts-mobile-app?utm_source=off&utf_medium=web&utm_campaign=github-repo
Apache License 2.0
741 stars 260 forks source link

Allow to auto-magically extract nutrition facts from a photo #4896

Open rugk opened 6 months ago

rugk commented 6 months ago

Problem

I'm always frustrated when I have to enter the nutrition facts manually. :wink:

Proposed solution

Especially given the recent developments of machine learning models getting more powerful, I guess an automatic OCR/ML recognition would be possible? Could not you train a ML model based on your OpenFoodFacts data?

Additional context

Of course it has to be corrected manually, but it would already be a good starter.

Mockups

N/A (likely just similar to the other OCR features for ingredients e.g.)

teolemon commented 6 months ago

@raphael0202

teolemon commented 6 months ago

@rugk we plan to extract automatically nutrition next year using Robotoff (our machine learning system)

raphael0202 commented 6 months ago

@rugk Yes it's a project we would like to do in 2024! Is it something you would be interested in contributing to?

rugk commented 6 months ago

Likely not technically, but testing for sure.

teolemon commented 6 months ago
teolemon commented 2 months ago

@raphael0202 is actively working on this. More updates soon.