openfoodfacts / openfoodfacts-ai

This is a tracking repo for all our AI projects. 🍕 🤖🍼
223 stars 52 forks source link

Train an object detection model to detect price tags from shelf images #352

Open raphael0202 opened 1 day ago

raphael0202 commented 1 day ago

Open Prices is a database of food prices from around the world. For data collections, we rely on volunteers that take pictures of individual price tags or shop shelves and complete the price on the web or mobile interface.

To accelerate contribution, we would like to crop automatically the individual price tags of shelf images, so that we can extract automatically the price and the barcode in a second step (or ask other volunteers to complete the data).

To illustrate, here is an proof image of a shop shelf:

Shop shelf

The idea is to train an object detection model that detect every individual price tag (the tag where the barcode and the price are written to).

We don't have a trained dataset to do so, we need first to annotate some data (with the help of the OFF community).

We have an instance of Label Studio running, that was already used to successfully annotate data for object detection models.

We also have a CLI that's a wrapper around Label Studio, and allow to easily upload/convert/pre-annotate data for object detection models. We usually use Yolov8 models for object detections, but other models can be explored as long as they can be converted to ONNX.

baslia commented 10 hours ago

I have some time to look at it, is there a way to get an account for Label Studio ? Additionally, some details on where the data is stored as well as how to access it would be helpful to assess how many data points are missing to fit a model. Thanks!