openfoodfacts / openfoodfacts-server

Open Food Facts database, API server and web interface - 🐪🦋 Perl, CSS and JS coders welcome 😊 For helping in Python, see Robotoff or taxonomy-editor
http://openfoodfacts.github.io/openfoodfacts-server/
GNU Affero General Public License v3.0
640 stars 373 forks source link

Add new Agribalyse 3.1 categories (e.g. vegan and vegetarian products) to the categories taxonomy #7602

Closed stephanegigandet closed 1 year ago

stephanegigandet commented 1 year ago

Related to #7601

There are new Agribalyse categories that we need to add to the categories taxonomy, in particular some vegetarian and vegan categories:

25415_2 | 25415 | entrées et plats composés | sandwichs | Burger végétarien | Veggie burger 20914 | 20914 | entrées et plats composés | plats végétariens | Escalope végétale ou steak à base de soja | Soy patty or vegetable escalope 25593 | 25593 | entrées et plats composés | plats végétariens | Galette ou pavé au blé et soja (convient aux véganes ou végétaliens), préemballé | Plant-based patty or steak from wheat and soybean (vegan), prepacked 25227 | 25227 | entrées et plats composés | plats végétariens | Nuggets soja et blé (convient aux véganes ou végétaliens), préemballé | Soybean and wheat-based nuggets (vegan) 7815_2 | 7815 | entrées et plats composés | sandwichs | Wrap végétarien | Wheat tortilla wrap, filled with soy-based, vegetarian 20337 | 20337 | viandes, œufs, poissons | substituts de charcuterie | Saucisse végétale au tofu (convient aux véganes ou végétaliens), préemballée | Plant-based sausage with tofu (vegan)

(just a sample of new categories)

We will need to review the Agribalyse categories or proxy categories that we had for vegetarian and vegan categories, to see if there is now a better match.

teolemon commented 1 year ago

ciqual_food_name:en:Vegetable Bolognese sauce
ciqual_food_name:fr:Sauce végétale type bolognaise, préemballée
agribalyse_food_code:11219
ciqual_food_code:11219

ciqual_food_name:en:Syrup, agave
ciqual_food_name:fr:Sirop d'agave
agribalyse_food_code:31089
ciqual_food_code:31089

ciqual_food_name:en:Syrup, maple
ciqual_food_name:fr:Sirop d'érable
agribalyse_food_code:31034
ciqual_food_code:31034

ciqual_food_name:en:Coconut water
ciqual_food_name:fr:Boisson à la noix de coco, nature, préemballée
agribalyse_food_code:18011
ciqual_food_code:18011

ciqual_food_name:en:Coconut-based drink, plain, prepacked
ciqual_food_name:fr:Boisson à la noix de coco, nature, préemballée
agribalyse_food_code:18907
ciqual_food_code:18907

ciqual_food_name:en:Pineapple juice, reconstituted from a concentrate
ciqual_food_name:fr:Jus d'ananas, à base de concentré
agribalyse_food_code:2000
ciqual_food_code:2000

ciqual_food_name:en:Pineapple juice, pure juice
ciqual_food_name:fr:Jus d'ananas, pur jus
agribalyse_food_code:2073
ciqual_food_code:2073

ciqual_food_name:en:Beetroot juice, pure juice
ciqual_food_name:fr:Jus de betterave
agribalyse_food_code:1
ciqual_food_code:1

ciqual_food_name:en:Carrot juice, pure juice
ciqual_food_name:fr:Jus de carotte, pur jus
agribalyse_food_code:2006
ciqual_food_code:2006

ciqual_food_name:en:Lemon juice, pure juice
ciqual_food_name:fr:Jus de citron, pur jus
agribalyse_food_code:2028
ciqual_food_code:2028

ciqual_food_name:en:Mixed red fruits juice, pure juice
ciqual_food_name:fr:Jus de fruits rouges
agribalyse_food_code:0002
ciqual_food_code:0002

ciqual_food_name:en:Mango juice, fresh
ciqual_food_name:fr:Jus de mangue, frais
agribalyse_food_code:2023
ciqual_food_code:2023

ciqual_food_name:en:Grapefruit juice, pure juice
ciqual_food_name:fr:Jus de pamplemousse (pomelo), pur jus
agribalyse_food_code:2027
ciqual_food_code:2027

ciqual_food_name:en:Grape juice, pure juice
ciqual_food_name:fr:Jus de raisin, pur jus
agribalyse_food_code:2016
ciqual_food_code:2016

ciqual_food_name:en:Tomato juice, pure juice (average)
ciqual_food_name:fr:Jus de tomate, pur jus (aliment moyen)
agribalyse_food_code:2053
ciqual_food_code:2053

ciqual_food_name:en:Orange juice, reconstituted from a concentrate
ciqual_food_name:fr:Jus d'orange, à base de concentré
agribalyse_food_code:2012
ciqual_food_code:2012

ciqual_food_name:en:Fruit juice, mixed - apple base, standard
ciqual_food_name:fr:Jus multifruit - base pomme, standard
agribalyse_food_code:2048
ciqual_food_code:2048

ciqual_food_name:en:Apricot nectar
ciqual_food_name:fr:Nectar d'abricot
agribalyse_food_code:2043
ciqual_food_code:2043

ciqual_food_name:en:Banana nectar
ciqual_food_name:fr:Nectar de banane
agribalyse_food_code:2366
ciqual_food_code:2366

ciqual_food_name:en:Mango nectar
ciqual_food_name:fr:Nectar de mangue
agribalyse_food_code:2370
ciqual_food_code:2370

ciqual_food_name:en:Peach nectar
ciqual_food_name:fr:Nectar de pêche
agribalyse_food_code:2371
ciqual_food_code:2371

ciqual_food_name:en:Pear nectar
ciqual_food_name:fr:Nectar de poire
agribalyse_food_code:2054
ciqual_food_code:2054

ciqual_food_name:en:Orange nectar
ciqual_food_name:fr:Nectar d'orange
agribalyse_food_code:2375
ciqual_food_code:2375

ciqual_food_name:en:Wine, white, dry
ciqual_food_name:fr:Vin blanc sec
agribalyse_food_code:5215
ciqual_food_code:5215

ciqual_food_name:en:Wine, rose
ciqual_food_name:fr:Vin rosé
agribalyse_food_code:5216
ciqual_food_code:5216

ciqual_food_name:en:Wine, red
ciqual_food_name:fr:Vin rouge
agribalyse_food_code:5214
ciqual_food_code:5214

ciqual_food_name:en:Broth, stock or bouillon, beef
ciqual_food_name:fr:Bouillon de boeuf, déshydraté reconstitué
agribalyse_food_code:25930
ciqual_food_code:25930

ciqual_food_name:en:Broth, stock or bouillon, poultry
ciqual_food_name:fr:Bouillon de volaille
agribalyse_food_code:25947
ciqual_food_code:25947

ciqual_food_name:en:Plant-based ball with wheat and/or soybean, prepacked
ciqual_food_name:fr:Boulette végétale au soja et/ou blé, préemballée
agribalyse_food_code:25589
ciqual_food_code:25589

ciqual_food_name:en:Veggie burger
ciqual_food_name:fr:Burger végétarien
agribalyse_food_code:25415_2
ciqual_food_code:25415

ciqual_food_name:en:Sauerkraut, without garnish, drained, cooked
ciqual_food_name:fr:Choucroute, sans garniture, égouttée
agribalyse_food_code:25220
ciqual_food_code:25220

ciqual_food_name:en:Cheeseburger, double, from fast foods restaurant
ciqual_food_name:fr:Double cheeseburger, provenant de fast food
agribalyse_food_code:25415_1
ciqual_food_code:25415

ciqual_food_name:en:Soy patty or vegetable escalope
ciqual_food_name:fr:Escalope végétale ou steak à base de soja
agribalyse_food_code:20914
ciqual_food_code:20914

ciqual_food_name:en:Cereal patty (without soybean)
ciqual_food_name:fr:Galette de céréales aux légumes (sans soja), préemballé
agribalyse_food_code:25234
ciqual_food_code:25234

ciqual_food_name:en:Plant-based patty or steak from wheat and soybean (vegan), prepacked
ciqual_food_name:fr:Galette ou pavé au blé et soja (convient aux véganes ou végétaliens), préemballé
agribalyse_food_code:25593
ciqual_food_code:25593

ciqual_food_name:en:Soy-based patty, plain (vegetable steak), prepacked
ciqual_food_name:fr:Galette ou pavé au soja et légumes, préemballé
agribalyse_food_code:25596
ciqual_food_code:25596

ciqual_food_name:en:Soy-based minced, prepacked
ciqual_food_name:fr:Haché végétal à base de soja, préemballé
agribalyse_food_code:30181
ciqual_food_code:30181

ciqual_food_name:en:Soybean and wheat-based nuggets (vegan)
ciqual_food_name:fr:Nuggets soja et blé (convient aux véganes ou végétaliens), préemballé
agribalyse_food_code:25227
ciqual_food_code:25227

ciqual_food_name:en:Wheat tortilla wrap, filled with soy-based, vegetarian
ciqual_food_name:fr:Wrap végétarien
agribalyse_food_code:7815_2
ciqual_food_code:7815

ciqual_food_name:en:Grated carrots
ciqual_food_name:fr:Carottes râpées, avec sauce, préemballées
agribalyse_food_code:26257
ciqual_food_code:26257

ciqual_food_name:en:Clementine, pulp, raw
ciqual_food_name:fr:Clémentine, pulpe, crue
agribalyse_food_code:13024_2
ciqual_food_code:13082

ciqual_food_name:en:Strawberry, coulis
ciqual_food_name:fr:Coulis de fraise
agribalyse_food_code:0003
ciqual_food_code:0003

ciqual_food_name:en:Raspberry, coulis
ciqual_food_name:fr:Coulis de framboise
agribalyse_food_code:0004
ciqual_food_code:0004

ciqual_food_name:en:Mandarin, pulp, raw
ciqual_food_name:fr:Mandarine, pulpe, crue
agribalyse_food_code:13024_1
ciqual_food_code:13024

ciqual_food_name:en:Tamarind, mature fruit, pulp, raw
ciqual_food_name:fr:Tamarin, fruit immature, pulpe, cru
agribalyse_food_code:13080
ciqual_food_code:13080

ciqual_food_name:en:Milk, semi-skimmed, vitamin D fortified, UHT
ciqual_food_name:fr:Lait demi-écrémé, UHT, enrichi en vitamines
agribalyse_food_code:19037
ciqual_food_code:19037

ciqual_food_name:en:Plant-based spread-cheese type, with soybean, prepacked
ciqual_food_name:fr:Spécialité végétale type fromage à tartiner, au soja, préemballée
agribalyse_food_code:1027
ciqual_food_code:1027

ciqual_food_name:en:Plant-based cheese, without soybean, prepacked, sliced
ciqual_food_name:fr:Spécialité végétale type fromage en tranche, sans soja, préemballée
agribalyse_food_code:1029_1
ciqual_food_code:1029

ciqual_food_name:en:Plant-based cheese, without soybean, prepacked, shredded
ciqual_food_name:fr:Spécialité végétale type fromage râpé, sans soja, préemballée
agribalyse_food_code:1029_2
ciqual_food_code:1029

ciqual_food_name:en:Avocado oil
ciqual_food_name:fr:Huile d'avocat
agribalyse_food_code:17100
ciqual_food_code:17100

ciqual_food_name:en:Rum baba, prepacked
ciqual_food_name:fr:Baba au rhum, préemballé
agribalyse_food_code:19688
ciqual_food_code:19688

ciqual_food_name:en:Quinoa FR, raw
ciqual_food_name:fr:Quinoa FR, cru
agribalyse_food_code:9340_2
ciqual_food_code:9340

ciqual_food_name:en:Quinoa FR, boiled/cooked in water, unsalted
ciqual_food_name:fr:Quinoa FR, cuit
agribalyse_food_code:9341_2
ciqual_food_code:9341

ciqual_food_name:en:Quinoa, boiled/cooked in water, unsalted
ciqual_food_name:fr:Quinoa, bouilli/cuit à l'eau, non salé
agribalyse_food_code:9341_1
ciqual_food_code:9341

ciqual_food_name:en:Quinoa, raw
ciqual_food_name:fr:Quinoa, cru
agribalyse_food_code:9340_1
ciqual_food_code:9340

ciqual_food_name:en:Wheat tortilla wrap, to be filled
ciqual_food_name:fr:Tortilla souple (à garnir), à base de blé
agribalyse_food_code:7815_1
ciqual_food_code:7815

ciqual_food_name:en:Soy-based sliced
ciqual_food_name:fr:Bouchées ou émincé au soja et blé (ne convient pas aux véganes ou végétaliens), préemballé
agribalyse_food_code:25224
ciqual_food_code:25224

ciqual_food_name:en:Crab, boiled/cooked in water
ciqual_food_name:fr:Crabe ou Tourteau, bouilli/cuit à l'eau
agribalyse_food_code:10025
ciqual_food_code:10025

ciqual_food_name:en:Lobster, boiled/cooked in water
ciqual_food_name:fr:Homard, bouilli/cuit à l'eau
agribalyse_food_code:10009
ciqual_food_code:10009

ciqual_food_name:en:Dried deffated black soldier fly protein
ciqual_food_name:fr:Insecte (Mouche Soldat Noir)
agribalyse_food_code:0005
ciqual_food_code:0005

ciqual_food_name:en:European plaice, raw
ciqual_food_name:fr:Plie commune, crue
agribalyse_food_code:26055
ciqual_food_code:26055

ciqual_food_name:en:Soy protein, textured, rehydrated, from soy flour
ciqual_food_name:fr:Protéine de soja texturée
agribalyse_food_code:20591_1
ciqual_food_code:20591

ciqual_food_name:en:Soy protein, textured, dehydrated, from soy flour
ciqual_food_name:fr:Protéine de soja texturée, réhydratée
agribalyse_food_code:20591_2
ciqual_food_code:20591

ciqual_food_name:en:Plant-based sausage with wheat or seitan
ciqual_food_name:fr:Saucisse végétale au blé ou seitan, préemballé
agribalyse_food_code:25232
ciqual_food_code:25232

ciqual_food_name:en:Plant-based sausage with tofu (vegan)
ciqual_food_name:fr:Saucisse végétale au tofu (convient aux véganes ou végétaliens), préemballée
agribalyse_food_code:20337
ciqual_food_code:20337

ciqual_food_name:en:Seitan
ciqual_food_name:fr:Seitan, préemballé
agribalyse_food_code:25598
ciqual_food_code:25598

ciqual_food_name:en:Plant-based ham, prepacked
ciqual_food_name:fr:Spécialité végétale type jambon cuit, préemballée
agribalyse_food_code:1030
ciqual_food_code:1030

ciqual_food_name:en:Tofu, smoked
ciqual_food_name:fr:Tofu fumé, préemballé
agribalyse_food_code:20912
ciqual_food_code:20912
teolemon commented 1 year ago

Coordination Spreadsheet: https://docs.google.com/spreadsheets/d/1dnjpVtz1KQVaYR1VGIWZF9XJ4LnacHPmS1jmWs_fl0Y/edit#gid=0

john-gom commented 1 year ago

This will be added into the issue/7601 branch.

Spreadsheet here show matching with existing categories and where new categories need to be added.

Categories tab shows existing taxonomies and where an AGRIBALYSE code or proxy could be added. It may also be appropriate to add a further alias if the ARGRIBALYSE name is slightly different.

The AGRIBALYSE_summary tab shows where a match was found in the Categories taxonomy and where new Categories need to be added.

https://docs.google.com/spreadsheets/d/1z3XF_0P3xevrdpl3exUu0jhp5C6VV68hKt404djcuhI/edit?usp=sharing

john-gom commented 1 year ago

Question: Should we include all of the different mineral water brands that are included in AGRIBALYSE or just stick pick one as being representative?

aleene commented 1 year ago

Do they have different eco impact?

john-gom commented 1 year ago

Do they have different eco impact?

The scores are pretty similar, most have a total score of 0.03 and DQR is either 2.97 or 3.01. You can see for yourself in the ecoscore/agribalyse/AGRIBALYSE_xf.xlsm in GitHub

john-gom commented 1 year ago

Have run update_all_products script locally with new categories and has added ecoscore to around 9000 products.

summary.csv

john-gom commented 1 year ago

Here's the summary of products that still don't have an ecoscore, grouped by the last of their categories_tags: missing.csv