Salt value divided by 1000 in some 3rd party edits

[stephanegigandet]

Yuka has been sending us salt values divided by 1000 (e.g. "nutriment_salt":"0.0017" with no unit specified (which makes it "g")). This has been going on for some time (~ January 25th 2020) but it did not happen with all edits.

Finding the affected edits is not obvious. I added data quality facets for low salt values. They have been computed for products edited by Yuka / kiliweb in the corresponding period:

Data quality	Products	*
nutrition-value-under-0-1-g-salt	9351	*
nutrition-value-under-0-001-g-salt	4342	*
nutrition-value-under-0-01-g-salt	4233	*

Not all of those products are affected by the bug. Most values < 0.1g but >= 0.01 g are correct. (but not all).

Most values < 0.01 g seem incorrect, but not all.

Action plan:

1. Stop new bad values.

• for existing products, reject salt values changes by Yuka that are more than 100 times lower than the previous value
• for new products added by Yuka, multiply by 1000 values < 0.001 g, reject values < 0.01 g or < 0.1g

2. Fix broken values

Apply similar logic.

[stephanegigandet]

Affected or possibly affected products:

Data quality	Products	*
yuka-salt-bug-new-salt-value-less-than-0-001-g	3841	*
yuka-salt-bug-new-salt-value-less-than-0-01-g	3495	*
yuka-salt-bug-new-salt-value-less-than-0-1-g	2654	*
yuka-salt-bug-salt-value-divided-by-more-than-100	843	*

[stephanegigandet]

Fixed.