search

micronutrientsupport / fct

Cleaning and standardisation of food composition tables
1 stars 2 forks source link

Fix text encoding #3

Closed rbroth closed 4 years ago

rbroth commented 4 years ago

The file MAPS_WAFCT has several text encoding errors. For example, food item 1 (code 01_172) has the following name: Baling béinré (northern Burkina Faso)*: sorghum porridge with monkey bread, tamarind, water, milk and sugar. Since it is unlikely that Burkina Fasoans use the copyright symbol in their food names, there must have been an error in converting the original FCT data into csv

LuciaSegovia commented 4 years ago

Hi Roman!

I've just seen this! Yeah, I know what you mean. I need to google how to fix that. 👍

rbroth commented 4 years ago

I'm quite busy on other project for the next few weeks, but I might be able to have a look at some point. See if you can identify the source of the problem; does the encoding problem exist in the source document? Or does it get introduced at some point during processing?

LuciaSegovia commented 4 years ago

No problem! It was introduced when saving it on csv and excel compatibility. It's sorted now :)

Closing this issue!