OCHA-DAP / Data-Team

A place for tracking data team issues
0 stars 1 forks source link

Colombia IDP map data #94

Open cjhendrix opened 9 years ago

cjhendrix commented 9 years ago

Consider asking the Colombia office to create a dataset for the sub-national IDP data so we can link to it from the map.

luiscape commented 9 years ago

@cjhendrix we'll get it done.

Here is what OCHA Colombia will probably add to HDX:

The Data Team has jointly worked with OCHA Colombia on making the map. We are very familiar to where the files are and how to add them to HDX.

Now, I would like to highlight that this is related to an open issue on HDX about a large file size #1548. OCHA Colombia (Xitong) tried to upload the original 500Mb file (which is much more granular) to HDX and couldn't for some reason.

cjhendrix commented 9 years ago

Hi Luis. This has sparked an interesting discussion in our dev chat.

Do you know what is in this 500mb monster CSV? Is it a single indicator? Some sort of repository of historic data on many themes?

luiscape commented 9 years ago

The file is a database dumb. It is highly granular, divided by gender, age, and type of displacements. Records are daily and almost individualized. The file is anonymised.

Here is the file.

Xitong (from OCHA Colombia) wanted to add the file directly to HDX. OCHA Colombia has simplified the file to generate monthly or yearly indicators. Those can be used in place of the original database. But I feel that the original database was preferred instead of derivatives.