search

devinit / ddw-analyst-ui

The Development Data Warehouse
http://ddw.devinit.org/
GNU General Public License v3.0
2 stars 1 forks source link

Povcalnet update #475

Closed k8hughes closed 3 years ago

k8hughes commented 3 years ago

Zach flagged this data has been updated, can we pull the update into the DDW?

k8hughes commented 3 years ago

@akmiller01 I think this happened yesterday didn't it?

akmiller01 commented 3 years ago

I triggered the update yesterday morning, it ran for about 10 hours but looking at the logs it seems to have encountered an error; so I may need to work on the code. the PovCalNetAgg and PovCalNetSmy tables finished, but PovCalNetP20 failed as well as PovCalNetDist.

akmiller01 commented 3 years ago

The World Bank no longer provides a headcount for the world at certain threshholds... I'll have to ask Dan/Zach about this: http://iresearch.worldbank.org/PovcalNet/PovcalNetAPI.ashx?Countries=all&GroupedBy=WB&povertyLine=1.9&RefYears=all&Display=Regional&format=csv

akmiller01 commented 3 years ago

Fixed the issues inline; we just won't have a P20 threshold in 2018/2019 while the WB omits that figure. PovCalNetDist is re-running now.

akmiller01 commented 3 years ago

https://github.com/devinit/ddw-analyst-ui/pull/479