devinit / datahub

Datahub v2
http://data.devinit.org
15 stars 3 forks source link

Refining fiscal year transformations on domestic data #444

Open Duncan-Knox opened 5 years ago

Duncan-Knox commented 5 years ago

Aim to use transformation data aligned from calendar year to fiscal year to use for countries which have government finance data in fiscal year which differ to the calendar year. This would improve the quality of data through mitigating impact of inflation between the months not aligned for fiscal and calendar years.

This applies to:

Bangladesh, Bhutan, Dominica, Egypt, Ethiopia, Kenya, Malawi, Mauritius, Nepal, Pakistan, Rwanda, Samoa, South Sudan, Tanzania, Tonga, Uganda (July to June). Burundi has just changed to July-June FY also.

This is a back-end task currently involving Richard and Dan. It may require automation from Alex.

danjwalton commented 5 years ago

Datasets used (all from IMF WEO):

1) Calculate GDP CY (USD constant 2016) from GDP CY (USD current) and GDP CY growth 2) Conversion factor is then [GDP CY (USD constant 2016)] / [GDP FY (NCU current)]

elmetodo commented 5 years ago

I have had a look through all 13 July-June FY countries, and the data on the WEO is quite variable and can be split into three groups.

6 (Bhutan, Egypt, Ethiopia, Nepal, Pakistan and Samoa) only have data for FY in the WEO, so presume the defaltor data is also in FY

4 (Bangladesh, Dominica, Malawi and Mauritius) have NCU current GDP in FY, so we would need to collect US$ GDP also. Guessing deflators will therefore be in CY.

6 (Kenya, Rwanda, South Sudan, Tanzania, Tonga and Uganda) only have data for CY in the WEO, so we would need to collect GDP in NCU and US$. Guessing deflators will therefore be in CY.

danjwalton commented 5 years ago

6 (Bhutan, Egypt, Ethiopia, Nepal, Pakistan and Samoa) only have data for FY in the WEO, so presume the defaltor data is also in FY

Yes, the deflator is FY. We therefore need to calculate an appropriate CY base 2016 deflator.

4 (Bangladesh, Dominica, Malawi and Mauritius) have NCU current GDP in FY, so we would need to collect US$ GDP also. Guessing deflators will therefore be in CY.

For these 4 countries, the above conversion method will work.

6 (Kenya, Rwanda, South Sudan, Tanzania, Tonga and Uganda) only have data for CY in the WEO, so we would need to collect GDP in NCU and US$. Guessing deflators will therefore be in CY.

These 6 will prove more tricky - without access to any raw FY data from IMF, we will need to look at other sources.

elmetodo commented 5 years ago

Hi Dan,

Apologies I am slightly confused, maybe best to have a quick call. As the government finance data (NCU current) is in FY the idea was to have the transformation data be in FY too, as assuming was it was all CY. However, for the first 6 there is basically no need to change anything as the transformation data is in FY already.

On the last 6 this isn't too much of an issue, as there is NCU FY GDP (current) data in the IMF staff/program reports. Likely US$ GDP FY (current) in them also and GDP FY growth.

danjwalton commented 5 years ago

As the government finance data (NCU current) is in FY the idea was to have the transformation data be in FY too, as assuming was it was all CY. However, for the first 6 there is basically no need to change anything as the transformation data is in FY already.

I may be the one who's mistaken... I believe we are looking to have the data (FY or otherwise) in constant 2016 USD prices, which would mean we need to be able to deflate to CY 2016.

On the last 6 this isn't too much of an issue, as there is NCU FY GDP (current) data in the IMF staff/program reports. Likely US$ GDP FY (current) in them also and GDP FY growth.

Ah yes. For some reason I assumed the WEO would contain these FY data. You're definitely right that we can extract them from the programme reports.

Definitely happy to have a call - but I am quite croaky with my current cold.

Duncan-Knox commented 5 years ago

This is an ongoing task via @elmetodo and @danwdevinit and unlikely to impact developer capacity for the time being.

Duncan-Knox commented 5 years ago

Postponed into the new year. Added to agenda on discussion with Richard Watts on 11/12/2018.