Closed dw8547 closed 7 years ago
I run a final sanity check on the automated individual donor ODA data series in DDW data series as follows: I downloaded all of the relevant .csv files from: https://github.com/devinit/digital-platform/tree/master/country-year/oda-donor and read the .csv files into tables. I then compared the content in these tables with fact.oda_donor_2012 applying a filer to 'from_di_id' as appropriate. For example, I compared:
https://github.com/devinit/digital-platform/tree/master/country-year/oda-donor/oda-AE
with:
SELECT
*
FROM fact.oda_donor_2012
WHERE from_di_id = 'AE'
AND year BETWEEN 2006 AND 2013
;
I did this for all of the files in https://github.com/devinit/digital-platform/tree/master/country-year/oda-donor. The files in this folder were updated/created at the time indicated in the repository. The data in fact.oda_donor_2012 was sourced from the OECD on 2016/01/20 as were the deflators used in the price conversion function which was used to convert the values into 2012 constant prices. Note: the OECD has not updated the deflators therefore they are out of sync with the CRS ⇒ minor data loss.
@xriss, it looks like the fact table fact.oda_donor_2012 has the right data in it (assuming what's in the .csv files in right). You can go ahead and replace the data with that from the DDW for these data series.
@xriss, the donor id 'afesd' has been removed (duplicate of 'arab-fund-afesd') & the donor id 'idb-specialfund' needs to be changed to 'idb-special-fund'.
@robtew, @timstrawson, @bill-anderson, I have checked the above automated data series originating from the OECD as follows: I downloaded all of the relevant .csv files from: https://github.com/devinit/digital-platform/tree/master/country-year/oda-donor and read the .csv files into tables. I then compared the content in these tables with fact.oda_donor_2012 applying a filer to 'from_di_id' as appropriate. For example, I compared:
https://github.com/devinit/digital-platform/tree/master/country-year/oda-donor/oda-AE
with:
SELECT
*
FROM fact.oda_donor_2012
WHERE from_di_id = 'AE'
AND year BETWEEN 2006 AND 2013
;
I did this for all of the files in https://github.com/devinit/digital-platform/tree/master/country-year/oda-donor. The files in this folder were created/updated at the time indicated in the repository. The data in fact.oda_donor_2012 was sourced from the OECD on 2016/01/20 as were the deflators used in the price conversion function which was used to convert the values into 2012 constant prices. Note: the OECD has not updated the deflators therefore they are out of sync with the CRS ⇒ minor data loss.
As the individual row differences look reasonable, I have let @xriss know that it is OK for him & @notshi to go ahead and replace the relevant data.
Here is a summary of the comparison in terms of the % error calculated as (dh - ddw) / dh) * 100. Please get in touch if you would like to examine and/or talk through any of these individually.
Below, I only show individual rows if the row error is > |1|%. If this number of rows is > 100 I only note the total number of rows that differed where the error is > |1|%. I have also indicated for which data series the total number of differing rows was 0. This is due to either a genuine lack of differences or a lack of data in either of the sources i.e., no matching rows.
A negative % error indicates that the DH row has a lower $ figure and a positive % error indicates that the DH row has a higher $ figure when compared with the corresponding row in DDW.
/*
from_di_id = 'AE'
id | year | dh_value | ddw_value | % error
----+------+-----------+-----------+---------
AZ | 2012 | 52711090 | 0 | 100
JO | 2012 | 251368000 | 1368001 | 99
OM | 2009 | 146619070 | 133350761 | 9
OM | 2010 | 25053649 | 12884506 | 49
PS | 2009 | 230548213 | 241308501 | -5
SD | 2010 | 54471198 | 37024533 | 32
SD | 2011 | 32318770 | 8368816 | 74
SD | 2012 | 15656049 | 7543986 | 52
(8 rows)
*/
/*
from_di_id = 'afdb'
id | year | dh_value | ddw_value | % error
----+------+-----------+-----------+---------
CD | 2010 | 139239989 | 107654438 | 23
GM | 2011 | 335964 | 46857 | 86
(2 rows)
*/
/*
from_di_id = 'arab-fund-afesd'
(0 rows)
*/
/*
from_di_id = 'asdb_special_funds'
(0 rows)
*/
/*
id | year | value | value | % error
----+------+---------+---------+---------
BT | 2011 | 3655278 | 2472293 | 32
(1 row)
*/
/*
from_di_id = 'AU'
id | year | value | value | % error
----+------+----------+----------+---------
AM | 2009 | 7 | 6 | 14
AZ | 2009 | 44 | 42 | 5
ET | 2012 | 29398609 | 27919723 | 5
ET | 2013 | 14708930 | 14469518 | 2
HN | 2009 | 106 | 108 | -2
HN | 2012 | 2355244 | 876391 | 63
HN | 2013 | 1183669 | 967008 | 18
HT | 2009 | 127 | 125 | 2
KE | 2012 | 22791494 | 21312636 | 6
LR | 2013 | 7907054 | 7679075 | 3
ML | 2012 | 11404577 | 9925727 | 13
ML | 2013 | 6616698 | 6390898 | 3
MV | 2012 | 8997717 | 7518866 | 16
MV | 2013 | 8071519 | 7843265 | 3
NP | 2012 | 45082067 | 43603173 | 3
TZ | 2012 | 10301919 | 8823060 | 14
TZ | 2013 | 13076638 | 12839968 | 2
(17 rows)
*/
/*
from_di_id = 'badea'
(0 rows)
*/
/*
from_di_id = 'BE'
(0 rows)
*/
/*
from_di_id = 'CA'
id | year | value | value | % error
-----------------+------+-----------+-----------+---------
america | 2010 | 114229298 | 108834778 | 5
america | 2012 | 140353780 | 134238071 | 4
AO | 2011 | 1024770 | 608921 | 41
asia | 2010 | 254776487 | 249285708 | 2
asia | 2012 | 254975960 | 248860325 | 2
BF | 2011 | 26339113 | 25886739 | 2
BI | 2011 | 2835287 | 2416823 | 15
BJ | 2011 | 7784903 | 7359300 | 5
BT | 2011 | 918790 | 503093 | 45
CF | 2011 | 5843997 | 5421189 | 7
CL | 2012 | 3532168 | 2856625 | 19
DJ | 2011 | 2875593 | 2457074 | 15
DO | 2012 | 1879491 | 2004592 | -7
ER | 2011 | 758945 | 343480 | 55
europe | 2010 | 32940664 | 27601562 | 16
europe | 2012 | 29628787 | 23513080 | 21
GM | 2011 | 2973904 | 2555242 | 14
GN | 2011 | 2563958 | 2145889 | 16
GQ | 2011 | 1581185 | 1164531 | 26
GW | 2011 | 847208 | 431615 | 49
KH | 2011 | 18265331 | 17824604 | 2
KI | 2011 | 720378 | 304968 | 58
KM | 2011 | 669239 | 253903 | 62
LA | 2011 | 2709290 | 2291008 | 15
LR | 2011 | 7831577 | 7405902 | 5
LS | 2011 | 1400094 | 983703 | 30
MG | 2011 | 1949755 | 1532568 | 21
MM | 2011 | 4154806 | 3734441 | 10
MR | 2011 | 553546 | 138377 | 75
MV | 2011 | 557940 | 142765 | 74
MW | 2011 | 12559160 | 12126670 | 3
NE | 2011 | 11264824 | 10834196 | 4
NP | 2011 | 11945318 | 11513706 | 4
PE | 2012 | 30629571 | 30139168 | 2
RW | 2011 | 11923724 | 11492142 | 4
SL | 2011 | 6725968 | 6301891 | 6
SO | 2011 | 24191221 | 23741921 | 2
south-of-sahara | 2010 | 298006922 | 292487120 | 2
ST | 2011 | 504014 | 88917 | 82
TD | 2011 | 9455987 | 9027969 | 5
TG | 2011 | 1420191 | 1003772 | 29
TL | 2011 | 1310520 | 894257 | 32
TV | 2011 | 483317 | 68250 | 86
UG | 2011 | 6493367 | 6069627 | 7
VU | 2011 | 1654323 | 1237564 | 25
WS | 2011 | 519505 | 104385 | 80
YE | 2011 | 5616545 | 5194077 | 8
ZM | 2011 | 7574072 | 7148770 | 6
(48 rows)
*/
/*
from_di_id = 'CH'
id | year | value | value | % error
-----------------------+------+----------+----------+---------
africa | 2012 | 33086075 | 36984109 | -12
AL | 2010 | 15583619 | 15171264 | 3
america | 2011 | 7746273 | 11247132 | -45
america | 2012 | 11074785 | 12049301 | -9
europe | 2011 | 28258858 | 23006893 | 19
europe | 2012 | 33312394 | 28112402 | 16
IN | 2011 | 10514615 | 19870730 | -89
KH | 2011 | 5125361 | 7166305 | -40
LA | 2011 | 23289085 | 25293323 | -9
middle-east | 2012 | 10319595 | 8816506 | 15
middle-east | 2013 | 12245308 | 12002177 | 2
MN | 2012 | 15638551 | 20511080 | -31
north-central-america | 2012 | 24961273 | 35680850 | -43
north-of-sahara | 2011 | 5499771 | 16304611 | -196
south-of-sahara | 2011 | 41671321 | 65030582 | -56
south-of-sahara | 2012 | 53021898 | 60817960 | -15
TD | 2011 | 12503652 | 12902406 | -3
VN | 2011 | 20149157 | 28899719 | -43
(18 rows)
*/
/*
from_di_id = 'CZ'
(0 rows)
*/
/*
from_di_id = 'DE'
(0 rows)
*/
/*
from_di_id = 'DK'
(0 rows)
*/
/*
from_di_id = 'ebrd'
(0 rows)
*/
/*
from_di_id = 'EE'
(0 rows)
*/
/*
from_di_id = 'ES'
(0 rows)
*/
/*
from_di_id = 'EU'
id | year | value | value | % error
-----------------------+------+-----------+------------+---------
AL | 2011 | 80965947 | 120577315 | -49
AM | 2011 | 89558618 | 93458207 | -4
america | 2011 | 38950772 | 49669845 | -28
BA | 2011 | 74297663 | 276257882 | -272
BF | 2011 | 129354816 | 141715339 | -10
BR | 2011 | 16722016 | 144562386 | -765
CD | 2011 | 283458607 | 300104279 | -6
CG | 2011 | 18590820 | 24463392 | -32
CL | 2011 | 14681113 | 88971491 | -506
CM | 2011 | 64674729 | 71180544 | -10
CN | 2011 | 44314921 | 190595770 | -330
CV | 2011 | 21351390 | 30340099 | -42
EG | 2011 | 62651161 | 105501355 | -68
ET | 2011 | 192361782 | 198619486 | -3
GE | 2011 | 132718690 | 171512715 | -29
JO | 2011 | 105468795 | 135919330 | -29
KE | 2011 | 115932601 | 133612494 | -15
LB | 2011 | 51236272 | 110131971 | -115
LR | 2010 | 90454991 | 94884911 | -5
MA | 2011 | 198643449 | 392650033 | -98
MD | 2011 | 140147672 | 158374584 | -13
ME | 2011 | 22467754 | 70109759 | -212
MG | 2011 | 30953911 | 67573805 | -118
MK | 2011 | 68401113 | 116992091 | -71
MR | 2011 | 67951497 | 87357365 | -29
MU | 2011 | 74161609 | 75362721 | -2
MW | 2011 | 67733590 | 75785006 | -12
MX | 2011 | 9446458 | 106123022 | -1023
MZ | 2011 | 120782879 | 152415996 | -26
north-central-america | 2011 | 24929144 | 44603960 | -79
north-of-sahara | 2010 | 137306551 | 204127127 | -49
north-of-sahara | 2011 | 121048486 | 131621417 | -9
PA | 2011 | 751682 | 12766914 | -1598
RS | 2011 | 246726992 | 997185473 | -304
SC | 2012 | 5929699 | 14363600 | -142
SN | 2011 | 105325422 | 113906849 | -8
south-of-sahara | 2011 | 413078473 | 475179567 | -15
SY | 2011 | 34230855 | 37324516 | -9
TG | 2009 | 46227599 | 50246277 | -9
TN | 2011 | 169785506 | 447896880 | -164
TR | 2011 | 407698424 | 2686990440 | -559
UA | 2011 | 141990993 | 209692350 | -48
UG | 2011 | 158921999 | 174888663 | -10
VN | 2011 | 61869131 | 138093324 | -123
ZA | 2011 | 185947266 | 302153181 | -62
(45 rows)
*/
/*
from_di_id = 'FI'
(0 rows)
*/
/*
from_di_id = 'FR'
id | year | value | value | % error
-----------------------+------+-----------+-----------+---------
AF | 2013 | 51900108 | 48001435 | 8
AL | 2013 | 34717012 | 4489837 | 87
AM | 2013 | 25020146 | 10825873 | 57
AO | 2013 | 9212467 | 5058923 | 45
AZ | 2013 | 8714644 | 2887554 | 67
BA | 2013 | 3186533 | 2605938 | 18
BD | 2013 | 49381892 | 9973195 | 80
BT | 2013 | 566423 | 113966 | 80
CD | 2013 | 77217949 | 34731984 | 55
CG | 2011 | 82470737 | 84227405 | -2
CI | 2013 | 229702102 | 225666286 | 2
CN | 2009 | 394928158 | 405027599 | -3
CN | 2010 | 361331836 | 375339452 | -4
CN | 2011 | 322383595 | 330104078 | -2
CN | 2013 | 245270074 | 226008370 | 8
CO | 2010 | 128033268 | 160954839 | -26
CO | 2011 | 128446114 | 168856994 | -31
CU | 2013 | 2982340 | 2792787 | 6
DJ | 2013 | 48648471 | 41350783 | 15
DO | 2011 | 75871709 | 103948485 | -37
DO | 2013 | 28206614 | 26820268 | 5
DZ | 2013 | 143075080 | 132588942 | 7
ER | 2013 | 3621768 | 625628 | 83
europe | 2013 | 1668273 | 108468469 | -6402
GE | 2013 | 20769722 | 15791580 | 24
GM | 2013 | 1659338 | 885788 | 47
GN | 2013 | 150921678 | 133324767 | 12
GQ | 2013 | 5686209 | 4374300 | 23
GY | 2013 | 444914 | 146778 | 67
HT | 2013 | 62526534 | 48834633 | 22
ID | 2009 | 211628196 | 289334260 | -37
ID | 2010 | 268223714 | 345233086 | -29
IQ | 2013 | 14913819 | 14413265 | 3
IR | 2013 | 14102261 | 12802122 | 9
JO | 2009 | 50912995 | 63914431 | -26
JO | 2011 | 21751819 | 25145044 | -16
KE | 2010 | 135661936 | 141183137 | -4
KE | 2011 | 105094764 | 106689765 | -2
KG | 2013 | 1940798 | 1552480 | 20
KM | 2013 | 41286598 | 38803105 | 6
KZ | 2013 | 4904147 | 3915458 | 20
LK | 2013 | 40299982 | 18717132 | 54
LR | 2013 | 1546268 | 1438178 | 7
LY | 2013 | 6588411 | 5994526 | 9
MD | 2013 | 41173824 | 6208457 | 85
ME | 2013 | 999499 | 659516 | 34
middle-east | 2013 | 2487528 | 13803076 | -455
MK | 2013 | 4675863 | 2809475 | 40
ML | 2013 | 108817077 | 96965306 | 11
MN | 2013 | 3566878 | 2277012 | 36
MR | 2013 | 49249519 | 38916842 | 21
MV | 2007 | 1863932 | 2519944 | -35
MZ | 2011 | 17887857 | 19517006 | -9
NA | 2009 | 6128543 | 7653140 | -25
NG | 2013 | 54001372 | 44084444 | 18
north-central-america | 2013 | 629771 | 16541470 | -2527
north-of-sahara | 2013 | 7135938 | 23575775 | -230
NP | 2013 | 2149038 | 1497476 | 30
PE | 2013 | 17117725 | 16714357 | 2
PK | 2013 | 52401206 | 36897097 | 30
RS | 2013 | 9030975 | 7869669 | 13
RW | 2013 | 8677055 | 7577222 | 13
SD | 2013 | 15635057 | 8376723 | 46
SL | 2013 | 1300440 | 424049 | 67
SO | 2013 | 7532015 | 3549527 | 53
south-america | 2013 | 6275573 | 8116326 | -29
south-central-asia | 2013 | 972137 | 111007517 | -11319
south-of-sahara | 2013 | 16489097 | 162926184 | -888
SY | 2013 | 27599182 | 19674128 | 29
TD | 2013 | 43229355 | 40613081 | 6
TG | 2013 | 28752770 | 27643942 | 4
TR | 2013 | 56579307 | 53506596 | 5
UA | 2013 | 28478248 | 13321914 | 53
UG | 2013 | 5302848 | 5138264 | 3
UZ | 2013 | 2473027 | 2380390 | 4
XK | 2013 | 25414060 | 7389356 | 71
ZA | 2010 | 20382346 | 23272812 | -14
ZA | 2011 | 40924324 | 175620324 | -329
(78 rows)
*/
/*
from_di_id = 'gavi'
id | year | dh_value | ddw_value | % error
----+------+-----------+-----------+---------
AF | 2009 | 19590856 | 18404407 | 6
AL | 2009 | 108225 | -484185 | 547
AO | 2013 | 4638388 | 4530129 | 2
AZ | 2007 | 135607 | 126405 | 7
BA | 2007 | 450168 | 436271 | 3
BA | 2009 | 11326 | 9826 | 13
BD | 2007 | 9611177 | 9010469 | 6
BD | 2008 | 28756618 | 28195778 | 2
BT | 2010 | 72991 | 42553 | 42
BT | 2013 | 55852 | 52052 | 7
CD | 2008 | 71942443 | 69111563 | 4
CD | 2009 | 27774546 | 25845203 | 7
CD | 2010 | 48813167 | 43985027 | 10
CG | 2008 | 2215895 | 2056629 | 7
CG | 2010 | 836858 | 689934 | 18
CG | 2013 | 5535961 | 5417384 | 2
CI | 2008 | 10139605 | 9469035 | 7
CI | 2009 | 6893732 | 5919971 | 14
CI | 2013 | 3924752 | 3409493 | 13
CM | 2008 | 7050320 | 6737465 | 4
CM | 2013 | 25316857 | 22998604 | 9
ER | 2008 | 712592 | 529846 | 26
ET | 2007 | 139046581 | 117784535 | 15
GH | 2008 | 7436520 | 7240755 | 3
GH | 2010 | 7786241 | 7157904 | 8
GH | 2013 | 43582652 | 41090234 | 6
GM | 2009 | 1161944 | 862486 | 26
GN | 2007 | 721180 | 661889 | 8
ID | 2013 | 41430613 | 37790145 | 9
IN | 2007 | 18126276 | 15987511 | 12
IN | 2009 | 3044592 | 1536163 | 50
KE | 2009 | 12501176 | 12176713 | 3
KG | 2008 | 1900803 | 1799207 | 5
KH | 2008 | 1019131 | 949450 | 7
KI | 2008 | 127880 | 115438 | 10
KM | 2013 | 249060 | 240799 | 3
KP | 2008 | 1666187 | 1558607 | 6
LA | 2008 | 704212 | 689191 | 2
LA | 2009 | 984672 | 618877 | 37
MD | 2009 | 4226 | -7107 | 268
MG | 2008 | 10349356 | 10011371 | 3
MM | 2007 | 965744 | -1005996 | 204
MM | 2008 | 3281503 | 3214213 | 2
MN | 2013 | 264152 | 255483 | 3
MR | 2009 | 1039687 | 943794 | 9
MR | 2013 | 2375850 | 2218927 | 7
MW | 2013 | 18068465 | 17513323 | 3
NE | 2013 | 22218030 | 20674491 | 7
NG | 2009 | 6619917 | 5477117 | 17
NG | 2013 | 148890530 | 146181385 | 2
NP | 2007 | 3131530 | 957796 | 69
NP | 2009 | 2344085 | 2256725 | 4
NP | 2013 | 3410304 | 2539860 | 26
PG | 2008 | 5708489 | 3422643 | 40
PG | 2009 | 26039 | -2033198 | 7908
PK | 2008 | 89123123 | 72312168 | 19
PK | 2009 | 43497617 | 33365073 | 23
RW | 2013 | 21542341 | 21043737 | 2
SB | 2008 | 305623 | 205317 | 33
SD | 2008 | 17535365 | 17262703 | 2
SL | 2007 | 5051404 | 3724718 | 26
SN | 2007 | 10634277 | 7764404 | 27
SN | 2013 | 22770594 | 20176207 | 11
ST | 2010 | 76730 | 75394 | 2
ST | 2013 | 331423 | 314637 | 5
TD | 2013 | 4053294 | 3577194 | 12
TG | 2008 | 4950466 | 3497459 | 29
TJ | 2007 | 46596 | 36273 | 22
TJ | 2008 | 5440750 | 3377261 | 38
TZ | 2008 | 11748606 | 11562686 | 2
TZ | 2013 | 47859463 | 46137576 | 4
UA | 2007 | 307791 | 293169 | 5
UA | 2008 | 140023 | 126077 | 10
UG | 2013 | 31243666 | 30755598 | 2
UZ | 2009 | 6159027 | 5998162 | 3
UZ | 2013 | 2465570 | 1116213 | 55
VN | 2009 | 14158229 | 2570116 | 82
YE | 2009 | 4368129 | 4299424 | 2
ZM | 2013 | 18223060 | 17949673 | 2
(79 rows)
*/
/*
from_di_id = 'GB'
(0 rows)
*/
/*
from_di_id = 'gef'
id | year | value | value | % error
-----------------------+------+----------+----------+---------
africa | 2009 | 8239459 | 8449634 | -3
america | 2008 | 1454833 | 3229758 | -122
america | 2009 | 4204008 | 6662729 | -58
AO | 2009 | 2133685 | 2177957 | -2
AO | 2010 | 862615 | 901124 | -4
BO | 2008 | 208050 | 242853 | -17
CD | 2009 | 2522866 | 2577507 | -2
CF | 2009 | 225281 | 234277 | -4
CM | 2009 | 808475 | 875025 | -8
CN | 2008 | 34453791 | 35427949 | -3
CN | 2010 | 58603617 | 59595058 | -2
CU | 2008 | 595749 | 1260352 | -112
CU | 2009 | 1140623 | 1944785 | -71
CU | 2010 | 2491648 | 2784793 | -12
CV | 2006 | 231639 | 280978 | -21
CV | 2007 | 21389 | 120467 | -463
CV | 2008 | 1600631 | 1635256 | -2
EG | 2008 | 2194966 | 2245707 | -2
GE | 2008 | 951847 | 968477 | -2
GH | 2009 | 1603042 | 1629854 | -2
GH | 2010 | 3355194 | 3495227 | -4
GM | 2009 | 140294 | 251569 | -79
GM | 2010 | 255292 | 359487 | -41
GY | 2008 | -931671 | 121101 | 113
HT | 2008 | 62515 | 98817 | -58
ID | 2007 | 2245867 | 3151138 | -40
ID | 2008 | 3532490 | 4221143 | -19
ID | 2009 | 4810667 | 6018385 | -25
ID | 2010 | 6257536 | 7960769 | -27
IR | 2009 | 937449 | 1080039 | -15
KE | 2010 | 2882721 | 2934383 | -2
KG | 2009 | 866987 | 925348 | -7
KH | 2007 | 160419 | 272797 | -70
KH | 2008 | 1431478 | 1529996 | -7
KH | 2009 | 1170548 | 1320104 | -13
KH | 2010 | 1407094 | 1545246 | -10
LA | 2010 | 1944915 | 2068870 | -6
MD | 2007 | 2876849 | 3031159 | -5
MD | 2009 | 1122044 | 1190098 | -6
MD | 2010 | 1190711 | 1290567 | -8
MN | 2008 | 1387313 | 1810467 | -31
MR | 2008 | -9523 | -6395 | 33
MU | 2008 | 3352816 | 3439186 | -3
MU | 2010 | 4685515 | 4850166 | -4
MV | 2009 | 691037 | 726063 | -5
MW | 2008 | 434402 | 454026 | -5
MW | 2009 | 159759 | 229194 | -43
NA | 2007 | 1625580 | 1701846 | -5
north-central-america | 2007 | 3026573 | 3904354 | -29
north-central-america | 2008 | 3496409 | 4221760 | -21
north-central-america | 2009 | 3543756 | 4573261 | -29
north-central-america | 2010 | 4358764 | 5464597 | -25
NP | 2008 | 967144 | 989443 | -2
PA | 2006 | 46328 | 47302 | -2
PA | 2007 | 534730 | 695019 | -30
PA | 2008 | 387786 | 474184 | -22
PA | 2009 | 371192 | 561625 | -51
PG | 2009 | 274150 | 278936 | -2
SD | 2009 | 3628347 | 4028320 | -11
SL | 2008 | 154524 | 206038 | -33
SL | 2009 | 16055 | 26497 | -65
SN | 2008 | 5642587 | 7150762 | -27
south-america | 2007 | 6341901 | 7301521 | -15
south-america | 2008 | 290224 | 2607536 | -798
south-america | 2009 | 317751 | 1945325 | -512
south-america | 2010 | 3187969 | 5087228 | -60
south-central-asia | 2010 | 1171926 | 3689546 | -215
south-of-sahara | 2010 | 11061945 | 17868349 | -62
TN | 2009 | 2046017 | 2099358 | -3
TN | 2010 | 4175998 | 4373354 | -5
TR | 2006 | 3451422 | 3506473 | -2
TR | 2007 | 3379495 | 3640673 | -8
TR | 2009 | 1521206 | 1556858 | -2
TR | 2010 | 1510068 | 1625349 | -8
TT | 2008 | 186145 | 219769 | -18
TT | 2009 | 67389 | 84615 | -26
TZ | 2008 | 2459599 | 2612410 | -6
UA | 2009 | 2378461 | 2577475 | -8
UG | 2007 | 3507830 | 3722610 | -6
UG | 2008 | 1790801 | 1912691 | -7
UG | 2009 | 2544526 | 2632591 | -3
UY | 2008 | 1008165 | 1321541 | -31
VN | 2007 | 2299340 | 2580501 | -12
VN | 2008 | 10360425 | 10545924 | -2
VN | 2009 | 6199750 | 6338140 | -2
VN | 2010 | 6447060 | 6734933 | -4
YE | 2010 | 640259 | 665074 | -4
ZA | 2008 | 5725067 | 5946561 | -4
ZA | 2010 | 13671194 | 14545010 | -6
ZM | 2006 | 1320343 | 1366424 | -3
ZM | 2007 | 1294047 | 1531834 | -18
ZM | 2008 | 1527341 | 2830489 | -85
ZM | 2009 | 2053780 | 2719638 | -32
ZM | 2010 | 3632745 | 4112034 | -13
(94 rows)
*/
/*
from_di_id = 'global-fund'
id | year | value | value | % error
----+------+----------+----------+---------
BO | 2006 | 6684454 | 6799280 | -2
BO | 2007 | 3594917 | 3902489 | -9
CR | 2006 | 522925 | 624291 | -19
CR | 2008 | 442219 | 551448 | -25
GN | 2006 | -1662230 | 957642 | 158
KH | 2008 | 38513084 | 39260046 | -2
LR | 2008 | 15930636 | 16673226 | -5
(7 rows)
*/
/*
from_di_id = 'GR'
(0 rows)
*/
/*
from_di_id = 'ibrd'
(0 rows)
*/
/*
from_di_id = 'ida'
id | year | value | value | % error
----+------+------------+------------+---------
BI | 2009 | 695922139 | 735966220 | -6
BO | 2007 | 15194796 | 14922461 | 2
CD | 2009 | 453311057 | 460581197 | -2
CF | 2009 | 413264229 | 429634886 | -4
CG | 2009 | 14562001 | 15076614 | -4
CI | 2009 | 199510812 | 236076866 | -18
CI | 2012 | 1545980500 | 1672124395 | -8
GN | 2012 | 818971766 | 1052241528 | -28
HT | 2009 | 462466434 | 523465076 | -13
RS | 2009 | 17412699 | 24257569 | -39
(10 rows)
*/
/*
from_di_id = 'idb-special-fund'
id | year | value | value | % error
-----------------------+------+-----------+-----------+---------
BO | 2010 | 102067815 | 173028614 | -70
CO | 2011 | 12115609 | 11308861 | 7
CR | 2011 | 2632492 | 2457415 | 7
EC | 2010 | 8162417 | 15083566 | -85
EC | 2011 | 10739101 | 10367296 | 3
GY | 2010 | 50514089 | 64865498 | -28
HN | 2010 | 114814997 | 174934733 | -52
JM | 2011 | 2805121 | 2370673 | 15
NI | 2010 | 114695035 | 157842138 | -38
north-central-america | 2011 | 48891381 | 45647371 | 7
PA | 2010 | 3249184 | 3331520 | -3
PY | 2010 | 8471350 | 24890935 | -194
SR | 2010 | 2272423 | 3175797 | -40
(13 rows)
*/
/*
from_di_id = 'IE'
id | year | value | value | % error
----+------+----------+--------+---------
SD | 2011 | 12148305 | 747823 | 94
(1 row)
*/
/*
from_di_id = 'ifad'
(0 rows)
*/
/*
from_di_id = 'imf-concessional-trust-fund'
(0 rows)
*/
/*
from_di_id = 'IS'
(0 rows)
*/
/*
from_di_id = 'islamic-dev-bank'
(0 rows)
*/
/*
from_di_id = 'IT'
id | year | value | value | % error
-----------------+------+----------+----------+---------
AF | 2011 | 55336277 | 51894929 | 6
AL | 2011 | 47078860 | 45727526 | 3
AM | 2011 | 571998 | 492801 | 14
AO | 2011 | 4706196 | 3094955 | 34
BA | 2011 | 5254501 | 4870271 | 7
BD | 2011 | 4993539 | 1891151 | 62
BF | 2011 | 7039307 | 4570152 | 35
BI | 2011 | 3566599 | 2510263 | 30
BJ | 2011 | 2015531 | 1129316 | 44
BO | 2011 | 11093770 | 10410721 | 6
BR | 2011 | 15477518 | 10204946 | 34
CF | 2011 | 844557 | 493842 | 42
CG | 2011 | 74479 | 39168 | 47
CI | 2011 | 2264201 | 1142592 | 50
CL | 2011 | 1074579 | 908803 | 15
CM | 2011 | 4337349 | 3655833 | 16
CN | 2011 | 5254509 | 3622291 | 31
CO | 2011 | 4190741 | 3623599 | 14
CR | 2011 | 46505 | 43869 | 6
CV | 2011 | 524760 | 501832 | 4
DO | 2011 | 2261061 | 1860442 | 18
EC | 2011 | 7828062 | 6377600 | 19
ER | 2011 | 2131279 | 1780562 | 16
ET | 2011 | 37109243 | 32818338 | 12
GE | 2011 | 115230 | 103502 | 10
GH | 2011 | 16529529 | 15260933 | 8
GM | 2011 | 532073 | 136566 | 74
GN | 2011 | 143833 | 130560 | 9
GT | 2011 | 7704642 | 5632179 | 27
GW | 2011 | 1063271 | 728868 | 31
HN | 2011 | 2633484 | 2505805 | 5
HT | 2011 | 5992921 | 2609684 | 56
ID | 2011 | 1165908 | 950277 | 18
IN | 2011 | 21122970 | 11617456 | 45
IQ | 2011 | 7530616 | 6265909 | 17
JM | 2011 | 5963 | 0 | 100
JO | 2011 | 4624734 | 4338168 | 6
KE | 2011 | 33060520 | 29544785 | 11
KH | 2011 | 4321773 | 1373711 | 68
KM | 2011 | 1312348 | 1218983 | 7
LA | 2011 | 549327 | 296912 | 46
LB | 2011 | 19911995 | 18975874 | 5
LR | 2011 | 753939 | 181968 | 76
MD | 2011 | 401171 | 348201 | 13
ME | 2011 | 390388 | 336537 | 14
MG | 2011 | 4821839 | 4520731 | 6
MK | 2011 | 1149620 | 1098537 | 4
ML | 2011 | 1774844 | 1664455 | 6
MM | 2011 | 4332199 | 3027627 | 30
MN | 2011 | 298526 | 113135 | 62
MR | 2011 | 2276085 | 2079777 | 9
MW | 2011 | 3707211 | 1447970 | 61
MX | 2011 | 1001155 | 916405 | 8
MZ | 2011 | 25136932 | 21968093 | 13
NA | 2011 | 649123 | 507912 | 22
NG | 2011 | 3039007 | 1158151 | 62
NI | 2011 | 2307509 | 1376673 | 40
NP | 2011 | 1883486 | 365581 | 81
PE | 2011 | 11664077 | 10166420 | 13
PH | 2011 | 4007566 | 3306511 | 17
PK | 2011 | 25447286 | 23751287 | 7
PS | 2011 | 12526314 | 10430218 | 17
PY | 2011 | 324610 | 316723 | 2
RW | 2011 | 1965280 | 948973 | 52
SD | 2011 | 17560998 | 16732249 | 5
SL | 2011 | 2176542 | 1094405 | 50
SN | 2011 | 8358953 | 6838333 | 18
SO | 2011 | 17575680 | 16791513 | 4
south-of-sahara | 2011 | 1152994 | 1012604 | 12
SS | 2011 | 1059065 | 165383 | 84
SV | 2011 | 5154178 | 3893926 | 24
SY | 2011 | 521636 | 494054 | 5
TD | 2011 | 1509915 | 1130869 | 25
TH | 2011 | 920564 | 759470 | 17
TJ | 2011 | 1081641 | 254995 | 76
TZ | 2011 | 8699484 | 6313609 | 27
UG | 2011 | 12236901 | 8723871 | 29
UY | 2011 | 2308232 | 2191898 | 5
VE | 2011 | 1285228 | 1180650 | 8
VN | 2011 | 6025068 | 3734210 | 38
XK | 2011 | 3315734 | 2863694 | 14
ZA | 2011 | 9752110 | 8480585 | 13
ZM | 2011 | 2058732 | 778943 | 62
ZW | 2011 | 3080259 | 1101324 | 64
(84 rows)
*/
/*
from_di_id = 'JP'
id | year | value | value | % error
----+------+------------+------------+---------
AR | 2011 | 10062489 | 10794488 | -7
BA | 2011 | 3167099 | 3417546 | -8
BD | 2011 | 199611992 | 209802505 | -5
BR | 2011 | 271504815 | 276029620 | -2
BW | 2011 | 5513569 | 5692793 | -3
BY | 2011 | 76227 | 453932 | -496
CI | 2011 | 8087297 | 8242337 | -2
CL | 2011 | 4854457 | 5383706 | -11
CN | 2011 | 852229949 | 954908139 | -12
CO | 2011 | 11333988 | 12344776 | -9
CU | 2011 | 4680845 | 4956906 | -6
DM | 2011 | 3368588 | 3443334 | -2
DO | 2011 | 11073114 | 11273132 | -2
DZ | 2011 | 1413977 | 1741888 | -23
EC | 2011 | 15113138 | 15341567 | -2
EG | 2011 | 114136718 | 116213277 | -2
FJ | 2011 | 20082704 | 20418422 | -2
GE | 2011 | 7895175 | 8144969 | -3
GN | 2011 | 1963094 | 2163721 | -10
GY | 2011 | 844897 | 871883 | -3
HN | 2011 | 10652566 | 10878173 | -2
ID | 2011 | 1003743066 | 1020583879 | -2
IQ | 2008 | 247388678 | 2358286820 | -853
IR | 2011 | 15593362 | 17906931 | -15
JM | 2011 | 2487712 | 2663441 | -7
JO | 2011 | 27431867 | 27957866 | -2
KG | 2011 | 29969383 | 30680169 | -2
KH | 2011 | 131916491 | 135169995 | -2
KZ | 2011 | 18814994 | 19587910 | -4
LA | 2011 | 51562920 | 54543669 | -6
LB | 2011 | 15362511 | 15688478 | -2
LY | 2011 | 8103059 | 8329328 | -3
MD | 2011 | 8023508 | 8200679 | -2
MG | 2011 | 10591662 | 11066317 | -4
MK | 2011 | 10213601 | 10412928 | -2
MM | 2011 | 42078358 | 46049332 | -9
MN | 2011 | 95481602 | 103023724 | -8
MR | 2011 | 9892302 | 10041819 | -2
MX | 2011 | 11889293 | 13558755 | -14
MY | 2011 | 190799388 | 197003953 | -3
NG | 2011 | 38180024 | 38804400 | -2
NP | 2011 | 74273053 | 78092027 | -5
PY | 2011 | 21817387 | 22201531 | -2
RS | 2009 | 4168946 | 15583994 | -274
RS | 2011 | 9347096 | 9874318 | -6
SV | 2011 | 14770963 | 15071322 | -2
SY | 2011 | 20735130 | 21447850 | -3
TH | 2011 | 291092611 | 307306281 | -6
TM | 2011 | 976227 | 1255024 | -29
UG | 2011 | 56554647 | 57422681 | -2
UY | 2011 | 2905204 | 2957115 | -2
UZ | 2011 | 29124632 | 30952000 | -6
VE | 2011 | 3394335 | 4022493 | -19
XK | 2011 | 1861427 | 1911251 | -3
YE | 2011 | 14509507 | 14737926 | -2
ZA | 2011 | 9195464 | 9472258 | -3
(56 rows)
*/
/*
from_di_id = 'KR'
id | year | value | value | % error
----+------+---------+---------+---------
MM | 2011 | 9704360 | 7804865 | 20
TH | 2011 | 6419859 | 4442183 | 31
(2 rows)
*/
/*
from_di_id = 'KW'
(0 rows)
*/
/*
from_di_id = 'LU'
(290 rows)
*/
/*
from_di_id = 'NL'
id | year | dh_value | ddw_value | % error
----+------+-----------+-----------+---------
AF | 2010 | 104951417 | 113160486 | -8
ET | 2010 | 61851366 | 53377953 | 14
(2 rows)
*/
/*
from_di_id = 'NO'
id | year | dh_value | ddw_value| % error
---------------+------+-----------+----------+---------
asia | 2011 | 22902238 | 22484884 | 2
asia | 2012 | 27668605 | 26998594 | 2
BR | 2010 | 279328864 | 42671351 | 85
BR | 2011 | 248024008 | 71880379 | 71
central-asia | 2009 | 4013604 | 3769187 | 6
KZ | 2009 | 3920364 | 3851194 | 2
south-america | 2009 | 8707305 | 8440012 | 3
UZ | 2009 | 382161 | 357553 | 6
ZW | 2008 | 22629216 | 23374710 | -3
(9 rows)
*/
/*
from_di_id = 'nordic-dev-fund'
(0 rows)
*/
/*
from_di_id = 'NZ'
id | year | dh_value | ddw_value | % error
----+------+----------+-----------+---------
BW | 2009 | 53 | 52 | 2
(1 row)
*/
/*
from_di_id = 'ofid'
(0 rows)
*/
/*
from_di_id = 'osce'
(0 rows)
*/
/*
from_di_id = 'PL'
id | year | dh_value| ddw_value| % error
----+------+----------+----------+---------
AF | 2013 | 3394478 | 3295978 | 3
AM | 2013 | 526069 | 543087 | -3
BI | 2013 | 159933 | 148651 | 7
BO | 2013 | 88711 | 98421 | -11
BY | 2013 | 19316600 | 20290704 | -5
CD | 2013 | 23312 | 46162 | -98
CG | 2013 | 57308 | 21892 | 62
EG | 2013 | 49109 | 53748 | -9
GE | 2013 | 3226313 | 3310946 | -3
GH | 2013 | 60343 | 45080 | 25
GT | 2013 | 13344 | 12951 | 3
ID | 2013 | 36600 | 24351 | 33
JO | 2013 | 220121 | 30104 | 86
KG | 2013 | 112690 | 281944 | -150
LA | 2013 | 9617 | 24853 | -158
LB | 2013 | 1395431 | 33653 | 98
LY | 2013 | 178195 | 148522 | 17
MD | 2013 | 2047556 | 2158991 | -5
MG | 2013 | 42067 | 6567 | 84
MM | 2013 | 145429 | 178408 | -23
MN | 2013 | 724248 | 749215 | -3
PE | 2013 | 79639 | 55400 | 30
RW | 2013 | 45525 | 133190 | -193
SN | 2013 | 27989 | 27562 | 2
SY | 2013 | 601696 | 2419214 | -302
TH | 2013 | 50568 | 2736 | 95
TJ | 2013 | 459158 | 623764 | -36
TZ | 2013 | 846761 | 590270 | 30
UA | 2013 | 14775154 | 14383245 | 3
ZA | 2013 | 122173 | 49285 | 60
ZM | 2013 | 56063 | 128331 | -129
(31 rows)
*/
/*
from_di_id = 'PT'
id | year | dh_value|ddw_value| % error
--------+------+---------+---------+---------
africa | 2009 | 398257 | 601346 | -51
PS | 2009 | 1018906 | 920732 | 10
UA | 2013 | 28 | 27 | 4
(3 rows)
*/
/*
from_di_id = 'SE'
id | year | dh_value| ddw_value | % error
-----------------+------+-----------+-----------+---------
PS | 2012 | 63854085 | 66195580 | -4
south-of-sahara | 2012 | 124677005 | 126715723 | -2
UA | 2011 | 40650765 | 39364893 | 3
(3 rows)
*/
/*
from_di_id = 'SI'
(0 rows)
*/
/*
from_di_id = 'SK'
(0 rows)
*/
/*
from_di_id = 'unaids'
(0 rows)
*/
/*
from_di_id = 'undp'
(127 rows)
*/
/*
from_di_id = 'unece'
id | year | dh_value | ddw_value | % error
--------------+------+----------+------------+---------
central-asia | 2009 | 23701 | 154218 | -551
(1 row)
*/
/*
from_di_id = 'unfpa'
(174 rows)
*/
/*
from_di_id = 'unhcr'
(0 rows)
*/
/*
from_di_id = 'unicef'
id | year | dh_value| ddw_value| % error
-------------+------+----------+----------+---------
AL | 2007 | 1508068 | 1554980 | -3
asia | 2008 | 598727 | 624464 | -4
BJ | 2008 | 5503703 | 5826603 | -6
BZ | 2008 | 585018 | 606920 | -4
BZ | 2009 | 765318 | 802678 | -5
CD | 2009 | 58050041 | 59760537 | -3
EC | 2008 | 1103005 | 1366756 | -24
ER | 2009 | 2826946 | 2869429 | -2
ET | 2009 | 37675536 | 43444360 | -15
GE | 2009 | 786500 | 840062 | -7
GH | 2007 | 8203713 | 8431310 | -3
GQ | 2008 | 715837 | 747266 | -4
GW | 2006 | 2362682 | 2414832 | -2
GY | 2006 | 921298 | 984446 | -7
HN | 2009 | 684463 | 811917 | -19
HT | 2009 | 2478758 | 3038606 | -23
IQ | 2008 | 2106849 | 2169646 | -3
IQ | 2009 | 2074936 | 2135083 | -3
KE | 2008 | 15378863 | 15617817 | -2
KM | 2006 | 932185 | 985620 | -6
KP | 2008 | 2294154 | 3114265 | -36
MG | 2006 | 6990554 | 7379470 | -6
middle-east | 2007 | 976856 | 992058 | -2
NA | 2009 | 1176929 | 1207802 | -3
NG | 2009 | 51211859 | 58966078 | -15
NI | 2006 | 1474419 | 1525494 | -3
RS | 2006 | 2373606 | 2415085 | -2
SO | 2009 | 10483530 | 11396344 | -9
south-asia | 2008 | 302928 | 316677 | -5
ST | 2009 | 717810 | 728645 | -2
west-indies | 2008 | 2996281 | 3059791 | -2
YE | 2009 | 9624302 | 9844675 | -2
(32 rows)
*/
/*
from_di_id = 'unpbf'
(0 rows)
*/
/*
from_di_id = 'unrwa'
(0 rows)
*/
/*
from_di_id = 'US'
(340 rows)
*/
/*
from_di_id = 'wfp'
id | year | dh_value|ddw_value| % error
----+------+---------+---------+---------
BJ | 2009 | 2222262 | 2293812 | -3
CD | 2008 | 67341 | 613968 | -812
CU | 2009 | 270064 | 278975 | -3
EC | 2008 | 34203 | 100615 | -194
HT | 2009 | 285990 | 600116 | -110
ID | 2009 | 2869761 | 3433518 | -20
LK | 2009 | 3020493 | 3696064 | -22
LS | 2009 | 1834306 | 1900252 | -4
LY | 2008 | -5238 | 0 | 100
NI | 2008 | 255050 | 268172 | -5
NI | 2009 | 471076 | 523033 | -11
PE | 2009 | 425259 | 432765 | -2
SV | 2008 | 116269 | 118703 | -2
TL | 2009 | 650570 | 802228 | -23
(14 rows)
*/
/*
from_di_id = 'who'
id | year | dh_value|ddw_value| % error
----+------+---------+---------+---------
CN | 2013 | 6272422 | 6031747 | 4
ET | 2013 | 5750788 | 3357616 | 42
ID | 2013 | 5587747 | 3779085 | 32
IN | 2013 | 8151266 | 6829400 | 16
JO | 2013 | 739641 | 690566 | 7
KH | 2013 | 2627609 | 2066615 | 21
MA | 2013 | 1078032 | 1022475 | 5
MN | 2013 | 1736355 | 1244852 | 28
PH | 2013 | 2176069 | 1392590 | 36
RW | 2013 | 2105093 | 1573097 | 25
TH | 2013 | 2705859 | 2601914 | 4
UZ | 2013 | 376082 | 218491 | 42
VN | 2013 | 5142462 | 3875509 | 25
ZA | 2013 | 2873039 | 2524476 | 12
(14 rows)
*/
Dead issue.
@xriss, this is a separate issue for the data check of the individual donor ODA data series in DDW. I'll use it to OK these:
@xriss, these do need to be replaced with DW data. The data for these is in fact.oda_donor_2012. To get at the individual donor data, we need to filer on the di_id for the relevant years so: