Check the imputation rate under different settings

mkao006 / sws_imputation

Repository for implementing imputation for the Statistical Working System

0 stars 0 forks source link

Check the imputation rate under different settings #20

Closed mkao006 closed 11 years ago

mkao006 commented 11 years ago

Validation

No validation
Old Validation (Moving average plus minus 40%)
New validation (Validate change and absolute value with quantile)

Methods

Incorporate linear interpolation

mkao006 commented 11 years ago

No Linear interpolation

No validation - Area (70.23%), Production (91.78%)
Old validation - Area (66.21%), Production (88.01%)
New validation (Only quantile on change ratio) - Area (65.05%), Production (86.68%)

mkao006 commented 11 years ago

Linear interpolation imputation

Area (11.42% to 3.29%)
Production (6.62% to 0.26%)

With Linear interpolation

No validation - Area (11.21%), Production (71.38%)
Old validation - Area (11.19%), Production (71.38%)
New validation - Area (10.58%), Production (66.9%)

mkao006 commented 11 years ago

The above statistics are computed based on the dataset with countries having complete region sub-regional profile, items with commodity group and omitting milk, other_meat and poultry meat. A total of 110,712 records.