[ip] Correlations as normalized conditional entropy

HoloClean / holoclean

A Machine Learning System for Data Enrichment.

http://www.holoclean.io

Apache License 2.0

515 stars 131 forks source link

[ip] Correlations as normalized conditional entropy #66

Closed minafarid closed 5 years ago

minafarid commented 5 years ago

[Do not merge yet]

Implemented normalized conditional entropy as a measure of correlation.
Modified some learning parameters in example

Current performance:

Precision = 1.00, Recall = 0.67, Repairing Recall = 0.79, 
F1 = 0.80, Repairing F1 = 0.88, 
Detected Errors = 435, Total Errors = 509, 
Correct Repairs = 342, Total Repairs = 342, Total Repairs (Grdth present) = 342