linqs / psl

The PSL software from the University of Maryland and the University of California Santa Cruz
http://psl.linqs.org
Apache License 2.0
298 stars 100 forks source link

Implement Cost Curve Evaluator #242

Open eriq-augustine opened 5 years ago

eriq-augustine commented 5 years ago

Issue by eriq-augustine Monday Feb 11, 2019 at 08:02 GMT Originally opened as https://github.com/eriq-augustine/psl/issues/195


Implement cost curves in an evaluator, ala: https://link.springer.com/content/pdf/10.1007/s10994-006-8199-5.pdf

Implementing the curve itself should not be too difficult (probably with a discrete or modular backend), but the area under the curve may be hard. In a talk, Rob Holte mentioned that they convert the cost curve to a ROC curve and compute the area under that (these curves have line-point duality).