byu-dml / d3m-dynamic-neural-architecture

1 stars 1 forks source link

NDCG Bug #178

Closed bjschoenfeld closed 5 years ago

bjschoenfeld commented 5 years ago

NDCG is computed in the rank problem incorrectly. The predictions and targets are need to be aligned before being passed to the metric computer. merged_data should be used to compute the ndcg.

https://github.com/byu-dml/d3m-dynamic-neural-architecture/blob/c881b49c0de7d46c3e7a1786230c4ba41175ded2/dna/problems.py#L267-L274