stsievert / salmon

A tool to collect triplet queries
https://docs.stsievert.com/salmon/
BSD 3-Clause "New" or "Revised" License
9 stars 2 forks source link

Provide gold standard for comparisons #64

Closed stsievert closed 3 years ago

stsievert commented 4 years ago

This is especially relevant for the Zappos shoe dataset. Look at the agreement by different users. I wouldn't expect the accuracy to be any higher.

stsievert commented 3 years ago

This issue belongs in https://github.com/stsievert/salmon-experiments (but it's closed anyways).