cosmir / openmic-2018

Tools and tutorials for the OpenMIC-2018 dataset.
MIT License
91 stars 10 forks source link

Raw label parser #20

Closed ejhumphrey closed 6 years ago

ejhumphrey commented 6 years ago

tooling to convert CSV results from CrowdFlower into a sparse label format. Introduces num_responses into the table, and bounds relevance values on [0, 1]. Histogram confirms that there's no relevance scores in the middle, e.g. no relevance values in (0.25, 0.75):

image

bmcfee commented 6 years ago

Histogram confirms that there's no relevance scores in the middle, e.g. no relevance values in (0.25, 0.75):

Does it? I see some height down there. Can you plot on a log y axis to verify?

ejhumphrey commented 6 years ago

I checked the values directly, I'm confident there's nothing there

image

coveralls commented 6 years ago

Pull Request Test Coverage Report for Build 12


Totals Coverage Status
Change from base Build 6: 0.0%
Covered Lines: 222
Relevant Lines: 236

💛 - Coveralls
coveralls commented 6 years ago

Pull Request Test Coverage Report for Build 12


Totals Coverage Status
Change from base Build 6: 0.0%
Covered Lines: 222
Relevant Lines: 236

💛 - Coveralls