A curated list of awesome datasets with human label variation (un-aggregated labels) in Natural Language Processing and Computer Vision, accompanying The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation (EMNLP 2022)
Not sure if this fits in here, but our 2020 article aimed at a phonetician/variationist audience seems in the same spirit---especially section 5, which argues that annotator disagreement is a feature, not a bug.
Not sure if this fits in here, but our 2020 article aimed at a phonetician/variationist audience seems in the same spirit---especially section 5, which argues that annotator disagreement is a feature, not a bug.