search

concepticon / norare-data

Cross-Linguistic Norms, Ratings, and Relations for Words and Concepts
Other
15 stars 1 forks source link

ratings per individual user #166

Open LinguList opened 2 years ago

LinguList commented 2 years ago

We have situations like the list by Jackson et al. 2019 where we have also individual non-aggregated ratings of anonymized users. The question we should ask ourselves is: do we want to be able to handle them as well? And if so, how? We could of course list the original data in some cleaned TSV, and do the aggregation automatically. Or we could have a large TSV with many columns, which reflect individual users' ratings...Or we could add a JSON file to the repository that contains the user ratings and could be loaded via norare's access to the data path.

AnnikaTjuka commented 2 years ago

Good point. I can only recall one other study that included non-aggregate ratings in addition to aggregate ratings. So a ratio of 1-2 for approx. 100 different data sets. If this is not going to become more common, it is probably best to use the data path.

LinguList commented 2 years ago

We could in fact render this first in JSON and then present it as a how-to (how to aggregate data and compare whatever) in a blog post. Maybe a good job for me, to also make acquaintance with NoRaRe again (we need to think of when we want to publish the Concepticon 3.0 / NoRaRE 1.0 data).

AnnikaTjuka commented 2 years ago

Sounds good! I think we talked about releasing Concepticon 3.0 / NoRaRe 1.0 in April.

LinguList commented 2 years ago

That may in fact be feasible! We would only need to find a solution to work on norare and concepticon in the same repository (maybe with git subdirectories). Let us try to schedule a meeting with @xrotwang early april on this.