[Data] Annotate user responses (creating "user" test set)

DFKI-NLP / InterroLang

InterroLang: Exploring NLP Models and Datasets through Dialogue-based Explanations [EMNLP 2023 Findings]

5 stars 1 forks source link

[Data] Annotate user responses (creating "user" test set) #106

Closed nfelnlp closed 1 year ago

nfelnlp commented 1 year ago

We will need to annotate the feedback files manually. In particular, based on the original user questions, we should annotate the gold parse. This lets us compare them with the actual parses and compute accuracies in #53

[x] Repo group
[x] BoolQ (Hosted Interface group)
[x] DailyDialog (Hosted Interface group)
[x] OLID (Hosted Interface group)