add development set for parsing

DFKI-NLP / InterroLang

InterroLang: Exploring NLP Models and Datasets through Dialogue-based Explanations [EMNLP 2023 Findings]

5 stars 1 forks source link

add development set for parsing #85

Closed tanikina closed 1 year ago

qiaw99 commented 1 year ago

I know these files are reserved for developement. Still I run experiments/generate_parsing_results.py to test them and get accuracies as below. @nfelnlp

Nearest Neighbor:

Name	Accuracy
BoolQ	34.69%
OLID	33.67%
Daily Dialog	36.73%

Adapter:

Exact Match Accuracy: 0.716
Intent Accuracy: 0.817
Micro F1: 0.832
Macro F1: 0.789