Annotation and parsers for "Evaluation Metrics for Machine Reading Comprehension: Prerequisite Skills and Readability" (Sugawara et al., ACL 2017)
In the annotation
directory.
skills
indicate skill numbers (multiple labeling).
skill_count
sents_indices
str(context).split()
in python.id
original_id
parse
directory for naming.Please refer to the following spredsheets for the annotation procedure, the skill definitions, and toy examples.
https://docs.google.com/spreadsheets/d/1B-t0309obrbNuwhWeDAYDcTdJv8owobUHLY07KXez54/edit?usp=sharing