question about evaluation dependency based srl

UniversalPropositions / UP-1.0

Universal Proposition Banks for Multilingual Semantic Role Labeling

Other

99 stars 18 forks source link

question about evaluation dependency based srl #9

Closed edchengg closed 4 years ago

edchengg commented 4 years ago

Hi, What should be a proper evaluation metric for dependency-based srl? For example, F1-measure but what kind of criteria should I consider (role label, position)? Thanks

yunyaoli commented 4 years ago

@edchengg You can refer to the CoNLL-2009 Shared Task Scorer for such details: http://ufal.mff.cuni.cz/conll2009-st/scorer.html