nclskfm / square-core

SQuARE: Software for question answering research.

https://square.ukp-lab.de

2 stars 0 forks source link

Develop v2 #40

Closed nclskfm closed 1 year ago

nclskfm commented 1 year ago

What does this PR do?

For testing: Extractive-QA Skill: 62c1ae1b536b1bb18ff91ce3 Mocked dataset-metadatas: squad and quoref

Multiple-Choice Skill: 62c1ae19536b1bb18ff91cde Mocked dataset-metadata: commonsense_qa and cosmos_qa

Currently supported metrics: exact_match, squad, squad_v2

Before submitting / marking as 'ready to review'

[ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
[ ] Did you make sure to update the documentation with your changes?
[ ] Did you write any new necessary tests?

Who can review?