IndoNLP / nusa-crowd

A collaborative project to collect datasets in Indonesian languages.

Apache License 2.0

262 stars 62 forks source link

Create dataset loader for UKARA 1.0 Challenge #128

Open SamuelCahyawijaya opened 2 years ago

SamuelCahyawijaya commented 2 years ago

https://indonlp.github.io/nusa-catalogue/card.html?ukara_challenge

aliakbars commented 2 years ago

self-assign

aliakbars commented 2 years ago

In our paper, we see this problem as a classification task. However, it could be seen as short-answer grading as well though we need to extract the info from the stimulus file manually if we want to get the question. Which one would be more suitable in this case? @SamuelCahyawijaya @afaji @gentaiscool?

aliakbars commented 2 years ago

@holylovenia What do you think?

bryanwilie commented 2 years ago

Tagging @holylovenia again since maybe she missed this one

holylovenia commented 2 years ago

Hi @aliakbars! Sorry for the late reply, I missed it last time. Please proceed using the Tasks.SHORT_ANSWER_GRADING and pairs_score schema. Thanks for waiting!

PS: Thanks for the kind reminder, @bryanwilie.