search

sileod / tasksource

Datasets collection and preprocessings framework for NLP extreme multitask learning
Apache License 2.0
138 stars 7 forks source link

Using tasksource for question answering datasets #9

Open Deehan1866 opened 6 days ago

Deehan1866 commented 6 days ago

Hi, I am really new to the AI field. I wanted to train electra-large model on several question answering tasks. Can I do that using tasksource? I am really confused about which tasks is applicable to tasksource. Does it only support the 600+tasks it includes? What if I want to train on some other dataset? There are no available blogs or resources on tasksource.

Please, help.

sileod commented 5 days ago

Hi, are you talking about Squad-like extractive question answering ? https://huggingface.co/datasets/rajpurkar/squad Or classification or multiple choice QA ? Tasksource only handles the latter currently.

To train on other datasets, you can look at the examples and implement your own preprocessings