AMontgomerie / question_generator

An NLP system for generating reading comprehension questions
MIT License
281 stars 72 forks source link

Generating Questions for Arabic Input #10

Open SyedShahzaib790 opened 3 years ago

SyedShahzaib790 commented 3 years ago

Hi there,

I was wondering, is there a way to use this in the Arabic language? I am trying and looking for something like this for Arabic. I want to give input context/comprehension from a book and expect this to create question-answer pairs for that.

Any guidance would be really appreciated. Thanks

AMontgomerie commented 2 years ago

Hi, sorry for the slow reponse.

I haven't tried doing this with any languages other than English, but it could work in theory as long as you have the training data for it. I'd recommend trying mt5 or another multilingual pretrained checkpoint instead of t5-base which I used. Then you could just replace the datasets I used with your own datasets once you've got them into the same format.