search

asahi417 / lm-question-generation

Multilingual/multidomain question generation datasets, models, and python library for question generation.
https://www.autoqg.net
MIT License
313 stars 30 forks source link

Generate questions for larger paragraphs. #18

Closed kimianoorbakhsh closed 10 months ago

kimianoorbakhsh commented 11 months ago

Hello,

I was wondering is it possible to use lmqg to generate questions for longer paragraphs? I get this error when I run on longer paragraphs: ExceedMaxLengthError: Input sentence exceeds max length of 512.

Thanks!

asahi417 commented 10 months ago

Hi, the max sequence length is a quite hard constrain, and the only quick solution would be to split the input document into smaller chunks and feed them to the model independently.