search

IINemo / lm-polygraph

MIT License
171 stars 23 forks source link

AutoModelForCausalLM max_length #163

Closed amayuelas closed 8 months ago

amayuelas commented 8 months ago

Is there a reason why the max length is equal to 256?

In models.py:

AutoModelForCausalLM.from_pretrained(max_length=256)

Aktsvigun commented 8 months ago

Hi @amayuelas ,

it was set to 256 since it was a sufficient length for all our experiments (WMT datasets, summarization datasets, CoQA, and bAbiQA). Thanks for mentioning, we'll make this parameter editable in a future version.