LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processing library datatrove and LLM training library nanotron.
if the max_length is passed from model_args, it gets parsed as str, and causes error for the lineif max_length is None and len(ids) > self.model_max_length and verbose:, i.e. TypeError: '>' not supported between instances of 'int' and 'str'. This pr will fix the issue.
if the max_length is passed from model_args, it gets parsed as str, and causes error for the line
if max_length is None and len(ids) > self.model_max_length and verbose:
, i.e.TypeError: '>' not supported between instances of 'int' and 'str'
. This pr will fix the issue.