huggingface / lighteval

LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processing library datatrove and LLM training library nanotron.
MIT License
467 stars 54 forks source link

fix: max_length type in base_model.py #138

Closed csarron closed 3 months ago

csarron commented 3 months ago

if the max_length is passed from model_args, it gets parsed as str, and causes error for the line if max_length is None and len(ids) > self.model_max_length and verbose:, i.e. TypeError: '>' not supported between instances of 'int' and 'str'. This pr will fix the issue.

csarron commented 3 months ago

Hi @NathanHB @clefourrier, could you help take a look? Thanks.