search

Stability-AI / lm-evaluation-harness

A framework for few-shot evaluation of autoregressive language models.
MIT License
145 stars 47 forks source link

Set pad_token_id for hugging face model to suppress warning #82

Open kishida opened 1 year ago

kishida commented 1 year ago

Set pad_token_id for hugging face model

mkshing commented 1 year ago

@kishida Hi sorry for the late reply. That looks good to me but I am wondering why you want to fix like this. Do you get some errors? IIRC, as default, it will be set to the pre-defined pad token id in the model config. So, if the model config is correct, it doesn't hurt.