Request for Assistance Regarding Attention Mask and Pad Token ID Warning Affecting Model Performance

[AlexandraDobrescu]

I encountered the following warning while running the model: "The attention mask and the pad token ID were not set. As a result, you might experience unexpected behavior. To ensure reliable results, please provide an attention_mask with your input. The pad_token_id has been set to eos_token_id: 151643 for open-end generation." I suspect this may be impacting the model's performance. Could you offer guidance on how to address this issue? Any assistance would be greatly appreciated.

[TaoSeekAI]

Same issue Any ideas ？

[tairenchen]

Same problem, any solutions?

[LifeRainSunshine]

一样的问题 求解决

[450711420]

same problem please share the solution if u guys solve this already thanks :)

[Ucas-HaoranWei]

I think it is because of the tokenizer version. My tokenizer version is 0.15.2.

[KlausFan]

same problem