Token indices sequence length is longer than the specified maximum sequence length for this model

RuolinZheng08 / twewy-discord-chatbot

Discord AI Chatbot using DialoGPT, trained on the game transcript of The World Ends With You

https://www.freecodecamp.org/news/discord-ai-chatbot/

MIT License

316 stars 157 forks source link

Token indices sequence length is longer than the specified maximum sequence length for this model #25

Open crybabylin opened 1 year ago

crybabylin commented 1 year ago

Token indices sequence length is longer than the specified maximum sequence length for this model (18166 > 1024). Running this sequence through the model will result in indexing errors

how do i resolve this?