a decoder-only architecture is being used.

RuolinZheng08 / twewy-discord-chatbot

Discord AI Chatbot using DialoGPT, trained on the game transcript of The World Ends With You

https://www.freecodecamp.org/news/discord-ai-chatbot/

MIT License

317 stars 156 forks source link

a decoder-only architecture is being used. #23

Open 12194916 opened 1 year ago

12194916 commented 1 year ago

A decoder-only architecture is being used, but right-padding was detected! For correct generation results, please set padding_side='left' when initializing the tokenizer.

I set the padding side to left before training and after, but it did not change

DiwakarBasnet commented 1 year ago

@12194916 I had similar warning, degrading transformer version to 4.22.2 worked for me.