search

microsoft / LMOps

General technology for enabling AI capabilities w/ LLMs and MLLMs
https://aka.ms/GeneralAI
MIT License
3.39k stars 253 forks source link

forward() got an unexpected keyword argument `token_type_ids` #208

Closed knightron0 closed 2 months ago

knightron0 commented 2 months ago

I'm trying to run MiniLLM with Llama-2-7b as the teacher model. Not sure why this error is persisting -- my arguments passed into forward() in the PPOModel class do not contain token_type_id and I have included return_token_type_ids=False with the AutoTokenizer class.

All related issues I found online told me to upgrade the transformers version, but that doesn't seem to work because ParallelLlamaForCausalLM is implemented locally.

knightron0 commented 2 months ago

Nevermind, I just realized the tokenizer mismatch won't work :P