hi! i install this transformers but found a error

zsc / llama_infer

Inference script for Meta's LLaMA models using Hugging Face wrapper

MIT License

110 stars 5 forks source link

Open aleien95 opened 1 year ago

aleien95 commented 1 year ago

"Tokenizer class {tokenizer_class_candidate} does not exist or is not currently imported.

how should i do? please!

zsc commented 1 year ago

There is still ongoing confusion between LLaMATokenizer and LlamaTokenizer. When you load a model and there are complaints about missing LLaMATokenizer, you may have to temporarily use https://github.com/mbehm/transformers/ . Otherwise, you can go for the latest head in https://github.com/huggingface/transformers/ now.