search

underlines / awesome-ml

Curated list of useful LLM / Analytics / Datascience resources
MIT License
1.86k stars 156 forks source link

Potentially invalid classnames? #3

Closed IngwiePhoenix closed 1 year ago

IngwiePhoenix commented 1 year ago

Hello!

I am not very much a python guy, but since my recent experiments with AI, I have gotten more used to how it works.

After following your LLaMa tutorial, I kept getting the error that the LLaMATokenizer was not found. After a bit of investigating, I found this:

image

So, perhaps the classnames are invalid? Anything I can do here?

Thanks and kind regards, Ingwie

underlines commented 1 year ago

did you install transformers original or the pip install git+https://github.com/zphang/transformers.git@llama_push after uninstalling with pip uninstall transfromers ?

underlines commented 1 year ago

Tokenizer has been renamed back 2 months ago. Issue should be solved with newer models and newer codebases.