load model error - Githubissues

paperswithcode / galai

Model API for GALACTICA

Apache License 2.0

2.67k stars 275 forks source link

load model error #63

Open wushixian opened 1 year ago

wushixian commented 1 year ago

when I call the huge model with "model = gal.load_model("huge")", the execption showed "Exception: Model "facebook/galactica-120b" on the Hub doesn't have a tokenizer", I clear the cache directory in .cache/huggingface/hub/, run the script again, the error still existed, what's the problem?

mkardas commented 1 year ago

What are your galai and transformers versions? What do you get for:

from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("facebook/galactica-120b")